Skip to content

Hybrid Methods for Robust Tabular Data Imputation

Sep 2026 · 0 citations · 24 references
Computer Science

TL;DR

This work proposes two hybrid imputation methods, which combine nuclear-norm-based low-rank initialization using Singular Value Thresholding and SoftImpute, respectively, with a non-iterative Random Forest refinement, effectively exploits the low-rank structure of real-world tabular data and accommodates mixed-type variables.

Abstract

Missing data are a fundamental challenge in statistical analysis and machine learning, as the choice of imputation method substantially impacts downstream inference. In this work, we propose two hybrid imputation methods called NuclearForest and SoftForest, which combine nuclear-norm-based low-rank initialization using Singular Value Thresholding (SVT) and SoftImpute, respectively, with a non-iterative Random Forest refinement. For the SVT-based component, we further introduce an adaptive step-size rule, prove adaptive step-size bounds, and establish convergence for the corresponding zero-initialized iteration. The low-rank initialization provides a structured warm start that captures the global covariance patterns in the data, while the subsequent Random Forest step recovers residual nonlinear signals encoding local dependencies. We conduct an extensive benchmark on diverse datasets from different application domains, comparing the proposed methods with seven established imputation methods under the Missing Completely at Random (MCAR), Missing at Random (MAR), and Missing Not at Random (MNAR) mechanisms across varying missingness rates. Our results demonstrate that NuclearForest and SoftForest match or exceed the imputation fidelity of state-of-the-art iterative methods such as MissForest, while significantly reducing computational cost. In particular, they achieve speedups of approximately 5.81 times and 9.52 times over MissForest by replacing iterative cycles with a single refinement step. Our approach effectively exploits the low-rank structure of real-world tabular data and accommodates mixed-type variables, providing an efficient and robust solution for data imputation in bioinformatics, economics, and beyond.

View source

Similar papers

Open access Oct 2026

A layered stacking ensemble approach for missing data imputation

Missing data is a challenging issue in data analysis. Researchers often address the issue by simply removing incomplete cases from the analysis. However, this approach reduces the sample size and can undermine the accuracy of statistical estimates. Alternatively, imputation techniques can be used to replace missing val...

Muhammad Asif, Klairung Samart · 0 citations
Open access Sep 2026

Evaluating the Cyclical Hybrid Imputation Technique (CHIT) under MCAR, MAR, and MNAR missing data mechanisms: Evidence from health datasets

Choosing an appropriate imputation strategy for clinical datasets requires understanding which missing data mechanism is operative, yet most imputation benchmarks conflate performance across mechanisms. The present work addresses this gap by conducting the first mechanism-stratified comparison of three imputation appro...

Kurban Kotan, Serdar Kırışoğlu · 0 citations
Preprint Sep 2026

Quasi-randomization-based inference for multivariate Mann-Whitney effects under random missingness

Marginal Mann-Whitney effects are widely used across various fields of research, and extensions of this estimand have been developed in many directions in statistical methodology. In this paper, we focus on an extensions for repeated measurements and factorial designs subject to randomly missing data. In a previous wor...

Dennis Dobler, Jörg-Tobias Kuhn, L. Amro et al. · 0 citations
#machine learning Preprint Oct 2026

Assumption-lean logistic regression with missing covariates

A stochastic approximation method that is based on $Z-estimation with a novel monotone operator is designed, and it is established that this algorithm is computationally efficient and achieves provable signal recovery at parametric rates under the hypothesis that covariates are missing completely at random.

Jyotishka Ray Choudhury, K. A. Verchand, R. Samworth et al. · 0 citations
Review Open access Aug 2026

Bayesian model comparison for random effects probit models with missing covariates

For model comparison in random effects probit models with incompletely observed covariates, this paper develops a Bayesian data-augmentation workflow in which latent Gaussian responses, random effects, and missing covariate values are updated within a common augmented sampling scheme. Because specifying a fully param...

Michael Bergrab · 0 citations
Open access Oct 2026

Cluster-aware imputation: a hybrid XGBoost-based model for missing data

The fast growth of high-dimensional datasets in computational biology, industrial IoT, and socio-economic research has made the issue of missing data more challenging. This common problem reduces statistical power and introduces systematic bias in later machine learning tasks. Traditional methods, such as listwise dele...

Mahmoud M. Ismail, M. Emad, Mai Mohamed · 0 citations

Related blog posts

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.