This work proposes RDDMPI, a conditional residual diffusion framework that operates directly in residual space, and reformulates probabilistic imputation as a baseline-residual decomposition, where a pretrained model captures the dominant signal and a diffusion process models the residual uncertainty.
Abstract
Multivariate time series imputation (MTSI) aims to recover missing values in temporal data composed of multiple interdependent variables. This problem is central to real-world applications such as healthcare monitoring, traffic networks, and energy systems. Recent diffusion-based approaches have shown strong potential for probabilistic imputation by learning to generate missing values through iterative denoising. However, most existing approaches perform diffusion directly in the original data space, requiring the denoising network to simultaneously capture global structure, temporal dynamics, and stochastic variability. This makes the generative task unnecessarily complex, especially when modern deterministic imputers can already provide accurate initial reconstructions. To address this limitation, we propose RDDMPI, a conditional residual diffusion framework that operates directly in residual space. Instead of modeling the full missing signal directly, we reformulate probabilistic imputation as a baseline-residual decomposition, where a pretrained model captures the dominant signal and a diffusion process models the residual uncertainty. To better exploit deterministic guidance, \model{} conditions the reverse denoising process on both the baseline-completed signal and its latent representation, while a reliability-aware conditioning mechanism adaptively controls the influence of baseline information during residual generation. This formulation simplifies the diffusion learning objective, enabling it to focus on structured correction terms rather than reconstructing the full signal. Experiments on multiple benchmark datasets demonstrate that RDDMPI consistently improves both reconstruction accuracy and uncertainty quantification.
The Masked Diffusion Time-series Imputation Model (MDTIM) is proposed, which leverages the training paradigm of masked diffusion model for imputation tasks, and introduces Stochastic Discretization, which maps continuous values to ordinal-aware tokens while preserving continuous dynamics.
Dongbin Kim, Seungyun Lee, Geonwoo Shin et al.· 0 citations
The Implicit Trajectory-Constrained Diffusion network (ITCD) is proposed, which employs a two-stage diffusion architecture to mitigate the distribution shift caused by padding, thereby enabling better adaptation to realistic data and achieving more consistent imputations.
ProCTI is proposed, a diffusion-imputation framework that augments local conditioning with retrieved global dataset-level priors through learned prototypes through a hybrid conditioning mechanism that integrates this global context with local signals during reverse diffusion, enabling more accurate reconstruction under...
Fariza Rashid, Duc Van Le, Rahat Masood et al.· 0 citations
Accurate probabilistic forecasting of multivariate time series (MTS) is crucial for many real-world applications but remains challenging due to the inherent complexity and non-stationarity of these signals. To address these challenges, we propose the Dynamic Decomposition Diffusion Model (D3M), which integrates advance...
Yu-Xin Li, Ao Wang, Xin-Yue Hu et al.· IEEE Transactions on Signal...· 0 citations
Reliable recovery of missing measurements is important for monitoring and analysis in energy time-series systems, where fine-grained measurements may contain sensitive temporal information. Diffusion models trained with differentially private stochastic gradient descent (DP-SGD) provide a promising framework for privac...
Hui-Zhen Huang, Yu Li, Tao Huang et al.· 0 citations
This work proposes the first pseudotime-conditioned diffusion-based imputation framework for time-series scRNA-seq data, consisting of two trajectory-aware models: pseudotime-conditioned conditional score-based diffusion imputation (P-CSDI) and pseudotime-conditioned hybrid-noise CSDI (PH-CSDI).
Graham Bishop, Min-Ho Ku, Daniel Lee et al.· Bioinformatics Advances· 0 citations
Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.