Aug 2026· Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2· 0 citations· 45 references
TL;DR
Low-Rank Prior-Induced Consistency Flow Matching (LOFT) is proposed for efficient and effective distribution modeling under highly sparse data, and introduces an uncertainty-aware rectification mechanism to enable efficient inference by linearizing generative trajectories.
Abstract
Generative models like diffusion and flow matching excel in traffic imputation but suffer from high inference latency, as the learned vector fields typically induce curved generative trajectories requiring multi-step numerical integration. Furthermore, learning the transformation from non-informative priors introduces redundant computational overhead. To address these issues, we propose Low-Rank Prior-Induced Consistency Flow Matching (LOFT) for efficient and effective distribution modeling under highly sparse data. First, we construct a low-rank prior from sparse observations to recover inherent spatiotemporal correlations. Initializing the flow with this informative prior reduces the mapping complexity, allowing the model to focus on fine-grained variations. Second, to enable efficient inference by linearizing generative trajectories, we introduce an uncertainty-aware rectification mechanism. This mechanism resolves the gradient conflict between improving accuracy and trajectory linearization by dynamically arbitrating the optimization trade-off based on the training progress and data uncertainty. Experimental results demonstrate that LOFT surpasses state-of-the-art baselines using an NFE (Number of Function Evaluations) of 2, whereas competing methods typically require 20 to 50 NFE, achieving over a 10× improvement in inference efficiency. The code is available at https://github.com/maoxiaowei97/LOFT.
Flow-matching diffusion models have recently emerged as a strong paradigm for high-fidelity visual generation. However, their prohibitively high fine-tuning cost limits scalability to downstream tasks. While Low-Rank Adaptation (LoRA) combined with spectral initialization has demonstrated accelerated convergence and im...
Jian-Yang Gu, Zheng Fang, Li-Chuan Xiang et al.· 0 citations
Generative modeling has shown strong promise for multivariate time mseries (MTS) forecasting, especially scale to high-dimensional settings. Diffusion-based methods achieve competitive performance but typically require many sampling steps at inference. VAE-based non-iterative forecasting frameworks have therefore emerg...
Shi-Bo Feng, Wan-Jin Feng, Yang Qiu et al.· 0 citations
This work introduces a novel framework, Gaussian Bridge Consistency (GBC), to address challenges of semi-supervised learning by constructing semantic interpolation paths between unlabeled samples and high-quality class anchors, and proposes BridgeMix, a confidence-aware feature mixing strategy that interpolates both sa...
Hong-Yang He, Xin-Yuan Song, Yan Zhong et al.· 1 citation
The decomposition provides a theoretical basis for adapting likelihood-based LLM methods to flow matching, while distinguishing exact substitutions from controlled surrogates, while distinguishing exact substitutions from controlled surrogates.
This work reformulates the transition-level log-likelihood in Flow-GRPO into a token-wise representation natively aligned with DiT patch architectures, constructing spatially fine-grained importance sampling ratios and introduces a continuous spatial credit map derived from reward gradients.
Yun-Kai Yang, Yudong Zhang, Xin-Ying Chen et al.· 0 citations
Flow Matching (FM) learns a velocity field whose ODE transports a simple source distribution to a target law. Existing finite-sample theory largely treats ambient-space regularity or data supported exactly on low-dimensional sets. We study linear FM under a noisy latent-generator model, where a low-dimensional H\"older...
Li-Feng Hao, Shao-Lin Ji· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.