Sep 2026· IEEE Transactions on Image Processing· Vol 35, pp. 9988-10000· 0 citations· 48 references
Medicine
Abstract
Real-time 4K video super-resolution (VSR) requires the effective reuse of temporal information under strict latency constraints, typically relying on temporal alignment and real-time reconstruction. However, imperfect alignment introduces perturbations into the temporal recursion, which can accumulate over time and degrade reconstruction quality—an effect widely observed in recurrent VSR pipelines but rarely analyzed explicitly from a dynamical perspective under real-time constraints. In this work, we formulate real-time VSR inference as a recurrent dynamical process, embedding alignment within the state update. This formulation enables explicit analysis of how alignment-induced perturbations are introduced and propagated during inference. Motivated by this analysis, we propose StableFlow, a stability-guided real-time VSR framework. Specifically, StableFlow introduces an Alignment Gain-aware Alignment Module (AGAM) to enhance the utility of temporally aligned features, a State-aware Perturbation Control Filter (SPCF) to suppress unreliable propagated information, and a Temporal Propagation Control (TPC) loss to regulate long-term recurrent state evolution. Our method combines efficient temporal alignment with state-aware perturbation control and a temporal propagation control loss to stabilize long-term recurrent behavior. Experiments demonstrate that StableFlow achieves real-time 4K performance (over 40 FPS on an NVIDIA RTX 3090) for <inline-formula> <tex-math notation="LaTeX">$4\times $ </tex-math></inline-formula>upscaling from <inline-formula> <tex-math notation="LaTeX">$960\times 540$ </tex-math></inline-formula> inputs to <inline-formula> <tex-math notation="LaTeX">$3840\times 2160$ </tex-math></inline-formula> outputs, with only 321K parameters and 77.45G FLOPs, while maintaining competitive reconstruction quality.
Event-guided video super-resolution (VSR) leverages high-temporal-resolution event streams to address motion blur, rapid dynamics, and poor illumination that challenge frame-only VSR methods. However, most existing approaches emphasize reconstruction quality while overlooking real-time performance and computational eff...
LiveVVT is introduced, a rolling streaming diffusion framework that preserves bounded bidirectional modeling within causal recurrent generation, and a progressive distillation framework integrating bidirectional VVT learning, teacher-trajectory regression for causal few-step adaptation, and Collaborative Matching Disti...
Yu-She Cao, Shi-Kun Feng, Ru-Xiang Duan et al.· 0 citations
DecoGS introduces an adaptive mechanism that selectively focuses optimization on spatiotemporal regions exhibiting motion or photometric changes, eliminating redundant updates that cause flickering and drift in nominally static regions, while enabling fast, high-fidelity scene updates.
Idil Sulo, Alexey Supikov, Ilke Demir et al.· 0 citations
Existing online video segmentation methods struggle to track objects in long, complex videos with long-term occlusions. We hypothesize that this limitation is caused by (i) the inability of their temporal propagation mechanism to adaptively select the object information that is propagated across time, and (ii) their in...
Experimental results demonstrate that STM-Net outperforms state-of-the-art methods in both objective metrics and subjective visual quality, providing a robust solution for screen content artifacts.
Zi-Yin Huang, Sik-Ho Tsang, Xin Qin et al.· 0 citations
Motion-Guided Mamba for Video Frame Interpolation (MGMVFI), an adaptation of the selective state space model tailored explicitly for VFI achieves state-of-the-art performance, particularly on complex and dynamic motions, thereby establishing a new direction for sequence modeling in video interpolation.
Jaehyun Park, Nam Ik Cho· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.