Concentrated Implicit Preference Optimization (cIPO) is proposed, a post-training framework for video diffusion models that captures inference-time errors without requiring human annotations or external reward models and consistently enhances video authenticity and temporal coherence across multiple datasets.
Abstract
Recent advances in preference alignment for diffusion-based video generation, particularly via Direct Preference Optimization (DPO), have significantly improved visual quality. However, temporally sparse artifacts such as motion collapse, object flickering, and color oversaturation remain a major barrier to perceptual realism. Existing methods struggle with these issues due to two key limitations: (1) the preference attribution bottleneck, where offline human annotations are costly and fail to accurately capture learning dynamics, while online reward signals are rollout-aware but often unstable and biased; and (2) temporal credit misallocation, where uniformly applied supervision cannot effectively target the brief segments in which artifacts occur. To address these challenges, we propose concentrated Implicit Preference Optimization (cIPO), a post-training framework for video diffusion models. cIPO derives implicit preference signals directly from the denoising process: given a real video, the model adds forward noise and reconstructs it via iterative denoising, treating the original as the preferred sample and the reconstruction as the dispreferred one. This formulation captures inference-time errors without requiring human annotations or external reward models. Moreover, frame-level discrepancies between original and reconstructed videos reveal when failures occur. cIPO leverages this by computing temporal reconstruction errors and concentrating optimization on high-error segments, enabling more precise correction of failure-prone regions. Extensive experiments demonstrate that cIPO consistently enhances video authenticity and temporal coherence across multiple datasets, highlighting the effectiveness and efficiency of implicit preference with temporally concentrated optimization.
AnchorSteer is proposed, a training-free framework that exerts fine-grained control over both initialization and denoising trajectory that consistently outperforms existing baselines in text--image alignment while preserving high visual quality.
Xinyi Wang, Yuyang Huang, Yalin Su et al.· 0 citations
MobileWan becomes the first 5B-scale video diffusion model deployable on a commercial mobile device and proposes a learnable attention head pruning method based on binary per-head gates optimized end-to-end using a noise-biased sparsity objective and distillation-based finetuning.
Mohsen Ghafoorian, Denis Korzhenkov, Adil Karjauv et al.· 1 citation
Experiments show that LDO substantially improves physical commonsense, object permanence, and trajectory fidelity while preserving visual quality, suggesting that predictive latent supervision offers a practical route to make video generators not only photorealistic but also physically legible.
Romy Mi Luo, Yujia Chen, Alex Dimakis et al.· 0 citations
Text-to-Image diffusion models are highly effective but remain heavily sensitive to the initial noise. This sensitivity causes significant instability in personalization tasks, where maintaining a specific subject's identity is crucial. While inference-based methods like the W+ Adapter offer efficient alternatives to costly fine-tuning, they suffer from structural conflicts between identity preservation and prompt consistency depending on this noise. In this study, we address this issue by proposing an automated discrete "Latent Space Exploration" framework utilizing random search to optimize seed selection. We compare our discrete seed optimization approach against "Initial Noise Selection," a continuous optimization method that modifies the noise tensor directly via gradient descent. We define a multi-objective scoring function integrating text consistency (CLIP), identity preservation (ArcFace), and structural validity (MTCNN). Quantitative experiments reveal a critical trade-off: while continuous optimization preserves identity competitively, it frequently degrades text consistency by ignoring prompt contexts like clothing or backgrounds. In contrast, our discrete exploration achieves a superior balance, ensuring a 100% face detection rate while maximizing both identity fidelity and text alignment. Furthermore, a subjective evaluation with 151 participants confirms that our method yields significantly higher overall visual quality and prompt fidelity. We conclude that discrete seed optimization offers a robust and practical solution for personalized generation.
Yu Yamamoto, Qiu Chen· International Conference on...· 0 citations
This work establishes the first connection between autoregressive video drifting and model internal representations, adopts erank as a quantitative metric for error accumulation, reveals counterintuitive scaling limitations for video world models, and presents a simple yet effective regularization strategy to improve long video generation robustness.
Backbone training-free video editing built on pre-trained text-to-image (T2I) diffusion models enables lightweight, prompt-driven edits without additional finetuning. A critical yet often overlooked factor is cross-frame latent selection during DDIM inversion, which largely determines spatiotemporal coherence in the subsequent denoising process. Existing pipelines typically rely on static, heuristic keyframe policies and temperature-softmax responsibilities, yielding unscalability i.e., numerical sensitivity and scale bias, that degrades generalization across diverse scenes. In this paper, we propose VIVID (Variational Inference for Video editing with Image Diffusion), an uncertainty-aware variational latent anchoring module that dynamically selects informative frames and compresses cross-frame latents into a compact set of semantic anchors. VIVID learns stable assignments via a variational objective with contrastive alignment and prior regularization, producing anchors that preserve spatial details while enforcing temporal continuity, and can be plugged into existing backbone training-free T2I-based video editing frameworks as a drop-in replacement for heuristic selection. Extensive experiments on standard benchmarks and in-the-wild videos demonstrate that VIVID achieves state-of-the-art inversion fidelity, editing quality, and temporal consistency, while reducing memory and runtime compared with prior backbone training-freebaselines. Code is released in: https://github.com/amasawa/VIVID.
Zhangkai Wu, Xuhui Fan, Zhongyuan Xie et al.· Proceedings of the 32nd ACM...· 0 citations