Reinforcement learning (RL) is promising for spatial text-to-image generation, but existing work largely focuses on policy optimization, assuming accurate rewards and effective online rollouts. We observe in-domain gains with out-of-domain degradation, exposing two limitations: unreliable spatial rewards in open-world...
Xiaofeng Tan, Jia-Xin Lin, Haobo Yuan et al.· 1 citation
Autoregressive video generation requires denoising the current frames while writing their key-value representations as context for future predictions. However, these two roles typically share parameters, and we find that their gradients exhibit distinct patterns and systematic negative alignment, hindering the joint op...
Zi-Han Su, Junhao Zhuang, Yao-Wei Li et al.· 4 citations· ⚡1
Routed Forcing is proposed, which routes the distillation objective by semantic region and noise stage to improve dynamics and diversity while preserving visual quality and lip synchronization in audio-driven streaming avatar generation.
Zi-Han Su, Si-Wen Lu, Junhao Zhuang et al.· arXiv.org· 1 citation
EchoWM is an omnimodal world model for enterable generative media that responds to continuous navigation while jointly generating 720p video, environmental sound, music and speech, and maintains synchronized environmental sound and speech over long-horizon generation.
This work proposes Cycle-World, a novel framework designed for stable and temporally consistent long-video generation that tackles error drift by enforcing strict temporal reversibility across both the training and inference phases, and demonstrates that forward generative drift can be strictly bottlenecked by a cycle-...
Zihan Su, Teng Hu, Jiangning Zhang et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.