Leveraging the paradigm of autoregressive diffusion, text-conditioned interactive video world models aim to simulate temporally coherent environments guided by textual instructions. While enabling low-latency, long-duration generation is pivotal for embodied AI and simulation-based planning, current frameworks primaril...
Ze-Yu Zhang, Jin-Yuan Mao, Da-Kai An et al.· 0 citations
By making objectives available to inference rather than only evaluation, COFFEE brings joint conditioning, completion-weighted guidance, and optimization-based constraints into pretrained neural generation, showing the potential of neural-symbolic methods in diffusion guidance.
Hua-Qiu Xu, Dong-Xin Li, Gwen Yidou-Weng et al.· 0 citations
We present Wan-Streamer v0.3, which reframes our native-streaming interaction model under a single organizing view: a video is a world plus an event stream. The world is the persistent context in which a video unfolds, including the environment, scene, subjects, ambient acoustic conditions, voice characteristics, and o...
Lianghua Huang, Zhigang Wu, Yupeng Shi et al.· arXiv.org· 2 citations
VIsion Pruning Router is proposed, a lightweight VIsion Pruning Router that adaptively selects the pruning strategy predicted to be best suited to each input at a specified pruning level that proves effective across various MLLM backbones and yields consistent gains on unseen benchmarks, highlighting the potential of s...
Hai-Jin Liang, P. Zhou, Zheng-Lin Wan et al.· 0 citations
Wan-Streamer v0.2 is presented, a latency-preserving upgrade of the native-streaming, end-to-end audio-visual interaction model, which raises the interactive output stream from 192x336 to 640x368 while preserving approximately 200 ms model-side signal-to-signal latency at 25 FPS.
Lianghua Huang, Zhigang Wu, Yupeng Shi et al.· arXiv.org· 2 citations
ReWorld separates the two during training and bounds them at inference, and under a three-axis protocol covering action following, long-horizon recall, and video quality, against six recent interactive world models it attains the best control fidelity.
