Video generators serve as interactive worlds for exploration and simulation, yet realistic and visually appealing frames do not necessarily depict a consistent 3D world. Existing benchmarks assess selected geometric properties or use vision-language models to judge memory and consistency, leaving systematic 3D evaluati...
Dong-Yue Lu, Guian Fang, Hur Lim et al.· 0 citations
Generalized referring expression segmentation (GRES) requires dynamically balancing high-level semantics for identifying a variable number of language-specified referents with fine-grained visual evidence for precise boundary delineation. This requirement challenges existing cascaded vision-language architectures, whic...
Rui-Cheng Zhang, Kai-Wen Shen, Jia-Qi Hou et al.· 0 citations
Mask Forcing, a Dual-Noise Masking Rollout strategy that perturbs the AR student self-rollout to mitigate mode collapse induced by reverse-KL mode seeking, improves multiple AR video diffusion distillation methods with higher visual quality efficiently, without incorporating real video data or additional post-training...
Zhuo-Ran Zhao, Sheng-Ju Qian, Tong-Tong Liang et al.· 2 citations
SolarWM, a fully open foundation for building interactive video world models from data preparation through long-horizon inference, is introduced, providing a reproducible and extensible foundation for interactive world-model research.
Jun-Chao Huang, Guian Fang, Sheng-Ju Qian et al.· 12 citations
VideoRAE is introduced, a representation autoencoder that converts features from a frozen video foundation model into compact, reconstruction-capable latents for video generation, establishing frozen video foundation representations as compact, versatile, and generation-friendly video latents.
Zhihao Xie, Junfeng Wu, Xinting Hu et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.