In recent years, multimodal large models have made significant progress in video understanding and reasoning. However, most of them rely on an offline setting, which assumes that both videos and questions can be fully accessed in advance. In contrast, streaming video question answering scenarios require capturing depen...
Shi-Han Wang, Zhen-Yu Yang, Li-Long Liu et al.· Proceedings of the 34th ACM...· 0 citations
Looped Transformers increase effective depth by re-executing shared layers, but three limitations hinder their adoption: memory grows with the loop count, compute can only be adjusted in whole-block steps, and the loop count is hard to change after training. We propose LooM (Loop-invariant Memory), which addresses each...
Le-Le Yang, Mu-Xi Diao, Zhong-Hao Yan et al.· 0 citations
Comparisons in conversational emotion-shift forecasting are easily distorted when a learned model receives rich features but its transition baseline is given a noisy or unavailable current-emotion label, when hyperparameter budgets differ, or when target-turn information enters the representation. We present an informa...
Bin Wen, Dai-Qiao Zhang, Tien-Ping Tan· 0 citations
Diffusion video models produce striking clips, but they cannot reliably render an exact formula, a correct chart, a rule-consistent game or narration synchronized to on-screen events. A different route is emerging: multimodal agents that write code to render every frame and synthesize every sound. We introduce VibeVide...
Mu-Xi Diao, Wen-Bin Xu, Le-Le Yang et al.· 1 citation
Coarsened-consistent panel operators with a closed-form Dirichlet-multinomial realization, learned completion, and rater-count transfer are defined, with modest and corpus-dependent gains, with several small or null partial-revelation differences.
Bin Wen, Dai-Qiao Zhang, Tien-Ping Tan· 0 citations
Long video understanding relies on video memory to overcome the context limits of multimodal large language models. Existing methods follow a build-then-reasoning pipeline: memory is built offline for the entire video, then reasoned over as a static source. In practice a long video is shared by several questions, and t...
Wei Chen, Xuan-Yu Zheng, Yan-Cheng Long et al.· arXiv.org· 0 citations
The Global State Model (GSM), a causal encoder--decoder architecture that concentrates the selection and aggregation of long-range information in the encoding stage, is introduced, offering a shared-state architecture for efficient language modeling.
Yun Zheng, Bin Wen, Xiao-Jie Wang et al.· arXiv.org· 0 citations
Open-world video understanding often requires a model to locate sparse visual evidence and acquire external knowledge that is absent from the video and its parametric memory. While Thinking-with-Videos enables active temporal perception and Deep Research supports multi-step information seeking, the two capabilities are...
Wenqi Liu, Shi-Jie Ma, Yun-Xiao Wang et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.