The Causal-Generative Dual-Judge (CGDJ) is introduced, auditing World Model Consistency from two perspectives, and analysis exposes audio-visual misalignment, where models verbalize correct causal logic more reliably than they render it, challenging the"world simulator"narrative.
Abstract
Recent advances in world models and video generation have given rise to an emerging reasoning paradigm that leverages video generative models to simulate, predict, and reason about real-world dynamics. We redefine this paradigm as Thinking in Video, where video is not merely an output artifact but a medium for constructing, extending, and verifying causal thought. However, this promise remains unverified: convincing rollouts may reflect memorized appearances rather than causal understanding, while existing metrics separate perceptual fidelity from semantic logic. To evaluate whether video generators support such reasoning, we introduce the Causal-Generative Dual-Judge (CGDJ), auditing World Model Consistency from two perspectives. Explicit Causal Perception tests whether a generator reads a video scenario as a reasoning problem through spatio-temporal flattened visual question answering, while Implicit Generative Perception-Prediction Gap evaluates whether it renders the causal consequence as a consistent future video. Applying CGDJ to representative open- and closed-source generators reveals a clear Perception-Prediction Gap: open-source models produce plausible dynamics despite near-zero explicit causal perception, whereas advanced closed-source systems show stronger but still limited alignment between reasoning and generation. Further analysis exposes audio-visual misalignment, where models verbalize correct causal logic more reliably than they render it, challenging the"world simulator"narrative.
This work proposes Vid-PRE (Video Prompt Reasoner and Enhancer), a model-agnostic prompt rewriter that offloads the cognitive burden of reasoning to a dedicated VLM, and introduces VWG-Bench, a comprehensive benchmark spanning 9 reasoning dimensions and 38 fine-grained tasks.
Meng Luo, Yi-Chen Liu, Jia-Hao Wang et al.· European Conference on Compu...· 1 citation
This work introduces RIG-BENCH, a novel comprehensive benchmark that systematically evaluates Reasoning-driven Image Generation (RIG) across four cognitively demanding domains: Concept-based, Transformation-based, Pattern&Structure, and Scenario-based.
Current image-to-video models achieve visual realism and physical plausibility, but reasoning about mental states remains unexplored. Actions are driven by belief, desire, and perception, requiring inference beyond explicit instructions. We introduce MindWorldBench to evaluate mental-state-conditioned video generation....
Rui-Qi Li, Xuan-Yi Liu, Si-Jia Li et al.· 0 citations
This work introduces PROWBench, comprising 170 programmatically constructed episodes and 600 proxy videos covering diverse scenes and interactions, and evaluates entity control, long-horizon memory, and adherence to the prescribed timeline and the visual realization of timestamped engine-recorded events.
Zheng-Hui Huang, Gui-Xu Lin, Yu-Ju Tsai et al.· 3 citations
Open-world video understanding often requires a model to locate sparse visual evidence and acquire external knowledge that is absent from the video and its parametric memory. While Thinking-with-Videos enables active temporal perception and Deep Research supports multi-step information seeking, the two capabilities are...
Wenqi Liu, Shi-Jie Ma, Yun-Xiao Wang et al.· 2 citations
Internalized Visual Thinking (IVT), a post-training framework that jointly optimizes textual prediction and next-embedding prediction over unlabeled videos, is introduced, suggesting that explicit pixel-space generation at inference time may not be necessary for effective proactive video reasoning.