Skip to content

MVVBench: Benchmarking 4D Reasoning in Vision-Language Models

Sep 2026 · arXiv.org · Vol abs/2609.30952 · 0 citations · 51 references
Computer Science

TL;DR

Preliminary evidence is presented that reinforcement learning with verifiable rewards can elicit some latent multi-view competence in the base model, pointing to training-time approaches as a promising direction for future work.

Abstract

Multi-view video understanding requires integrating spatial and temporal evidence across multiple, often non-overlapping camera streams: tracking entities as they transition between viewpoints, aligning events across time, and reasoning about latent 4D continuity rather than any single visible frame. We introduce MVVBench, a benchmark for multi-view video reasoning built from real world multi camera datasets. Questions are curated to be monocular-ambiguous along both the view and the temporal axis: each question is unanswerable from any single view in the designated input set, and the majority are further unanswerable from any single moment. Each question becomes uniquely solvable only by jointly reasoning across views and across time. MVVBench spans diverse dynamic scenes and probes six capabilities: implicit/explicit attribute identification, implicit/explicit relative distance, relative camera pose, and compositional counting, with human-authored QA and rigorous verification. Beyond benchmarking, we provide an extensive analysis of when and why current vision language models succeed or fail, characterizing errors due to temporal mis-localization, cross-view identity breaks, and brittle multi-hop reasoning. We then study inference-time elicitation strategies that unlock latent multi-view competence---task-specific chain-of-thought scaffolds and structured cross-view evidence aggregation---yielding substantial gains without retraining. Finally, we present preliminary evidence that reinforcement learning with verifiable rewards can elicit some latent multi-view competence in the base model, pointing to training-time approaches as a promising direction for future work. Together, MVVBench offers a rigorous evaluation of 4D multi-view reasoning and a foundation for future progress toward reliable embodied perception.

View source

Similar papers

Preprint Aug 2026

CrossView: Can Vision-Language Models Reason Across Cameras?

Video understanding benchmarks have long centered on single-camera settings, where modern multi-modal language models achieve strong performance across image and video tasks. Yet, the real world runs on multi-camera networks: autonomous vehicles, security systems, and robots all gather data across many simultaneous vie...

Sahil Shah, S. Sharan, Harsh Goel et al. · 1 citation
Preprint Aug 2026

StateSight: Benchmarking Latent Spatial-State Reconstruction in Vision-Language Models

The results show that format-valid responses can mask failures to recover the spatial structure required for verifiable visual inference, and that format-valid responses can mask failures to recover the spatial structure required for verifiable visual inference.

Michelle Lin · 0 citations
#small language model Book Open access Oct 2026

STACK: 3D Spatial Task Analysis in Collaborative Construction Keyframes

STACK is presented, to the knowledge the first benchmark pairing real multi-party construction video with dense 3D annotations and goal-paired judgment, exposing a gap between perception and judgment in current VLMs and informing their use as analyzers of collaborative group dynamics.

Changsoo Jung, Sheikh Mannan, Jack Fitzgerald et al. · 0 citations
Preprint Sep 2026

Geometric Encoding for Spatial Reasoning in Vision-Language Models

Vision-Language Models (VLMs) are far more reliable at recognizing what appears in a video than at reasoning about its spatial and temporal properties, such as metric distances, object dimensions, and consistent object identities across frames. We present Geometric Code, a perception-to-geometry pipeline that computes...

Antonio Jun, Hao-Shui Yu, Zheng Lu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

MV-STRIDE: Enabling MLLMs to Master Multi-View Spatial Reasoning via Hierarchical Capability Modeling

MV-STRIDE, a Multi-View hierarchical SpaTial Reasoning dataset with Interdependent and DEcomposed capabilitiEs, explicitly models the dependency relationships between foundational perception, scene understanding, and complex contextual reasoning, providing a coherent learning pathway aligned with human spatial cognitio...

Jin Xu, Xiao-Jiang Huang, Zhuo Luo et al. · 1 citation
Preprint Aug 2026

Multi-View Relational Distillation for Spatial Reasoning with Vision-Language Models

It is shown that MVRD makes visual representations more geometric while retaining language alignment, and generalizes to 3D scene understanding tasks such as object grounding, dense captioning, and question answering, while approaching feature fusion methods with considerably fewer added parameters and lower latency.

K. T. Nguyen, Hanbo Shim, Jinwoo Kim et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.