Skip to content
Preprint

Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent

Aug 2026 · 1 citation · ⚡ 1 influential · 33 references
Computer Science

TL;DR

Video-DR is introduced, featuring a decoupled perception-exploration pipeline with stage-wise tool unlocking that compels exhaustive cross-frame visual grounding prior to web retrieval, enabling autonomous exploration that breaks the imitation-learning ceiling.

Abstract

We introduce Video-DeepResearch (Video-DR), extending multimodal agents from static images to continuous video streams, a setting that demands dense spatiotemporal grounding coupled with open-web exploration. Preliminary evaluations reveal two critical bottlenecks in current models: (1) modality bias, where agents bypass visual tools in favor of textual search, and (2) parametric knowledge leakage, where models rely on internal memory rather than genuine tool-augmented execution. To address these challenges, we propose Video-DR, featuring a decoupled perception-exploration pipeline with stage-wise tool unlocking that compels exhaustive cross-frame visual grounding prior to web retrieval. Our framework adopts a two-stage training recipe: supervised fine-tuning followed by Group Relative Policy Optimization (GRPO), enabling autonomous exploration that breaks the imitation-learning ceiling. Furthermore, we curate Video-DR-Bench, a human-AI collaborative benchmark comprising 200 complex, multi-hop VQA instances. Empirical results demonstrate that our Video-DeepResearch-35B-A3B establishes a new state-of-the-art of 64.0% average accuracy, surpassing proprietary Claude-4.5-Sonnet (59.0%) by 5.0 points and significantly outperforming GPT-5 (52.5%) and Gemini 2.5 Pro (57.5%). The 30B-A3B variant achieves 59.3%, competitive with Claude-4.5-Sonnet and demonstrating the effectiveness of our training paradigm even at compact scale. Code: https://github.com/Osilly/Vision-DeepResearch.

View source

Similar papers

Preprint Aug 2026

Thinking Beyond Videos: Unifying Video Reasoning and Deep Research for Open-World Video Agents

Open-world video understanding often requires a model to locate sparse visual evidence and acquire external knowledge that is absent from the video and its parametric memory. While Thinking-with-Videos enables active temporal perception and Deep Research supports multi-step information seeking, the two capabilities are...

Wenqi Liu, Shi-Jie Ma, Yun-Xiao Wang et al. · 2 citations
Preprint Aug 2026

DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents

DeepVoyager-VL is proposed, a long-horizon multimodal deep-search framework for vision-in-the-loop search that constructs a multimodal event graph to drive data synthesis, yielding problems with intermediate visual dependencies and long reasoning chains.

Huan-Yao Zhang, Jie-Peng Zhou, Ru Zhao et al. · 0 citations
Preprint Aug 2026

VGI-Bench: Probing Visual Intelligence in Video Generation Models

VGI-bench is introduced, containing 27 tasks and 810 instances, organized by a two-level taxonomy of task domains and skill tags for fine-grained evaluation of visual reasoning capabilities of video generation models, and it is hoped VGI-bench will help stimulate the development of next-generation video generation mode...

Xuan He, Cong Wei, Yuhao Cheng et al. · 3 citations
Preprint Aug 2026

Beyond Trial-and-Error: Agentic Optimization for Image-to-Video Adherence

This work provides a practical and extensible methodology for enhancing the predictability and control of state-of-the-art video generation models, moving the field beyond speculative curiosities toward reliable, production-ready tools.

Aman Tyagi, Hemanth Boinpally, Jonathan Chen et al. · 1 citation
Preprint Sep 2026

DSE-VTG: Dual-Side Enhancement for Training-Free Video Temporal Grounding

DSE-VTG is proposed, a \underline{D}ual-\underline{S}ide \underline{E}nhancement framework that addresses both temporal dynamics and task-specific training without any task-specific training, and achieves state-of-the-art performance among training-free methods.

Zhuo Cao, Bing-Qing Zhang, Sen Wang et al. · 0 citations
#computer vision Preprint Aug 2026

AVA-Encoder: Towards Agent-Native Video Representation Learning

The Agentic Video Auto-Encoder (AVA-Encoder), a novel auto-encoding framework driven by agentic self-evolution to learn agent-native video representations that outperforms a carefully human-tuned policy while using 74.3% fewer shot-level and keyframe-level system-prompt tokens.

Chuyue Li, Jinpeng Yu, Hao-Zhe Wang et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.