The ActiveArena-Sim, an active-perception simulator with controllable viewpoints and large-scale workspaces as the foundation, is introduced, and ActiveArena-Bench is proposed, which comprises 35 tasks across 5 fine-grained categories, covering visual exploration and interactive information acquisition.
Abstract
Active perception and manipulation are crucial for robots to interact with complex scenes. Existing benchmarks struggle to evaluate how robots effectively acquire and maintain information in memory in an active manner. To this end, we introduce ActiveArena-Sim, an active-perception simulator with controllable viewpoints and large-scale workspaces as the foundation. Built on this, we propose ActiveArena-Bench, which comprises 35 tasks across 5 fine-grained categories, covering visual exploration and interactive information acquisition. Each task is difficult to solve from passive observations alone, requiring multi-round evidence acquisition and memory-based reasoning. The benchmark provides rich memory annotations, standardized training data, and ID/OOD protocols featuring disjoint scenes, unseen distractor configurations, and novel backgrounds. Moreover, we present ActiveArena-VLA, a modular suite of 13 vision-language-action configurations for controlled studies of memory writing, memory capacity, proprioceptive state, subtask supervision, and high-level planning in active perception. Benchmark results reveal a substantial ID-OOD gap: uniform memory sampling, increased memory capacity under reliable write policies, proprioceptive inputs, and subtask supervision improve OOD generalization, while planner-guided memory management and decision-making achieve performance close to the best-performing configuration using only sparse memory. ActiveArena thus provides a unified testbed to develop and diagnose models for active perception and manipulation.
This work introduces ActiveScale, a framework that advances active perception through coordinated model, data, and hardware designs, and introduces Active-perception Mobile-manipulation Platform (AMP), a robotic platform that supports active perception and mobile manipulation through single-operator teleoperation, enab...
Shuai Zhou, Kai-Sheng Pang, Wen-Xuan Song et al.· arXiv.org· 1 citation
Understanding ongoing robot manipulation requires models to interpret visual observations in relation to interaction history and task progress. We introduce RoboChrono, a benchmark for streaming task understanding comprising 39 scenarios and 34,713 evaluation instances, constructed from real robot executions and comple...
Yu-Zhou Wu, Long-Teng Fan, Zi-Meng Li et al.· 0 citations
This work proposes an agent-based active exploration framework that enables robots to dynamically interact with the environment rather than merely execute predefined instructions, and introduces a fine-grained perception-execution interleaving strategy, which tightly couples visual feedback with skill execution to impr...
Shi-Lin Ma, Chu-Bin Zhang, Xu-Long Bai et al.· arXiv.org· 0 citations
We study robotic in-context learning (ICL), an emerging paradigm that enables robots to infer and execute tasks from visual demonstrations. Despite its growing promise, the problem itself remains under-defined: a visual demonstration simultaneously conveys action trajectories, object semantics, manipulation affordances...
Min-Xing Li, Ming-Hao Han, Wei-Zhi Zhao et al.· 0 citations
VA-Bench is introduced to evaluate the complete observe-reason-act-revise loop and tests whether general-purpose MLLMs can turn visual demonstrations and actively acquired evidence into successful embodied action.
Zhong-Bo Zhang, Jia-Yi Jin, Yi-Fan Wang et al.· 1 citation
Robo-Harness K1 is introduced, a robot-use agent (RUA) framework that exposes perception as tools that makes 3D geometry accessible without changing the VLM architecture or training a depth encoder, and suggests that perception-augmented RUAs offer a promising route to sample-efficient, generalizable robotic policies t...
Ze-Xi Li, Ye-Hang Zhang, Wen-Qian Li et al.· 6 citations· ⚡2
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduJul 30, 2026
From feet to fingertips — we are teaching robots intelligent whole-body control, fine dexterity, and teamwork to complete a broad range of complex tasks.