Skip to content

ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulation

Sep 2026 · 2 citations · 65 references
Computer Science

TL;DR

The ActiveArena-Sim, an active-perception simulator with controllable viewpoints and large-scale workspaces as the foundation, is introduced, and ActiveArena-Bench is proposed, which comprises 35 tasks across 5 fine-grained categories, covering visual exploration and interactive information acquisition.

Abstract

Active perception and manipulation are crucial for robots to interact with complex scenes. Existing benchmarks struggle to evaluate how robots effectively acquire and maintain information in memory in an active manner. To this end, we introduce ActiveArena-Sim, an active-perception simulator with controllable viewpoints and large-scale workspaces as the foundation. Built on this, we propose ActiveArena-Bench, which comprises 35 tasks across 5 fine-grained categories, covering visual exploration and interactive information acquisition. Each task is difficult to solve from passive observations alone, requiring multi-round evidence acquisition and memory-based reasoning. The benchmark provides rich memory annotations, standardized training data, and ID/OOD protocols featuring disjoint scenes, unseen distractor configurations, and novel backgrounds. Moreover, we present ActiveArena-VLA, a modular suite of 13 vision-language-action configurations for controlled studies of memory writing, memory capacity, proprioceptive state, subtask supervision, and high-level planning in active perception. Benchmark results reveal a substantial ID-OOD gap: uniform memory sampling, increased memory capacity under reliable write policies, proprioceptive inputs, and subtask supervision improve OOD generalization, while planner-guided memory management and decision-making achieve performance close to the best-performing configuration using only sparse memory. ActiveArena thus provides a unified testbed to develop and diagnose models for active perception and manipulation.

View source

Similar papers

ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardware

This work introduces ActiveScale, a framework that advances active perception through coordinated model, data, and hardware designs, and introduces Active-perception Mobile-manipulation Platform (AMP), a robotic platform that supports active perception and mobile manipulation through single-operator teleoperation, enab...

Shuai Zhou, Kai-Sheng Pang, Wen-Xuan Song et al. · 1 citation
Preprint Sep 2026

RoboChrono: A Real Robot Benchmark for Streaming Task Understanding

Understanding ongoing robot manipulation requires models to interpret visual observations in relation to interaction history and task progress. We introduce RoboChrono, a benchmark for streaming task understanding comprising 39 scenarios and 34,713 evaluation instances, constructed from real robot executions and comple...

Yu-Zhou Wu, Long-Teng Fan, Zi-Meng Li et al. · 0 citations
Sep 2026

From Passive Execution to Active Exploration: Agentic Embodied Manipulation in Realistic Environments

This work proposes an agent-based active exploration framework that enables robots to dynamically interact with the environment rather than merely execute predefined instructions, and introduces a fine-grained perception-execution interleaving strategy, which tightly couples visual feedback with skill execution to impr...

Shi-Lin Ma, Chu-Bin Zhang, Xu-Long Bai et al. · 0 citations
Preprint Sep 2026

In-context Robot Learning Made Simple: A Democratized Recipe for Manipulation Tasks

We study robotic in-context learning (ICL), an emerging paradigm that enables robots to infer and execute tasks from visual demonstrations. Despite its growing promise, the problem itself remains under-defined: a visual demonstration simultaneously conveys action trajectories, object semantics, manipulation affordances...

Min-Xing Li, Ming-Hao Han, Wei-Zhi Zhao et al. · 0 citations
Preprint Sep 2026

Robo-Harness K1: Harnessing Robot-Use Agents via Perception Augmentation

Robo-Harness K1 is introduced, a robot-use agent (RUA) framework that exposes perception as tools that makes 3D geometry accessible without changing the VLM architecture or training a depth encoder, and suggests that perception-augmented RUAs offer a promising route to sample-efficient, generalizable robotic policies t...

Ze-Xi Li, Ye-Hang Zhang, Wen-Qian Li et al. · 6 citations · ⚡2

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.