This work proposes an agent-based active exploration framework that enables robots to dynamically interact with the environment rather than merely execute predefined instructions, and introduces a fine-grained perception-execution interleaving strategy, which tightly couples visual feedback with skill execution to improve exploration robustness.
Abstract
Recent advances in agentic systems have substantially enhanced the long-horizon capability of embodied manipulation. However, many existing frameworks still follow a passive execution paradigm, which limits their applicability to real-world scenarios involving textual semantic cues, distractors, and initially invisible targets. To bridge this gap, we propose an agent-based active exploration framework that enables robots to dynamically interact with the environment rather than merely execute predefined instructions. Specifically, our framework consists of three collaborative modules: a planning module for high-level task reasoning, a perception module for visual scene understanding, and an execution module for low-level manipulation. This design allows the robot to actively acquire task-relevant information, adapt its behavior based on environmental feedback, and complete manipulation tasks under partial observability. Furthermore, we introduce a fine-grained perception-execution interleaving strategy, which tightly couples visual feedback with skill execution to improve exploration robustness. We evaluate our method on a realistic Find-and-Place task, demonstrating its effectiveness in challenging environments where target objects must be actively discovered before manipulation.
General-purpose agents can plan, use tools, and revise their behavior from feedback, but it remains unclear whether these capabilities transfer from digital environments to embodied manipulation. To investigate this question, we introduce LIBERO-Agent, an agent-native benchmark for evaluating these agents in robot mani...
The Embodied Task Agent is introduced, a new paradigm for extending digital agents into the physical world, and OpenETA is released as its open-source implementation, which provides replaceable Planners, composable Tools and Skills, auditable memory, replayable trajectories, and common interfaces for simulation and rea...
Yi-Tong Chen, Zezheng Huai, Si-Xian Li et al.· 5 citations· ⚡1
RoboHarn-Evo is introduced, a dual-loop harness that evolves Hierarchical Physical Knowledge (HPK) from physical experience that demonstrates that physical interaction can be accumulated into reusable knowledge for improving subsequent manipulation.
Shi-Feng Bao, Fan-Ding Huang, Yi-Han Lin et al.· arXiv.org· 4 citations
The ActiveArena-Sim, an active-perception simulator with controllable viewpoints and large-scale workspaces as the foundation, is introduced, and ActiveArena-Bench is proposed, which comprises 35 tasks across 5 fine-grained categories, covering visual exploration and interactive information acquisition.
Yi-Bo Li, En-Shen Zhou, Rui Chen et al.· 2 citations
Zeva is presented, the first framework that enables in-context learning from a robot's own physical interaction experience while keeping the policy model frozen, and achieves the best performance among the compared frontier VLAs and WAMs and enables self-evolution during deployment without gradient updates.
Fu Chen, Xin Ding, Bing-Jia Huang et al.· 3 citations
This work introduces RoboSkill, a framework that connects skill acquisition and reuse through an Explore, Execute, Evolve loop, and complements vision with tactile feedback to reduce uncertainty during physical interaction and augment textual guidance with reusable code to reduce reasoning overhead during skill reuse.
Si-Cheng Xie, Yi-Tong Chen, Hai-Dong Cao et al.· arXiv.org· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.