AntiGrounding, a visual action-selection framework built around a dual geometric--visual trajectory interface, is presented, where component ablations and evaluator sensitivity characterize trajectory assessment, proposal search, orientation control, and evaluator choice.
Abstract
Natural-language instructions specify manipulation goals but leave the robot's motion underdetermined. We present AntiGrounding, a visual action-selection framework built around a dual geometric--visual trajectory interface. Each short trajectory retained after feasibility filtering remains an explicit motion plan and serves as a visual prompt for instruction-conditioned vision--language model (VLM) assessment. Structured multi-view visual question answering (VQA) scores safety, task alignment, efficiency, and physical plausibility. Weighted view fusion aggregates these scores for trajectory selection, while the scores also guide subsequent translational proposals. Separate orientation and gripper controls coordinate physical interaction. Planning proceeds in an initialized digital twin, which validates selected segments before the real robot executes the same waypoint sequences. Across eight real-world manipulation tasks, AntiGrounding with a single GPT-6 Astra evaluator achieves \AstraOverall\% overall success. Under the reported deployment protocol, $\pi_{0.5}$ achieves \PiOverall\%, and a PIVOT-style visual proposal-selection baseline with the same evaluator achieves \PivotOverall\%. Component ablations and evaluator sensitivity characterize trajectory assessment, proposal search, orientation control, and evaluator choice. Performance depends on digital-twin fidelity and physical interaction.
Improved robustness to the evaluated occlusions and distribution shifts is supported, addressing part of the gap between structured manipulation and less controlled environments.
Jia-Wei Geng, Zhen-Yang Liu, Yu-Zheng Wu et al.· 0 citations
This work proposes the Future Representation Action Model (FRAM), a small policy that explicitly links the future end-effector trajectory to the current visual input and selects visual information based on future motion to obtain both high performance and robustness in a small robot policy.
Existing agentic manipulation systems treat pretrained vision-language-action (VLA) policies as opaque, language-only primitives: when a policy call fails under unfamiliar instructions or scene perturbations, the agent cannot steer its behavior and is forced into futile retries or costly manual takeover. We present Int...
Chen Zhao, Zi-Peng Ye, Shi-Feng Bao et al.· 0 citations
A robot generalist must interpret a scene, act on it, and satisfy every condition of a task. How far do frontier vision-language models (VLMs) meet these demands? We introduce Embodied Agent Arena, evaluating ten VLM agents across Geometry, Spatial Reasoning, Affordance, Task Planning, and Manipulation. Its 1,000 cases...
Hao-Jian Huang, Pu-Kun Zhao, Ze-Xi Li et al.· 1 citation
Robotic navigation typically assumes a collision-free route to the goal exists; in cluttered environments with movable obstacles, however, reaching the goal may require physical interaction. Classical solutions encode these behaviors through geometric rules and task-specific logic, while learning-based approaches often...
Georges Jetti, Michael Khayyat, Jean-Pierre Sleiman et al.· 0 citations
This paper describes the original point-based formulation of the framework and its relationship to the subsequent GeneralVLA extension, and describes the original point-based formulation of the framework's relationship to the subsequent GeneralVLA extension.
From feet to fingertips — we are teaching robots intelligent whole-body control, fine dexterity, and teamwork to complete a broad range of complex tasks.