Skip to content

AntiGrounding: Executable Robot Trajectories as Visual Prompts for VLM-Guided Manipulation

Jun 2025 · 0 citations · 26 references
Computer Science

TL;DR

AntiGrounding, a visual action-selection framework built around a dual geometric--visual trajectory interface, is presented, where component ablations and evaluator sensitivity characterize trajectory assessment, proposal search, orientation control, and evaluator choice.

Abstract

Natural-language instructions specify manipulation goals but leave the robot's motion underdetermined. We present AntiGrounding, a visual action-selection framework built around a dual geometric--visual trajectory interface. Each short trajectory retained after feasibility filtering remains an explicit motion plan and serves as a visual prompt for instruction-conditioned vision--language model (VLM) assessment. Structured multi-view visual question answering (VQA) scores safety, task alignment, efficiency, and physical plausibility. Weighted view fusion aggregates these scores for trajectory selection, while the scores also guide subsequent translational proposals. Separate orientation and gripper controls coordinate physical interaction. Planning proceeds in an initialized digital twin, which validates selected segments before the real robot executes the same waypoint sequences. Across eight real-world manipulation tasks, AntiGrounding with a single GPT-6 Astra evaluator achieves \AstraOverall\% overall success. Under the reported deployment protocol, $\pi_{0.5}$ achieves \PiOverall\%, and a PIVOT-style visual proposal-selection baseline with the same evaluator achieves \PivotOverall\%. Component ablations and evaluator sensitivity characterize trajectory assessment, proposal search, orientation control, and evaluator choice. Performance depends on digital-twin fidelity and physical interaction.

View source

Similar papers

FRAM: Trajectory-Guided Visual Feature Selection for Compact Language-Conditioned Robot Manipulation

This work proposes the Future Representation Action Model (FRAM), a small policy that explicitly links the future end-effector trajectory to the current visual input and selects visual information based on future motion to obtain both high performance and robustness in a small robot policy.

Hiroshi Ito, Hyogo Hiruma, Yoshiki Kanai et al. · 0 citations
Preprint Nov 2026

InteractVLA: Turning VLAs into Interactive Tools for Agentic Robotic Manipulation

Existing agentic manipulation systems treat pretrained vision-language-action (VLA) policies as opaque, language-only primitives: when a policy call fails under unfamiliar instructions or scene perturbations, the agent cannot steer its behavior and is forced into futile retries or costly manual takeover. We present Int...

Chen Zhao, Zi-Peng Ye, Shi-Feng Bao et al. · 0 citations
Review Oct 2026

Are Frontier VLM Agents Ready to Be Robot Generalists? An Empirical Study with the Embodied Agent Arena

A robot generalist must interpret a scene, act on it, and satisfy every condition of a task. How far do frontier vision-language models (VLMs) meet these demands? We introduce Embodied Agent Arena, evaluating ten VLM agents across Geometry, Spatial Reasoning, Affordance, Task Planning, and Manipulation. Its 1,000 cases...

Hao-Jian Huang, Pu-Kun Zhao, Ze-Xi Li et al. · 1 citation
Preprint Oct 2026

LLM-guided Planar Loco-Manipulation for Quadruped Robots

Robotic navigation typically assumes a collision-free route to the goal exists; in cluttered environments with movable obstacles, however, reaching the goal may require physical interaction. Classical solutions encode these behaviors through geometric rules and task-specific logic, while learning-based approaches often...

Georges Jetti, Michael Khayyat, Jean-Pierre Sleiman et al. · 0 citations

HiWE: Hierarchical World Knowledge Model with Visual Keypoint Enhancement for Zero-Shot 3D Path Planning

This paper describes the original point-based formulation of the framework and its relationship to the subsequent GeneralVLA extension, and describes the original point-based formulation of the framework's relationship to the subsequent GeneralVLA extension.

Guo-Qing Ma, Ming-Qi Yuan, Chen Gao et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.