Skip to content

AdaHVLA: Adaptive Harnesses for Long-Horizon Vision-Language-Action Execution

Sep 2026 · arXiv.org · Vol abs/2609.29204 · 2 citations · 39 references
Computer Science

TL;DR

AdaHVLA is introduced, an adaptive harness that refines code-based coordination policies through robot experience to better align agent reasoning and memory with VLA execution.

Abstract

Vision-language-action (VLA) models offer strong local control and instruction following but often struggle with long-horizon tasks requiring persistent memory and planning. Task harnesses provide persistent context for agent reasoning by retaining task history and tracking progress across execution stages. To bring these complementary capabilities together, we introduce AdaHVLA, an adaptive harness that refines code-based coordination policies through robot experience to better align agent reasoning and memory with VLA execution. Its decoupled multiagent adaptation process separates evidence analysis, harness revision, and behavioral assessment into distinct working contexts, using testable coordination hypotheses to guide revisions and subsequent rollouts to assess their predicted effects. A stateful revision graph links execution evidence, hypotheses, revisions, and observed effects, preserving alternative harnesses and adaptation memory to guide refinement across repeated attempts and continued adaptation across tasks and environments. In simulation, AdaHVLA raises mean test success on NaVILA-LH from 22.5\% to as high as 57.5\% and improves manipulation test success across three VLA backbones by up to 30.8 percentage points over the initial harness. Real-world deployment further illustrates how the adapted policies support stable execution across task stages.

View source

Similar papers

Sep 2026

HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness

This work introduces HarnessVLN, a zero-shot, training-free framework that unifies instruction-following and object-goal navigation through a shared Agent Harness and demonstrates its applicability to both navigation tasks in real-world environments.

Yang Chen, Li-Rong Che, Zhen-Yu Huang et al. · 8 citations · ⚡2
Preprint Aug 2026

HarnessWAM: Bridging Prediction and Deliberation in World Action Models

Results demonstrate that model-external structured state maintenance and closed-loop agentic decision making can effectively extend the local control capabilities of WAMs into embodied task execution that is plannable, verifiable, and recoverable.

Zhao-Peng Gu, Bing-Ke Zhu, Tianxin Lin et al. · 5 citations
Preprint Oct 2026

EvoMem-VLA: State-Evolution Memory for Long-Horizon Robot Manipulation

Most vision-language-action (VLA) models rely on current observations and lose task-relevant evidence once it leaves view, limiting performance on long-horizon, memory-dependent tasks. Existing efforts incorporate compressed historical features or sparse visual keyframes. However, isolated snapshots can leave the polic...

Yu-Heng Na, Zhi-De Zhong, Jun-Jie He et al. · 1 citation
Preprint Sep 2026

Towards Neuro-Symbolic Procedural Reasoning for Long-Horizon Vision-Language-Action Manipulation

A neuro-symbolic framework that combines learned VLA control with explicit task graphs and multimodal procedural memory is investigated, which positions structured symbolic reasoning and demonstration-derived visual guidance as complementary mechanisms for reliable long-horizon VLA manipulation.

Vivek Chavan, Ya-Huan Shi, O. Heimann et al. · 0 citations
Preprint Aug 2026

Skills in Weights, Memory in Code: Hybrid Learning for Memory-Dependent Robot Manipulation

HyMeS, a hybrid learning framework that leverages the reasoning and memory-management capabilities of coding agents to steer a Markovian VLA for memory-dependent manipulation, is proposed, enabling data-efficient compositional generalization.

Yun-Hao Zhao, Zhen-Yang Ni, Haoyang Chen et al. · 0 citations

DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agents

Pretrained robot policies provide useful action priors, but long-horizon manipulation still requires coordination between semantic reasoning and physical execution. Semantic reasoning operates at a coarser timescale than physical interaction, while episode-level failures provide limited guidance on which system compone...

Hao-Yuan Deng, Jie-Bin Liu, Teng-Xiao Zhang et al. · 2 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.