Skip to content

CAC-VLA: Context-Gated Action Conditioning for Vision-Language-Action Models

Jul 2026 · arXiv.org · Vol abs/2607.04816 · 2 citations · ⚡ 1 influential · 43 references
Computer Science

TL;DR

CAC-VLA is proposed, a Context-Gated Action Conditioning framework that learns a lightweight latent-action interface directly within the VLM that enables VLM-native action conditioning while calibrating the influence of latent-action guidance on expert action generation.

Abstract

Vision-Language-Action (VLA) models have become a promising paradigm for generalist robot manipulation, where visual-language representations are used to condition continuous action generation. However, these representations are not explicitly optimized for action conditioning, leaving the action expert to bridge the gap between multimodal understanding and precise motor control. Recent action-reasoning methods introduce additional modules to generate explicit action plans or action-space reasoning signals, demonstrating the benefit of action-level guidance but often requiring separate action-generation frameworks. We propose CAC-VLA, a Context-Gated Action Conditioning framework that learns a lightweight latent-action interface directly within the VLM. Instead of generating executable trajectories, CAC-VLA trains the VLM to predict coarse-to-fine latent actions, which are structured representations encoded from future action segments, and adaptively leverages them to condition the action expert via a context gate. This enables VLM-native action conditioning while calibrating the influence of latent-action guidance on expert action generation. Experiments on LIBERO, LIBERO-Plus, and CALVIN demonstrate the effectiveness of CAC-VLA, achieving 98.9% and 90.4% average success rates on LIBERO and LIBERO-Plus, respectively, and outperforming {\pi}0.5 by 9.3 percentage points on CALVIN.

View source

Similar papers

#artificial intelligence Preprint Oct 2026

PAIR: Bridging Perception and Action in Vision-Language-Action Models

Vision-language-action (VLA) models map visual observations and language instructions to continuous robot actions. This task requires a transition from representations that describe the scene and instruction to representations that support action generation. Many continuous-action VLAs leave this transition implicit an...

Kai Feng, Guoheng Sun, Ang Li · 0 citations
Preprint Aug 2026

Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models

Intention Distillation (INDI) is proposed, which distills behavior-level intent into the action decoder and organizes downstream predictions in an objective-dependent manner, and shows that action decoders benefit from explicitly modeling the semantic objective of the behavior they generate.

Sangoh Lee, Sang-Woo Mo, Wook-Shin Han · 0 citations
Conference Aug 2026

RoVLA: Action-Conditioned Temporal Grounding and Structured Conditioning for Vision–Language–Action Policies

Vision-Language-Action (VLA) models have shown strong potential for robotic manipulation, yet pretrained policies do not always expose the information needed for precise action generation. In particular, effective control can benefit from (i) temporal context that reflects how recent actions have shaped the current sce...

Pei-Sen Huang, Jian-Hua Hu, Jie-Ren Deng et al. · 0 citations
Preprint Sep 2026

H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Space

Vision-Language-Action (VLA) models have shown strong potential for robotic manipulation, but many existing methods still rely on direct mappings from language and visual observations to dense actions. This formulation can weaken the semantic reasoning capability inherited from pre-trained Vision-Language Models (VLMs)...

Xiong-Feng Peng, Lu Xu, Yan-Dong Wang et al. · 0 citations
Preprint Oct 2026

ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection

Predictive Vision-Language-Action (VLA) models aim to improve robotic manipulation via future observation or world dynamics forecasting. However, existing approaches often fail to realize this potential and underperform direct action prediction models. We argue that these limitations stem from modality misalignment bet...

Yi-Jie Zhu, Rui Shao, Jie He et al. · 0 citations
Preprint Oct 2026

ViDAL: A Visual Dynamics-Grounded Action Latent Space for Vision-Language-Action Models

Vision-Language-Action (VLA) models have become a central paradigm for robot policy learning, which predict actions in three forms: raw action chunks, discrete action tokens, or continuous action latents. However, existing action representations primarily model action trajectories, with limited consideration of the vis...

Yuan Xu, Yi-Xiang Chen, Qi-Sen Ma et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.