Skip to content

LM-X: Explainable Vision--Language--Action Modeling via Progress, Event, and Uncertainty Prediction

Aug 2026 · 0 citations · 62 references
Computer Science

TL;DR

LM-X is introduced, which organizes prediction across task, event, and motor scales without claiming anatomical correspondence and shows that explicit multi-timescale predictive state can strengthen control while exposing interpretable internal estimates.

Abstract

Large-scale vision--language--action (VLA) policies have advanced generalist robot control, yet most remain stimulus-to-action black boxes: actions are exposed, but their explanatory state is not. They provide no native account of three explanatory signals: task progress, the next semantic transition, or local command reliability. Prior work shows that progress and event structure aid long-horizon control and that uncertainty supports monitoring; however, such capabilities are typically added or extracted only after action pretraining. The field therefore lacks a VLA foundation model whose explanatory state is jointly pretrained with control. Drawing on biological sensorimotor organization, in which outcome-sensitive, event-segmented, and probabilistic predictions structure behavior, we introduce LM-X. LM-X learns three directly supervised online signals: return-to-go (RTG) estimates visible progress and state quality; event-to-go (ETG) predicts the action sequence to the next semantic event; and heteroscedastic action-flow variance reports local command reliability. RTG conditions ETG and both condition action generation; uncertainty is estimated inside the action expert, making explanation part of control rather than a post-hoc description. We pretrain LM-X on more than 20,000 hours of heterogeneous real-robot trajectories, including over 1,000 hours of failed rollouts. LM-X achieves 74.1\% success on 50 randomized-hard RoboTwin2.0 tasks and 73.5\% on seven real-robot tasks, compared with 55.4\% and 50.7\% for GR00T N1.7. Its signals track progress and regression, anticipate event-scale motion, detect high-error actions, and provide advance failure warning. These results establish LM-X as an explainable VLA foundation model that couples transparent predictive state with stronger generalist control. Github: https://github.com/loongOpen/LoongWu-LM-X-VLA

View source

Similar papers

Preprint Aug 2026

HarnessWAM: Bridging Prediction and Deliberation in World Action Models

Results demonstrate that model-external structured state maintenance and closed-loop agentic decision making can effectively extend the local control capabilities of WAMs into embodied task execution that is plannable, verifiable, and recoverable.

Zhao-Peng Gu, Bing-Ke Zhu, Tianxin Lin et al. · 5 citations
Preprint Aug 2026

PredVLA: Predictive Sensorimotor Modeling for Sub-Million-Parameter Robot Manipulation

A mechanism-by-mechanism transition to the recurrent behavior-cloning baseline shows that replacing the predictive pathway with direct observation input produces the largest single performance drop, accounting for approximately $70\% of the endpoint gap.

Hiroki Sawada, Shunichi Kasahara · 1 citation
Preprint Aug 2026

Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models

Intention Distillation (INDI) is proposed, which distills behavior-level intent into the action decoder and organizes downstream predictions in an objective-dependent manner, and shows that action decoders benefit from explicitly modeling the semantic objective of the behavior they generate.

Sangoh Lee, Sang-Woo Mo, Wook-Shin Han · 1 citation
Preprint Aug 2026

SLIM-0.5B: Learning Action-Grounded Predictive Latents for Robot Manipulation

SLIM (Self-supervised Latent Interaction Model), a compact 0.5B-parameter latent interaction policy, which matches or exceeds representative large-scale VLA and world-action-model baselines with fewer parameters, no additional embodied pretraining, lower inference latency, and substantially lower GPU memory usage.

Jing-Kai Wang, Zihan Tang, Gu Zhang et al. · 0 citations
Jul 2026

WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory

WorldScape Policy 2.0 is introduced, a controllable WAM with reasoning-augmented long short-term memory and fine-grained instruction following and in-context adaptation that demonstrates superior capabilities in long-horizon autonomous planning, fine-grained instruction following and in-context adaptation.

Hai-Sheng Su, Zong-Dai Liu, Xin Jin et al. · 2 citations
Jul 2026

TFP: Temporally Conditioned Memory-Fusion Policies for Visuomotor Learning

Temporally Conditioned Memory-Fusion Policies (TFP), a lightweight memory-action framework for VLA backbones, is introduced and suggests that compact, event-sensitive memory dynamics can improve VLA policies under occlusion, visual perturbation, and stage-dependent task structure.

Yushen Liang, Yue Peng, Baosheng Jin et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.