Skip to content

LIBERO-MAX: Do Robot Policies Adapt When the World Changes?

Sep 2026 · arXiv.org · Vol abs/2609.36518 · 3 citations · ⚡ 1 influential · 80 references
Computer Science

Abstract

Robots must often continue a task after a target moves, the viewpoint shifts, or an obstacle appears, even though their earlier observations and committed actions reflect the previous scene. Many simulation robustness benchmarks fix external conditions at reset, leaving this temporal challenge underexamined. We introduce LIBERO-MAX, a benchmark of 8,000 paired cases spanning eight types of changes to geometry, observations, appearance, clutter, and paths. Each pair compares task execution with and without a mid-task event, holding the task, initial state, policy seed, and pre-event action sequence fixed. This controlled comparison distinguishes event-associated regressions from failures already present without the change. Across fourteen current VLA, hybrid, and world-action policies, events reduce success by 11.0-25.7 percentage points. Event profiles reveal shared vulnerabilities to geometry and observation changes, while policy-family rankings interleave. Camera controls show that robustness reflects both competence under the changed conditions and the trajectory from which they are encountered; varying query cadence does not eliminate the gap. Together, the paired protocol and temporal diagnostics establish LIBERO-MAX as a reproducible testbed for diagnosing failures under mid-execution changes and measuring progress toward robot policies that remain effective as the world changes.

View source

Similar papers

Preprint Sep 2026

RoboRecover: Benchmarking Robot Policy Recovery under Execution Deviations

Results show that initial-state performance does not determine recovery performance and policies exhibit different recovery strengths across scenarios, and RoboRecover establishes recovery from execution-induced intermediate states as a distinct dimension of robot policy evaluation.

Yang Li, Chen Zhao, Zhuo-Ran Wang et al. · 1 citation
Preprint Oct 2026

RobotUse: Allocating Computation, Context, and Decisions

Robot agents must connect their intended actions to observed outcomes while retaining the context needed to revise their choices over repeated attempts. Existing interfaces often leave these choices inside predefined tools or require agents to manage detailed execution code and its growing history. We introduce RobotUs...

Junhoo Lee, In-Chang Baek, Seungyeon Kim et al. · 0 citations
Preprint Sep 2026

RecastVLA: From Past Interaction to Future Control with Adaptive Policy States

Sequential manipulation requires a robot to track what has already happened, even when the current scene no longer reveals it. Policies with explicit history representations make past interactions available as context for current decisions. We ask how action generation itself can form a persistent state for subsequent...

Wen-Bo Li, Jun Yang, Yi-Teng Chen et al. · 0 citations

When Successful Strategies Fail: Adaptation to Environmental Novelty in Terminal Agents

This work introduces AGNI, an automated pipeline that extracts trajectory-relevant assumptions, injects targeted environmental changes, and validates that the resulting novel tasks remain solvable and highlights a gap between task competence and adaptive capability and motivate environmental variation as a core dimensi...

Janvijay Singh, Vaishnavi Shrivastava, Dilek Hakkani-Tur et al. · 0 citations
#artificial intelligence Preprint Sep 2026

IndustrialVLA-Bench: A Traceable Multi-Axis Evaluation of Open Robot Policy Models

IndustrialVLA-Bench is presented, an evidence-aware evaluation of six released VLA and WAM systems under a unified reporting schema that evaluates clean capability on LIBERO, non-language robustness on LIBERO-Plus, instruction sensitivity on LIBERO-Para, and observed execution cost.

Yi-Qi Wang, Zhi-Feng Rao, Jia-Qi Zhang et al. · 2 citations · ⚡1

Related blog posts

MIT News · Artificial Intelligence Nov 13, 2026

Helping robots fit into the human workplace

Founded by Anthony Jules ’92, SM ’92 and Professor Emeritus Rodney Brooks, Robust AI’s robots are designed to collaborate with humans in factories and warehouses.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.