Skip to content
Preprint

AquaMend: Minimal Re-probing and Conditional Rollback for Latent-Belief Failures in Embodied Agents

Sep 2026 · 0 citations · 20 references
Computer Science

TL;DR

Across 32 paired scenarios in a self-constructed simulation benchmark, AquaMend recovers in 28/32 cases and reduces mean complete loss by 21.6% versus restart, and its paired loss difference from decision-theoretic troubleshooting (DTT) is not statistically significant after Holm correction.

Abstract

Physical changes or sensing errors can invalidate embodied agents'task-relevant beliefs. AquaMend compares re-probing, rollback, and supported continuation on a probe-belief-action graph under an expected-loss objective covering sensing, physical recovery, and uncorrected failures. A joint posterior guides a one-step policy with conditional detection-power screening. The per-belief three-way optimum requires independence, separability, and fully resolving probes; the general policy has no global optimality guarantee. Across 32 paired scenarios in a self-constructed simulation benchmark, AquaMend recovers in 28/32 cases and reduces mean complete loss by 21.6% versus restart. Its paired loss difference from decision-theoretic troubleshooting (DTT) is not statistically significant after Holm correction. Against the all-candidate ablation, online decision time decreases by 12.3% overall but increases by 3.4% in the uncovered late stage.

View source

Similar papers

#machine learning Preprint Oct 2026

Failure Recovery via Belief Updates and World Modeling for Long-Horizon Agents

Long-horizon agents often struggle to recover from failures whose causes lie several steps earlier, beyond what local reflection or backtracking can resolve. We introduce BELIEFWEAVER, a framework that combines persistent evidence across attempts with prospective reasoning over repair directions. It maintains a relatio...

Xi-Yang Wu, Zhi-Chao Liu, Sheng Zhang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Bayesian Belief Layer for Controllable Opinion Dynamics in LLM Agents

Bayesian Chronicle Agents is introduced, a minimal belief layer separating what an agent believes from how it speaks, and it is shown that prescribed $\kappa$ remains recoverable after the language round-trip, with perfect rank-order recovery across all four models.

Hafsa Akbar, Daniel Platnick, Marjan Alirezaie et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Prospective Hindsight: Self-Calibrating Reinforcement Learning via Prediction-Reality Gaps

Reinforcement learning for long-horizon agents relies on purely retrospective training signals: credit is assigned only after observing environmental consequences, leaving the agent's belief at action time invisible to the gradient. We introduce Prospective Hindsight (PH), a self-calibrating training principle that aug...

Jia-Xin Zhang, Xiang-Yu Peng, Qing-Lin Chen et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Belief-State Engine: Augmenting LLMs for Principled Planning Under Partial Observability

It is proved that the LLM paired with the BSE is a sound Markov policy on the belief MDP induced by the underlying POMDP, and inherits the Bellman optimality guarantees of classical POMDP theory, provided the LLM is never exposed to the raw history.

Arnab Chattopadhayay, Debdipta Halder · 0 citations

The Model Knows Another Way: Strategy Switching for Effective RLVR Exploration

This work introduces Problem--Strategy Rollout Allocation (PSRA), which treats unguided and strategy-conditioned prompts as competing exploration arms and uses Bayesian sequential allocation to direct a fixed rollout budget toward arms most likely to yield informative, non-saturated groups.

Jin Cui, Xin-Yue Long, Bo-Ran Zhao et al. · 1 citation
#natural language process... Preprint Sep 2026

DeepRewind: Predicting and Repairing Premature Commitments in Deep Research Agents

Deep-research agents conduct long-horizon investigations through iterative search, evidence evaluation, belief revision, and synthesis. However, they may commit to claims before sufficient evidence is available, causing later reasoning to reinforce an incorrect interpretation. We introduce DeepRewind, an additive contr...

Amirhossein Abaskohi, Amirhossein Dabiriaghdam, Le-Le Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.