Across 32 paired scenarios in a self-constructed simulation benchmark, AquaMend recovers in 28/32 cases and reduces mean complete loss by 21.6% versus restart, and its paired loss difference from decision-theoretic troubleshooting (DTT) is not statistically significant after Holm correction.
Abstract
Physical changes or sensing errors can invalidate embodied agents'task-relevant beliefs. AquaMend compares re-probing, rollback, and supported continuation on a probe-belief-action graph under an expected-loss objective covering sensing, physical recovery, and uncorrected failures. A joint posterior guides a one-step policy with conditional detection-power screening. The per-belief three-way optimum requires independence, separability, and fully resolving probes; the general policy has no global optimality guarantee. Across 32 paired scenarios in a self-constructed simulation benchmark, AquaMend recovers in 28/32 cases and reduces mean complete loss by 21.6% versus restart. Its paired loss difference from decision-theoretic troubleshooting (DTT) is not statistically significant after Holm correction. Against the all-candidate ablation, online decision time decreases by 12.3% overall but increases by 3.4% in the uncovered late stage.
Long-horizon agents often struggle to recover from failures whose causes lie several steps earlier, beyond what local reflection or backtracking can resolve. We introduce BELIEFWEAVER, a framework that combines persistent evidence across attempts with prospective reasoning over repair directions. It maintains a relatio...
Xi-Yang Wu, Zhi-Chao Liu, Sheng Zhang et al.· 0 citations
Bayesian Chronicle Agents is introduced, a minimal belief layer separating what an agent believes from how it speaks, and it is shown that prescribed $\kappa$ remains recoverable after the language round-trip, with perfect rank-order recovery across all four models.
Hafsa Akbar, Daniel Platnick, Marjan Alirezaie et al.· 0 citations
Reinforcement learning for long-horizon agents relies on purely retrospective training signals: credit is assigned only after observing environmental consequences, leaving the agent's belief at action time invisible to the gradient. We introduce Prospective Hindsight (PH), a self-calibrating training principle that aug...
Jia-Xin Zhang, Xiang-Yu Peng, Qing-Lin Chen et al.· 0 citations
It is proved that the LLM paired with the BSE is a sound Markov policy on the belief MDP induced by the underlying POMDP, and inherits the Bellman optimality guarantees of classical POMDP theory, provided the LLM is never exposed to the raw history.
This work introduces Problem--Strategy Rollout Allocation (PSRA), which treats unguided and strategy-conditioned prompts as competing exploration arms and uses Bayesian sequential allocation to direct a fixed rollout budget toward arms most likely to yield informative, non-saturated groups.
Jin Cui, Xin-Yue Long, Bo-Ran Zhao et al.· arXiv.org· 1 citation
Deep-research agents conduct long-horizon investigations through iterative search, evidence evaluation, belief revision, and synthesis. However, they may commit to claims before sufficient evidence is available, causing later reasoning to reinforce an incorrect interpretation. We introduce DeepRewind, an additive contr...
Amirhossein Abaskohi, Amirhossein Dabiriaghdam, Le-Le Wang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.