Skip to content

The Memory Trust Gap: Capability-Dependent Failures in Persistent-Memory Agents

Sep 2026 · 1 citation · 17 references
Computer Science

TL;DR

This work evaluates a frozen, closed-set, action-scored benchmark with 2 suites that represent 2 different meanings of "no memory", finding that at the 3 smaller scales, models trust a stale document more than a stale memory; at 8B, the difference is not significant.

Abstract

Persistent memory supports personalized agents, but a stale stored fact can override current authoritative evidence without warning. We study when this harm begins as model capability changes. We evaluate a frozen, closed-set, action-scored benchmark with 2 suites that represent 2 different meanings of"no memory"(a Benefit suite, unsolvable without the stored fact, and a Safety suite, in which an authoritative tool always holds the correct value), on a same-family model-size series (Qwen3 0.6/1.7/4/8B). The Memory Trust Gap reflects over-trust rather than confusion. In the Benefit suite, models answer with the stale value 0.92-1.00 of the time at every scale. In the Safety suite, harm below the no-memory baseline under the trap conditions ($\Delta_{\mathrm{mem}}$) is capability-gated, with the larger models collapsing most once a stale note is made to look current. In a $2\times2\times2\times2$ factorial, which feature triggers over-trust depends on both the feature and model scale. Removing a label amplifies over-trust at every size, and a recency feature (stale dated newer) fools the larger models harder. Source authority is weak and scale-flat, and position changes from positive to negative across the Qwen3 model-size series. We confirm these scale interactions with direct cross-size contrast tests rather than overlapping per-model intervals. Mitigation is likewise capability-dependent: exposing metadata improves accuracy for the capable models, but only pre-resolving the conflict restores accuracy for the 2 smaller checkpoints. The same pattern appears on the capable models in an independent Llama-Instruct model-size series and on 2 external datasets (RGB, MisBench). A framing control finds no consistent advantage for the memory label: at the 3 smaller scales, models trust a stale document more than a stale memory; at 8B, the difference is not significant.

View source

Similar papers

Preprint Aug 2026

TEPA: Revoking Stale Memories for Conflict-Robust Language Agents

The introduction of TEPA, a revocable evidence-memory mechanism that makes validity an explicit state of memory, and the results establish lifecycle revocation as a core memory operation for agents that must falsify, audit, and later re-promote evolving knowledge.

Yan Zhou, Yue Ouyang, Kaiyang Zheng et al. · 3 citations · ⚡1
Preprint Aug 2026

MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governance

Averaged over five seeds, MemGuard achieves the best success metric and lowest average steps in all 16 backbone-benchmark settings, improving over ReasoningBank, the strongest prior baseline among the memory methods the authors evaluate.

Hao-Yu Wang, Guang-Yuan Dong, He Liang et al. · 4 citations
#artificial intelligence Preprint Sep 2026

The Delegation Danger Band: Why Mid-Capability Sub-Agents Over-Trust Inherited Stale State

Agent frameworks increasingly delegate work by forking sub-agents; a common default makes the child inherit the parent's full working context. We measure how the effect of inherited state changes with capability, where $C_m$ denotes clean fork-fresh accuracy. We compare 3 inheritance policies: Reset (fork fresh: base e...

Jun-Hao Hu, S. Ramachandran · 0 citations
Preprint Sep 2026

TRACE: Governing Memory Validity in Evolving Multi-Agent Systems

TRACE is presented, a training-free layer that treats re-entry as an eligibility decision rather than a storage or retrieval operation, reconciling a departure checkpoint against absence-period updates, resolving explicit and implicit invalidation, and releasing a bounded Return View only when it covers the returning r...

Wen-Jun Xiong, Shengtao Zhang, Shangding Gu et al. · 0 citations
Review Sep 2026

Reputation as Community Memory for the Agentic Web

Agents can now externalize experience into memory, consolidating historical traces into semantic knowledge and procedural shortcuts that persist between sessions. Such memory is typically private to a single agent. We argue that agentic memory benefits from being collective, because trustworthy knowledge of the shared...

Ryan Chard, Gus Ellerm, Alexander Brace et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.