Skip to content

Beyond Memory Construction: Rethinking Memory Access for LLM-based Conversational Agents

Sep 2026 · arXiv.org · Vol abs/2609.33226 · 0 citations · 62 references
Computer Science

TL;DR

This work proposes Threader, a memory system that shifts the focus from memory construction to efficient, structure-aware access over raw interactions, and preserves them as first-class memory, organizes them into topic-coherent segments via lightweight incremental segmentation, and enables accurate retrieval through multi-view representation.

Abstract

Memory is a core component of conversational agents, enabling coherent and context-aware behavior over long interactions. Recent approaches commonly rely on LLM-based memory construction, where raw interactions are rewritten into structured memory units and later retrieved via a RAG pipeline. While effective in controlled settings, we show that this paradigm breaks down in long-horizon, high-entropy conversations: memory construction becomes increasingly lossy and unstable as context length and information complexity grow, and incurs prohibitive cost due to repeated LLM invocation. To address these limitations, we propose Threader, a memory system that shifts the focus from memory construction to efficient, structure-aware access over raw interactions. Instead of rewriting interactions, Threader preserves them as first-class memory, organizes them into topic-coherent segments via lightweight incremental segmentation, and enables accurate retrieval through multi-view representation. At query time, it performs multi-signal retrieval that combines segment-level access with localized evidence matching, ensuring both completeness and coherence. Extensive experiments demonstrate that Threader consistently improves answer accuracy and evidence recall, while significantly reducing the memory construction overhead.

View source

Similar papers

Remember by Asking: Retrieval-Induced Memory Evolution for LLM Agents

RIME is introduced, a retrieval-induced memory framework that shifts memory construction from monolithic compression toward evidence-centered integration and consistently achieves the best performance across all three quality metrics among the compared methods, while requiring substantially fewer query-time LLM tokens.

Wan-Qi Zhou, Jia-Wei Lu, Yang Wang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

MemFit: Efficient Long-Term Agentic Memory

Long-term memory systems for large language models (LLMs) have gained popularity for extending reasoning capabilities across applications. Current memory systems rely on LLM agents to organize and consolidate memory, resulting in costly, inefficient write operations. To address this limitation, we propose MemFit, a lon...

Mitchell Piehl, Mu-Chao Ye · 1 citation
#natural language process... Preprint Sep 2026

JustMem: Just-Enough Memory Access for Long-Term Conversations

JustMem is introduced, which stores conversation history as compact atomic memories and adapts memory access along two dimensions to each query and achieves the highest mean accuracy and retrieval recall among the compared memory systems while using substantially fewer generative-model tokens for memory construction an...

Guan-Hua Chen, Yan-Ting Wang, Wen-Jing Zhi et al. · 1 citation
#artificial intelligence Preprint Oct 2026

Gated Memory: Admission-Controlled Memory Formation for Conversational AI

Personalized conversational AI relies on long-term memory systems that extract facts from user utterances and store them in persistent vector stores. Despite progress in retrieval, deduplication, and lifecycle management, the formation stage, the moment a fact is first written to storage has received almost no principl...

Preeti Saraswat, Divya Neelagiri, A. Manoj · 0 citations

AutoViewMem: Self-Configuring Orthogonal Views for Conversational Long-Term Memory

Experiments on the LoCoMo and PersonaMem benchmarks, under both Qwen3-8B and Qwen3-14B backbones, show that AutoViewMem improves long-horizon question answering and personalization over strong memory baselines while preserving a simple inference pipeline.

Zi-Jie Cao, Xi-Jun Qu, Zhi-Cheng Gu et al. · 0 citations
#natural language process... Preprint Oct 2026

Test-Time Memory Construction

T$^2$Mem is proposed, a Test-Time Memory construction framework that defers memory construction to inference and progressively builds memory along the reasoning process, demonstrating that deferring memory construction to inference enables the memory construction process to dynamically adapt to the information needs of...

Zi-Jun Wang, Yi-Fan Ji, Haidong Xin et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.