Skip to content

Interactive Memory Learning for Long-Term Conversations

Sep 2026 · 1 citation · 49 references
Computer Science

TL;DR

InteraCtive Memory Learning is proposed, a multi-agent framework that transforms the memory mechanism from a passive archive into a learnable, interactive memory policy that significantly outperforms strong baselines.

Abstract

Recent advancements in large language models have significantly enhanced the capabilities of agents in modeling long-term conversations. Despite these successes, existing approaches typically adopt a static heuristic paradigm, where information is passively archived without adaptive memory valuation. Consequently, these methods fail to self-evolve or align their memory management with evolving user needs. To address this, we propose ICML (InteraCtive Memory Learning), a multi-agent framework that transforms the memory mechanism from a passive archive into a learnable, interactive memory policy. Specifically, we first employ a session synthesis pipeline to generate expert data, facilitating rapid test-time adaptation in unseen scenarios. Building on this, ICML utilizes an online reinforcement learning mechanism where a Planner agent selectively encodes high-value information and a Trigger agent dynamically retrieves it to optimize response quality, whereby the two agents co-evolve through continuous interaction feedback. Crucially, both agents are synchronized through a delayed reward mechanism that propagates future feedback back to earlier storage decisions, ensuring memory policies are precisely aligned with user expectations. Experimental results demonstrate that ICML significantly outperforms strong baselines, exhibiting the unique capability to continuously improve response quality as interactions accumulate.

View source

Similar papers

ActiveMem: Dynamic Latent Memory Trees for Long-Horizon Agents

ActiveMem is proposed, a hierarchical memory framework that recursively organizes agent experiences into dependency-aware latent execution trees while explicitly preserving execution transitions, enabling coherent reasoning-path retrieval conditioned on the current execution state.

Song-Li Wu, Jing-Yi Wang, Zhao-Cheng Du et al. · 5 citations
Preprint Aug 2026

HERO: Human-profile Enhanced Retrieval Optimization Framework for Long-term Agent Memory

This work proposes a novel Human-profile Enhanced Retrieval Optimization framework for long-term agent memory (HERO), which converts the dialogue history into a traceable heterogeneous memory graph that preserves raw dialogue text as evidence for reasoning, thereby mitigating information loss.

Yuanhua Lin, Yile Li, Zhi-Yuan Zhao et al. · 0 citations
#artificial intelligence Preprint Sep 2026

How Can Recommendation Feedback Evolve Agent Memory?

Content-generation agents continuously receive impressions, clicks, conversions, and negative feedback from recommendation systems, providing real-world outcome signals for memory evolution. However, these signals are delayed and noisy, confounded by audience composition, placement, and recommendation policies, and may...

Shang-Wen Mao, Ming-Ming Li, Hao Zhang et al. · 0 citations

Coding Agent Memory Post-training: Unlocking the Memory Potential of Pre-trained File Operations for Long-Horizon Tasks via Reinforcement Learning

Coding Agent Memory Gym (CAMG), a suite of long-horizon agentic-RL environments spanning Shop, Coding, DeepResearch, and AutoResearch, which provides executable shell access and an episode-persistent workspace, enabling agents to create, revise, search, and reuse files as memory throughout an episode.

Li-Rui Luo, Ke-Long Mao, He-Ming Xia et al. · 1 citation

RPMem: Learning Long-Term Recurrent Parametric Memory Across Sessions for LLM Agents

RPMem is introduced, a two-stage architecture that compiles each session into a model-independent latent memory through forward computation and selectively integrates it with retained memory via a task-trained recurrent gate, establishing RPMem as a lifecycle-independent parametric memory framework that maintains evolv...

Fan-Yu Zhao, Rui-Ke Cao, Liang Dong et al. · 1 citation · ⚡1

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.