Skip to content

MemTransfer: Benchmarking Memory Beyond Matched Experience in Embodied Decision-Making

Sep 2026 · arXiv.org · Vol abs/2609.32313 · 1 citation · 28 references
Computer Science

Abstract

Memory lets an embodied agent reuse past experience, yet retaining useful information does not ensure that the agent can apply it when conditions change. We present MemTransfer, a benchmark comparing six memory representations, a working-memory baseline and five representations of past experience, under a shared frozen vision-language-model policy. It comprises 100 navigation cases across ten task types in a simulated warehouse, with expert demonstrations supplying the history. Three comparisons vary the starting pose, route availability, and amount and task relevance of history. With one demonstration per task, Full-context and Episodic memory reach 95.3% and 100.0% success at the original demonstration start, but lose 48-49 percentage points at a new test start. Summary changes little between these two test starts, yet with four demonstrations per task it retains a smaller fraction of its unchanged-route success after blocking (39.3%) than Working memory (44.8%) or the two trajectory memories (56-58%). At the new test start, increasing from one to four relevant demonstrations raises Episodic success by 14.3 percentage points, while the other evaluated representations gain no more than 1.3 percentage points. Replacing half of the relevant histories with other-task experience lowers success for both trajectory memories. These results show that robustness to one kind of mismatch does not imply robustness to another, motivating evaluation of both stored information and its use at decision time.

View source

Similar papers

#artificial intelligence Review Nov 2026

Review the Episodes, Refine the Lessons: Simple Memory Evolution for Embodied Agents

Recent studies of embodied agents based on frontier multimodal large language models (MLLMs) develop harness engineering around the MLLM, such as harnesses with post-trained policies and recursive self-improvement loops. Yet whether these additions exceed the native capability of the MLLM remains unexplored. We introdu...

Yi-Fei Yao, Yu-De Zou, Xing Gao et al. · 0 citations

DolphinBench: Mapping the Pareto Frontier of Agent Memory

DolphinBench is presented, a benchmark that evaluates memory directly through an agent's task completion and requires all evaluations to report total cost and latency alongside accuracy, which enables us to evaluate agent memory systems holistically.

Soumil Rathi, Deshraj Yadav, Taranjeet Singh · 0 citations

When Successful Memories Mislead Embodied Agents:Memory Adaption For Task-Conditioned Execution

Memory Adaptation for Task-Conditioned Execution (MATE) is introduced, a deterministic post-retrieval procedure that converts trajectories into execution-oriented memory and supports memory adaptation as a distinct stage between retrieval and embodied execution.

Quan-Quan Li, Hong-Bo Zhang, Yi-He Chi et al. · 1 citation
Preprint Oct 2026

What Should Embodied Agents Remember? Benchmarking and Evaluating Memory Modality for Embodied Agents

Memory allows large language model (LLM) agents to use past experience, often stored as textual records, when responding to requests. For embodied agents that control robots, visual and spatial observations introduce a broader choice of memory modalities, affecting both the information available for subsequent tasks an...

Jun-Xiang Wang, Yu-Chen Liu, Yi Wu et al. · 0 citations

MemBodied: Recurrent Associative Memory for Vision-Language-Action Models

Findings support MemBodied as a practical alternative to expanding the policy context for history-dependent manipulation, a fixed-size episodic memory with two complementary components: an associative state that records interactions across policy calls and an episode anchor that preserves a compact representation of th...

Tej Deep Pala, N. Majumder, Bryce Goh et al. · 1 citation
#artificial intelligence Review Oct 2026

When the Past Shapes Action: Understanding Embodied Memory

This survey examines embodied memory as a mechanism for preserving decision-relevant information beyond the current observation, and provides a framework for understanding memory as an essential component of reliable, adaptive, and lifelong-horizon embodied intelligence.

Si-Qi Li, Zi-Yi Bai, Xinrun Xu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.