Skip to content
Preprint

Safe Task Planning with Long-Term Graph Memory for Embodied Agents

Sep 2026 · 1 citation · 70 references
Computer Science

TL;DR

A novel safe task-planning framework, SafeMem, which constructs and maintains a long-term semantic graph memory of the open and dynamic environment, and substantially improves safe success rates compared to state-of-the-art VLM-driven task planners.

Abstract

Large language models (LLMs) and vision-language models (VLMs) have significantly advanced zero-shot task planning for embodied agents. However, most LLM- and VLM-driven methods struggle to generate safe high-level actions due to a lack of physical risk awareness, particularly under partial observability, where hazards lie outside the immediate field of view. To address this challenge, we propose a novel safe task-planning framework, SafeMem, which constructs and maintains a long-term semantic graph memory of the open and dynamic environment. Based on egocentric observations, the proposed framework incrementally accumulates knowledge about surrounding objects and their relationships with a graph. Then, an LLM-based risk predictor evaluates candidate actions using the graph memory, triggering a conservatism-modulated replanning loop with explanations for detected hazards. Extensive experiments on the IS-Bench benchmark and a real-world robot platform demonstrate that the SafeMem framework substantially improves safe success rates compared to state-of-the-art VLM-driven task planners. Video results are available on our webpage: https://sites.google.com/view/safemem.

View source

Similar papers

Preprint Oct 2026

From VLM Planners to Robotic Agents: Self-Evolving Harnesses for History-Dependent Manipulation

Vision-language-action (VLA) models achieve strong performance across embodied manipulation tasks by unifying visual understanding, language conditioning, and action generation. However, long-horizon tasks can involve non-Markovian dependencies: successful decisions may require retaining task progress and past interact...

Ting-Wen Du, Hao-Yu Guo, Han-Xue Zhang et al. · 1 citation

SAGE: Symbolic Action-Gating and Editing for LLM Task Planners

SAGE (Symbolic Action-Gating and Editing), a single-LLM planner built from two lightweight mechanisms: a domain-agnostic symbolic gate that blocks precondition-violating actions with typed reasons as a runtime safety monitor, and a local edit that regenerates only the failed sub-goal's suffix, keeping completed and unt...

T. Bui, Jongsul Moon, Youngouk Kim et al. · 0 citations
Sep 2026

HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness

This work introduces HarnessVLN, a zero-shot, training-free framework that unifies instruction-following and object-goal navigation through a shared Agent Harness and demonstrates its applicability to both navigation tasks in real-world environments.

Yang Chen, Li-Rong Che, Zhen-Yu Huang et al. · 8 citations · ⚡2
Preprint Oct 2026

SimpleVLN: Towards Simple and Frontier Vision-Language Navigation

Vision-and-Language Navigation (VLN) requires embodied agents to ground language in visual observations and make long-horizon decisions. Existing methods often address these demands through task-specific architectures. As multimodal large language models (MLLMs) become increasingly capable, an important question remain...

Ling-Yi Hong, Wei-Ren Cai, Jia-Yu Chen et al. · 1 citation
#artificial intelligence Preprint Oct 2026

M-Plan: Comprehensive Planning For LLM Agents with Memory Arrangement

M-Plan is proposed, a closed-loop MAS framework that integrates long-term and short-term memory that enhances agents' performance on multi-turn tasks while maintaining a plug-and-play design and outperforms multiple baseline methods in both accuracy and efficiency.

Zi-Yang Liu, Jiakang Yuan, Jiayuan Fan et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.