Skip to content
Preprint

An Agentic Framework for Proactive Robots with Procedural Assistance Memory

Oct 2026 · 1 citation · 57 references
Computer Science

TL;DR

A memory-based agentic framework in which a VLM task predictor reads a Procedural Assistance Memory alongside the current observation to decide when to assist and what task to perform, and a VLA executor performs the predicted task.

Abstract

Proactive robots should anticipate user needs and provide assistance before being explicitly asked. A straightforward approach is to infer human intentions from commonsense knowledge, but the same observed behavior can imply different needs across users, potentially leading to unwanted assistance. We observe that everyday routines in the real world exhibit recurring patterns, so learning these patterns can reduce ambiguity in proactive decisions. Based on this, we propose a memory-based agentic framework in which a VLM task predictor reads a Procedural Assistance Memory (PAM) alongside the current observation to decide when to assist and what task to perform, and a VLA executor performs the predicted task. PAM is structured as a finite-state machine over activity phases, per-state assistance rules, and event-driven transitions; a reflection VLM revises PAM from each day's interaction trace without weight updates or retraining. In our 5-day desk-assistance evaluation, memory-free baselines remain conservative, with limited recall on proactive tasks. Our system improves consistently with accumulated experience, achieving the highest precision, recall, and F1 and reducing first-fire delay from approximately 5 seconds on Day 1 to 1 second by Day 5. Our approach also adapts to changes in the user's routine through continued memory reflection, recovering from memory--routine misalignment after a single memory update. The project page is available at https://davian-robotics.github.io/PAM/

View source

Similar papers

Preprint Oct 2026

Proactive Robot Assistance via Event-Driven Reasoning over State Changes

An event-driven framework that monitors workspace state changes with an event monitor and, upon event completion, extracts stabilized pre/post snapshots that characterize the resulting state transition achieves performance comparable to variants given user instructions.

Feng-Kai Liu, Hao Su, Hao-Zhuang Chi et al. · 1 citation
Preprint Oct 2026

ProactiveVLA: Augmenting Embodied Memory through Proactive Environment Exploration

Rapid adaptation to a new environment requires a robot to acquire useful knowledge about local objects, states, and interactions from limited experience. Systems that combine a reasoning agent with a frozen vision-language-action model (VLA) can adapt through execution feedback and memory, making the choice of experien...

Shi-Zuo Tian, Hao-Dong Luo, Yu-Tong Li et al. · 1 citation

Robots That Take Initiative: A Framework for Building and Evaluating Proactive Robots

This work introduces a unified formalism for proactive robot assistance, organize it into three levels, and provides a framework to address the highest level of unprompted proactive assistance, and presents a method, GAP, that instantiates the framework, learning from passive observation to anticipate user goals and ac...

Maithili Patel, Sonia Chernova · 0 citations
Sep 2026

In-Context Robot Learning with VLM Agents

GPT-Policy is introduced, a general-agent framework for in-context robot learning that integrates a context compiler that preserves task-relevant visual transitions, a VLM that proposes robot-tool actions, and a constrained controller that verifies and executes each action and reports its outcome.

Dong-Zhou Cheng, Taoran Yi, Ye Fang et al. · 16 citations · ⚡4
Preprint Oct 2026

RobotUse: Allocating Computation, Context, and Decisions

Robot agents must connect their intended actions to observed outcomes while retaining the context needed to revise their choices over repeated attempts. Existing interfaces often leave these choices inside predefined tools or require agents to manage detailed execution code and its growing history. We introduce RobotUs...

Junhoo Lee, In-Chang Baek, Seungyeon Kim et al. · 0 citations
Preprint Oct 2026

RoboDoctor: Training-Free Recursive Self-Improvement for Robot Policies

Generalist robot policies and language-model agents provide complementary capabilities, but completing a task also requires adapting their use to the consequences of physical interaction. We study execution as a locus of adaptation: feedback guides the current action and supplies evidence for revising subsequent decisi...

He-Yang Yu, Hao-Min Li, Si-Hang Li et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.