Skip to content
#robotics Preprint

ORPA: Online Residual Policy Adaptation for Robot Manipulation Control with Human Feedback

Aug 2026 · 0 citations · 21 references
Computer Science

Abstract

Robotic manipulation policies trained via imitation learning, such as Action Chunking with Transformers (ACT), can achieve strong performance under ideal conditions but often remain sensitive to small execution errors and distribution shifts. Correcting these failures typically requires dataset aggregation and full-policy retraining, which is computationally expensive and unsuitable for real-time deployment. In this work, we propose Online Residual Policy Adaptation (ORPA), a framework that enables immediate, feedback-driven correction of robot actions without modifying the underlying policy parameters. ORPA augments a pretrained control policy with a lightweight, feedback-conditioned module that predicts residual adjustments directly in joint space, allowing the system to adapt its behavior at runtime. We evaluate ORPA on a set of precision-sensitive manipulation tasks using the ALOHA platform, demonstrating improvements in success rate and recovery from small perturbations compared to baseline control policies and rule-based inverse kinematics corrections.

View source

Similar papers

#artificial intelligence Review Apr 2023

Transformer-Based Autonomous Driving Models and Deployment-Oriented Compression: A Survey

This survey reviews representative Transformer-based autonomous driving models and organizes them by task role, sensing configuration, and architectural design and analyzes how efficiency constraints reshaping model design choices in practice affects deployability, robustness, and safety.

J. Zhong, Zheng Liu, Xiangshan Chen · 21 citations

FlowCorrect: Efficient Interactive Correction of Generative Flow Policies for Robotic Manipulation

The results clearly demonstrate that FlowCorrect learns from very few demonstrations and enables fast, sample-efficient, incremental, human-in-the-loop corrections of generative visuomotor policies at deployment time in real-world robotics.

Edgar Welte, Yitian Shi, R. Wolf et al. · 4 citations
#artificial intelligence Conference Sep 2025

Spatial-Semantic Reasoning using Large Language Models for Efficient UAV Search Operations

A real-time semantic navigation framework for Unmanned Aerial Vehicles (UAVs) focused on improving time efficiency in the Object Goal Navigation (ObjectNav) task, using a Large Language Model that interprets user-provided natural language instructions and performs semantic reasoning over detected objects and spatial context to prioritize high-probability search regions.

Marin Maletic, Marijana Peti, T. Petrović et al. · 3 citations
#artificial intelligence Preprint Jul 2026

Mask2Real-WM: Segmentation Masks as a Sim-to-Real Bridge for Controllable Dexterous World Models

Mask2Real-WM is presented, a two-stage action-conditioned world model for dexterous manipulation that decouples pixel prediction into a dynamics model and a rendering model that shows that mask conditioning and simulation pretraining are both required for per-DoF action controllability across all 23 degrees of freedom.

Riccardo Feingold, Davide Liconti, Chenyu Yang et al. · 1 citation

Planning-aligned Token Compression for Long-Context Autonomous Driving

This work proposes COMPACT-VA, a planning-aligned working memory framework built on conditional VQ-VAE, compressing extended context into bounded representations, and evaluates on high-signal dynamic scenarios where historical context is most critical for behavior correctness, and accordingly design behavioral metrics.

Zhixuan Liang, Yuxiao Chen, Yurong You et al. · 1 citation

Related blog posts