Skip to content

Physics filtering favors the generalization of robot learning

Aug 2026 · npj Robotics · Vol 4 · 2 citations · 116 references
Computer Science

TL;DR

It is shown that robots can generalize effectively under dynamics uncertainties even with limited training data by leveraging a feedback mechanism, namely PhyFilter, that corrects learning outputs with physics-filtered learning residuals, and shows that physics-filtered feedback can serve as a powerful alternative to massive data scaling.

Abstract

Living organisms exhibit extraordinary adaptability to unseen environments through their intrinsic physical structures and lifelong feedback-driven learning. Endowing robots with comparable generalization is critical for reliable operation in the real world. While recent approaches attempt to improve generalization by scaling training data, such strategies remain impractical for robotics, where collecting real-world demonstrations at the scale of large language models is prohibitively costly and slow. Contrary to this reliance on massive datasets, we show that robots can generalize effectively under dynamics uncertainties even with limited training data by leveraging a feedback mechanism, namely PhyFilter, that corrects learning outputs with physics-filtered learning residuals. PhyFilter operates as a lightweight, model-agnostic module whose parameters can be automatically optimized through an auto-learning algorithm, eliminating manual tuning and enabling seamless integration with diverse robot policies. We validate PhyFilter across four representative robotic systems, demonstrating that it enables quadruped robots to generalize to unseen terrains, payload variations, and speed ranges; drones to flight under unseen wind disturbances; aerial manipulators to achieve centimeter-level in-air capture despite wind and mass uncertainties; and acceleration differentiators to remain robust with distribution shift. These results show that physics-filtered feedback can serve as a powerful alternative to massive data scaling.

Read PDF

Similar papers

Preprint Aug 2026

GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions

GeniWorld is presented, an interactive world model for robots that generalizes robustly across unseen scenarios by explicitly decoupling embodiment kinematics from environmental dynamics, and generates diverse manipulation trajectories within the world model, improving downstream policy performance and robustness in co...

Cheng-Hao Gu, Hanyang Yu, Jingbo Zhang et al. · 2 citations · ⚡2
Preprint Aug 2026

Autonomously Acquiring Robot Manipulation Skills with Language-Driven Quality-Diversity

This paper proposes an approach designed to output diverse motion primitive archives by autonomously leveraging quality-diversity algorithms, only requiring a free-form description of the task in common language, and proposes an autonomous exploration mechanism able to reliably output sets of functionals covering the f...

Émiland Garrabé, Mahdi Khoramshahi, Stéphane Doncieux · 0 citations
Open access Sep 2026

Robust Task Generalization for Dual-Arm Learning from Demonstration

A Movement Primitive learning algorithm based on Gaussian Processes, combined with real-time zero-shot adaptation through Pathwise Conditioning, which encapsulates the predictive uncertainty of the demonstrated movement using heteroscedastic GPs and utilizes an update via Matheron's rule to instantaneously adjust the t...

Adrián Prados, L. Lishan, Alberto Mendez et al. · 0 citations
Preprint Aug 2026

Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RL

This work uses Sample-based Model Predictive Control entirely in simulation as an automated, rapidly tunable expert to generate massive offline datasets and validate the robustness of this sim-to-real framework by successfully deploying complex loco-manipulation skills across different morphologies.

Martin Schuck, Maks Sorokin, S. Manni et al. · 1 citation
Preprint Aug 2026

Reward-Free Continual Adaptation for Resilient Space Robots

This work introduces a reward-free continual learning framework that leverages latent-state world models that adapts to altered dynamics without receiving new rewards across simulated planetary traversal, orbital navigation, and precision assembly tasks subjected to severe morphological failures.

Andrej Orsula, M. Olivares-Mendez, Carol Martínez · 0 citations
Conference Aug 2026

From Human Demonstrations to Robotic Actions: Real2Sim Verification of a Diffusion Policy for Autonomous Robotic Manipulation

The Universal Manipulation Interface (UMI), originally developed by the Robotics and Embodied AI Lab at Stanford University, has demonstrated remarkable effectiveness for training manipulation policies for terrestrial robotic manipulators using imitation and diffusion based learning techniques. The long term objective...

Neal D'Andrea, Joshua Wachs, A. Wade et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.