PDRVLA is introduced, whose lightweight Physical Dynamics Module extracts physical tokens from vision--language features to condition action generation without online video generation, andlations show improved future prediction with world-model supervision and evaluate how subtask conditioning, future object-pose super...
Han-Qing Wang, Zhao-Tian Cai, Ruichuan An et al.· 0 citations
Tactile sensation is essential for contact-rich manipulation tasks. It provides direct feedback on object geometry, surface properties, and interaction forces, enhancing perception and enabling fine-grained control. An inherent limitation of tactile sensors is that readings are available only when an object is touched....
Seongjin Bien, Carlo Kneissl, Tobias J\"ulg et al.· 0 citations
NablaEngine and $\nabla$Mimic are released as open-source infrastructure for first-order humanoid policy learning and it is shown that exact gradients of the simulator itself do better, once two obstacles are removed.
SACQ is introduced, an ultra- low-bit weight-only vector-codebook quantization framework for VLAs that combines structure-aware codebook fitting with role-specific quadratic metrics that reflect input statistics and downstream sensitivity.
Haesung Lee, Insu Han· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Mechanistic interpretability to E2E driving is applied by training Sparse Autoencoders on the internal activations of a simple, single-camera end-to-end path planning model, revealing interpretable structure aligned with route intent, vehicle speed, and braking behavior.
Manav Gagvani, Benjamin Namikas, Sivamurugan Velmurugan et al.· 0 citations
AquaProbe separates newly introduced divergence from that accumulated through a frozen vision encoder using paired clean and physically rendered images and allocates a fixed LoRA budget according to the measured profile.
Md Minhajul Islam Shovo, Nishi Kanta Paul, T. Dong et al.· 0 citations
FOCUS is introduced, which combines local optimal-transport alignment with short-horizon differentiable actor-critic learning and improves sample efficiency and training stability over adversarial imitation-from-observation methods and prior differentiable imitation baselines.
João A. Cândido Ramos, Lionel Blondé, Hugues Vinzant et al.· 0 citations
This work proposes a specification-aware action distribution optimization framework that enforces a broad class of Signal Temporal Logic constraints during execution of a pretrained robotics foundation model without modifying its parameters.
Sadik Bera Yüksel, Derya Aksaray· arXiv.org· 0 citations
Self-driving laboratories (SDLs) accelerate scientific discovery by automating experimental execution and optimization. AI agents can increasingly propose new experiments, but existing SDLs can only run the procedures they were built for. Adapting them to a new experiment still requires extensive manual engineering, wh...
Jiaru Bai, Yuchi Zhao, Han Hao et al.· 0 citations
A universal controller for any robot morphology would greatly improve computational and data efficiency. Steps have been made towards such multi-robot control by utilizing contextual information about the properties of individual robots and exploiting their modular structure in the architecture of deep reinforcement le...
Laurens Engwegen, Max Weltevrede, Caroline Horsch et al.· 0 citations
This work introduces ID-WM (Implicit Dynamics World Models), a hierarchical world model that decouples state-space reachability from local control and yields a 135% performance gain over single-level world model MPC, particularly in complex, unseen configurations for long-horizon tasks.
Gao-Yue Zhou, Yvonne Wu, Zichen Jeff Cui et al.· 0 citations
RoboArchitect shows that harness design can be automated, offering a strong alternative to finetuning on a novel setup, and its design can be effectively automated and optimized without weight updates.
Sheng-Guang Wu, Su-Ning Huang, Cherie Ho et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.