Scaling humanoid foundation models is bottlenecked by the scarcity of robotic data. While massive egocentric human data offers a scalable alternative, bridging the cross-embodiment chasm remains a fundamental challenge due to kinematic mismatches. We introduce UniT (Unified Latent Action Tokenizer via Visual Anchoring)...
While decoupled control schemes for legged mobile manipulators have shown robustness, learning holistic whole-body control policies for tracking global end-effector poses remains fragile against Out-of-Distribution (OOD) inputs induced by sensor noise or infeasible user commands. To improve robustness against these per...
Ziyang Cheng, Haoyu Wei, Hang Yin et al.· 0 citations
Bin picking in real industrial environments remains challenging due to severe clutter, occlusions, and the high cost of traditional 3D sensing setups. We present Pickalo, a modular 6D pose-based bin-picking pipeline built entirely on low-cost hardware. A wrist-mounted RGB-D camera actively explores the scene from multi...
Alessandro Tarsi, Matteo Mastrogiuseppe, Saverio Taliani et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
In this study, we address the problem of language-guided robotic manipulation, where a robot is required to manipulate a wide range of objects based on visual observations and natural language instructions. This task is essential for service robots that operate in human environments, and requires safety, efficiency, an...
Yusuke Takagi, Motonari Kambara, Daichi Yashima et al.· 0 citations
Embodied AI agents increasingly require parallel execution of multiple tasks, such as manipulation, conversation, and memory construction, from shared observations under distinct time constraints. Recent Mixture-of-Transformers (MoT) Vision-Language-Action Models (VLAs) support such heterogeneous outputs, yet existing...
Xiangyu Li, Huaizhi Tang, Xin Ding et al.· 0 citations
Control co-design jointly optimizes a robot's physical design and its controller. Existing techniques are limited in the number of model parameters and the complexity of the physical models they can handle. In this paper, we propose a gradient-based bilevel formulation that replaces the dynamics models of earlier techn...
MoMa-SG, a novel framework for building semantic-kinematic 3D scene graphs of articulated scenes containing a myriad of interactable objects, and the Arti4D-Semantic dataset, which provides parent-child relation annotations between container and contained objects together with object axis annotations across 62 in-the-w...
Martin Buchner, Adrian Rofer, Tim Engelbracht et al.· arXiv.org· 12 citations
World models offer a promising avenue for more faithfully capturing complex dynamics, including contacts and non-rigidity, as well as complex sensory information, such as visual perception, in situations where standard simulators struggle. However, these models are computationally complex to evaluate, posing a challeng...
Joseph Amigo, Rooholla Khorrambakht, Nicolas Mansard et al.· 0 citations
Likelihood-based policy gradient methods are the dominant approach for training robot control policies from rewards. These methods rely on differentiable action likelihoods, which constrain policy outputs to simple distributions like Gaussians. In this work, we show how flow matching policy gradients, a recent framewor...
Achieving highly dynamic parkour with humanoid robots on complex terrains unseen during the pre-training stage remains a challenge in robotics. Although general locomotion policies demonstrate capabilities across broad terrain distributions, they often struggle with arbitrary and highly challenging environments. To ove...
Shaoting Zhu, Baijun Ye, Jiaxuan Wang et al.· 0 citations
NeuroVLA is introduced, a brain-inspired architecture that couples a cortical vision-language planner to recurrent cerebellar modulation and a stateful spiking spinal controller that translates semantic intent into actions while incorporating high-frequency proprioceptive and force feedback, maintaining short-term moto...
Wei-Yu Guo, He Zhang, Peng-Teng Li et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.