World Action Agent is presented, a multi-agent harness through which VLMs pilot robots with basic tools, making every decision within a visual action workspace, outperforming end-to-end VLAs, code-as-policy agents, and a visual-harness baseline with the same backbone.
Ye-Hang Zhang, Hao-Jian Huang, Yi-Fan Chang et al.· 4 citations
MorphIK is a flow-matching model that solves inverse kinematics for revolute-joint-based kinematic chains it has never seen during training, and allows learning and generalizing neural inverse kinematics for a multitude of known and unknown robots.
Lennart Clasmeier, Jan-Gerrit Habekost, C. Weber et al.· 0 citations
An operational taxonomy, a coverage comparison against the eight closest surveys, an evaluation loop that isolates the advantage of prediction, and an actionable protocol of four advantage-aware metrics anchored on named testbeds are contributed.
Gaytri Jena, Kapil Wanaskar, Vinija Jain et al.· 0 citations
MISCO is developed, a novel evolutionary framework empowered by deep generative models to optimize VSR designs with theoretical guarantees that represents a step change towards more scalable and reliable soft robot development.
Jun-Ru Song, Huan Xiao, Yang Yang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work presents RoboLDA, a Bayesian probabilistic model that decomposes VSR morphology generation into a four-level hierarchy:"task-robot-organ-voxel", and is trained via variational inference, which pioneers hierarchical generative modeling of robot morphology.
Jun-Ru Song, Yang Yang, Jing-Dan Shi et al.· 0 citations
The results suggest that the frontier of Physical AI depends not only on stronger action models, but also on executable harnesses that integrate perception, task understanding and reasoning, and action execution into a unified, verifiable, and feedback-driven system.
X. Wang, Wen-Hao Wu, Meng-Hao Zhang et al.· 5 citations
DAWN is a noise-robust perception framework for legged locomotion which builds noise robustness directly into a world model via two modifications: feeding noisy depth to the encoder while keeping clean depth as the reconstruction target, forcing the model to implicitly denoise its input.
Yo-Han Choi, Min-Jun Kim, Jin-Sung Kim et al.· 1 citation
This work proposes an LLM chaining architecture that separates instruction classification and action generation into two specialized stages, reducing per-inference prompt length by approximately 45% while improving planning consistency.
Lucas Da Mota Bruno, Jiahao Sim, Y. Hagiwara· 0 citations
This work proposes embodiment-conditioned safety filtering, in which a Hamilton-Jacobi reachability-based value function and its corresponding safety-maximizing policy are shared across robots, and performs Hamilton-Jacobi reachability analysis directly in latent space so that the learned safety concepts can generalize...
This work introduces a unified formalism for proactive robot assistance, organize it into three levels, and provides a framework to address the highest level of unprompted proactive assistance, and presents a method, GAP, that instantiates the framework, learning from passive observation to anticipate user goals and ac...
KeyGen is introduced, a framework that learns canonicalized semantic 3D keypoints from point clouds and uses them as structured object-centric representations for policy learning to predict full manipulation trajectories, enabling consistent geometric correspondence across object instances.
Shu-Xin Cao, Liquang Wang, Masoud Moghani et al.· 1 citation
This paper investigates temporal neural networks for \mbox{end-effector} position \mbox{estimation} of an aerial continuum manipulator (ACM) operating under aerodynamic effects induced by the unmanned aerial vehicle (UAV). An experimental dataset is collected under stationary (\mbox{rotor-off}) and \mbox{free-hovering}...
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.