This survey examines embodied memory as a mechanism for preserving decision-relevant information beyond the current observation, and provides a framework for understanding memory as an essential component of reliable, adaptive, and lifelong-horizon embodied intelligence.
Si-Qi Li, Zi-Yi Bai, Xinrun Xu et al.· 0 citations
A paired protocol with empty, neutral, nonsense, infeasible, and wrong-task instructions is applied to six model checkpoints in LIBERO-Goal simulation and three methods for suppressing the start are tested.
Min-Su Jang, Jae-Woo Choi, Youngwoo Yoon et al.· 0 citations
Vision-language-action models (VLAs) map language instructions and visual observations to robot actions, showing strong capabilities across robotic manipulation tasks. However, in our probing experiment, we find that action representations near the action output do not fully preserve task-relevant visual grounding. Mot...
Guangyu Zhao, Yongchang Zhang, Haoxuan Ru et al.· 0 citations
Imitation learning policies are intended to make robotic manipulation robust to variations in object pose, appearance, and environment that challenge pre-programmed motion. However, real-world performance remains difficult to predict, as conventional optimization signals such as validation loss show no consistent relat...
Ammar N. Abbas, Aayush Jain, P. Viswanath et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
CWAM (Causal WAM), which incorporates the sparsity constraint into a pretrained WAM by adding a sparse routing path to its action head, with the world modeling objective remaining unchanged, is proposed.
Jun-Tao Cheng, Jin-Zhou Tang, Fan Feng et al.· 0 citations
Embodied surgical AI requires reliable multimodal data, yet surgical data collection remains costly, difficult to repeat, and strongly dependent on the hardware setup. We present Sensorium, an open-source Python library for recording, processing, annotating, and curating multimodal surgical data from configurable robot...
Lorenzo Mazza, Ariel Rodriguez, Stefanie Speidel· 0 citations
It is found that LLM team with a dedicated external conflict resolution protocol results in fewest breaches, and is also found that LLM team with a dedicated external conflict resolution protocol results in fewest breaches.
Khawaja Abaid Ullah, A. Acharya, M. J. Khojasteh· 0 citations
Dexterous manipulation with multi-fingered hands is the next frontier of robotics, yet learned hand skills remain limited to simple grasps or basic repeated motions, such as rotating an object. As robots attempt more demanding in-hand maneuvers, safety, such as not dropping the object, becomes critical, yet it is rarel...
Ian T. Chuang, Hiya Shah, Vamsi Chilamkur et al.· 0 citations
Embodied perception requires positional representations that capture both physical geometry and the spatial and temporal extent of observations. We introduce POD-RoPE (Physical Observation Distribution RoPE), which represents token observation footprints as distributions over camera centers, viewing directions, and sam...
Xiaodi Huang, Zilin Wang, Jinpeng Liu et al.· 0 citations
AffordSim is introduced, a scalable data generator and benchmark that integrates open-vocabulary 3D affordance prediction into simulation-based trajectory generation and achieves 93% of the trajectory collection success rate of manual contact annotations on affordance-critical tasks and 89% on hard composite tasks.
Ming-Yang Li, Hao Xu, Hao-Wen Sun et al.· arXiv.org· 0 citations
The Control Barrier Function (CBF) method has been widely adopted in solving safety-critical control problems. However, the existence of a CBF is only a sufficient condition for system safety. The recently proposed Taylor-Lagrange Control (TLC) method addresses this limitation by providing a necessary and sufficient co...
Wei Xiao, Christos Cassandras, Anni Li· 0 citations
Occupancy World Models (OWMs) aim to predict future 3D occupancy scenes from historical observations and future ego motions, providing a useful world simulation tool for autonomous driving. Existing methods usually rely on large networks to implicitly align multi-frame historical states and predict future occupancy in...
Haoran Xu, Peixi Peng, Shijun Guo et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.