This work argues that their continual coordination under competing demands constitutes an important and underexplored target for modern robot learning and proposes the ethological behavioral substrate as a conceptual lens for studying this form of competence in artificial agents.
VPTwin is proposed, a Real-Sim-Real video prediction framework that anchors real-world future prediction using real-synchronized simulation twins and establishes a predictive planning loop using VPTwin to visually verify VLM-proposed actions and guide reliable real-world execution.
Zheng-Hao Xiao, Min-Ting Pan, Nan-Tian He et al.· 0 citations
A high-performing teacher is built that makes navigation evidence selection explicit and compressible, and a compact student is trained by transferring both where to attend and what to do, then further match action distributions during fine-tuning.
Zhihao Chen, Yi-Yuan Ge, Zi-Yang Wang et al.· IEEE transactions on circuit...· 0 citations
CAPEX, an experience-conditioned demonstration collection framework that uses execution experience from previous attempts to adapt how frequently the foundation model must observe, reason, and replan, is introduced and suggests that foundation models can serve as scalable sources of reusable robot experience.
Shivam Aarya, Xi-Jia Zhang, Cheng-Yue Huang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
It is found that, given task-specific natural-language guidance, VLMs can estimate actuator-response relationships, resolve ambiguous observations through intervention, and actively create informative visual feedback when signals are sparse, suggesting that pretrained multimodal models can serve as important decision-m...
Ryan Lopez, Sachin Vaidya, Seouing-Ho Choi et al.· 0 citations
The results show that inference-time parameter variation is a reliable, training-free source of path diversity, and that H-Graph hybridization reliably converts this diversity into shorter, higher quality trajectories.
RoboFoundry is proposed, the first embodied agentic framework that formulates this process of system-as-policy evolution across foundation models as Self-Evolving System-as-Policy, highlighting its potential for fully autonomous embodied agents.
Ultrasound (US) acquisition depends on the operator's ability to interpret anatomy and anticipate how the view will change with probe motion. Many robotic US navigation methods select actions without explicitly predicting these anatomical changes. We propose SonoGraph-WM, an action- and goal-conditioned world model for...
Xue-Song Li, Shuai Chen, Feng Li et al.· 0 citations
RECAST is a robot navigation framework that combines the reasoning of a VLM with the spatial grounding of vision foundation models to build an Actionable Cost map and improves success over the strongest prior method.
Incheol Cho, Jintae Park, Jinkyu Kim et al.· 0 citations
Robotic manipulation is inherently history-dependent, yet most pretrained robotic policies condition on only the current observation or a short temporal window. Equipping such policies with long-term memory remains challenging: existing approaches either feed the backbone multi-frame observation windows, which substant...
Xin-Yu Zhao, Yixiang Shan, Tao Yang et al.· 0 citations
RE-0, a recursively verified policy improvement framework, which improves both teacher-assisted execution and the standalone student, and generalizes to novel robots and scenes, and RE-OPD, which turns verified interventions into supervision for on-policy distillation.
Jia-Wei Zhang, Xiang-Rong Zhang, Rui-Ke Song et al.· 0 citations
Vision-and-language navigation increasingly relies on general-purpose semantic planners, yet translating correct high-level intent into reliable physical execution remains difficult in spatially constrained transitions. Reaching a staircase, doorway, or narrow passage does not ensure traversal; the agent must identify...
Xue-Kang Yang, Lu-Yao Chen, Shuang Luo et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.