This work introduces skill-space shooting, which uses foundation model guidance to explore corrections through reusable skills and turn successful trials into policy improvement, and enables scalable and generalizable policy improvement within and across tasks.
Zi-Hang Rui, Ren-Hao Wang, Hao-Xu Huang et al.· 0 citations
Autonomous vehicles interacting with passengers through natural language must reason beyond immediate commands. Passenger intent may span multiple stages of behavior, depend on future events, refer to surrounding agents or landmarks, and remain relevant as driving conditions evolve. Existing language-enabled driving da...
Parthib Roy, Yashpal Tandon, Marcus Blennemann et al.· 0 citations
EgoGears, a complementary single- and multi-video benchmark designed to diagnose this transition inodied systems, is introduced and 29 single-video and 31 multi-video MLLM configurations across six model families in the main leaderboard are reported.
Yue-Dong Tan, Lei-Tao Qi, Yu Liu et al.· 0 citations
Average performance on routine driving benchmarks does not establish planner reliability under rare, safety-critical hazards. We proposed ExceptionDrive, a counterfactual planning benchmark that uses VLM-assisted screening, localized multi-view editing, and quality auditing to insert hazards into real nuScenes scenes w...
Zi-Yin Luo, Zhe Sun, Ye-Hao Lu et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work introduces RoboSkill, a framework that connects skill acquisition and reuse through an Explore, Execute, Evolve loop, and complements vision with tactile feedback to reduce uncertainty during physical interaction and augment textual guidance with reusable code to reduce reasoning overhead during skill reuse.
Si-Cheng Xie, Yi-Tong Chen, Hai-Dong Cao et al.· 0 citations
An edge-centric, semantic-aware coverage planning framework that integrates aerial terrain perception, robot-specific traversability reasoning, and payload-efficient semantic state sharing is proposed, motivated by AI-enabled goal-oriented communication envisioned for AI-native 6G networks.
Credit-Guided Policy Improvement (CGPI), which recovers signed, reference-relative decision credit from action-induced observation transitions without external outcome feedback from action-induced observation transitions without external outcome feedback is proposed.
Yang Li, Si-Jia Zhang, Yi-Han Li et al.· 0 citations
Large language models (LLMs) are increasingly used as high-level planners in robot navigation, but their outputs may become unreliable when instructions are ambiguous, unsupported by the environment, or semantically inconsistent. This paper presents a Risk-Aware Semantic Grounding framework for trustworthy LLM-based ro...
Łukasz Sobczak, Nur Keleşoğlu, S. Nowak· 0 citations
Video2STL is presented, a framework that converts observation-only videos into parametric Signal Temporal Logic (STL) specifications and uses the resulting formal representation for robot learning, and supports cross-embodiment transfer from human or animal videos to robot control.
Merve Atasever, Keyan Azbijari, Cagan Bakirci et al.· 0 citations
This work introduces ENCORE, which gives the agent a few demonstrations as evidence to read rather than as training data, and shows that on RoboDojo tasks whose instructions leave the goal unstated, no program succeeds without demonstrations.
Yi-Fan Kang, Zihan Wang, Zhi-Wen Fan et al.· 1 citation
P predictive visual latents are established as a foundation for effective WAM learning from task-specific demonstrations and for transferring future-modeling knowledge acquired from broader in-the-wild videos.
Yang Zhang, Jiang-Yuan Zhao, Chen-You Fan et al.· 3 citations
EgoHumanoid-V2 is presented, the first egocentric human-to-humanoid skill transfer framework for coordinated whole-body loco-manipulation, which improves end-effector pose accuracy while preserving whole-body coordination and uses robot-arm rendering and training-time image augmentation to reduce the visual embodiment...
Jin Chen, Yi-Ming Jiang, Chong-Yang Xu et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.