Gym-Anything for Robotics is introduced, a framework in which coding agents create realistic robotics simulations and introduces several new ways for frontier models to improve, including in-context learning across repeated attempts, a privileged teacher that reads the simulator state and teaches a student in context,...
BURGER is introduced, a language-conditioned robotic drawing benchmark with a scalable, prompt-driven pipeline for generating continuous drawing trajectories, both in simulation and the real world, revealing distinct failure patterns across VLA models.
Xiang-Yu Xu, Bang-Shuai Peng, Zi-Yi Liu et al.· 0 citations
Large language model (LLM) agents for personal health read wearable data and recommend, but do not learn about the individual in a way that can be audited or falsified. We present EpiCoach, an agentic system that treats one athlete, a cross-country mountain biker, as the subject of accountable N-of-1 science. Claims ab...
This paper proposes a hybrid MPC and RL framework for highway driving in autonomous trucks, where a finite-horizon MPC, solved via dynamic programming, uses a pre-trained RL model for terminal cost estimation.
Hooman Hamze, Benjamin Houshmand, Deepthi Pathare et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Robot foundation models increasingly rely on flow-based action generation for general-purpose manipulation, yet the generated actions are not guaranteed to satisfy physical constraints such as joint limits and collision avoidance. This problem is especially challenging when the feasible set cannot be described analytic...
Jianming Ma, Rongjun Jin, Yizhi Chen et al.· 0 citations
Universal Manipulation Interface (UMI) devices allow human experts to demonstrate tasks for robot learning without teleoperating physical robots. Using these demonstrations as training data still requires a consistent hardware setup, calibration, and data processing. We present UMI-Live, a full-stack open-source bimanu...
Govind Velamoor, Adrian Lin, Sam Jung et al.· 0 citations
Predicting future physical states stands as a central challenge in embodied intelligence. Existing video world models leave 3D dynamics implicit, action-based formulations remain tied to specific robot configurations, and 3D motion prediction models use flow-only supervision, providing a limited learning signal for phy...
Yu-Hao Lu, Jiong-Xu Chen, He-Xiang Wei et al.· 0 citations
Experience can help embodied agents turn high-level plans into grounded actions, but transferring it across tasks remains challenging: previously effective strategies may be inapplicable to the current state or fail to produce their intended outcomes. We present EmbodiExp, a framework for constructing transferable expe...
Zhifeng Gu, Ying Chen, Rui Jiang et al.· 0 citations
Tactus is presented, a textile-integrated sensing glove that co-optimizes three design pillars: a thin, conformal 3D-knit form factor, strategically placed capacitive tactile sensors at manipulation-relevant regions informed by empirical contact studies, and IMU-fused pose tracking that maintains accuracy through the h...
Li Guan, Rachael Granberry, Sahar A. Aseeri et al.· 0 citations
AtomTree is presented, a hierarchical framework for state-aware task planning with LLMs that incrementally builds a tree of subgoals and actions, where the LLM decides at each step, from the current symbolic state, whether to further decompose or to output a grounded low-level action.
Joint-embedding predictive architectures (JEPAs) learn to predict representations rather than pixels, offering a compact way to model how visual scenes evolve. We ask whether this predictive objective improves closed-loop control when a vision-language-action (VLA) policy already uses V-JEPA features. We call our JEPA-...
Rufeng Xiao (VLA Research Team, Synthoid.ai), Ruihao Xiao (VLA Research Team et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.