Robot tasks require grounding spatial language in physical scenes, but task success alone cannot establish whether spatial instructions are followed. We present BEHAVIOR-Spatial, a benchmark built on BEHAVIOR-1K that measures spatial question answering, point-based target grounding, and robot action to examine how VLM...
Sirui Chen, Huang Huang, Qineng Wang et al.· 2 citations· ⚡1
In generative recommendation, position has two distinct meanings: an event’s order in the sequence and its wall-clock time. Existing approaches usually inject temporal information through auxiliary embeddings or relative attention biases, while vanilla RoPE captures only order. We revisit RoPE for generative recommenda...
Xiao-Kai Wei, Jia-Jun Wu, Dai-Yao Yi et al.· Proceedings of the 20th ACM...· 2 citations· ⚡1
Early successes on agentic robotics point to a potential paradigm shift toward using coding agents to control robots. Existing robotics benchmarks are built around visuomotor policy learning, leaving it open whether coding agents can reliably control diverse robots under physical-world constraints. We therefore introdu...
Kang-Rui Wang, Qineng Wang, Chang-He Chen et al.· 0 citations
DyCraft, a system for animated 3D scene generation that breaks animation into steps that coding agents can more reliably solve, substantially reduces physical violations and generates higher-quality animated 3D scenes that are more often preferred by human raters.
Jeff Tan, Hang Dai, Ze-Qian Long et al.· 0 citations
This work proposes Distillation through Reasoning Path Compression (D-RPC), which constrains the teacher to follow a compact, dynamically maintained bank of reusable high-level reasoning paths, and achieves the highest average accuracy among the evaluated distillation methods.
Vision-language-action (VLA) policies trained on large datasets are capable within their training domains, yet they still fail to generalize to the variety of situations a robot meets in real-world deployment. Agentic robot systems complement the policy with a vision-language model (VLM) orchestrator that learns when t...
Xi-Lun Zhang, M. Wang, Erik Bauer et al.· 1 citation· ⚡1
The diversity of robot embodiments and action spaces makes it challenging to build robot world models that generalize across different embodiments. We introduce the Latent Action-Conditioned Robot World Model (LAC-WM), which operates within a learned unified latent action space shared across diverse embodiments. This u...
Huang Huang, Sriram Yenamandra, Arjun Majumdar et al.· 4 citations
T2-Z is introduced for test-time optimization of environment latents, which augments a robotic world model with a learnable environment latent to condition world predictions, and can efficiently infer environment latents from as little as a single test-time interaction trajectory.
Chen-Yuan Zhou, Yi-Ning Hong, Huang Huang et al.· 0 citations
Results demonstrate that generative video rendering mitigates the visual sim-to-real gap for zero-shot policy transfer, and shows that policy performance improves with more generated videos per simulation trajectory, increasing opening-task success by 65 percentage points.
Huang Huang, Wen-Si Ai, Zi-Yu Chen et al.· 0 citations
Policies trained offline from teleoperated demonstrations can degrade outside their training distribution. This gap is particularly acute in long-horizon whole-body mobile manipulation, where long horizons amplify compounding errors and coordinated arm, torso, and base motion makes exhaustive demonstration coverage imp...
Wen-Si Ai, Christopher Luey, Karthik Dharmarajan et al.· 0 citations
DressAgent is introduced, a hierarchical agentic system that recovers garment sewing patterns through planning and closed-loop refinement grounded in physical simulation that outperforms feed-forward methods by a large margin, surpasses or matches differentiable optimization in a fraction of the time, and generalizes t...
Nan-Xiang Jiang, Yu-Nuo Chen, Zeng Tao et al.· 0 citations
World-action models (WAMs) couple future prediction with robot control, yet existing systems often vary the video backbone, interaction structure, supervision, and inference procedure simultaneously, making their design choices difficult to compare. We introduce OPENWAM, an open world-action modeling framework built ar...
Heng Yu, David Yuan, Ju-Ze Zhang et al.· 3 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.