T2-Z is introduced for test-time optimization of environment latents, which augments a robotic world model with a learnable environment latent to condition world predictions, and can efficiently infer environment latents from as little as a single test-time interaction trajectory.
Chen-Yuan Zhou, Yi-Ning Hong, Huang Huang et al.· 0 citations
Overall, the results suggest that scaling ego-centric data brings agent modeling close to its limit while leaving its effects on the world far behind, and that closing this gap will depend on how models are trained, not only on how much data they see.
Jia-Hua Dong, Anurag Bagchi, Yash Jangir et al.· 0 citations
Mobile manipulators such as humanoid robots are increasingly deployed in dynamic, unstructured environments to perform dexterous manipulation tasks. However, end-to-end manipulation policies trained to imitate demonstration data collected from a single robot pose are brittle: even centimeter-scale deviations in robot p...
Suzannah Wistreich, Stephen Tian, Isabella Huang et al.· 0 citations
We introduce BIND, a new action representation for visuomotor robot policies that binds 3D robot actions to their corresponding 2D image features, yielding strong data efficiency gains and robustness to out-of-distribution object positions and camera viewpoints. The action heads of current robot policies are typically...
C. Smith, Arsh Tangri, V. Guizilini et al.· 0 citations
DriveReferee is introduced, which uses a learned geometry readout to predict the scene representation from camera observations and executes the geometric safety rule directly rather than learning it, and which matches or outperforms all learned-verifier and heuristic baselines.
Feng-Cheng Yu, Dhruv Parikh, Jun-Jie Ye et al.· 0 citations
This paper proposes Large Reward Models (LRMs), a framework that adapts foundation VLMs into frame-level reward generators for robot policy refinement, and shows that LRM progress rewards provide the strongest non-privileged online refinement signal, improving the IL baseline and narrowing the gap to privileged environ...
PhysWAM is presented, a unified world-action model for autonomous driving that co-denoises multiview video, metric depth, and ego motion within a single flow-matching transformer and Coupled Point Projection is introduced, demonstrating that the geometric relationship between scene depth and ego motion provides a direc...
Dhruv Parikh, Feng-Cheng Yu, Quan-Kai Gao et al.· 0 citations
Rolling-WAM is presented, a formulation that distributes joint denoising across successive replanning cycles and delivers a 4.5x steady-state replanning speedup over standard joint WAMs.
Ying Zhou, Jun-Jie Ye, Yi-Qi Zhao et al.· arXiv.org· 2 citations
It is found that most baselines drastically degrade in performance, as they require significant overlap between viewpoints, while AnyView maintains the ability to produce realistic, plausible, and spatiotemporally consistent videos when prompted from $\textit{any}$ viewpoint.
Basile Van Hoorick, Dian Chen, Shun Iwase et al.· arXiv.org· 12 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.