T2-Z is introduced for test-time optimization of environment latents, which augments a robotic world model with a learnable environment latent to condition world predictions, and can efficiently infer environment latents from as little as a single test-time interaction trajectory.
Chen-Yuan Zhou, Yi-Ning Hong, Huang Huang et al.· 0 citations
Results demonstrate that generative video rendering mitigates the visual sim-to-real gap for zero-shot policy transfer, and shows that policy performance improves with more generated videos per simulation trajectory, increasing opening-task success by 65 percentage points.
Huang Huang, Wen-Si Ai, Zi-Yu Chen et al.· 0 citations
Policies trained offline from teleoperated demonstrations can degrade outside their training distribution. This gap is particularly acute in long-horizon whole-body mobile manipulation, where long horizons amplify compounding errors and coordinated arm, torso, and base motion makes exhaustive demonstration coverage imp...
Wen-Si Ai, Christopher Luey, Karthik Dharmarajan et al.· 0 citations
Memory-dependent robotic manipulation requires policies to use information that is no longer available in the current observation. Retaining history alone is insufficient: memory must preserve information that supports future actions. One challenge is whether a memory-free foundation model can learn to retain and use h...
Yi-Ze Liu, Huang Huang, Yi-Ning Hong et al.· 0 citations
RoboTTT, a robot model and training recipe that scale visuomotor context to 8K timesteps, three orders of magnitude beyond state-of-the-art policies, without growing inference latency, unlocks new robot capabilities: one-shot in-context imitation from human video demonstrations, on-the-fly policy improvement, robustnes...
TrAct is proposed, a world-model-based robot decision-making framework that uses visual tracks as an intermediate interface between control and prediction, enabling more accurate world modeling and stronger robot generalization.
Zhi-Hang Cao, Howard Ji, Kevin Zhang et al.· 3 citations
Masked Visual Actions is introduced, a pixel-space control interface that expresses action as a partially revealed trajectory of an arbitrary entity in a video that supports inverse modeling by synthesizing robot motion from desired object motion.
Hadi Alzayer, Wenlong Huang, Haonan Chen et al.· arXiv.org· 3 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.