Results demonstrate that generative video rendering mitigates the visual sim-to-real gap for zero-shot policy transfer, and shows that policy performance improves with more generated videos per simulation trajectory, increasing opening-task success by 65 percentage points.
Huang Huang, Wen-Si Ai, Zi-Yu Chen et al.· 0 citations
DuetGen, an autonomous visual text generator built on DeepFusion, is introduced, which jointly learns autoregressive planning and continuous diffusion rendering and demonstrates the value of jointly learned planning representations and region-specific rendering for autonomous visual text generation.
Guan-Qiao Chen, Jing Tan, Dong-Xing Mao et al.· arXiv.org· 0 citations
Memory-dependent robotic manipulation requires policies to use information that is no longer available in the current observation. Retaining history alone is insufficient: memory must preserve information that supports future actions. One challenge is whether a memory-free foundation model can learn to retain and use h...
Yi-Ze Liu, Huang Huang, Yi-Ning Hong et al.· 2 citations
A series of models are explored that connect item Semantic IDs with natural language in a unified representation space and seek to unlock the potential of natural-language chain-of-thought (CoT) reasoning for recommendation, including OneReason.