Recent studies of embodied agents based on frontier multimodal large language models (MLLMs) develop harness engineering around the MLLM, such as harnesses with post-trained policies and recursive self-improvement loops. Yet whether these additions exceed the native capability of the MLLM remains unexplored. We introdu...
Yi-Fei Yao, Yu-De Zou, Xing Gao et al.· 0 citations
Learning humanoid loco-manipulation from human demonstrations rests on observing how locomotion, posture, and object interaction evolve together as tasks unfold. Scaling collection across diverse environments, in turn, favors lightweight, portable capture systems. Yet, existing datasets provide only partial views of th...
Yun-Song Zhou, Xue-Kun Jiang, Hai-Qi Shen et al.· 0 citations
Vision-language-action (VLA) models achieve strong performance across embodied manipulation tasks by unifying visual understanding, language conditioning, and action generation. However, long-horizon tasks can involve non-Markovian dependencies: successful decisions may require retaining task progress and past interact...
Ting-Wen Du, Hao-Yu Guo, Han-Xue Zhang et al.· 1 citation
This monograph seeks to define physical AI, present its technical landscape, and examine each key technical subfield in depth, and establishes a unified framework for Physical AI: artificial systems that perceive, model, and act upon the physical world through continuous feedback under real-world constraints.
Wei-Nan Zhang, Chun-Hua Shen, Tian-Fan Xue et al.· 0 citations
MegaParts, a scalable autoregressive 3D generation framework to address this challenge by combining structured sequence modeling with a token-efficient vector-quantized shape tokenizer, achieves higher mesh quality than baseline autoregressive and diffusion models and suggests that LLM native token-efficient autoregres...
Manwen Liao, Xinyu Lian, Jian Mao et al.· 0 citations
GeoVerse is a framework that synthesizes world-consistent novel views by performing generation within the geometric latent space of a pretrained 3D foundation model and injecting appearance priors from a video generative model via a ControlNet-style adapter.
Ke-Rui Ren, Tao Lu, Lin-Ning Xu et al.· 0 citations
InfiniHand is an end-to-end streaming feed-forward framework that jointly estimates MANO parameters, camera trajectories, and hand locations directly from uncalibrated egocentric video, achieving a 21% reduction in ARCTIC PA-p compared to ViDiHand while substantially mitigating world-space drift.
Causal Imprint is introduced, which learns future-relevant scene changes from training-only future supervision and provides predictive representations directly to the action expert without future-video rollout at inference.
This work introduces InternW0, the first instantiation of the InternW physical world model series from Shanghai AI Laboratory, built around omnimodal interfaces, asynchronous multi-frequency processing, and local physical modeling under partial observations and external influences.
Ji-Song Cai, Yao Mu, Gan-Lin Yang et al.· 0 citations
GAUGE, a real-world-grounded diagnostic benchmark for jointly evaluating how numerical simulators and generative video world models reproduce or deviate from real-world physics, is introduced and no uniformly faithful physics engine is revealed.
Shuai Wang, Yaxin Feng, Xuekun Jiang et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.