This work presents WorldAgent, an agentic framework for verification-guided physical world construction from a single natural-language prompt, without iterative user debugging, and introduces AgenticSimBench, on which WorldAgent achieves the best scores among the evaluated agent-based methods on five of seven metrics.
Abstract
Constructing complex physical worlds from language requires coordinating extensive 3D environments, detailed structures and objects at different spatial scales, and interacting physical processes under both stated goals and implicit physical constraints. We present WorldAgent, an agentic framework for verification-guided physical world construction from a single natural-language prompt, without iterative user debugging. A world construction layer expands the prompt into a structured world specification and uses physical knowledge to build scenes and run numerical simulations. After every step, a verification layer inspects scene geometry and simulation states alongside rendered views. Failed checks guide automatic revisions to the specification and re-execution of the affected steps. Accepted worlds pass the required checks and remain editable for further inspection and resimulation. We introduce AgenticSimBench, on which WorldAgent achieves the best scores among the evaluated agent-based methods on five of seven metrics. In a 26-participant user study, it receives the highest mean ratings across all four criteria.
WorLDS: World-state Observation and Reasoning for Language-guided Discovery and Search, a framework that grounds reasoning in a persistent graph initialized from geospatial priors and updated by perception, is presented.
Finley R. Holt, Luis A. Pabon, J. Alora et al.· arXiv.org· 0 citations
RoboHarn-Evo is introduced, a dual-loop harness that evolves Hierarchical Physical Knowledge (HPK) from physical experience that demonstrates that physical interaction can be accumulated into reusable knowledge for improving subsequent manipulation.
Shi-Feng Bao, Fan-Ding Huang, Yi-Han Lin et al.· arXiv.org· 4 citations
Experiments show that Code-as-World-VL achieves state-of-the-art performance on QuantiPhy and surpasses leading proprietary models, highlighting the potential of executable world representations as a scalable foundation for physical intelligence.
This work introduces WorldSolver, a benchmark of 168 simulation tasks derived from physical phenomena in 61 classic computer graphics papers, spanning 7 physical domains, and evaluates them along three dimensions: Execution Checks for successful execution, Visual Fidelity for reproducing the intended dynamic behavior i...
Si-Ru Jiang, Yongzhe Lyu, Shuo Lu et al.· 0 citations
PRISM, Planning with Belief under Incomplete World Models, a lightweight inference-time framework that augments VLM planners with an explicit probabilistic belief over candidate object locations provides a transparent uncertainty representation that exposes the agent's location hypotheses at each step, supporting inter...
M. S. Yasar, Murugan Sankaradas, Srimat T. Chakradhar· IEEE International Symposium...· 0 citations
CodeActionBench is introduced, a benchmark of 25 manipulation tasks that evaluates this capability through agentic Code-as-Policy and provides a controlled testbed for measuring how general-purpose models translate their capabilities into manipulation behavior and for examining typical failure scenarios in that process...
Yiheng Lyu, Xueying Jiang, Wen-Hao Li et al.· arXiv.org· 3 citations
Known for his clear and elegant writing style, Bertsekas shaped fields from control and optimization to large-scale computation and artificial intelligence.