Extensive experiments demonstrate that the CoDeR framework substantially extends the capabilities of existing world models, enabling long-term memory, open-ended interactions, autonomous evolution, and persistent multi-agent dynamics, while achieving state-of-the-art performance across multiple evaluation settings.
Abstract
We introduce \textbf{CoDeR}, a new paradigm for world modeling. Unlike existing video world models that implicitly represent world dynamics through visual observations, our system explicitly constructs an executable world with code and employs video generation models for visual realization. Specifically, we coordinate five complementary roles to translate high-level concepts into structured world rules, executable dynamics, and perceptual observations. This design enables \textit{long-term memory}, \textit{open-ended interactions}, \textit{autonomous world evolution}, and \textit{multi-agent scenarios}, where multiple entities can act, interact, and evolve persistently beyond the current observation. Extensive experiments demonstrate that our framework substantially extends the capabilities of existing world models, enabling long-term memory, open-ended interactions, autonomous evolution, and persistent multi-agent dynamics, while achieving state-of-the-art performance across multiple evaluation settings. Code and model weights will be made publicly available. Project Page: \href{https://becauseimbatman0.github.io/CoDeR}{CoDeR}.
MiniMax-H3 follows proxy-based spatiotemporal specifications from simple interactive worlds built by the coding agent while preserving rich visual details and dynamics, demonstrating the potential of combining code for persistent world evolution with video models for flexible visual realization.
This work proposes the Agent-Editing World Model (AEWM), which models how reasoning and actions shape future task progress rather than simulating tool responses, and combines AEWM with EditAct, which integrates these capabilities with real execution.
Shuang Sun, Guo-Xin Chen, Fan-Zhen Meng et al.· 0 citations
Generative video world models can now synthesize open-ended environments that agents can navigate and interact with in simple ways. Yet open-ended generation does not imply full interaction: as a generated world expands, newly created content through navigation should expand what the agent can act upon, and as the agen...
Xin-Di Yang, Bao-Lu Li, Liam Lee et al.· 0 citations
The Programmable World Model is introduced, a framework that decouples world-state evolution from visual observation generation and demonstrates the effectiveness of separating explicit state evolution from generative rendering for building persistent, programmable worlds.
Zheng-Hui Huang, Gui-Xu Lin, Jia-Cheng Lin et al.· 20 citations· ⚡3
World Tokens is an embodied policy architecture built around a World Adapter that bridges visual-language understanding, world-dynamics modeling, and action generation and is highly competitive on LIBERO, attains the best reported averages on SIMPLER, and substantially improves real-world R1 Pro success over a matched...
Qu Tang, Benhui Zhuang, Bo Yuan et al.· 2 citations· ⚡1
Large language model (LLM)-powered coding agents have made rapid progress in automating software engineering tasks, yet repository-level issue resolution remains challenging. Beyond generating a plausible patch, an agent must localize relevant code across interdependent files and maintain repository context that is bot...
Yun-Xiang Zhang, Hai-Quan Wang, Jia-Wei Guo et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.