Skip to content
Preprint

Code Plans, Diffusion Renders: Open-Ended Generative World Modeling

Sep 2026 · 0 citations · 108 references
Computer Science

TL;DR

Extensive experiments demonstrate that the CoDeR framework substantially extends the capabilities of existing world models, enabling long-term memory, open-ended interactions, autonomous evolution, and persistent multi-agent dynamics, while achieving state-of-the-art performance across multiple evaluation settings.

Abstract

We introduce \textbf{CoDeR}, a new paradigm for world modeling. Unlike existing video world models that implicitly represent world dynamics through visual observations, our system explicitly constructs an executable world with code and employs video generation models for visual realization. Specifically, we coordinate five complementary roles to translate high-level concepts into structured world rules, executable dynamics, and perceptual observations. This design enables \textit{long-term memory}, \textit{open-ended interactions}, \textit{autonomous world evolution}, and \textit{multi-agent scenarios}, where multiple entities can act, interact, and evolve persistently beyond the current observation. Extensive experiments demonstrate that our framework substantially extends the capabilities of existing world models, enabling long-term memory, open-ended interactions, autonomous evolution, and persistent multi-agent dynamics, while achieving state-of-the-art performance across multiple evaluation settings. Code and model weights will be made publicly available. Project Page: \href{https://becauseimbatman0.github.io/CoDeR}{CoDeR}.

View source

Similar papers

Preprint Aug 2026

Code World Model: Coding Agent as World Brain

MiniMax-H3 follows proxy-based spatiotemporal specifications from simple interactive worlds built by the coding agent while preserving rich visual details and dynamics, demonstrating the potential of combining code for persistent world evolution with video models for flexible visual realization.

Yiwen Chen, Guo-Sheng Lin, Chi Zhang · 9 citations
#artificial intelligence Preprint Sep 2026

Agent-Editing World Model: Rethinking World Modeling for LLM Agents

This work proposes the Agent-Editing World Model (AEWM), which models how reasoning and actions shape future task progress rather than simulating tool responses, and combines AEWM with EditAct, which integrates these capabilities with real execution.

Shuang Sun, Guo-Xin Chen, Fan-Zhen Meng et al. · 0 citations
Preprint Oct 2026

Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models

Generative video world models can now synthesize open-ended environments that agents can navigate and interact with in simple ways. Yet open-ended generation does not imply full interaction: as a generated world expands, newly created content through navigation should expand what the agent can act upon, and as the agen...

Xin-Di Yang, Bao-Lu Li, Liam Lee et al. · 0 citations
Preprint Sep 2026

Programmable World Model

The Programmable World Model is introduced, a framework that decouples world-state evolution from visual observation generation and demonstrates the effectiveness of separating explicit state evolution from generative rendering for building persistent, programmable worlds.

Zheng-Hui Huang, Gui-Xu Lin, Jia-Cheng Lin et al. · 20 citations · ⚡3
Preprint Aug 2026

World Tokens: Enhancing Embodied Policies with Training-Time World Modeling

World Tokens is an embodied policy architecture built around a World Adapter that bridges visual-language understanding, world-dynamics modeling, and action generation and is highly competitive on LIBERO, attains the best reported averages on SIMPLER, and substantially improves real-world R1 Pro success over a matched...

Qu Tang, Benhui Zhuang, Bo Yuan et al. · 2 citations · ⚡1
#artificial intelligence Preprint Sep 2026

RepoAtlas: Guiding Coding Agents via Evolving Multimodal Repository Views

Large language model (LLM)-powered coding agents have made rapid progress in automating software engineering tasks, yet repository-level issue resolution remains challenging. Beyond generating a plausible patch, an agent must localize relevant code across interdependent files and maintain repository context that is bot...

Yun-Xiang Zhang, Hai-Quan Wang, Jia-Wei Guo et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.