Skip to content
Preprint

FlowSim: Rendering-Free Closed-Loop Simulation for Evaluating End-to-End Driving Systems

Oct 2026 · 0 citations · 29 references
Computer Science

TL;DR

This paper proposes FlowSim, a rendering-free simulation paradigm that predicts the internal latent representation directly from a previous latent and target-frame symbolic scene conditions, and establishes FlowSim as an efficient and practical alternative to conventional image-space simulation methods.

Abstract

Closed-loop evaluation of end-to-end (E2E) driving systems typically relies on generating sensor observations and re-processing them through the perception encoder, introducing substantial computational cost and a sim2real gap between simulated and real sensor observations. In this paper, we ask a more fundamental question: is image-space simulation necessary for closed-loop evaluation of E2E driving systems? We propose FlowSim, a rendering-free simulation paradigm that predicts the internal latent representation directly from a previous latent and target-frame symbolic scene conditions. The predicted latent is then processed by the original frozen downstream modules, eliminating image rendering and perception re-encoding. Explicit cross-frame agent association improves latent transition prediction and rollout stability, while variable-horizon simulation enables long-horizon prediction from a common real anchor without accumulating intermediate rollout errors. Experiments on nuScenes and NavSim demonstrate that FlowSim preserves downstream behavior competitively with, and often exceeds image-space simulation in source-to-reference agreement across variable simulation horizons and both dense and sparse latent representations. By predicting the latent directly, both instantiations of FlowSim simulate each step in 0.04--0.06s, substantially faster than the image-space simulation methods they are compared against. These results establish FlowSim as an efficient and practical alternative to conventional image-space simulation methods. Our project page is https://hanfeng-wu.github.io/flowsim_page/.

View source

Similar papers

Sep 2026

ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation

This work presents ZYT-World, a single architecture that natively generates four fisheye views with field of view>180{\deg} and three pinhole views and a 19M-parameter variational autoencoder decoder decoder, W8A8 quantization, and the inference engine reduce decoding, backbone, and incremental-execution costs, respect...

Bo-Ni Hu, Xiong Wei, Hao-Ming Huang et al. · 1 citation · ⚡1
Sep 2026

RECAST: From Log Replay to Closed-Loop Driving Simulation with View-Complete Actors

Closed-loop driving simulation requires rendered observations to remain reliable as the ego vehicle and surrounding actors move beyond their recorded trajectories, exposing views absent from the source log. Existing data-driven simulators reconstruct dynamic actors from sparse observations, which can result in renderin...

Zi-Jun Zhao, Lie-Wen Liao, Kang Shen et al. · 0 citations
Book Open access Nov 2026

LATTE: Language-Driven Construction of 3D Driving Scenes for Closed-Loop AD Simulation

LATTE is a language-driven framework for constructing explicit 3D driving scenes from open-world scene requests that not only supports open-world asset insertion and more coherent scene layout, but also produces behaviorally effective test cases that measurably alter downstream AD performance.

Zai-Yi Hu, Hai-Feng Wu, Yi-Yi Liao et al. · 0 citations
#artificial intelligence Preprint Oct 2026

TerraTransfer++: Demonstration-Free End-to-End Planner

End-to-end autonomous driving has achieved state-of-the-art performance on benchmarks and real-world deployments. Its standard training recipe, however, is expensive across all existing paradigms: imitation learning requires fleet-scale driving logs whose behavior distribution only thinly covers the safety-critical tai...

Zikang Xiong, Wei-Xin Li, Zhouchonghao Wu et al. · 0 citations
Sep 2026

FeasibleFlow: One-Step Joint Transport of Configuration Feasibility and Trajectories for End-to-End Driving

This work proposes FeasibleFlow, a one-step end-to-end generative framework that jointly transports a configuration-space feasibility field and multimodal ego trajectories and introduces the Anchor-relative ranker (ARR) and Pareto-ReinFlow to balance safety and progress in candidate selection and generation.

Xiang Li, Bi-Kun Wang, Qing Xu et al. · 0 citations
Preprint Oct 2026

Drive3R: Block-wise Streaming Geometric Foundation Models for Autonomous Driving

High-fidelity closed-loop simulation for autonomous driving increasingly relies on dense multi-view 3D reconstruction. While recent feed-forward geometric foundation models have revolutionized per-scene optimization, applying them to continuous, long-horizon driving sequences is computationally intractable due to GPU m...

Tian-Yi Yang, Hao-Jun Yang, Ji-Peng Xiao et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.