Nov 2026· Proceedings of the 34th ACM International Conference on Multimedia· pp. 3279-3288· 0 citations
Abstract
Closed-loop simulation is central to autonomous driving (AD) safety evaluation, yet it remains difficult to turn natural-language requests into valid 3D test scenarios. Existing language-driven methods either operate in pixel space without explicit scene instantiation, or rely on fixed asset banks and coarse object placement that are insufficient for open-world, test-oriented scene construction. We present LATTE, a language-driven framework for constructing explicit 3D driving scenes from open-world scene requests. LATTE decomposes the problem into two coupled parts: Image-Grounded Asset Construction (IGAC), which acquires insertion-ready 3D assets for missing objects from visual evidence, and Structurally Coherent Layout Optimization (SCLO), which turns language-guided initial placements into simulation-suitable layouts under physical and semantic constraints. The resulting edits are written back to a real-scene-reconstructed simulator and evaluated through closed-loop AD rollouts. Experiments show that LATTE not only supports open-world asset insertion and more coherent scene layout, but also produces behaviorally effective test cases that measurably alter downstream AD performance. The project page is at here.
This work presents ZYT-World, a single architecture that natively generates four fisheye views with field of view>180{\deg} and three pinhole views and a 19M-parameter variational autoencoder decoder decoder, W8A8 quantization, and the inference engine reduce decoding, backbone, and incremental-execution costs, respect...
This paper proposes FlowSim, a rendering-free simulation paradigm that predicts the internal latent representation directly from a previous latent and target-frame symbolic scene conditions, and establishes FlowSim as an efficient and practical alternative to conventional image-space simulation methods.
Han-Feng Wu, Alvaro Marcos-Ramiro, Michael Schmidt et al.· 0 citations
Building interactive simulators and scalable robot-learning environments requires a large number of articulated assets. However, most existing 3D assets used in simulation are rigid, and manually converting them into articulated objects with executable kinematic structures is highly labor-intensive, time-consuming, and...
Yi-Xuan Yang, Lu-Yang Xie, Zhen Luo et al.· Proceedings of the 34th ACM...· 4 citations
Closed-loop evaluation of end-to-end driving requires continuous rollouts that reveal how earlier decisions affect subsequent driving. However, existing benchmarks evaluate only short segments and fail to capture later consequences. Ambiguous directional commands also obscure the intended navigation objective. We intro...
Jungho Kim, Hongjae Shin, Seung-Su Yu et al.· 0 citations
To solve problems in 3D space rather than merely describe images, multimodal large language models (MLLMs) need 3D spatiotemporal reasoning: reconstructing 3D geometry from occluded 2D views, anticipating physical dynamics, and executing precise, closed-loop actions. Prior studies test passive VQA on static images or s...
Cheng-Long Shi, Ze-Kai Yuan, Yue Song et al.· 0 citations
Closed-loop driving simulation requires rendered observations to remain reliable as the ego vehicle and surrounding actors move beyond their recorded trajectories, exposing views absent from the source log. Existing data-driven simulators reconstruct dynamic actors from sparse observations, which can result in renderin...
Zi-Jun Zhao, Lie-Wen Liao, Kang Shen et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.