Function-Room Generation is introduced, a new indoor 3D scene generation setting that creates rooms supporting explicit functional goals rather than merely visually plausible layouts, and ScenePRM, an execution-grounded process reward framework that improves the expert through reinforcement learning with functional, geometric, relational, and future-constructability feedback.
Abstract
We introduce Function-Room Generation, a new indoor 3D scene generation setting that creates rooms supporting explicit functional goals rather than merely visually plausible layouts. Existing agentic and executable methods improve controllability, but often depend on costly test-time generate--evaluate--revise loops, making functional room generation slow and computationally expensive. We address this challenge with three technical contributions. First, we design a recursive domain-specific language to effectively organize the hierarchical object compositions required by functional rooms, from room structure and major furniture to dense support-surface and nested small objects. It represents rooms as staged executable programs with explicit geometric and functional relations. Second, we propose a sequential feed-forward scene construction framework that distills recursive construction traces into a scene construction expert. At inference time, the expert writes executable DSL code stage by stage, and a deterministic executor directly instantiates each stage without teacher agents, online critics, or iterative repair. Third, we introduce ScenePRM, an execution-grounded process reward framework that improves the expert through reinforcement learning with functional, geometric, relational, and future-constructability feedback. We further establish a function-oriented benchmark and show state-of-the-art performance on both general indoor scene generation and function-room generation, achieving stronger functional completeness, relation correctness, geometric executability, and generation efficiency.
RoomWright is presented, an agentic usage-driven framework for generating 3D scenes represented entirely as code for embodied interaction, providing interactive environments for embodied AI and policy learning.
Zijian Xiao, Zi-Peng Ye, Jin-Kun Hao et al.· 1 citation
By combining HRAP with RMR, ScenePilot offers an efficient alternative to one-shot generation and heavy full-scene optimization, improving physical plausibility, functional coherence, and controllability while preserving diversity.
Jiawei Zhang, Hong-Song Wang, Pan Zhou· 0 citations
A unified framework for generating physically consistent dynamic 3D scenes from text, with outputs directly executable in Unreal Engine, using the ESG, which specifies entities with physical attributes, spatial relations, and event-driven timelines in a machine-checkable form.
Xin-Tong Fang, Zhi-Yuan Fang, Ren-Gan Xie et al.· 0 citations
Across scene-level 3D object detection, object pose estimation, and scene reconstruction, Lucida improves mAP over Boxer by 69% on R2S-Scene, raises ADD-SB@0.05 from 57.8% to 83.4% on CA-1M, and increases scene F-Score from 0.794 for SAM3D to 0.924.
Ming-Han Qin, Yuang Wang, Xiuyu Yang et al.· 3 citations· ⚡2
This work introduces Code4Scene, a benchmark of 190 Unreal Engine cases built from human-assembled scenes that evaluates coding agents on two complementary settings under a shared execution interface, and exposes a gap between plausible 3D generation and reliable spatial reasoning and state control.
Xiao-Kang Ye, Siddhant Hitesh Mantri, Zi-Meng Chen et al.· 0 citations
In indoor environments, object positions frequently change due to human activities or embodied-agent interactions, causing previously constructed scene graphs to become inconsistent with the current scene. To address this issue, we propose DSG, a dynamic 3D scene graph construction framework that detects object changes...
Min-Yi Liao, Chao Ye, Jia-Ning Fei et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.