This work proposes LayoutDSL, a novel LLM-based framework for learning an interior layout policy in a domain-specific language (DSL) action space that substantially improves spatial plausibility and design logicality over strong baselines and existing methods.
Abstract
Indoor scene layout generation is a challenging task in interior design. Existing methods often oversimplify the task by reducing room conditions to coarse 3D bounding boxes and neglecting structural elements such as doors and windows. More fundamentally, many prior approaches formulate spatial reasoning as direct coordinate prediction, thereby casting interior layout design as continuous regression over raw geometric parameters, which hinders the model from learning the underlying reasoning logic of intelligent layout design. We propose \textbf{LayoutDSL}, a novel LLM-based framework for learning an interior layout policy in a domain-specific language (DSL) action space. The DSL provides an explicit symbolic representation of layout information and serves as a structured action space for layout reasoning, where each action corresponds to an interpretable design decision. Under this DSL-based policy learning paradigm, we construct 3D-FrontDSL, a dataset of room-structure annotations paired with synthetic DSL action sequences for supervised fine-tuning. To promote a more generalizable and scalable policy with verifiable feedback, we design rewards grounded in interior design principles and physical plausibility, and optimize the policy via reinforcement learning. Extensive experiments demonstrate that LayoutDSL substantially improves spatial plausibility and design logicality over strong baselines and existing methods.
Experimental results show that SG-Layout improves spatial reasoning accuracy and geometric consistency over the compact open-source backbone, with particularly clear advantages in relation-dense and compositionally complex scenes.
Junsheng Wang, Chao Chen, Mengying Xie et al.· 0 citations
By combining HRAP with RMR, ScenePilot offers an efficient alternative to one-shot generation and heavy full-scene optimization, improving physical plausibility, functional coherence, and controllability while preserving diversity.
Jiawei Zhang, Hong-Song Wang, Pan Zhou· 0 citations
The development of Embodied AI urgently necessitates high-fidelity environment modeling enriched with spatial context. However, existing 3D semantic scene understanding methods predominantly focus on isolated instance-level labels or high-dimensional semantic vector embeddings, lacking effective modeling of explicit sp...
Zhe Zhong, Qin-Yuan Ren· 2026 IEEE International Conf...· 0 citations
RoomWright is presented, an agentic usage-driven framework for generating 3D scenes represented entirely as code for embodied interaction, providing interactive environments for embodied AI and policy learning.
Zijian Xiao, Zi-Peng Ye, Jin-Kun Hao et al.· 2 citations
TTL-SR is proposed, a geometry-aware Test-Time Learning framework for quantitative Spatial Reasoning that leverages geometric consistency constraints and unlabeled test data to adapt models to target domains to boost spatial reasoning performance.
Ge-Ge Zhang, Shuai-Cheng Niu, Gang Dai et al.· 0 citations
This work reformulates open-world object placement as a heuristic search task guided by reasoning from a Multimodal Large Language Model (MLLM), and introduces Presto, a zero-shot, training-free framework that operates within an imaginary action space to iteratively refine object position and scale.
Weixuan Ding, Shang Liu, Han-Yu Pei et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.