Skip to content
Preprint

Learning an Interior Layout Policy in a Domain Specific Language Action Space

Jul 2026 · 0 citations · 56 references
Computer Science

TL;DR

This work proposes LayoutDSL, a novel LLM-based framework for learning an interior layout policy in a domain-specific language (DSL) action space that substantially improves spatial plausibility and design logicality over strong baselines and existing methods.

Abstract

Indoor scene layout generation is a challenging task in interior design. Existing methods often oversimplify the task by reducing room conditions to coarse 3D bounding boxes and neglecting structural elements such as doors and windows. More fundamentally, many prior approaches formulate spatial reasoning as direct coordinate prediction, thereby casting interior layout design as continuous regression over raw geometric parameters, which hinders the model from learning the underlying reasoning logic of intelligent layout design. We propose \textbf{LayoutDSL}, a novel LLM-based framework for learning an interior layout policy in a domain-specific language (DSL) action space. The DSL provides an explicit symbolic representation of layout information and serves as a structured action space for layout reasoning, where each action corresponds to an interpretable design decision. Under this DSL-based policy learning paradigm, we construct 3D-FrontDSL, a dataset of room-structure annotations paired with synthetic DSL action sequences for supervised fine-tuning. To promote a more generalizable and scalable policy with verifiable feedback, we design rewards grounded in interior design principles and physical plausibility, and optimize the policy via reinforcement learning. Extensive experiments demonstrate that LayoutDSL substantially improves spatial plausibility and design logicality over strong baselines and existing methods.

View source

Similar papers

Preprint Aug 2026

SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs

Experimental results show that SG-Layout improves spatial reasoning accuracy and geometric consistency over the compact open-source backbone, with particularly clear advantages in relation-dense and compositionally complex scenes.

Junsheng Wang, Chao Chen, Mengying Xie et al. · 0 citations
Conference Aug 2026

Enhancing Spatial Understanding in Vision-Language Models via Curriculum Learning

The development of Embodied AI urgently necessitates high-fidelity environment modeling enriched with spatial context. However, existing 3D semantic scene understanding methods predominantly focus on isolated instance-level labels or high-dimensional semantic vector embeddings, lacking effective modeling of explicit sp...

Zhe Zhong, Qin-Yuan Ren · 0 citations
Preprint Aug 2026

Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction

RoomWright is presented, an agentic usage-driven framework for generating 3D scenes represented entirely as code for embodied interaction, providing interactive environments for embodied AI and policy learning.

Zijian Xiao, Zi-Peng Ye, Jin-Kun Hao et al. · 2 citations
#artificial intelligence Preprint Sep 2026

Geometry-Aware Test-Time Learning for Quantitative Spatial Reasoning

TTL-SR is proposed, a geometry-aware Test-Time Learning framework for quantitative Spatial Reasoning that leverages geometric consistency constraints and unlabeled test data to adapt models to target domains to boost spatial reasoning performance.

Ge-Ge Zhang, Shuai-Cheng Niu, Gang Dai et al. · 0 citations
Preprint Aug 2026

presto: Efficient, Training-free, and Open-world Object Placement via Imaginary Search

This work reformulates open-world object placement as a heuristic search task guided by reasoning from a Multimodal Large Language Model (MLLM), and introduces Presto, a zero-shot, training-free framework that operates within an imaginary action space to iteratively refine object position and scale.

Weixuan Ding, Shang Liu, Han-Yu Pei et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.