From text to immersive 3D: an end-to-end pipeline for automated retrieval-augmented virtual room generation
TL;DR
Results demonstrate that immersive WebXR representations substantially strengthen user engagement and understanding, offering a scalable pathway for employer branding and digital recruitment, and point to interactivity as a key avenue for future work.
Abstract
This paper introduces a retrieval-augmented Text-to-WebXR pipeline that converts free text into interactive, browser-based 3D environments. Leveraging embedding-based retrieval, cross-encoder reranking, and a structured scene schema with constraint-aware placement, the approach generated one validated room description for each of the 229 firms. Expert evaluation indicates consistently high quality (M=4.46/5), with near-perfect scores in consistency (4.99) and completeness (4.88). A user study with 204 participants shows that 79.6% perceive 3D environments as a meaningful enhancement to textual profiles; participants with less prior 3D experience found the representations more helpful, indicating a novelty effect. These results demonstrate that immersive WebXR representations substantially strengthen user engagement and understanding, offering a scalable pathway for employer branding and digital recruitment, and point to interactivity as a key avenue for future work.