This study establishes an end-to-end prototype from raw BIM data input, through defect identification, to repair suggestion generation, and establishes an end-to-end prototype to identify and repair various defects in BIM via domain-specific LLMs.
Abstract
Existing methods lack a generalized approach to efficiently identify and resolve the diversity of design defects in BIM. Therefore, this study proposes an integrated framework to identify and repair various defects in BIM via domain-specific LLMs. Firstly, a BIM-to-Text method with component-balanced chunking is introduced to bridge BIM data with LLMs. Then, prompt learning with rule injection, few-shot prompting and RAG is proposed to identify defects and generate repair suggestions. Meanwhile, a hallucination control strategy combining key identifier validation and token-length thresholds is introduced to ensure reliability. Experiments show capability expansion yields 85% identification accuracy versus 70% for traditional rule checking, achieving a 94% rate of reasonable repair suggestions. Moreover, the proposed hallucination control further increased accuracy from 64% to 85%, eliminating 92.5% of hallucinations in a single intervention round. This study establishes an end-to-end prototype from raw BIM data input, through defect identification, to repair suggestion generation.
To address fragmented research and the lack of integrated development frameworks for multimodal large models (MLMs) in construction engineering, this study employs a systematic literature review approach and proposes a structured framework focusing on the design and construction stages.
This study examined l...
Zhan-Sheng Liu, Hao Zhou, Yun-Gui Li et al.· Engineering Construction and...· 0 citations
RAG-enhanced MLLMs are a viable, low-barrier solution for inspection tasks in remanufacturing scenarios with limited expert supervision and diverse object classes and demonstrate their viability in low-data, multi-class remanufacturing scenarios.
This research provides a highly accurate, scalable, and reliable framework for automated bridge defect analysis, offering a practical methodology to enhance data utilization in bridge management.
Lu-yang Zhang, Xuzhao Lu, Fengzong Gong et al.· Advances in Structural Engin...· 0 citations
Retrieval-augmented generation has emerged as a core technological paradigm for addressing the bottlenecks of hallucinations and knowledge lag in large language models. However, many existing reviews focus on a single technical branch or vertical application scenario, making only scattered references to hardware, evalu...
Accurate detection of power equipment defects is a critical link in ensuring the safe operation of power grids. With the rapid advancement of Multimodal Large Language Models (MLLMs), general-purpose Vision Language Models (VLMs) have demonstrated strong capabilities in natural image understanding. Nevertheless, in the...
This work finds that utilizing chat templates renders the model more compliant with harmful queries compared to a non-chat template, and shows that using a non-chat template during distillation better preserves the base student's internal representations, while chat template distillation induces a larger representation...
Anjila Budathoki, Manish Dhakal, Benjamin M. Ampel et al.· 0 citations