성과공개

홈 성과공개 상세 정보

상세 정보

논문
Understanding User Requirements in LLM-Augmented BIM Systems: A TAM-Based Evaluation of NADIA-S
연도
5차
분류
구성기술2
연구기관
연세대학교
Yonsei University
구분2
학술발표
논문명
Understanding User Requirements in LLM-Augmented BIM Systems: A TAM-Based Evaluation of NADIA-S
Understanding User Requirements in LLM-Augmented BIM Systems: A TAM-Based Evaluation of NADIA-S
학술지명

ISSN
학술지 볼륨번호
게재일
논문페이지
주저자명
장수형
Suhyung Jang
교신저자명
이강
Ghang Lee
공동저자명
현석호, 이정헌
Seokho Hyun, Junghun Lee
논문 초록

Recent research on integrating large language models (LLMs) with buidling information modeling (BIM) systems has heightened expectations for overcoming technical barriers that hinder BIM adoption. Despite these expectations, there remains a lack of understanding regarding users' requirements for LLM-augmented BIM systems. Understanding these requirements is crucial for guiding development and addressing adoption barriers, yet this area remained underexplored. This study aims to investigate the factors that could drive the adoption of LLM-augmented BIM systems. An expert evaluation was conducted on an LLM-augmented BIM system - "Natural-language-based Architectural Detailing through Integration with AI via Speech (NADIA-S) - which is built upon a six-step, generalized LLM-augmented BIM framework. Through a case study, experts performed interactive design detailing and compliance-checking tasks in a BIM model using NADIA-S. Responses were collected through questionaires based on the Technology Acceptance Model (TAM) uisng a 5-point Likert scale, focuing on perceived ease of use (PEU), perceived usefulness (PU), and behavioral intention (BI). The results revealed high mean scores, ranging from 3.75 to 4.58 for PEU, 4.08 to 4.25 for PU, and 4.25 to 4.50 for BI, with significant positive effects observed between PEU and PU, PEU and BI, and PU and BI. Qualitative feedback highlights perferecnes for interactive conversational user interfaces, the need for multimodal input capabilities, improvements in AI's comprehension of BIM systems, and the importance of enhanced system stability and control over AI-generated results. Addresing these areas will improve adaptability, reliability, and user confidence, advancing LLM-driven BIM adoption in the AECO industry.
첨부파일
Understanding User Requireemtns in LLM Augmented BIM Systems.pdf
목록