A Framework for Evaluating the Context-Dependent Performance of Intelligent Construction Technologies

2025 4th International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR 2025), 2025

Recommended citation: Yang,G., Liu, W., Lin, J.R., Pan, P.* (2025). A Framework for Evaluating the Context-Dependent Performance of Intelligent Construction Technologies. 2025 4th International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR 2025), 1-6. Ningbo, China. doi: 10.1109/AIHCIR67580.2025.11405265 http://doi.org/10.1109/AIHCIR67580.2025.11405265 cited by count

Abstract

The adoption of Intelligent Construction (IC) technologies, particularly AI-driven systems and autonomous robots, is pivotal for the architecture, engineering, and construction (AEC) industry’s transformation, yet their performance often varies significantly across projects - a challenge known as context dependency. Existing evaluation methods, focused on single-case studies, fail to capture this variance, hindering reliable investment decisions. To address this gap, we propose a novel “Expectation-Robustness” framework. The framework first utilizes a multi-criteria benefit evaluation system to quantify a technology’s performance in a single project into a standardized Overall Benefit Score (OBS). Then, by treating the OBS scores from multiple projects as a statistical sample, we define two key metrics: (1) Expected Benefit, measured by the mean of OBS, representing the technology’s average performance; and (2) Performance Robustness, measured by the inverse of the Coefficient of Variation (CV) of OBS, representing its stability across diverse contexts. We validated the framework using a large-scale dataset of 678 technology application cases from national IC pilot projects in China. An analysis of 10 typical technologies, with a special focus on construction robots (e.g., for floor-finishing and tile-laying), revealed distinct performance profiles, highlighting the critical role of performance robustness in real-world robotic deployment. Our framework moves beyond simplistic single-point estimates, offering a more scientific basis for stakeholders to make informed decisions on technology investment, research, development, and deployment, thereby promoting the sustainable development of intelligent construction.

Download paper here

Download preprint here

Financial Sources:

Leave a Comment