建築物検査時のアイトラッキングで、専門家の思考を解明(Eye tracking during building inspections provides insight on how experts think)


2023-03-28 ペンシルベニア州立大学(PennState)





ファサード検査時の視線パターンを解析し、検査員のセンスメイキングプロセスを理解する。 Analysis of gaze patterns during facade inspection to understand inspector sense-making processes

Muhammad Rakeh Saleem,Robert Mayne & Rebecca Napolitan

Scientific Reports  Published:20 February 2023


figure 1


This work seeks to capture how an expert interacts with a structure during a facade inspection so that more detailed and situationally-aware inspections can be done with autonomous robots in the future. Eye tracking maps where an inspector is looking during a structural inspection, and it recognizes implicit human attention. Experiments were performed on a facade during a damage assessment to analyze key, visually-based features that are important for understanding human-infrastructure interaction during the process. For data collection and analysis, experiments were conducted to assess an inspector’s behavioral changes while assessing a real structure. These eye tracking features provided the basis for the inspector’s intent prediction and were used to understand how humans interact with the structure during the inspection processes. This method will facilitate information-sharing and decision-making during the inspection processes for collaborative human-robot teams; thus, it will enable unmanned aerial vehicle (UAV) for future building inspection through artificial intelligence support.