Lightweight deep learning framework for recognizing construction workers' activities based on simplified node combinations

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

View graph of relations

Author(s)

Detail(s)

Original languageEnglish
Article number105236
Journal / PublicationAutomation in Construction
Volume158
Online published19 Dec 2023
Publication statusPublished - Feb 2024

Abstract

Monitoring construction workers' activities is vital to effective construction project management. However, most existing studies on skeleton-based worker activity recognition use full-body skeleton data, which involve inconvenient movement and high computational demands. This research aimed to identify simplified skeleton node combinations at various scales and develop a framework that reduces computational demands without sacrificing accuracy for the combinations. To this end, this study selected five node combinations at different scales using five deep learning algorithms and developed a lightweight deep learning framework by reducing input features and sample frequencies and stacking temporal convolution network (TCN) blocks. The results demonstrate that this framework outperforms the original deep learning algorithm utilizing the entire skeleton by approximately 1.94%–6.75%. This research contributes to the field of automated construction workers' activity recognition by reducing inconvenient movements and computational demands. Further research needs to investigate the relationships between sensor locations and specific types of motions. © 2023 Elsevier B.V.

Research Area(s)

  • Lightweight deep learning, Low sample frequency, Reduced input feature dimension, Simplified skeleton node combinations, Worker action recognition