Vision-Based Construction Worker Activity Analysis Informed by Body Posture

Dominic Roberts, Wilfredo Torres Calderon, Shuai Tang, Mani Golparvar-Fard

Research output: Contribution to journalArticlepeer-review


Activity analysis of construction resources is generally performed by manually observing construction operations either in person or through recorded videos. It is thus prone to observer fatigue and bias and is of limited scalability and cost-effectiveness. Automating this procedure obviates these issues and can allow project teams to focus on performance improvement. This paper introduces a novel deep learning- and vision-based activity analysis framework that estimates and tracks two-dimensional (2D) worker pose and outputs per-frame worker activity labels given input red-green-blue (RGB) video footage of a construction worker operation. We used 317 annotated videos of bricklaying and plastering operations to train and validate the proposed method. This method obtained 82.6% mean average precision (mAP) for pose estimation and 72.6% multiple-object tracking accuracy (MOTA), and 81.3% multiple-object tracking precision (MOTP) for pose tracking. Cross-validation activity analysis accuracy of 78.5% was also obtained. We show that worker pose contributes to activity analysis results. This highlights the potential for using vision-based ergonomics assessment methods that rely on pose in conjunction with the proposed method for assessing the ergonomic viability of individual activities.

Original languageEnglish (US)
Article number04020017
JournalJournal of Computing in Civil Engineering
Issue number4
StatePublished - Jul 1 2020
Externally publishedYes

ASJC Scopus subject areas

  • Civil and Structural Engineering
  • Computer Science Applications


Dive into the research topics of 'Vision-Based Construction Worker Activity Analysis Informed by Body Posture'. Together they form a unique fingerprint.

Cite this