An annotation tool for benchmarking methods for automated construction worker pose estimation and activity analysis

D. Roberts, M. Wang, W. Torres Calderon, M. Golparvar-Fard

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The increase in affordability and quality of jobsite cameras provides opportunities to facilitate monitoring of construction worker activities. Research has highlighted the potential of computer vision algorithms to be used for automated activity analysis. However, applying and adapting such techniques to the construction setting and deploying them for use on job sites entails extensive validation against a construction-specific benchmark dataset. Most state-of-the-art computer vision algorithms are strongly supervised and thus such benchmarks require large amounts of per-image ground truth annotations, both to enable the algorithm to learn how to perform its task during training time and for evaluation on a separate portion of this dataset at test-time. We address this need by introducing an annotation tool that enables users to label visual footage of construction workers by positioning both worker instances and individual key points corresponding to the body parts of each worker (e.g., left wrist, right elbow, nose) in the scene. This annotation tool is the first such publicly available tool capable of producing ground truth for pose estimation, tracking and activity analysis methods to the best of our knowledge. We demonstrate the capabilities of our tool by exhaustively annotating key points, identities and activity labels in a dataset of 393 image sequences that depict workers performing various construction-related activities. This preliminary set of annotation tasks demonstrates the ease of use and flexibility of our annotation tool.

Original languageEnglish (US)
Title of host publicationInternational Conference on Smart Infrastructure and Construction 2019, ICSIC 2019
Subtitle of host publicationDriving Data-Informed Decision-Making
EditorsM.J. DeJong, Jennifer M. Schooling, G.M.B. Viggiani
PublisherICE Publishing
Pages307-313
Number of pages7
ISBN (Electronic)9780727764669
DOIs
StatePublished - 2019
Event2nd International Conference on Smart Infrastructure and Construction: Driving Data-Informed Decision-Making, ICSIC 2019 - Cambridge, United Kingdom
Duration: Jul 1 2019Jul 3 2019

Publication series

NameInternational Conference on Smart Infrastructure and Construction 2019, ICSIC 2019: Driving Data-Informed Decision-Making

Conference

Conference2nd International Conference on Smart Infrastructure and Construction: Driving Data-Informed Decision-Making, ICSIC 2019
Country/TerritoryUnited Kingdom
CityCambridge
Period7/1/197/3/19

ASJC Scopus subject areas

  • Building and Construction
  • Civil and Structural Engineering

Fingerprint

Dive into the research topics of 'An annotation tool for benchmarking methods for automated construction worker pose estimation and activity analysis'. Together they form a unique fingerprint.

Cite this