TY - GEN
T1 - An annotation tool for benchmarking methods for automated construction worker pose estimation and activity analysis
AU - Roberts, D.
AU - Wang, M.
AU - Torres Calderon, W.
AU - Golparvar-Fard, M.
N1 - Publisher Copyright:
© International Conference on Smart Infrastructure and Construction 2019, ICSIC 2019: Driving Data-Informed Decision-Making.
PY - 2019
Y1 - 2019
N2 - The increase in affordability and quality of jobsite cameras provides opportunities to facilitate monitoring of construction worker activities. Research has highlighted the potential of computer vision algorithms to be used for automated activity analysis. However, applying and adapting such techniques to the construction setting and deploying them for use on job sites entails extensive validation against a construction-specific benchmark dataset. Most state-of-the-art computer vision algorithms are strongly supervised and thus such benchmarks require large amounts of per-image ground truth annotations, both to enable the algorithm to learn how to perform its task during training time and for evaluation on a separate portion of this dataset at test-time. We address this need by introducing an annotation tool that enables users to label visual footage of construction workers by positioning both worker instances and individual key points corresponding to the body parts of each worker (e.g., left wrist, right elbow, nose) in the scene. This annotation tool is the first such publicly available tool capable of producing ground truth for pose estimation, tracking and activity analysis methods to the best of our knowledge. We demonstrate the capabilities of our tool by exhaustively annotating key points, identities and activity labels in a dataset of 393 image sequences that depict workers performing various construction-related activities. This preliminary set of annotation tasks demonstrates the ease of use and flexibility of our annotation tool.
AB - The increase in affordability and quality of jobsite cameras provides opportunities to facilitate monitoring of construction worker activities. Research has highlighted the potential of computer vision algorithms to be used for automated activity analysis. However, applying and adapting such techniques to the construction setting and deploying them for use on job sites entails extensive validation against a construction-specific benchmark dataset. Most state-of-the-art computer vision algorithms are strongly supervised and thus such benchmarks require large amounts of per-image ground truth annotations, both to enable the algorithm to learn how to perform its task during training time and for evaluation on a separate portion of this dataset at test-time. We address this need by introducing an annotation tool that enables users to label visual footage of construction workers by positioning both worker instances and individual key points corresponding to the body parts of each worker (e.g., left wrist, right elbow, nose) in the scene. This annotation tool is the first such publicly available tool capable of producing ground truth for pose estimation, tracking and activity analysis methods to the best of our knowledge. We demonstrate the capabilities of our tool by exhaustively annotating key points, identities and activity labels in a dataset of 393 image sequences that depict workers performing various construction-related activities. This preliminary set of annotation tasks demonstrates the ease of use and flexibility of our annotation tool.
UR - http://www.scopus.com/inward/record.url?scp=85095967348&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85095967348&partnerID=8YFLogxK
U2 - 10.1680/icsic.64669.307
DO - 10.1680/icsic.64669.307
M3 - Conference contribution
AN - SCOPUS:85095967348
T3 - International Conference on Smart Infrastructure and Construction 2019, ICSIC 2019: Driving Data-Informed Decision-Making
SP - 307
EP - 313
BT - International Conference on Smart Infrastructure and Construction 2019, ICSIC 2019
A2 - DeJong, M.J.
A2 - Schooling, Jennifer M.
A2 - Viggiani, G.M.B.
PB - ICE Publishing
T2 - 2nd International Conference on Smart Infrastructure and Construction: Driving Data-Informed Decision-Making, ICSIC 2019
Y2 - 1 July 2019 through 3 July 2019
ER -