Automated worker activity analysis in indoor environments for direct-work rate improvement from long sequences of RGB-D images

Ardalan Khosrowpour, Igor Fedorov, Aleksander Holynski, Juan Carlos Niebles, Mani Golparvar-Fard

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a new method for activity analysis of construction workers using inexpensive RGB+depth sensors. This is an important task, as no current workforce assessment method can provide detailed and continuous information to help project managers identify bottlenecks affecting labor's productivity. Previous work using RGB-D images focuses on action recognition form short video sequences wherein only one action is represented within each video. Automating this analysis for long sequences of RGB-D images is challenging because the start and the end of each action is unknown, recognizing single actions is still challenging, and there are no data sets and validation metrics to evaluate algorithms. Given an input sequence of RGB-D images, our algorithm divides it into temporal segments and automatically classifies the observed actions. To do so, the algorithm first detects body postures in real time. Then a kernel density estimation (KDE) model is trained to model classification scores from discriminatively trained bag-of-poses action classifiers. Further, a hidden Markov model (HMM) labels sequences of actions that are most discriminative. The performance of our model is tested on unprecedented data sets of actual drywall construction operations. Experimental results, in addition to the perceived benefits and limitations of the proposed method, are discussed in detail.

Original languageEnglish (US)
Title of host publicationConstruction Research Congress 2014
Subtitle of host publicationConstruction in a Global Network - Proceedings of the 2014 Construction Research Congress
PublisherAmerican Society of Civil Engineers
Pages729-738
Number of pages10
ISBN (Print)9780784413517
DOIs
StatePublished - 2014
Event2014 Construction Research Congress: Construction in a Global Network, CRC 2014 - Atlanta, GA, United States
Duration: May 19 2014May 21 2014

Publication series

NameConstruction Research Congress 2014: Construction in a Global Network - Proceedings of the 2014 Construction Research Congress

Other

Other2014 Construction Research Congress: Construction in a Global Network, CRC 2014
CountryUnited States
CityAtlanta, GA
Period5/19/145/21/14

ASJC Scopus subject areas

  • Building and Construction

Fingerprint Dive into the research topics of 'Automated worker activity analysis in indoor environments for direct-work rate improvement from long sequences of RGB-D images'. Together they form a unique fingerprint.

Cite this