Automated vision-based recognition of construction worker actions for building interior construction operations using RGBD cameras

Víctor Escorcia, María A. Dávila, Mani Golparvar-Fard, Juan Carlos Niebles

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we present a novel method for reliable recognition of construction workers and their actions using color and depth data from a Microsoft Kinect sensor. Our algorithm is based on machine learning techniques, in which meaningful visual features are extracted based on the estimated body pose of workers. We adopt a bag-of-poses representation for worker actions and combine it with powerful discriminative classifiers to achieve accurate action recognition. The discriminative framework is able to focus on the visual aspects that are distinctive and can detect and recognize actions from different workers. We train and test our algorithm by using 80 videos from four workers involved in five drywall related construction activities. These videos were all collected from drywall construction activities inside of an under construction dining hall facility. The proposed algorithm is further validated by recognizing the actions of a construction worker that was never seen before in the training dataset. Experimental results show that our method achieves an average precision of 85.28 percent. The results reflect the promise of the proposed method for automated assessment of craftsmen productivity, safety, and occupational health at indoor environments.

Original languageEnglish (US)
Title of host publicationConstruction Research Congress 2012
Subtitle of host publicationConstruction Challenges in a Flat World, Proceedings of the 2012 Construction Research Congress
Pages879-888
Number of pages10
DOIs
StatePublished - 2012
Externally publishedYes
EventConstruction Research Congress 2012: Construction Challenges in a Flat World - West Lafayette, IN, United States
Duration: May 21 2012May 23 2012

Publication series

NameConstruction Research Congress 2012: Construction Challenges in a Flat World, Proceedings of the 2012 Construction Research Congress

Other

OtherConstruction Research Congress 2012: Construction Challenges in a Flat World
CountryUnited States
CityWest Lafayette, IN
Period5/21/125/23/12

ASJC Scopus subject areas

  • Civil and Structural Engineering
  • Building and Construction

Fingerprint Dive into the research topics of 'Automated vision-based recognition of construction worker actions for building interior construction operations using RGBD cameras'. Together they form a unique fingerprint.

Cite this