Automated visual recognition of construction equipment actions using spatio-temporal features and multiple binary Support Vector Machines

Arsalan Heydarian, Mani Golparvar-Fard, Juan Carlos Niebles

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Video recording of construction operations provides an understandable data that could be used to analyze and improve construction performance. Despite the benefits, manual stopwatch study of previously recorded videos can be laborintensive, may suffer from biases of the observers, and impractical after substantial period of observations. To address these limitations, this paper presents a new visionbased method for automated action recognition of construction equipment from different camera viewpoints. This is particularly a challenging task as construction equipment can be partially occluded and they usually come in wide variety of sizes and appearances. The scale and pose of the equipment action can also significantly vary based on the camera configurations. In the proposed method, first a video is represented as a collection of spatio-temporal features by extracting space-time interest points and describing each feature with a histogram of oriented gradients (HOG). The algorithm automatically learns the probability distributions of the spatiotemporal features and action categories using a multiple binary Support Vector Machine (SVM) classifier. This strategy handles noisy feature points arisen from typical dynamic backgrounds. Given a novel video sequence, the multiple binary SVM classifier recognizes and localizes multiple equipment actions in long and dynamic video sequences containing multiple equipment actions. We have exhaustively tested our algorithm on 1,200 videos from earthmoving operations. Results with average accuracy of 85% across all categories of equipment actions reflect the promise of the proposed method for automated performance monitoring.

Original languageEnglish (US)
Title of host publicationConstruction Research Congress 2012
Subtitle of host publicationConstruction Challenges in a Flat World, Proceedings of the 2012 Construction Research Congress
Pages889-898
Number of pages10
DOIs
StatePublished - 2012
Externally publishedYes
EventConstruction Research Congress 2012: Construction Challenges in a Flat World - West Lafayette, IN, United States
Duration: May 21 2012May 23 2012

Publication series

NameConstruction Research Congress 2012: Construction Challenges in a Flat World, Proceedings of the 2012 Construction Research Congress

Other

OtherConstruction Research Congress 2012: Construction Challenges in a Flat World
CountryUnited States
CityWest Lafayette, IN
Period5/21/125/23/12

ASJC Scopus subject areas

  • Civil and Structural Engineering
  • Building and Construction

Fingerprint Dive into the research topics of 'Automated visual recognition of construction equipment actions using spatio-temporal features and multiple binary Support Vector Machines'. Together they form a unique fingerprint.

Cite this