Exploring the Potential of Image-Based 3D Geometry and Appearance Reasoning for Automated Construction Progress Monitoring

Jacob J. Lin, Jae Yong Lee, Mani Golparvar-Fard

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The exponential increase in the volume of images and videos captured on construction sites and the growing availability of building information models (BIM) and schedules with production-level details has created a unique opportunity to automate how progress is monitored and reported on construction sites. However, the state-of-the-art methods of automated progress comparison are still in its infancy largely because of these methods either only leverage geometry of the 3D reconstructed scenes to reason about presence or detect and classify construction material from 2D images without considering geometrical characteristics. To the best of our knowledge, this paper is the first to offer a computer vision method that can jointly reason about geometry and appearance of observed BIM elements in site images and videos to monitor and report on their state of progress. The new method fuses structure-from-motion geometrical features together with directional and radial appearance features in a new deep convolutional neural network (CNN) architecture to detect and classify state of work-in-progress. Our experimental results show that using geometrical features reduces errors in appearance-based recognition methods and offers a new opportunity to scale the applicability of automated progress detection methods to real-world settings.

Original languageEnglish (US)
Title of host publicationComputing in Civil Engineering 2019
Subtitle of host publicationData, Sensing, and Analytics - Selected Papers from the ASCE International Conference on Computing in Civil Engineering 2019
EditorsYong K. Cho, Fernanda Leite, Amir Behzadan, Chao Wang
PublisherAmerican Society of Civil Engineers
Pages162-170
Number of pages9
ISBN (Electronic)9780784482438
StatePublished - 2019
EventASCE International Conference on Computing in Civil Engineering 2019: Data, Sensing, and Analytics, i3CE 2019 - Atlanta, United States
Duration: Jun 17 2019Jun 19 2019

Publication series

NameComputing in Civil Engineering 2019: Data, Sensing, and Analytics - Selected Papers from the ASCE International Conference on Computing in Civil Engineering 2019

Conference

ConferenceASCE International Conference on Computing in Civil Engineering 2019: Data, Sensing, and Analytics, i3CE 2019
CountryUnited States
CityAtlanta
Period6/17/196/19/19

ASJC Scopus subject areas

  • Computer Science(all)
  • Civil and Structural Engineering

Fingerprint Dive into the research topics of 'Exploring the Potential of Image-Based 3D Geometry and Appearance Reasoning for Automated Construction Progress Monitoring'. Together they form a unique fingerprint.

Cite this