Bi-Directional Image-to-Text Mapping for NLP-Based Schedule Generation and Computer Vision Progress Monitoring

Juan D. Núñez-Morales, Yoonhwa Jung, Mani Golparvar-Fard

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

State-of-the-art in construction document analytics and progress detection has experienced accelerated growth over the last decade. However, each area encountered isolated growth, not considering their interactions. Today, progress monitoring practices are often neglected due to requiring manual input of visible progress against schedules. Such a challenge can be attributed to (1) vision-based progress tracking lacking formal construction work templates applied in common construction workflows, and (2) research in automated schedule generation and analytics lacking focus on extracting fragnets from a body of existing schedules. This study brings together insights on research trends for automated schedule generation and analytics using Natural Language Processing (NLP) and detection of under-construction objects using Computer Vision. Finally, the AIConstruct system is presented to demonstrate, for the first time, how the integration of text and image can create seamless data synchronization for construction progress monitoring and automated schedule generation, unlocking a new research paradigm.

Original languageEnglish (US)
Title of host publicationAdvanced Technologies, Automation, and Computer Applications in Construction
EditorsJennifer S. Shane, Katherine M. Madson, Yunjeong Mo, Cristina Poleacovschi, Roy E. Sturgill
PublisherAmerican Society of Civil Engineers
Pages826-835
Number of pages10
ISBN (Electronic)9780784485262
DOIs
StatePublished - 2024
Externally publishedYes
EventConstruction Research Congress 2024, CRC 2024 - Des Moines, United States
Duration: Mar 20 2024Mar 23 2024

Publication series

NameConstruction Research Congress 2024, CRC 2024
Volume1

Conference

ConferenceConstruction Research Congress 2024, CRC 2024
Country/TerritoryUnited States
CityDes Moines
Period3/20/243/23/24

ASJC Scopus subject areas

  • Civil and Structural Engineering
  • Building and Construction

Fingerprint

Dive into the research topics of 'Bi-Directional Image-to-Text Mapping for NLP-Based Schedule Generation and Computer Vision Progress Monitoring'. Together they form a unique fingerprint.

Cite this