InstaDam: Open-Source Platform for Rapid Semantic Segmentation of Structural Damage

Vedhus Hoskere, Fouad Amer, Doug Friedel, Wanxian Yang, Yu Tang, Yasutaka Narazaki, Matthew D. Smith, Mani Golparvar-Fard, Billie F. Spencer

Research output: Contribution to journalArticlepeer-review

Abstract

The tremendous success of automated methods for the detection of damage in images of civil infrastructure has been fueled by exponential advances in deep learning over the past decade. In particular, many efforts have taken place in academia and more recently in industry that demonstrate the success of supervised deep learning methods for semantic segmentation of damage (i.e., the pixel-wise identification of damage in images). However, in graduating from the detection of damage to applications such as inspection automation, efforts have been limited by the lack of large open datasets of real-world images with annotations for multiple types of damage, and other related information such as material and component types. Such datasets for structural inspections are difficult to develop because annotating the complex and amorphous shapes taken by damage patterns remains a tedious task (requiring too many clicks and careful selection of points), even with state-of-the art annotation software. In this work, InstaDam—an open source software platform for fast pixel-wise annotation of damage—is presented. By utilizing binary masks to aid user input, InstaDam greatly speeds up the annotation process and improves the consistency of annotations. The masks are generated by applying established image processing techniques (IPTs) to the images being annotated. Several different tunable IPTs are implemented to allow for rapid annotation of a wide variety of damage types. The paper first describes details of InstaDam’s software architecture and presents some of its key features. Then, the benefits of InstaDam are explored by comparing it to the Image Labeler app in Matlab. Experiments are conducted where two employed student annotators are given the task of annotating damage in a small dataset of images using Matlab, InstaDam without IPTs, and InstaDam. Comparisons are made, quantifying the improvements in annotation speed and annotation consistency across annotators. A description of the statistics of the different IPTs used for different annotated classes is presented. The gains in annotation consistency and efficiency from using InstaDam will facilitate the development of datasets that can help to advance research into automation of visual inspections.
Original languageEnglish (US)
Article number520
Pages (from-to)1-16
Number of pages16
JournalApplied Sciences (Switzerland)
Volume11
Issue number2
DOIs
StatePublished - Jan 2 2021

Keywords

  • Computer vision
  • Damage identi-fication
  • Deep learning
  • Image processing
  • Software analysis
  • Software engineering
  • Structural inspections
  • Supervised learning
  • Usability testing
  • User interface design

ASJC Scopus subject areas

  • Materials Science(all)
  • Instrumentation
  • Engineering(all)
  • Process Chemistry and Technology
  • Computer Science Applications
  • Fluid Flow and Transfer Processes

Fingerprint Dive into the research topics of 'InstaDam: Open-Source Platform for Rapid Semantic Segmentation of Structural Damage'. Together they form a unique fingerprint.

Cite this