Use of deep convolutional neural networks and change detection technology for railway track inspections

Ryan M. Harrington, Arthur de O. Lima, Richard Fox-Ivey, Thanh Nguyen, John Laurent, Marcus S. Dersch, J. Riley Edwards

Research output: Contribution to journalArticlepeer-review

Abstract

Railroad track inspections conducted in accordance with federal regulations and internal railway operating practices result in significant labor costs and occupy valuable network capacity. These factors, combined with advancements in the field of machine vision, have encouraged a transition from human visual inspections to machine-based alternatives. Commercial machine vision technologies for railway inspection currently exist, and automated analysis approaches—which deliver objective results—are available in some systems. However, they are limited to a “pass/fail” approach through the detection of components which fail to meet maintenance or geometry thresholds, as opposed to being able to detect subtle changes in track conditions to identify evolving problems. To overcome these limitations, this paper presents results from the field deployment and validation of a system that pairs three-dimensional (3D) machine vision with automated change detection technology. The change detection approach uses a deep convolution neural network (DCNN) to accurately characterize track conditions between repeat runs. Current automated track inspection technologies were studied, and the applicability of change detection is discussed. The paper presents the process for 3D image capture, DCNN training, and evaluation by comparing DCNN results to an expert human evaluator. Finally, it presents change detection results for fastener presence and spike height. Results indicate that this technology can successfully identify fasteners and spikes with percent accuracies greater than 98% and that it can successfully generate change detection results for comparison of track condition among runs.

Original languageEnglish (US)
JournalProceedings of the Institution of Mechanical Engineers, Part F: Journal of Rail and Rapid Transit
DOIs
StateAccepted/In press - 2022
Externally publishedYes

Keywords

  • 3D laser triangulation
  • algorithms
  • artificial intelligence
  • change detection
  • deep convolutional neural networks
  • inspection
  • operational efficiency
  • safety

ASJC Scopus subject areas

  • Mechanical Engineering

Fingerprint

Dive into the research topics of 'Use of deep convolutional neural networks and change detection technology for railway track inspections'. Together they form a unique fingerprint.

Cite this