Dense 3D displacement and strain measurement framework of miter gates using computer vision

Yasutaka Narazaki, Vedhus Hoskere, Billie F. Spencer, Stuart Foltz, Matthew D. Smith

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper investigates the framework of vision-based dense 3D displacement and strain measurement using a digital camera. The framework has three components: (i) Estimation of 3D displacement and strain from images before and after deformation (water-fill event), (ii) evaluation of the expected accuracy of the measurement, and (iii) selection of the measurement setting with the highest expected accuracy. The framework first estimates the full-field optical flow between the images before and after water-fill event, and project the flow to the finite element (FE) model to estimate the 3D displacement and strain. Then, the expected displacement/strain estimation accuracy is evaluated at each node/element of the FE model. Finally, methods and measurement settings with the highest expected accuracy are selected to achieve the best results from the field measurement. Physics-based graphics model (PBGM) is used effectively to simulate the vision-based measurements in a photo-realistic environment and evaluate the performance of different methods and measurement settings by comparing the estimated values with the ground-truth values. The framework investigated in this paper can be used to analyze and optimize the performance of the measurement with different camera placement and post-processing steps prior to the field test.

Original languageEnglish (US)
Title of host publicationStructural Health Monitoring 2019
Subtitle of host publicationEnabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring
EditorsFu-Kuo Chang, Alfredo Guemes, Fotis Kopsaftopoulos
PublisherDEStech Publications Inc.
Pages3065-3072
Number of pages8
ISBN (Electronic)9781605956015
StatePublished - Jan 1 2019
Event12th International Workshop on Structural Health Monitoring: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT), IWSHM 2019 - Stanford, United States
Duration: Sep 10 2019Sep 12 2019

Publication series

NameStructural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring
Volume2

Conference

Conference12th International Workshop on Structural Health Monitoring: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT), IWSHM 2019
CountryUnited States
CityStanford
Period9/10/199/12/19

Fingerprint

Displacement measurement
Strain measurement
Computer vision
Water
Physics
Optical flows
Digital cameras
Cameras
Processing

ASJC Scopus subject areas

  • Computer Science Applications
  • Health Information Management

Cite this

Narazaki, Y., Hoskere, V., Spencer, B. F., Foltz, S., & Smith, M. D. (2019). Dense 3D displacement and strain measurement framework of miter gates using computer vision. In F-K. Chang, A. Guemes, & F. Kopsaftopoulos (Eds.), Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring (pp. 3065-3072). (Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring; Vol. 2). DEStech Publications Inc..

Dense 3D displacement and strain measurement framework of miter gates using computer vision. / Narazaki, Yasutaka; Hoskere, Vedhus; Spencer, Billie F.; Foltz, Stuart; Smith, Matthew D.

Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring. ed. / Fu-Kuo Chang; Alfredo Guemes; Fotis Kopsaftopoulos. DEStech Publications Inc., 2019. p. 3065-3072 (Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring; Vol. 2).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Narazaki, Y, Hoskere, V, Spencer, BF, Foltz, S & Smith, MD 2019, Dense 3D displacement and strain measurement framework of miter gates using computer vision. in F-K Chang, A Guemes & F Kopsaftopoulos (eds), Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring. Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring, vol. 2, DEStech Publications Inc., pp. 3065-3072, 12th International Workshop on Structural Health Monitoring: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT), IWSHM 2019, Stanford, United States, 9/10/19.
Narazaki Y, Hoskere V, Spencer BF, Foltz S, Smith MD. Dense 3D displacement and strain measurement framework of miter gates using computer vision. In Chang F-K, Guemes A, Kopsaftopoulos F, editors, Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring. DEStech Publications Inc. 2019. p. 3065-3072. (Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring).
Narazaki, Yasutaka ; Hoskere, Vedhus ; Spencer, Billie F. ; Foltz, Stuart ; Smith, Matthew D. / Dense 3D displacement and strain measurement framework of miter gates using computer vision. Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring. editor / Fu-Kuo Chang ; Alfredo Guemes ; Fotis Kopsaftopoulos. DEStech Publications Inc., 2019. pp. 3065-3072 (Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring).
@inproceedings{bd9b919852de45c2b055a9115fb268f1,
title = "Dense 3D displacement and strain measurement framework of miter gates using computer vision",
abstract = "This paper investigates the framework of vision-based dense 3D displacement and strain measurement using a digital camera. The framework has three components: (i) Estimation of 3D displacement and strain from images before and after deformation (water-fill event), (ii) evaluation of the expected accuracy of the measurement, and (iii) selection of the measurement setting with the highest expected accuracy. The framework first estimates the full-field optical flow between the images before and after water-fill event, and project the flow to the finite element (FE) model to estimate the 3D displacement and strain. Then, the expected displacement/strain estimation accuracy is evaluated at each node/element of the FE model. Finally, methods and measurement settings with the highest expected accuracy are selected to achieve the best results from the field measurement. Physics-based graphics model (PBGM) is used effectively to simulate the vision-based measurements in a photo-realistic environment and evaluate the performance of different methods and measurement settings by comparing the estimated values with the ground-truth values. The framework investigated in this paper can be used to analyze and optimize the performance of the measurement with different camera placement and post-processing steps prior to the field test.",
author = "Yasutaka Narazaki and Vedhus Hoskere and Spencer, {Billie F.} and Stuart Foltz and Smith, {Matthew D.}",
year = "2019",
month = "1",
day = "1",
language = "English (US)",
series = "Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring",
publisher = "DEStech Publications Inc.",
pages = "3065--3072",
editor = "Fu-Kuo Chang and Alfredo Guemes and Fotis Kopsaftopoulos",
booktitle = "Structural Health Monitoring 2019",

}

TY - GEN

T1 - Dense 3D displacement and strain measurement framework of miter gates using computer vision

AU - Narazaki, Yasutaka

AU - Hoskere, Vedhus

AU - Spencer, Billie F.

AU - Foltz, Stuart

AU - Smith, Matthew D.

PY - 2019/1/1

Y1 - 2019/1/1

N2 - This paper investigates the framework of vision-based dense 3D displacement and strain measurement using a digital camera. The framework has three components: (i) Estimation of 3D displacement and strain from images before and after deformation (water-fill event), (ii) evaluation of the expected accuracy of the measurement, and (iii) selection of the measurement setting with the highest expected accuracy. The framework first estimates the full-field optical flow between the images before and after water-fill event, and project the flow to the finite element (FE) model to estimate the 3D displacement and strain. Then, the expected displacement/strain estimation accuracy is evaluated at each node/element of the FE model. Finally, methods and measurement settings with the highest expected accuracy are selected to achieve the best results from the field measurement. Physics-based graphics model (PBGM) is used effectively to simulate the vision-based measurements in a photo-realistic environment and evaluate the performance of different methods and measurement settings by comparing the estimated values with the ground-truth values. The framework investigated in this paper can be used to analyze and optimize the performance of the measurement with different camera placement and post-processing steps prior to the field test.

AB - This paper investigates the framework of vision-based dense 3D displacement and strain measurement using a digital camera. The framework has three components: (i) Estimation of 3D displacement and strain from images before and after deformation (water-fill event), (ii) evaluation of the expected accuracy of the measurement, and (iii) selection of the measurement setting with the highest expected accuracy. The framework first estimates the full-field optical flow between the images before and after water-fill event, and project the flow to the finite element (FE) model to estimate the 3D displacement and strain. Then, the expected displacement/strain estimation accuracy is evaluated at each node/element of the FE model. Finally, methods and measurement settings with the highest expected accuracy are selected to achieve the best results from the field measurement. Physics-based graphics model (PBGM) is used effectively to simulate the vision-based measurements in a photo-realistic environment and evaluate the performance of different methods and measurement settings by comparing the estimated values with the ground-truth values. The framework investigated in this paper can be used to analyze and optimize the performance of the measurement with different camera placement and post-processing steps prior to the field test.

UR - http://www.scopus.com/inward/record.url?scp=85074270378&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85074270378&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85074270378

T3 - Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring

SP - 3065

EP - 3072

BT - Structural Health Monitoring 2019

A2 - Chang, Fu-Kuo

A2 - Guemes, Alfredo

A2 - Kopsaftopoulos, Fotis

PB - DEStech Publications Inc.

ER -