TY - JOUR
T1 - A deep learning-based approach to improve reconstruction of ultrasound computed tomography with full waveform inversion
AU - Anwar, Shoaib
AU - Yunker, Austin
AU - Kettimuthu, Rajkumar
AU - Anastasio, Mark A.
AU - Liu, Zhengchun
AU - Su, Weihua
AU - He, Jiaze
N1 - This work is supported by the financial contributions of NSF projects #2152764 and #2152765. The authors extend gratitude for the computational resources provided by ACCESS Project #MDE220005. Special thanks to Dr Paul Rodriguez for his expert technical support in data generation and training through the XSEDE Extended Collaborative Support Service (ECSS) Grant.
PY - 2025/3/1
Y1 - 2025/3/1
N2 - Enabled by multiple modalities of smart materials-based actuation and sensing, full waveform inversion (FWI) nowadays is an advanced ultrasound computed tomography technique that utilizes waveform data to generate high-resolution images of scanned regions. This technology offers promise for defect/damage detection and disease diagnosis, showing potential in nondestructive testing, structural health monitoring, and medical imaging. To reduce the lengthy computational time caused by time-domain FWI, modern AI-driven and data-driven approaches have been studied to accelerate the reconstruction process in recent years. However, most existing research focused on tuning specific neural networks for fixed-domain applications, leaving the relationship between model performance and characteristics of various training datasets underexplored. This paper presents a comprehensive investigation into the improvements achievable by integrating deep learning with the adjoint tomography theory, addressing the scientific questions of how amounts/distributions of the training data, augmentation, and loss functions influence the efficacy of this approach. The selected integration strategy involves training a U-Net neural network model using pairs of low-resolution inverted images and their corresponding high-resolution ground truth images. Once trained, the U-Net model instantaneously converts low-resolution inference images to high-resolution reconstructions. Generated using a proposed high-performance computing-based framework, multiple datasets were designed to offer a general representation of various applications while maintaining the shared characteristics across different use cases. The study also incorporates augmentation strategies to expand the size and complexity of the training dataset without significantly increasing the number of samples. Furthermore, a hyperparameter tuning framework was introduced to investigate the impact of multiple loss functions on the model performance. An additional challenge in data-driven approaches is the generalizability of the neural network model when exposed to out-of-distribution data. This study rigorously tests the model’s generalizability against several out-of-distribution datasets and finds that the U-Net model maintains a degree of generalizability when trained with unscaled datasets.
AB - Enabled by multiple modalities of smart materials-based actuation and sensing, full waveform inversion (FWI) nowadays is an advanced ultrasound computed tomography technique that utilizes waveform data to generate high-resolution images of scanned regions. This technology offers promise for defect/damage detection and disease diagnosis, showing potential in nondestructive testing, structural health monitoring, and medical imaging. To reduce the lengthy computational time caused by time-domain FWI, modern AI-driven and data-driven approaches have been studied to accelerate the reconstruction process in recent years. However, most existing research focused on tuning specific neural networks for fixed-domain applications, leaving the relationship between model performance and characteristics of various training datasets underexplored. This paper presents a comprehensive investigation into the improvements achievable by integrating deep learning with the adjoint tomography theory, addressing the scientific questions of how amounts/distributions of the training data, augmentation, and loss functions influence the efficacy of this approach. The selected integration strategy involves training a U-Net neural network model using pairs of low-resolution inverted images and their corresponding high-resolution ground truth images. Once trained, the U-Net model instantaneously converts low-resolution inference images to high-resolution reconstructions. Generated using a proposed high-performance computing-based framework, multiple datasets were designed to offer a general representation of various applications while maintaining the shared characteristics across different use cases. The study also incorporates augmentation strategies to expand the size and complexity of the training dataset without significantly increasing the number of samples. Furthermore, a hyperparameter tuning framework was introduced to investigate the impact of multiple loss functions on the model performance. An additional challenge in data-driven approaches is the generalizability of the neural network model when exposed to out-of-distribution data. This study rigorously tests the model’s generalizability against several out-of-distribution datasets and finds that the U-Net model maintains a degree of generalizability when trained with unscaled datasets.
KW - convolution neural network
KW - deep learning
KW - full waveform inversion
KW - reconstruction improvement
KW - ultrasound computed tomography
UR - https://www.scopus.com/pages/publications/105001508094
UR - https://www.scopus.com/inward/citedby.url?scp=105001508094&partnerID=8YFLogxK
U2 - 10.1088/1361-665X/adc359
DO - 10.1088/1361-665X/adc359
M3 - Article
AN - SCOPUS:105001508094
SN - 0964-1726
VL - 34
JO - Smart Materials and Structures
JF - Smart Materials and Structures
IS - 3
M1 - 035059
ER -