TY - JOUR
T1 - Federated learning-based semantic segmentation for pixel-wise defect detection in additive manufacturing
AU - Mehta, Manan
AU - Shao, Chenhui
N1 - Funding Information:
The authors would like to thank the authors of the layer-wise imaging dataset at the Oak Ridge National Laboratory for compiling and releasing the pixel-wise annotated data. Support for DOI 10.13139/ORNLNCCS/1779073 dataset is provided by the U.S. Department of Energy , project Peregrine under Contract DE-AC05-00OR22725 . Project Peregrine used resources of the Oak Ridge Leadership Computing Facility at Oak Ridge National Laboratory , which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725 .
Publisher Copyright:
© 2022 The Authors
PY - 2022/7
Y1 - 2022/7
N2 - Semantic segmentation is a promising machine learning (ML) method for highly precise fine-scale defect detection and part qualification in additive manufacturing (AM). Most existing segmentation methods utilize convolutional neural network architectures that require large quantities of training data. However, obtaining sufficient data—both in quality and quantity—to train such models is expensive and time-consuming for individual AM practitioners, which severely limits the deployment of semantic segmentation in a data-scarce production environment. Similar data may be readily available with other AM practitioners that cannot be pooled together for conventional centralized learning (CL) due to its sensitive nature or conflicts of interest. This paper develops a federated learning (FL)-based method to simultaneously alleviate the constraints of data availability and data privacy. A U-Net architecture is created for semantic segmentation and is trained under the FL framework. The effectiveness of the developed FL-based semantic segmentation approach is demonstrated using case studies on layer-wise images from the laser powder bed fusion process. Results show that the proposed technique achieves a comparable defect detection performance with CL, which shares data among manufacturers/clients but does not preserve data privacy, and significantly outperforms individual learning, where each manufacturer trains a model using its own data. Additionally, the impact of data distribution across clients, incentives to participate in FL, and the learning dynamics of FL are discussed in detail. It is found that data diversity within and across clients improves FL performance, and FL does not involve a significantly higher training cost compared to CL. Lastly, transfer learning is shown to enhance FL generalizability, thus allowing more manufacturers with heterogeneous machines or technologies to benefit from participating in a data federation. Overall, this work puts forth FL as a promising paradigm for privacy-preserving collaborative ML in AM process control.
AB - Semantic segmentation is a promising machine learning (ML) method for highly precise fine-scale defect detection and part qualification in additive manufacturing (AM). Most existing segmentation methods utilize convolutional neural network architectures that require large quantities of training data. However, obtaining sufficient data—both in quality and quantity—to train such models is expensive and time-consuming for individual AM practitioners, which severely limits the deployment of semantic segmentation in a data-scarce production environment. Similar data may be readily available with other AM practitioners that cannot be pooled together for conventional centralized learning (CL) due to its sensitive nature or conflicts of interest. This paper develops a federated learning (FL)-based method to simultaneously alleviate the constraints of data availability and data privacy. A U-Net architecture is created for semantic segmentation and is trained under the FL framework. The effectiveness of the developed FL-based semantic segmentation approach is demonstrated using case studies on layer-wise images from the laser powder bed fusion process. Results show that the proposed technique achieves a comparable defect detection performance with CL, which shares data among manufacturers/clients but does not preserve data privacy, and significantly outperforms individual learning, where each manufacturer trains a model using its own data. Additionally, the impact of data distribution across clients, incentives to participate in FL, and the learning dynamics of FL are discussed in detail. It is found that data diversity within and across clients improves FL performance, and FL does not involve a significantly higher training cost compared to CL. Lastly, transfer learning is shown to enhance FL generalizability, thus allowing more manufacturers with heterogeneous machines or technologies to benefit from participating in a data federation. Overall, this work puts forth FL as a promising paradigm for privacy-preserving collaborative ML in AM process control.
KW - Data privacy
KW - Defect detection
KW - Federated learning
KW - Metal additive manufacturing
KW - Quality
KW - Semantic segmentation
UR - http://www.scopus.com/inward/record.url?scp=85133231510&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85133231510&partnerID=8YFLogxK
U2 - 10.1016/j.jmsy.2022.06.010
DO - 10.1016/j.jmsy.2022.06.010
M3 - Article
AN - SCOPUS:85133231510
SN - 0278-6125
VL - 64
SP - 197
EP - 210
JO - Journal of Manufacturing Systems
JF - Journal of Manufacturing Systems
ER -