TY - JOUR
T1 - Improving the accuracy of the deep energy method
AU - Chadha, Charul
AU - He, Junyan
AU - Abueidda, Diab
AU - Koric, Seid
AU - Guleryuz, Erman
AU - Jasiuk, Iwona
N1 - The authors would like to thank the National Center for Supercomputing Applications (NCSA) at the University of Illinois at Urbana-Champaign, particularly its Industry Program, Research Consulting Directorate, and the Center for Artificial Intelligence Innovation (CAII) for their support and hardware resources. This research is also a part of the Delta research computing project, supported by the National Science Foundation (award OCI 2005572) and the State of Illinois.
PY - 2023/12
Y1 - 2023/12
N2 - The deep energy method (DEM), a type of physics-informed neural network, is evolving as an alternative to finite element analysis. It employs the principle of minimum potential energy to predict an object’s behavior under various boundary conditions. However, the model’s accuracy is contingent upon choosing the appropriate architecture for the model, which can be challenging due to the high interactions between hyperparameters, large search space, difficulty in identifying objective functions, and non-convex relationships with the objective functions. To improve DEM’s accuracy, we first introduce random Fourier feature (RFF) mapping. RFF mapping helps during the model’s training by reducing bias toward high frequencies. The effects of six hyperparameters are then studied under static compression, tension, and bending loads in planar linear elasticity. Based on this study, a systematic automated hyperparameter optimization approach is proposed. Due to the high interaction between hyperparameters and the non-convex nature of the optimization problem, Bayesian optimization algorithms are used. The models trained using optimized hyperparameters and having Fourier feature mapping can accurately predict deflections compared to finite element analysis. Additionally, the deflections obtained for tension and compression load cases are more sensitive to variations in hyperparameters than bending.
AB - The deep energy method (DEM), a type of physics-informed neural network, is evolving as an alternative to finite element analysis. It employs the principle of minimum potential energy to predict an object’s behavior under various boundary conditions. However, the model’s accuracy is contingent upon choosing the appropriate architecture for the model, which can be challenging due to the high interactions between hyperparameters, large search space, difficulty in identifying objective functions, and non-convex relationships with the objective functions. To improve DEM’s accuracy, we first introduce random Fourier feature (RFF) mapping. RFF mapping helps during the model’s training by reducing bias toward high frequencies. The effects of six hyperparameters are then studied under static compression, tension, and bending loads in planar linear elasticity. Based on this study, a systematic automated hyperparameter optimization approach is proposed. Due to the high interaction between hyperparameters and the non-convex nature of the optimization problem, Bayesian optimization algorithms are used. The models trained using optimized hyperparameters and having Fourier feature mapping can accurately predict deflections compared to finite element analysis. Additionally, the deflections obtained for tension and compression load cases are more sensitive to variations in hyperparameters than bending.
UR - http://www.scopus.com/inward/record.url?scp=85170089303&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85170089303&partnerID=8YFLogxK
U2 - 10.1007/s00707-023-03691-3
DO - 10.1007/s00707-023-03691-3
M3 - Article
AN - SCOPUS:85170089303
SN - 0001-5970
VL - 234
SP - 5975
EP - 5998
JO - Acta Mechanica
JF - Acta Mechanica
IS - 12
ER -