TY - JOUR
T1 - Shared memory parallelization for high-fidelity large-scale 3D polyhedral particle simulations
AU - Park, Eun Hyun
AU - Kindratenko, Volodymyr
AU - Hashash, Youssef M.A.
N1 - Funding Information:
Access to the large-memory system was provided by the Innovative Systems Laboratory (ISL) at the National Center for Supercomputing Applications (NCSA).
Publisher Copyright:
© 2021 Elsevier Ltd
PY - 2021/9
Y1 - 2021/9
N2 - Particle shape plays a vital role in granular material behavior, but simulations with realistic particle shapes are uncommon due to significant computational demands of complex particle geometry representation. In this work, BLOKS3D, a polyhedral Discrete Element Method (DEM) and impulse-based DEM (iDEM) codes are parallelized to enable large-scale simulations with realistic particle shapes on readily accessible multi-core machines. Data structures used in the original codes were redesigned and optimized, leading to 15% improved performance of the original serial codes. New parallel algorithms were developed resulting in 28 times performance improvement on a 48-core (quad-CPU) shared memory system over single core serial algorithm. The parallelized 3D polyhedral DEM and iDEM were applied to series of column collapse simulations. The codes successfully reproduced the runout distance in granular column collapse experiments. The particle force data from both parallelized DEM and iDEM matched data from the serial algorithm. The new parallel implementation of iDEM was then demonstrated with unprecedented 52 million 3D polyhedral particles simulations. This work will benefit future granular material studies with the newly introduced capacity to run large-scale simulations with realistic particle shapes on shared memory hardware platforms readily accessible to many engineers and researchers.
AB - Particle shape plays a vital role in granular material behavior, but simulations with realistic particle shapes are uncommon due to significant computational demands of complex particle geometry representation. In this work, BLOKS3D, a polyhedral Discrete Element Method (DEM) and impulse-based DEM (iDEM) codes are parallelized to enable large-scale simulations with realistic particle shapes on readily accessible multi-core machines. Data structures used in the original codes were redesigned and optimized, leading to 15% improved performance of the original serial codes. New parallel algorithms were developed resulting in 28 times performance improvement on a 48-core (quad-CPU) shared memory system over single core serial algorithm. The parallelized 3D polyhedral DEM and iDEM were applied to series of column collapse simulations. The codes successfully reproduced the runout distance in granular column collapse experiments. The particle force data from both parallelized DEM and iDEM matched data from the serial algorithm. The new parallel implementation of iDEM was then demonstrated with unprecedented 52 million 3D polyhedral particles simulations. This work will benefit future granular material studies with the newly introduced capacity to run large-scale simulations with realistic particle shapes on shared memory hardware platforms readily accessible to many engineers and researchers.
KW - Discrete element method
KW - Impulse-based discrete element method
KW - Polyhedral particle
KW - Shared-memory parallelization
UR - http://www.scopus.com/inward/record.url?scp=85107458813&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85107458813&partnerID=8YFLogxK
U2 - 10.1016/j.compgeo.2021.104008
DO - 10.1016/j.compgeo.2021.104008
M3 - Article
AN - SCOPUS:85107458813
SN - 0266-352X
VL - 137
JO - Computers and Geotechnics
JF - Computers and Geotechnics
M1 - 104008
ER -