Provably optimal parallel transport sweeps on semi-structured grids

Michael P. Adams, Marvin L. Adams, W. Daryl Hawkins, Timmie Smith, Lawrence Rauchwerger, Nancy M. Amato, Teresa S. Bailey, Robert D. Falgout, Adam Kunen, Peter Brown

Research output: Contribution to journalArticle

Abstract

We have found provably optimal algorithms for full-domain discrete-ordinate transport sweeps on a class of grids in 2D and 3D Cartesian geometry that are regular at a coarse level but arbitrary within the coarse blocks. We describe these algorithms and show that they always execute the full eight-octant (or four-quadrant if 2D) sweep in the minimum possible number of stages for a given Px×Py×Pz partitioning. Computational results confirm that our optimal scheduling algorithms execute sweeps in the minimum possible stage count. Observed parallel efficiencies agree well with our performance model. Our PDT transport code has achieved approximately 68% parallel efficiency with >1.5M parallel threads, relative to 8 threads, on a simple weak-scaling problem with only three energy groups, 10 directions per octant, and 4096 cells/thread. Our ARDRA code has achieved 71% efficiency with >1.5M cores, relative to 16 cores, with 36 directions per octant and 48 energy groups. We demonstrate similar efficiencies with PDT on a realistic set of nuclear-reactor test problems, with unstructured meshes that resolve fine geometric details. These results demonstrate that discrete-ordinates transport sweeps can be executed with high efficiency using more than 106 parallel processes.

Original languageEnglish (US)
Article number109234
JournalJournal of Computational Physics
Volume407
DOIs
StatePublished - Apr 15 2020
Externally publishedYes

Keywords

  • Parallel algorithms
  • Parallel transport sweeps
  • Performance models
  • Scheduling algorithms
  • STAPL
  • Unstructured mesh

ASJC Scopus subject areas

  • Numerical Analysis
  • Modeling and Simulation
  • Physics and Astronomy (miscellaneous)
  • Physics and Astronomy(all)
  • Computer Science Applications
  • Computational Mathematics
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Provably optimal parallel transport sweeps on semi-structured grids'. Together they form a unique fingerprint.

  • Cite this

    Adams, M. P., Adams, M. L., Hawkins, W. D., Smith, T., Rauchwerger, L., Amato, N. M., Bailey, T. S., Falgout, R. D., Kunen, A., & Brown, P. (2020). Provably optimal parallel transport sweeps on semi-structured grids. Journal of Computational Physics, 407, [109234]. https://doi.org/10.1016/j.jcp.2020.109234