Mapping to Irregular Torus Topologies and Other Techniques for Petascale Biomolecular Simulation

James C. Phillips, Yanhua Sun, Nikhil Jain, Eric J. Bohm, Laxmikant V Kale

Research output: Contribution to journalConference article

Abstract

Currently deployed petascale supercomputers typically use toroidal network topologies in three or more dimensions. While these networks perform well for topology-agnostic codes on a few thousand nodes, leadership machines with 20,000 nodes require topology awareness to avoid network contention for communication-intensive codes. Topology adaptation is complicated by irregular node allocation shapes and holes due to dedicated input/output nodes or hardware failure. In the context of the popular molecular dynamics program NAMD, we present methods for mapping a periodic 3-D grid of fixed-size spatial decomposition domains to 3-D Cray Gemini and 5-D IBM Blue Gene/Q toroidal networks to enable hundred-million atom full machine simulations, and to similarly partition node allocations into compact domains for smaller simulations using multiple copy algorithms. Additional enabling techniques are discussed and performance is reported for NCSA Blue Waters, ORNL Titan, ANL Mira, TACC Stampede, and NERSC Edison.

Original languageEnglish (US)
Article number7012994
Pages (from-to)81-91
Number of pages11
JournalInternational Conference for High Performance Computing, Networking, Storage and Analysis, SC
Volume2015-January
Issue numberJanuary
DOIs
StatePublished - Jan 16 2014
EventInternational Conference for High Performance Computing, Networking, Storage and Analysis, SC 2014 - New Orleans, United States
Duration: Nov 16 2014Nov 21 2014

Fingerprint

Topology
Supercomputers
Molecular dynamics
Genes
Decomposition
Hardware
Atoms
Communication
Water

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Software

Cite this

Mapping to Irregular Torus Topologies and Other Techniques for Petascale Biomolecular Simulation. / Phillips, James C.; Sun, Yanhua; Jain, Nikhil; Bohm, Eric J.; Kale, Laxmikant V.

In: International Conference for High Performance Computing, Networking, Storage and Analysis, SC, Vol. 2015-January, No. January, 7012994, 16.01.2014, p. 81-91.

Research output: Contribution to journalConference article

@article{2f60c4de9187478a9301dcbe67920d46,
title = "Mapping to Irregular Torus Topologies and Other Techniques for Petascale Biomolecular Simulation",
abstract = "Currently deployed petascale supercomputers typically use toroidal network topologies in three or more dimensions. While these networks perform well for topology-agnostic codes on a few thousand nodes, leadership machines with 20,000 nodes require topology awareness to avoid network contention for communication-intensive codes. Topology adaptation is complicated by irregular node allocation shapes and holes due to dedicated input/output nodes or hardware failure. In the context of the popular molecular dynamics program NAMD, we present methods for mapping a periodic 3-D grid of fixed-size spatial decomposition domains to 3-D Cray Gemini and 5-D IBM Blue Gene/Q toroidal networks to enable hundred-million atom full machine simulations, and to similarly partition node allocations into compact domains for smaller simulations using multiple copy algorithms. Additional enabling techniques are discussed and performance is reported for NCSA Blue Waters, ORNL Titan, ANL Mira, TACC Stampede, and NERSC Edison.",
author = "Phillips, {James C.} and Yanhua Sun and Nikhil Jain and Bohm, {Eric J.} and Kale, {Laxmikant V}",
year = "2014",
month = "1",
day = "16",
doi = "10.1109/SC.2014.12",
language = "English (US)",
volume = "2015-January",
pages = "81--91",
journal = "International Conference for High Performance Computing, Networking, Storage and Analysis, SC",
issn = "2167-4329",
number = "January",

}

TY - JOUR

T1 - Mapping to Irregular Torus Topologies and Other Techniques for Petascale Biomolecular Simulation

AU - Phillips, James C.

AU - Sun, Yanhua

AU - Jain, Nikhil

AU - Bohm, Eric J.

AU - Kale, Laxmikant V

PY - 2014/1/16

Y1 - 2014/1/16

N2 - Currently deployed petascale supercomputers typically use toroidal network topologies in three or more dimensions. While these networks perform well for topology-agnostic codes on a few thousand nodes, leadership machines with 20,000 nodes require topology awareness to avoid network contention for communication-intensive codes. Topology adaptation is complicated by irregular node allocation shapes and holes due to dedicated input/output nodes or hardware failure. In the context of the popular molecular dynamics program NAMD, we present methods for mapping a periodic 3-D grid of fixed-size spatial decomposition domains to 3-D Cray Gemini and 5-D IBM Blue Gene/Q toroidal networks to enable hundred-million atom full machine simulations, and to similarly partition node allocations into compact domains for smaller simulations using multiple copy algorithms. Additional enabling techniques are discussed and performance is reported for NCSA Blue Waters, ORNL Titan, ANL Mira, TACC Stampede, and NERSC Edison.

AB - Currently deployed petascale supercomputers typically use toroidal network topologies in three or more dimensions. While these networks perform well for topology-agnostic codes on a few thousand nodes, leadership machines with 20,000 nodes require topology awareness to avoid network contention for communication-intensive codes. Topology adaptation is complicated by irregular node allocation shapes and holes due to dedicated input/output nodes or hardware failure. In the context of the popular molecular dynamics program NAMD, we present methods for mapping a periodic 3-D grid of fixed-size spatial decomposition domains to 3-D Cray Gemini and 5-D IBM Blue Gene/Q toroidal networks to enable hundred-million atom full machine simulations, and to similarly partition node allocations into compact domains for smaller simulations using multiple copy algorithms. Additional enabling techniques are discussed and performance is reported for NCSA Blue Waters, ORNL Titan, ANL Mira, TACC Stampede, and NERSC Edison.

UR - http://www.scopus.com/inward/record.url?scp=84983103218&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84983103218&partnerID=8YFLogxK

U2 - 10.1109/SC.2014.12

DO - 10.1109/SC.2014.12

M3 - Conference article

AN - SCOPUS:84983103218

VL - 2015-January

SP - 81

EP - 91

JO - International Conference for High Performance Computing, Networking, Storage and Analysis, SC

JF - International Conference for High Performance Computing, Networking, Storage and Analysis, SC

SN - 2167-4329

IS - January

M1 - 7012994

ER -