PPL: An abstract runtime system for hybrid parallel programming

Alex Brooks, Hoang Vu Dang, Nikoli Dryden, Marc Snir

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Hardware trends indicate that supercomputers will see fast growing intra-node parallelism. Future programming models will need to carefully manage the interaction between inter- and intra-node parallelism to cope with this evolution. There exist many programming models which expose both levels of parallelism. However, they do not scale well as per-node thread counts rise and there is limited interoperability between threading and communication, leading to unnecessary software overheads and an increased amount of unnecessary communication. To address this, it is necessary to understand the limitations of current models and develop new approaches. We propose a new runtime system design, PPL, which abstracts important high-level concepts of a typical parallel system for distributed-memory machines. By modularizing these elements, layers can be tested to better understand the needs of future programming models. We present details of the design and development implementation of PPL in C++11 and evaluate the performance of several di erent module implementations through micro-benchmarks and three applications: Barnes-Hut, Monte Carlo particle tracking, and a sparse-triangular solver.

Original languageEnglish (US)
Title of host publicationProceedings of ESPM2 2015
Subtitle of host publication1st International Workshop on Extreme Scale Programming Models and Middleware - Held in conjunction with SC 2015: The International Conference for High Performance Computing, Networking, Storage and Analysis
PublisherAssociation for Computing Machinery, Inc
Pages2-9
Number of pages8
ISBN (Electronic)9781450339964
DOIs
StatePublished - Nov 15 2015
Event1st International Workshop on Extreme Scale Programming Models and Middleware, ESPM2 2015 - Austin, United States
Duration: Nov 15 2015 → …

Publication series

NameProceedings of ESPM2 2015: 1st International Workshop on Extreme Scale Programming Models and Middleware - Held in conjunction with SC 2015: The International Conference for High Performance Computing, Networking, Storage and Analysis

Other

Other1st International Workshop on Extreme Scale Programming Models and Middleware, ESPM2 2015
CountryUnited States
CityAustin
Period11/15/15 → …

Keywords

  • Distributed-memory parallelism
  • Multithreading
  • One-sided communication
  • PGAS
  • Programming models
  • RDMA

ASJC Scopus subject areas

  • Hardware and Architecture
  • Software

Fingerprint Dive into the research topics of 'PPL: An abstract runtime system for hybrid parallel programming'. Together they form a unique fingerprint.

  • Cite this

    Brooks, A., Dang, H. V., Dryden, N., & Snir, M. (2015). PPL: An abstract runtime system for hybrid parallel programming. In Proceedings of ESPM2 2015: 1st International Workshop on Extreme Scale Programming Models and Middleware - Held in conjunction with SC 2015: The International Conference for High Performance Computing, Networking, Storage and Analysis (pp. 2-9). (Proceedings of ESPM2 2015: 1st International Workshop on Extreme Scale Programming Models and Middleware - Held in conjunction with SC 2015: The International Conference for High Performance Computing, Networking, Storage and Analysis). Association for Computing Machinery, Inc. https://doi.org/10.1145/2832241.2832246