Challenges and successes in achieving the potential of MPI

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The first MPI standard specified a powerful and general message-passing model, including both point-to-point and collective communications. MPI-2 took MPI beyond simple message-passing, adding support for remote memory operations and parallel I/O. Implementations of MPI-1 appeared with the MPI standard; implementations of MPI-2 are continuing to appear. But many implementations build on top of a point-to-point communication base, leading to inefficiencies in the performance of the MPI implementation. Even for MPI-1, many MPI implementations base their collective operations on relatively simple algorithms, built on top of MPI point-to-point (or a simple lower-level communication layer). These implementations achieve the functionality but not the scalable performance that is possible in MPI. In MPI-2, providing a high-performance implementation of the remote-memory operations requires great care and attention to the opportunities for performance that are contained in the MPI standard. One of the goals of the MPICH2 project is to provide an easily extended example of an implementation of MPI that goes beyond a simple pointto- point communication model. This talk will discuss some of the challenges in implementing collective, remote-memory, and I/O operations in MPI. For example, many of the best algorithms for collective operations involve the use of message subdivision (possibly involving less than one instance of a MPI derived datatype) and multisend or store-andforward operations. As another example, the remote memory operations in MPI-2 specify semantics that are designed to specify precise behavior, excluding ambiguities or race conditions. These clean (if somewhat complex) semantics are sometimes seen as a barrier to performance. This talk will discuss some of the methods that can be used to exploit the RMA semantics to provide higher performance for typical application codes. The approaches taken in MPICH2, along with current results from the MPICH2 project, will be discussed.

Original languageEnglish (US)
Title of host publicationRecent Advances in Parallel Virtual Machine and Message Passing Interface - 8th European PVM/MPI Users’ Group Meeting, Proceedings
EditorsYiannis Cotronis, Jack Dongarra
PublisherSpringer
Pages7
Number of pages1
ISBN (Print)3540426094, 9783540426097
DOIs
StatePublished - 2001
Externally publishedYes
Event8th European on Parallel Virtual Machine and Message Passing Interface Users’ Group Meeting, 2001 - Santorini/Thera, Greece
Duration: Sep 23 2001Sep 26 2001

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume2131
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other8th European on Parallel Virtual Machine and Message Passing Interface Users’ Group Meeting, 2001
Country/TerritoryGreece
CitySantorini/Thera
Period9/23/019/26/01

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Challenges and successes in achieving the potential of MPI'. Together they form a unique fingerprint.

Cite this