Leveraging MPI's one-sided communication interface for shared-memory programming

Torsten Hoefler, James Dinan, Darius Buntinas, Pavan Balaji, Brian W. Barrett, Ron Brightwell, William Gropp, Vivek Kale, Rajeev Thakur

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Hybrid parallel programming with MPI for internode communication in conjunction with a shared-memory programming model to manage intranode parallelism has become a dominant approach to scalable parallel programming. While this model provides a great deal of flexibility and performance potential, it saddles programmers with the complexity of utilizing two parallel programming systems in the same application. We introduce an MPI-integrated shared-memory programming model that is incorporated into MPI through a small extension to the one-sided communication interface. We discuss the integration of this interface with the upcoming MPI 3.0 one-sided semantics and describe solutions for providing portable and efficient data sharing, atomic operations, and memory consistency. We describe an implementation of the new interface in the MPICH2 and Open MPI implementations and demonstrate an average performance improvement of 40% to the communication component of a five-point stencil solver.

Original languageEnglish (US)
Title of host publicationRecent Advances in the Message Passing Interface - 19th European MPI Users' Group Meeting, EuroMPI 2012, Proceedings
Pages132-141
Number of pages10
DOIs
StatePublished - 2012
Event19th European MPI Users' Group Meeting on Recent Advances in the Message Passing Interface, EuroMPI 2012 - Vienna, Austria
Duration: Sep 23 2012Sep 26 2012

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7490 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other19th European MPI Users' Group Meeting on Recent Advances in the Message Passing Interface, EuroMPI 2012
Country/TerritoryAustria
CityVienna
Period9/23/129/26/12

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Leveraging MPI's one-sided communication interface for shared-memory programming'. Together they form a unique fingerprint.

Cite this