A fault-tolerance protocol for parallel applications with communication imbalance

Esteban Meneses, Laxmikant V. Kale

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The predicted failure rates of future supercomputers loom the groundbreaking research large machines are expected to foster. Therefore, resilient extreme-scale applications are an absolute necessity to effectively use the new generation of supercomputers. Rollback-recovery techniques have been traditionally used in HPC to provide resilience. Among those techniques, message logging provides the appealing features of saving energy, accelerating recovery, and having low performance penalty. Its increased memory consumption is, however, an important downside. This paper introduces memory-constrained message logging (MCML), a general framework for decreasing the memory footprint of message-logging protocols. In particular, we demonstrate the effectiveness of MCML in maintaining message logging feasible for applications with substantial communication imbalance. This type of applications appear in many scientific fields. We present experimental results with several parallel codes running on up to 4,096 cores. Using those results and an analytical model, we predict MCML can reduce execution time up to 25% and energy consumption up to 15%, at extreme scale.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE 27th International Symposium on Computer Architecture and High Performance Computing, SBAC-PAD 2015
PublisherIEEE Computer Society
Pages162-169
Number of pages8
ISBN (Electronic)9781467380119
DOIs
StatePublished - Jan 12 2016
Event27th IEEE International Symposium on Computer Architecture and High Performance Computing, SBAC-PAD 2015 - Florianopolis, Brazil
Duration: Oct 18 2015Oct 21 2015

Publication series

NameProceedings - Symposium on Computer Architecture and High Performance Computing
Volume2016-January
ISSN (Print)1550-6533

Other

Other27th IEEE International Symposium on Computer Architecture and High Performance Computing, SBAC-PAD 2015
CountryBrazil
CityFlorianopolis
Period10/18/1510/21/15

Keywords

  • Communication imbalance
  • Fault tolerance
  • Message logging

ASJC Scopus subject areas

  • Hardware and Architecture
  • Software

Fingerprint Dive into the research topics of 'A fault-tolerance protocol for parallel applications with communication imbalance'. Together they form a unique fingerprint.

Cite this