Exploring the feasibility of lossy compression for PDE simulations

Jon Calhoun, Franck Cappello, Luke N. Olson, Marc Snir, William D. Gropp

Research output: Contribution to journalArticle

Abstract

Checkpoint restart plays an important role in high-performance computing (HPC) applications, allowing simulation runtime to extend beyond a single job allocation and facilitating recovery from hardware failure. Yet, as machines grow in size and in complexity, traditional approaches to checkpoint restart are becoming prohibitive. Current methods store a subset of the application’s state and exploit the memory hierarchy in the machine. However, as the energy cost of data movement continues to dominate, further reductions in checkpoint size are needed. Lossy compression, which can significantly reduce checkpoint sizes, offers a potential to reduce computational cost in checkpoint restart. This article investigates the use of numerical properties of partial differential equation (PDE) simulations, such as bounds on the truncation error, to evaluate the feasibility of using lossy compression in checkpointing PDE simulations. Restart from a checkpoint with lossy compression is considered for a fail-stop error in two time-dependent HPC application codes: PlasComCM and Nek5000. Results show that error in application variables due to a restart from a lossy compressed checkpoint can be masked by the numerical error in the discretization, leading to increased efficiency in checkpoint restart without influencing overall accuracy in the simulation.

Original languageEnglish (US)
Pages (from-to)397-410
Number of pages14
JournalInternational Journal of High Performance Computing Applications
Volume33
Issue number2
DOIs
StatePublished - Mar 1 2019

Keywords

  • Lossy compression
  • checkpoint restart
  • compression
  • error propagation
  • error tolerance selection
  • exascale
  • fault tolerance

ASJC Scopus subject areas

  • Software
  • Theoretical Computer Science
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Exploring the feasibility of lossy compression for PDE simulations'. Together they form a unique fingerprint.

  • Cite this