Abstract
Checkpoint restart plays an important role in high-performance computing (HPC) applications, allowing simulation runtime to extend beyond a single job allocation and facilitating recovery from hardware failure. Yet, as machines grow in size and in complexity, traditional approaches to checkpoint restart are becoming prohibitive. Current methods store a subset of the application’s state and exploit the memory hierarchy in the machine. However, as the energy cost of data movement continues to dominate, further reductions in checkpoint size are needed. Lossy compression, which can significantly reduce checkpoint sizes, offers a potential to reduce computational cost in checkpoint restart. This article investigates the use of numerical properties of partial differential equation (PDE) simulations, such as bounds on the truncation error, to evaluate the feasibility of using lossy compression in checkpointing PDE simulations. Restart from a checkpoint with lossy compression is considered for a fail-stop error in two time-dependent HPC application codes: PlasComCM and Nek5000. Results show that error in application variables due to a restart from a lossy compressed checkpoint can be masked by the numerical error in the discretization, leading to increased efficiency in checkpoint restart without influencing overall accuracy in the simulation.
Original language | English (US) |
---|---|
Pages (from-to) | 397-410 |
Number of pages | 14 |
Journal | International Journal of High Performance Computing Applications |
Volume | 33 |
Issue number | 2 |
DOIs | |
State | Published - Mar 1 2019 |
Keywords
- Lossy compression
- checkpoint restart
- compression
- error propagation
- error tolerance selection
- exascale
- fault tolerance
ASJC Scopus subject areas
- Software
- Theoretical Computer Science
- Hardware and Architecture