Automatic generation of I/O kernels for HPC applications

Babak Behzad, Hoang Vu Dang, Farah Hariri, Weizhe Zhang, Marc Snir

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The study of the I/O performance of a parallel application can be facilitated by the use of an I/O kernel - a program that generates the same I/O calls as the original application, but can be executed much faster. Such I/O kernels are especially important when the programs under study are proprietary or classified, and only available in binary form.In this paper, we show how to create automatically such an I/O kernel, by executing the target application with an instrumented I/O library, next 'compressing' the resulting I/O traces into a compact C program that generates those traces.

Original languageEnglish (US)
Title of host publicationProceedings of PDSW 2014
Subtitle of host publication9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages31-36
Number of pages6
ISBN (Electronic)9781479970254
DOIs
StatePublished - Jan 20 2014
Event9th Parallel Data Storage Workshop, PDSW 2014 - Held in Conjunction with the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2014 - New Orleans, United States
Duration: Nov 16 2014 → …

Publication series

NameProceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis

Other

Other9th Parallel Data Storage Workshop, PDSW 2014 - Held in Conjunction with the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2014
CountryUnited States
CityNew Orleans
Period11/16/14 → …

Keywords

  • I/O kernels
  • I/O trace and replay
  • Parallel I/O

ASJC Scopus subject areas

  • Hardware and Architecture
  • Software

Cite this

Behzad, B., Dang, H. V., Hariri, F., Zhang, W., & Snir, M. (2014). Automatic generation of I/O kernels for HPC applications. In Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis (pp. 31-36). [7016280] (Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/PDSW.2014.6