Exploring parallel I/O concurrency with speculative prefetching

Yong Chen, Surendra Byna, Xian He Sun, Rajeev Thakur, William Gropp

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Parallel applications can benefit greatly from massive computational capability, but their performance usually suffers due to large latency in I/O accesses. Conventional I/O prefetching techniques are conservative and are limited by low accuracy and coverage. As the processor performance has been increasing rapidly and the computing power is virtually free, we introduce a novel speculative approach for comprehensive and aggressive parallel I/O prefetching in this study. We present the design of our approach, as well as challenges, solutions, and the prototype implementation. The experiments have shown promising results in reducing I/O access latency.

Original languageEnglish (US)
Title of host publicationProceedings - 37th International Conference on Parallel Processing, ICPP 2008
Pages422-429
Number of pages8
DOIs
StatePublished - Nov 17 2008
Event37th International Conference on Parallel Processing, ICPP 2008 - Portland, OR, United States
Duration: Sep 9 2008Sep 12 2008

Publication series

NameProceedings of the International Conference on Parallel Processing
ISSN (Print)0190-3918

Other

Other37th International Conference on Parallel Processing, ICPP 2008
CountryUnited States
CityPortland, OR
Period9/9/089/12/08

ASJC Scopus subject areas

  • Software
  • Mathematics(all)
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Exploring parallel I/O concurrency with speculative prefetching'. Together they form a unique fingerprint.

  • Cite this

    Chen, Y., Byna, S., Sun, X. H., Thakur, R., & Gropp, W. (2008). Exploring parallel I/O concurrency with speculative prefetching. In Proceedings - 37th International Conference on Parallel Processing, ICPP 2008 (pp. 422-429). [4625877] (Proceedings of the International Conference on Parallel Processing). https://doi.org/10.1109/ICPP.2008.54