Noncontiguous I/O accesses through MPI-IO

Avery Ching, Alok Choudhary, Kenin Coloma, Wei Keng Liao, Robert Ross, William Gropp

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

I/O performance remains a weakness of parallel computing systems today. While this weakness is partly attributed to rapid advances in other system components, I/O interfaces available to programmers and the I/O methods supported by file systems have traditionally not matched efficiently with the types of I/O operations that scientific applications perform, particularly noncontiguous accesses. The MPI-IO interface allows for rich descriptions of the I/O patterns desired for scientific applications and implementations such as ROMIO have taken advantage of this ability while remaining limited by underlying file system methods. A method of noncontiguous data access, list I/O, was recently implemented in the Parallel Virtual File System (PVFS). We implement support for this interface in the ROMIO MPI-IO implementation. Through a suite of noncontiguous I/O tests we compared ROMIO list I/O to current methods of ROMIO noncontiguous access and found that the list I/O interface provides performance benefits in many noncontiguous cases.

Original languageEnglish (US)
Title of host publicationProceedings - CCGrid 2003
Subtitle of host publication3rd IEEE/ACM International Symposium on Cluster Computing and the Grid
Pages104-111
Number of pages8
DOIs
StatePublished - Dec 1 2003
Externally publishedYes
Event3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGrid 2003 - Tokyo, Japan
Duration: May 12 2003May 15 2003

Publication series

NameProceedings - CCGrid 2003: 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid

Other

Other3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGrid 2003
CountryJapan
CityTokyo
Period5/12/035/15/03

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Computer Science Applications
  • Software
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Noncontiguous I/O accesses through MPI-IO'. Together they form a unique fingerprint.

  • Cite this

    Ching, A., Choudhary, A., Coloma, K., Liao, W. K., Ross, R., & Gropp, W. (2003). Noncontiguous I/O accesses through MPI-IO. In Proceedings - CCGrid 2003: 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (pp. 104-111). [1199358] (Proceedings - CCGrid 2003: 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid). https://doi.org/10.1109/CCGRID.2003.1199358