TY - GEN
T1 - A case for using MPI's derived datatypes to improve I/O performance
AU - Thakur, Rajeev
AU - Gropp, William
AU - Lusk, Ewing
N1 - Publisher Copyright:
© 1998 IEEE.
PY - 1998
Y1 - 1998
N2 - MPI-IO, the I/O part of the MPI-2 standard, is a promising new interface for parallel I/O. A key feature of MPI-IO is that it allows users to access several noncontiguous pieces of data from a file with a single I/O function call by defining file views with derived datatypes. We explain how critical this feature is for high performance, why users must create and use derived datatypes whenever possible, and how it enables implementations to perform optimizations. In particular, we describe two optimizations our MPI-IO implementation, ROMIO, performs: data sieving and collective I/O. We demonstrate the performance and portability of the approach with performance results on five different parallel machines: HP Exemplar, IBM SP, Intel Paragon, NEC SX-4, and SGI Origin2000.
AB - MPI-IO, the I/O part of the MPI-2 standard, is a promising new interface for parallel I/O. A key feature of MPI-IO is that it allows users to access several noncontiguous pieces of data from a file with a single I/O function call by defining file views with derived datatypes. We explain how critical this feature is for high performance, why users must create and use derived datatypes whenever possible, and how it enables implementations to perform optimizations. In particular, we describe two optimizations our MPI-IO implementation, ROMIO, performs: data sieving and collective I/O. We demonstrate the performance and portability of the approach with performance results on five different parallel machines: HP Exemplar, IBM SP, Intel Paragon, NEC SX-4, and SGI Origin2000.
KW - MPI-IO
KW - Parallel I/O
UR - http://www.scopus.com/inward/record.url?scp=0742309931&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0742309931&partnerID=8YFLogxK
U2 - 10.1109/SC.1998.10006
DO - 10.1109/SC.1998.10006
M3 - Conference contribution
AN - SCOPUS:0742309931
T3 - Proceedings of the International Conference on Supercomputing
BT - SC 1998 - Proceedings of the ACM/IEEE Conference on Supercomputing
PB - Association for Computing Machinery
T2 - 1998 ACM/IEEE Conference on Supercomputing, SC 1998
Y2 - 7 November 1998 through 13 November 1998
ER -