TY - GEN
T1 - Benchmarking parallel I/O performance for a large scale scientific application on the TeraGrid
AU - Löffler, Frank
AU - Tao, Jian
AU - Allen, Gabrielle
AU - Schnetter, Erik
PY - 2010/5/3
Y1 - 2010/5/3
N2 - This paper is a report on experiences in benchmarking I/O performance on leading computational facilities on the NSF TeraGrid network with a large scale scientific application. Instead of focusing only on the raw file I/O bandwidth provided by different machine architectures, the I/O performance and scalability of the computational tools and libraries that are used in current production simulations are tested as a whole, however with focus mostly on bulk transfers. It is seen that the I/O performance of our production code scales very well, but is limited by the I/O system itself at some point. This limitation occurs at a low percentage of the computational size of the machines, which shows that at least for the application used for this paper the I/O system can be an important limiting factor in scaling up to the full size of the machine.
AB - This paper is a report on experiences in benchmarking I/O performance on leading computational facilities on the NSF TeraGrid network with a large scale scientific application. Instead of focusing only on the raw file I/O bandwidth provided by different machine architectures, the I/O performance and scalability of the computational tools and libraries that are used in current production simulations are tested as a whole, however with focus mostly on bulk transfers. It is seen that the I/O performance of our production code scales very well, but is limited by the I/O system itself at some point. This limitation occurs at a low percentage of the computational size of the machines, which shows that at least for the application used for this paper the I/O system can be an important limiting factor in scaling up to the full size of the machine.
UR - http://www.scopus.com/inward/record.url?scp=77951600247&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77951600247&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-11842-5_37
DO - 10.1007/978-3-642-11842-5_37
M3 - Conference contribution
AN - SCOPUS:77951600247
SN - 3642118410
SN - 9783642118418
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 272
EP - 279
BT - High Performance Computing and Applications - Second International Conference, HPCA 2009, Revised Selected Papers
T2 - 2nd International Conference on High-Performance Computing and Applications, HPCA 2009
Y2 - 10 August 2009 through 12 August 2009
ER -