Communication analysis of parallel 3D FFT for flat cartesian meshes on large blue gene systems

Anthony Chan, Pavan Balaji, William Gropp, Rajeev Thakur

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Parallel 3D FFT is a commonly used numerical method in scientific computing. P3DFFT is a recently proposed implementation of parallel 3D FFT that is designed to allow scalability to massively large systems such as Blue Gene. While there has been recent work that demonstrates such scalability on regular cartesian meshes (equal length in each dimension), its performance and scalability for flat cartesian meshes (much smaller length in one dimension) is still a concern. In this paper, we perform studies on a 16-rack (16384-node) Blue Gene/L system that demonstrates that a combination of the network topology and the communication pattern of P3DFFT can result in early network saturation and consequently performance loss. We also show that remapping processes on nodes and rotating the mesh by taking the communication properties of P3DFFT into consideration, can help alleviate this problem and improve performance by up to 48% in some special cases.

Original languageEnglish (US)
Title of host publicationHigh Performance Computing - HiPC 2008 - 15th International Conference, Proceedings
PublisherSpringer-Verlag Berlin Heidelberg
Pages350-364
Number of pages15
ISBN (Print)354089893X, 9783540898931
DOIs
StatePublished - 2008
Event15th International Conference on High Performance Computing, HiPC 2008 - Bangalore, India
Duration: Dec 17 2008Dec 20 2008

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5374 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other15th International Conference on High Performance Computing, HiPC 2008
CountryIndia
CityBangalore
Period12/17/0812/20/08

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Communication analysis of parallel 3D FFT for flat cartesian meshes on large blue gene systems'. Together they form a unique fingerprint.

Cite this