Optimizing an MPI weather forecasting model via processor virtualization

Eduardo R. Rodrigues, Philippe O.A. Navaux, Jairo Panetta, Celso Luiz Mendes, Laxmikant V Kale

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Weather forecasting models are computationally intensive applications. These models are typically executed in parallel machines and a major obstacle for their scalability is load imbalance. The causes of such imbalance are either static (e.g. topography) or dynamic (e.g. shortwave radiation, moving thunderstorms). Various techniques, often embedded in the application's source code, have been used to address both sources. However, these techniques are inflexible and hard to use in legacy codes. In this paper, we demonstrate the effectiveness of processor virtualization for dynamically balancing the load in BRAMS, a mesoscale weather forecasting model based on MPI parallelization. We use the Charm++ infrastructure, with its overdecomposition and object-migration capabilities, to move subdomains across processors during execution of the model. Processor virtualization enables better overlap between computation and communication and improved cache efficiency. Furthermore, by employing an appropriate load balancer, we achieve better processor utilization while requiring minimal changes to the model's code.

Original languageEnglish (US)
Title of host publication17th International Conference on High Performance Computing, HiPC 2010
DOIs
StatePublished - Dec 1 2010
Event17th International Conference on High Performance Computing, HiPC 2010 - Goa, India
Duration: Dec 19 2010Dec 22 2010

Publication series

Name17th International Conference on High Performance Computing, HiPC 2010

Other

Other17th International Conference on High Performance Computing, HiPC 2010
CountryIndia
CityGoa
Period12/19/1012/22/10

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Theoretical Computer Science

Fingerprint Dive into the research topics of 'Optimizing an MPI weather forecasting model via processor virtualization'. Together they form a unique fingerprint.

  • Cite this

    Rodrigues, E. R., Navaux, P. O. A., Panetta, J., Mendes, C. L., & Kale, L. V. (2010). Optimizing an MPI weather forecasting model via processor virtualization. In 17th International Conference on High Performance Computing, HiPC 2010 [5713171] (17th International Conference on High Performance Computing, HiPC 2010). https://doi.org/10.1109/HIPC.2010.5713171