G-Charm: An adaptive runtime system for message-driven parallel applications on hybrid systems

R. Vasudevan, Sathish S. Vadhiyar, Laxmikant V Kale

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The effective use of GPUs for accelerating applications depends on a number of factors including effective asynchronous use of heterogeneous resources, reducing memory transfer between CPU and GPU, increasing occupancy of GPU kernels, overlapping data transfers with computations, reducing GPU idling and kernel optimizations. Overcoming these challenges require considerable effort on the part of the application developers and most optimization strategies are often proposed and tuned specifically for individual applications. In this paper, we present G-Charm, a generic framework with an adaptive runtime system for efficient execution of message-driven parallel applications on hybrid systems. The framework is based on Charm++, a message-driven programming environment and runtime for parallel applications. The techniques in our framework include dynamic scheduling of work on CPU and GPU cores, maximizing reuse of data present in GPU memory, data management in GPU memory, and combining multiple kernels. We have presented results using our framework on Tesla S1070 and Fermi C2070 systems using three classes of applications: a highly regular and parallel 2D Jacobi solver, a regular dense matrix Cholesky factorization representing linear algebra computations with dependencies among parallel computations and highly irregular molecular dynamics simulations. With our generic framework, we obtain 1.5 to 15 times improvement over previous GPU-based implementation of Charm++. We also obtain about 14\% improvement over an implementation of Cholesky factorization with a static work-distribution scheme.

Original languageEnglish (US)
Title of host publicationICS 2013 - Proceedings of the 2013 ACM International Conference on Supercomputing
Pages349-358
Number of pages10
DOIs
StatePublished - Jul 11 2013
Event27th ACM International Conference on Supercomputing, ICS 2013 - Eugene, OR, United States
Duration: Jun 10 2013Jun 14 2013

Publication series

NameProceedings of the International Conference on Supercomputing

Other

Other27th ACM International Conference on Supercomputing, ICS 2013
CountryUnited States
CityEugene, OR
Period6/10/136/14/13

Keywords

  • charm++
  • combining kernels
  • data management
  • gpu
  • hybrid execution
  • optimizations

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'G-Charm: An adaptive runtime system for message-driven parallel applications on hybrid systems'. Together they form a unique fingerprint.

Cite this