DAME: A Runtime-Compiled engine for derived datatypes

Tarun Prabhu, William Gropp

Research output: Chapter in Book/Report/Conference proceedingConference contribution


In order to achieve high performance on modern and future machines, applications need to make effective use of the complex, hierarchical memory system. Writing performanceportable code continues to be challenging since each architecture has unique memory access characteristics. In addition, some optimization decisions can only reasonably be made at runtime. This suggests that a two-pronged approach to address the challenge is required. First, provide the programmer with a means to express memory operations declaratively which will allow a runtime system to transparently access the memory in the best way and second, exploit runtime information. MPI's derived datatypes accomplish the former although their performance in currentMPI implementations shows scope for improvement. JIT-compilation can be used for the latter. In this work, we present DAME | a language and interpreter that is used as the backend for MPI's derived datatypes. We also present DAME-L and DAME-X, two JIT-enabled implementations of DAME. All three implementations have been integrated into MPICH. We evaluate the performance of our implementations using DDTBench and two mini- Applications written with MPI derived datatypes and obtain communication speedups of up to 20x and mini- Application speedup of 3x.

Original languageEnglish (US)
Title of host publicationProceedings of the 22nd European MPI Users' Group Meeting, EuroMPI 2015
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450337953
StatePublished - Sep 21 2015
Event22nd European MPI Users' Group Meeting, EuroMPI 2015 - Bordeaux, France
Duration: Sep 21 2015Sep 23 2015

Publication series

NameACM International Conference Proceeding Series


Other22nd European MPI Users' Group Meeting, EuroMPI 2015


  • Data movement
  • Derived datatypes
  • Hpc
  • Jit
  • Mpi

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications


Dive into the research topics of 'DAME: A Runtime-Compiled engine for derived datatypes'. Together they form a unique fingerprint.

Cite this