CkDirect: Unsynchronized one-sided communication in a message-driven paradigm

Eric Bohm, Sayantan Chakravorty, Pritish Jetley, Abhinav Bhatelé, Laxmikant V. Kalé

Research output: Chapter in Book/Report/Conference proceedingConference contribution


A significant fraction of parallel scientific codes are iterative with barriers between iterations or even between phases of the same iteration. The sender of a message is assured that the receiver is executing exactly the same iteration or phase. This opens up the opportunity to use one-sided communication without synchronization, explicit or implicit, between the sender and receiver of every message. The synchronization inherent in the application is sufficient to ensure correctness. We present CkDirect, an interface for such one-sided communication in the message driven Charm++ runtime system. CkDirect helps avoid unnecessary synchronization and message copying as well as scheduling overhead in iterative scientific codes. We describe the interface as well as its implementations on two different interconnects: Infiniband and Blue Gene/P. We evaluate CkDirect through a micro-benchmark, two simple scientific codes: stencil computation and matrix multiplication, as well as a full fledged quantum chemistry application called OpenAtom.

Original languageEnglish (US)
Title of host publicationICPPW 2009 - The 38th International Conference Parallel Processing Workshops
Number of pages8
StatePublished - Dec 1 2009
Event38th International Conference Parallel Processing Workshops, ICPPW 2009 - Vienna, Austria
Duration: Sep 22 2009Sep 25 2009

Publication series

NameProceedings of the International Conference on Parallel Processing Workshops
ISSN (Print)1530-2016


Other38th International Conference Parallel Processing Workshops, ICPPW 2009


  • Application-level synchronization
  • One-sided communication
  • Performance evaluation

ASJC Scopus subject areas

  • Software
  • Mathematics(all)
  • Hardware and Architecture


Dive into the research topics of 'CkDirect: Unsynchronized one-sided communication in a message-driven paradigm'. Together they form a unique fingerprint.

Cite this