Maximizing Throughput on a Dragonfly Network

Nikhil Jain, Abhinav Bhatele, Xiang Ni, Nicholas J. Wright, Laxmikant V. Kale

Research output: Contribution to journalConference articlepeer-review


Interconnection networks are a critical resource for large supercomputers. The dragonfly topology, which provides a low network diameter and large bisection bandwidth, is being explored as a promising option for building multi-Petaflop's and Exaflop's systems. Unlike the extensively studied torus networks, the best choices of message routing and job placement strategies for the dragonfly topology are not well understood. This paper aims at analyzing the behavior of a machine built using a dragonfly network for various routing strategies, job placement policies, and application communication patterns. Our study is based on a novel model that predicts traffic on individual links for direct, indirect, and adaptive routing strategies. We analyze results for individual communication patterns and some common parallel job workloads. The predictions presented in this paper are for a 100+ Petaflop's prototype machine with 92,160 high radix routers and 8.8 million cores.

Original languageEnglish (US)
Article number7013015
Pages (from-to)336-347
Number of pages12
JournalInternational Conference for High Performance Computing, Networking, Storage and Analysis, SC
Issue numberJanuary
StatePublished - Jan 16 2014
EventInternational Conference for High Performance Computing, Networking, Storage and Analysis, SC 2014 - New Orleans, United States
Duration: Nov 16 2014Nov 21 2014


  • dragonfly networks
  • job placement
  • modeling
  • prediction
  • routing

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Software


Dive into the research topics of 'Maximizing Throughput on a Dragonfly Network'. Together they form a unique fingerprint.

Cite this