Collectives on two-tier direct networks

Nikhil Jain; Johnmark Lau; Laxmikant Kale

doi:10.1007/978-3-642-33518-1_12

Collectives on two-tier direct networks

Nikhil Jain, Johnmark Lau, Laxmikant Kale

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Collectives are an important component of parallel programs, and have a significant impact on performance and scalability of an application. To obtain best performance, platform specific implementations of various parallel programming frameworks, such as MPI and Charm++, are done. As a result, when systems with new network topologies are built, new topology aware algorithms for collectives are added to these frameworks that also contain the topology oblivious algorithms. In this paper, we propose topology aware algorithms for collectives performed on two-tier direct networks such as IBM PERCS and Dragonfly. We observe that, for large message operations, significant performance gains can be made by taking advantage of large number of links in a two-tier direct network. We evaluate proposed algorithms using an analytical model based on link utilization.

Original language	English (US)
Title of host publication	Recent Advances in the Message Passing Interface - 19th European MPI Users' Group Meeting, EuroMPI 2012, Proceedings
Pages	67-77
Number of pages	11
DOIs	https://doi.org/10.1007/978-3-642-33518-1_12
State	Published - Oct 24 2012
Event	19th European MPI Users' Group Meeting on Recent Advances in the Message Passing Interface, EuroMPI 2012 - Vienna, Austria Duration: Sep 23 2012 → Sep 26 2012

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	7490 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	19th European MPI Users' Group Meeting on Recent Advances in the Message Passing Interface, EuroMPI 2012
Country/Territory	Austria
City	Vienna
Period	9/23/12 → 9/26/12

Keywords

Collectives
Dragonfly
PERCS
Topology
Two-tier networks

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Online availability

10.1007/978-3-642-33518-1_12

Library availability

Discover UIUC Full Text

Cite this

Jain, N., Lau, J., & Kale, L. (2012). Collectives on two-tier direct networks. In Recent Advances in the Message Passing Interface - 19th European MPI Users' Group Meeting, EuroMPI 2012, Proceedings (pp. 67-77). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7490 LNCS). https://doi.org/10.1007/978-3-642-33518-1_12

Collectives on two-tier direct networks. / Jain, Nikhil; Lau, Johnmark; Kale, Laxmikant.

Recent Advances in the Message Passing Interface - 19th European MPI Users' Group Meeting, EuroMPI 2012, Proceedings. 2012. p. 67-77 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7490 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Jain, N, Lau, J & Kale, L 2012, Collectives on two-tier direct networks. in Recent Advances in the Message Passing Interface - 19th European MPI Users' Group Meeting, EuroMPI 2012, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7490 LNCS, pp. 67-77, 19th European MPI Users' Group Meeting on Recent Advances in the Message Passing Interface, EuroMPI 2012, Vienna, Austria, 9/23/12. https://doi.org/10.1007/978-3-642-33518-1_12

Jain N, Lau J, Kale L. Collectives on two-tier direct networks. In Recent Advances in the Message Passing Interface - 19th European MPI Users' Group Meeting, EuroMPI 2012, Proceedings. 2012. p. 67-77. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-33518-1_12

@inproceedings{0e2ccff3bc0a46bd81d6544d79623c64,

title = "Collectives on two-tier direct networks",

abstract = "Collectives are an important component of parallel programs, and have a significant impact on performance and scalability of an application. To obtain best performance, platform specific implementations of various parallel programming frameworks, such as MPI and Charm++, are done. As a result, when systems with new network topologies are built, new topology aware algorithms for collectives are added to these frameworks that also contain the topology oblivious algorithms. In this paper, we propose topology aware algorithms for collectives performed on two-tier direct networks such as IBM PERCS and Dragonfly. We observe that, for large message operations, significant performance gains can be made by taking advantage of large number of links in a two-tier direct network. We evaluate proposed algorithms using an analytical model based on link utilization.",

keywords = "Collectives, Dragonfly, PERCS, Topology, Two-tier networks",

author = "Nikhil Jain and Johnmark Lau and Laxmikant Kale",

year = "2012",

month = oct,

day = "24",

doi = "10.1007/978-3-642-33518-1_12",

language = "English (US)",

isbn = "9783642335174",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "67--77",

booktitle = "Recent Advances in the Message Passing Interface - 19th European MPI Users' Group Meeting, EuroMPI 2012, Proceedings",

note = "19th European MPI Users' Group Meeting on Recent Advances in the Message Passing Interface, EuroMPI 2012 ; Conference date: 23-09-2012 Through 26-09-2012",

}

TY - GEN

T1 - Collectives on two-tier direct networks

AU - Jain, Nikhil

AU - Lau, Johnmark

AU - Kale, Laxmikant

PY - 2012/10/24

Y1 - 2012/10/24

N2 - Collectives are an important component of parallel programs, and have a significant impact on performance and scalability of an application. To obtain best performance, platform specific implementations of various parallel programming frameworks, such as MPI and Charm++, are done. As a result, when systems with new network topologies are built, new topology aware algorithms for collectives are added to these frameworks that also contain the topology oblivious algorithms. In this paper, we propose topology aware algorithms for collectives performed on two-tier direct networks such as IBM PERCS and Dragonfly. We observe that, for large message operations, significant performance gains can be made by taking advantage of large number of links in a two-tier direct network. We evaluate proposed algorithms using an analytical model based on link utilization.

AB - Collectives are an important component of parallel programs, and have a significant impact on performance and scalability of an application. To obtain best performance, platform specific implementations of various parallel programming frameworks, such as MPI and Charm++, are done. As a result, when systems with new network topologies are built, new topology aware algorithms for collectives are added to these frameworks that also contain the topology oblivious algorithms. In this paper, we propose topology aware algorithms for collectives performed on two-tier direct networks such as IBM PERCS and Dragonfly. We observe that, for large message operations, significant performance gains can be made by taking advantage of large number of links in a two-tier direct network. We evaluate proposed algorithms using an analytical model based on link utilization.

KW - Collectives

KW - Dragonfly

KW - PERCS

KW - Topology

KW - Two-tier networks

UR - http://www.scopus.com/inward/record.url?scp=84867641591&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84867641591&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-33518-1_12

DO - 10.1007/978-3-642-33518-1_12

M3 - Conference contribution

AN - SCOPUS:84867641591

SN - 9783642335174

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 67

EP - 77

BT - Recent Advances in the Message Passing Interface - 19th European MPI Users' Group Meeting, EuroMPI 2012, Proceedings

T2 - 19th European MPI Users' Group Meeting on Recent Advances in the Message Passing Interface, EuroMPI 2012

Y2 - 23 September 2012 through 26 September 2012

ER -

Collectives on two-tier direct networks

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this