Scaling all-to-all multicast on fat-tree networks

Sameer Kumar, Laxmikant V. Kalé

Research output: Contribution to conferencePaper

Abstract

In this paper, we study the all-to-all multicast operation. Strategies for all-to-all multicast need to be different for small and large messages. For small messages, the major issue is the minimization of software overhead, where as for large messages, the issue is network contention. Many modern large parallel computers use the fat-tree interconnection topology. We therefore analyze network contention on fat-tree networks and develop strategies to optimize collective multicast using known contention free communication schedules on fat-tree networks in the design of two novel strategies. We evaluate performance of these strategies with up to 256 nodes (1024 processors) on an alpha cluster. We present schemes that perform well when a contiguous chunk of nodes is not available. For large messages, many of our strategies have two times better through-put than native MPI. We also demonstrate that the software overhead of a collective operation is a small fraction of the total completion time in the presence of the communication co-processor. We therefore compare the performance of the studied strategies using both metrics (i) Completion time, and (ii) Computation overhead.

Original languageEnglish (US)
Pages205-214
Number of pages10
DOIs
StatePublished - Sep 29 2004
EventProceedings - Tenth International Conference on Parallel and Distributed Systems (ICPADS 2004) - Newport Beach, CA, United States
Duration: Jul 7 2004Jul 9 2004

Other

OtherProceedings - Tenth International Conference on Parallel and Distributed Systems (ICPADS 2004)
CountryUnited States
CityNewport Beach, CA
Period7/7/047/9/04

    Fingerprint

ASJC Scopus subject areas

  • Hardware and Architecture

Cite this

Kumar, S., & Kalé, L. V. (2004). Scaling all-to-all multicast on fat-tree networks. 205-214. Paper presented at Proceedings - Tenth International Conference on Parallel and Distributed Systems (ICPADS 2004), Newport Beach, CA, United States. https://doi.org/10.1109/ICPADS.2004.1316097