High throughput data center topology design

Ankit Singla, P. Brighten Godfrey, Alexandra Kolla

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

With high throughput networks acquiring a crucial role in supporting data-intensive applications, a variety of data center network topologies have been proposed to achieve high capacity at low cost. While this work explores a large number of design points, even in the limited case of a network of identical switches, no proposal has been able to claim any notion of optimality. The case of heterogeneous networks, incorporating multiple line-speeds and port-counts as data centers grow over time, introduces even greater complexity. In this paper, we present the first non-trivial upper-bound on network throughput under uniform traffic patterns for any topology with identical switches. We then show that random graphs achieve throughput surprisingly close to this bound, within a few percent at the scale of a few thousand servers. Apart from demonstrating that homogeneous topology design may be reaching its limits, this result also motivates our use of random graphs as building blocks for design of heterogeneous networks. Given a heterogeneous pool of network switches, we explore through experiments and analysis, how the distribution of servers across switches and the interconnection of switches affect network throughput. We apply these insights to a real-world heterogeneous data center topology, VL2, demonstrating as much as 43% higher throughput with the same equipment.

Original languageEnglish (US)
Title of host publicationProceedings of the 11th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2014
PublisherUSENIX Association
Pages29-41
Number of pages13
ISBN (Electronic)9781931971096
StatePublished - Jan 1 2014
Event11th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2014 - Seattle, United States
Duration: Apr 2 2014Apr 4 2014

Publication series

NameProceedings of the 11th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2014

Conference

Conference11th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2014
CountryUnited States
CitySeattle
Period4/2/144/4/14

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'High throughput data center topology design'. Together they form a unique fingerprint.

Cite this