Finishing flows quickly with preemptive scheduling

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Today's data centers face extreme challenges in providing low latency. However, fair sharing, a principle commonly adopted in current congestion control protocols, is far from optimal for satisfying latency requirements. We propose Preemptive Distributed Quick (PDQ) flow scheduling, a protocol designed to complete flows quickly and meet flow deadlines. PDQ enables flow preemption to approximate a range of scheduling disciplines. For example, PDQ can emulate a shortest job first, algorithm to give priority to the short flows by pausing the contending flows. PDQ borrows ideas from centralized scheduling disciplines and implements them in a fully distributed manner, making it scalable to today's data centers. Further, we develop a multipath version of PDQ to exploit path diversity. Through extensive packet-level and flow-level simulation, we demonstrate that PDQ significantly outperforms TCP, ItCP and D3 in data center environments. VVe further show that PDQ is stable, resilient to packet loss, and preserves nearly all its performance gains even given inaccurate flow information.

Original languageEnglish (US)
Title of host publicationProceedings of the ACM SIGCOMM 2012 and Best Papers of the Co-located Workshops
Pages127-138
Number of pages12
Edition4
DOIs
StatePublished - 2012
EventAnnual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, ACM SIGCOMM 2012 - Helsinki, Finland
Duration: Aug 13 2012Aug 17 2012

Publication series

NameComputer Communication Review
Number4
Volume42
ISSN (Print)0146-4833
ISSN (Electronic)1943-5819

Other

OtherAnnual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, ACM SIGCOMM 2012
Country/TerritoryFinland
CityHelsinki
Period8/13/128/17/12

Keywords

  • Data center
  • Deadline
  • Flow scheduling

ASJC Scopus subject areas

  • Software
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Finishing flows quickly with preemptive scheduling'. Together they form a unique fingerprint.

Cite this