Bobtail: Avoiding long tails in the cloud

Yunjing Xu, Zachary Musgrave, Brian Noble, Michael Bailey

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Highly modular data center applications such as Bing, Facebook, and Amazon's retail platform are known to be susceptible to long tails in response times. Services such as Amazon's EC2 have proven attractive platforms for building similar applications. Unfortunately, virtualization used in such platforms exacerbates the long tail problem by factors of two to four. Surprisingly, we find that poor response times in EC2 are a property of nodes rather than the network, and that this property of nodes is both pervasive throughout EC2 and persistent over time. The root cause of this problem is co-scheduling of CPU-bound and latency-sensitive tasks. We leverage these observations in Bobtail, a system that proactively detects and avoids these bad neighboring VMs without significantly penalizing node instantiation. With Bobtail, common communication patterns benefit from reductions of up to 40% in 99.9th percentile response times.

Original languageEnglish (US)
Title of host publicationProceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2013
PublisherUSENIX Association
Pages329-341
Number of pages13
ISBN (Electronic)9781931971003
StatePublished - 2013
Externally publishedYes
Event10th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2013 - Lombard, United States
Duration: Apr 2 2013Apr 5 2013

Publication series

NameProceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2013

Conference

Conference10th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2013
CountryUnited States
CityLombard
Period4/2/134/5/13

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Bobtail: Avoiding long tails in the cloud'. Together they form a unique fingerprint.

Cite this