Scaling microblogging services with divergent traffic demands

Tianyin Xu, Yang Chen, Lei Jiao, Ben Y. Zhao, Pan Hui, Xiaoming Fu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Today's microblogging services such as Twitter have long outgrown their initial designs as SMS-based social networks. Instead, a massive and steadily-growing user population of more than 100 million is using Twitter for everything from capturing the mood of the country to detecting earthquakes and Internet service failures. It is unsurprising that the traditional centralized client-server architecture has not scaled with user demands, leading to server overload and significant impairment of availability. In this paper, we argue that the divergence in usage models of microblogging services can be best addressed using complementary mechanisms, one that provides reliable messages between friends, and another that delivers events from popular celebrities and media outlets to their thousands or even millions of followers. We present Cuckoo, a new microblogging system that offloads processing and bandwidth costs away from a small centralized server base while ensuring reliable message delivery. We use a 20-day Twitter availability measurement to guide our design, and trace-driven emulation of 30,000 Twitter users to evaluate our Cuckoo prototype. Compared to the centralized approach, Cuckoo achieves 30-50% server bandwidth savings and 50-60% CPU load reduction, while guaranteeing reliable message delivery.

Original languageEnglish (US)
Title of host publicationMiddleware 2011 - ACM/IFIP/USENIX 12th International Middleware Conference, Proceedings
Pages20-40
Number of pages21
DOIs
StatePublished - 2011
Externally publishedYes
Event12th ACM/IFIP/USENIX International Middleware Conference, Middleware 2011 - Lisbon, Portugal
Duration: Dec 12 2011Dec 16 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7049 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other12th ACM/IFIP/USENIX International Middleware Conference, Middleware 2011
CountryPortugal
CityLisbon
Period12/12/1112/16/11

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Scaling microblogging services with divergent traffic demands'. Together they form a unique fingerprint.

  • Cite this

    Xu, T., Chen, Y., Jiao, L., Zhao, B. Y., Hui, P., & Fu, X. (2011). Scaling microblogging services with divergent traffic demands. In Middleware 2011 - ACM/IFIP/USENIX 12th International Middleware Conference, Proceedings (pp. 20-40). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7049 LNCS). https://doi.org/10.1007/978-3-642-25821-3_2