Latency-aware data partitioning for geo-replicated Online Social Networks

Lei Jiao, Tianyin Xu, Jun Li, Xiaoming Fu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Large-Scale Online Social Networks (OSNs) usually employ data replication across multiple datacenters in multiple geo-locations to ensure high availability and performance [1]. The de facto method for data replication in current OSNs (e.g., Facebook) is full replication which enables each geo-distributed datacenter to maintain one copy of all the data. The full replication method can simply achieve good performance but poses high overhead for maintenance (e.g., replica storage and synchronization). Firstly, full replication leads to linear storage growth with the increasing of datacenter deployment, which is of poor scalability. Secondly, the data replicas across all the locations requires synchronization, resulting in large inter-datacenter WAN traffic which is very expensive. The ideal solution is to partition user data across multiple datacenters, making each geo-distributed datacenter to maintain one partition of the whole data set. Unfortunately, partitioning OSN data by tradition graph algorithms is known to be very difficult due to the high interconnection and inter-dependency within the OSN data [2]. Besides, geo-partitioning goes beyond the traditional graph partitioning problems because the user-perceived latency is a critical Quality-of-Service (QoS) issue to be considered.

Original languageEnglish (US)
Title of host publicationProceedings of the Workshop on Posters and Demos Track, PDT'11 - 12th International Middleware Conference, Middleware'11
DOIs
StatePublished - 2011
Externally publishedYes
EventWorkshop on Posters and Demos Track, PDT'11 - 12th International Middleware Conference, Middleware'11 - Lisbon, Portugal
Duration: Dec 12 2011Dec 12 2011

Publication series

NameProceedings of the Workshop on Posters and Demos Track, PDT'11 - 12th International Middleware Conference, Middleware'11

Other

OtherWorkshop on Posters and Demos Track, PDT'11 - 12th International Middleware Conference, Middleware'11
Country/TerritoryPortugal
CityLisbon
Period12/12/1112/12/11

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Latency-aware data partitioning for geo-replicated Online Social Networks'. Together they form a unique fingerprint.

Cite this