Towards Web-based Delta Synchronization for Cloud Storage Services

He Xiao, Zhenhua Li, Ennan Zhai, Tianyin Xu, Yang Li, Yunhao Liu, Quanlu Zhang, Yao Liu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Delta synchronization (sync) is crucial for network-level efficiency of cloud storage services. Practical delta sync techniques are, however, only available for PC clients and mobile apps, but not web browsers—the most pervasive and OS-independent access method. To understand the obstacles of web-based delta sync, we implement a delta sync solution, WebRsync, using state-of-the-art web techniques based on rsync, the de facto delta sync protocol for PC clients. Our measurements show that WebRsync severely suffers from the inefficiency of JavaScript execution inside web browsers, thus leading to frequent stagnation and even hanging. Given that the computation burden on the web browser mainly stems from data chunk search and comparison, we reverse the traditional delta sync approach by lifting all chunk search and comparison operations from the client side to the server side. Inevitably, this brings considerable computation overhead to the servers. Hence, we further leverage locality-aware chunk matching and lightweight checksum algorithms to reduce the overhead. The resulting solution, WebR2sync+, outpaces WebRsync by an order of magnitude, and is able to simultaneously support 6800–8500 web clients’ delta sync using a standard VM server instance based on a Dropbox-like system architecture.

Original languageEnglish (US)
Title of host publicationProceedings of the 16th USENIX Conference on File and Storage Technologies, FAST 2018
PublisherUSENIX Association
Pages155-168
Number of pages14
ISBN (Electronic)9781931971423
StatePublished - Jan 1 2018
Event16th USENIX Conference on File and Storage Technologies, FAST 2018 - Oakland, United States
Duration: Feb 12 2018Feb 15 2018

Publication series

NameProceedings of the 16th USENIX Conference on File and Storage Technologies, FAST 2018

Conference

Conference16th USENIX Conference on File and Storage Technologies, FAST 2018
CountryUnited States
CityOakland
Period2/12/182/15/18

ASJC Scopus subject areas

  • Hardware and Architecture
  • Software
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Towards Web-based Delta Synchronization for Cloud Storage Services'. Together they form a unique fingerprint.

  • Cite this

    Xiao, H., Li, Z., Zhai, E., Xu, T., Li, Y., Liu, Y., Zhang, Q., & Liu, Y. (2018). Towards Web-based Delta Synchronization for Cloud Storage Services. In Proceedings of the 16th USENIX Conference on File and Storage Technologies, FAST 2018 (pp. 155-168). (Proceedings of the 16th USENIX Conference on File and Storage Technologies, FAST 2018). USENIX Association.