Synchronization and Deduplication in Coded Distributed Storage Networks

Salim El Rouayheb; Sreechakra Goparaju; Han Mao Kiah; Olgica Milenkovic

doi:10.1109/TNET.2015.2502274

Synchronization and Deduplication in Coded Distributed Storage Networks

Salim El Rouayheb, Sreechakra Goparaju, Han Mao Kiah, Olgica Milenkovic

Research output: Contribution to journal › Article › peer-review

Abstract

We consider the problem of synchronizing coded data in distributed storage networks undergoing insertion and deletion edits. We present modifications of distributed storage codes that allow updates in the parity-check values to be performed with one round of communication at low bit rates and with small storage overhead. Our main contributions are novel protocols for synchronizing frequently updated and semi-static data based on functional intermediary coding involving permutation and Vandermonde matrices.

Original language	English (US)
Pages (from-to)	3056-3069
Number of pages	14
Journal	IEEE/ACM Transactions on Networking
Volume	24
Issue number	5
DOIs	https://doi.org/10.1109/TNET.2015.2502274
State	Published - Oct 2016

Keywords

Deduplication
deletions
distributed storage codes
file synchronization
insertions

ASJC Scopus subject areas

Software
Computer Science Applications
Computer Networks and Communications
Electrical and Electronic Engineering

Online availability

10.1109/TNET.2015.2502274

Library availability

Discover UIUC Full Text

Cite this

@article{43908e3ab3d24485b029012ca5a2f9f7,

title = "Synchronization and Deduplication in Coded Distributed Storage Networks",

abstract = "We consider the problem of synchronizing coded data in distributed storage networks undergoing insertion and deletion edits. We present modifications of distributed storage codes that allow updates in the parity-check values to be performed with one round of communication at low bit rates and with small storage overhead. Our main contributions are novel protocols for synchronizing frequently updated and semi-static data based on functional intermediary coding involving permutation and Vandermonde matrices.",

keywords = "Deduplication, deletions, distributed storage codes, file synchronization, insertions",

author = "{El Rouayheb}, Salim and Sreechakra Goparaju and Kiah, {Han Mao} and Olgica Milenkovic",

note = "Publisher Copyright: {\textcopyright} 2015 IEEE.",

year = "2016",

month = oct,

doi = "10.1109/TNET.2015.2502274",

language = "English (US)",

volume = "24",

pages = "3056--3069",

journal = "IEEE/ACM Transactions on Networking",

issn = "1063-6692",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "5",

}

TY - JOUR

T1 - Synchronization and Deduplication in Coded Distributed Storage Networks

AU - El Rouayheb, Salim

AU - Goparaju, Sreechakra

AU - Kiah, Han Mao

AU - Milenkovic, Olgica

PY - 2016/10

Y1 - 2016/10

N2 - We consider the problem of synchronizing coded data in distributed storage networks undergoing insertion and deletion edits. We present modifications of distributed storage codes that allow updates in the parity-check values to be performed with one round of communication at low bit rates and with small storage overhead. Our main contributions are novel protocols for synchronizing frequently updated and semi-static data based on functional intermediary coding involving permutation and Vandermonde matrices.

AB - We consider the problem of synchronizing coded data in distributed storage networks undergoing insertion and deletion edits. We present modifications of distributed storage codes that allow updates in the parity-check values to be performed with one round of communication at low bit rates and with small storage overhead. Our main contributions are novel protocols for synchronizing frequently updated and semi-static data based on functional intermediary coding involving permutation and Vandermonde matrices.

KW - Deduplication

KW - deletions

KW - distributed storage codes

KW - file synchronization

KW - insertions

UR - http://www.scopus.com/inward/record.url?scp=85027063111&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85027063111&partnerID=8YFLogxK

U2 - 10.1109/TNET.2015.2502274

DO - 10.1109/TNET.2015.2502274

M3 - Article

AN - SCOPUS:85027063111

SN - 1063-6692

VL - 24

SP - 3056

EP - 3069

JO - IEEE/ACM Transactions on Networking

JF - IEEE/ACM Transactions on Networking

IS - 5

ER -

Synchronization and Deduplication in Coded Distributed Storage Networks

Abstract

Keywords

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this