Software-defined consistency group abstractions for virtual machines

Muntasir Raihan Rahman, Sudarsan Piduri, Ilya Languev, Rean Griffith, Indranil Gupta

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we propose a practical scalable software-level mechanism for taking crash-consistent snapshots of a group of virtual machines. The group is dynamically defined at the software virtualization layer allowing us to move the consistency group abstraction from the hardware array layer into the hypervisor with very low overhead (∼ 50 msecs VM freeze time). This low overhead allows us to take crash-consistent snapshots of large software-defined consistency groups at a reasonable frequency, guaranteeing low data loss for disaster recovery. To demonstrate practicality, we use our mechanism to take crash-consistent snapshots of multi-disk virtual machines running two database applications: PostgreSQL, and Apache Cassandra. Deployment experiments confirm that our mechanism scales well with number of VMs, and snapshot times remain invariant of virtual disk size and usage.

Original languageEnglish (US)
Title of host publicationProceedings of the 4th Workshop on Distributed Cloud Computing, DCC 2016
PublisherAssociation for Computing Machinery
ISBN (Print)9781450342209
DOIs
StatePublished - Jul 25 2016
Event4th Annual ACM PODC Workshop on Distributed Cloud Computing, DCC 2016 - Chicago, United States
Duration: Jul 25 2016Jul 28 2016

Publication series

NameProceedings of the Annual ACM Symposium on Principles of Distributed Computing

Other

Other4th Annual ACM PODC Workshop on Distributed Cloud Computing, DCC 2016
CountryUnited States
CityChicago
Period7/25/167/28/16

Fingerprint

Disasters
Hardware
Recovery
Experiments
Virtual machine
Virtualization

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

Rahman, M. R., Piduri, S., Languev, I., Griffith, R., & Gupta, I. (2016). Software-defined consistency group abstractions for virtual machines. In Proceedings of the 4th Workshop on Distributed Cloud Computing, DCC 2016 [a3] (Proceedings of the Annual ACM Symposium on Principles of Distributed Computing). Association for Computing Machinery. https://doi.org/10.1145/2955193.2955198

Software-defined consistency group abstractions for virtual machines. / Rahman, Muntasir Raihan; Piduri, Sudarsan; Languev, Ilya; Griffith, Rean; Gupta, Indranil.

Proceedings of the 4th Workshop on Distributed Cloud Computing, DCC 2016. Association for Computing Machinery, 2016. a3 (Proceedings of the Annual ACM Symposium on Principles of Distributed Computing).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Rahman, MR, Piduri, S, Languev, I, Griffith, R & Gupta, I 2016, Software-defined consistency group abstractions for virtual machines. in Proceedings of the 4th Workshop on Distributed Cloud Computing, DCC 2016., a3, Proceedings of the Annual ACM Symposium on Principles of Distributed Computing, Association for Computing Machinery, 4th Annual ACM PODC Workshop on Distributed Cloud Computing, DCC 2016, Chicago, United States, 7/25/16. https://doi.org/10.1145/2955193.2955198
Rahman MR, Piduri S, Languev I, Griffith R, Gupta I. Software-defined consistency group abstractions for virtual machines. In Proceedings of the 4th Workshop on Distributed Cloud Computing, DCC 2016. Association for Computing Machinery. 2016. a3. (Proceedings of the Annual ACM Symposium on Principles of Distributed Computing). https://doi.org/10.1145/2955193.2955198
Rahman, Muntasir Raihan ; Piduri, Sudarsan ; Languev, Ilya ; Griffith, Rean ; Gupta, Indranil. / Software-defined consistency group abstractions for virtual machines. Proceedings of the 4th Workshop on Distributed Cloud Computing, DCC 2016. Association for Computing Machinery, 2016. (Proceedings of the Annual ACM Symposium on Principles of Distributed Computing).
@inproceedings{2c5b3776bdf44b93a36b7e6d2d35e695,
title = "Software-defined consistency group abstractions for virtual machines",
abstract = "In this paper we propose a practical scalable software-level mechanism for taking crash-consistent snapshots of a group of virtual machines. The group is dynamically defined at the software virtualization layer allowing us to move the consistency group abstraction from the hardware array layer into the hypervisor with very low overhead (∼ 50 msecs VM freeze time). This low overhead allows us to take crash-consistent snapshots of large software-defined consistency groups at a reasonable frequency, guaranteeing low data loss for disaster recovery. To demonstrate practicality, we use our mechanism to take crash-consistent snapshots of multi-disk virtual machines running two database applications: PostgreSQL, and Apache Cassandra. Deployment experiments confirm that our mechanism scales well with number of VMs, and snapshot times remain invariant of virtual disk size and usage.",
author = "Rahman, {Muntasir Raihan} and Sudarsan Piduri and Ilya Languev and Rean Griffith and Indranil Gupta",
year = "2016",
month = "7",
day = "25",
doi = "10.1145/2955193.2955198",
language = "English (US)",
isbn = "9781450342209",
series = "Proceedings of the Annual ACM Symposium on Principles of Distributed Computing",
publisher = "Association for Computing Machinery",
booktitle = "Proceedings of the 4th Workshop on Distributed Cloud Computing, DCC 2016",

}

TY - GEN

T1 - Software-defined consistency group abstractions for virtual machines

AU - Rahman, Muntasir Raihan

AU - Piduri, Sudarsan

AU - Languev, Ilya

AU - Griffith, Rean

AU - Gupta, Indranil

PY - 2016/7/25

Y1 - 2016/7/25

N2 - In this paper we propose a practical scalable software-level mechanism for taking crash-consistent snapshots of a group of virtual machines. The group is dynamically defined at the software virtualization layer allowing us to move the consistency group abstraction from the hardware array layer into the hypervisor with very low overhead (∼ 50 msecs VM freeze time). This low overhead allows us to take crash-consistent snapshots of large software-defined consistency groups at a reasonable frequency, guaranteeing low data loss for disaster recovery. To demonstrate practicality, we use our mechanism to take crash-consistent snapshots of multi-disk virtual machines running two database applications: PostgreSQL, and Apache Cassandra. Deployment experiments confirm that our mechanism scales well with number of VMs, and snapshot times remain invariant of virtual disk size and usage.

AB - In this paper we propose a practical scalable software-level mechanism for taking crash-consistent snapshots of a group of virtual machines. The group is dynamically defined at the software virtualization layer allowing us to move the consistency group abstraction from the hardware array layer into the hypervisor with very low overhead (∼ 50 msecs VM freeze time). This low overhead allows us to take crash-consistent snapshots of large software-defined consistency groups at a reasonable frequency, guaranteeing low data loss for disaster recovery. To demonstrate practicality, we use our mechanism to take crash-consistent snapshots of multi-disk virtual machines running two database applications: PostgreSQL, and Apache Cassandra. Deployment experiments confirm that our mechanism scales well with number of VMs, and snapshot times remain invariant of virtual disk size and usage.

UR - http://www.scopus.com/inward/record.url?scp=85054823650&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054823650&partnerID=8YFLogxK

U2 - 10.1145/2955193.2955198

DO - 10.1145/2955193.2955198

M3 - Conference contribution

AN - SCOPUS:85054823650

SN - 9781450342209

T3 - Proceedings of the Annual ACM Symposium on Principles of Distributed Computing

BT - Proceedings of the 4th Workshop on Distributed Cloud Computing, DCC 2016

PB - Association for Computing Machinery

ER -