Morphus: Supporting online reconfigurations in Sharded NoSQL systems

Mainak Ghosh, Wenting Wang, Gopalakrishna Holla, Indranil Gupta

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

While sharded NoSQL stores offer high availability, reconfiguration operations present a major pain point in deployments today. For instance, in order to change a configuration setting such as the shard (or primary) key of a database table, the prevalent solutions entail shutting down the database, exporting and re-importing the table, and restarting the database. This goes against the NoSQL philosophy of high availability of data. Our system, called Morph us, provides support towards reconfigurations for NoSQL stores in an online manner. Morphus allows read and write operations to continue concurrently with the data transfer among servers. Morphus works for NoSQL stores that feature master-slave replication, range partitioning, and flexible data placement. This paper presents: i) a systems architecture for online reconfigurations, incorporated into Mongo DB, and ii) optimal algorithms for online reconfigurations. Our evaluation using realistic workloads shows that Morphus completes reconfiguration efficiently, offers high availability, and incurs low overhead for reads and writes.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE International Conference on Autonomic Computing, ICAC 2015
EditorsPhilippe Lalanda, Samuel Kounev, Ada Diaconescu, Lucy Cherkasova
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-10
Number of pages10
ISBN (Electronic)9781467369701
DOIs
StatePublished - Sep 14 2015
Event12th IEEE International Conference on Autonomic Computing, ICAC 2015 - Grenoble, France
Duration: Jul 7 2015Jul 10 2015

Publication series

NameProceedings - IEEE International Conference on Autonomic Computing, ICAC 2015

Other

Other12th IEEE International Conference on Autonomic Computing, ICAC 2015
CountryFrance
CityGrenoble
Period7/7/157/10/15

Fingerprint

Availability
Data transfer
Servers

Keywords

  • Nosql
  • Reconfiguration
  • Shard key change

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Software
  • Control and Systems Engineering

Cite this

Ghosh, M., Wang, W., Holla, G., & Gupta, I. (2015). Morphus: Supporting online reconfigurations in Sharded NoSQL systems. In P. Lalanda, S. Kounev, A. Diaconescu, & L. Cherkasova (Eds.), Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015 (pp. 1-10). [7266929] (Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICAC.2015.42

Morphus : Supporting online reconfigurations in Sharded NoSQL systems. / Ghosh, Mainak; Wang, Wenting; Holla, Gopalakrishna; Gupta, Indranil.

Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015. ed. / Philippe Lalanda; Samuel Kounev; Ada Diaconescu; Lucy Cherkasova. Institute of Electrical and Electronics Engineers Inc., 2015. p. 1-10 7266929 (Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ghosh, M, Wang, W, Holla, G & Gupta, I 2015, Morphus: Supporting online reconfigurations in Sharded NoSQL systems. in P Lalanda, S Kounev, A Diaconescu & L Cherkasova (eds), Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015., 7266929, Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015, Institute of Electrical and Electronics Engineers Inc., pp. 1-10, 12th IEEE International Conference on Autonomic Computing, ICAC 2015, Grenoble, France, 7/7/15. https://doi.org/10.1109/ICAC.2015.42
Ghosh M, Wang W, Holla G, Gupta I. Morphus: Supporting online reconfigurations in Sharded NoSQL systems. In Lalanda P, Kounev S, Diaconescu A, Cherkasova L, editors, Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 1-10. 7266929. (Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015). https://doi.org/10.1109/ICAC.2015.42
Ghosh, Mainak ; Wang, Wenting ; Holla, Gopalakrishna ; Gupta, Indranil. / Morphus : Supporting online reconfigurations in Sharded NoSQL systems. Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015. editor / Philippe Lalanda ; Samuel Kounev ; Ada Diaconescu ; Lucy Cherkasova. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 1-10 (Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015).
@inproceedings{d312b15ddb224fc58699f61c73fcf8d8,
title = "Morphus: Supporting online reconfigurations in Sharded NoSQL systems",
abstract = "While sharded NoSQL stores offer high availability, reconfiguration operations present a major pain point in deployments today. For instance, in order to change a configuration setting such as the shard (or primary) key of a database table, the prevalent solutions entail shutting down the database, exporting and re-importing the table, and restarting the database. This goes against the NoSQL philosophy of high availability of data. Our system, called Morph us, provides support towards reconfigurations for NoSQL stores in an online manner. Morphus allows read and write operations to continue concurrently with the data transfer among servers. Morphus works for NoSQL stores that feature master-slave replication, range partitioning, and flexible data placement. This paper presents: i) a systems architecture for online reconfigurations, incorporated into Mongo DB, and ii) optimal algorithms for online reconfigurations. Our evaluation using realistic workloads shows that Morphus completes reconfiguration efficiently, offers high availability, and incurs low overhead for reads and writes.",
keywords = "Nosql, Reconfiguration, Shard key change",
author = "Mainak Ghosh and Wenting Wang and Gopalakrishna Holla and Indranil Gupta",
year = "2015",
month = "9",
day = "14",
doi = "10.1109/ICAC.2015.42",
language = "English (US)",
series = "Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "1--10",
editor = "Philippe Lalanda and Samuel Kounev and Ada Diaconescu and Lucy Cherkasova",
booktitle = "Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015",
address = "United States",

}

TY - GEN

T1 - Morphus

T2 - Supporting online reconfigurations in Sharded NoSQL systems

AU - Ghosh, Mainak

AU - Wang, Wenting

AU - Holla, Gopalakrishna

AU - Gupta, Indranil

PY - 2015/9/14

Y1 - 2015/9/14

N2 - While sharded NoSQL stores offer high availability, reconfiguration operations present a major pain point in deployments today. For instance, in order to change a configuration setting such as the shard (or primary) key of a database table, the prevalent solutions entail shutting down the database, exporting and re-importing the table, and restarting the database. This goes against the NoSQL philosophy of high availability of data. Our system, called Morph us, provides support towards reconfigurations for NoSQL stores in an online manner. Morphus allows read and write operations to continue concurrently with the data transfer among servers. Morphus works for NoSQL stores that feature master-slave replication, range partitioning, and flexible data placement. This paper presents: i) a systems architecture for online reconfigurations, incorporated into Mongo DB, and ii) optimal algorithms for online reconfigurations. Our evaluation using realistic workloads shows that Morphus completes reconfiguration efficiently, offers high availability, and incurs low overhead for reads and writes.

AB - While sharded NoSQL stores offer high availability, reconfiguration operations present a major pain point in deployments today. For instance, in order to change a configuration setting such as the shard (or primary) key of a database table, the prevalent solutions entail shutting down the database, exporting and re-importing the table, and restarting the database. This goes against the NoSQL philosophy of high availability of data. Our system, called Morph us, provides support towards reconfigurations for NoSQL stores in an online manner. Morphus allows read and write operations to continue concurrently with the data transfer among servers. Morphus works for NoSQL stores that feature master-slave replication, range partitioning, and flexible data placement. This paper presents: i) a systems architecture for online reconfigurations, incorporated into Mongo DB, and ii) optimal algorithms for online reconfigurations. Our evaluation using realistic workloads shows that Morphus completes reconfiguration efficiently, offers high availability, and incurs low overhead for reads and writes.

KW - Nosql

KW - Reconfiguration

KW - Shard key change

UR - http://www.scopus.com/inward/record.url?scp=84961848460&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84961848460&partnerID=8YFLogxK

U2 - 10.1109/ICAC.2015.42

DO - 10.1109/ICAC.2015.42

M3 - Conference contribution

AN - SCOPUS:84961848460

T3 - Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015

SP - 1

EP - 10

BT - Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015

A2 - Lalanda, Philippe

A2 - Kounev, Samuel

A2 - Diaconescu, Ada

A2 - Cherkasova, Lucy

PB - Institute of Electrical and Electronics Engineers Inc.

ER -