Morphus: Supporting online reconfigurations in Sharded NoSQL systems

Mainak Ghosh, Wenting Wang, Gopalakrishna Holla, Indranil Gupta

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

While sharded NoSQL stores offer high availability, reconfiguration operations present a major pain point in deployments today. For instance, in order to change a configuration setting such as the shard (or primary) key of a database table, the prevalent solutions entail shutting down the database, exporting and re-importing the table, and restarting the database. This goes against the NoSQL philosophy of high availability of data. Our system, called Morph us, provides support towards reconfigurations for NoSQL stores in an online manner. Morphus allows read and write operations to continue concurrently with the data transfer among servers. Morphus works for NoSQL stores that feature master-slave replication, range partitioning, and flexible data placement. This paper presents: i) a systems architecture for online reconfigurations, incorporated into Mongo DB, and ii) optimal algorithms for online reconfigurations. Our evaluation using realistic workloads shows that Morphus completes reconfiguration efficiently, offers high availability, and incurs low overhead for reads and writes.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE International Conference on Autonomic Computing, ICAC 2015
EditorsPhilippe Lalanda, Samuel Kounev, Ada Diaconescu, Lucy Cherkasova
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-10
Number of pages10
ISBN (Electronic)9781467369701
DOIs
StatePublished - Sep 14 2015
Event12th IEEE International Conference on Autonomic Computing, ICAC 2015 - Grenoble, France
Duration: Jul 7 2015Jul 10 2015

Publication series

NameProceedings - IEEE International Conference on Autonomic Computing, ICAC 2015

Other

Other12th IEEE International Conference on Autonomic Computing, ICAC 2015
Country/TerritoryFrance
CityGrenoble
Period7/7/157/10/15

Keywords

  • Nosql
  • Reconfiguration
  • Shard key change

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Software
  • Control and Systems Engineering

Fingerprint

Dive into the research topics of 'Morphus: Supporting online reconfigurations in Sharded NoSQL systems'. Together they form a unique fingerprint.

Cite this