Leveraging Metadata in No SQL Storage Systems

Ala Alkhaldi, Indranil Gupta, Vaijayanth Raghavan, Mainak Ghosh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

NoSQL systems have grown in popularity for storing big data because these systems offer high availability, i.e., Operations with high throughput and low latency. However, metadata in these systems are handled today in ad-hoc ways. We present Wasef, a system that treats metadata in a NoSQL database system, as first-class citizens. Metadata may include information such as: operational history for a database table (e.g., Columns), placement information for ranges of keys, and operational logs for data items (key-value pairs). Wasef allows the NoSQL system to store and query this metadata efficiently. We integrate Wasef into Apache Cassandra, one of the most popular key-value stores. We then implement three important use cases in Cassandra: dropping columns in a flexible manner, verifying data durability during migrational operations such as node decommissioning, and maintaining data provenance. Our experimental evaluation uses AWS EC2 instances and YCSB workloads. Our results show that Wasef: i) scales well with the size of the data and the metadata, ii) minimally affects throughput and operation latencies.

Original languageEnglish (US)
Title of host publicationProceedings - 2015 IEEE 8th International Conference on Cloud Computing, CLOUD 2015
EditorsCalton Pu, Ajay Mohindra
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages57-64
Number of pages8
ISBN (Electronic)9781467372879
DOIs
StatePublished - Aug 19 2015
Event8th IEEE International Conference on Cloud Computing, CLOUD 2015 - New York, United States
Duration: Jun 27 2015Jul 2 2015

Publication series

NameProceedings - 2015 IEEE 8th International Conference on Cloud Computing, CLOUD 2015

Other

Other8th IEEE International Conference on Cloud Computing, CLOUD 2015
CountryUnited States
CityNew York
Period6/27/157/2/15

Keywords

  • Metadata
  • Nosql
  • Provenance

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Leveraging Metadata in No SQL Storage Systems'. Together they form a unique fingerprint.

Cite this