NVRAM-aware logging in transaction systems

Jian Huang, Karsten Schwan, Moinuddin K. Qureshi

Research output: Contribution to journalConference article

Abstract

Emerging byte-addressable, non-volatile memory technolo- gies (NVRAM) like phase-change memory can increase the capacity of future memory systems by orders of magnitude. Compared to systems that rely on disk storage, NVRAM- based systems promise significant improvements in perfor- mance for key applications like online transaction process- ing (OLTP). Unfortunately, NVRAM systems suffer from two drawbacks: their asymmetric read-write performance and the notable higher cost of the new memory technologies compared to disk. This paper investigates the cost-effective use of NVRAM in transaction systems. It shows that us- ing NVRAM only for the logging subsystem (NV-Logging) provides much higher transactions per dollar than simply replacing all disk storage with NVRAM. Specifically, for NV-Logging, we show that the software overheads associated with centralized log buffers cause performance bottlenecks and limit scaling. The per-transaction logging methods de- scribed in the paper help avoid these overheads, enabling concurrent logging for multiple transactions. Experimental results with a faithful emulation of future NVRAM-based servers using the TPCC, TATP, and TPCB benchmarks show that NV-Logging improves throughput by 1.42 - 2.72x over the costlier option of replacing all disk storage with NVRAM. Results also show that NV-Logging performs 1.21 - 6.71x better than when logs are placed into the PMFS NVRAM-optimized file system. Compared to state-of-the- art distributed logging, NV-Logging delivers 20.4% through- put improvements.

Original languageEnglish (US)
Pages (from-to)389-400
Number of pages12
JournalProceedings of the VLDB Endowment
Volume8
Issue number4
DOIs
StatePublished - Dec 2014
Externally publishedYes
Event3rd Workshop on Spatio-Temporal Database Management, STDBM 2006, Co-located with the 32nd International Conference on Very Large Data Bases, VLDB 2006 - Seoul, Korea, Republic of
Duration: Sep 11 2006Sep 11 2006

Fingerprint

Data storage equipment
Phase change memory
Costs
Servers
Throughput
Processing

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Computer Science(all)

Cite this

NVRAM-aware logging in transaction systems. / Huang, Jian; Schwan, Karsten; Qureshi, Moinuddin K.

In: Proceedings of the VLDB Endowment, Vol. 8, No. 4, 12.2014, p. 389-400.

Research output: Contribution to journalConference article

Huang, Jian ; Schwan, Karsten ; Qureshi, Moinuddin K. / NVRAM-aware logging in transaction systems. In: Proceedings of the VLDB Endowment. 2014 ; Vol. 8, No. 4. pp. 389-400.
@article{dea261ccbe9b4046a34f52c1a7e38da1,
title = "NVRAM-aware logging in transaction systems",
abstract = "Emerging byte-addressable, non-volatile memory technolo- gies (NVRAM) like phase-change memory can increase the capacity of future memory systems by orders of magnitude. Compared to systems that rely on disk storage, NVRAM- based systems promise significant improvements in perfor- mance for key applications like online transaction process- ing (OLTP). Unfortunately, NVRAM systems suffer from two drawbacks: their asymmetric read-write performance and the notable higher cost of the new memory technologies compared to disk. This paper investigates the cost-effective use of NVRAM in transaction systems. It shows that us- ing NVRAM only for the logging subsystem (NV-Logging) provides much higher transactions per dollar than simply replacing all disk storage with NVRAM. Specifically, for NV-Logging, we show that the software overheads associated with centralized log buffers cause performance bottlenecks and limit scaling. The per-transaction logging methods de- scribed in the paper help avoid these overheads, enabling concurrent logging for multiple transactions. Experimental results with a faithful emulation of future NVRAM-based servers using the TPCC, TATP, and TPCB benchmarks show that NV-Logging improves throughput by 1.42 - 2.72x over the costlier option of replacing all disk storage with NVRAM. Results also show that NV-Logging performs 1.21 - 6.71x better than when logs are placed into the PMFS NVRAM-optimized file system. Compared to state-of-the- art distributed logging, NV-Logging delivers 20.4{\%} through- put improvements.",
author = "Jian Huang and Karsten Schwan and Qureshi, {Moinuddin K.}",
year = "2014",
month = "12",
doi = "10.14778/2735496.2735502",
language = "English (US)",
volume = "8",
pages = "389--400",
journal = "Proceedings of the VLDB Endowment",
issn = "2150-8097",
publisher = "Very Large Data Base Endowment Inc.",
number = "4",

}

TY - JOUR

T1 - NVRAM-aware logging in transaction systems

AU - Huang, Jian

AU - Schwan, Karsten

AU - Qureshi, Moinuddin K.

PY - 2014/12

Y1 - 2014/12

N2 - Emerging byte-addressable, non-volatile memory technolo- gies (NVRAM) like phase-change memory can increase the capacity of future memory systems by orders of magnitude. Compared to systems that rely on disk storage, NVRAM- based systems promise significant improvements in perfor- mance for key applications like online transaction process- ing (OLTP). Unfortunately, NVRAM systems suffer from two drawbacks: their asymmetric read-write performance and the notable higher cost of the new memory technologies compared to disk. This paper investigates the cost-effective use of NVRAM in transaction systems. It shows that us- ing NVRAM only for the logging subsystem (NV-Logging) provides much higher transactions per dollar than simply replacing all disk storage with NVRAM. Specifically, for NV-Logging, we show that the software overheads associated with centralized log buffers cause performance bottlenecks and limit scaling. The per-transaction logging methods de- scribed in the paper help avoid these overheads, enabling concurrent logging for multiple transactions. Experimental results with a faithful emulation of future NVRAM-based servers using the TPCC, TATP, and TPCB benchmarks show that NV-Logging improves throughput by 1.42 - 2.72x over the costlier option of replacing all disk storage with NVRAM. Results also show that NV-Logging performs 1.21 - 6.71x better than when logs are placed into the PMFS NVRAM-optimized file system. Compared to state-of-the- art distributed logging, NV-Logging delivers 20.4% through- put improvements.

AB - Emerging byte-addressable, non-volatile memory technolo- gies (NVRAM) like phase-change memory can increase the capacity of future memory systems by orders of magnitude. Compared to systems that rely on disk storage, NVRAM- based systems promise significant improvements in perfor- mance for key applications like online transaction process- ing (OLTP). Unfortunately, NVRAM systems suffer from two drawbacks: their asymmetric read-write performance and the notable higher cost of the new memory technologies compared to disk. This paper investigates the cost-effective use of NVRAM in transaction systems. It shows that us- ing NVRAM only for the logging subsystem (NV-Logging) provides much higher transactions per dollar than simply replacing all disk storage with NVRAM. Specifically, for NV-Logging, we show that the software overheads associated with centralized log buffers cause performance bottlenecks and limit scaling. The per-transaction logging methods de- scribed in the paper help avoid these overheads, enabling concurrent logging for multiple transactions. Experimental results with a faithful emulation of future NVRAM-based servers using the TPCC, TATP, and TPCB benchmarks show that NV-Logging improves throughput by 1.42 - 2.72x over the costlier option of replacing all disk storage with NVRAM. Results also show that NV-Logging performs 1.21 - 6.71x better than when logs are placed into the PMFS NVRAM-optimized file system. Compared to state-of-the- art distributed logging, NV-Logging delivers 20.4% through- put improvements.

UR - http://www.scopus.com/inward/record.url?scp=84938770007&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84938770007&partnerID=8YFLogxK

U2 - 10.14778/2735496.2735502

DO - 10.14778/2735496.2735502

M3 - Conference article

AN - SCOPUS:84938770007

VL - 8

SP - 389

EP - 400

JO - Proceedings of the VLDB Endowment

JF - Proceedings of the VLDB Endowment

SN - 2150-8097

IS - 4

ER -