TY - GEN
T1 - Distributed data persistency
AU - Kokolis, Apostolos
AU - Psistakis, Antonis
AU - Reidys, Benjamin
AU - Huang, Jian
AU - Torrellas, Josep
N1 - Publisher Copyright:
© 2021 Association for Computing Machinery.
PY - 2021/10/18
Y1 - 2021/10/18
N2 - Distributed applications such as key-value stores and databases avoid frequent writes to secondary storage devices to minimize performance degradation. They provide fault tolerance by replicating variables in the memories of different nodes, and using data consistency protocols to ensure consistency across replicas. Unfortunately, the reduced data durability guarantees provided can cause data loss or slow data recovery. In this environment, non-volatile memory (NVM) offers the ability to attain both high performance and data durability in distributed applications. However, it is unclear how to tie NVM memory persistency models to the existing data consistency frameworks, and what are the durability guarantees that the combination will offer to distributed applications. In this paper, we propose the concept of Distributed Data Persistency (DDP) model, which is the binding of the memory persistency model with the data consistency model in a distributed system. We reason about the interaction between consistency and persistency by using the concepts of Visibility Point and Durability Point. We design low-latency distributed protocols for DDP models that combine five consistency models with five persistency models. For the resulting DDP models, we investigate the trade-offs between performance, durability, and intuition provided to the programmer.
AB - Distributed applications such as key-value stores and databases avoid frequent writes to secondary storage devices to minimize performance degradation. They provide fault tolerance by replicating variables in the memories of different nodes, and using data consistency protocols to ensure consistency across replicas. Unfortunately, the reduced data durability guarantees provided can cause data loss or slow data recovery. In this environment, non-volatile memory (NVM) offers the ability to attain both high performance and data durability in distributed applications. However, it is unclear how to tie NVM memory persistency models to the existing data consistency frameworks, and what are the durability guarantees that the combination will offer to distributed applications. In this paper, we propose the concept of Distributed Data Persistency (DDP) model, which is the binding of the memory persistency model with the data consistency model in a distributed system. We reason about the interaction between consistency and persistency by using the concepts of Visibility Point and Durability Point. We design low-latency distributed protocols for DDP models that combine five consistency models with five persistency models. For the resulting DDP models, we investigate the trade-offs between performance, durability, and intuition provided to the programmer.
KW - Data consistency
KW - Distributed architecture
KW - Memory persistency
KW - Non-volatile memory
UR - http://www.scopus.com/inward/record.url?scp=85118826975&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85118826975&partnerID=8YFLogxK
U2 - 10.1145/3466752.3480060
DO - 10.1145/3466752.3480060
M3 - Conference contribution
AN - SCOPUS:85118826975
T3 - Proceedings of the Annual International Symposium on Microarchitecture, MICRO
SP - 71
EP - 85
BT - MICRO 2021 - 54th Annual IEEE/ACM International Symposium on Microarchitecture, Proceedings
PB - IEEE Computer Society
T2 - 54th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2021
Y2 - 18 October 2021 through 22 October 2021
ER -