Low-Overhead Paxos Replication

被引：10

作者：

Guo J. ^{[1
]}

Chu J. ^{[1
]}

Cai P. ^{[1
]}

Zhou M. ^{[1
]}

Zhou A. ^{[1
]}

机构：

[1] East China Normal University, 3663 N. Zhongshan Rd., Shanghai

来源：

Data Science and Engineering | 2017年 / 2卷 / 2期

基金：

中国国家自然科学基金;

关键词：

Database recovery; Log replication; OceanBase; Paxos;

D O I：

10.1007/s41019-017-0039-z

中图分类号：

学科分类号：

摘要：

Log replication is a key component in highly available database systems. In order to guarantee data consistency and reliability, it is common for modern database systems to utilize Paxos protocol, which is responsible for replicating transactional logs from one primary node to multiple backups. However, the Paxos replication needs to store and synchronize some additional metadata, such as committed log sequence number (commit point), to guarantee the consistency of the database. This increases the overhead of storage and network, which would have a negative impact on the throughput in the update intensive work load. In this paper, we present an implementation of log replication and database recovery methods, which adopts the idea of piggybacking, i.e., commit point can be embedded in the commit logs. This practice not only retains virtues of Paxos replication, but also reduces disk and network IO effectively. We implemented and evaluated our approach in a main memory database system. Our experiments show that the piggybacking method can offer 1.3× higher throughput than typical log replication with synchronization mechanism. © 2017, The Author(s).

引用

页码：169 / 177

页数：8

共 24 条

[1] Baker J., Bond C., Corbett J.C., Et al., Megastore: Providing scalable, highly available storage for interactive services, Fifth Biennial Conference on Innovative Data Systems Research, pp. 223-234, (2011)
[2] Balakrishnan M., Malkhi D., Davis J.D., Et al., CORFU: a distributed shared log, ACM Trans Comput Syst, 31, 4, (2013)
[3] Balakrishnan M., Malkhi D., Wobber T., Et al., Tango: Distributed data structures over a shared log, Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, pp. 325-340, (2013)
[4] Bernstein P.A., Reid C.W., Das S., Hyder—a transactional record manager for shared flash, Fifth Biennial Conference on Innovative Data Systems Research, pp. 9-20, (2011)
[5] Burrows M., The Chubby lock service for loosely-coupled distributed systems, Proceedings of the 7Th Symposium on Operating Systems Design and Implementation, pp. 335-350, (2006)
[6] Cassandra Website
[7] Cattell R., Scalable SQL and NoSQL data stores, SIGMOD Rec, 39, 4, pp. 12-27, (2011)
[8] Cooper B.F., Ramakrishnan R., Srivastava U., Et al., PNUTS: Yahoo!’s hosted data serving platform, Proc VLDB Endow, 1, 2, pp. 1277-1288, (2008)
[9] Cooper B.F., Silberstein A., Tam E., Ramakrishnan R., Sears R., Benchmarking cloud serving systems with YCSB, Proceedings of the 1St ACM Symposium on Cloud Computing, pp. 143-154, (2010)
[10] Corbett J.C., Dean J., Epstein M., Et al., Spanner: Google’s globally distributed database, ACM Trans Comput Syst, 31, 3, (2013)

← 1 2 3 →