Adaptive Erasure Coded Data Maintenance for Consensus in Distributed Networks
Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Title of host publication | Proceedings - 2021 40th International Symposium on Reliable Distributed Systems, SRDS 2021 |
Publisher | Institute of Electrical and Electronics Engineers, Inc. |
Pages | 345-346 |
ISBN (electronic) | 978-1-6654-3819-3 |
ISBN (print) | 978-1-6654-3820-9 |
Publication status | Published - 2021 |
Publication series
Name | Proceedings of the IEEE Symposium on Reliable Distributed Systems |
---|---|
ISSN (Print) | 1060-9857 |
ISSN (electronic) | 2575-8462 |
Conference
Title | 40th International Symposium on Reliable Distributed Systems, SRDS 2021 |
---|---|
Location | Virtual |
Place | United States |
City | Chicago |
Period | 20 - 23 September 2021 |
Link(s)
Abstract
Distributed data services usually rely on consensus protocols, such as Paxos and Raft, to provide fault-Tolerance and data consistency across distributed data centers and even edge networks. In consensus protocols, erasure coded replication has appealing storage and network cost savings compared with full copy replication, which help achieve low latency, high fault-Tolerance and high throughput. However, the liveness level will inevitably decrease when erasure codes are naively applied in consensus protocols. To keep the original liveness level, an existing protocol, called CRaft, switches from erasure coded replication to full copy replication when the number of failures exceeds a certain threshold. Such a solution, however, degrades system performance sharply. To tackle this problem, this work proposes a novel protocol called HRaft to enable graceful degradation on storage and network efficiency when failures happen. Without using full copy replication, it replenishes some coded blocks in healthy servers to reduce storage and network costs and to keep data consistency. The performance of the proposed protocol will be evaluated by deploving it into practical networks.
Research Area(s)
- consensus protocol, Erasure codes, fault tolerance, network storage, Paxos, Raft
Citation Format(s)
Adaptive Erasure Coded Data Maintenance for Consensus in Distributed Networks. / Jia, Yulei; Xu, Guangping; Sung, Chi Wan et al.
Proceedings - 2021 40th International Symposium on Reliable Distributed Systems, SRDS 2021. Institute of Electrical and Electronics Engineers, Inc., 2021. p. 345-346 (Proceedings of the IEEE Symposium on Reliable Distributed Systems).
Proceedings - 2021 40th International Symposium on Reliable Distributed Systems, SRDS 2021. Institute of Electrical and Electronics Engineers, Inc., 2021. p. 345-346 (Proceedings of the IEEE Symposium on Reliable Distributed Systems).
Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review