Adaptive Erasure Coded Data Maintenance for Consensus in Distributed Networks

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)peer-review

View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publicationProceedings - 2021 40th International Symposium on Reliable Distributed Systems, SRDS 2021
PublisherIEEE
Pages345-346
ISBN (Electronic)978-1-6654-3819-3
ISBN (Print)978-1-6654-3820-9
Publication statusPublished - 2021

Publication series

NameProceedings of the IEEE Symposium on Reliable Distributed Systems
ISSN (Print)1060-9857
ISSN (Electronic)2575-8462

Conference

Title40th International Symposium on Reliable Distributed Systems, SRDS 2021
LocationVirtual
PlaceUnited States
CityChicago
Period20 - 23 September 2021

Abstract

Distributed data services usually rely on consensus protocols, such as Paxos and Raft, to provide fault-Tolerance and data consistency across distributed data centers and even edge networks. In consensus protocols, erasure coded replication has appealing storage and network cost savings compared with full copy replication, which help achieve low latency, high fault-Tolerance and high throughput. However, the liveness level will inevitably decrease when erasure codes are naively applied in consensus protocols. To keep the original liveness level, an existing protocol, called CRaft, switches from erasure coded replication to full copy replication when the number of failures exceeds a certain threshold. Such a solution, however, degrades system performance sharply. To tackle this problem, this work proposes a novel protocol called HRaft to enable graceful degradation on storage and network efficiency when failures happen. Without using full copy replication, it replenishes some coded blocks in healthy servers to reduce storage and network costs and to keep data consistency. The performance of the proposed protocol will be evaluated by deploving it into practical networks.

Research Area(s)

  • consensus protocol, Erasure codes, fault tolerance, network storage, Paxos, Raft

Citation Format(s)

Adaptive Erasure Coded Data Maintenance for Consensus in Distributed Networks. / Jia, Yulei; Xu, Guangping; Sung, Chi Wan; Mostafa, Salwa.

Proceedings - 2021 40th International Symposium on Reliable Distributed Systems, SRDS 2021. IEEE, 2021. p. 345-346 (Proceedings of the IEEE Symposium on Reliable Distributed Systems).

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)peer-review