Projects per year
Abstract
This paper considers the design of heterogeneous multi-cloud systems for big data storage and computing in the presence of cloud collusion and failures. A fundamental concept of such a system is the secrecy capacity, which represents the maximum amount of information that can be stored for each unit of storage space under the requirements of secure distributed computing. A capacity-achieving code is designed for matrix multiplication, a computing subroutine widely used in machine learning applications. The code allows fast parallel decoding and unequal data allocation in the clouds. Such a flexibility leads naturally to the idea of optimizing data allocation to minimize the computing time. Given any feasible storage budget, the optimal solution is derived, characterizing explicitly the fundamental tradeoff between storage and computing. Furthermore, it is shown via majorization theory that the whole tradeoff curve improves if the cloud computing rates are more even. Experiments on Amazon EC2 clusters are conducted, corroborating our theoretical observations and the negligibility of decoding overhead. © 2022 IEEE.
| Original language | English |
|---|---|
| Pages (from-to) | 1015-1036 |
| Number of pages | 22 |
| Journal | IEEE Transactions on Information Theory |
| Volume | 69 |
| Issue number | 2 |
| Online published | 15 Sept 2022 |
| DOIs | |
| Publication status | Published - Feb 2023 |
Funding
This work was supported in part by a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China, under Project CityU 11205318
Research Keywords
- Cloud computing
- Coded distributed computing
- Codes
- Decoding
- heterogeneous systems
- multi-cloud computing
- Resource management
- Runtime
- secrecy capacity
- Security
- Servers
- storage-computation tradeoff
Publisher's Copyright Statement
- COPYRIGHT TERMS OF DEPOSITED POSTPRINT FILE: © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Chen, J., Sung, C. W., & Chan, T. H. (2023). Heterogeneity Shifts the Storage-Computation Tradeoff in Secure Multi-Cloud Systems. IEEE Transactions on Information Theory, 69(2), 1015-1036. https://doi.org/10.1109/TIT.2022.3206868.
RGC Funding Information
- RGC-funded
Fingerprint
Dive into the research topics of 'Heterogeneity Shifts the Storage-Computation Tradeoff in Secure Multi-Cloud Systems'. Together they form a unique fingerprint.Projects
- 1 Finished
-
GRF: Code Design for Distributed Storage Systems with Awareness of Network Topology
SUNG, C. W. (Principal Investigator / Project Coordinator), CHAN, T. (Co-Investigator) & Xu, G. (Co-Investigator)
1/01/19 → 22/05/23
Project: Research