Heterogeneity Shifts the Storage-Computation Tradeoff in Secure Multi-Cloud Systems

Jiajun Chen, Chi Wan Sung*, Terence H. Chan

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

9 Citations (Scopus)
93 Downloads (CityUHK Scholars)

Abstract

This paper considers the design of heterogeneous multi-cloud systems for big data storage and computing in the presence of cloud collusion and failures. A fundamental concept of such a system is the secrecy capacity, which represents the maximum amount of information that can be stored for each unit of storage space under the requirements of secure distributed computing. A capacity-achieving code is designed for matrix multiplication, a computing subroutine widely used in machine learning applications. The code allows fast parallel decoding and unequal data allocation in the clouds. Such a flexibility leads naturally to the idea of optimizing data allocation to minimize the computing time. Given any feasible storage budget, the optimal solution is derived, characterizing explicitly the fundamental tradeoff between storage and computing. Furthermore, it is shown via majorization theory that the whole tradeoff curve improves if the cloud computing rates are more even. Experiments on Amazon EC2 clusters are conducted, corroborating our theoretical observations and the negligibility of decoding overhead. © 2022 IEEE.
Original languageEnglish
Pages (from-to)1015-1036
Number of pages22
JournalIEEE Transactions on Information Theory
Volume69
Issue number2
Online published15 Sept 2022
DOIs
Publication statusPublished - Feb 2023

Funding

This work was supported in part by a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China, under Project CityU 11205318

Research Keywords

  • Cloud computing
  • Coded distributed computing
  • Codes
  • Decoding
  • heterogeneous systems
  • multi-cloud computing
  • Resource management
  • Runtime
  • secrecy capacity
  • Security
  • Servers
  • storage-computation tradeoff

Publisher's Copyright Statement

  • COPYRIGHT TERMS OF DEPOSITED POSTPRINT FILE: © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Chen, J., Sung, C. W., & Chan, T. H. (2023). Heterogeneity Shifts the Storage-Computation Tradeoff in Secure Multi-Cloud Systems. IEEE Transactions on Information Theory, 69(2), 1015-1036. https://doi.org/10.1109/TIT.2022.3206868.

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Heterogeneity Shifts the Storage-Computation Tradeoff in Secure Multi-Cloud Systems'. Together they form a unique fingerprint.

Cite this