Cost-Efficient Scheduling of Bulk Transfers in Inter-Datacenter WANs

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal

View graph of relations

Author(s)

  • Zhenjie Yang
  • Yong Cui
  • Xin Wang
  • Yadong Liu
  • Shihan Xiao
  • Chuming Li

Detail(s)

Original languageEnglish
Pages (from-to)1973-1986
Journal / PublicationIEEE - ACM Transactions on Networking
Volume27
Issue number5
Online published26 Aug 2019
Publication statusPublished - Oct 2019

Abstract

With the quick growth of traffic between data centers, inefficient transfer scheduling in inter-datacenter networks can lead to a huge waste of bandwidth thus significant bandwidth cost. Previous work have explored different ways, such as software-defined WANs and dynamic pricing mechanisms, to overcome the inefficiency of inter-datacenter networks. However, there is a big challenge in addressing the fundamental conflicts between the deadline-aware transfer scheduling and minimizing the bandwidth cost. Unlike existing efforts that schedule inter-datacenter transfers under fixed link capacities, wherein some deadlines are violated and the service quality is degraded, we aim to finish all the transfers on time with as little bandwidth as possible to minimize the bandwidth cost. We take into account the variation of bandwidth price and the deadline requirements of services, and formulate the problem of cost-efficient scheduling of bulk transfers with deadline guarantee, which is shown to be NP-hard. Benefitting from the relax-and-round method, we propose a progressively-descending algorithm (PDA) to schedule bulk transfers and meet the above goals with a guaranteed approximation ratio. We apply our algorithm in a bulk transfer scheduler, Butler, and build a small-scale testbed to evaluate its efficiency. Both large-scale simulation and testbed experiment results validate the ability of our scheme on cutting down the bandwidth cost. Compared with existing approaches, it reduces up to 60% bandwidth cost and increases the network utilization by up to 140%.

Research Area(s)

  • Inter-datacenter WAN, cost, scheduling

Citation Format(s)

Cost-Efficient Scheduling of Bulk Transfers in Inter-Datacenter WANs. / Yang, Zhenjie; Cui, Yong; Wang, Xin; Liu, Yadong; Li, Minming; Xiao, Shihan; Li, Chuming.

In: IEEE - ACM Transactions on Networking, Vol. 27, No. 5, 10.2019, p. 1973-1986.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal