Resolution Matters: Revisiting Prediction-Based Job Co-location in Public Clouds

Justin Kur*, Jingshu Chen, Ji Xue, Jun Huang

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

Overall resource utilization in public cloud data centers remains very low. To increase the efficiency of these data centers, low priority batch jobs are often co-located on the same machines as latency-sensitive jobs. Existing methodologies have used machine learning to predict the amount of resources that should be reserved for these jobs to maintain acceptable latency. However, these methodologies overlook the impact of measurement granularity on usage prediction and scheduling performance. When batch jobs have long durations, coarsegrained data can be used to make the prediction problem less challenging, but the resulting predictions may degrade scheduling performance. In this paper, we investigate the impact of measurement granularity on scheduler performance using extensive trace-driven simulation and job data generated from the Alibaba cluster trace. © 2022 IEEE.
Original languageEnglish
Title of host publicationProceedings - 2022 IEEE/ACM 15th International Conference on Utility and Cloud Computing (UCC 2022)
PublisherIEEE
Pages163-166
ISBN (Electronic)978-1-6654-6087-3
DOIs
Publication statusPublished - Dec 2022
Event15th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2022 - Vancouver, United States
Duration: 6 Dec 20229 Dec 2022

Publication series

NameProceedings - 2022 IEEE/ACM 15th International Conference on Utility and Cloud Computing, UCC 2022

Conference

Conference15th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2022
Country/TerritoryUnited States
CityVancouver
Period6/12/229/12/22

Bibliographical note

Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).

Research Keywords

  • Cloud computing
  • Job scheduling
  • Resource usage prediction

Fingerprint

Dive into the research topics of 'Resolution Matters: Revisiting Prediction-Based Job Co-location in Public Clouds'. Together they form a unique fingerprint.

Cite this