Accurate Prediction of Required Virtual Resources via Deep Reinforcement Learning

Haojun Huang*, Zhaoxi Li, Jialin Tian, Geyong Min*, Wang Miao, Dapeng Oliver Wu

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

6 Citations (Scopus)

Abstract

Resource provisioning for the ever-increasing applications to host the necessary network functions necessitates the efficient and accurate prediction of required resources. However, the current efforts fail to leverage the inherent features hidden in network traffic, such as temporal stability, service correlation and periodicity, to predict the required resources in an intelligent manner, incurring coarse-grain prediction accuracies. To tackle this problem, in this paper, we propose an Accurate Prediction of Required virtual Resources (APRR) approach via Deep Reinforcement Learning (DRL). We first confirm the resource requests have more similar features and identify the high-dimensional required resources in computing, storage and bandwidth can be effectively consolidated into a single standardized value. Built upon these observations, we then model the required resources as a time-variant network matrix, which includes a number of elements, obtained from the network measurements, and some missing elements needed to be inferred. To obtain accurately predicted results, DRL-based matrix factorization with a set of available rules has been introduced into APRR and alternately executed in agent to minimize the prediction errors. Moreover, the error-prioritized designed for model training with quicker convergence. Simulation experiments on real-world datasets illustrate that APRR can accurately predict the required virtual resources compared with the related approaches. © 2022 IEEE.
Original languageEnglish
Pages (from-to)920-933
JournalIEEE/ACM Transactions on Networking
Volume31
Issue number2
Online published15 Sept 2022
DOIs
Publication statusPublished - Apr 2023

Research Keywords

  • Bandwidth
  • Computational modeling
  • Correlation
  • deep reinforcement learning
  • network matrix
  • Predictive models
  • Quality of service
  • Reinforcement learning
  • Stability analysis
  • Virtual network functions
  • virtual resources

Fingerprint

Dive into the research topics of 'Accurate Prediction of Required Virtual Resources via Deep Reinforcement Learning'. Together they form a unique fingerprint.

Cite this