Green Edge AI: A Contemporary Survey

Yuyi Mao, Xianghao Yu, Kaibin Huang, Ying-Jun Angela Zhang, Jun Zhang*

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

13 Citations (Scopus)

Abstract

Artificial intelligence (AI) technologies have emerged as pivotal enablers across a multitude of industries, including consumer electronics, healthcare, and manufacturing, largely due to their significant resurgence over the past decade. The transformative power of AI is primarily derived from the utilization of deep neural networks (DNNs), which require extensive data for training and substantial computational resources for processing. Consequently, DNN models are typically trained and deployed on resource-rich cloud servers. However, due to potential latency issues associated with cloud communications, deep learning (DL) workflows (e.g., DNN training and inference) are increasingly being transitioned to wireless edge networks in proximity to end-user devices (EUDs). This shift is designed to support latency-sensitive applications and has given rise to a new paradigm of edge AI, which will play a critical role in upcoming sixth-generation (6G) networks to support ubiquitous AI applications. Despite its considerable potential, edge AI faces substantial challenges, mostly due to the dichotomy between the resource limitations of wireless edge networks and the resource-intensive nature of DL. Specifically, the acquisition of large-scale data, as well as the training and inference processes of DNNs, can rapidly deplete the battery energy of EUDs. This necessitates an energy-conscious approach to edge AI to ensure both optimal and sustainable performance. In this article, we present a contemporary survey on green edge AI. We commence by analyzing the principal energy consumption components of edge AI systems to identify the fundamental design principles of green edge AI. Guided by these principles, we then explore energy-efficient design methodologies for the three critical tasks in edge AI systems, including training data acquisition, edge training, and edge inference. Finally, we underscore potential future research directions to further enhance the energy efficiency (EE) of edge AI.

© 2024 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
Original languageEnglish
Pages (from-to)880-911
Number of pages32
JournalProceedings of the IEEE
Volume112
Issue number7
DOIs
Publication statusPublished - Jul 2024

Funding

The work of Yuyi Mao was supported by the Start-Up Fund of Hong Kong Polytechnic University under Project ID P0038174. The work of Xianghao Yu was supported by Hong Kong Research Grants Council (RGC) under Grant 11208724. The work of Kaibin Huang was supported in part by the RGC of Hong Kong Special Administrative Region, China, through the Fellowship Award, under Grant HKU RFS2122-7S04; in part by the Areas of Excellence Scheme under Grant AoE/E-601/22-R; and in part by the Collaborative Research Fund under Grant C1009-22G and Grant 17212423. Part of the described research work was conducted in the JC STEM Lab of Robotics for Soft Materials funded by The Hong Kong Jockey Club Charities Trust. The work of Ying-Jun Angela Zhang was supported in part by the General Research Fund under Project 14201920, Project 14202421, Project 14214122, and Project 14202723; in part by the Areas of Excellence Scheme under Project AoE/E-601/22-R; and in part by NSFC/RGC Collaborative Research Scheme under Project CRS_HKUST603/22, all from the RGC of Hong Kong. The work of Jun Zhang was supported in part by Hong Kong RGC through the Areas of Excellence Scheme under Grant AoE/E-601/22-R and in part by the NSFC/RGC Collaborative Research Scheme under Grant CRS_HKUST603/22.

Research Keywords

  • Data acquisition
  • edge artificial intelligence (AI)
  • edge inference
  • energy efficiency (EE)
  • federated learning (FL)
  • green AI
  • mobile edge computing (MEC)
  • sixth-generation (6G) wireless networks

Fingerprint

Dive into the research topics of 'Green Edge AI: A Contemporary Survey'. Together they form a unique fingerprint.

Cite this