TY - JOUR
T1 - Deep Reinforcement Learning Over RIS-Assisted Integrated Sensing and Communication
T2 - Challenges and Opportunities
AU - Chen, Zhen
AU - Huang, Lei
AU - So, Hing Cheung
AU - Jiang, Hao
AU - Zhang, Xiu Yin
AU - Wang, Jiangzhou
PY - 2024/12/23
Y1 - 2024/12/23
N2 - The advancement of deep learning significantly accelerates the development of future integrated sensing and communication (ISAC) systems. Deep reinforcement learning (DRL), as a promising deep learning approach, has emerged to leverage a distributed personalized dataset from different reconfigurable intelligent surface (RIS) nodes. However, the high costs associated with data offloading and model training pose challenges to implementing network intelligence within existing ISAC frameworks, particularly at network edges. To address this limitation, a paradigm of RIS-enabled DRL technology is developed, which can overcome the arithmetic, high frequency transmission and coverage region problems. The fundamental studies with respect to the RIS-assisted ISAC modeling and its solution are investigated, which can provide insights into the design of RIS-enabled DRL in ISAC network. To facilitate the corresponding implementation, key techniques are proposed to integrate the communication, sensing and computation capabilities of ISAC network. Moreover, future trends of RIS-enabled DRL technology for ISAC network, such as potential applications and open issues, are discussed. © 2025 IEEE. All rights reserved, including rights for text and data mining, and training of artificial intelligence and similar technologies.
AB - The advancement of deep learning significantly accelerates the development of future integrated sensing and communication (ISAC) systems. Deep reinforcement learning (DRL), as a promising deep learning approach, has emerged to leverage a distributed personalized dataset from different reconfigurable intelligent surface (RIS) nodes. However, the high costs associated with data offloading and model training pose challenges to implementing network intelligence within existing ISAC frameworks, particularly at network edges. To address this limitation, a paradigm of RIS-enabled DRL technology is developed, which can overcome the arithmetic, high frequency transmission and coverage region problems. The fundamental studies with respect to the RIS-assisted ISAC modeling and its solution are investigated, which can provide insights into the design of RIS-enabled DRL in ISAC network. To facilitate the corresponding implementation, key techniques are proposed to integrate the communication, sensing and computation capabilities of ISAC network. Moreover, future trends of RIS-enabled DRL technology for ISAC network, such as potential applications and open issues, are discussed. © 2025 IEEE. All rights reserved, including rights for text and data mining, and training of artificial intelligence and similar technologies.
UR - http://www.scopus.com/inward/record.url?scp=85213412648&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85213412648&origin=recordpage
U2 - 10.1109/MVT.2024.3503537
DO - 10.1109/MVT.2024.3503537
M3 - RGC 21 - Publication in refereed journal
SN - 1556-6072
JO - IEEE Vehicular Technology Magazine
JF - IEEE Vehicular Technology Magazine
ER -