Skip to main navigation Skip to search Skip to main content

Enhancing Routing Performance Through Trajectory Planning With DRL in UAV-Aided VANETs

Jingxuan CHEN, Dianrun HUANG, Yijie WANG, Ziping YU, Zhongliang ZHAO*, Xianbin CAO, Yang LIU, Tony Q. S. QUEK, Dapeng Oliver WU

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

52 Downloads (CityUHK Scholars)

Abstract

Vehicular Ad-hoc Networks (VANETs) have gained significant attention as a key enabler for intelligent transportation systems, facilitating vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) communications. Despite their potential, VANETs face critical challenges in maintaining reliable end-to-end connectivity due to their highly dynamic topology and sparse node distribution, particularly in areas with limited infrastructure coverage. Addressing these limitations is crucial for advancing the reliability and scalability of VANETs. To bridge these gaps, this work introduces a heterogeneous UAV-aided VANET framework that leverages uncrewed aerial vehicles (UAVs), also known as autonomous aerial vehicles, to enhance data transmission. The key contributions of this paper include: 1) the design of a novel adaptive dual-model routing (ADMR) protocol that operates in two modes: direct vehicle clustering for intra-cluster communication and UAV/RSU-assisted routing for inter-cluster communication; 2) the development of a modified density-based clustering algorithm (MDBSCAN) for dynamic vehicle node clustering; and 3) an improved UAV trajectory planning method based on a multi-agent soft actor-critic (MASAC) deep reinforcement learning algorithm, which optimizes network reachability. Simulation results reveal that the UAV trajectory optimization method achieves higher network reachability ratios compared to existing approaches. Also, the proposed ADMR protocol improves the packet delivery ratio (PDR) while maintaining low end-to-end latency. These findings demonstrate the potential to enhance VANET performance, while also providing valuable insights for the development of intelligent transportation systems and related fields. © 2025 The Authors.
Original languageEnglish
Pages (from-to)517-533
JournalIEEE Transactions on Machine Learning in Communications and Networking
Volume3
Online published8 Apr 2025
DOIs
Publication statusPublished - 2025

Funding

This work was supported in part by the National Key Research and Development Program of China under Grant 2021YFB3901500. The work of Yang Liu and Tony Q. S. Quek was supported by Beihang World TOP University Cooperation Program.

Research Keywords

  • Routing
  • Routing protocols
  • Autonomous aerial vehicles
  • Vehicular ad hoc networks
  • Vehicle dynamics
  • Trajectory planning
  • Network topology
  • Wireless communication
  • Topology
  • Heuristic algorithms
  • VANETs
  • UAV trajectory planning
  • DRL
  • routing protocol

Publisher's Copyright Statement

  • This full text is made available under CC-BY-NC-ND 4.0. https://creativecommons.org/licenses/by-nc-nd/4.0/

Fingerprint

Dive into the research topics of 'Enhancing Routing Performance Through Trajectory Planning With DRL in UAV-Aided VANETs'. Together they form a unique fingerprint.

Cite this