Fair and Efficient Traffic Light Control with Reinforcement Learning

Yongshuo Wan*, Kui Wu, Tuo Shi, Jianping Wang

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

1 Citation (Scopus)

Abstract

Traditional traffic signal control methods primarily focus on enhancing crossroad efficiency, often overlooking fairness among drivers. Existing solutions for achieving fair traffic light control either rely on oversimplified assumptions and offline optimization or disproportionately prioritize the interests of drivers in the busy lanes. In this paper, we propose a novel reinforcement learning approach to ensuring fairness in traffic light control by minimizing waiting time disparities among drivers while optimizing traffic throughput. We present a comprehensive model of the crossroad intersection and define traffic signal phases that govern permissible driving movements. Our solution utilizes a Deep Q-Network (DQN) agent for continuous-time control and combines offline and online training. Through extensive simulations, we demonstrate the effectiveness of our fairness-driven approach using both classical metrics, such as throughput and average waiting time, and new performance metrics, including waiting time disparities and Jain’s fairness index. Evaluation results show that our approach leads to more equitable and efficient traffic signal control. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
Original languageEnglish
Title of host publicationProceedings of the International Symposium on Intelligent Computing and Networking 2024 (ISICN 2024)
EditorsMichel Kadoch, Kejie Lu, Feng Ye, Yi Qian
PublisherSpringer, Cham
Pages17-33
ISBN (Electronic)9783031674471
ISBN (Print)9783031674464
DOIs
Publication statusPublished - 2024
Event1st International Symposium on Intelligent Computing and Networking (ISICN 2024) - San Juan, Puerto Rico, United States
Duration: 18 Mar 202420 Mar 2024
https://www.isicn.org/2024/

Publication series

NameLecture Notes in Networks and Systems
Volume1094
ISSN (Print)2367-3370
ISSN (Electronic)2367-3389

Conference

Conference1st International Symposium on Intelligent Computing and Networking (ISICN 2024)
PlaceUnited States
CitySan Juan, Puerto Rico
Period18/03/2420/03/24
Internet address

Research Keywords

  • Fairness
  • Reinforcement Learning
  • Traffic Light Control

Fingerprint

Dive into the research topics of 'Fair and Efficient Traffic Light Control with Reinforcement Learning'. Together they form a unique fingerprint.

Cite this