Towards Efficient Personalized Driver Behavior Modeling with Machine Unlearning

Qun Song, Rui Tan, Jianping Wang

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

2 Citations (Scopus)
30 Downloads (CityUHK Scholars)

Abstract

Driver Behavior Modeling (DBM) aims to predict and model human driving behaviors, which is typically incorporated into the Advanced Driver Assistance System to enhance transportation safety and improve driving experience. Inverse reinforcement learning (IRL) is a prevailing DBM technique with the goal of modeling the driving policy by recovering an unknown internal reward function from human driver demonstrations. However, the latest IRL-based design is inefficient due to the laborious manual feature engineering processes. Besides, the reward function usually experiences increased prediction errors when deployed for unseen vehicles. In this paper, we propose a novel deep learning-based reward function for IRL-based DBM with efficient model personalization via machine unlearning. We evaluate our approach on a highway simulation constructed using the realistic human driving dataset NGSIM. We deploy our approach on both a server GPU and an embedded GPU. The evaluation results show that our approach achieves a higher prediction accuracy compared with the latest IRL-based DBM approach that uses a weighted sum of trajectory features as the reward function. Our model personalization method obtains the highest accuracy and lowest latency compared with the baselines. © 2023 Owner/Author.
Original languageEnglish
Title of host publicationProceedings of 2023 Cyber-Physical Systems and Internet-of-Things Week (CPS-IoT Week) - Workshops
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery
Pages31-36
ISBN (Print)9798400700491
DOIs
Publication statusPublished - 2023
Event7th ACM/IEEE Workshop on the Internet of Safe Things (SafeThings 2023) - San Antonio, United States
Duration: 9 May 20239 May 2023
https://safe-things-2023.github.io/index.html

Publication series

NameACM International Conference Proceeding Series

Conference

Conference7th ACM/IEEE Workshop on the Internet of Safe Things (SafeThings 2023)
Country/TerritoryUnited States
CitySan Antonio
Period9/05/239/05/23
Internet address

Funding

This research is supported in part by the National Research Foundation, Singapore and National University of Singapore through its National Satellite of Excellence in Trustworthy Software Systems (NSOE-TSS) office under the Trustworthy Computing for Secure Smart Nation Grant (TCSSNG) award no. NSOE-TSS2020-01, and in part by a project from Hong Kong Research Grant Council under GRF 11200220.

Research Keywords

  • Driver behavior modeling
  • inverse reinforcement learning
  • machine unlearning
  • model personalization
  • neural network

Publisher's Copyright Statement

  • This full text is made available under CC-BY 4.0. https://creativecommons.org/licenses/by/4.0/

Fingerprint

Dive into the research topics of 'Towards Efficient Personalized Driver Behavior Modeling with Machine Unlearning'. Together they form a unique fingerprint.

Cite this