Amateur : Augmented Reality Based Vehicle Navigation System

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

View graph of relations


Related Research Unit(s)


Original languageEnglish
Article number155
Journal / PublicationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Issue number4
Online published27 Dec 2018
Publication statusPublished - Dec 2018


This paper presents Amateur, an augmented reality based vehicle navigation system using commodity smart phones. Amateurreads the navigation information from a digital map, matches it into live road condition video captured by smart phone, anddirectly annotates the navigation instructions on the video stream. The Amateur design entails two major challenges, includingthe lane identification and the intersection inference so as to correctly annotate navigation instructions for lane-changingand intersection-turning. In this paper, we propose a particle filter based design, assisted by inertial motion sensors andlane markers, to tolerate incomplete and even erroneous detection of road conditions. We further leverage traffic lights asland markers to estimate the position of each intersection to accurately annotate the navigation instructions. We develop aprototype system on Android mobile phones and test our system in a total number of more than 300km travel distance ondifferent taxi cabs in a city. The evaluation results suggest that our system can timely provide correct instructions to navigatedrivers. Our system can identify lanes in 2s with 92.7% accuracy and detect traffic lights with 95.29% accuracy. Overall, theaccuracy of the navigation signs placement is less than 105 pixels on the screen throughout the experiments. The feedbackfrom 50 taxi drivers indicates that Amateur provides an improved experience compared to traditional navigation systems.

Research Area(s)

  • Augmented Reality, Navigation Service, Smartphone