Beyond Video Surveillance : Exploiting Sleep-Talk of Apps to See Smartphone's ID

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publication2022 IEEE Wireless Communications and Networking Conference (WCNC)
PublisherInstitute of Electrical and Electronics Engineers, Inc.
Pages1922-1927
ISBN (electronic)9781665442664
ISBN (print)978-1-6654-4267-1
Publication statusPublished - 2022

Publication series

NameIEEE Wireless Communications and Networking Conference, WCNC
ISSN (Print)1525-3511
ISSN (electronic)1558-2612

Conference

Title2022 IEEE Wireless Communications and Networking Conference (WCNC 2022)
LocationHilton Austin
PlaceUnited States
CityAustin
Period10 - 13 April 2022

Abstract

Video cameras have been widely deployed at city-scale for security surveillance. However, under poor light condition and limited video resolution, it is often impossible to determine the identity of a pedestrian by using computer vision alone. Motivated by the fast and continuous penetration of smartphones, in this paper, we explore the feasibility of augmenting video cameras to 'see' the identities of smartphones (e.g., MAC addresses, cellular IDs, or even phone numbers) carried by pedestrians. We develop IDCam-a system that integrates a video camera with a smart antenna array, which leverages spatial-domain sensing of smartphone's sleep-talk (i.e., the packets transmitted by apps while the phone's screen is off) to match the angles of smartphone's packets and pedestrians in the video, enabling passive identity linking without the cooperation of target. Experiment results show that IDCam accurately links visual and wireless identities in a complex deployment environment with tens of pedestrians and intensive multipath signal propagation.

Research Area(s)

  • array signal processing, computer vision, object detection, sensor fusion

Citation Format(s)

Beyond Video Surveillance: Exploiting Sleep-Talk of Apps to See Smartphone's ID. / Fan, Zhuochen; Liu, Tian; Huang, Jun et al.
2022 IEEE Wireless Communications and Networking Conference (WCNC). Institute of Electrical and Electronics Engineers, Inc., 2022. p. 1922-1927 (IEEE Wireless Communications and Networking Conference, WCNC).

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review