Beyond Video Surveillance: Exploiting Sleep-Talk of Apps to See Smartphone's ID

Zhuochen Fan, Tian Liu, Jun Huang*, Tong Yang

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

Video cameras have been widely deployed at city-scale for security surveillance. However, under poor light condition and limited video resolution, it is often impossible to determine the identity of a pedestrian by using computer vision alone. Motivated by the fast and continuous penetration of smartphones, in this paper, we explore the feasibility of augmenting video cameras to 'see' the identities of smartphones (e.g., MAC addresses, cellular IDs, or even phone numbers) carried by pedestrians. We develop IDCam-a system that integrates a video camera with a smart antenna array, which leverages spatial-domain sensing of smartphone's sleep-talk (i.e., the packets transmitted by apps while the phone's screen is off) to match the angles of smartphone's packets and pedestrians in the video, enabling passive identity linking without the cooperation of target. Experiment results show that IDCam accurately links visual and wireless identities in a complex deployment environment with tens of pedestrians and intensive multipath signal propagation.
Original languageEnglish
Title of host publication2022 IEEE Wireless Communications and Networking Conference (WCNC)
PublisherIEEE
Pages1922-1927
ISBN (Electronic)9781665442664
ISBN (Print)978-1-6654-4267-1
DOIs
Publication statusPublished - 2022
Event2022 IEEE Wireless Communications and Networking Conference (WCNC 2022) - Hilton Austin, Austin, United States
Duration: 10 Apr 202213 Apr 2022

Publication series

NameIEEE Wireless Communications and Networking Conference, WCNC
ISSN (Print)1525-3511
ISSN (Electronic)1558-2612

Conference

Conference2022 IEEE Wireless Communications and Networking Conference (WCNC 2022)
Country/TerritoryUnited States
CityAustin
Period10/04/2213/04/22

Research Keywords

  • array signal processing
  • computer vision
  • object detection
  • sensor fusion

Fingerprint

Dive into the research topics of 'Beyond Video Surveillance: Exploiting Sleep-Talk of Apps to See Smartphone's ID'. Together they form a unique fingerprint.

Cite this