F2Key: Dynamically Converting Your Face into a Private Key Based on COTS Headphones for Reliable Voice Interaction

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

2 Scopus Citations
View graph of relations

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publicationMOBISYS ’24 - Proceedings of the 2024 The 22nd Annual International Conference on Mobile Systems, Applications and Services
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery
Pages127-140
Number of pages14
ISBN (print)979-8-4007-0581-6
Publication statusPublished - 2024

Conference

Title22nd ACM International Conference on Mobile Systems, Applications, and Services (ACM MobiSys 2024)
LocationToranomon Hills Forum
PlaceJapan
CityTokyo
Period3 - 7 June 2024

Abstract

In this paper, we proposed F2Key, the first earable physical security system based on commercial off-the-shelf headphones. F2Key enables impactful applications, such as enhancing voiceprint-based authentication systems, reliable voice assistants, audio deepfake defense, and the legal validity of artifacts. The key idea of F2Key is to establish a stable acoustic sensing field across the user's face and embed the user's facial structures and articulatory habits into a user-specific generative model that serves as a private key. The private key can decrypt the Channel Impulse Response (CIR) profiles provided by the acoustic sensing field into an inferred spectrogram that can match the real one calculated from the corresponding speech, provided that the user's CIR-spectrogram mapping relationship is consistent with the one embedded in the generative model. Extensive experiments demonstrate that F2Key resists 99.9%, 96.4%, and 95.3% of speech replay attacks, mimicry attacks, and hybrid attacks, respectively. We discussed and evaluated F2Key from different perspectives, such as the health consideration and identical twins study, to show the practicality and reliability. © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.

Research Area(s)

  • Acoustic sensing, Deepfake detection, Earable Sensing, Physical security system

Bibliographic Note

Research Unit(s) information for this publication is provided by the author(s) concerned.

Citation Format(s)

F2Key: Dynamically Converting Your Face into a Private Key Based on COTS Headphones for Reliable Voice Interaction. / Duan, Di; Sun, Zehua; Ni, Tao et al.
MOBISYS ’24 - Proceedings of the 2024 The 22nd Annual International Conference on Mobile Systems, Applications and Services. New York, NY: Association for Computing Machinery, 2024. p. 127-140.

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review