Back-mirror : Back-of-device one-handed interaction on smartphones

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

23 Scopus Citations
View graph of relations

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publicationSA 2016 - SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications
PublisherAssociation for Computing Machinery, Inc
ISBN (print)9781450345514
Publication statusPublished - Dec 2016

Conference

Title2016 SIGGRAPH ASIA Mobile Graphics and Interactive Applications, SA 2016
PlaceChina
CityMacau
Period5 - 8 December 2016

Abstract

We present Back-Mirror, a low-cost camera-based approach for widening the interaction space on the back surface of a smartphone by using mirror reflection. Back-Mirror consists of two main parts: a smartphone accessory with a mirror that can reflect the back surface to the rear-facing camera of the phone, and a computer-vision algorithm for gesture recognition based on the visual pattern on the back surface. Our approach captures the finger position on the back surface, and tracks finger movement with higher resolution than the previous methods. We further designed a set of intuitive gestures that can be recognized by Back-Mirror, including swiping up, down, left and right, tapping left, middle, right, and holding gestures. Furthermore, we created applications of Back-of-device, such as game, media player, photo gallery, and unlock mechanism, allowing users to experience the use of Back-Mirror gestures in the real-life scenarios.

Research Area(s)

  • Back-of-device, Camera, Gestures, Mobile interaction, Motion sensing, Smartphone

Citation Format(s)

Back-mirror: Back-of-device one-handed interaction on smartphones. / Wong, Pui Chung; Fu, Hongbo; Zhu, Kening.
SA 2016 - SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications. Association for Computing Machinery, Inc, 2016. 13.

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review