Back-mirror: Back-of-device one-handed interaction on smartphones

Pui Chung Wong*, Hongbo Fu, Kening Zhu

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

We present Back-Mirror, a low-cost camera-based approach for widening the interaction space on the back surface of a smartphone by using mirror reflection. Back-Mirror consists of two main parts: a smartphone accessory with a mirror that can reflect the back surface to the rear-facing camera of the phone, and a computer-vision algorithm for gesture recognition based on the visual pattern on the back surface. Our approach captures the finger position on the back surface, and tracks finger movement with higher resolution than the previous methods. We further designed a set of intuitive gestures that can be recognized by Back-Mirror, including swiping up, down, left and right, tapping left, middle, right, and holding gestures. Furthermore, we created applications of Back-of-device, such as game, media player, photo gallery, and unlock mechanism, allowing users to experience the use of Back-Mirror gestures in the real-life scenarios.
Original languageEnglish
Title of host publicationSA 2016 - SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications
PublisherAssociation for Computing Machinery
ISBN (Print)9781450345514
DOIs
Publication statusPublished - Dec 2016
Event2016 SIGGRAPH ASIA Mobile Graphics and Interactive Applications, SA 2016 - Macau, China
Duration: 5 Dec 20168 Dec 2016

Conference

Conference2016 SIGGRAPH ASIA Mobile Graphics and Interactive Applications, SA 2016
PlaceChina
CityMacau
Period5/12/168/12/16

Research Keywords

  • Back-of-device
  • Camera
  • Gestures
  • Mobile interaction
  • Motion sensing
  • Smartphone

Fingerprint

Dive into the research topics of 'Back-mirror: Back-of-device one-handed interaction on smartphones'. Together they form a unique fingerprint.

Cite this