MirrorTablet : Exploring a low-cost mobile system for capturing unmediated hand gestures in remote collaboration

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

10 Scopus Citations
View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publicationMUM '17 : Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia
PublisherAssociation for Computing Machinery (ACM)
Pages79-89
ISBN (print)9781450353786
Publication statusPublished - 26 Nov 2017

Publication series

NameACM International Conference Proceeding Series
VolumePart F132882

Conference

Title16th International Conference on Mobile and Ubiquitous Multimedia, MUM 2017
PlaceGermany
CityStuttgart
Period26 - 29 November 2017

Abstract

Direct and natural images of hand gestures have been shown to benefit remote collaboration on physical tasks in several settings, including ad-hoc ones. However, to capture such unmediated hand gestures within collaborative tasks, existing approaches require stationary hardware systems or heavily instrumented mobile devices, making them unfeasible for use at ad-hoc workplaces. We present MirrorTablet, a low-cost mirror-based system taking advantage of the built-in front-facing camera of a tablet to capture the user’s unmediated hand interactions on and above the screen. This system requires minimal instrumentation of the tablet and can be easily (un-)mounted, making it suitable for mobile usage. A user study with ten pairs of participants on a helper-worker setup working on construction tasks showed that MirrorTablet improved task completion time and had positive effects on participants’ perceived workload when working with unfamiliar tasks compared to using a common sketch-only interface. In addition, qualitative feedback yielded design considerations on hand visualization for mobile device remote collaboration on physical tasks.

Research Area(s)

  • Hand Gestures, Hand Interactions, Mobile Devices, Physical Tasks, Remote Collaboration

Citation Format(s)

MirrorTablet: Exploring a low-cost mobile system for capturing unmediated hand gestures in remote collaboration. / Le, Khanh-Duy; Zhu, Kening; Fjeld, Morten.
MUM '17 : Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia. Association for Computing Machinery (ACM), 2017. p. 79-89 (ACM International Conference Proceeding Series; Vol. Part F132882).

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review