Imperceptible on-screen markers for mobile interaction on public large displays

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal

4 Scopus Citations
View graph of relations

Author(s)

  • Goshiro YAMAMOTO
  • Luiz SAMPAIO
  • Takafumi TAKETOMI
  • Hirokazu KATO
  • Tomohiro KURODA

Detail(s)

Original languageEnglish
Pages (from-to)2027-2036
Journal / PublicationIEICE Transactions on Information and Systems
VolumeE100-D
Issue number9
Online published1 Sep 2017
Publication statusPublished - Sep 2017
Externally publishedYes

Abstract

We present a novel method to enable users to experience mobile interaction with digital content on external displays by embedding markers imperceptibly on the screen. Our method consists of two parts: marker embedding on external displays and marker detection. To embed markers, similar to previous work, we display complementary colors in alternating frames, which are selected by considering L∗a∗b color space in order to make the markers harder for humans to detect. Our marker detection process does not require mobile devices to be synchronized with the display, while certain constraints for the relation between camera and display update rate need to be fulfilled. In this paper, we have conducted three experiments. The results show 1) selecting complementary colors in the a∗b∗ color plane maximizes imperceptibility, 2) our method is extremely robust when used with static contents and can handle animated contents up to certain optical flow levels, and 3) our method was proved to work well in case of small movements, but large movements can lead to loss of tracking.

Research Area(s)

  • Human Visual Perception, Imperceptible Marker, Unsynchronized Capture

Citation Format(s)

Imperceptible on-screen markers for mobile interaction on public large displays. / YAMAMOTO, Goshiro; SAMPAIO, Luiz; TAKETOMI, Takafumi; SANDOR, Christian; KATO, Hirokazu; KURODA, Tomohiro.

In: IEICE Transactions on Information and Systems, Vol. E100-D, No. 9, 09.2017, p. 2027-2036.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal