Mathematical Design of a Novel Gesture-Based Instruction/Input Device Using Wave Detection

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

9 Scopus Citations
View graph of relations



Original languageEnglish
Pages (from-to)822-841
Journal / PublicationSIAM Journal on Imaging Sciences
Issue number2
Online published7 Jun 2016
Publication statusPublished - 2016
Externally publishedYes


In this paper, we present a conceptual design of a novel gesture-based instruction/input device using wave detection. The device recogonizes/detects gestures from a person and based on which gives the specific orders/inputs to the computing machine that is connected to it. The gestures are modeled as the shapes of some impenetrable or penetrable scatterers from a certain admissible class, called a dictionary. The device generates time-harmonic point signals for the gesture recognition/detection. It then collects the scattered wave in a relatively small backscattering aperture on a bounded surface containing the point sources. The recognition algorithm consists of two steps and requires only two incident waves of different wavenumbers. The approximate location of the scatterer is first determined by using the measured data at a small wavenumber and the shape of the scatterer is then identified using the computed location of the scatterer and the measured data at a regular wavenumber. We provide the mathematical principle with rigorous justifications underlying the design. Numerical experiments show that the proposed device works effectively and efficiently in some practical scenarios. © 2016, Society for Industrial and Applied Mathematics.

Research Area(s)

  • gesture recognition, instruction/input device, inverse scattering, wave propagation

Citation Format(s)