Facial Position and Expression-Based Human-Computer Interface for Persons With Tetraplegia

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

22 Scopus Citations
View graph of relations

Author(s)

  • Zhen-Peng Bian
  • Junhui Hou
  • Lap-Pui Chau
  • Nadia Magnenat-Thalmann

Detail(s)

Original languageEnglish
Article number7058374
Pages (from-to)915-924
Journal / PublicationIEEE Journal of Biomedical and Health Informatics
Volume20
Issue number3
Online published11 Mar 2015
Publication statusPublished - May 2016
Externally publishedYes

Abstract

A human-computer interface (namely Facial position and expression Mouse system, FM) for the persons with tetraplegia based on a monocular infrared depth camera is presented in this paper. The nose position along with the mouth status (close/open) is detected by the proposed algorithm to control and navigate the cursor as computer user input. The algorithm is based on an improved Randomized Decision Tree, which is capable of detecting the facial information efficiently and accurately. A more comfortable user experience is achieved by mapping the nose motion to the cursor motion via a nonlinear function. The infrared depth camera enables the system to be independent of illumination and color changes both from the background and on human face, which is a critical advantage over RGB camera-based options. Extensive experimental results show that the proposed system outperforms existing assistive technologies in terms of quantitative and qualitative assessments.

Research Area(s)

  • assistive technology (AT), Camera mouse, computer access., Fitts' law, hand-free control, humancomputer interaction (HCI), perceptual user interface, severe disabilities

Citation Format(s)

Facial Position and Expression-Based Human-Computer Interface for Persons With Tetraplegia. / Bian, Zhen-Peng; Hou, Junhui; Chau, Lap-Pui; Magnenat-Thalmann, Nadia.

In: IEEE Journal of Biomedical and Health Informatics, Vol. 20, No. 3, 7058374, 05.2016, p. 915-924.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review