Gesture recognition for interactive controllers using MEMS motion sensors

Shengli Zhou, Qing Shan, Fei Fei, Wen J. Li*, Chung Ping Kwong, Patrick C. K. Wu, Bojun Meng, Christina K. H. Chan, Jay Y. J. Liou

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

54 Citations (Scopus)

Abstract

In this paper we present our work on real-time human gesture recognition for multimedia interactive controllers through the use of Microelectromechanical Systems (MEMS) 3 axes acceleration sensors. The changes of accelerations in three perpendicular directions due to different gesture motions are detected in real-time by 3-axes MEMS accelerometer embedded in a wireless micro sensing mote, which exports sensor data to a PC via Bluetooth protocol. In the data collection stage, in order to realize real-time recognition, an "auto-cut" algorithm was developed to gather the start and stop motions of an input gesture automatically. After comparing several different data processing methods, we chose Discrete Cosine Transforms (DCT) to reduce the dimension of the input gestures. Subsequently, a series of experiments were performed to analyze the influence of sensor sampling frequency and the number of dominant frequencies for various gestures, and then the best combination was selected for our recognition experiments. Finally, the Hidden Markov Model (HMM) was employed to achieve real-time gesture recognition. We have shown that the gesture recognition accuracy could reach 95.7% when 20 training samples of each gesture and 70 testing samples were used. © 2009 IEEE.
Original languageEnglish
Title of host publication4th IEEE International Conference on Nano/Micro Engineered and Molecular Systems, NEMS 2009
Pages935-940
DOIs
Publication statusPublished - 2009
Externally publishedYes
Event4th IEEE International Conference on Nano/Micro Engineered and Molecular Systems, NEMS 2009 - Shenzhen, China
Duration: 5 Jan 20098 Jan 2009

Conference

Conference4th IEEE International Conference on Nano/Micro Engineered and Molecular Systems, NEMS 2009
PlaceChina
CityShenzhen
Period5/01/098/01/09

Research Keywords

  • Gesture recognition
  • Hidden Markove model
  • Interactive controller
  • MEMS accelerometer

Fingerprint

Dive into the research topics of 'Gesture recognition for interactive controllers using MEMS motion sensors'. Together they form a unique fingerprint.

Cite this