Towards a Virtual Keyboard Scheme Based on Wearing One Motion Sensor Ring on Each Hand

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

10 Scopus Citations
View graph of relations

Author(s)

  • Chao Lian
  • Xianshou Ren
  • Yuliang Zhao
  • Xueliang Zhang
  • Ruoyu Chen
  • Shuyu Wang
  • Xiaopeng Sha

Related Research Unit(s)

Detail(s)

Original languageEnglish
Article number9195851
Pages (from-to)3379-3387
Journal / PublicationIEEE Sensors Journal
Volume21
Issue number3
Online published14 Sept 2020
Publication statusPublished - 1 Feb 2021

Abstract

In this paper, we present an improved ring-type virtual keyboard scheme that can achieve impressive performance with only one smart ring on a finger of each hand. The smart ring integrates a 6-DoF Inertial Measurement Unit (IMU) and a 3-DoF magnetometer sensor for collecting motion data during typing. First, a new keyboard layout is designed, by changing the previous rectangular layout to an arc structure, this method increases the difference in attitude angle between adjacent keys, which greatly improved the keystroke recognition accuracy. Secondly, other than the attitude angle feature, we also adopt acceleration data, gyroscope data and magnetometer data to describe the subtle differences between different keystrokes motion. Then, feature importance evaluation and feature correlation analysis were used to select features with high contribution rate and low similarity to describe keystrokes. Finally, nine effective features were selected from the attitude angle and magnetometer data for the final keystroke recognition. By weighing the number of selected features, recognition speed and recognition accuracy of training models, the keystroke recognition speed can increase by nearly 4 times while ensuring 98.53% of the keystroke recognition accuracy. This new ring-type virtual keyboard input scheme has the advantages in portability, small volume, and lower cost over many existing human-computer interface methods.

Research Area(s)

  • Internet of things, machine learning, motion recognition, virtual keyboard, wearable sensors

Citation Format(s)

Towards a Virtual Keyboard Scheme Based on Wearing One Motion Sensor Ring on Each Hand. / Lian, Chao; Ren, Xianshou; Zhao, Yuliang et al.
In: IEEE Sensors Journal, Vol. 21, No. 3, 9195851, 01.02.2021, p. 3379-3387.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review