Glove-based hand gesture recognition sign language translator using capacitive touch sensor

Kalpattu S. Abhishek; Lee Chun Fai Qubeley; Derek Ho

doi:10.1109/EDSSC.2016.7785276

Glove-based hand gesture recognition sign language translator using capacitive touch sensor

Kalpattu S. Abhishek
, Lee Chun Fai Qubeley
, Derek Ho^*

^*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

106 Citations (Scopus)

Abstract

The sign language translator is a bridge between those who comprehend sign languages and those who do not which is the majority of humanity. However, conventional signa language translators are bulky and expensive, limiting their wide adoption. In this paper, we present a gesture recognition glove based on charge-transfer touch sensors for the translation of the American Sign Language. The device is portable and can be implemented with low-cost hardware. The prototype recognize gestures for the numbers 0 to 9 and the 26 English alphabets, A to Z. The glove experimentally achieved, based on 1080 trials, an overall detection accuracies of over 92 %, which is comparable with current high-end counterparts. The proposed device i expected to bridge the communication gap between the hearing and speech impaired and members of the general public.

Original language	English
Title of host publication	2016 IEEE International Conference on Electron Devices and Solid-State Circuits, EDSSC 2016
Publisher	IEEE
Pages	334-337
ISBN (Print)	9781509018307
DOIs	https://doi.org/10.1109/EDSSC.2016.7785276
Publication status	Published - 15 Dec 2016
Event	2016 IEEE International Conference on Electron Devices and Solid-State Circuits, EDSSC 2016 - Hong Kong, Hong Kong, China Duration: 3 Aug 2016 → 5 Aug 2016

Conference

Conference	2016 IEEE International Conference on Electron Devices and Solid-State Circuits, EDSSC 2016
Place	Hong Kong, China
City	Hong Kong
Period	3/08/16 → 5/08/16

Funding

This work was funded by the City University of Hong Kong, grant no. 6000559.

Research Keywords

Glove
gesture recognition
sign language translator
capacitive sensor
portable

Access Output

10.1109/EDSSC.2016.7785276

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

@inproceedings{4c445689591d424fb957181b34f4138e,

title = "Glove-based hand gesture recognition sign language translator using capacitive touch sensor",

abstract = "The sign language translator is a bridge between those who comprehend sign languages and those who do not which is the majority of humanity. However, conventional signa language translators are bulky and expensive, limiting their wide adoption. In this paper, we present a gesture recognition glove based on charge-transfer touch sensors for the translation of the American Sign Language. The device is portable and can be implemented with low-cost hardware. The prototype recognize gestures for the numbers 0 to 9 and the 26 English alphabets, A to Z. The glove experimentally achieved, based on 1080 trials, an overall detection accuracies of over 92 \%, which is comparable with current high-end counterparts. The proposed device i expected to bridge the communication gap between the hearing and speech impaired and members of the general public.",

keywords = "Glove, gesture recognition, sign language translator, capacitive sensor, portable",

author = "Abhishek, \{Kalpattu S.\} and Qubeley, \{Lee Chun Fai\} and Derek Ho",

year = "2016",

month = dec,

day = "15",

doi = "10.1109/EDSSC.2016.7785276",

language = "English",

isbn = "9781509018307",

pages = "334--337",

booktitle = "2016 IEEE International Conference on Electron Devices and Solid-State Circuits, EDSSC 2016",

publisher = "IEEE",

address = "United States",

note = "2016 IEEE International Conference on Electron Devices and Solid-State Circuits, EDSSC 2016 ; Conference date: 03-08-2016 Through 05-08-2016",

}

Abhishek, KS, Qubeley, LCF & Ho, D 2016, Glove-based hand gesture recognition sign language translator using capacitive touch sensor. in 2016 IEEE International Conference on Electron Devices and Solid-State Circuits, EDSSC 2016., 7785276, IEEE, pp. 334-337, 2016 IEEE International Conference on Electron Devices and Solid-State Circuits, EDSSC 2016, Hong Kong, Hong Kong, China, 3/08/16. https://doi.org/10.1109/EDSSC.2016.7785276

Glove-based hand gesture recognition sign language translator using capacitive touch sensor. / Abhishek, Kalpattu S.; Qubeley, Lee Chun Fai; Ho, Derek.
2016 IEEE International Conference on Electron Devices and Solid-State Circuits, EDSSC 2016. IEEE, 2016. p. 334-337 7785276.

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - Glove-based hand gesture recognition sign language translator using capacitive touch sensor

AU - Abhishek, Kalpattu S.

AU - Qubeley, Lee Chun Fai

AU - Ho, Derek

PY - 2016/12/15

Y1 - 2016/12/15

N2 - The sign language translator is a bridge between those who comprehend sign languages and those who do not which is the majority of humanity. However, conventional signa language translators are bulky and expensive, limiting their wide adoption. In this paper, we present a gesture recognition glove based on charge-transfer touch sensors for the translation of the American Sign Language. The device is portable and can be implemented with low-cost hardware. The prototype recognize gestures for the numbers 0 to 9 and the 26 English alphabets, A to Z. The glove experimentally achieved, based on 1080 trials, an overall detection accuracies of over 92 %, which is comparable with current high-end counterparts. The proposed device i expected to bridge the communication gap between the hearing and speech impaired and members of the general public.

AB - The sign language translator is a bridge between those who comprehend sign languages and those who do not which is the majority of humanity. However, conventional signa language translators are bulky and expensive, limiting their wide adoption. In this paper, we present a gesture recognition glove based on charge-transfer touch sensors for the translation of the American Sign Language. The device is portable and can be implemented with low-cost hardware. The prototype recognize gestures for the numbers 0 to 9 and the 26 English alphabets, A to Z. The glove experimentally achieved, based on 1080 trials, an overall detection accuracies of over 92 %, which is comparable with current high-end counterparts. The proposed device i expected to bridge the communication gap between the hearing and speech impaired and members of the general public.

KW - Glove

KW - gesture recognition

KW - sign language translator

KW - capacitive sensor

KW - portable

UR - https://www.scopus.com/pages/publications/85010607029

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85010607029&origin=recordpage

U2 - 10.1109/EDSSC.2016.7785276

DO - 10.1109/EDSSC.2016.7785276

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 9781509018307

SP - 334

EP - 337

BT - 2016 IEEE International Conference on Electron Devices and Solid-State Circuits, EDSSC 2016

PB - IEEE

T2 - 2016 IEEE International Conference on Electron Devices and Solid-State Circuits, EDSSC 2016

Y2 - 3 August 2016 through 5 August 2016

ER -

Glove-based hand gesture recognition sign language translator using capacitive touch sensor

Abstract

Conference

Funding

Research Keywords

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this