Triboelectric Bending Sensors for AI-Enabled Sign Language Recognition

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

4 Citations (Scopus)
8 Downloads (CityUHK Scholars)

Abstract

Human–machine interfaces and wearable electronics, as fundamentals to achieve human-machine interactions, are becoming increasingly essential in the era of the Internet of Things. However, contemporary wearable sensors based on resistive and capacitive mechanisms demand an external power, impeding them from extensive and diverse deployment. Herein, a smart wearable system is developed encompassing five arch-structured self-powered triboelectric sensors, a five-channel data acquisition unit to collect finger bending signals, and an artificial intelligence (AI) methodology, specifically a long short-term memory (LSTM) network, to recognize signal patterns. A slider-crank mechanism that precisely controls the bending angle is designed to quantitively assess the sensor's performance. Thirty signal patterns of sign language of each letter are collected and analyzed after the environment noise and cross-talks among different channels are reduced and removed, respectively, by leveraging low pass filters. Two LSTM models are trained using different training sets, and four indexes are introduced to evaluate their performance, achieving a recognition accuracy of 96.15%. This work demonstrates a novel integration of triboelectric sensors with AI for sign language recognition, paving a new application avenue of triboelectric sensors in wearable electronics. © 2025 The Author(s). Advanced Science published by Wiley-VCH GmbH.
Original languageEnglish
Article number2408384
JournalAdvanced Science
Volume12
Issue number8
Online published7 Jan 2025
DOIs
Publication statusPublished - 24 Feb 2025

Funding

This work was supported by the National Natural Science Foundation of China (Grant no. 22072125) and City University of Hong Kong (Grant Nos. 7030009 and 9610609).

Research Keywords

  • long short-term memory
  • pattern recognition
  • smart wearable system
  • triboelectric bending sensor

Publisher's Copyright Statement

  • This full text is made available under CC-BY 4.0. https://creativecommons.org/licenses/by/4.0/

Fingerprint

Dive into the research topics of 'Triboelectric Bending Sensors for AI-Enabled Sign Language Recognition'. Together they form a unique fingerprint.

Cite this