GASLA : Enhancing the Applicability of Sign Language Translation

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

View graph of relations

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publicationIEEE INFOCOM 2022 - IEEE Conference on Computer Communications
PublisherInstitute of Electrical and Electronics Engineers, Inc.
Pages1249-1258
ISBN (electronic)978-1-6654-5822-1
ISBN (print)978-1-6654-5823-8
Publication statusPublished - 2022

Publication series

NameProceedings - IEEE INFOCOM
ISSN (Print)0743-166X
ISSN (electronic)2641-9874

Conference

Title41st IEEE International Conference on Computer Communications (IEEE INFOCOM 2022)
LocationVirtual
PlaceUnited Kingdom
CityLondon
Period2 - 5 May 2022

Abstract

This paper studies an important yet overlooked applicability issue in existing American sign language (ASL) translation systems. With excessive sensing data collected for each ASL word already, current designs treat every to-be-recognized sentence as new and collect their sensing data from scratch, while the amounts of sentences and the data samples per sentence are large usually. It takes a long time to complete the data collection for each single user, e.g., hours to a half day, which brings non-trivial burden to the end users inevitably and prevents the broader adoption of the ASL systems in practice. In this paper, we figure out the reason causing this issue. We present GASLA atop the wearable sensors to instrument our design. With GASLA, the sentence-level sensing data can be generated from the word-level data automatically, which can be then applied to train ASL systems. Moreover, GASLA has a clear interface to be integrated to existing ASL systems for overhead reduction directly. With this ability, sign language translation could become highly lightweight in both initial setup and future new-sentence addition. Compared with around 10 per-sentence data samples in current systems, GASLA requires 2–3 samples to achieve a similar performance.

Citation Format(s)

GASLA: Enhancing the Applicability of Sign Language Translation. / Li, Jiao; Liu, Yang; Xu, Weitao et al.
IEEE INFOCOM 2022 - IEEE Conference on Computer Communications. Institute of Electrical and Electronics Engineers, Inc., 2022. p. 1249-1258 (Proceedings - IEEE INFOCOM).

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review