TipText: Eyes-Free Text Entry on a Fingertip Keyboard

Zheer Xu; Pui Chung Wong; Jun Gong; Te-Yen Wu; Aditya Shekhar Nittala; Xiaojun Bi; Jürgen Steimle; Hongbo Fu; Kening Zhu; Xing-Dong Yang

doi:10.1145/3332165.3347865

TipText: Eyes-Free Text Entry on a Fingertip Keyboard

Zheer Xu, Pui Chung Wong, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jürgen Steimle, Hongbo Fu, Kening Zhu, Xing-Dong Yang

School of Creative Media

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

87 Citations (Scopus)

Abstract

In this paper, we propose and investigate a new text entry technique using micro thumb-tip gestures. Our technique features a miniature QWERTY keyboard residing invisibly on the first segment of the user’s index finger. Text entry can be carried out using the thumb-tip to tap the tip of the index finger. The keyboard layout was optimized for eyes-free input by utilizing a spatial model reflecting the users’ natural spatial awareness of key locations on the index finger. We present our approach of designing and optimizing the keyboard layout through a series of user studies and computer simulated text entry tests over 1,146,484 possibilities in the design space. The outcome is a 2×3 grid with the letters highly confining to the alphabetic and spatial arrangement of QWERTY. Our user evaluation showed that participants achieved an average text entry speed of 11.9 WPM and were able to type as fast as 13.3 WPM towards the end of the experiment.

Original language	English
Title of host publication	UIST 2019
Subtitle of host publication	Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology
Publisher	Association for Computing Machinery
Pages	883-899
Number of pages	17
ISBN (Print)	978-1-4503-6816-2
DOIs	https://doi.org/10.1145/3332165.3347865
Publication status	Published - Oct 2019
Event	32nd Annual ACM Symposium on User Interface Software and Technology, UIST 2019 - New Orleans, United States Duration: 20 Oct 2019 → 23 Oct 2019 http://uist.acm.org/uist2019/

Publication series

Name	UIST - Proceedings of the Annual ACM Symposium on User Interface Software and Technology

Conference

Conference	32nd Annual ACM Symposium on User Interface Software and Technology, UIST 2019
Place	United States
City	New Orleans
Period	20/10/19 → 23/10/19
Internet address	http://uist.acm.org/uist2019/

Bibliographical note

Research Unit(s) information for this publication is provided by the author(s) concerned.

Research Keywords

Micro thumb-tip gesture
text entry
wearable

Access Output

10.1145/3332165.3347865

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Xu, Z., Wong, P. C., Gong, J., Wu, T.-Y., Nittala, A. S., Bi, X., Steimle, J., Fu, H., Zhu, K., & Yang, X.-D. (2019). TipText: Eyes-Free Text Entry on a Fingertip Keyboard. In UIST 2019: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (pp. 883-899). (UIST - Proceedings of the Annual ACM Symposium on User Interface Software and Technology). Association for Computing Machinery. https://doi.org/10.1145/3332165.3347865

@inproceedings{f8e80482d63841bfbf5a51aa95739461,

title = "TipText: Eyes-Free Text Entry on a Fingertip Keyboard",

abstract = "In this paper, we propose and investigate a new text entry technique using micro thumb-tip gestures. Our technique features a miniature QWERTY keyboard residing invisibly on the first segment of the user{\textquoteright}s index finger. Text entry can be carried out using the thumb-tip to tap the tip of the index finger. The keyboard layout was optimized for eyes-free input by utilizing a spatial model reflecting the users{\textquoteright} natural spatial awareness of key locations on the index finger. We present our approach of designing and optimizing the keyboard layout through a series of user studies and computer simulated text entry tests over 1,146,484 possibilities in the design space. The outcome is a 2×3 grid with the letters highly confining to the alphabetic and spatial arrangement of QWERTY. Our user evaluation showed that participants achieved an average text entry speed of 11.9 WPM and were able to type as fast as 13.3 WPM towards the end of the experiment.",

keywords = "Micro thumb-tip gesture, text entry, wearable",

author = "Zheer Xu and Wong, {Pui Chung} and Jun Gong and Te-Yen Wu and Nittala, {Aditya Shekhar} and Xiaojun Bi and J{\"u}rgen Steimle and Hongbo Fu and Kening Zhu and Xing-Dong Yang",

note = "Research Unit(s) information for this publication is provided by the author(s) concerned.; 32nd Annual ACM Symposium on User Interface Software and Technology, UIST 2019 ; Conference date: 20-10-2019 Through 23-10-2019",

year = "2019",

month = oct,

doi = "10.1145/3332165.3347865",

language = "English",

isbn = "978-1-4503-6816-2",

series = "UIST - Proceedings of the Annual ACM Symposium on User Interface Software and Technology",

publisher = "Association for Computing Machinery",

pages = "883--899",

booktitle = "UIST 2019",

address = "United States",

url = "http://uist.acm.org/uist2019/",

}

Xu, Z, Wong, PC, Gong, J, Wu, T-Y, Nittala, AS, Bi, X, Steimle, J, Fu, H , Zhu, K & Yang, X-D 2019, TipText: Eyes-Free Text Entry on a Fingertip Keyboard. in UIST 2019: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. UIST - Proceedings of the Annual ACM Symposium on User Interface Software and Technology, Association for Computing Machinery, pp. 883-899, 32nd Annual ACM Symposium on User Interface Software and Technology, UIST 2019, New Orleans, Louisiana, United States, 20/10/19. https://doi.org/10.1145/3332165.3347865

TipText: Eyes-Free Text Entry on a Fingertip Keyboard. / Xu, Zheer; Wong, Pui Chung; Gong, Jun et al.
UIST 2019: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, 2019. p. 883-899 (UIST - Proceedings of the Annual ACM Symposium on User Interface Software and Technology).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - TipText

T2 - 32nd Annual ACM Symposium on User Interface Software and Technology, UIST 2019

AU - Xu, Zheer

AU - Wong, Pui Chung

AU - Gong, Jun

AU - Wu, Te-Yen

AU - Nittala, Aditya Shekhar

AU - Bi, Xiaojun

AU - Steimle, Jürgen

AU - Fu, Hongbo

AU - Zhu, Kening

AU - Yang, Xing-Dong

N1 - Research Unit(s) information for this publication is provided by the author(s) concerned.

PY - 2019/10

Y1 - 2019/10

N2 - In this paper, we propose and investigate a new text entry technique using micro thumb-tip gestures. Our technique features a miniature QWERTY keyboard residing invisibly on the first segment of the user’s index finger. Text entry can be carried out using the thumb-tip to tap the tip of the index finger. The keyboard layout was optimized for eyes-free input by utilizing a spatial model reflecting the users’ natural spatial awareness of key locations on the index finger. We present our approach of designing and optimizing the keyboard layout through a series of user studies and computer simulated text entry tests over 1,146,484 possibilities in the design space. The outcome is a 2×3 grid with the letters highly confining to the alphabetic and spatial arrangement of QWERTY. Our user evaluation showed that participants achieved an average text entry speed of 11.9 WPM and were able to type as fast as 13.3 WPM towards the end of the experiment.

AB - In this paper, we propose and investigate a new text entry technique using micro thumb-tip gestures. Our technique features a miniature QWERTY keyboard residing invisibly on the first segment of the user’s index finger. Text entry can be carried out using the thumb-tip to tap the tip of the index finger. The keyboard layout was optimized for eyes-free input by utilizing a spatial model reflecting the users’ natural spatial awareness of key locations on the index finger. We present our approach of designing and optimizing the keyboard layout through a series of user studies and computer simulated text entry tests over 1,146,484 possibilities in the design space. The outcome is a 2×3 grid with the letters highly confining to the alphabetic and spatial arrangement of QWERTY. Our user evaluation showed that participants achieved an average text entry speed of 11.9 WPM and were able to type as fast as 13.3 WPM towards the end of the experiment.

KW - Micro thumb-tip gesture

KW - text entry

KW - wearable

UR - http://www.scopus.com/inward/record.url?scp=85074848036&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85074848036&origin=recordpage

U2 - 10.1145/3332165.3347865

DO - 10.1145/3332165.3347865

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 978-1-4503-6816-2

T3 - UIST - Proceedings of the Annual ACM Symposium on User Interface Software and Technology

SP - 883

EP - 899

BT - UIST 2019

PB - Association for Computing Machinery

Y2 - 20 October 2019 through 23 October 2019

ER -

Xu Z, Wong PC, Gong J, Wu TY, Nittala AS, Bi X et al. TipText: Eyes-Free Text Entry on a Fingertip Keyboard. In UIST 2019: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery. 2019. p. 883-899. (UIST - Proceedings of the Annual ACM Symposium on User Interface Software and Technology). doi: 10.1145/3332165.3347865

TipText: Eyes-Free Text Entry on a Fingertip Keyboard

Abstract

Publication series

Conference

Bibliographical note

Research Keywords

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this