Skip to main navigation Skip to search Skip to main content

1D-Touch: NLP-Assisted Coarse Text Selection via a Semi-Direct Gesture

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

53 Downloads (CityUHK Scholars)

Abstract

Existing text selection techniques on touchscreen focus on improving the control for moving the carets. Coarse-grained text selection on word and phrase levels has not received much support beyond word-snapping and entity recognition. We introduce 1D-Touch, a novel text selection method that complements the carets-based sub-word selection by facilitating the selection of semantic units of words and above. This method employs a simple vertical slide gesture to expand and contract a selection area from a word. The expansion can be by words or by semantic chunks ranging from sub-phrases to sentences. This technique shifts the concept of text selection, from defining a range by locating the first and last words, towards a dynamic process of expanding and contracting a textual semantic entity. To understand the effects of our approach, we prototyped and tested two variants: WordTouch, which offers a straightforward word-by-word expansion, and ChunkTouch, which leverages NLP to chunk text into syntactic units, allowing the selection to grow by semantically meaningful units in response to the sliding gesture. Our evaluation, focused on the coarse-grained selection tasks handled by 1D-Touch, shows a 20% improvement over the default word-snapping selection method on Android. © 2023 Owner/Author.
Original languageEnglish
Pages (from-to)463-482
JournalProceedings of the ACM on Human-Computer Interaction
Volume7
Issue numberISS
Online published1 Nov 2023
DOIs
Publication statusPublished - Dec 2023

Funding

This research was supported by the Hong Kong Research Grants Council - ECS scheme under project number CityU 21209419. We thank Shumin Zhai from Google LLC for the insightful discussions. We thank our reviewers for their constructive feedback.

Research Keywords

  • Natural Language Processing
  • Text selection
  • Touch interface

Publisher's Copyright Statement

  • This full text is made available under CC-BY 4.0. https://creativecommons.org/licenses/by/4.0/

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of '1D-Touch: NLP-Assisted Coarse Text Selection via a Semi-Direct Gesture'. Together they form a unique fingerprint.

Cite this