CCESK : A Chinese Character Educational System Based on Kinect

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal

1 Scopus Citations
View graph of relations

Author(s)

  • Yang Yang
  • Hubert P. H. Shum
  • Jiao Li
  • Lanling Zeng
  • Nauman Aslam
  • Zhigeng Pan

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)342-347
Journal / PublicationIEEE Transactions on Learning Technologies
Volume11
Issue number3
Online published11 Jul 2017
Publication statusPublished - Jul 2018

Abstract

In this paper, a Chinese character educational system based on Kinect is proposed for guiding beginners to learn the basics of Chinese characters in a more intuitive way. It extracts 19 common components, denoted as alphabets, from Chinese characters. 19 postures were designed according to the shapes of these alphabets. Instead of memorizing Chinese characters through repetitive copying, students can first associate an alphabet with the corresponding designed posture. Then they break down a Chinese character into a set of alphabets in order to perform the sequence of corresponding postures so that they can easily remember the whole character. Our proposed system contains 2 major functions: 1) the learning function that is responsible for delivering the courseware, and 2) the testing function that is used to let students acquire their learning progress through some tests. A rule-based algorithm is designed to recognize the students' input postures captured from the Kinect motion sensor so as to determine whether the students have performed the correct postures. We conducted a survey which involved 90 students to try our proposed system as well as two other learning modes for comparison. Moreover, we have interviewed those 30 students who had tried our proposed system with some open-ended questions. The positive results show that the proposed system can promote students' experiences in learning Chinese characters.

Research Area(s)

  • Computer-aided instruction, courseware, posture recognition, student experiments

Citation Format(s)

CCESK : A Chinese Character Educational System Based on Kinect. / Yang, Yang; Leung, Howard; P. H. Shum, Hubert; Li, Jiao; Zeng, Lanling; Aslam, Nauman; Pan, Zhigeng.

In: IEEE Transactions on Learning Technologies, Vol. 11, No. 3, 07.2018, p. 342-347.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal