ImmerTai : Immersive Motion Learning in VR Environments

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalNot applicablepeer-review

View graph of relations

Author(s)

  • Xiaoming Chen
  • Zhibo Chen
  • Ye Li
  • Tianyu He
  • Sen Liu
  • Ying He

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)416-427
Journal / PublicationJournal of Visual Communication and Image Representation
Volume58
Early online date30 Nov 2018
StatePublished - Jan 2019

Abstract

Immersive learning in Virtual Reality (VR) environments is the developing trend for future education systems including remote physical training. This paper presents “ImmerTai” a system that is designed for effective remote motion training, particularly for Chinese Taichi, in an immersive way. With ImmerTai, the Taichi expert's motion is captured and delivered to remote students in CAVE, HMD and PC environments for learning. The students’ motions are also captured for motion quality assessment and a group of students can form a virtual collaborative learning scenario. We built up a Taichi motion dataset with ground truth of motion quality, and based on this, we developed and evaluated several motion quality assessment methods. Then, user tests were designed and carried out to measure and compare the learning outcomes (learning time, quality and overall efficiency) of students in Cave Automatic Virtual Environment (CAVE), Head Mounted Display (HMD) and Personal Computer (PC) environments. Meanwhile, the connections between students’ learning outcomes and their VR experience were investigated and discussed too. Our results show that ImmerTai can accelerate the learning process of students noticeably (up to 17%) compared to non-immersive learning with the conventional PC setup. However, we observed a substantial difference in the quality of the learnt motion between CAVE (26% gain) and HMD (23% drop) compared to PC (baseline). While strong VR presence can enhance the learning experience of students, their learning outcomes are not fully consistent to their experience. Overall, ImmerTai with CAVE demonstrated a significantly higher learning efficiency than other tested environments.

Research Area(s)

  • Immersive education, Motion training, VR education

Citation Format(s)

ImmerTai : Immersive Motion Learning in VR Environments. / Chen, Xiaoming; Chen, Zhibo; Li, Ye; He, Tianyu; Hou, Junhui; Liu, Sen; He, Ying.

In: Journal of Visual Communication and Image Representation, Vol. 58, 01.2019, p. 416-427.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalNot applicablepeer-review