Infusing a Convolutional Neural Network with Encoded Joint Node Image Data to Recognize 25 Daily Human Activities

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

1 Scopus Citations
View graph of relations

Author(s)

  • Yuliang Zhao
  • Tianang Sun
  • Zhongjie Ju
  • Fanghecong Dong
  • Le Yang
  • Xiaoyong Lv
  • Chao Lian

Related Research Unit(s)

Detail(s)

Original languageEnglish
Article number2300266
Journal / PublicationAdvanced Intelligent Systems
Publication statusOnline published - 21 Aug 2023

Abstract

Human activity recognition (HAR) has gained popularity in the field of computer vision such as video surveillance, security, and virtual reality. However, traditional methods are limited in terms of computations and holistic learning of human skeletal sequences. In this article, a new time-series skeleton joint data imaging method is infused into an improved convolutional neural network to handle these problems. First, the raw time-series data of 33 body nodes are transformed to red–green–blue images by encoding the 3D positional information to one pixel. Second, the LeNet-5 network is enhanced by expanding the receptive field, introducing coordinate attention and the smooth maximum unit to improve smoothness and feature extraction. Third, the ability of coded images to express human activities is studied in various environments. It is shown in the experimental results that the method achieves an impressive accuracy of 98.02% in recognizing 25 daily human activities, such as running, writing, and walking. In addition, it is shown that the number of floating point operations, parameters, and inference time of the method are 0.08%, 0.47%, and 3.05%, respectively, of the average values for six other networks (including AlexNet, GoogLeNet, and MobileNet). The proposed method is thus a novel, lightweight, and high-precision solution for HAR. © 2023 The Authors. Advanced Intelligent Systems published by Wiley-VCH GmbH.

Research Area(s)

  • convolutional neural network, human activity recognition, image processing

Citation Format(s)

Infusing a Convolutional Neural Network with Encoded Joint Node Image Data to Recognize 25 Daily Human Activities. / Zhao, Yuliang; Sun, Tianang; Ju, Zhongjie et al.
In: Advanced Intelligent Systems, 21.08.2023.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review