Infrared head pose estimation with multi-scales feature fusion on the IRHP database for human attention recognition

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

4 Scopus Citations
View graph of relations


  • Hai Liu
  • Xiang Wang
  • Wei Zhang
  • Zhaoli Zhang
  • You-Fu Li

Related Research Unit(s)


Original languageEnglish
Pages (from-to)510-520
Journal / PublicationNeurocomputing
Online published23 Jun 2020
Publication statusPublished - 21 Oct 2020


Head pose estimation (HPE) has been widely applied in human attention recognition, robot vision and assistant driving. Infrared (IR) images bear unique advantages of being still effective under visible scenarios, which are resistance to illumination changing and strong penetration. However, the lack of public IR database hinders the research progress in the low illumination environment. In this paper, we establish a first-of-its-kind infrared head pose (IRHP) database and propose a novel convolutional neural network architecture IRHP-Net on the IRHP database. The IRHP database contains 145 kinds of IR head pose images of subjects, and benchmark evaluations are conducted on our database by the facial features-based standard HPE classification methods to prove the usability and effectiveness of IRHP database. To extract the adaptive features for the IR images, a novel multi-scale feature fusion descriptor is developed in the proposed IRHP-Net model. Quantitative assessments of the proposed method on the IRHP images demonstrate the significant improvements over the traditional methods. The new proposed IRHP-Net model can be utilized in human attention recognition and intelligent driving assistant system.

Research Area(s)

  • Attention recognition, Convolutional neural network, Feature fusion, Head pose estimation, Infrared image