Understanding the role of eye movement consistency in face recognition and autism through integrating deep neural networks and hidden Markov models

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

11 Scopus Citations
View graph of relations

Author(s)

  • Janet H. Hsiao
  • Jeehye An
  • Veronica Kit Sum Hui
  • Yueyuan Zheng
  • Antoni B. Chan

Related Research Unit(s)

Detail(s)

Original languageEnglish
Article number28
Journal / Publicationnpj Science of Learning
Volume7
Online published25 Oct 2022
Publication statusPublished - 2022

Link(s)

Abstract

Greater eyes-focused eye movement pattern during face recognition is associated with better performance in adults but not in children. We test the hypothesis that higher eye movement consistency across trials, instead of a greater eyes-focused pattern, predicts better performance in children since it reflects capacity in developing visual routines. We first simulated visual routine development through combining deep neural network and hidden Markov model that jointly learn perceptual representations and eye movement strategies for face recognition. The model accounted for the advantage of eyes-focused pattern in adults, and predicted that in children (partially trained models) consistency but not pattern of eye movements predicted recognition performance. This result was then verified with data from typically developing children. In addition, lower eye movement consistency in children was associated with autism diagnosis, particularly autistic traits in social skills. Thus, children’s face recognition involves visual routine development through social exposure, indexed by eye movement consistency.

Research Area(s)

Citation Format(s)

Download Statistics

No data available