Bootstrapping Social Emotion Classification with Semantically Rich Hybrid Neural Networks

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

51 Scopus Citations
View graph of relations

Author(s)

  • Xiangsheng Li
  • Yanghui Rao
  • Haoran Xie
  • Jian Yin
  • Fu Lee Wang

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)428-442
Journal / PublicationIEEE Transactions on Affective Computing
Volume8
Issue number4
Online published18 Jun 2017
Publication statusPublished - Oct 2017

Abstract

Social emotion classification aims to predict the aggregation of emotional responses embedded in online comments contributed by various users. Such a task is inherently challenging because extracting relevant semantics from free texts is a classical research problem. Moreover, online comments are typically characterized by a sparse feature space, which makes the corresponding emotion classification task very difficult. On the other hand, though deep neural networks have been shown to be effective for speech recognition and image analysis tasks because of their capabilities of transforming sparse low-level features to dense high-level features, their effectiveness on emotion classification requires further investigation. The main contribution of our work reported in this paper is the development of a novel model of semantically rich hybrid neural network (HNN) which leverages unsupervised teaching models to incorporate semantic domain knowledge into the neural network to bootstrap its inference power and interpretability. To our best knowledge, this is the first successful work of incorporating semantics into neural networks to enhance social emotion classification and network interpretability. Through empirical studies based on three real-world social media datasets, our experimental results confirm that the proposed hybrid neural networks outperform other state-of-the-art emotion classification methods.

Research Area(s)

  • hybrid neural network, Social emotion classification, sparse encoding, transfer learning

Citation Format(s)

Bootstrapping Social Emotion Classification with Semantically Rich Hybrid Neural Networks. / Li, Xiangsheng; Rao, Yanghui; Xie, Haoran et al.
In: IEEE Transactions on Affective Computing, Vol. 8, No. 4, 10.2017, p. 428-442.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review