Automatic categorization of questions for user-interactive question answering

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

14 Scopus Citations
View graph of relations

Author(s)

  • Wanpeng Song
  • Liu Wenyin
  • Naijie Gu
  • Xiaojun Quan
  • Tianyong Hao

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)147-156
Journal / PublicationInformation Processing and Management
Volume47
Issue number2
Publication statusPublished - Mar 2011

Abstract

Question categorization, which suggests one of a set of predefined categories to a user's question according to the question's topic or content, is a useful technique in user-interactive question answering systems. In this paper, we propose an automatic method for question categorization in a user-interactive question answering system. This method includes four steps: feature space construction, topic-wise words identification and weighting, semantic mapping, and similarity calculation. We firstly construct the feature space based on all accumulated questions and calculate the feature vector of each predefined category which contains certain accumulated questions. When a new question is posted, the semantic pattern of the question is used to identify and weigh the important words of the question. After that, the question is semantically mapped into the constructed feature space to enrich its representation. Finally, the similarity between the question and each category is calculated based on their feature vectors. The category with the highest similarity is assigned to the question. The experimental results show that our proposed method achieves good categorization precision and outperforms the traditional categorization methods on the selected test questions. © 2010 Elsevier Ltd. All rights reserved.

Research Area(s)

  • Question answering, Question categorization, Text similarity calculation

Citation Format(s)

Automatic categorization of questions for user-interactive question answering. / Song, Wanpeng; Wenyin, Liu; Gu, Naijie et al.

In: Information Processing and Management, Vol. 47, No. 2, 03.2011, p. 147-156.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review