On the use of commonsense ontology for multimedia event recounting
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 73-88 |
Journal / Publication | International Journal of Multimedia Information Retrieval |
Volume | 5 |
Issue number | 2 |
Online published | 30 Nov 2015 |
Publication status | Published - Jun 2016 |
Link(s)
Abstract
Textually narrating the observed evidences relevant to the reasons why a video clip is being retrieved for an event is still a highly challenging problem. This paper explores the use of a commonsense ontology, namely ConceptNet, in generating short descriptions for recounting the audio–visual evidences. The ontology is exploited as a knowledge engine to provide event–relevant common sense, which is expressed in terms of concepts and their relationships, for semantics understanding, context-based concept screening and sentence synthesis. A principal way of exploiting the ontology, from extracting the event–relevant semantic network to the formation of syntactic parse trees, is outlined and discussed. Experimental results on two benchmark datasets (TRECVID MED and MediaEval) show the effectiveness of our approach. The findings show insights on the usability of common sense for multimedia search, including the feasibility of inferring relevant concepts for event detection, as well as the quality of textual sentences in meeting human expectation.
Research Area(s)
- Event detection, Event recounting, Ontology
Citation Format(s)
On the use of commonsense ontology for multimedia event recounting. / Tan, Chun-Chet; Ngo, Chong-Wah.
In: International Journal of Multimedia Information Retrieval, Vol. 5, No. 2, 06.2016, p. 73-88.
In: International Journal of Multimedia Information Retrieval, Vol. 5, No. 2, 06.2016, p. 73-88.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review