Concept-based interactive search system

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)peer-review

15 Scopus Citations
View graph of relations

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publicationMultiMedia Modeling
Subtitle of host publication23rd International Conference, MMM 2017, Proceedings
EditorsCathal Gurrin, Björn Thór Jónsson, Laurent Amsaleg, Shin’ichi Satoh, Gylfi Thór Gudmundsson
PublisherSpringer Verlag
Pages463-468
Volume10133 LNCS
ISBN (Print)9783319518138
Publication statusPublished - 31 Dec 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10133 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Title23rd International Conference on MultiMedia Modeling, MMM 2017
PlaceIceland
CityReykjavik
Period4 - 6 January 2017

Abstract

Our successful multimedia event detection system at TRECVID 2015 showed its strength on handling complex concepts in a query. The system was based on a large number of pre-trained concept detectors for textual-to-visual relation. In this paper, we enhance the system by enabling human-in-the-loop. In order to facilitate a user to quickly find an information need, we incorporate concept screening, video reranking by highlighted concepts, relevance feedback and color sketch to refine a coarse retrieval result. The aim is to eventually come up with a system suitable for both Ad-hoc Video Search and Known-Item Search. In addition, as the increasing awareness of difficulty in distinguishing shots of very similar scenes, we also explore the automatic story annotation along the timeline of a video, so that a user can quickly grasp the story happened in the context of a target shot and reject shots with incorrect context. With the story annotation, a user can refine the search result as well by simply adding a few keywords in a special “context field” of a query.

Research Area(s)

  • Concept bank, Known-item search, Semantic query, Story annotation, Video reranking, Video search

Citation Format(s)

Concept-based interactive search system. / Lu, Yi-Jie; Nguyen, Phuong Anh; Zhang, Hao; Ngo, Chong-Wah.

MultiMedia Modeling: 23rd International Conference, MMM 2017, Proceedings. ed. / Cathal Gurrin; Björn Thór Jónsson; Laurent Amsaleg; Shin’ichi Satoh; Gylfi Thór Gudmundsson. Vol. 10133 LNCS Springer Verlag, 2016. p. 463-468 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10133 LNCS).

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)peer-review