Hierarchical Visualization of Video Search Results for Topic-based Browsing

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

14 Scopus Citations
View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Article number7579193
Pages (from-to)2161-2170
Journal / PublicationIEEE Transactions on Multimedia
Volume18
Issue number11
Online published28 Sept 2016
Publication statusPublished - Nov 2016

Abstract

Existing video search engines return a ranked list of videos for each user query, which is not convenient for browsing the results of query topics that have multiple facets, such as the 'early life', 'personal life' and 'presidency' of a query 'Barack Obama'. Organizing video search results into semantically structured hierarchies with nodes covering different topic facets can significantly improve the browsing efficiency for such kind of queries. In this paper, we introduce a hierarchical visualization approach for video search result browsing, which can help users quickly understand multiple facets of a query topic in a very well organized manner. Given a query, our approach starts from the hierarchy of its textual descriptions normally available on Wikipedia, and then adjusts the hierarchical structure by analyzing video information to reflect the topic structure of the search result. After that, a simple optimization problem is formulated to perform video-to-node association considering three important criteria. Furthermore, additional topic facets are mined to complement the contents of the existing semantic hierarchies. A large YouTube video dataset is constructed to evaluate our approach both quantitatively and qualitatively. A demo system is also developed for users to interact with the proposed browsing approach.

Research Area(s)

  • hierarchical structure, Search result visualization, video search, visual analysis

Citation Format(s)

Hierarchical Visualization of Video Search Results for Topic-based Browsing. / Jiang, Yu-Gang; Wang, Jiajun; Wang, Qiang et al.
In: IEEE Transactions on Multimedia, Vol. 18, No. 11, 7579193, 11.2016, p. 2161-2170.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review