Skip to main navigation Skip to search Skip to main content

Mobile search with multimodal queries

  • Xing Xie
  • , Lie Lu
  • , Menglei Jia
  • , Hua Li
  • , Frank Seide
  • , Wei-Ying Ma

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

The popularity of mobile devices, such as PDAs and SmartPhones, has grown rapidly over the last couple of years. Though most users still perform searches using desktop computers, it is expected that more and more people will also search the Web while they are on the move. In addition to text-based keyword queries, mobile devices can support richer and hybrid queries such as images, audio, video, and their combinations. In this paper, we will discuss mobile search systems that support image queries and audio queries, covering typical designs for mobile visual and audio search, as well as the opportunities and challenges. Specifically, we will present an in-depth study of two real systems we have developed: product image categorization and mobile ringtone search, which use image queries and audio queries, respectively. Experimental results on real-life data demonstrate their effectiveness and efficiency. © 2008 IEEE.
Original languageEnglish
Article number4469877
Pages (from-to)589-601
JournalProceedings of the IEEE
Volume96
Issue number4
DOIs
Publication statusPublished - Apr 2008
Externally publishedYes

Bibliographical note

Publication details (e.g. title, author(s), publication statuses and dates) are captured on an “AS IS” and “AS AVAILABLE” basis at the time of record harvesting from the data source. Suggestions for further amendments or supplementary information can be sent to [email protected].

Research Keywords

  • Content-based image retrieval (CBIR)
  • High-dimensional indexing
  • Image categorization
  • Information retrieval
  • Mobile search
  • Query by humming (QBH)
  • Ringtone search
  • Voice search

Policy Impact

  • Cited in Policy Documents

Fingerprint

Dive into the research topics of 'Mobile search with multimodal queries'. Together they form a unique fingerprint.

Cite this