RGBD Salient Object Detection via Deep Fusion

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

155 Scopus Citations
View graph of relations

Author(s)

  • Shengfeng He
  • Jiandong Tian
  • Yandong Tang
  • Qingxiong Yang

Detail(s)

Original languageEnglish
Article number7879320
Pages (from-to)2274-2285
Journal / PublicationIEEE Transactions on Image Processing
Volume26
Issue number5
Online published14 Mar 2017
Publication statusPublished - May 2017

Abstract

Numerous efforts have been made to design various low-level saliency cues for RGBD saliency detection, such as color and depth contrast features as well as background and color compactness priors. However, how these low-level saliency cues interact with each other and how they can be effectively incorporated to generate a master saliency map remain challenging problems. In this paper, we design a new convolutional neural network (CNN) to automatically learn the interaction mechanism for RGBD salient object detection. In contrast to existing works, in which raw image pixels are fed directly to the CNN, the proposed method takes advantage of the knowledge obtained in traditional saliency detection by adopting various flexible and interpretable saliency feature vectors as inputs. This guides the CNN to learn a combination of existing features to predict saliency more effectively, which presents a less complex problem than operating on the pixels directly. We then integrate a superpixel-based Laplacian propagation framework with the trained CNN to extract a spatially consistent saliency map by exploiting the intrinsic structure of the input image. Extensive quantitative and qualitative experimental evaluations on three data sets demonstrate that the proposed method consistently outperforms the state-of-the-art methods.

Research Area(s)

  • convolutional neural network, Laplacian propagation, RGBD saliency detection

Citation Format(s)

RGBD Salient Object Detection via Deep Fusion. / Qu, Liangqiong; He, Shengfeng; Zhang, Jiawei; Tian, Jiandong; Tang, Yandong; Yang, Qingxiong.

In: IEEE Transactions on Image Processing, Vol. 26, No. 5, 7879320, 05.2017, p. 2274-2285.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review