Weakly-Supervised Saliency Detection via Salient Object Subitizing
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 4370-4380 |
Journal / Publication | IEEE Transactions on Circuits and Systems for Video Technology |
Volume | 31 |
Issue number | 11 |
Online published | 5 Jan 2021 |
Publication status | Published - Nov 2021 |
Link(s)
Abstract
Salient object detection aims at detecting the most visually distinct objects and producing the corresponding masks. As the cost of pixel-level annotations is high, image tags are usually used as weak supervisions. However, an image tag can only be used to annotate one class of objects. In this paper, we introduce saliency subitizing as the weak supervision since it is class-agnostic. This allows the supervision to be aligned with the property of saliency detection, where the salient objects of an image could be from more than one class. To this end, we propose a model with two modules, Saliency Subitizing Module (SSM) and Saliency Updating Module (SUM). While SSM learns to generate the initial saliency masks using the subitizing information, without the need for any unsupervised methods or some random seeds, SUM helps iteratively refine the generated saliency masks. We conduct extensive experiments on five benchmark datasets. The experimental results show that our method outperforms other weakly-supervised methods and even performs comparably to some fully-supervised methods.
Research Area(s)
- weak supervision, saliency detection, object subitizing
Citation Format(s)
Weakly-Supervised Saliency Detection via Salient Object Subitizing. / Zheng, Xiaoyang; Tan, Xin; Zhou, Jie et al.
In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 31, No. 11, 11.2021, p. 4370-4380.
In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 31, No. 11, 11.2021, p. 4370-4380.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review