Fast User-Guided Single Image Reflection Removal via Edge-Aware Cascaded Networks

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

3 Scopus Citations
View graph of relations

Author(s)

  • Huaidong Zhang
  • Xuemiao Xu
  • Hai He
  • Shengfeng He
  • Guoqiang Han
  • Jing Qin

Detail(s)

Original languageEnglish
Pages (from-to)2012-2023
Journal / PublicationIEEE Transactions on Multimedia
Volume22
Issue number8
Online published4 Nov 2019
Publication statusPublished - Aug 2020
Externally publishedYes

Abstract

Taking photos through a glass window leads to glare or reflection, which might distract the viewer from the scene behind the window. In this paper, we involve user interaction to tackle the ill-posedness of the reflection removal problem. Users are allowed to draw strokes or lassos to indicate the background and reflection layers. Instead of designing hand-crafted features, we propose the edge-aware cascaded networks for reflection removal. The proposed network is a two-stage pipeline. The first stage takes the edge hints converted from user guidance and the image with reflection as input, and then separates the input image into the background and reflection layers. The second stage involves a refinement network to recover the missing details of the background layers. We simulate different types of user guidance, and the networks are trained on simulated data. The cascaded networks are end-to-end and perform with a single feed-forward pass, enabling fast editing. Extensive experimental evaluations demonstrate that the proposed used-guided reflection removal network yields better performance than the state-of-the-art methods on real-world scenarios. Furthermore, we show that novice users can easily generate reflection-free images, and large improvements in reflection removal quality can be obtained in just one minute.

Research Area(s)

  • convolutional neural network, image refinement, Reflection removal, user interaction

Citation Format(s)

Fast User-Guided Single Image Reflection Removal via Edge-Aware Cascaded Networks. / Zhang, Huaidong; Xu, Xuemiao; He, Hai; He, Shengfeng; Han, Guoqiang; Qin, Jing; Wu, Dapeng.

In: IEEE Transactions on Multimedia, Vol. 22, No. 8, 08.2020, p. 2012-2023.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review