TY - JOUR
T1 - Spatiotemporal Tree Filtering for Enhancing Image Change Detection
AU - Li, Dawei
AU - Yan, Siyuan
AU - Zhao, Mingbo
AU - Chow, Tommy W. S.
PY - 2020
Y1 - 2020
N2 - Change detection has received extensive attention because of its realistic significance and broad application fields. However, none of the existing change detection algorithms can handle all scenarios and tasks so far. Different from the most of contributions from the research community in recent years, this paper does not work on designing new change detection algorithms. We, instead, solve the problem from another perspective by enhancing the raw detection results after change detection. As a result, the proposed method is applicable to various kinds of change detection methods, and regardless of how the results are detected. In this paper, we propose Fast Spatiotemporal Tree Filter (FSTF), a purely unsupervised detection method, to enhance coarse binary detection masks obtained by different kinds of change detection methods. In detail, the proposed FSTF has adopted a volumetric structure to effectively synthesize spatiotemporal information of the same target from the current time and history frames to enhance detection. The computational complexity analyzed in the view of graph theory also show that the fast realization of FSTF is a linear time algorithm, which is capable of handling efficient on-line detection tasks. Finally, comprehensive experiments based on qualitative and quantitative analysis verify that FSTF-based change detection enhancement is superior to several other state-of-the-art methods including fully connected Conditional Random Field (CRF), joint bilateral filter, and guided filter. It is illustrated that FSTF is versatile enough to also improve saliency detection as well as semantic image segmentation.
AB - Change detection has received extensive attention because of its realistic significance and broad application fields. However, none of the existing change detection algorithms can handle all scenarios and tasks so far. Different from the most of contributions from the research community in recent years, this paper does not work on designing new change detection algorithms. We, instead, solve the problem from another perspective by enhancing the raw detection results after change detection. As a result, the proposed method is applicable to various kinds of change detection methods, and regardless of how the results are detected. In this paper, we propose Fast Spatiotemporal Tree Filter (FSTF), a purely unsupervised detection method, to enhance coarse binary detection masks obtained by different kinds of change detection methods. In detail, the proposed FSTF has adopted a volumetric structure to effectively synthesize spatiotemporal information of the same target from the current time and history frames to enhance detection. The computational complexity analyzed in the view of graph theory also show that the fast realization of FSTF is a linear time algorithm, which is capable of handling efficient on-line detection tasks. Finally, comprehensive experiments based on qualitative and quantitative analysis verify that FSTF-based change detection enhancement is superior to several other state-of-the-art methods including fully connected Conditional Random Field (CRF), joint bilateral filter, and guided filter. It is illustrated that FSTF is versatile enough to also improve saliency detection as well as semantic image segmentation.
KW - binary mask enhancement
KW - Change detection
KW - post-processing
KW - spatiotemporal filtering
KW - tree filtering
KW - binary mask enhancement
KW - Change detection
KW - post-processing
KW - spatiotemporal filtering
KW - tree filtering
KW - binary mask enhancement
KW - Change detection
KW - post-processing
KW - spatiotemporal filtering
KW - tree filtering
UR - http://www.scopus.com/inward/record.url?scp=85091187851&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85091187851&origin=recordpage
U2 - 10.1109/TIP.2020.3017339
DO - 10.1109/TIP.2020.3017339
M3 - RGC 21 - Publication in refereed journal
SN - 1057-7149
VL - 29
SP - 8805
EP - 8820
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
M1 - 9174824
ER -