Deep Learning–Based Automated Detection of Sewer Defects in CCTV Videos

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

114 Scopus Citations
View graph of relations

Author(s)

  • Srinath Shiv Kumar
  • Dulcy M. Abraham
  • Mohammad R. Jahanshahi
  • Tom Iseley
  • Jack C. P. Cheng

Detail(s)

Original languageEnglish
Article number04019047
Journal / PublicationJournal of Computing in Civil Engineering
Volume34
Issue number1
Online published25 Oct 2019
Publication statusPublished - Jan 2020
Externally publishedYes

Abstract

Automated interpretation of closed-circuit television (CCTV) inspection videos could improve the speed and consistency of sewer condition assessment. Previous approaches focus on defect classification, with less emphasis on defect localization. Furthermore, previous approaches used pre-engineered features for image classification, leading to low generalization capabilities. This paper presents a deep learning-based framework for the classification and localization of sewer defects. Three state-of-the-art models—single-shot detector (SSD), you only look once (YOLO), and faster region-based convolutional neural network (Faster R-CNN)—are evaluated for speed and precision in detecting sewer defects. Three thousand eight hundred annotated images of defects were used to train and test the models. To demonstrate the viability of real-time automated defect detection, a prototype system was developed for detecting root intrusions and deposits, and evaluated on inspection videos televising 335 m of sewer laterals. The prototype system detected 51 out of 56 instances of defects and generated four false positives. Future research aims to incorporate postprocessing and data fusion to improve the speed and accuracy of the prototype. © 2019 American Society of Civil Engineers.

Research Area(s)

  • Automated defect detection, Closed-circuit television (CCTV), Condition assessment, Convolutional neural networks (CNNs), Deep learning, Sewer pipelines

Citation Format(s)

Deep Learning–Based Automated Detection of Sewer Defects in CCTV Videos. / Kumar, Srinath Shiv; Wang, Mingzhu; Abraham, Dulcy M. et al.
In: Journal of Computing in Civil Engineering, Vol. 34, No. 1, 04019047, 01.2020.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review