Efficient In-Loop Filtering Based on Enhanced Deep Convolutional Neural Networks for HEVC

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal

2 Scopus Citations
View graph of relations


  • Zhaoqing Pan
  • Xiaokai Yi
  • Yun Zhang
  • Byeungwoo Jeon
  • Sam Kwong

Related Research Unit(s)


Original languageEnglish
Article number9049421
Pages (from-to)5352-5366
Journal / PublicationIEEE Transactions on Image Processing
Online published27 Mar 2020
Publication statusPublished - 2020


The raw video data can be compressed much by the latest video coding standard, high efficiency video coding (HEVC). However, the block-based hybrid coding used in HEVC will incur lots of artifacts in compressed videos, the video quality will be severely influenced. To settle this problem, the in-loop filtering is used in HEVC to eliminate artifacts. Inspired by the success of deep learning, we propose an efficient in-loop filtering algorithm based on the enhanced deep convolutional neural networks (EDCNN) for significantly improving the performance of in-loop filtering in HEVC. Firstly, the problems of traditional convolutional neural networks models, including the normalization method, network learning ability, and loss function, are analyzed. Then, based on the statistical analyses, the EDCNN is proposed for efficiently eliminating the artifacts, which adopts three solutions, including a weighted normalization method, a feature information fusion block, and a precise loss function. Finally, the PSNR enhancement, PSNR smoothness, RD performance, subjective test, and computational complexity/GPU memory consumption are employed as the evaluation criteria, and experimental results show that when compared with the filter in HM16.9, the proposed in-loop filtering algorithm achieves an average of 6.45% BDBR reduction and 0.238 dB BDPSNR gains.

Research Area(s)

  • Convolutional neural networks, high efficiency video coding, in-loop filtering