Importance-Aware Filter Selection for Convolutional Neural Network Acceleration

Zikun Liu, Zhen Chen, Weiping Li

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

Convolutional Neural Networks(CNNs) are widely used in many fields, including artificial intelligence, computer vision and video coding. However, CNNs are typically overparameterized and contain significant redundancy. Traditional model acceleration methods mainly rely on specific manual rules. This usually leads to sub-optimal results with relatively limited compression ratio. Recent works have deployed the self-learning agent on the layer-level acceleration but still combined with human-designed criterias. In this paper, we proposed a filter-based model acceleration method to directly and automatically decide which filters should be pruned with the reinforcement learning method DDPG. We designed a novel reward function with the reward shaping technique for the training process. Our method is utilized on the models trained on MNIST and CIFAR-10 datasets and achieves both higher acceleration ratio and less accuracy loss than the conventional methods simultaneously.
Original languageEnglish
Title of host publication2019 IEEE International Conference on Visual Communications and Image Processing (VCIP)
PublisherIEEE
ISBN (Electronic)978-1-7281-3723-0
ISBN (Print)978-1-7281-3724-7
DOIs
Publication statusPublished - Dec 2019
Event34th IEEE International Conference on Visual Communications and Image Processing, VCIP 2019 - Aerial UTS Function Centre, Sydney, Australia
Duration: 1 Dec 20194 Dec 2019
http://www.vcip2019.org/

Publication series

NameIEEE International Conference on Visual Communications and Image Processing, VCIP
ISSN (Print)1018-8770
ISSN (Electronic)2642-9357

Conference

Conference34th IEEE International Conference on Visual Communications and Image Processing, VCIP 2019
PlaceAustralia
CitySydney
Period1/12/194/12/19
Internet address

Research Keywords

  • CNNs acceleration
  • Deep learning
  • Model acceleration
  • Reinforcement learning

Fingerprint

Dive into the research topics of 'Importance-Aware Filter Selection for Convolutional Neural Network Acceleration'. Together they form a unique fingerprint.

Cite this