Constructing Accurate and Efficient Deep Spiking Neural Networks With Double-Threshold and Augmented Schemes

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

38 Scopus Citations
View graph of relations

Author(s)

  • Qiang Yu
  • Chenxiang Ma
  • Shiming Song
  • Gaoyan Zhang
  • Jianwu Dang

Detail(s)

Original languageEnglish
Pages (from-to)1714-1726
Journal / PublicationIEEE Transactions on Neural Networks and Learning Systems
Volume33
Issue number4
Online published20 Jan 2021
Publication statusPublished - Apr 2022

Abstract

Spiking neural networks (SNNs) are considered as a potential candidate to overcome current challenges, such as the high-power consumption encountered by artificial neural networks (ANNs); however, there is still a gap between them with respect to the recognition accuracy on various tasks. A conversion strategy was, thus, introduced recently to bridge this gap by mapping a trained ANN to an SNN. However, it is still unclear that to what extent this obtained SNN can benefit both the accuracy advantage from ANN and high efficiency from the spike-based paradigm of computation. In this article, we propose two new conversion methods, namely TerMapping and AugMapping. The TerMapping is a straightforward extension of a typical threshold-balancing method with a double-threshold scheme, while the AugMapping additionally incorporates a new scheme of augmented spike that employs a spike coefficient to carry the number of typical all-or-nothing spikes occurring at a time step. We examine the performance of our methods based on the MNIST, Fashion-MNIST, and CIFAR10 data sets. The results show that the proposed double-threshold scheme can effectively improve the accuracies of the converted SNNs. More importantly, the proposed AugMapping is more advantageous for constructing accurate, fast, and efficient deep SNNs compared with other state-of-the-art approaches. Our study, therefore, provides new approaches for further integration of advanced techniques in ANNs to improve the performance of SNNs, which could be of great merit to applied developments with spike-based neuromorphic computing.

Research Area(s)

  • Artificial neural network (ANN)-to-spiking neural network (SNN) conversion, augmented spikes, Biological neural networks, deep SNNs, double thresholds, Membrane potentials, neuromorphic computing, Neuromorphic engineering, Neurons, pattern recognition, Standards, Task analysis, Training

Citation Format(s)

Constructing Accurate and Efficient Deep Spiking Neural Networks With Double-Threshold and Augmented Schemes. / Yu, Qiang; Ma, Chenxiang; Song, Shiming et al.
In: IEEE Transactions on Neural Networks and Learning Systems, Vol. 33, No. 4, 04.2022, p. 1714-1726.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review