Synaptic Learning With Augmented Spikes
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 1134-1146 |
Journal / Publication | IEEE Transactions on Neural Networks and Learning Systems |
Volume | 33 |
Issue number | 3 |
Online published | 20 Jan 2021 |
Publication status | Published - Mar 2022 |
Link(s)
Abstract
Traditional neuron models use analog values for information representation and computation, while all-or-nothing spikes are employed in the spiking ones. With a more brain-like processing paradigm, spiking neurons are more promising for improvements in efficiency and computational capability. They extend the computation of traditional neurons with an additional dimension of time carried by all-or-nothing spikes. Could one benefit from both the accuracy of analog values and the time-processing capability of spikes? In this article, we introduce a concept of augmented spikes to carry complementary information with spike coefficients in addition to spike latencies. New augmented spiking neuron model and synaptic learning rules are proposed to process and learn patterns of augmented spikes. We provide systematic insights into the properties and characteristics of our methods, including classification of augmented spike patterns, learning capacity, construction of causality, feature detection, robustness, and applicability to practical tasks, such as acoustic and visual pattern recognition. Our augmented approaches show several advanced learning properties and reliably outperform the baseline ones that use typical all-or-nothing spikes. Our approaches significantly improve the accuracies of a temporal-based approach on sound and MNIST recognition tasks to 99.38% and 97.90%, respectively, highlighting the effectiveness and potential merits of our methods. More importantly, our augmented approaches are versatile and can be easily generalized to other spike-based systems, contributing to a potential development for them, including neuromorphic computing.
Research Area(s)
- Augmented spikes, Biological information theory, Biological system modeling, Computational modeling, Encoding, Feature extraction, neuromorphic computing, Neurons, pattern recognition, spike encoding, spiking neural networks (SNNs), synaptic learning, Task analysis
Citation Format(s)
Synaptic Learning With Augmented Spikes. / Yu, Qiang; Song, Shiming; Ma, Chenxiang et al.
In: IEEE Transactions on Neural Networks and Learning Systems, Vol. 33, No. 3, 03.2022, p. 1134-1146.
In: IEEE Transactions on Neural Networks and Learning Systems, Vol. 33, No. 3, 03.2022, p. 1134-1146.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review