Abstract
Among many k-winners-take-all (kWTA) models, the dual-neural network (DNN-kWTA) model is with significantly less number of connections. However, for analog realization, noise is inevitable and affects the operational correctness of the kWTA process. Most existing results focus on the effect of additive noise. This brief studies the effect of time-varying multiplicative input noise. Two scenarios are considered. The first one is the bounded noise case, in which only the noise range is known. Another one is for the general noise distribution case, in which we either know the noise distribution or have noise samples. For each scenario, we first prove the convergence property of the DNN-kWTA model under multiplicative input noise and then provide an efficient method to determine whether a noise-affected DNN-kWTA network performs the correct kWTA process for a given set of inputs. With the two methods, we can efficiently measure the probability of the network performing the correct kWTA process. In addition, for the case of the inputs being uniformly distributed, we derive two closed-form expressions, one for each scenario, for estimating the probability of the model having correct operation. Finally, we conduct simulations to verify our theoretical results.
© 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
© 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
| Original language | English |
|---|---|
| Pages (from-to) | 18922-18930 |
| Journal | IEEE Transactions on Neural Networks and Learning Systems |
| Volume | 35 |
| Issue number | 12 |
| Online published | 6 Oct 2023 |
| DOIs | |
| Publication status | Published - Dec 2024 |
Research Keywords
- Analytical models
- Closed-form solutions
- Convergence
- dual-neural network <inline-formula xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <tex-math notation="LaTeX">$k$</tex-math> </inline-formula>-winners-take-all (DNN-<inline-formula xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <tex-math notation="LaTeX">$k$</tex-math> </inline-formula>WTA)
- Integrated circuit modeling
- Learning systems
- multiplicative input noise
- Neurons
- Noise level
- operational correctness
Fingerprint
Dive into the research topics of 'Effect of Time-Varying Multiplicative Noise on DNN-kWTA Model'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver