Skip to main navigation Skip to search Skip to main content

Effect of Time-Varying Multiplicative Noise on DNN-kWTA Model

  • Wenhao Lu
  • , Yuanjin Zheng
  • , Chi-Sing Leung*
  • *Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

Among many k-winners-take-all (kWTA) models, the dual-neural network (DNN-kWTA) model is with significantly less number of connections. However, for analog realization, noise is inevitable and affects the operational correctness of the kWTA process. Most existing results focus on the effect of additive noise. This brief studies the effect of time-varying multiplicative input noise. Two scenarios are considered. The first one is the bounded noise case, in which only the noise range is known. Another one is for the general noise distribution case, in which we either know the noise distribution or have noise samples. For each scenario, we first prove the convergence property of the DNN-kWTA model under multiplicative input noise and then provide an efficient method to determine whether a noise-affected DNN-kWTA network performs the correct kWTA process for a given set of inputs. With the two methods, we can efficiently measure the probability of the network performing the correct kWTA process. In addition, for the case of the inputs being uniformly distributed, we derive two closed-form expressions, one for each scenario, for estimating the probability of the model having correct operation. Finally, we conduct simulations to verify our theoretical results. 

© 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
Original languageEnglish
Pages (from-to)18922-18930
JournalIEEE Transactions on Neural Networks and Learning Systems
Volume35
Issue number12
Online published6 Oct 2023
DOIs
Publication statusPublished - Dec 2024

Research Keywords

  • Analytical models
  • Closed-form solutions
  • Convergence
  • dual-neural network <inline-formula xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <tex-math notation="LaTeX">$k$</tex-math> </inline-formula>-winners-take-all (DNN-<inline-formula xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <tex-math notation="LaTeX">$k$</tex-math> </inline-formula>WTA)
  • Integrated circuit modeling
  • Learning systems
  • multiplicative input noise
  • Neurons
  • Noise level
  • operational correctness

Fingerprint

Dive into the research topics of 'Effect of Time-Varying Multiplicative Noise on DNN-kWTA Model'. Together they form a unique fingerprint.

Cite this