An improved SNN using virtual space (VSNN) was introduced, which has unique advantages in online training or equidistant-sampling problems and can effectively supplement the SNN algorithm system, promoting the bionic research of artificial neural networks.
Abstract
Accurate nonlinear modeling underpins every layer of modern engineering. Sampling neural network (SNN) is a new fitting network, which has a simple structure, clear physical concept, concise algorithm, stable performance, and adopts a new error diffusion training method similar to the diffusion of neural stimuli in living organisms. To improve accuracy, an improved SNN using virtual space (VSNN) was introduced. Based on the spectral analysis, four types of VSNN algorithms are obtained through zero extension, mirror symmetry, center symmetry, and constant extension, respectively. The VSNNs demonstrated a significant reduction, that is, 23.8%, 66.9%, 63.9%, and 71.3% in average root-mean-square error compared to SNN, extreme learning machine, least squares method, and backpropagation, respectively, across 40 benchmark tests. The research on VSNNs can effectively supplement the SNN algorithm system, promoting the bionic research of artificial neural networks. It has unique advantages in online training or equidistant-sampling problems. The application value is proved by the experiments of the Negative Temperature Coefficient sensor and the Chebyshev filter.
An improved multi-operator differential evolution algorithm, called NN-IMODE, tailored for comprehensive Feedforward Neural Networks optimization, encompassing the number of hidden layers, neurons per layer, weights, biases, and activation functions, is introduced.
Aridj Ferhat, Farouq Zitouni, Karam M. Sallam et al.· Cluster Computing· 0 citations
A radial basis function neural network for dynamic equations on time scales using a Gaussian-type activation generated by the time-scale exponential to establish two-sided exponential bounds, uniform convergence to the classical Gaussian as the graininess tends to zero, and a localisation–admissibility condition arisin...
Mahammad Khuddush, S. Georgiev· Mathematics· 0 citations
Neural networks are typically trained using first-order methods and back-propagation. It is unclear whether this approach is optimal for morphological layers whose weight Jacobians are sparse and whose resulting parameter gradients can be poor. In this work, we propose a novel weight update method for morphological neu...
Artificial neural networks (ANNs) and deep learning are widely used to identify patterns in complex data. This review describes the development of neural networks and explains key learning methods and architectures, including feed-forward networks, convolutional neural networks, recurrent neural networks, restricted Bo...
Mitesh Upreti, Sanjay Mathur· Advances in Research· 0 citations
The learning rate (LR) is the single most influential hyperparameter governing the convergence and stability of stochastic gradient descent (SGD). While numerous heuristic schedules for LR decay and warmup have been proposed to improve generalization, their underlying mathematical behavior as discrete control parameter...
S. Akhatkulov, Islom Yalgoshev, Dildora Rajabova· 2026 International Russian A...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.