It is proved that more corners of hypercube can be programmed as stable states (whether the number of neurons is even or even) and a new perspective to the so called "Programming Problem" of Hopfield Neural Network is presented.
Abstract
Using the logical basis of synthesizing Hopfield Neural Network with desired corners of hypercube as stable states (proposed in [1]), it is proved that more corners of hypercube can be programmed as stable states (whether the number of neurons is even or odd). The research paper presents a new perspective to the so called"Programming Problem"of Hopfield Neural Network.
This paper applied a circuit implemented ReLU Hopfield Neural Network to a mathematical problem with an inequality constraint and implemented a circuit and observed converged neural circuit outputs that corresponded well to theoretical results and simulations.
Ryosei Okubo, Y. Mitsuya, Hiroyuki Takahashi· Frontiers in Neuroscience· 0 citations
The Lyapunov spectrum of a nonlinear recurrent neural network with random asymmetric couplings is calculated in the limit $N\to\infty$. The calculation is based on a finite-$N$ identity that expresses the cumulative distribution of Lyapunov exponents as a response function of the tangent-space dynamics, with the tangen...
Multilayer perceptrons (MLPs) are considered as a singular model of learning machines. Singularities cause local minima and plateaus in the learning process. I/O-equivalence, where two different MLPs are regarded as the same multivariable function, is an important concept for understanding singularities in neural netwo...
In this article, we extend learning rules from real binary to complex-valued spins. This formulation allows for a robust and natural representation of grayscale patterns, where spins behave as multi-state neurons and can be stored in a complex-valued weight matrix. We describe a rule that performs better than standard...
