Abstract:
We investigate the computational power of continuous-time symmetric Hopeld nets. As is well known, such networks have very constrained, Liapunov-function controlled dynamics. Nevertheless, we show that they are universal and ecient computational devices, in the sense that any convergent fully parallel computation by a network of n discrete-time binary neurons, with in general asymmetric interconnections, can be simulated by a symmetric continuous-time Hopeld net containing only 14n + 6 units using the saturated-linear sigmoid activation function. In terms of standard discrete computation models this result implies that any polynomially space-bounded Turing machine can be simulated by a polynomially size-increasing sequence of continuous-time Hopeld nets. 1
Citations
|
166
|
Absolute stability of global pattern formation and parallel memory storage by competitive neural networks
– Cohen, Grossberg
- 1883
|
|
159
|
Structural Complexity I
– Balc'azar, D'iaz, et al.
- 1988
|
|
77
|
Analog computation via neural networks
– Siegelmann, Sontag
- 1994
|
|
52
|
On the effect of analog noise in discrete-time analog computations
– Maass, Orponen
- 1998
|
|
43
|
Bounds on the complexity of recurrent neural network implementations of finite state machines. Neural Networks
– Horne, Hush
- 1996
|
|
43
|
On the Computational Power of Neural Networks
– Siegelmann, Sontag
- 1995
|
|
36
|
Neural networks and physical systems with emergent collective computational abilities
– Hop
- 1982
|
|
26
|
A survey of continuous-time computation theory
– Orponen
- 1997
|
|
24
|
Exponential transient classes of symmetric neural networks for synchronous and sequential updating
– Goles, Mart'inez
- 1989
|
|
24
|
Optimal simulation of automata by neural nets
– Indyk
- 1995
|
|
20
|
Neurons with graded response have collective computational properties like those of two-state neurons
– Hop
- 1984
|
|
17
|
The computational power of continuous time neural networks
– Orponen
- 1997
|
|
16
|
Theory of neuromata
– Sma, Wiedermann
- 1998
|
|
15
|
Computational power of neural networks: A characterization in terms of Kolmogorov complexity
– Balcazar, Gavalda, et al.
- 1997
|
|
11
|
Neural" computation of decisions in optimization problems
– Hop, Tank
- 1985
|
|
8
|
The computational power of discrete Hop nets with hidden units
– Orponen
- 1996
|
|
6
|
A continuous-time optical neural network
– Stoll, Lee
- 1988
|
|
5
|
Interactive system for universal functional optimization (ufo
– Luksan, Tuma, et al.
- 1988
|
|
2
|
Some afterthoughts on Hop networks
– Sma, Antti-Poika
- 1999
|