Download:
|
by Lluis Garrido, Sergio G Omez
http://www.etse.urv.es/~sgomez/papers/bpout_web.ps.gz
Add To MetaCart
Abstract:
The minimization quadratic error criterion which gives rise to the backpropagation algorithm is studied using functional analysis techniques. With them, we recover easily the well-known statistical result which states that the searched global minimum is a function which assigns, to each input pattern, the expected value of its corresponding output patterns. Its application to classification tasks shows that only certain output class representations can be used to obtain the optimal Bayesian decision rule. Finally, our method permits the study of other error criterions, finding out, for instance, that absolute value errors lead to medians instead of mean values.
Citations
|
888
|
An Introduction to Probability Theory and Its Applications
– FELLER
- 1968
|
|
834
|
Multi-layer feed forward networks are universal aproximators
– Hornik, Stinchcombe, et al.
- 1989
|
|
547
|
Approximation by superposition of a sigmoidal function
– Cybenko
- 1989
|
|
474
|
random variables, and stochastic processes
– Probability
- 1991
|
|
266
|
Universal approximation bounds for superpositions of a sigmoidal function
– Barron
- 1993
|
|
72
|
The multilayer perceptron as an approximation to a Bayes optimal discriminant function
– Ruck, Rogers, et al.
- 1990
|
|
71
|
Perceptron-Based Learning Algorithms
– Gallant
- 1990
|
|
63
|
Neurocomputing
– Hecht-Nielsen
- 1989
|
|
37
|
Back-propagation, weightelimination and time series prediction
– Weigend, Rumelhart, et al.
- 1991
|
|
29
|
V.: The theory of probability
– Gnedenko
- 1962
|
|
26
|
Neural network classification: A Bayesian interpretation
– Wan
- 1990
|
|
9
|
Artificial neural networks: learning algorithms, performance evaluation, and applications
– Karayiannis, Venetsanopoulos
- 1993
|
|
9
|
Improvement of learning in recurrent networks by substituting the sigmoid activation function
– Sopena, Alqu'ezar
- 1994
|
|
1
|
Use of neural nets to measure the polarization and its Bayesian interpretation
– Garrido, Gaitan
- 1991
|