MetaCartSign in to MyCiteSeer

Include Citations | Advanced Search | Help

Include Citations | Advanced Search | Help

  Analytical interpretation of feed-forward nets outputs after training

Download:
Download as a PDF | Download as a PS
by Lluis Garrido, Sergio G Omez
http://www.etse.urv.es/~sgomez/papers/bpout_web.ps.gz
Add To MetaCart

Abstract:

The minimization quadratic error criterion which gives rise to the backpropagation algorithm is studied using functional analysis techniques. With them, we recover easily the well-known statistical result which states that the searched global minimum is a function which assigns, to each input pattern, the expected value of its corresponding output patterns. Its application to classification tasks shows that only certain output class representations can be used to obtain the optimal Bayesian decision rule. Finally, our method permits the study of other error criterions, finding out, for instance, that absolute value errors lead to medians instead of mean values.

Citations

888 An Introduction to Probability Theory and Its Applications – FELLER - 1968
834 Multi-layer feed forward networks are universal aproximators – Hornik, Stinchcombe, et al. - 1989
547 Approximation by superposition of a sigmoidal function – Cybenko - 1989
474 random variables, and stochastic processes – Probability - 1991
266 Universal approximation bounds for superpositions of a sigmoidal function – Barron - 1993
72 The multilayer perceptron as an approximation to a Bayes optimal discriminant function – Ruck, Rogers, et al. - 1990
71 Perceptron-Based Learning Algorithms – Gallant - 1990
63 Neurocomputing – Hecht-Nielsen - 1989
37 Back-propagation, weightelimination and time series prediction – Weigend, Rumelhart, et al. - 1991
29 V.: The theory of probability – Gnedenko - 1962
26 Neural network classification: A Bayesian interpretation – Wan - 1990
9 Artificial neural networks: learning algorithms, performance evaluation, and applications – Karayiannis, Venetsanopoulos - 1993
9 Improvement of learning in recurrent networks by substituting the sigmoid activation function – Sopena, Alqu'ezar - 1994
1 Use of neural nets to measure the polarization and its Bayesian interpretation – Garrido, Gaitan - 1991