David Barber, Peter Sollich  Home/Search
Context Related
| mbfys.kun.nl/snn/pub/report...newton.ps Cached: PS.gz PS PDF This document uses CoBlitz to cache paper downloads. If your firewall is blocking outgoing connections to port 3125, you can use these links to download local copies.
Image Update HelpPS.gz PS PDF From: mbfys.kun.nl/SNN/Publicat...index (more) (Enter author homepages) |
Rate this article:      (best)Comment on this article |
Abstract: We analyse online gradient descent learning from finite training sets at non-infinitesimal learning rates j for both linear and non-linear networks. In the linear case, exact results are obtained for the time-dependent generalization error of networks with a large number of weights N , trained on p = ffN examples. This allows us to study in detail the effects of finite training set size ff on, for example, the optimal choice of learning rate j. We also compare online and offline learning, for... (Update)
Context of citations to this paper: More
.... [5, 6, 7] or di#erent kinds of approximations, such as Fokker Planck approaches [8, 9, 10, 11] and Gaussian local field distributions [12]. Exact work on non linear learning rules has drawn heavily on techniques from the spin glass and disordered systems community (for an...
.... [5, 6, 7] or different kinds of approximations, such as Fokker Planck approaches [8, 9, 10, 11] and Gaussian local field distributions [12]. Exact work on non linear learning rules has drawn heavily on techniques from the spin glass and disordered systems community (for an...
Cited by: More
Supervised Learning with Restricted Training Sets: a.. - Heimel, Coolen (Correct)
Similar documents (at the sentence level): More
43.3%: Online Learning From Finite Training Sets and Robustness to.. - Sollich, Barber (1998) (Correct)
37.5%: Online Learning From Finite Training Sets and - Robustness To Input (Correct)
20.0%: Online Learning From Finite Training Sets in Nonlinear Networks - Peter Sollich (1998) (Correct)
Active bibliography (related documents): More All
0.5: Dynamics of Batch Learning in Multilayer Networks -.. - Fukumizu (Correct)
0.3: Bayesian Mean Field Algorithms for Neural Networks and Gaussian.. - Winther (1998) (Correct)
0.3: Correlation between cognitive function scores and.. - Halkjær, Waldemar, .. (Correct)
Similar documents based on text: More All
0.6: Off-line On-line - Scenario Mistake-Bound Pac (Correct)
0.4: The Colors Of An Online Learning Society: Experiences From.. - Andersson, Wu (2002) (Correct)
0.4: Strategies for Combining on-Line and Off-Line.. - Gauthier.. (2001) (Correct)
Related documents from co-citation: More All
4: Dynamics of supervised learning with restricted training sets - Coolen, Saad - 1998
2: On Fokker-Planck approximations of on-line learning processes - Heskes - 1994
2: Optimal Generalization in Perceptrons (context) - Kinouchi, Caticha - 1992
BibTeX entry: (Update)
D. Barber and P. Sollich. Online learning from finite training sets. In D. Saad, editor, On-Line Learning in Neural Networks, pages 279--302. Cambridge U.P., 1998. http://citeseer.ist.psu.edu/article/barber98online.html More
@misc{ barber98online,
author = "D. Barber and P. Sollich",
title = "Online learning from finite training sets",
text = "D. Barber and P. Sollich. Online learning from finite training sets. In
D. Saad, editor, On-Line Learning in Neural Networks, pages 279--302. Cambridge
U.P., 1998.",
year = "1998",
url = "citeseer.ist.psu.edu/article/barber98online.html" }
Citations (may not include all citations):22 Learning processes in neural networks - Heskes, Kappen - 1991
14 Eigenvalues of covariance matrices - application to neural- .. (context) - LeCun, Kanter et al. - 1991
7 Learning by online gradient descent - Biehl, Schwarze - 1995
7 Phase transitions in simple learning (context) - Hertz, Krogh et al. - 1989
4 The effect of correlated input data on the dynamics of learn.. - Halkjaer, Winther - 1997
2 Online learning in soft committee machines (context) - Saad, Solla - 1995
2 Generalization in a linear perceptron in the presence of noi.. (context) - Review, -- et al. - 1992
2 The effect of correlations in neural networks (context) - Wendemuth, Opper et al. - 1993
1 Modern Analytic Techniques to Solve the Dynamics of Recurren.. (context) - Physics, -- et al. - 1996
1 line learning from finite training sets (context) - Physics, -- et al.
1 Online learning from finite training sets: An analytical cas.. (context) - Letters, Barber et al.
1 Finite size effects in learning and generalization in linear.. (context) - Review, Sollich - 1994
1 Learning unrealizable tasks from minimum entropy queries - Sollich - 1995
Documents on the same site (http://www.mbfys.kun.nl/SNN/Publications/publ/index.html): More
Learning in Two-Layered Networks with Correlated Examples - Heskes, Coolen (1997) (Correct)
Population Coding in a Neural Net for Trajectory Formation - Glasius, Komoda, Gielen (1994) (Correct)
Biologically Inspired Neural Network for Trajectory.. - Glasius, Komoda, Gielen (1993) (Correct)
Online articles have much greater impact More about CiteSeer.IST Add search form to your site Submit documents Feedback
CiteSeer.IST - Copyright Penn State and NEC