David Haussler, Michael Kearns, H. Sebastian Seung, Naftali Tishby  Home/Search
Context Related
Links: ACM DBLP | mit.edu/people/seung/papers/hkst.ps Cached: PS.gz PS PDF This document uses CoBlitz to cache paper downloads. If your firewall is blocking outgoing connections to port 3125, you can use these links to download local copies.
Image Update HelpPS.gz PS PDF From: mit.edu/people/seung/pape...index (more) (Enter author homepages) |
Rate this article:      (best)Comment on this article |
Abstract: . In this paper we introduce and investigate a mathematically rigorous theory of learning curves that is based on ideas from statistical mechanics. The advantage of our theory over the well-established VapnikChervonenkis theory is that our bounds can be considerably tighter in many cases, and are also more reflective of the true behavior of learning curves. This behavior can often exhibit dramatic properties such as phase transitions, as well as power law asymptotics not explained by the VC... (Update)
Cited by: More
Learning from Data of Variable Quality - Koby Crammer Michael (Correct)
Finding the Most Interesting Patterns in a Database Quickly.. - Scheffer, Wrobel (2002) (Correct)
Average-Case Analysis of Classification Algorithms for Boolean.. - Scheffer (2000) (Correct)
Similar documents (at the sentence level):
29.1%: Rigorous Learning Curve Bounds from Statistical Mechanics - Haussler, Kearns, Seung.. (1994) (Correct)
Active bibliography (related documents): More All
0.3: Efficient Noise-Tolerant Learning From Statistical Queries - Kearns (1998) (Correct)
0.3: Characterizing Rational versus Exponential Learning Curves - Schuurmans (1995) (Correct)
0.3: Annealed Theories of Learning - Seung (1995) (Correct)
Similar documents based on text: More All
0.3: Learning From a Population of Hypotheses - Michael Kearns And (1995) (Correct)
0.3: Computer Architecture: a qualitative overview of Hennessy and.. - Machanick (2001) (Correct)
0.3: A General Lower Bound on the Number - Of Examples Needed (Correct)
Related documents from co-citation: More All
13: Decision theoretic generalizations of the PAC model for neural net and other lea.. (context) - Haussler - 1992
10: Estimation of Dependences Based on Empirical Data (context) - Vapnik - 1982
10: Statistical mechanics of learning from examples (context) - Seung, Sompolinsky et al. - 1992
BibTeX entry: (Update)
Haussler, D., Kearns, M., Seung, H., and Tishby, N. (1996). Rigorous learning curve bounds from statistical mechanics. MACHINE LEARNING, 25:195--236. http://citeseer.ist.psu.edu/haussler96rigorous.html More
@inproceedings{ haussler94rigorous,
author = "David Haussler and H. Sebastian Seung and Michael J. Kearns and Naftali Tishby",
title = "Rigorous Learning Curve Bounds from Statistical Mechanics",
booktitle = "Computational Learing Theory",
pages = "76-87",
year = "1994",
url = "citeseer.ist.psu.edu/haussler96rigorous.html" }
Citations (may not include all citations):2319 Elements of Information Theory (context) - Cover, Thomas - 1991 ACM
454 the uniform convergence of relative frequencies of events to.. (context) - Vapnik, Chervonenkis - 1971
348 Estimation of Dependences Based on Empirical Data (context) - Vapnik - 1982
318 Convergence of Stochastic Processes (context) - Pollard - 1984
268 Decision-theoretic generalizations of the PAC model for neur.. (context) - Haussler - 1992
151 A general lower bound on the number of examples needed for l.. (context) - Ehrenfeucht, Haussler et al. - 1989
59 Central limit theorems for empirical measures (context) - Dudley - 1978
58 Statistical mechanics of learning from examples (context) - Seung, Sompolinsky et al. - 1992
44 A statistical approach to learning and generalization in neu.. (context) - Levin, Tishby et al. - 1989
40 The statistical mechanics of learning a rule (context) - Watkin, Rau et al. - 1993
37 The space of interactions in neural network models (context) - Gardner - 1988
29 Measuring the VC dimension of a learning machine - --, Levin et al. - 1994
25 Recognizing hand-printed letters and digits using backpropag.. (context) - Martin, Pittman - 1991 ACM
24 Learnability with respect to fixed distributions (context) - Benedek, Itai - 1991 ACM DBLP
24 Statistical theory of learning a rule (context) - --, Tishby - 1990
20 Four types of learning curves - Amari, Fujita et al. - 1992 ACM
13 How tight are the Vapnik-Chervonenkis bounds (context) - Cohn, Tesauro - 1992
13 General bounds on the number of examples needed for learning.. (context) - Simon - 1993
12 Lower bounds in pattern recognition and learning (context) - Devroye, Lugosi - 1994
11 The transition to perfect generalization in perceptrons (context) - Baum, Lyuu - 1991 ACM
11 the sample complexity of weak learning (context) - Goldman, Kearns et al. - 1990
10 Learning curves in large neural networks (context) - Sompolinsky, Seung et al. - 1991 ACM DBLP
8 Implementing Valiant's learnability theory using random sets (context) - Comput, Oblow - 1992 ACM DBLP
8 First-order transition to perfect generalization in a neural.. (context) - Gyorgyi - 1990
7 Average case analysis of empirical and explanation-based lea.. (context) - Sarrett, Pazzani - 1992
5 Systems that can learn from examples: replica calculation of.. (context) - Phys, Engel et al. - 1993
5 Learning Theory (context) - Comput - 1990 ACM
4 Statistical mechanics calculation of Vapnik Chervonenkis bou.. (context) - Engel, Fink - 1993
4 Three unfinished works on the optimal storage capacity of ne.. (context) - Gardner, Derrida - 1989
1 Exhaustive learning (context) - Learning, Schwartz et al. - 1990
1 Workshop on Comput (context) - Rivest, Proc et al. - 1992
1 Bounds on the sample complexity of Bayesian learning using i.. (context) - Computation, Haussler et al. - 1991 ACM DBLP
The graph only includes citing articles where the year of publication is known.
Documents on the same site (http://hebb.mit.edu/people/seung/papers/index.html): More
On-line Learning of Dichotomies - Barkai, Seung (1994) (Correct)
Unsupervised Learning by Convex and Conic Coding - Lee, Seung (1997) (Correct)
Nonlinear Network Models of the Oculomotor Integrator - Lee, Reis, Seung, Tank (1996) (Correct)
Online articles have much greater impact More about CiteSeer.IST Add search form to your site Submit documents Feedback
CiteSeer.IST - Copyright Penn State and NEC