In the model selection problem, we must balance the complexity of a statistical model with its goodness of fit to the training data. This problem arises repeatedly in statistical estimation,
|
4463
|
Elements of Information Theory
– Cover, Thomas
- 1991
|
|
734
|
Probability inequalities for sums of bounded random variables
– Hoeffding
- 1963
|
|
719
|
Modeling by shortest data description
– Rissanen
- 1972
|
|
666
|
On the uniform convergence of relative frequencies of events to their probabilities. Theory Prob
– Vapnik, Chervonenkis
- 1971
|
|
643
|
Estimation of Dependencies Based on Empirical Data
– Vapnik
- 1982
|
|
443
|
Cross-validatory Choice and Assessment of Statistical Predictors
– Stone
- 1974
|
|
268
|
Inferring decision trees using the Minimum Description Length principle
– Quinlan, Rivest
- 1989
|
|
193
|
Stochastic complexity and modeling
– Rissanen
- 1986
|
|
178
|
Computational limitations on learning from examples
– Pitt, Valiant
- 1988
|
|
146
|
The effective number of parameters: An analysis of generalization and regularization in nonlinear learning systems
– Moody, Hanson, et al.
- 1992
|
|
139
|
1991]:‘Minimum complexity density estimation
– Barron, Cover
|
|
137
|
Toward Efficient Agnostic Learning
– Kearns, Schapire, et al.
- 1994
|
|
130
|
A Conservation Law for Generalization Performance
– Schaffer
- 1994
|
|
59
|
On the connection between in-sample testing and generalization error
– Wolpert
- 1992
|
|
56
|
Rigorous learning curve bounds from statistical mechanics, Machine Learning 25
– Haussler, Kearns, et al.
- 1996
|
|
43
|
Statistical mechanics of learning from examples
– Seung, Sompolinsky, et al.
- 1992
|
|
39
|
Training a 3-node neural net is NP-complete
– Blum, Rivest
- 1989
|
|
29
|
Measuring the VC-dimension of the learning machine
– Vapnik, Levin, et al.
- 1994
|
|
28
|
Stochastic Complexity in Statistical Inquiry, volume 15
– Rissanen
- 1989
|
|
26
|
Asymptotics for and against cross-validation
– Stone
- 1977
|
|
3
|
Estimation of DependencesBased on Empirical Data
– Vapnik
- 1982
|
|
3
|
A bound on the error of cross validation, with consequences for the training-test split
– Kearns
- 1996
|
|
1
|
Rigourous learning curve bounds from statistical mechanics
– Tishby
- 1994
|
|
1
|
Rigourous learning curve boundsfrom statistical mechanics
– Haussler, Kearns, et al.
- 1994
|
|
1
|
Stochastic Complexity in Statistical Inquiry,volume 15
– Rissanen
- 1989
|
|
1
|
Statistical mechanics of learning from examples
– Sompolinsky
- 1992
|
|
1
|
Cross-validatory choice and assessment of statistical predictions
– tone
- 1974
|
|
1
|
Asymptotics for and against cross-validation
– tone
- 1977
|
|
