(Enter summary)
Abstract: This paper focuses on a general setup for obtaining sample size lower bounds for learning
concept classes under fixed distribution laws in an extended PAC learning framework.
These bounds do not depend on the running time of learning procedures and are informationtheoretic
in nature. They are based on incompressibility methods drawn from Kolmogorov
Complexity and Algorithmic Probability theories.
1 INTRODUCTION
In recent years the job of algorithmically understanding data, above and beyond... (Update)
Context of citations to this paper: More
.... space [Hof90] whereas Apolloni and Gentile suggest to measure the complexity of a concept class by the complexity of its covers [AG98]. These notions are closely related to the Vapnik Chervonenkis dimension which captures somehow the capacity of a concept class and thus...
...13) Remark 2.1. Left inequality can be improved using the VC complexity index and related information theory results; see for instance [2]. Furthermore, note that fairly strong surjectivity requirements are not a heavy limitation to the learning algorithms; they essentially...
Cited by: More
Narrowing confidence interval width of SVM learning risk.. - Apolloni, Malchiodi
(Correct)
Algorithmic Information Theory and Machine Learning - Bousquet, Yvon (2000)
(Correct)
Active bibliography (related documents): More All
0.6: Knowledge Acquisition in Statistical Learning Theory - Fine (1999)
(Correct)
0.2: Learning Dynamical Systems in a Stationary Environment - Campi, Kumar (1996)
(Correct)
0.2: Probabilistic Analysis of Learning in Artificial Neural Networks: .. - Anthony (1994)
(Correct)
Similar documents based on text: More All
0.4: Journal of Machine Learning Research 2 (2001) 213-242.. - Cation Algorithm Claudio
(Correct)
0.3: Neural Cooperating Procedure for Fractal Analysis.. - Apolloni..
(Correct)
0.3: Correlation Collapse under Persistent Input Derangement .. - Apolloni, de Falco..
(Correct)
Related documents from co-citation: More All
2: A formal theory of inductive inference (context) - Solomono - 1964
2: An Introduction to Kolmogorov Complexity and Its Applications
- Li, Vitanyi - 1997
2: Communications of the ACM (context) - Valiant, of et al. - 1984
BibTeX entry: (Update)
B. Apolloni and C. Gentile, Sample size lower bounds in pac learning by algorithmic complexity theory, 1998. http://citeseer.ist.psu.edu/apolloni98sample.html More
@article{ apolloni98sample,
author = "B. Apolloni and C. Gentile",
title = "Sample size lower bounds in {PAC} learning by {Algorithmic Complexity Theory}",
journal = "Theoretical Computer Science",
volume = "209",
number = "1--2",
pages = "141--162",
year = "1998",
url = "citeseer.ist.psu.edu/apolloni98sample.html" }
Citations (may not include all citations):
660
An introduction to Kolmogorov Complexity and its Application..
- LI, VITANYI - 1993
493
Communication of ACM (context) - VALIANT, of et al. - 1984
465
Learnability and the Vapnik- Chervonenkis Dimension (context) - BLUMER, EHRENFEUCHT et al. - 1989
348
Estimation of dependences based on empirical data (context) - VAPNIK - 1982
151
A General Lower Bound on the Number of Examples Needed for L.. (context) - EHRENFEUCHT, HAUSSLER et al. - 1988
142
Learning from Noisy Examples (context) - ANGLUIN, LAIRD - 1988
115
the density of families of sets (context) - SAUER - 1972
107
Fractal geometry (context) - FALCONER - 1990
94
Learning in the presence of malicious errors
- KEARNS, LI - 1988
85
Bounds on the Sample Complexity of Bayesian Learning Using I..
- HAUSSLER, KEARNS et al. - 1994
60
Introduction to stochastic processes (context) - CINLAR - 1975
52
Learning from good and bad data (context) - LAIRD - 1988
47
Information and Randomness (context) - CALUDE - 1994
37
Statistical Queries and Faulty PAC Oracles
- DECATUR - 1993
34
Learnability by Fixed Distributions (context) - BENEDEK, ITAI - 1991
23
A Markovian Extension of Valiant's Learning Model (context) - ALDOUS, VAZIRANI - 1995
13
General Bounds on the Number of Examples Needed for Learning.. (context) - SIMON - 1993
12
Kluwer Academic Publishers (context) - YOUNG, theory et al. - 1993
11
Randomness conservation inequalities; information and indepe.. (context) - LEVIN - 1984
8
Probably approximate learning over classes of distributions (context) - NATARAJAN - 1992
8
Exploiting Random Walks for Learning
- BARTLETT, FISCHER et al. - 1994
7
Investigating the Distribution Assumptions in the PAC Learni.. (context) - BARTLETT, WILLIAMSON - 1991
2
Noise-tolerant Learning Near the Information-theoretic Bound (context) - CESA-BIANCHI, DICHTERMANN et al.
Documents on the same site (http://laren.usr.dsi.unimi.it/en/articles.html): More
P-sufficient statistics for PAC learning k-term-DNF formulas .. - Apolloni, Gentile
(Correct)
A Hybrid Symbolic Subsymbolic Controller for Complex.. - Apolloni, Piccolboni..
(Correct)
Correlation Collapse under Persistent Input Derangement .. - Apolloni, de Falco..
(Correct)
Online articles have much greater impact More about CiteSeer.IST Add search form to your site Submit documents Feedback
CiteSeer.IST - Copyright Penn State and NEC