See this document in CiteSeerX!

Sample Size Lower Bounds in PAC Learning by Algorithmic Complexity Theory (1998)  (Make Corrections)  (2 citations)
B. Apolloni, C. Gentile
Theoretical Computer Science



  Home/Search   Context   Related

 
View or download:
laren.usr.dsi.unimi.it/e...Kolmog.ps.gz
Cached:  PS.gz  PS  PDF   Image  Update  Help

From:  laren.usr.dsi.unimi.it...articles (more)
(Enter author homepages)

Rate this article: (best)
  Comment on this article  
(Enter summary)

Abstract: This paper focuses on a general setup for obtaining sample size lower bounds for learning concept classes under fixed distribution laws in an extended PAC learning framework. These bounds do not depend on the running time of learning procedures and are informationtheoretic in nature. They are based on incompressibility methods drawn from Kolmogorov Complexity and Algorithmic Probability theories. 1 INTRODUCTION In recent years the job of algorithmically understanding data, above and beyond... (Update)

Context of citations to this paper:   More

.... space [Hof90] whereas Apolloni and Gentile suggest to measure the complexity of a concept class by the complexity of its covers [AG98]. These notions are closely related to the Vapnik Chervonenkis dimension which captures somehow the capacity of a concept class and thus...

...13) Remark 2.1. Left inequality can be improved using the VC complexity index and related information theory results; see for instance [2]. Furthermore, note that fairly strong surjectivity requirements are not a heavy limitation to the learning algorithms; they essentially...

Cited by:   More
Narrowing confidence interval width of SVM learning risk.. - Apolloni, Malchiodi   (Correct)
Algorithmic Information Theory and Machine Learning - Bousquet, Yvon (2000)   (Correct)

Active bibliography (related documents):   More   All
0.6:   Knowledge Acquisition in Statistical Learning Theory - Fine (1999)   (Correct)
0.2:   Learning Dynamical Systems in a Stationary Environment - Campi, Kumar (1996)   (Correct)
0.2:   Probabilistic Analysis of Learning in Artificial Neural Networks: .. - Anthony (1994)   (Correct)

Similar documents based on text:   More   All
0.4:   Journal of Machine Learning Research 2 (2001) 213-242.. - Cation Algorithm Claudio   (Correct)
0.3:   Neural Cooperating Procedure for Fractal Analysis.. - Apolloni..   (Correct)
0.3:   Correlation Collapse under Persistent Input Derangement .. - Apolloni, de Falco..   (Correct)

Related documents from co-citation:   More   All
2:   A formal theory of inductive inference (context) - Solomono - 1964
2:   An Introduction to Kolmogorov Complexity and Its Applications - Li, Vitanyi - 1997
2:   Communications of the ACM (context) - Valiant, of et al. - 1984

BibTeX entry:   (Update)

B. Apolloni and C. Gentile, Sample size lower bounds in pac learning by algorithmic complexity theory, 1998. http://citeseer.ist.psu.edu/apolloni98sample.html   More

@article{ apolloni98sample,
    author = "B. Apolloni and C. Gentile",
    title = "Sample size lower bounds in {PAC} learning by {Algorithmic Complexity Theory}",
    journal = "Theoretical Computer Science",
    volume = "209",
    number = "1--2",
    pages = "141--162",
    year = "1998",
    url = "citeseer.ist.psu.edu/apolloni98sample.html" }
Citations (may not include all citations):
660   An introduction to Kolmogorov Complexity and its Application.. - LI, VITANYI - 1993
493   Communication of ACM (context) - VALIANT, of et al. - 1984
465   Learnability and the Vapnik- Chervonenkis Dimension (context) - BLUMER, EHRENFEUCHT et al. - 1989
348   Estimation of dependences based on empirical data (context) - VAPNIK - 1982
151   A General Lower Bound on the Number of Examples Needed for L.. (context) - EHRENFEUCHT, HAUSSLER et al. - 1988
142   Learning from Noisy Examples (context) - ANGLUIN, LAIRD - 1988
115   the density of families of sets (context) - SAUER - 1972
107   Fractal geometry (context) - FALCONER - 1990
94   Learning in the presence of malicious errors - KEARNS, LI - 1988
85   Bounds on the Sample Complexity of Bayesian Learning Using I.. - HAUSSLER, KEARNS et al. - 1994
60   Introduction to stochastic processes (context) - CINLAR - 1975
52   Learning from good and bad data (context) - LAIRD - 1988
47   Information and Randomness (context) - CALUDE - 1994
37   Statistical Queries and Faulty PAC Oracles - DECATUR - 1993
34   Learnability by Fixed Distributions (context) - BENEDEK, ITAI - 1991
23   A Markovian Extension of Valiant's Learning Model (context) - ALDOUS, VAZIRANI - 1995
13   General Bounds on the Number of Examples Needed for Learning.. (context) - SIMON - 1993
12   Kluwer Academic Publishers (context) - YOUNG, theory et al. - 1993
11   Randomness conservation inequalities; information and indepe.. (context) - LEVIN - 1984
8   Probably approximate learning over classes of distributions (context) - NATARAJAN - 1992
8   Exploiting Random Walks for Learning - BARTLETT, FISCHER et al. - 1994
7   Investigating the Distribution Assumptions in the PAC Learni.. (context) - BARTLETT, WILLIAMSON - 1991
2   Noise-tolerant Learning Near the Information-theoretic Bound (context) - CESA-BIANCHI, DICHTERMANN et al.

Documents on the same site (http://laren.usr.dsi.unimi.it/en/articles.html):   More
P-sufficient statistics for PAC learning k-term-DNF formulas .. - Apolloni, Gentile   (Correct)
A Hybrid Symbolic Subsymbolic Controller for Complex.. - Apolloni, Piccolboni..   (Correct)
Correlation Collapse under Persistent Input Derangement .. - Apolloni, de Falco..   (Correct)

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC