Download:
|
by Ron Meir, Ran El-yaniv, Shai Ben-david
in Proceedings of the 13th Annual Conference on Computational Learning Theory
http://www.cs.technion.ac.il/~rani/papers/Colt2000_final.ps
Add To MetaCart
Abstract:
We introduce and analyze LocBoost, a new boosting algorithm, which leads to the incremental construction of a mixture of experts type architecture. We provide upper bounds on the expected loss of such models in terms of the smoothness properties of the gating functions appearing in the mixture of experts model. Furthermore, an incremental algorithm is proposed for the construction of the classifier, based on a maximum-likelihood approach and the EM algorithm. Preliminary numerical results appear to be promising. 1
Citations
|
5825
|
Introduction to Algorithms
– Cormen, Leiserson, et al.
- 2001
|
|
4344
|
Maximum likelihood from incomplete data via the EM algorithm
– Dempster, Laird, et al.
- 1977
|
|
1004
|
Experiments with a new boosting algorithm
– Schapire
- 1996
|
|
593
|
Hierarchical Mixtures of Experts and the EM algorithm
– Jordan, Jacobs
- 1993
|
|
573
|
A Probabilistic Theory of Pattern Recognition
– Devroye, Gyorfi, et al.
- 1996
|
|
543
|
Additive logistic regression: a statistical view of boosting
– Friedman, Hastie, et al.
|
|
483
|
Boosting the Margin: A New Explanation for the Effectiveness of Voting Methods
– Schapire, Freund, et al.
- 1997
|
|
389
|
Improved boosting algorithms using confidence-rated predictions
– Schapire, Singer
- 1998
|
|
194
|
Neural Network Learning: Theoretical Foundations
– ANTHONY, BARTLETT
- 1999
|
|
105
|
Functional gradient techniques for combining hypotheses
– Mason, Baxter, et al.
- 1999
|
|
70
|
Perceptron-Based Learning Algorithms
– Gallant
- 1990
|
|
60
|
Arcing the edge
– Breiman
- 1997
|
|
55
|
Improved generalization through explicit optimization of margins. Machine Learning 38(3):243–255
– Mason, Bartlett, et al.
- 2000
|
|
21
|
Estimation of Mixture Models
– Li
- 1999
|
|
19
|
Regularizing adaboost
– Rätsch, Onoda, et al.
- 1998
|
|
15
|
A simple cost function for boosting
– Frean, Downs
- 1998
|
|
14
|
Minimax nonparametric classification - Part I: rates of convergence
– Yang
- 1999
|
|
5
|
Matching pursuit with time-frequencey dictionaries
– Mallat, Zhang
- 1993
|
|
5
|
DynamBoost: combining boosted hypotheses in a dynamic way
– Moerland, Mayoraz
- 1999
|
|
4
|
Boosting classifiers locally
– Maclin
- 1998
|
|
4
|
Theory of Statistics
– Schervich
- 1995
|
