Download:
by Zhi-hua Zhou, Jian-xin Wu, Yuan Jiang, Shi-fu Chen
in: Proceedings of the 17th International Joint Conference on Artificial Intelligence
http://cs.nju.edu.cn/people/zhouzh/zhouzh.files/Publication/ijcai01.pdf
Add To MetaCart
Abstract:
Neural network ensemble is a learning paradigm where several neural networks are jointly used to solve a problem. In this paper, the relationship between the generalization ability of the neural network ensemble and the correlation of the individual neural networks is analyzed, which reveals that ensembling a selective subset of individual networks is superior to ensembling all the individual networks in some cases. Therefore an approach named GASEN is proposed, which trains several individual neural networks and then employs genetic algorithm to select an optimum subset of individual networks to constitute an ensemble. Experimental results show that, comparing with a popular ensemble approach, i.e. averaging all, and a theoretically optimum selective ensemble approach, i.e. enumerating, GASEN has preferable performance in generating ensembles with strong generalization ability in relatively small computational cost. 1
Citations
|
4828
|
Genetic Algorithms
– Goldberg
- 1989
|
|
2138
|
UCI Repository of Machine Learning Databases
– Merz, Murphy
- 1996
|
|
1453
|
Bagging Predictors
– Breiman
- 1996
|
|
509
|
C4.5: Programs for
– Quinlan
- 1993
|
|
431
|
Learning representation by back propagating errors
– Rumelhart, Hinton, et al.
- 1986
|
|
368
|
Neural network ensembles
– Hansen, Salamon
- 1990
|
|
308
|
Neural network ensembles, cross validation, and active learning
– Krogh, Vedelsby
- 1995
|
|
157
|
Multivariate adaptive regression splines (with discussion). The Annals of Statistics
– Friedman
- 1991
|
|
98
|
Estimating optimal transformations for multiple regression and correlation
– Breiman, Friedman
- 1985
|
|
55
|
expert-level performance on a scienti c image analysis task by a system using combined arti cial neural networks
– Cherkauer, Human
- 1996
|
|
51
|
Making use of population information in evolutionary artificial neural networks
– Yao, Liu
- 1998
|
|
42
|
A Genetic Algorithm for function OpTimization: A Matlab implementation
– Houck, Joines, et al.
- 1995
|
|
38
|
Learning with ensembles: how overfitting can be useful
– Sollich, Krogh
- 1996
|
|
30
|
Ensemble learning via negative correlation
– Liu, Yao
- 1999
|
|
24
|
Pose invariant face recognition
– Huang, Chen, et al.
- 2000
|
|
16
|
A case study on bagging, boosting and basic ensembles of neural networks for OCR
– Mao
- 1998
|
|
16
|
Classification of Seismic Signals by Integrating Ensembles of Neural Networks
– Shimshoni, Intrator
- 1998
|
|
15
|
Ensemble methods for handwritten digit recognition
– Hansen, Liisberg, et al.
- 1992
|
|
12
|
Face Recognition Using Hybrid Classifier Systems
– Gutta, Wechsler
- 1996
|
