See this document in CiteSeerX!

Weight Averaging for Neural Networks and Local Resampling Schemes (1996)  (Make Corrections)  (1 citation)
Joachim Utans



  Home/Search   Context   Related

 
View or download:
fit.edu/~imlm/imlm96/papers/utans.ps
Cached:  PS.gz  PS  PDF   Image  Update  Help

From:  fit.edu/~imlm/imlm96/papers (more)
(Enter author homepages)

Rate this article: (best)
  Comment on this article  
(Enter summary)

Abstract: Recently methods for combining estimators have been popular and enjoyed considerable success. Typically, one obtains several models by considering different model architectures (e.g. linear or nonlinear) or uses different partitions of the data (overlapping or nonoverlapping) for estimating the model. In a final step the outputs of each model are combined, either by assigning fixed weights a priori (e.g. equal weighting) or be estimating these weights from data as well. Here we propose a... (Update)

Context of citations to this paper:   More

...2500 Stability ( No. examples CMM Bagging C4.5 Figure 4: Average stability as a function of the number of artificial examples. [33] combined multiple neural networks into one by averaging parameters, with the goal of achieving performance time computational savings; the...

Cited by:   More
Knowledge Discovery Via Multiple Models - Domingos (1998)   (Correct)

Similar documents (at the sentence level):
5.3%:   Architecture Selection Strategies for Neural Networks.. - Moody, Utans (1995)   (Correct)

Active bibliography (related documents):   More   All
0.3:   A Smoothing Regularizer for Feedforward and Recurrent Neural.. - Wu, Moody (1996)   (Correct)
0.3:   Trading with Committees: A Comparative Study - Rehfuss, Wu, Moody   (Correct)
0.3:   Optimal Linear Combinations of Neural Networks - Hashem (1994)   (Correct)

Similar documents based on text:   More   All
0.2:   NCV: A Machine Learning Development Environment for.. - Davis, Sommer, Musicant   (Correct)
0.2:   Arcing Classifiers - Breiman (1998)   (Correct)
0.2:   Bias, Variance, and Arcing Classifiers - Breiman (1996)   (Correct)

BibTeX entry:   (Update)

J. Utans. Weight averaging for neural networks and local resampling schemes. In Proceedings of the AAAI-96 Workshop on Integrating Multiple Learned Models for Improving and Scaling Machine Learning Algorithms, pages 133--138, Portland, OR, 1996. AAAI Press. http://citeseer.ist.psu.edu/utans96weight.html   More

@misc{ utans96weight,
  author = "J. Utans",
  title = "Weight averaging for neural networks and local resampling schemes",
  text = "J. Utans. Weight averaging for neural networks and local resampling schemes.
    In Proceedings of the AAAI-96 Workshop on Integrating Multiple Learned Models
    for Improving and Scaling Machine Learning Algorithms, pages 133--138, Portland,
    OR, 1996. AAAI Press.",
  year = "1996",
  url = "citeseer.ist.psu.edu/utans96weight.html" }
Citations (may not include all citations):
657   Bagging predictors - Breiman - 1994  ACM   DBLP
413   Adaptive mixtures of local experts (context) - Jacobs, Jordan et al. - 1991
367   Stacked generalization - Wolpert - 1990  ACM
301   Neural networks and the bias/variance dilemma (context) - Geman, Bienenstock et al. - 1992  ACM
109   Stacked regression (context) - Breiman - 1992
104   Spline Smoothing and Nonparametric Regression (context) - Eubank - 1988
99   Learning in artificial neural networks: A statistical perspe.. (context) - White - 1989
71   Maximum likelihood estimation of misspecified models (context) - White - 1982
60   Democracy in neural nets: Voting schemes for classification (context) - Battiti, Colla - 1994
29   Learning with ensembles: How over-fitting can be usefull - Sollich, Krogh - 1995
27   Principled architecture selection for neural networks: Appli.. (context) - Moody, Utans - 1992  DBLP
23   Combining forecasts -- twenty years later (context) - Granger - 1989
15   and searching for minimum in neural networks (context) - Sjoberg, Ljung - 1992
15   Cross--validation: A review (context) - Stone - 1978
5   An efficient method to estimate bagging's generalization err.. - Wolpert, Macready - 1996  DBLP
4   Forecasting with more than one model (context) - Bunn - 1989
3   Predicting the U.S. index of industrial production (context) - Moody, Levin et al. - 1993
1   Specification tests for neural networks: A case study in tac.. (context) - Zapranis, Utans et al. - 1996
1   Combining estimators using non-constant weighting functions (context) - Statist, Statistics et al. - 1995  DBLP
1   Improving Regresssion Estimation: Averaging Methods for Vari.. (context) - Perrone - 1993
1   Input variable selection for neural networks: Application to.. (context) - Utans, Moody et al. - 1995

Documents on the same site (http://www.cs.fit.edu/~imlm/imlm96/papers.html):   More
Scaling Up: Distributed Machine Learning with Cooperation - Provost, Hennessy (1996)   (Correct)
On Voting Ensembles of Classifiers (Extended Abstract) - Matan   (Correct)
Classifier Combining: Analytical Results and Implications - Tumer, Ghosh (1995)   (Correct)

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC