Feature Subset Selection by Bayesian networks: a comparison with genetic and sequential algorithms

Feature Subset Selection by Bayesian networks: a comparison with genetic and sequential algorithms

Cached

Download Links

[www.sc.ehu.es]
[www.sc.ehu.es]
[www.sc.ehu.es]

Other Repositories/Bibliography

DBLP

by I. Inza , P. Larrañaga , B. Sierra

Citations:

35 - 13 self

BibTeX

@MISC{Inza_featuresubset,
    author = {I. Inza and P. Larrañaga and B. Sierra},
    title = {Feature Subset Selection by Bayesian networks: a comparison with genetic and sequential algorithms},
    year = {}
}

Bookmark

OpenURL

Abstract

In this paper we perform a comparison among FSS-EBNA, a randomized, populationbased and evolutionary algorithm, and two genetic and other two sequential search approaches in the well known Feature Subset Selection (FSS) problem. In FSS-EBNA, the FSS problem, stated as a search problem, uses the EBNA (Estimation of Bayesian Network Algorithm) search engine, an algorithm within the EDA (Estimation of Distribution Algorithm) approach. The EDA paradigm is born from the roots of the GA community in order to explicitly discover the relationships among the features of the problem and not disrupt them by genetic recombination operators. The EDA paradigm avoids the use of recombination operators and it guarantees the evolution of the population of solutions and the discovery of these relationships by the factorization of the probability distribution of best individuals in each generation of the search. In EBNA, this factorization is carried out by a Bayesian network induced by a chea...

Citations

5664	Probabilistic Reasoning in Intelligent Systems - Pearl - 1988
2888	Induction of Decision Trees - Quinlan - 1986
1581	Estimating the dimension of a model - SCHWARZ - 1978
1433	Genetic algorithms in search, optimization, and machine learning - Goldberg - 1989
897	Instance-Based Learning Algorithms - Aha, Kibler, et al. - 1991
877	A Bayesian method for the induction of probabilistic networks from data - Cooper, Herskovits - 1992
844	Graphical Models - Lauritzen - 1996
775	G: Wrappers for Feature Subset Selection - Kohavi, John - 1996
752	Learning Bayesian networks: the combination of knowledge and statistical data - Heckerman, Geiger, et al. - 1995
739	A Comparative Study on Feature Selection in Text Categorization - Yang
687	Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms - Bäck - 1996
662	Repository of machine learning databases - Murphy, Aha - 1994
528	A study of cross-validation and bootstrap for accuracy estimation and model selection - Kohavi - 1995
515	K: Irrelevant features and the subset selection problem - GH, Kohavi, et al.
474	Uniform crossover in genetic algorithms - Syswerda - 1989
314	Data Mining : An Overview from a Database Perspective - Chen, Han, et al.
301	Toward optimal feature selection - Koller, Sahami - 1996
274	Inferring decision trees using the minimum description length principle. Information and Computation 80.227–248 - QUINLAN, RIVEST - 1989
257	Population-based incremental learning: a method for integrating genetic search based function optimization and competitive et al - Baluja - 1994
241	F: A survey of optimization by building and using probabilistic models - Pelikan, DE, et al.
238	Feature selection: Evaluation, application, and small sample performance - JAIN, ZONGKER - 1997
219	BOA: The Bayesian Optimization Algorithm - Pelikan
205	From recombination of genes to the estimation of distributions: I. binary parameters - Muhlenbein, PaaB - 1996
203	Feature selection for knowledge discovery & data mining - Liu, Motoda - 1998
201	The Feature Selection Problem: Traditional Methods and a New Algorithm - Kira, Rendell - 1992
198	Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation - Larranaga, Lozano - 2002
190	A parameter-less genetic algorithm - Harik, Lobo - 1999
183	AJ: Subset selection in regression - Miller - 1990
179	Induction of selective bayesian classifiers - Langley, Sage - 1994
178	Linkage learning via probabilistic modeling in the ecga - Harik - 1999
172	Greedy attribute selection - Caruana, Freitag
158	Propagating uncertainty in Bayesian networks by probabilistic logic sampling, in - Henrion - 1988
153	Theory refinement on bayesian networks - Buntine - 1991
153	A branch and bound algorithm for feature subset selection - NARENDRA, FUKUNAGA - 1977
152	Deliberation scheduling for problem solving in time-constrained environments - Boddy, Dean - 1994
148	Feature subset selection using a genetic algorithm - YANG, V - 1998
147	Conditional independence in statistical theory - Dawid - 1979
146	Expert systems and probabilistic network models - Castillo, Gutierrez, et al. - 1997
122	Prototype and feature selection by sampling and random mutation hill climbing algorithms - Skalak - 1994
118	MIMIC: Finding Optima by Estimating Probability Densities - Bonet, Isbell, et al. - 1997
117	M.S.: Efficient algorithms for minimizing cross validation error - Moore, Lee - 1994
111	Using optimal dependency-trees for combinatorial optimization: Learning the structure of the search space - Baluja, Davies - 1997
98	D.: Learning bayesian networks is np-hard - Chickering, Geiger, et al. - 1994
96	Comparison of algorithms that select features for pattern recognition - Kudo, Sklansky
88	The equation for response to selection and its use for prediction - Muhlenbein - 1998
85	Using decision trees to improve case-based learning - Cardie - 1993
83	The bivariate marginal distribution algorithm - Pelikan, Mühlenbein - 1999
82	Schemata, distributions and graphical models in evolutionary optimization - Mühlenbein, Mahnig, et al. - 1999
77	Dimensionality and sample size considerations in pattern recognition practice - Jain, Chandrasekaran - 1982
74	A survey of methods for scaling up inductive algorithms. Data Mining and Knowledge Discovery - Provost, Kolluri - 1999