by Roberto Ruiz, Jesús S. Aguilar-ruiz, José C. Riquelme
http://www.upo.es/eps/aguilar/papers/SOAP%20Efficient%20Feature%20Selection%20of%20Numeric%20Attributes.pdf
Add To MetaCart
Abstract:
Abstract. The attribute selection techniques for supervised learning, used in the preprocessing phase to emphasize the most relevant attributes, allow making models of classification simpler and easy to understand. Depending on the method to apply: starting point, search organization, evaluation strategy, and the stopping criterion, there is an added cost to the classification algorithm that we are going to use, that normally will be compensated, in greater or smaller extent, by the attribute reduction in the classification model. The algorithm (SOAP: Selection of Attributes by Projection) has some interesting characteristics: lower computational cost (O(mn log n) m attributes and n examples in the data set) with respect to other typical algorithms due to the absence of distance and statistical calculations; with no need for transformation. The performance of SOAP is analysed in two ways: percentage of reduction and classification. SOAP has been compared to CFS [6] and ReliefF [11]. The results are generated by C4.5 and 1NN before and after the application of the algorithms. 1
Citations
|
3215
|
C4.5: Programs for machine learning
– Quinlan
- 1993
|
|
2489
|
Induction of Decision Trees
– Quinlan
- 1986
|
|
2138
|
UCI Repository of Machine Learning Databases
– Blake, Merz
- 1998
|
|
540
|
Wrappers for Feature Subset Selection
– Kohavi, John
- 1997
|
|
255
|
Toward optimal feature selection
– Koller, Sahami
- 1996
|
|
220
|
A practical approach to feature selection
– Rendell, Kira
- 1992
|
|
191
|
Boolean feature discovery in empirical learning
– Pagallo, Haussler
- 1990
|
|
174
|
Learning With Many Irrelevant Features
– Almuallim, Ditterich
- 1991
|
|
73
|
Learning Boolean Concepts in the Presence of Many Irrelevant Features
– Almuallim, Dietterich
- 1994
|
|
72
|
Fundamentals of Algorithms
– Brassard, Bratley
- 1996
|
|
70
|
A Probabilistic Approach to Feature Selection-A Filter Solution
– Liu, Setiono
- 1996
|
|
50
|
Chi2: Feature selection and discretization of numeric attributes
– Liu, Setiono
- 1995
|
|
48
|
Correlation-based feature selection for machine learning
– Hall
- 1998
|
|
41
|
Neural Network Feature Selector
– Setiono, Liu
- 1997
|
|
35
|
Feature Selection Using Rough Sets Theory
– Modrzejewski
- 1993
|
|
9
|
An adaption of Relief for attribute estimation in regression
– Robnik-Sikonja
- 1997
|
|
7
|
Data set editing by ordered projection
– Aguilar, Riquelme, et al.
- 2000
|
|
3
|
Estimating attibutes: Analisys and extensions of relief
– Kononenko
- 1994
|
