Download:
|
by Sreerama K. Murthy, Simon Kasif, Steven Salzberg, Richard Beigel
http://www.eecs.uic.edu/~beigel/papers/mksb-OC1-aaai.PS.gz
Add To MetaCart
Abstract:
This paper introduces OC1, a new algorithm for generating multivariate decision trees. Multivariate trees classify examples by testing linear combinations of the features at each non-leaf node of the tree. Each test is equivalent to a hyperplane at an oblique orientation to the axes. Because of the computational intractability of finding an optimal orientation for these hyperplanes, heuristic methods must be used to produce good trees. This paper explores a new method that combines deterministic and randomized procedures to search for a good tree. Experiments on several different real-world data sets demonstrate that the method consistently finds much smaller trees than comparable methods using univariate tests. In addition, the accuracy of the trees found with our method matches or exceeds the best results of other machine learning methods.
Citations
|
2489
|
Induction of Decision Trees
– Quinlan
- 1986
|
|
2438
|
Classification and Regression Trees
– Breiman, Friedman, et al.
- 1984
|
|
265
|
Inferring decision trees using the minimum description length principle
– Quinlan, Rivest
- 1989
|
|
153
|
A Nearest Hyperrectangle Learning Method
– Salzberg
- 1991
|
|
151
|
An Empirical Comparison of Pruning Methods for Decision Tree
– Mingers
- 1987
|
|
120
|
An empirical comparison of pattern recognition, neural nets, and machine learning classification methods
– Weiss, Kapouleas
- 1989
|
|
80
|
Learning Oblique Decision Trees
– Heath, Kasif, et al.
- 1993
|
|
77
|
Pattern Recognition and Scene Analysis
– Duda, Hart
- 1973
|
|
62
|
Pattern Recognition via Linear Programming: Theory and Application to Medical Diagnosis
– Mangasarian, Setiono, et al.
- 1989
|
|
31
|
Linear machine decision trees
– Utgoff, Brodley
- 1991
|
|
17
|
A Geometric Framework for Machine Learning
– Heath
- 1992
|
|
13
|
Distance metrics for instance-based learning
– Salzberg
- 1991
|
|
5
|
The attribute specification problem in decision tree generation
– Fayyad, Irani
- 1992
|
