Effects of Different Types of New Attribute on Constructive Induction
|
Abstract:
This paper studies the effects on decision tree learning of constructing four types of attribute (conjunctive, disjunctive, M-of-N, and X-of-N representations). To reduce effects of other factors such as tree learning methods, new attribute search strategies, evaluation functions, and stopping criteria, a single tree learning algorithm is developed. With different option settings, it can construct four different types of new attribute, but all other factors are fixed. The study reveals that conjunctive and disjunctive representations have very similar performance in terms of prediction accuracy and theory complexity on a variety of concepts. Moreover, the study demonstrates that the stronger representation power of M-of-N than conjunction and disjunction and the stronger representation power of X-of-N than these three types of new attribute can be reflected in the performance of decision tree learning. 1.
Citations
| 3215 | C4.5: Programs for Machine Learning – Quinlan - 1993 |
| 655 | UCI Repository of Machine Learning Databases [machine-readable data repository – Murphy, Aha - 1992 |
| 54 | Id2-of-3: Constructive induction of m-of-n concepts for discriminators in decision trees – Murphy, Pazzani - 1991 |
| 53 | Lookahead feature construction for learning hard concepts – Ragavan, Rendell - 1993 |
| 29 | Pattern Recognition as Knowledge-Guided Computer Induction – Michalski - 1978 |
| 25 | Multistrategy Constructive Induction: AQ17-MCI – Bloedorn, Michalski, et al. - 1993 |
| 25 | Adaptive Decision Tree Algorithms for Learning From Examples – Pagallo - 1990 |
| 14 | Constructing nominal x-of-n attributes – Zheng - 1995 |
| 5 | Continuous-valued X-of-N attributes versus nominal X-of-N attributes for constructive induction: a case study – Zheng - 1995 |
| 1 | A comparison of constructive induction with different types of new attribute – Zheng - 1996 |
