See this document in CiteSeerX!

The Case Against Accuracy Estimation for Comparing Induction Algorithms (1997)  (Make Corrections)  (70 citations)
Foster Provost, Tom Fawcett, Ron Kohavi



  Home/Search   Context   Related

 
View or download:
wisc.edu/~shavlik/roc.pdf
Cached:  PS.gz  PS  PDF   Image  Update  Help

From:  wisc.edu/~shavlik/cs760 (more)
(Enter author homepages)

Rate this article: (best)
  Comment on this article  
(Enter summary)

Abstract: We analyze critically the use of classification accuracy to compare classifiers on natural data sets, providing a thorough investigation using ROC analysis, standard machine learning algorithms, and standard benchmark data sets. The results raise serious concerns about the use of accuracy for comparing classifiers and drawinto question the conclusions that can be drawn from such studies. In the course of the presentation, we describe and demonstrate what we believe to be the proper use of ROC... (Update)

Cited by:   More
Anomaly Detection Based on Unsupervised Niche Clustering.. - Leon, Nasraoui, Gomez (2004)   (Correct)
A Geometric Framework for Unsupervised Anomaly - Detection Detecting Intrusions   (Correct)
Machine Learning, 58, 33--38, 2005 2005 Springer Science +.. - Of Roc Analysis   (Correct)

Similar documents (at the sentence level):
51.3%:   The Case Against Accuracy Estimation for Comparing.. - Provost, Fawcett, Kohavi (1998)   (Correct)

Active bibliography (related documents):   More   All
0.5:   Refinement of Neuro-psychological tests for.. - Mani, Dick..   (Correct)
0.1:   Robust Classification for Imprecise Environments - Provost, Fawcett (1989)   (Correct)
0.1:   An Empirical Comparison of Voting Classification Algorithms.. - Bauer, Kohavi (1998)   (Correct)

Similar documents based on text:   More   All
0.4:   Robust Classification Systems for Imprecise Environments - Provost, Fawcett (1998)   (Correct)
0.4:   Analysis and Visualization of Classifier Performance.. - Provost, Fawcett (1997)   (Correct)
0.3:   Explicitly Representing Expected Cost: An Alternative to ROC.. - Drummond, Holte (2000)   (Correct)

Related documents from co-citation:   More   All
22:   Analysis and visualization of classifier performance: Comparison under imprecise.. - Provost, Fawcett - 1997
20:   Programs for machine learning (context) - Quinlan - 1993
15:   Classification and Regression Trees (context) - Breiman, Friedman et al. - 1984

BibTeX entry:   (Update)

F. Provost, T. Fawcett, and Ron Kohavi. The case against accuracy estimation for comparing induction algorithms. In Proc. Fifteenth Intl. Conf. Machine Learning, pages 445--553, Madison, WI, 1998. http://citeseer.ist.psu.edu/provost97case.html   More

@inproceedings{ provost-case,
    author = "Foster J. Provost and Tom Fawcett and Ron Kohavi",
    title = " The Case Against Accuracy Estimation for Comparing Induction Algorithms",
    url = "citeseer.ist.psu.edu/provost97case.html" }
Citations (may not include all citations):
667   UCI repository of machine learning databases (context) - Merz, Murphy - 1998
657   Bagging predictors - Breiman - 1996  ACM   DBLP
190   Wadsworth International Group (context) - Breiman, Friedman et al. - 1984
171   Supervised and unsupervised discretization of continuous fea.. - Dougherty, Kohavi et al. - 1995
164   A study of cross-validation and bootstrap for accuracy estim.. - Kohavi - 1995
116   Beyond independence: Conditions for the optimality of the si.. - Domingos, Pazzani - 1997
107   Approximate statistical tests for comparing supervised class.. - Dietterich - 1998
56   Signal Detection Theory and ROC Analysis (context) - Egan - 1975
55   Measuring the accuracy of diagnostic systems (context) - Swets - 1988
53   The use of the area under the ROC curve in the evaluation of.. (context) - Bradley - 1997
48   Data mining using MLC++ : A machine learning library in C - Kohavi, Sommer et al. - 1997
24   Evaluation of Diagnostic Systems: Methods from Signal Detect.. (context) - andR, Pickett - 1982
21   Data Mining and Knowledge Discovery (context) - Fawcett, Provost et al. - 1997  ACM
19   Cost sensitive learning bibliography (context) - Turney - 1996
15   A conservation law for generalization performance (context) - Scha - 1994  DBLP
2   ers: Pitfalls to avoid and a recommended approach (context) - Salzberg, classi - 1997
1   Tailoring rulesets to misclassi#catioin costs (context) - Catlett - 1995
1   cation systems for imprecise environments (context) - Provost, Fawcett et al. - 1998
1   Analysis and visualization of classi#er performance: Compari.. (context) - Provost, Fawcett - 1997
1   Pruning decision trees with misclassi #cation costs (context) - Bradford, Kunz et al. - 1998



The graph only includes citing articles where the year of publication is known.


Documents on the same site (http://www.cs.wisc.edu/~shavlik/cs760.html):
This Is a Publication of - The American Association   (Correct)

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC