See this document in CiteSeerX!

Pointwise ROC Confidence Bounds: An Empirical Evaluation (2005)  (Make Corrections)  (1 citation)
Sofus A. Macskassy Foster Provost...



  Home/Search   Context   Related

 
View or download:
dsic.upv.es/%7Eflip...macskassy1CRC.pdf
Cached:  PDF   PS.gz  PS  Image  Update  Help

From:  dsic.upv.es/~flip/ROCML2...papers (more)
(Enter author homepages)

Rate this article: (best)
  Comment on this article  
(Enter summary)

Abstract: This paper is about constructing and evaluating pointwise confidence bounds on an ROC curve. We describe four confidencebound methods, two from the medical field and two used previously in machine learning research. We evaluate whether the bounds indeed contain the relevant operating point on the "true" ROC curve with a confidence of 1-#. We then evaluate pointwise confidence bounds on the region where the future performance of a model is expected to lie. For evaluation we use a synthetic ... (Update)

Cited by:   More
ROC Confidence Bands: An Empirical Evaluation - Sofus Macskassy Smacskas (2005)   (Correct)

Active bibliography (related documents):   More   All
0.3:   Receiver Operating Characteristic analysis for.. - Tilbury, Van.. (2000)   (Correct)
0.3:   Detection of Malignancy Associated Changes in Cervical Cells.. - Hallinan (1999)   (Correct)
0.3:   Bayesian Inference for Reliable Biomedical Signal Processing - Sykacek (2000)   (Correct)

System load high. Please wait...
Timeout. Please try your query later.
Similar documents based on text:   More   All
1.0:   Confidence Bands for ROC Curves - Macskassy, Provost, Littman (2003)   (Correct)
0.4:   Tree Induction vs. Logistic Regression: A Learning-Curve.. - Perlich, Provost, Simonoff (2003)   (Correct)
0.4:   A Simple Relational Classifier - Macskassy, Provost (2003)   (Correct)

BibTeX entry:   (Update)

Macskassy, S., Provost, F., & Rosset, S. (2005). Pointwise ROC Confidence Bounds: An Empirical Evaluation. Proceedings of the Workshop on ROC Analysis in Machine Learning (ROCML-2005) at ICML-2005. http://citeseer.ist.psu.edu/macskassy05pointwise.html   More

@misc{ macskassy05pointwise,
  author = "S. Macskassy and F. Provost and S. Rosset",
  title = "Pointwise ROC Confidence Bounds: An Empirical Evaluation",
  text = "Macskassy, S., Provost, F., & Rosset, S. (2005). Pointwise ROC Confidence
    Bounds: An Empirical Evaluation. Proceedings of the Workshop on ROC Analysis
    in Machine Learning (ROCML-2005) at ICML-2005.",
  year = "2005",
  url = "citeseer.ist.psu.edu/macskassy05pointwise.html" }
Citations (may not include all citations):
546   An Introduction to the Bootstrap (context) - Efron, Tibshirani - 1993
70   The case against accuracy estimation for comparing induction.. - Provost, Fawcett et al. - 1998
53   Robust classification for imprecise environments - Provost, Fawcett - 2001
15   Bootstrap methods for the cost-sensitive evaluation of class.. - Margineantu, Dietterich - 2000
13   ROC Graphs: Notes and Practical Considerations for Data Mini.. - Fawcett - 2003
9   Using Asymmetric Distributions to Improve Text Classifier Pr.. (context) - Bennett - 2003
4   Maximum-likelihood estimation of parameters of signal-detect.. (context) - Dorfman, Alf - 1969
3   Receiver-operating characteristic (context) - Zweig, Campbell - 1993
3   Distribution-free confidence bounds for ROC curves (context) - Hilgers - 1993
3   Statistical Comparison of Two ROC-curve Estimates Obtained f.. (context) - Metz, Herman et al. - 1998
2   Advances in statistical methodology for the evaluation of di.. (context) - Campbell - 1994
2   Empirical likelihood confidence regions for comparison distr.. (context) - Claeskens, Jing et al. - 2003
2   Nonparametric confidence intervals for receiver operating ch.. (context) - Hall, Hyndman et al. - 2004
2   Confidence Bands for ROC Curves: Methods and an Empirical St.. (context) - Macskassy, Provost - 2004
2   Benchmarking Default Prediction Models: Pitfalls and Remedie.. (context) - Stein - 2002
2   Application of the theory of error to the interpreation of t.. (context) - Working, Hotelling - 1929
1   Improved methods for bandwidth selection when estimating roc.. (context) - Hall, Hyndman - 2003
1   Receiver operating characteristic analysis for intelligent m.. - Tilbury, Eetvelt et al. - 2000
1   ROC Confidence Bands: An Empirical Evaluation - Macskassy, Provost et al. - 2005
1   The use of relative operating characteristic (context) - Beck, Shultz - 1986

Documents on the same site (http://www.dsic.upv.es/~flip/ROCML2005/papers.html):   More
The Expected Performance Curve - Samy Bengio Bengio (2005)   (Correct)
Bagging Evolutionary ROC-based Hypotheses - Application.. - Azé, Roche, Michèle.. (2005)   (Correct)
AUC Maximizing Support Vector Learning - Brefeld, Scheffer (2005)   (Correct)

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC