(Enter summary)
Abstract: This paper is about constructing and evaluating pointwise confidence
bounds on an ROC curve. We describe four confidencebound
methods, two from the medical field and two used previously
in machine learning research. We evaluate whether the
bounds indeed contain the relevant operating point on the "true"
ROC curve with a confidence of 1-#. We then evaluate pointwise
confidence bounds on the region where the future performance of
a model is expected to lie. For evaluation we use a synthetic
... (Update)
Cited by: More
ROC Confidence Bands: An Empirical Evaluation - Sofus Macskassy Smacskas (2005)
(Correct)
Active bibliography (related documents): More All
0.3: Receiver Operating Characteristic analysis for.. - Tilbury, Van.. (2000)
(Correct)
0.3: Detection of Malignancy Associated Changes in Cervical Cells.. - Hallinan (1999)
(Correct)
0.3: Bayesian Inference for Reliable Biomedical Signal Processing - Sykacek (2000)
(Correct)
System load high. Please wait...
Timeout. Please try your query later.
Similar documents based on text: More All
1.0: Confidence Bands for ROC Curves - Macskassy, Provost, Littman (2003)
(Correct)
0.4: Tree Induction vs. Logistic Regression: A Learning-Curve.. - Perlich, Provost, Simonoff (2003)
(Correct)
0.4: A Simple Relational Classifier - Macskassy, Provost (2003)
(Correct)
BibTeX entry: (Update)
Macskassy, S., Provost, F., & Rosset, S. (2005). Pointwise ROC Confidence Bounds: An Empirical Evaluation. Proceedings of the Workshop on ROC Analysis in Machine Learning (ROCML-2005) at ICML-2005. http://citeseer.ist.psu.edu/macskassy05pointwise.html More
@misc{ macskassy05pointwise,
author = "S. Macskassy and F. Provost and S. Rosset",
title = "Pointwise ROC Confidence Bounds: An Empirical Evaluation",
text = "Macskassy, S., Provost, F., & Rosset, S. (2005). Pointwise ROC Confidence
Bounds: An Empirical Evaluation. Proceedings of the Workshop on ROC Analysis
in Machine Learning (ROCML-2005) at ICML-2005.",
year = "2005",
url = "citeseer.ist.psu.edu/macskassy05pointwise.html" }
Citations (may not include all citations):
546
An Introduction to the Bootstrap (context) - Efron, Tibshirani - 1993
70
The case against accuracy estimation for comparing induction..
- Provost, Fawcett et al. - 1998
53
Robust classification for imprecise environments
- Provost, Fawcett - 2001
15
Bootstrap methods for the cost-sensitive evaluation of class..
- Margineantu, Dietterich - 2000
13
ROC Graphs: Notes and Practical Considerations for Data Mini..
- Fawcett - 2003
9
Using Asymmetric Distributions to Improve Text Classifier Pr.. (context) - Bennett - 2003
4
Maximum-likelihood estimation of parameters of signal-detect.. (context) - Dorfman, Alf - 1969
3
Receiver-operating characteristic (context) - Zweig, Campbell - 1993
3
Distribution-free confidence bounds for ROC curves (context) - Hilgers - 1993
3
Statistical Comparison of Two ROC-curve Estimates Obtained f.. (context) - Metz, Herman et al. - 1998
2
Advances in statistical methodology for the evaluation of di.. (context) - Campbell - 1994
2
Empirical likelihood confidence regions for comparison distr.. (context) - Claeskens, Jing et al. - 2003
2
Nonparametric confidence intervals for receiver operating ch.. (context) - Hall, Hyndman et al. - 2004
2
Confidence Bands for ROC Curves: Methods and an Empirical St.. (context) - Macskassy, Provost - 2004
2
Benchmarking Default Prediction Models: Pitfalls and Remedie.. (context) - Stein - 2002
2
Application of the theory of error to the interpreation of t.. (context) - Working, Hotelling - 1929
1
Improved methods for bandwidth selection when estimating roc.. (context) - Hall, Hyndman - 2003
1
Receiver operating characteristic analysis for intelligent m..
- Tilbury, Eetvelt et al. - 2000
1
ROC Confidence Bands: An Empirical Evaluation
- Macskassy, Provost et al. - 2005
1
The use of relative operating characteristic (context) - Beck, Shultz - 1986
Documents on the same site (http://www.dsic.upv.es/~flip/ROCML2005/papers.html): More
The Expected Performance Curve - Samy Bengio Bengio (2005)
(Correct)
Bagging Evolutionary ROC-based Hypotheses - Application.. - Azé, Roche, Michèle.. (2005)
(Correct)
AUC Maximizing Support Vector Learning - Brefeld, Scheffer (2005)
(Correct)
Online articles have much greater impact More about CiteSeer.IST Add search form to your site Submit documents Feedback
CiteSeer.IST - Copyright Penn State and NEC