Semi-supervised learning using randomized mincuts

Semi-supervised learning using randomized mincuts (2004)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Avrim Blum , John Lafferty , Mugizi Robert Rwebangira , Rajashekar Reddy

Venue:	In Proceedings of the 21st International Conference on Machine Learning
Citations:	47 - 4 self

BibTeX

@INPROCEEDINGS{Blum04semi-supervisedlearning,
    author = {Avrim Blum and John Lafferty and Mugizi Robert Rwebangira and Rajashekar Reddy},
    title = {Semi-supervised learning using randomized mincuts},
    booktitle = {In Proceedings of the 21st International Conference on Machine Learning},
    year = {2004},
    pages = {97--104}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

In many application domains there is a large amount of unlabeled data but only a very limited amount of labeled training data. One general approach that has been explored for utilizing this unlabeled data is to construct a graph on all the data points based on distance relationships among examples, and then to use the known labels to perform some type of graph partitioning. One natural partitioning to use is the minimum cut that agrees with the labeled data (Blum & Chawla, 2001), which can be thought of as giving the most probable label assignment if one views labels as generated according to a Markov Random Field on the graph. Zhu et al. (2003) propose a cut based on a relaxation of this field, and Joachims (2003) gives an algorithm based on finding an approximate min-ratio cut. In this paper, we extend the mincut approach by adding randomness to the graph structure. The resulting algorithm addresses several shortcomings of the basic mincut approach, and can be given theoretical justification from both a Markov random field perspective and from sample complexity considerations. In cases where the graph does not have small cuts for a given classification problem, randomization may not help. However, our experiments on several datasets show that when the structure of the graph supports small cuts, this can result in highly accurate classifiers with good accuracy/coverage tradeoffs. In addition, we are able to achieve good performance with a very simple graph-construction procedure.

Citations

No citations identified.