Generalized expectation criteria for semi-supervised learning of conditional random fields

Generalized expectation criteria for semi-supervised learning of conditional random fields (2008)

Cached

Download Links

by Gideon S. Mann , Andrew Mccallum

Venue:	In In Proc. ACL, pages 870 – 878
Citations:	35 - 6 self

BibTeX

@INPROCEEDINGS{Mann08generalizedexpectation,
    author = {Gideon S. Mann and Andrew Mccallum},
    title = {Generalized expectation criteria for semi-supervised learning of conditional random fields},
    booktitle = {In In Proc. ACL, pages 870 – 878},
    year = {2008}
}

Bookmark

OpenURL

Abstract

This paper presents a semi-supervised training method for linear-chain conditional random fields that makes use of labeled features rather than labeled instances. This is accomplished by using generalized expectation criteria to express a preference for parameter settings in which the model’s distribution on unlabeled data matches a target distribution. We induce target conditional probability distributions of labels given features from both annotated feature occurrences in context and adhoc feature majority label assignment. The use of generalized expectation criteria allows for a dramatic reduction in annotation time by shifting from traditional instance-labeling to feature-labeling, and the methods presented outperform traditional CRF training and other semi-supervised methods when limited human effort is available. 1

Citations

509	Transductive Inference for Text Classification using Support Vector Machines - Joachims - 1999
202	A framework for learning predictive structures from multiple tasks and unlabeled data. Journal of Machine Learning Research - Ando, Zhang - 2005
160	Partially labeled classification with Markov random walks - Szummer, Jaakkola - 2008
140	Learning to classify text from labeled and unlabeled documents - Nigam, McCallum, et al. - 1998
89	Contrastive Estimation: Training Log-Linear Models on Unlabeled Data - Smith, Eisner - 2005
58	Prototype-driven learning for sequence models - Haghighi, Klein - 2006
56	Learning from labeled and unlabeled data with label propagation - Zhu, Ghahramani - 2002
55	Semi-supervised learning by entropy minimization - Grandvalet, Bengio - 2005
41	Incorporating prior knowledge into boosting - Schapire, Rochery, et al. - 2002
40	Learning from labeled features using generalized expectation criteria - Druck, Mann, et al. - 2008
39	Name tagging with word clusters and discriminative training - Miller, Guinness, et al. - 2004
37	Semi-supervised conditional random fields for improved sequence segmentation and labeling - Jiao, Wang, et al. - 2006
32	Guiding semisupervision with constraint-driven learning - Chang, Ratinov, et al. - 2007
31	Optimization with EM and expectationconjugate-gradient - Salakhutdinov, Roweis, et al. - 2003
28	Unsupervised learning of field segmentation models for information extraction - Grenager, Klein, et al. - 2005
28	robust, scalable semi-supervised learning via expectation regularization - Simple
20	Trained named entity recognition using distributional clusters - Freitag - 2004
10	Active learning with feedback on both features and instances - Raghavan, Madani, et al.
6	Hidden-state conditional random fields - Quattoni, Wang, et al.
2	Leveraging existing resources using generalized expectation criteria - Druck, Mann, et al. - 2007
2	Generalized expectation criteria. Computer science technical note - McCallum, Mann, et al. - 2007