| M. Kearns, Y. Mansour, and A. Y. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. In Learning in Graphical Models. Kluwer AP, 1998. |
....to soft EM clustering, where each sample o gets fractionally assigned to a cluster j according to the posterior probability P (j o, #) and each model is trained using the posterior probability weighted samples. An information theoretic analysis of these two assignment strategies has been given in [21]. Let us analyze these two algorithms from the perspective of objective function and explain why they usually perform very similarly in practice. The general log likelihood objective function to be maximized for model based partitional clustering can be written as # , 2.1) where # ....
M. Kearns, Y. Mansour, and A. Y. Ng. An informationtheoretic analysis of hard and soft assignment methods for clustering. In Proc. 13th Uncertainty in Artificial Intelligence, pages 282--293, 1997.
....small number of prominent classes in a data set with multidimensionality. However, the centroids with huge dimensionality are hard to interpret in SOM. Moreover the robustness of SOM is also a problem especially when the number of clusters is unknown or the data set is sparse. 15 Kearns et al.[Kearns et al. 1998] gave an information theoretic analysis of hard assignments (used by K means) and soft assignments (used by EM algorithm) for clustering and proposed a posterior partition algorithm which is close to the soft assignments of EM for clustering. The relationship between maximum likelihood and ....
M. Kearns, Y. Mansour, and A. Y. Ng, \An Information-theoretic Analysis of Hard and Soft Assignment Methods for Clustering," In Learning in Graphical Models. Kluwer AP, 1998.
.... and astrophysics (see, e.g. 8, 32] for pointers to the literature) A classic approach to the problem of learning mixtures of Gaussians is to utilize a local search technique called Expectation Maximization (EM) The EM algorithm is often described as a probabilistic version of k means [24]. The objective of the EM algorithm is to maximize the likelihood between the actual and computed parameters of the Gaus11 sians. Just as k means is susceptible to local minima, unless the initial parameters are chosen carefully, the EM algorithm is susceptible to local maxima. The first ....
M. Kearns, Y. Mansour, and A. Ng. An information-theoretic analysis of hard and soft assignment methods of clustering. In Proceedings of the 13th Conference on Uncertainty in Artificial Intelligence, pages 282--293, August 1997. 110
....given in this paper enables soft assignment, whereby each sequence is partially assigned to a cluster according to the cluster a posteriori probability given the sequence. This EM based algorithm is much preferred in noisy data situations or when the underlying densities are with more overlap [10]. 3. Background: HMMs In this section, we give a brief review of hidden Markov models (HMMs) Our main purpose is to define notation used in our clustering formulation. For a detailed overview of HMMs, readers are directed to [14] A complete specification of a first order HMM with a simple ....
M. Kearns, Y. Mansour, and A. Ng. An informationtheoretic analysis of hard and soft assignment methods for clustering. In Uncertainty in Artificial Intelligence, pages 282--293, 1997.
No context found.
M. Kearns, Y. Mansour, and A. Y. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. In Learning in Graphical Models. Kluwer AP, 1998.
No context found.
M. Kearns, Y. Mansour, and A. Y. Ng, \An Information-theoretic Analysis of Hard and Soft Assignment Methods for Clustering," In Learning in Graphical Models. Kluwer AP, 1998.
No context found.
Kearns, M., Y. Mansour, and A. Y. Ng (1997). An information-theoretic analysis of hard and soft assignment methods for clustering. In Proceedings of the Thirteenth Annual Conference on Uncertainty in Artificial Intelligence (UAI-- 97), San Francisco, CA, pp. 282--293. Morgan Kaufmann Publishers.
No context found.
Kearns, M., Y. Mansour, and A. Y. Ng (1997). An information-theoretic analysis of hard and soft assignment methods for clustering. In Proceedings of the Thirteenth Annual Conference on Uncertainty in Artificial Intelligence (UAI-- 97), San Francisco, CA, pp. 282--293. Morgan Kaufmann Publishers.
No context found.
M. Kearns, Y. Mansour, and A. Y. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence, pages 282--293, 1997.
No context found.
M. Kearns, Y. Mansour, and A. Ng. An informationtheoretic analysis of hard and soft assignment methods for clustering. In Proc. 13th UAI, pages 282-293, 1997.
No context found.
M. Kearns, Y. Mansour, and A. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. In 13th Annual Conf. on Uncertainty in Arti cial Intelligence (UAI97), 1997.
No context found.
Michael Kearns, Yishay Mansour, and Andrew Y. Ng. An informationtheoretic analysis of hard and soft assignment methods for clustering. In Proceedings of Uncertainty in Arti cial Intelligence, pages 282-293. AAAI, 1997.
No context found.
M. Kearns, Y. Mansour, A. Ng, "An information-theoretic analysis of hard and soft assignment methods for clustering," Proc. 13th Conference on Uncertainty in Artificial Intelligence, 1997.
No context found.
M. Kearns, Y. Mansour, and A. Y. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. In Proceedings of Uncertainty in Arti cial Intelligence, pages 282-293. AAAI, 1997.
No context found.
M. Kearns, Y. Mansour, and A. Ng. An informationtheoretic analysis of hard and soft assignment methods for clustering. In Proc. 13th UAI, pages 282-293, 1997.
No context found.
M. J. Kearns, Y. Mansour, and A. Y. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. In M.I. Jordan, editor, Learning in Graphical Models, pages 495--520. Kluwer, 1998.
No context found.
Michael Kearns, Yishay Mansour, and Andrew Y. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. In Proc. of 13th Conf. on Uncertainty in Artificial Intelligence (UAI-97), pages 282--293, 1997.
No context found.
Michael Kearns, Yishay Mansour, and Andrew Y Ng, "An information-theoretic analysis of hard and soft assignment methods for clustering," in Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence. 1997, pp. 282--293, Morgan Kaufmann.
No context found.
M. Kearns, Y. Mansour, and A. Y. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. In Proceedings of 13th Conference on Uncertainty in Artificial Intelligence (UAI-97), pages 282--293, 1997.
No context found.
Kearns, M., Mansour, Y., and Ng, A. Y. An information-theoretic analysis of hard and soft assignment methods for clustering. In Proceedings of Uncertainty in Arti cial Intelligence (1997), pp. 282-293.
No context found.
M. Kearns, Y. Mansour, and A. Y. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence, pages 282-- 293, 1997.
No context found.
M. Kearns, Y. Mansour, and A. Y. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence, pages 282--293, 1997.
No context found.
M. Kearns, Y. Mansour, and A. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. In 13th Annual Conf. on Uncertainty in Artificial Intelligence (UAI97), 1997.
No context found.
M. Kearns, Y. Mansour, and A. Ng. An information-theoretic analysis of hard and soft assignment methods for clustering. In 13th Annual Conf. on Uncertainty in Artificial Intelligence (UAI97), 1997.
No context found.
Kearns M., Mansour Y., and Ng A.Y. \An information-theoretic analysis of hard and soft assignment methods for clustering", in Proc. Uncertainty in Arti cial Intelligence, pp. 282{ 293, 1997.
First 50 documents
Online articles have much greater impact More about CiteSeer.IST Add search form to your site Submit documents Feedback
CiteSeer.IST - Copyright Penn State and NEC