We investigate the relationships between Dirichlet process (DP) based models and allocation models for a variable number of components, based on exchangeable distributions. It is shown that the DP partition distribution is a limiting case of a Dirichlet-Multinomial allocation model. Comparisons of posterior performance of DP and allocation models are made in the Bayesian paradigm and illustrated in the context of univariate mixture models. It is shown in particular that the unbalancedness of the allocation distribution, present in the prior DP model, persists a posteriori. Exploiting the model connections, a new MCMC sampler for general DP based models is introduced, which uses split/merge moves in a reversible jump framework. Performance of this new sampler relative to that of some traditional samplers for DP processes is then explored.
|
404
|
Statistical Analysis of Finite Mixture Distributions
– Titterington, Smith, et al.
- 1985
|
|
400
|
Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
– Green
- 1995
|
|
244
|
On Bayesian Analysis of Mixtures with an Unknown Number of Components
– Richardson, Green
|
|
224
|
A Bayesian analysis of some nonparametric problems
– FERGUSON
- 1973
|
|
155
|
Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems
– ANTONIAK
- 1974
|
|
154
|
Bayesian density estimation and inference using mixtures
– Escobar, West
- 1995
|
|
98
|
Bayesian computation and stochastic systems (with discussion
– Besag, Green, et al.
- 1995
|
|
95
|
Markov chain sampling methods for dirichlet process mixture models
– Neal
- 2000
|
|
68
|
Estimating normal means with a conjugate style Dirichlet process prior
– MACEACHERN
- 1994
|
|
61
|
Practical Bayesian density estimation using mixtures of normals
– Roeder, Wasserman
- 1997
|
|
60
|
Bayesian model comparison via jump diffusions
– Phillips, Smith
- 1996
|
|
58
|
Estimating mixture of Dirichlet process models
– MacEachern, Müller
- 1998
|
|
56
|
Sequential importance sampling for nonparametric Bayes models: the next generation
– MacEachern, Clyde, et al.
- 1999
|
|
55
|
A semi-parametric Bayesian model for randomised block designs
– BUSH, MACEACHERN
- 1996
|
|
54
|
Spatial statistics and Bayesian computation (with Discussion
– Besag, Green
- 1993
|
|
48
|
Mixture models: Theory, geometry, and applications
– Lindsay
- 1995
|
|
42
|
On a class of Bayesian nonparametric estimates: I. Density estimates
– Lo
- 1984
|
|
25
|
Bayesian Deviance, the effective Number of Parameters, and the Comparison of Arbitrarily Complex Models,” technical report
– Spiegelhalter, Best, et al.
- 1998
|
|
21
|
Bayesian Curve Fitting using Multivariate Normal Mixtures
– Müller, Erkanli, et al.
- 1996
|
|
18
|
Bayesian mixture modeling
– Neal
- 1992
|
|
17
|
A Bayesian method for combining results from several binomial experiments
– CONSONNI, VERONESE
- 1995
|
|
16
|
Asymptotic inference for mixture models using data-dependent priors
– Wasserman
- 2000
|
|
13
|
Bayesian nonparametric inference for random distributions and related functions
– Walker, Damien, et al.
- 1999
|
|
10
|
Contribution to the discussion of paper by Grenander and Miller
– Green
- 1994
|
|
10
|
Bayesian Analysis of Finite Mixture Distributions
– Nobile
- 1994
|
|
9
|
Bayesian Inference (Kendall's Advanced theory of Statistics
– O’Hagan
- 1994
|
|
7
|
Testing for mixtures: a Bayesian entropy approach
– Mengersen, Robert
- 1996
|
|
7
|
A note on the Dirichlet process prior in Bayesian nonparametric inference with partial exchangeability
– Petrone, Raftery
- 1997
|
|
6
|
Mixture models in measurement error problems, with reference to epidemiological studies. Unpublished manuscript
– RICHARDSON, LEBLOND, et al.
- 2002
|
|
5
|
Handbook of mathematical functions, 9th edition
– Abramowitz, Stegun
- 1972
|
|
4
|
Mixtures of distributions: inference and estimation, chapter 24 (pp. 441--464) of Practical Markov chain
– Robert
- 1996
|
|
2
|
A note on convergence rates of Gibbs sampling for nonparametric mixtures, Unpublished manuscript
– Petrone, Roberts, et al.
- 1998
|
|
1
|
Contribution to the Discussion of paper by
– Richardson
- 1999
|
|
