#### DMCA

## On Sequential Monte Carlo Sampling Methods for Bayesian Filtering (2000)

### Cached

### Download Links

- [www.cs.cmu.edu]
- [www.cs.cmu.edu]
- [www.cs.cmu.edu]
- [www.cs.cmu.edu]
- [www-sigproc.eng.cam.ac.uk]
- [www.cs.ubc.ca]
- [www.di.ens.fr]
- [www.di.ens.fr]
- [www.di.ens.fr]
- [www.di.ens.fr]
- [www.stat.columbia.edu]
- [www-sigproc.eng.cam.ac.uk]
- [www.stat.columbia.edu]
- [www.stat.columbia.edu]
- [www-sigproc.eng.cam.ac.uk]
- [www.stat.columbia.edu]
- [www.di.ens.fr]
- [www.gatsby.ucl.ac.uk]
- [www.di.ens.fr]
- [www.cimat.mx]
- [www3.nd.edu]
- [www.stat.columbia.edu]
- [www.di.ens.fr]
- [www.gatsby.ucl.ac.uk]
- [www.stats.ox.ac.uk]
- [www-sigproc.eng.cam.ac.uk]
- [jimbeck.caltech.edu]
- [jimbeck.caltech.edu]

Venue: | STATISTICS AND COMPUTING |

Citations: | 1021 - 75 self |

### Citations

1694 | Novel approach to non-linear/non-gaussian bayesian state estimation - Gordon, Salmond, et al. |

1137 | Stochastic Processes and Filtering Theory - Jazwinski - 1970 |

643 | Sequential Monte Carlo methods for dynamic systems
- LIU, CHEN
- 1998
(Show Context)
Citation Context ...ods have been proposed to approximate the importance function and the associated importance weight based on importance sampling (Doucet 1997, 1998) and Markov chain Monte Carlo (Berzuini et al. 1998, =-=Liu and Chen 1998-=-). These iterative algorithms are computationally intensive and there is a lack of theoretical convergence results. However, they may be useful when non-iterative schemes fail. In fact, the general fr... |

557 |
Stochastic simulation
- Ripley
- 1987
(Show Context)
Citation Context ...s below a fixed threshold Nthres, the SIR resampling procedure is used (Rubin 1988). Note that it is possible to implement the SIR procedure exactly in O(N) operations by using a classical algorithm (=-=Ripley 1987-=- p. 96) and Carpenter, Clifford and Fearnhead (1997), Doucet (1997, 1998) and Pitt and Shepherd (1999). Other resampling procedures which reduce the MC variation, such as stratified sampling (Carpente... |

484 |
Bayesian Inference in Econometric Models Using Monte Carlo Integration
- Geweke
- 1989
(Show Context)
Citation Context ...normalised importance function π(x0:n | y0:n) which has a support including that of the state posterior. Then an estimate �IN ( fn) of the posterior expectation I ( fn) is obtained using Bayesian I=-=S (Geweke 1989): �IN ( fn) = N�-=-�� i=1 � (i) fn x 0:n � (i) ˜w n , ˜w(i) n = w ∗(i) n �N j) j=1 w∗( n where w ∗(i) n = p(y0:n | x0:n)p(x0:n)/π(x0:n | y0:n) is the unnormalised importance weight. Under weak assumptions... |

278 | Sequential imputations and Bayesian missing data problems - Kong, Liu, et al. - 1994 |

261 | Improved particle filter for nonlinear problems - Carpenter, Clifford, et al. - 1999 |

247 | On sequential simulation-based methods for Bayesian filtering - Doucet, Godsill, et al. |

213 | Bayesian Statistics without Tears: A Sampling-Resampling Perspective - Smith, Gelfand - 1992 |

210 |
Non-Gaussian state-space modeling of nonstationary time series
- Kitagawa
- 1987
(Show Context)
Citation Context ...arlo algorithms have been largely neglected until recent years. In the late 80’s, massive increases in computational power allowed the rebirth of numerical integration methods for Bayesian filtering=-= (Kitagawa 1987-=-). Current research has now focused on MC integration methods, which have the great advantage of not being subject to the assumption of linearity or Gaussianity in the model, and relevants198 Doucet, ... |

204 |
Using the SIR algorithm to simulate posterior distributions
- Rubin
- 1988
(Show Context)
Citation Context ... One cannot evaluate Neff exactly but, an estimate �Neff of Neff is given by: �Neff = � N i=1 1 � ˜w (i) k � 2 (35) When �Neff is below a fixed threshold Nthres, the SIR resampling proced=-=ure is used (Rubin 1988-=-). Note that it is possible to implement the SIR procedure exactly in O(N) operations by using a classical algorithm (Ripley 1987 p. 96) and Carpenter, Clifford and Fearnhead (1997), Doucet (1997, 199... |

192 | Rao-Blackwellisation of sampling schemes - Casella, Robert - 1996 |

167 |
Bayesian Forecasting and Dynamic Models, 2nd ed
- WEST, HARRISON
- 1997
(Show Context)
Citation Context ...ssary to build these on a case by case basis, dependent on the model studied. To this end, it is possible to base these developments on previous work in suboptimal filtering (Anderson and Moore 1979, =-=West and Harrison 1997), -=-and this is considered in the next subsection. 2. Importance distribution obtained by local linearisation A simple choice selects as the importance function π(xk | xk−1, yk) a parametric distributi... |

153 |
Smoothness priors analysis of time series
- Kitagawa, Gersch
- 1996
(Show Context)
Citation Context ...and Fearnhead (1997), Doucet (1997, 1998) and Pitt and Shepherd (1999). Other resampling procedures which reduce the MC variation, such as stratified sampling (Carpenter, Clifford and Fearnhead 1997, =-=Kitagawa and Gersch 1996-=-) and residual resampling (Higuchi 1997, Liu and Chen 1998), may be applied as an alternative to SIR.s202 Doucet, Godsill and Andrieu An appropriate algorithm based on the SIR scheme proceeds as follo... |

145 | Metropolized Independent Sampling with Comparisons to Rejection Sampling and Importance Sampling - Liu - 1996 |

120 |
Blind deconvolution via sequential imputations
- Liu, Chen
- 1995
(Show Context)
Citation Context ...blem or the optimal filtering problem. Practical applications include target tracking (Gordon, Salmond and Smith 1993), blind deconvolution of digital communications channels (Clapp and Godsill 1999, =-=Liu and Chen 1995),-=- estimation of stochastic volatility (Pitt and Shephard 0960-3174 C○ 2000 Kluwer Academic Publishers 1999) and digital enhancement of speech and audio signals (Godsill and Rayner 1998). Except in a ... |

90 | Sequential importance sampling for nonparametric Bayes: the next generation - MacEachern, Clyde, et al. - 1999 |

89 | Dynamic conditional independence models and Markov chain Monte Carlo methods - Berzuini, Best, et al. - 1997 |

74 | Digital Audio Restoration: A Statistical Model-Based Approach - Godsill, Rayner - 1998 |

61 |
Monte Carlo techniques to estimate the conditional expectation in multi-stage non-linear filtering
- Handschin, Mayne
- 1969
(Show Context)
Citation Context ...on methods which are designed to make the most of any structure within the model studied. Numerous methods have been developed for reducing the variance of MC estimates including antithetic sampling (=-=Handschin and Mayne 1969-=-, Handschin 1970) and control variates (Akashi and Kumamoto 1975, Handschin 1970). We apply here the Rao-Blackwellisation method, see Casella and Robert (1996) for a general reference on the topic. In... |

57 |
Optimal Filtering. Englewood Cliffs
- O, MOORE
- 1979
(Show Context)
Citation Context ... approximating these filtering distributions, see for example Jazwinski (1970). The most popular algorithms, the extended Kalman filter and the Gaussian sum filter, rely on analytical approximations (=-=Anderson and Moore 1979). I-=-nteresting work in the automatic control field was carried out during the 1960’s and 70’s using sequential Monte Carlo (MC) integration methods, see Akashi and Kumamoto (1975), Handschin and Mayne... |

52 | Mixture models, Monte Carlo, Bayesian updating and dynamic models - West - 1993 |

51 |
Random Sampling Approach to state estimation in Switching Environments
- Akashi, H
- 1977
(Show Context)
Citation Context ..., conditional upon x1 0:n , x20:n is a linear Gaussian state space model and the integrations required by the Rao-Blackwellisation method can be realized using the Kalman filter. Akashi and Kumamoto (=-=Akashi and Kumamoto 1977-=-, Tugnait 1982) introduced this algorithm under the name of RSA (Random Sampling Algorithm) in the particular case where x1 k is a homogeneous scalar finite state-space Markov chain. In this case, the... |

47 | A hybrid bootstrap filter for target tracking in clutter - Gordon - 1997 |

47 |
Monte Carlo techniques for prediction and filtering of non-linear stochastic processes. Automatica
- Handschin
- 1970
(Show Context)
Citation Context ...ned to make the most of any structure within the model studied. Numerous methods have been developed for reducing the variance of MC estimates including antithetic sampling (Handschin and Mayne 1969, =-=Handschin 1970-=-) and control variates (Akashi and Kumamoto 1975, Handschin 1970). We apply here the Rao-Blackwellisation method, see Casella and Robert (1996) for a general reference on the topic. In a sequential fr... |

46 | Nonlinear Filters: Estimation and Applications - Tanizaki - 1996 |

43 |
Monte Carlo filter using the genetic algorithm operators
- Higuchi
- 1996
(Show Context)
Citation Context ...and Shepherd (1999). Other resampling procedures which reduce the MC variation, such as stratified sampling (Carpenter, Clifford and Fearnhead 1997, Kitagawa and Gersch 1996) and residual resampling (=-=Higuchi 1997-=-, Liu and Chen 1998), may be applied as an alternative to SIR.s202 Doucet, Godsill and Andrieu An appropriate algorithm based on the SIR scheme proceeds as follows at time k. SIS/Resampling Monte Carl... |

42 |
Detection and estimation for abruptly changing systems
- Tugnait
- 1982
(Show Context)
Citation Context ..., x20:n is a linear Gaussian state space model and the integrations required by the Rao-Blackwellisation method can be realized using the Kalman filter. Akashi and Kumamoto (Akashi and Kumamoto 1977, =-=Tugnait 1982-=-) introduced this algorithm under the name of RSA (Random Sampling Algorithm) in the particular case where x1 k is a homogeneous scalar finite state-space Markov chain. In this case, they adopted the ... |

22 | Fixed-lag smoothing using sequential importance sampling
- Clapp, Godsill
- 1999
(Show Context)
Citation Context ...e Bayesian filtering problem or the optimal filtering problem. Practical applications include target tracking (Gordon, Salmond and Smith 1993), blind deconvolution of digital communications channels (=-=Clapp and Godsill 1999, -=-Liu and Chen 1995), estimation of stochastic volatility (Pitt and Shephard 0960-3174 C○ 2000 Kluwer Academic Publishers 1999) and digital enhancement of speech and audio signals (Godsill and Rayner ... |

22 | Nonlinear and non-Gaussian state-space modeling with Monte Carlo techniques: A survey and comparative study
- Tanizaki
- 2003
(Show Context)
Citation Context ... importance function which limits seriously the number of resampling steps. B. Nonlinear series We consider here the following nonlinear reference model (Gordon, Salmon and Smith 1993, Kitagawa 1987, =-=Tanizaki and Mariano 1998): xk = f -=-(xk−1) + vk = 1 2 xk−1 + 25 yk = g(xk) + wk = (xk) 2 + wk 20 xk−1 + 8 cos (1.2k) + vk 1 + (xk−1) 2 (73) (74) where x0 ∼ N (0, 5), vk and wk are mutually independent white Gaussian noise, vk ... |

20 | Predictive Updating Methods With Application to Bayesian Classification - Chen, Liu - 1996 |

17 | Prediction, Filtering and Smoothing in Non-Linear and Non-Normal Cases Using Monte Carlo - Tanizaki, Mariano - 1995 |

15 |
Carlo methods for Bayesian estimation of hidden Markov models. Applications to Radiation Signals
- Doucet
- 1997
(Show Context)
Citation Context ...roximation of the optimal importance function. Several Monte Carlo methods have been proposed to approximate the importance function and the associated importance weight based on importance sampling (=-=Doucet 1997-=-, 1998) and Markov chain Monte Carlo (Berzuini et al. 1998, Liu and Chen 1998). These iterative algorithms are computationally intensive and there is a lack of theoretical convergence results. However... |

12 | Monte Carlo integration in general dynamic models - Muller - 1991 |

11 |
Construction of discrete-time nonlinear filter by monte carlo methods with variance-reducing techniques
- Akashi, Kumamoto
- 1975
(Show Context)
Citation Context ...within the model studied. Numerous methods have been developed for reducing the variance of MC estimates including antithetic sampling (Handschin and Mayne 1969, Handschin 1970) and control variates (=-=Akashi and Kumamoto 1975-=-, Handschin 1970). We apply here the Rao-Blackwellisation method, see Casella and Robert (1996) for a general reference on the topic. In a sequential framework, MacEachern, Clyde and Liu (1999) have a... |

9 | Filtering via simulation: auxiliary particle filter - K, Shephard - 1999 |

6 |
Digital Audio Restoration—A Statistical Model Based Approach
- Godsill, Rayner
- 1998
(Show Context)
Citation Context ...pp and Godsill 1999, Liu and Chen 1995), estimation of stochastic volatility (Pitt and Shephard 0960-3174 C○ 2000 Kluwer Academic Publishers 1999) and digital enhancement of speech and audio signals=-= (Godsill and Rayner 1998-=-). Except in a few special cases, including linear Gaussian state space models (Kalman filter) and hidden finite-state space Markov chains, it is impossible to evaluate these distributions analyticall... |

6 | The use of Bayesian belief networks to fuse continuous and discrete information for target recognition, tracking and situation assessment - Stewart, McCarty - 1992 |

3 | Switching state-space models: Likelihood function, filtering and smoothing - Billio, Monfort - 1998 |

3 | 1986)Applying the Monte Carlo method for optimum estimation in systems with random structure - Svetnik |

2 | Posterior integration in dynamic models - Müller - 1992 |

2 | Switching state-space models:likelihood function, filtering and smoothing - Billio, Monfort - 1998 |

1 | Kumamoto H.(1975) Construction of Discrete-time Nonlinear Filter by Monte Carlo Methods with Variance-reducing Techniques - Akashi |

1 | Kumamoto H.(1977) Random Sampling Approach to State Estimation in Switching Environments - Akashi |