Annealed SMC Samplers for Nonparametric Bayesian Mixture Models
| Autor: | Ali Taylan Cemgil, Bilge Gunsel, Yener Ulker |
|---|---|
| Rok vydání: | 2011 |
| Předmět: |
business.industry
Applied Mathematics Monte Carlo method Bayesian probability Mixture model Machine learning computer.software_genre Dirichlet process symbols.namesake Signal Processing symbols Artificial intelligence Electrical and Electronic Engineering business Particle filter Cluster analysis Gaussian process Algorithm computer Importance sampling Mathematics |
| Zdroj: | IEEE Signal Processing Letters. 18:3-6 |
| ISSN: | 1558-2361 1070-9908 |
| DOI: | 10.1109/lsp.2010.2072919 |
| Popis: | We develop a novel online algorithm for posterior inference in Dirichlet Process Mixtures (DPM). Our method is based on the Sequential Monte Carlo (SMC) samplers framework that generalizes sequential importance sampling approaches. Unlike the existing methods, the framework enables us to retrospectively update long trajectories in the light of recent observations and this leads to sophisticated clustering update schemes and annealing strategies that seem to prevent the algorithm to get stuck around a local mode. The performance has been evaluated on a Bayesian Gaussian density estimation problem with an unknown number of mixture components. Our simulations suggest that the proposed annealing strategy outperforms conventional samplers. It also provides significantly smaller Monte Carlo standard error with respect to particle filtering given comparable computational resources. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|