Interleave Variational Optimization with Monte Carlo Sampling: A Tale of Two Approximate Inference Paradigms
| Autor: | Alexander T. Ihler, Qi Lou, Rina Dechter |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Mathematical optimization
Partition function (quantum field theory) Partition function (statistical mechanics) Computer science Monte Carlo method Message passing Inference 02 engineering and technology General Medicine 010501 environmental sciences Probabilistic inference 01 natural sciences Task (project management) Approximate inference 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Graphical model 0105 earth and related environmental sciences |
| Zdroj: | AAAI Scopus-Elsevier |
| ISSN: | 2374-3468 2159-5399 |
| DOI: | 10.1609/aaai.v33i01.33017900 |
| Popis: | Computing the partition function of a graphical model is a fundamental task in probabilistic inference. Variational bounds and Monte Carlo methods, two important approximate paradigms for this task, each has its respective strengths for solving different types of problems, but it is often nontrivial to decide which one to apply to a particular problem instance without significant prior knowledge and a high level of expertise. In this paper, we propose a general framework that interleaves optimization of variational bounds (via message passing) with Monte Carlo sampling. Our adaptive interleaving policy can automatically balance the computational effort between these two schemes in an instance-dependent way, which provides our framework with the strengths of both schemes, leads to tighter anytime bounds and an unbiased estimate of the partition function, and allows flexible tradeoffs between memory, time, and solution quality. We verify our approach empirically on real-world problems taken from recent UAI inference competitions. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|