WAIC and WBIC for mixture models
| Autor: | Sumio Watanabe |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Independent and identically distributed random variables
Applied Mathematics 05 social sciences Posterior probability 050401 social sciences methods Experimental and Cognitive Psychology Statistical model Mixture model Normal distribution 03 medical and health sciences Clinical Psychology 0302 clinical medicine 0504 sociology Statistical inference Applied mathematics Probability distribution Likelihood function 030217 neurology & neurosurgery Analysis Mathematics |
| Zdroj: | Behaviormetrika. 48:5-21 |
| ISSN: | 1349-6964 0385-7417 |
| DOI: | 10.1007/s41237-021-00133-z |
| Popis: | In Bayesian statistical inference, an unknown probability distribution is estimated from a sample using a statistical model and a prior. In general, a pair of a model and a prior may or may not be appropriate for unknown distribution; some evaluation procedures of the estimated result are necessary. If a statistical model is regular and the likelihood function can be approximated by some Gaussian function, then AIC and BIC can be applied to such evaluation processes. However, if a statistical model contains hierarchical structure or latent variables, then regularity condition is not satisfied. The information criteria WAIC and WBIC are devised so as to estimate the generalization loss and the free energy, respectively, even if the posterior distribution is far from any normal distribution and even if the unknown true distribution is not realizable by a statistical model. In this paper, we introduce mathematical foundation and computing methods of WAIC and WBIC in a normal mixture which is a typically singular statistical model, and discuss their properties in statistical inference. Also, we study the case that samples are not independently and identically distributed, for example, they are conditional independent or exchangeable. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full text from SpringerLink