Practical Challenges and Methodological Flexibility in Prior Elicitation

Autor: Angelika Stefan, Eric-Jan Wagenmakers, Nathan J. Evans
Přispěvatelé: Psychologische Methodenleer (Psychologie, FMG), Psychology Other Research (FMG)
Rok vydání: 2019
Předmět:
Process (engineering)
Computer science
Best practice
Bayesian probability
bepress|Social and Behavioral Sciences|Psychology|Quantitative Psychology
02 engineering and technology
PsycINFO
050905 science studies
Prior probability
0202 electrical engineering
electronic engineering
information engineering

Humans
PsyArXiv|Social and Behavioral Sciences|Quantitative Methods|Statistical Methods
Flexibility (engineering)
Frequentist probability
bepress|Social and Behavioral Sciences|Psychology
05 social sciences
Foundation (evidence)
Bayes Theorem
020207 software engineering
Data science
PsyArXiv|Social and Behavioral Sciences
Research Design
PsyArXiv|Social and Behavioral Sciences|Psychology
other

bepress|Social and Behavioral Sciences
Psychology (miscellaneous)
PsyArXiv|Social and Behavioral Sciences|Quantitative Methods
0509 other social sciences
Zdroj: Psychological Methods, 27(2), 177-197. American Psychological Association
ISSN: 1082-989X
Popis: The Bayesian statistical framework requires the specification of prior distributions, which reflect predata knowledge about the relative plausibility of different parameter values. As prior distributions influence the results of Bayesian analyses, it is important to specify them with care. Prior elicitation has frequently been proposed as a principled method for deriving prior distributions based on expert knowledge. Although prior elicitation provides a theoretically satisfactory method of specifying prior distributions, there are several implicit decisions that researchers need to make at different stages of the elicitation process, each of them constituting important researcher degrees of freedom. Here, we discuss some of these decisions and group them into 3 categories: decisions about (a) the setup of the prior elicitation; (b) the core elicitation process; and (c) combination of elicited prior distributions from different experts. Importantly, different decision paths could result in greatly varying priors elicited from the same experts. Hence, researchers who wish to perform prior elicitation are advised to carefully consider each of the practical decisions before, during, and after the elicitation process. By explicitly outlining the consequences of these practical decisions, we hope to raise awareness for methodological flexibility in prior elicitation and provide researchers with a more structured approach to navigate the decision paths in prior elicitation. Making the decisions explicit also provides the foundation for further research that can identify evidence-based best practices that may eventually reduce the methodologically flexibility in prior elicitation. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Databáze: OpenAIRE