Quo Vadis, Methodology? The Key Role of Manipulation Checks for Validity Control and Quality of Science
| Autor: | Klaus Fiedler, Johannes Prager, Linda McCaughey |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Psychological science
validity manipulation check media_common.quotation_subject diagnostic design Control (management) 050109 social psychology Psychology Social 050105 experimental psychology Article Manipulation checks Significance testing Humans Psychology 0501 psychology and cognitive sciences Quality (business) General Psychology media_common demand effect significance testing 05 social sciences Contrast (statistics) Reproducibility of Results attention check Research Design Key (cryptography) Engineering ethics scientific scrutiny Psychological Theory Behavioral Research Personality |
| Zdroj: | Perspectives on Psychological Science |
| ISSN: | 1745-6924 |
| Popis: | The current debate about how to improve the quality of psychological science revolves, almost exclusively, around the subordinate level of statistical significance testing. In contrast, research design and strict theorizing, which are superordinate to statistics in the methods hierarchy, are sorely neglected. The present article is devoted to the key role assigned to manipulation checks (MCs) for scientific quality control. MCs not only afford a critical test of the premises of hypothesis testing but also (a) prompt clever research design and validity control, (b) carry over to refined theorizing, and (c) have important implications for other facets of methodology, such as replication science. On the basis of an analysis of the reality of MCs reported in current issues of the Journal of Personality and Social Psychology, we propose a future methodology for the post– p < .05 era that replaces scrutiny in significance testing with refined validity control and diagnostic research designs. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|