Learning from Null Effects: A Bottom-Up Approach
| Autor: | Ala' Alrababa'h, Scott Williamson, Andrea Dillon, Jens Hainmueller, Dominik Hangartner, Michael Hotard, David Laitin, Duncan Lawrence, Jeremy Weinstein |
|---|---|
| Rok vydání: | 2022 |
| Předmět: |
publication bias
Sociology and Political Science bepress|Social and Behavioral Sciences|Economics SocArXiv|Social and Behavioral Sciences|Economics bepress|Social and Behavioral Sciences|Political Science|Models and Methods SocArXiv|Social and Behavioral Sciences|Political Science null results file drawer problem bepress|Social and Behavioral Sciences|Sociology SocArXiv|Social and Behavioral Sciences|Sociology bepress|Social and Behavioral Sciences|Political Science SocArXiv|Social and Behavioral Sciences|Political Science|Models and Methods JC Political theory Political Science and International Relations bepress|Social and Behavioral Sciences SocArXiv|Social and Behavioral Sciences |
| Zdroj: | Political Analysis, 31 (3) |
| ISSN: | 1476-4989 1047-1987 |
| Popis: | A critical barrier to generating cumulative knowledge in political science and related disciplines is the inability of researchers to observe the results from the full set of research designs that scholars have conceptualized, implemented, and analyzed. For a variety of reasons, studies that produce null findings are especially likely to be unobserved, creating biases in publicly accessible research. While several approaches have been suggested to overcome this problem, none have yet proven adequate. We call for the establishment of a new discipline-wide norm in which scholars post short "null results reports" online that summarize their research designs, findings, and interpretations. To address the inevitable incentive problems that earlier proposals for reform were unable to overcome, we argue that decentralized research communities can spur the broader disciplinary norm change that would bring advantage to scientific advance. To facilitate our contribution, we offer a template for these reports that incorporates evaluation of the possible explanations for the null findings, including statistical power, measurement strategy, implementation issues, spillover/contamination, and flaws in theoretical priors. We illustrate the template's utility with two experimental studies focused on the naturalization of immigrants in the United States and attitudes toward Syrian refugees in Jordan. Political Analysis, 31 (3) ISSN:1047-1987 ISSN:1476-4989 |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|