High replicability of newly discovered social-behavioural findings is achievable.

Autor: Protzko J; Department of Psychological & Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA, USA. protzko@gmail.com.; Department of Psychological Science, Central Connecticut State University, New Britain, CT, USA. protzko@gmail.com., Krosnick J; Institute for Research in the Social Sciences, Stanford University, Stanford, CA, USA., Nelson L; Haas School of Business, University of California, Berkeley, Berkeley, CA, USA., Nosek BA; Center for Open Science, Charlottesville, VA, USA.; Department of Psychology, University of Virginia, Charlottesville, VA, USA., Axt J; Department of Psychology, McGill University, Montreal, Quebec, Canada., Berent M; Matt Berent Consulting, Sharon, PA, USA., Buttrick N; Department of Psychology, University of Wisconsin-Madison, Madison, WI, USA., DeBell M; Institute for Research in the Social Sciences, Stanford University, Stanford, CA, USA., Ebersole CR; Department of Psychology, University of Virginia, Charlottesville, VA, USA., Lundmark S; SOM Institute, University of Gothenburg, Gothenburg, Sweden., MacInnis B; Institute for Research in the Social Sciences, Stanford University, Stanford, CA, USA., O'Donnell M; McDonough School of Business, Georgetown University, Washington, DC, USA., Perfecto H; Olin School of Business, Washington University in St. Louis, St. Louis, MO, USA., Pustejovsky JE; Educational Psychology Department, University of Wisconsin-Madison, Madison, WI, USA., Roeder SS; Darla Moore School of Business, University of South Carolina, Columbia, SC, USA., Walleczek J; Phenoscience Laboratories, Berlin, Germany., Schooler JW; Department of Psychological & Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA, USA.
Jazyk: angličtina
Zdroj: Nature human behaviour [Nat Hum Behav] 2024 Feb; Vol. 8 (2), pp. 311-319. Date of Electronic Publication: 2023 Nov 09.
DOI: 10.1038/s41562-023-01749-9
Abstrakt: Failures to replicate evidence of new discoveries have forced scientists to ask whether this unreliability is due to suboptimal implementation of methods or whether presumptively optimal methods are not, in fact, optimal. This paper reports an investigation by four coordinated laboratories of the prospective replicability of 16 novel experimental findings using rigour-enhancing practices: confirmatory tests, large sample sizes, preregistration and methodological transparency. In contrast to past systematic replication efforts that reported replication rates averaging 50%, replication attempts here produced the expected effects with significance testing (P < 0.05) in 86% of attempts, slightly exceeding the maximum expected replicability based on observed effect sizes and sample sizes. When one lab attempted to replicate an effect discovered by another lab, the effect size in the replications was 97% that in the original study. This high replication rate justifies confidence in rigour-enhancing methods to increase the replicability of new discoveries.
(© 2023. The Author(s).)
Databáze: MEDLINE
Externí odkaz: