The process of replication target selection in psychology: what to consider?

Autor: Pittelkow MM; Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands., Field SM; Centre of Science and Technology Studies, Leiden University, Leiden, the Netherlands., Isager PM; Oslo New University College, Oslo, Norway., Van't Veer AE; Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands., Anderson T; Department of Psychology, University of Toronto, Toronto, Canada., Cole SN; School of Education, Language and Psychology, York St John University, York, UK., Dominik T; Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, USA., Giner-Sorolla R; School of Psychology, University of Kent, Canterbury, UK., Gok S; Program in Cognitive Science, Department of Instructional Systems Technology, Indiana University, Bloomington, IN, USA., Heyman T; Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands., Jekel M; Social Psychology, University of Cologne, Cologne, Germany., Luke TJ; Department of Psychology, University of Gothenburg, Gothenburg, Sweden., Mitchell DB; WellStar College of Health and Human Services, Kennesaw State University, Kennesaw, GA, USA., Peels R; Philosophy Department and the Faculty of Religion and Theology, Vrije Universiteit, Amsterdam, The Netherlands., Pendrous R; Centre for Contextual Behavioural Science, School of Psychology, University of Chester, Chester, UK.; Institute of Applied Health Research, University of Birmingham, Birmingham, UK., Sarrazin S; Maison de santé pluridisciplinaire Pasteur, Chevilly-Larue, France., Schauer JM; Department of Preventive Medicine - Division of Biostatistics, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA., Specker E; Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria., Tran US; Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria., Vranka MA; Faculty of Social Sciences, Charles University, Prague, Czech Republic., Wicherts JM; Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands., Yoshimura N; Research Organization of Open Innovation and Collaboration, Ritsumeikan University, Osaka, Japan.; Research Fellow of the Japan Society for the Promotion of Science, Erasmus University Rotterdam, Rotterdam, The Netherlands., Zwaan RA; Department of Psychology, Education, and Child Studies, Erasmus University Rotterdam, Rotterdam, The Netherlands., van Ravenzwaaij D; Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands.
Jazyk: angličtina
Zdroj: Royal Society open science [R Soc Open Sci] 2023 Feb 01; Vol. 10 (2), pp. 210586. Date of Electronic Publication: 2023 Feb 01 (Print Publication: 2023).
DOI: 10.1098/rsos.210586
Abstrakt: Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.
(© 2023 The Authors.)
Databáze: MEDLINE