Reporting and interpreting non-significant results in animal cognition research

Autor: Benjamin G. Farrar, Alizée Vernouillet, Elias Garcia-Pelegrin, Edward W. Legg, Katharina F. Brecht, Poppy J. Lambert, Mahmoud Elsherif, Shannon Francis, Laurie O’Neill, Nicola S. Clayton, Ljerka Ostojić
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: PeerJ, Vol 11, p e14963 (2023)
Druh dokumentu: article
ISSN: 2167-8359
DOI: 10.7717/peerj.14963
Popis: How statistically non-significant results are reported and interpreted following null hypothesis significance testing is often criticized. This issue is important for animal cognition research because studies in the field are often underpowered to detect theoretically meaningful effect sizes, i.e., often produce non-significant p-values even when the null hypothesis is incorrect. Thus, we manually extracted and classified how researchers report and interpret non-significant p-values and examined the p-value distribution of these non-significant results across published articles in animal cognition and related fields. We found a large amount of heterogeneity in how researchers report statistically non-significant p-values in the result sections of articles, and how they interpret them in the titles and abstracts. Reporting of the non-significant results as “No Effect” was common in the titles (84%), abstracts (64%), and results sections (41%) of papers, whereas reporting of the results as “Non-Significant” was less common in the titles (0%) and abstracts (26%), but was present in the results (52%). Discussions of effect sizes were rare (
Databáze: Directory of Open Access Journals