P < .05 is in the Eye of the Beholder: A Response to Beaujean and Farmer (2020)
Autor: | Zhihui Yi, Mark R. Dixon, James B. Schreiber, Becky F. Barron, Dana Paliliunas |
---|---|
Rok vydání: | 2021 |
Předmět: |
Reinterpretation
Inclusion (disability rights) 05 social sciences 050301 education Relational frame theory Education Original data Restricted range Argument Developmental and Educational Psychology 0501 psychology and cognitive sciences Statistical analysis Experimental methods Positive economics Psychology 0503 education 050104 developmental & child psychology |
Zdroj: | Journal of Behavioral Education. 30:489-511 |
ISSN: | 1573-3513 1053-0819 |
DOI: | 10.1007/s10864-021-09435-4 |
Popis: | The recent commentary by Beaujean and Farmer (2020) on the original paper by Dixon et al. (2019) serves a cautionary tale of selective p-values, the law of small N sizes, and the type-II error. We believe these authors have crafted a somewhat questionable argument in which only 57% of the original Dixon et al. data were re-analyzed, based on a series of assumptions that removed significant power from the original statistical analysis. We here provide an additional 12 re-analyses of the original data and demonstrated that depending on the testing assumptions and data inclusion criteria, p-value may or may not exceed the commonly used .05 level. Although we support healthy discussion on experimental methods, and appreciate the reinterpretation of our findings, the reader is cautioned that because Beaujean and Farmer’s conclusions are limited to such a restricted range of data and different pre-analytic assumptions, the actual importance of their obtained p-value must remain in the eye of the beholder. |
Databáze: | OpenAIRE |
Externí odkaz: | |
Nepřihlášeným uživatelům se plný text nezobrazuje | K zobrazení výsledku je třeba se přihlásit. |