Calculating and reporting effect sizes on scientific papers (1): p < 0.05 limitations in the analysis of mean differences of two groups

Autor: Helena Espirito Santo, Fernanda Bento Daniel
Jazyk: portugalština
Rok vydání: 2015
Předmět:
Zdroj: Revista Portuguesa de Investigação Comportamental e Social, Vol 1, Iss 1, Pp 3-16 (2015)
Druh dokumentu: article
ISSN: 2183-4938
DOI: 10.7342/ismt.rpics.2015.1.1.14
Popis: The Portuguese Journal of Behavioral and Social Research requires authors to follow the recommendations of the Publication Manual of the American Psychological Association (APA, 2010) in the presentation of statistical information. One of the APA recommendations is that effect sizes should be presented along with levels of statistical significance. Since p-values from the results of the statistical tests do not indicate the magnitude or importance of a difference, then effect sizes (ES) should reported. In fact, ES give meaning to statistical tests; emphasize the power of statistical tests; reduce the risk of interpret mere sampling variation as real relationship; can increase the reporting of “non-significant"results, and allow the accumulation of knowledge from several studies using meta-analysis. Thus, the objectives of this paper are to present the limits of the significance level; describe the foundations of presentation of ES of statistical tests to analyze differences between two groups; present the formulas to calculate directly ES, providing examples of our own previous studies; show how to calculate confidence intervals; provide the conversion formulas for the review of the literature; indicate how to interpret the ES; and show that, although interpretable, the meaning (small, medium or large effect for an arbitrary metric) could be inaccurate, requiring that interpretation should be made in the context of the research area and in the context of real world variables.
Databáze: Directory of Open Access Journals