Randomized controlled trials reporting patient-reported outcomes with no significant differences between study groups are potentially susceptible to unjustified conclusions-a systematic review.

Autor: Saarinen A; Department of Orthopaedics and Traumatology, Turku University Hospital, Finland. Electronic address: anjusaa@utu.fi., Pakarinen O; Department of Surgery, Päijät-Häme Central Hospital, Lahti, Finland., Vaajala M; Faculty of Medicine and Health Technology, Tampere University, Tampere, Finland., Liukkonen R; Faculty of Medicine and Health Technology, Tampere University, Tampere, Finland., Ponkilainen V; Center for Musculoskeletal Diseases, Tampere University Hospital, Tampere, Finland., Kuitunen I; Institute of Clinical Medicine, University of Eastern Finland, Kuopio, Finland; Department of Pediatrics, Kuopio University Hospital, Kuopio, Finland., Uimonen M; Faculty of Medicine and Health Technology, Tampere University, Tampere, Finland; Department of Cardiothoracic Surgery, Tampere Heart Hospital, Tampere, Finland.
Jazyk: angličtina
Zdroj: Journal of clinical epidemiology [J Clin Epidemiol] 2024 May; Vol. 169, pp. 111308. Date of Electronic Publication: 2024 Feb 28.
DOI: 10.1016/j.jclinepi.2024.111308
Abstrakt: Objectives: Ceiling effect may lead to misleading conclusions when using patient-reported outcome measure (PROM) scores as an outcome. The aim of this study was to investigate the potential source of ceiling effect-related errors in randomized controlled trials (RCTs) reporting no differences in PROM scores between study groups.
Study Design and Setting: A systematic review of RCTs published in the top 10 orthopedic journals according to their impact factors was conducted, focusing on studies that reported no significant differences in outcomes between two study groups. All studies published during 2012-2022 that reported no differences in PROM outcomes and used parametric statistical approach were included. The aim was to investigate the potential source of ceiling effect-related errors-that is, when the ceiling effect suppresses the possible difference between the groups. The proportions of patients exceeding the PROM scales were simulated using the observed dispersion parameters based on the assumed normal distribution, and the differences in the proportions between the study groups were subsequently analyzed.
Results: After an initial screening of 2343 studies, 190 studies were included. The central 95% theoretical distribution of the scores exceeded the PROM scales in 140 (74%) of these studies. In 33 (17%) studies, the simulated patient proportions exceeding the scales indicated potential differences between the compared groups.
Conclusion: It is common to have a mismatch between the chosen PROM instrument and the population being studied increasing the risk of an unjustified "no difference" conclusion due to a ceiling effect. Thus, a considerable ceiling effect should be considered a potential source of error.
Competing Interests: Declaration of competing interest A.S. received financial support from Vappu Uuspää Foundation, and Päivikki and Sakari Sohlberg Foundation. The other authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
(Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)
Databáze: MEDLINE