Poor sample size reporting quality and insufficient sample size in economic evaluations conducted alongside pragmatic trials: a cross-sectional survey.

Autor: Wu C; School of Public Health, Chongqing Medical University, Chongqing, China., Hao J; Medical Research and Biometrics Centre, National Clinical Research Centre for Cardiovascular Diseases, Fuwai Hospital, National Centre for Cardiovascular Diseases, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing, China; Department of Clinical Sciences, Liverpool School of Tropical Medicine, Liverpool, UK; Institute for Global Health, University College London, London, UK., Xin Y; Department of Science and Technology, West China Hospital, Sichuan University, Chengdu, China., Song R; Department of Health Service Management, School of Health Management, China Medical University, Shenyang, China., Li W; Department of Health Service Management, School of Health Management, China Medical University, Shenyang, China., Zuo L; Department of Pulmonary and Critical Care Medicine, West China Hospital, Sichuan University /West China School of Nursing, Sichuan University, Chengdu, China; Integrated Care Management Centre, Outpatient Department, West China Hospital, Sichuan University, Chengdu, China., Zhang X; Department of Health Service Management, School of Health Management, China Medical University, Shenyang, China., Cai Y; Department of Health Service Management, School of Health Management, China Medical University, Shenyang, China., Wu H; Department of Health Service Management, School of Health Management, China Medical University, Shenyang, China., Hui W; Department of Science and Technology, West China Hospital, Sichuan University, Chengdu, China. Electronic address: huiwen@scu.edu.cn.
Jazyk: angličtina
Zdroj: Journal of clinical epidemiology [J Clin Epidemiol] 2024 Dec; Vol. 176, pp. 111535. Date of Electronic Publication: 2024 Sep 21.
DOI: 10.1016/j.jclinepi.2024.111535
Abstrakt: Objectives: Economic evaluations based on well-designed and -conducted pragmatic randomized controlled trials (pRCTs) can provide valuable evidence on the cost-effectiveness of interventions, enhancing the relevance and applicability of findings to healthcare decision-making. However, economic evaluation outcomes are seldom taken into consideration during the process of sample size calculation in pragmatic trials. The reporting quality of sample size and information on its calculation in economic evaluations that are well-suited to pRCTs remain unknown. This study aims to assess the reporting quality of sample size and estimate the power values of economic evaluations in pRCTs.
Study Design and Setting: We conducted a cross-sectional survey using data of pRCTs available from PubMed and OVID from 1 January 2010 to 24 April 2022. Two groups of independent reviewers identified articles; three groups of reviewers each extracted the data. Descriptive statistics presented the general characteristics of included studies. Statistical power analyses were performed on clinical and economic outcomes with sufficient data.
Results: The electronic search identified 715 studies and 152 met the inclusion criteria. Of these, 26 were available for power analysis. Only 9 out of 152 trials (5.9%) considered economic outcomes when estimating sample size, and only one adjusted the sample size accordingly. Power values for trial-based economic evaluations and clinical trials ranged from 2.56% to 100% and 3.21%-100%, respectively. Regardless of the perspectives, in 14 out of the 26 studies (53.8%), the power values of economic evaluations for quality-adjusted life years (QALYs) were lower than those of clinical trials for primary endpoints (PEs). In 11 out of the 24 (45.8%) and in 8 out of the 13 (61.5%) studies, power values of economic evaluations for QALYs were lower than those of clinical trials for PEs from the healthcare and societal perspectives, respectively. Power values of economic evaluations for non-QALYs from the healthcare and societal perspectives were potentially higher than those of clinical trials in 3 out of the 4 studies (75%). The power values for economic outcomes in Q1 were not higher than those for other journal impact factor quartile categories.
Conclusion: Theoretically, pragmatic trials with concurrent economic evaluations can provide real-world evidence for healthcare decision makers. However, in pRCT-based economic evaluations, limited consideration, and inadequate reporting of sample-size calculations for economic outcomes could negatively affect the results' reliability and generalisability. We thus recommend that future pragmatic trials with economic evaluations should report how sample sizes are determined or adjusted based on the economic outcomes in their protocols to enhance their transparency and evidence quality.
Competing Interests: Declaration of competing interest None.
(Copyright © 2024 Elsevier Inc. All rights reserved.)
Databáze: MEDLINE