Are results from randomized trials in anesthesiology robust or fragile? An analysis using the fragility index
| Autor: | Matt Vassar, Kody Dormire, Matthew Parke, Jarryd Horn, Kale Goerke, Brad A. White, Corbin Walters, Trevor Bright, Chase Meyer |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Research design
medicine.medical_specialty 050402 sociology Index (economics) Citation index law.invention 03 medical and health sciences 0302 clinical medicine Fragility 0504 sociology Randomized controlled trial Bias law Anesthesiology Medicine Humans 030212 general & internal medicine Randomized Controlled Trials as Topic business.industry Health Policy 05 social sciences Public Health Environmental and Occupational Health Science Citation Index Sample size determination Research Design Sample Size Physical therapy Journal Impact Factor business |
| Zdroj: | International journal of evidence-based healthcare. 18(1) |
| ISSN: | 1744-1609 |
| Popis: | Aim In anesthesiology, the findings from randomized controlled trials often underpin guidelines influencing clinical decision-making and therefore directly affect patient care. The aim of this study is to evaluate the fragility index and fragility quotient of randomized controlled trials published in the eight highest ranked anesthesiology journals. In addition, we assess the extent to which risk of bias scores, loss to follow-up, Web of Science Citation Index, and journal impact factor influence fragility index and fragility quotient. Methods We included randomized trials published between 2014 and 2016 from the eight highest ranking anesthesiology journals based on Clarivate Analytics' Science Citation Index and Google Scholar Metrics: Anesthesiology subcategory. We included journals that published general anesthesia topics and omitted specialty anesthesia journals. The fragility index and fragility quotient for all included trials were calculated. Risk of bias for each trial was evaluated using the Cochrane 'risk of bias' Tool 2.0. Results One hundred and thirty one randomized control trials were included in this analysis. The median fragility index was 3 (interquartile range 1.0-5.5) with a fragility quotient of 0.03 (interquartile range 0.01-0.08). In 11% (14/131) of trials, the number of patients lost to follow-up was greater than the corresponding fragility index. Weak correlations were found between fragility index and total sample size (r = 0.13) and between fragility index and event frequency (r = 0.19). A near-negligible correlation was found between 5-year impact factor and fragility index (r = -0.03) and, similarly, between fragility index and Science Citation Index (r = -0.05). Ten trials were at high risk of bias with the randomization process found to be the domain at the highest risk of bias. Conclusion In assessing the fragility of randomized controlled trials published in the top eight anesthesiology journals, our study suggests that statistically significant results in these journals are disconcertingly fragile. The median fragility index calculated from our 131 primary studies reveals that only three nonevents must be replaced with events to negate statistical significance. Although a current scale does not exist for fragility index ranges, many trials published by the top journals in anesthesiology are based on concerning methodology and highly fragile outcomes. With small median sample sizes and few patient events characterizing a large number of these trials, many of today's current guidelines and clinical practices may be founded on research containing statistical significance but lacking clinical significance. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|