Many meta-analyses of rare events in the Cochrane Database of Systematic Reviews were underpowered

Ref ID 811
First Author P. Jia
Journal JOURNAL OF CLINICAL EPIDEMIOLOGY
Year Of Publishing 2021
URL https://www.sciencedirect.com/science/article/pii/S0895435620311884
Keywords • Statistical
• Cochrane
• Power
Problem(s) • Small number of trials in meta-analyses
• Weaknesses identified in some Cochrane reviews
Article Type Empirical
Article Subtype Cross-sectional survey/Methodological systematic review
First Author Country China
Aim To assess the statistical power of meta-analyses of rare events from the Cochrane Database of Systematic Reviews from January 2003 to May 2018.
Level of Investigation Analytical
Summary of Findings From 4,177 meta-analyses from the Cochrane Database of Systematic Reviews from January 2003 to May 2018 (no. of systematic reviews not reported), only 11.81% of meta-analyses reached sufficient power. The median power to detect 10%, 30%, and 50% relative risk reduction were 0.06 (interquartile range [IQR]: 0.05 to 0.06), 0.08 (IQR: 0.06 to 0.15), and 0.17 (IQR: 0.10 to 0.42), respectively); the corresponding proportion of meta-analyses that reached sufficient power were 0.32%, 3.68%, and 11.81%. Meta-analyses incorporating data from more studies had higher probability to achieve a sufficient power (rate ratio = 2.49, 95% CI: 1.76, 3.52, P < 0.001).
Number of systematic reviews included 4177
Number of eligible systematic reviews assessed 6781
Treatment impacted No
Treatment impacted description
Interpretation impacted Not Applicable
Interpretation impacted description