- Framework of problems / Rigourous
- Weaknesses identified in some Cochrane reviews
- P value-driven methods were underpowered to detect publication bias: analysis of Cochrane review meta-analyses
Ref ID | 332 |
First Author | L. Furuya-Kanamori |
Journal | JOURNAL OF CLINICAL EPIDEMIOLOGY |
Year Of Publishing | 2020 |
URL | https://www.jclinepi.com/article/S0895-4356(19)30381-6/fulltext |
Keywords |
Publication bias General medical |
Problem(s) |
Poor consideration of publication bias Weaknesses identified in some Cochrane reviews |
Number of systematic reviews included | 5014 |
Summary of Findings | The proportion of meta-analyses detected as asymmetrical via Egger’s, Harbord’s, Peters’, and Begg’s tests decreased by 42.6%, 41.1%, 29.3%, and 28.3%, respectively, when the median number of studies in the meta-analysis decreased from 87 to 14. P values decreased as the number of studies increased in the meta-analysis, despite the level of symmetry remaining constant. The simulation study confirmed that when publication bias is present, P value tests underestimate the presence of publication bias, particularly when study numbers are small. |
Did the article find that the problem(s) led to qualitative changes in interpretation of the results? | Not Applicable |
Are the methods of the article described in enough detail to replicate the study? | Yes |