P value-driven methods were underpowered to detect publication bias: analysis of Cochrane review meta-analyses

Ref ID 332
First Author L. Furuya-Kanamori
Journal JOURNAL OF CLINICAL EPIDEMIOLOGY
Year Of Publishing 2020
URL https://www.jclinepi.com/article/S0895-4356(19)30381-6/fulltext
Keywords Publication bias
General medical
Problem(s) Poor consideration of publication bias
Weaknesses identified in some Cochrane reviews
Number of systematic reviews included 5014
Summary of Findings The proportion of meta-analyses detected as asymmetrical via Egger’s, Harbord’s, Peters’, and Begg’s tests decreased by 42.6%, 41.1%, 29.3%, and 28.3%, respectively, when the median number of studies in the meta-analysis decreased from 87 to 14. P values decreased as the number of studies increased in the meta-analysis, despite the level of symmetry remaining constant. The simulation study confirmed that when publication bias is present, P value tests underestimate the presence of publication bias, particularly when study numbers are small.
Did the article find that the problem(s) led to qualitative changes in interpretation of the results? Not Applicable
Are the methods of the article described in enough detail to replicate the study? Yes