Impact of choice of quality appraisal tool for systematic reviews in overviews

Ref ID 119
First Author D. Pieper
Journal JOURNAL OF EVIDENCE-BASED MEDICINE
Year Of Publishing 2014
URL https://onlinelibrary.wiley.com/doi/pdfdirect/10.1111/jebm.12097?download=true
Keywords Surgery
Author
Single reviewer
Problem(s) Single reviewer / lack of double checking
Number of systematic reviews included 32
Summary of Findings The result of the evidence synthesis was not dependent on the choice of a critical appraisal tool. However, inter-rater reliability differed depending on the tool, Cohens Kappa ranging from 0.47 to 0.76. The high heterogeneity between two pairs of reviewers indicates that independent verification and consistency of reviewer judgements is more important than choice of quality assessment tool.
Did the article find that the problem(s) led to qualitative changes in interpretation of the results? Not Applicable
Are the methods of the article described in enough detail to replicate the study? No