Can Cochrane Reviews in controversial areas be biased? A sensitivity analysis based on the protocol of a Systematic Cochrane Review on low-level laser therapy in osteoarthritis

Ref ID 250
First Author J. M. Bjordal
Journal PHOTOMEDICINE & LASER THERAPY
Year Of Publishing 2005
URL https://pubmed.ncbi.nlm.nih.gov/16262573/
Keywords • Allegiance
• Error
• Cochrane
• Rheumatology
• Subgroup
• Missing data
Problem(s) • Errors in effect estimate calculations or data synthesis
• Errors in study inclusion or omission of relevant studies
• Failure to address missing outcome data in analyses
• Unplanned or unjustified subgroup or sensitivity analyses
• Weaknesses identified in some Cochrane reviews
• Non-financial conflicts of interest of review authors
Article Type Empirical
Article Subtype Case study
First Author Country Norway
Aim To replicate the literature searches, study selection, data extraction and data synthesis of one Cochrane review of low level laser therapy for osteoarthritis classes 1,2 and 3 published in 2004 and to examine potential errors and biases in the review process.
Level of Investigation Descriptive
Summary of Findings Replication of the literature searches for the Cochrane review of low level laser therapy for osteoarthritis classes 1,2 and 3 identified two trials that met the original stated objective without being included in the Cochrane review. An imbalance of the review group was identified as reviewers tend to favour their own trial conclusions. Other problems included: Inclusion of invalid (categorical) data in statistical analysis of continuous data; Omission of continuous data in statistical analysis of included trials; Omission of categorical data in statistical analysis of included trials; Omission of data from non-included trials; Lack of transparency in which trial data is entered into main results and; Non-performance of pre-planned subgroup analysis.
Number of systematic reviews included 1
Number of eligible systematic reviews assessed 1
Treatment impacted Yes
Treatment impacted description
Interpretation impacted Yes
Interpretation impacted description Cochrane review displays omissions of relevant trial data that contradict the review conclusion. Serious errors in data synthesis, omission of relevant data, and non-inclusion of eligible trials were identified, and nearly all systematically pointed in a negative direction for LLLT efficacy.