Poor consideration of publication bias

This problem is addressed in PRISMA 2009, PRISMA 2020, AMSTAR 1, AMSTAR 2, ROBIS and MECIR. Publication bias, or the tendency for academic papers to report significant results, can be addressed by searching for and including grey literature. Retrospective examination of publication bias, such as the use of funnel plots or GRADE assessment can also be useful, but only if conducted and interpreted correctly.

Articles that support this problem:

Methodological quality and reporting of systematic reviews in hand and wrist pathology

2017 : Journal of hand surgery (european volume)

Assessing the methodological quality of systematic reviews in radiation oncology: A systematic review

2017 : Cancer epidemiology

Journal impact factor is associated with PRISMA endorsement, but not with the methodological quality of low back pain systematic reviews: a methodological review

2020 : European spine journal

Overall confidence in the results of systematic reviews on exercise therapy for chronic low back pain: a cross-sectional analysis using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) 2 tool

2020 : Brazilian journal of physical therapy

Methodological quality and descriptive characteristics of prosthodontic‐related systematic reviews

2013 : Journal of oral rehabilitation

Quality assessment of systematic reviews of vitamin D, cognition and dementia

2018 : Bjpsych open

Methodological quality of systematic reviews published in the urological literature from 1998 to 2012

2015 : The journal of urology

An AMSTAR assessment of the methodological quality of systematic reviews of oral healthcare interventions published in the Journal of Applied Oral Science (JAOS)

2011 : Journal of applied oral science

Quality of urological systematic reviews registered in PROSPERO

2019 : Bju international

Variable methodological quality and use found in systematic reviews referenced in STEMI clinical practice guidelines

2017 : The american journal of emergency medicine

The methodological quality of systematic reviews on the treatment of adult major depression needs improvement according to AMSTAR 2: A cross-sectional study

2020 : Heliyon

Statistical controversies in clinical research: publication bias evaluations are not routinely conducted in clinical oncology systematic reviews

2017 : Annals of oncology

Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study

2016 : Plos medicine

Systematic reviews in burns care: poor quality and getting worse

2017 : Journal of burn care & research

Evaluation of methodology and quality characteristics of systematic reviews in orthodontics

2011 : Orthodontics & craniofacial research

Methodological quality of systematic reviews and clinical trials on women's health published in a Brazilian evidence-based health journal

2013 : Clinics

The quality of systematic reviews of effectiveness in literacy learning in English: a ‘tertiary’review

2007 : Journal of research in reading

The quality of systematic reviews addressing peripheral nerve repair and reconstruction

2019 : Journal of plastic, reconstructive & aesthetic surgery: jpras

Prostate Artery Embolisation: Poor Design and Reporting Impact the Value of Current Systematic Reviews

2018 : European urology

Quality assessment of systematic reviews regarding the effectiveness of zygomatic implants: an overview of systematic reviews

2020 : Medicina oral, patologia oral y cirugia bucal

Quality assessment of systematic reviews on periodontal regeneration in humans

2013 : Journal of periodontology

Quality of systematic reviews of the Foods with Function Claims registered at the Consumer Affairs Agency Web site in Japan: a prospective systematic review

2017 : Nutrition research

Quality of Systematic Reviews of the Foods with Function Claims in Japan: Comparative Before- and After-Evaluation of Verification Reports by the Consumer Affairs Agency

2019 : Nutrients

Systematic Reviews in Craniofacial Trauma—Strengths and Weaknesses

2016 : Annals of plastic surgery

The currency, completeness and quality of systematic reviews of acute management of moderate to severe traumatic brain injury: A comprehensive evidence map

2018 : Plos one [electronic resource]

Statistical methods can be improved within Cochrane pregnancy and childbirth reviews

2011 : Journal of clinical epidemiology

Reporting and methodological quality of systematic reviews in the orthopaedic literature

2013 : Jbjs

Critical appraisal of systematic reviews on the effect of a history of periodontitis on dental implant loss

2013 : Journal of clinical periodontology

The methodological quality of systematic reviews and meta-analyses on the effectiveness of non-pharmacological cancer pain management

2015 : Pain management nursing

The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey

2007 : Cmaj

Quality Assessment of Systematic Reviews on the Efficacy of Oral Appliance Therapy for Adult and Pediatric Sleep-Disordered Breathing

2016 : Journal of clinical sleep medicine

Quality assessment of systematic reviews on alveolar ridge preservation

2013 : Journal of the american dental association

Non-communicable diseases research output in the Eastern Mediterranean region: an overview of systematic reviews

2020 : Bmc medical research methodology

The association between periodontitis and coronary heart disease: a quality assessment of systematic reviews

2013 : Journal of the american dental association

Publication bias is underreported in systematic reviews published in high-impact-factor journals: metaepidemiologic study

2014 : Journal of clinical epidemiology

Systematic reviews supporting practice guideline recommendations lack protection against bias

2013 : Journal of clinical epidemiology

P value-driven methods were underpowered to detect publication bias: analysis of Cochrane review meta-analyses

2020 : Journal of clinical epidemiology

Epidemiology, quality, and reporting characteristics of systematic reviews and meta-analyses of nursing interventions published in Chinese journals

2015 : Nursing outlook

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool

2015 : Npj primary care respiratory medicine

Methodological quality of systematic reviews in subfertility: a comparison of Cochrane and non-Cochrane systematic reviews in assisted reproductive technologies

2012 : Human reproduction

Quality Assessment of Systematic Review of the Bariatric Surgery for Diabetes Mellitus

2019 : Journal of diabetes research

Publication bias in meta-analyses from the Cochrane Database of Systematic Reviews

2015 : Statistics in medicine

The methodological quality of systematic reviews of animal studies in dentistry

2012 : The veterinary journal

Assessment of the quality of systematic reviews on COVID‐19: A comparative study of previous coronavirus outbreaks

2020 : Journal of medical virology

Epidemiology, quality and reporting characteristics of systematic reviews of traditional Chinese medicine interventions published in Chinese journals

2011 : Plos one

Chinese herbal medicine for the treatment of primary hypertension: a methodology overview of systematic reviews

2016 : Systematic reviews

Assessment of publication bias and outcome reporting bias in systematic reviews of health services and delivery research: A meta-epidemiological study

2020 : Plos one

The case of the misleading funnel plot

2006 : Bmj

In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias

2005 : Journal of clinical epidemiology

Dissemination bias in systematic reviews of animal research: a systematic review

2014 : Plos one

Search for unpublished data by systematic reviewers: an audit

2017 : Bmj open

Methodological Quality of Systematic Reviews and Meta-Analysis on Asthma Treatments. A Cross-Sectional Study

2020 : Annals of the american thoracic society

Methodological Assessment in a Systematic Review for Anal Human Papillomavirus among Men

2019 : Journal of infectious diseases

Assessment of funnel plot asymmetry and publication bias in reproductive health meta-analyses: an analytic survey

2007 : Reproductive health

Improvement needed in the network geometry and inconsistency of Cochrane network meta-analyses: a cross-sectional survey

2019 : Journal of clinical epidemiology

The magnitude of small-study effects in the Cochrane Database of Systematic Reviews: an empirical study of nearly 30 000 meta-analyses

2020 : Bmj evidence-based medicine

Systematic review adherence to methodological or reporting quality

2017 : Systematic reviews

Evaluating Approaches to Quality Assessment in Library and Information Science LIS Systematic Reviews: A Methodology Review

2016 : Evidence based library and information practice

Nature and reporting characteristics of UK health technology assessment systematic reviews

2018 : Bmc medical research methodology

The landscape of systematic reviews in urology (1998 to 2015): an assessment of methodological quality

2017 : Bju international

Potential Problems With Systematic Reviews and Meta-Analyses

2017 : Journal of pain

A review of methodological quality of systematic reviews on multiple pregnancies

2006 : Journal of obstetrics & gynaecology

A descriptive analysis of child-relevant systematic reviews in the Cochrane Database of Systematic Reviews

2010 : Bmc pediatrics

Comparison of methodological quality rating of systematic reviews on neuropathic pain using AMSTAR and R-AMSTAR

2018 : Bmc med res methodol

DPP-4 inhibitors for the treatment of type 2 diabetes: a methodology overview of systematic reviews

2019 : Acta diabetologica

Survey of the reporting characteristics of systematic reviews in rehabilitation

2013 : Physical therapy

Identification and impact of outcome selection bias in meta‐analysis

2005 : Statistics in medicine

Reporting of sources of funding in systematic reviews in periodontology and implant dentistry

2014 : British dental journal

Systematic reviews in dentistry: Current status, epidemiological and reporting characteristics

2019 : Journal of dentistry

Low Methodological Quality of Systematic Reviews Published in the Urological Literature (2016-2018)

2020 : Urology

Assessment of the methodological quality of systematic reviews published in the urological literature from 1998 to 2008

2010 : The journal of urology

Methodological quality of systematic reviews on treatments for depression: a cross-sectional study

2018 : Epidemiology & psychiatric science

The quality of Cochrane systematic reviews of acupuncture: an overview

2020 : Bmc complementary medicine and therapies

Association Between Prospective Registration and Quality of Systematic Reviews in Type 2 Diabetes Mellitus: A Meta-epidemiological Study

2021 : Frontiers in medicine

The effectiveness of adjunctive measures in managing peri-implant mucositis: an umbrella review

2022 : International journal of implant dentistry

Analysis of Systematic Reviews in Clinical Practice Guidelines for Head and Neck Cancer

2022 : Laryngoscope

Evidence Mapping Based on Systematic Reviews of Cognitive Behavioral Therapy for Neuropathic Pain

2023 : Neural plasticity

A Call for Improving Research on Pain Neuroscience Education and Chronic Pain: An Overview of Systematic Reviews

2023 : Journal of orthopaedic & sports physical therapy

Digital Biomarker-Based Interventions: Systematic Review of Systematic Reviews

2022 : Journal of medical internet research

Critical appraisal of systematic reviews of intervention in dentistry published between 2019-2020 using the AMSTAR 2 tool

2022 : Evidence based dentistry

Comment on "Ticks infected with Crimean-Congo hemorrhagic fever virus (CCHFV): A decision approach systematic review and meta-analysis regarding their role as vectors"

2023 : Travel medicine and infectious disease

A commentary on "Robot-assisted kidney transplantation as a minimally invasive approach for kidney transplant recipients: A systematic review and meta-analyses" [Int. J. Surg. 99 (2022) 106264]

2022 : International journal of surgery

Trends in systematic reviews of kidney transplantation: A 10-year analysis of the evidence base

2023 : Transplantation reviews

Efficacy and safety of acupuncture for polycystic ovary syndrome: An overview of systematic reviews

2023 : The journal of integrative medicine

An Overview of Systematic Reviews: Acupuncture in the Treatment of Essential Hypertension

2022 : International journal of general medicine

Is data missing? An assessment of publication bias in orthodontic systematic reviews from 2010 to 2021

2022 : European journal of orthodontics