Overinterpretation of Research Findings: Evaluation of "Spin" in Systematic Reviews of Diagnostic Accuracy Studies in High-Impact Factor Journals

Ref ID 527
First Author T. A. McGrath
Journal CLINICAL CHEMISTRY
Year Of Publishing 2020
URL https://watermark.silverchair.com/hvaa093.pdf?token=AQECAHi208BE49Ooan9kkhW_Ercy7Dm3ZL_9Cf3qfKAc485ysgAAAsEwggK9BgkqhkiG9w0BBwagggKuMIICqgIBADCCAqMGCSqGSIb3DQEHATAeBglghkgBZQMEAS4wEQQMhoGopop7KXOQ-AfOAgEQgIICdHbIbaHQOWgRbbI8K6jZDZ_QSD7aWI0-sZrJr0j2fA4KdadsCZN5_G95Ay_Ht537vmEERJHZGR2VFOwqR24qUM9t_RGhehQybGiPOIhPJJXxaIQIJrrkSVDiaATFTdpBK_XVjc494kKAU3bzhsEliDdgamdVP7_coTQqg9jDBMJZYs5gH7-4rCayLHBXX-en5ewnFk-vE1p1M5SI13oJRtBFCcTd276rrxiTndYnHXpwHyjQKpC0Z9oUFPp8eEmKcZfx19btHZggzy7I_RgR7eDrDcIKokp0ob7bU7qo0aauNCkj7yXe0-5al74sjbXpjqMcMpuGa9qPOP5-dzcJkr6CkmTk3ohFjJ4bXS0lHC1A1sed2uZujSsQUUHuoxzJtjhB8wq9pKMb4Iy5O36B6JhmEUS2YAc6iifd7kLmjV3jlroafZOXGaDks1xEnah3DCCOWOO4le44bUfzofi4maznz4tlJZwBuEvWPLl5n6skksA7qozfF3SJPKzWUWy6CmjNet7BuetX-jleURPdp2MuqHmNfXVNjOklQzRL_WvqH5IP-z20k7DqqCzRSCf8hjNCZsXDJvNswlHQwt2eunF38Ndu14qjnRf4rKS3we7vLTvplYbh7GgZtHS94iLpqCaV6xMsAbPDEBw7OMvWcZfl2SQrEh9Jia9p00CfSNIE_kXVXpp7LkOlgM_91WI36sZslXF_faFekE9IDM7M6x4_sk7qYZME1uIHqtDlutrALTsdfDFH2AvRSvps0wUAMEdEdf1MjsfKETHe4cEnRVFT7wRJvYDJWRq7dxPs_iVUFPQrmiouaMpffRjlLOiMe2_86rQ
Keywords • Spin
• Non-Cochrane reviews
• Cochrane
• Diagnostic
Problem(s) • Spin or subjective interpretation of findings
• Cochrane reviews more rigorous/higher quality than non-Cochrane reviews
Article Type Empirical
Article Subtype Cross-sectional survey/Methodological systematic review
First Author Country Canada
Aim To assess the frequency of “spin” in both abstracts and full text reports of systematic reviews of diagnostic accuracy studies published in Medline between January 2010 to January 2019.
Level of Investigation Descriptive
Summary of Findings At least one actual overinterpretation practice was present in the abstract in 46% of included reviews and in the full-text report in 38% of included reviews. Reviews published in the Cochrane Database of Systematic Reviews were less likely to contain actual overinterpretation in the abstract or the full-text report than reviews in other high-impact journals
Number of systematic reviews included 137
Number of eligible systematic reviews assessed 1242
Treatment impacted Yes
Treatment impacted description Two investigators independently applied criteria for assessing overinterpretation and conclusion positivity to each included systematic review.
Interpretation impacted Yes
Interpretation impacted description Common overinterpretations were "positive conclusion, not reflecting the reported summary accuracy estimates"; "positive conclusion, not taking high risk of bias and/or applicability concerns into account"; and "positive conclusion, not taking heterogeneity into account".