A systematic review of the quality of distal radius systematic reviews: Methodology and reporting assessment
- PMID: 30673700
- PMCID: PMC6343870
- DOI: 10.1371/journal.pone.0206895
A systematic review of the quality of distal radius systematic reviews: Methodology and reporting assessment
Abstract
Background: Many systematic reviews (SRs) have been published about the various treatments for distal radius fractures (DRF). The heterogeneity of SRs results may come from the misuse of SR methods, and literature overviews have demonstrated that SRs should be considered with caution as they may not always be synonymous with high-quality standards. Our objective is to evaluate the quality of published SRs on the treatment of DRF through these tools.
Methods: The methods utilized in this review were previously published in the PROSPERO database. We considered SRs of surgical and nonsurgical interventions for acute DRF in adults. A comprehensive search strategy was performed in the MEDLINE database (inception to May 2017) and we manually searched the grey literature for non-indexed research. Data were independently extracted by two authors. We assessed SR internal validity and reporting using AMSTAR (Assessing the Methodological Quality of Systematic Reviews and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyzes). Scores were calculated as the sum of reported items. We also extracted article characteristics and provided Spearman's correlation measurements.
Results: Forty-one articles fulfilled the eligibility criteria. The mean score for PRISMA was 15.90 (CI 95%, 13.9-17.89) and AMSTAR was 6.48 (CI 95% 5.72-7.23). SRs that considered only RCTs had better AMSTAR [7.56 (2.1) vs. 5.62 (2.3); p = 0.014] and PRISMA scores [18.61 (5.22) vs. 13.93 (6.47), p = 0.027]. The presence of meta-analysis on the SRs altered PRISMA scores [19.17 (4.75) vs. 10.21 (4.51), p = 0.001] and AMSTAR scores [7.68 (1.9) vs. 4.39 (1.66), p = 0.001]. Journal impact factor or declaration of conflict of interest did not change PRISMA and AMSTAR scores. We found substantial inter observer agreement for PRISMA (0.82, 95% CI 0.62-0.94; p = 0.01) and AMSTAR (0.65, 95% CI 0.43-0.81; p = 0.01), and moderate correlation between PRISMA and AMSTAR scores (0.83, 95% CI 0.62-0.92; p = 0.01).
Conclusions: DRF RCT-only SRs have better PRISMA and AMSTAR scores. These tools have substantial inter-observer agreement and moderate inter-tool correlation. We exposed the current research panorama and pointed out some factors that can contribute to improvements on the topic.
Conflict of interest statement
The authors have declared that no competing interests exist.
Figures
Similar articles
-
Abstract analysis method facilitates filtering low-methodological quality and high-bias risk systematic reviews on psoriasis interventions.BMC Med Res Methodol. 2017 Dec 29;17(1):180. doi: 10.1186/s12874-017-0460-z. BMC Med Res Methodol. 2017. PMID: 29284417 Free PMC article.
-
Methodological and reporting quality assessment of systematic reviews and meta-analyses in the association between sleep duration and hypertension.Syst Rev. 2024 Aug 6;13(1):211. doi: 10.1186/s13643-024-02622-0. Syst Rev. 2024. PMID: 39107813 Free PMC article.
-
Comparison of methodological quality rating of systematic reviews on neuropathic pain using AMSTAR and R-AMSTAR.BMC Med Res Methodol. 2018 May 8;18(1):37. doi: 10.1186/s12874-018-0493-y. BMC Med Res Methodol. 2018. PMID: 29739339 Free PMC article.
-
Completeness of reporting in systematic reviews and meta-analyses in vascular surgery.J Vasc Surg. 2023 Dec;78(6):1550-1558.e2. doi: 10.1016/j.jvs.2023.04.009. Epub 2023 Apr 15. J Vasc Surg. 2023. PMID: 37068527 Review.
-
Systematic Reviews in Sports Medicine.Am J Sports Med. 2016 Feb;44(2):533-8. doi: 10.1177/0363546515580290. Epub 2015 Apr 21. Am J Sports Med. 2016. PMID: 25899433 Review.
Cited by
-
Percutaneous pinning for treating distal radial fractures in adults.Cochrane Database Syst Rev. 2020 Feb 7;2(2):CD006080. doi: 10.1002/14651858.CD006080.pub3. Cochrane Database Syst Rev. 2020. PMID: 32032439 Free PMC article.
-
Treatment of radius or ulna fractures in the elderly: A systematic review covering effectiveness, safety, economic aspects and current practice.PLoS One. 2019 Mar 28;14(3):e0214362. doi: 10.1371/journal.pone.0214362. eCollection 2019. PLoS One. 2019. PMID: 30921377 Free PMC article.
-
Diagnostic criteria and outcome measures in randomized clinical trials on carpal tunnel syndrome: a systematic review.Sao Paulo Med J. 2023 Apr 17;141(6):e2022086. doi: 10.1590/1516-3180.2022.0086.07022023. eCollection 2023. Sao Paulo Med J. 2023. PMID: 37075455 Free PMC article.
-
Declining Quality of Systematic Reviews in Orthopaedic Sports Medicine: An Updated Systematic Review.Arthrosc Sports Med Rehabil. 2022 Jan 13;4(2):e789-e795. doi: 10.1016/j.asmr.2021.11.013. eCollection 2022 Apr. Arthrosc Sports Med Rehabil. 2022. PMID: 36457822 Free PMC article. Review.
-
What to Expect? Use of Supplemental Fixation With a Concomitant Dorsal Spanning Plate for Complex Intraarticular Distal Radius Fractures.Hand (N Y). 2024 May 2:15589447241247335. doi: 10.1177/15589447241247335. Online ahead of print. Hand (N Y). 2024. PMID: 38695392 Free PMC article.
References
-
- Higgins JS. Cochrane handbook for systematic reviews of interventions 4.2.4. 2005.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Medical
Research Materials