Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Jan 23;14(1):e0206895.
doi: 10.1371/journal.pone.0206895. eCollection 2019.

A systematic review of the quality of distal radius systematic reviews: Methodology and reporting assessment

Affiliations

A systematic review of the quality of distal radius systematic reviews: Methodology and reporting assessment

João Carlos Belloti et al. PLoS One. .

Abstract

Background: Many systematic reviews (SRs) have been published about the various treatments for distal radius fractures (DRF). The heterogeneity of SRs results may come from the misuse of SR methods, and literature overviews have demonstrated that SRs should be considered with caution as they may not always be synonymous with high-quality standards. Our objective is to evaluate the quality of published SRs on the treatment of DRF through these tools.

Methods: The methods utilized in this review were previously published in the PROSPERO database. We considered SRs of surgical and nonsurgical interventions for acute DRF in adults. A comprehensive search strategy was performed in the MEDLINE database (inception to May 2017) and we manually searched the grey literature for non-indexed research. Data were independently extracted by two authors. We assessed SR internal validity and reporting using AMSTAR (Assessing the Methodological Quality of Systematic Reviews and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyzes). Scores were calculated as the sum of reported items. We also extracted article characteristics and provided Spearman's correlation measurements.

Results: Forty-one articles fulfilled the eligibility criteria. The mean score for PRISMA was 15.90 (CI 95%, 13.9-17.89) and AMSTAR was 6.48 (CI 95% 5.72-7.23). SRs that considered only RCTs had better AMSTAR [7.56 (2.1) vs. 5.62 (2.3); p = 0.014] and PRISMA scores [18.61 (5.22) vs. 13.93 (6.47), p = 0.027]. The presence of meta-analysis on the SRs altered PRISMA scores [19.17 (4.75) vs. 10.21 (4.51), p = 0.001] and AMSTAR scores [7.68 (1.9) vs. 4.39 (1.66), p = 0.001]. Journal impact factor or declaration of conflict of interest did not change PRISMA and AMSTAR scores. We found substantial inter observer agreement for PRISMA (0.82, 95% CI 0.62-0.94; p = 0.01) and AMSTAR (0.65, 95% CI 0.43-0.81; p = 0.01), and moderate correlation between PRISMA and AMSTAR scores (0.83, 95% CI 0.62-0.92; p = 0.01).

Conclusions: DRF RCT-only SRs have better PRISMA and AMSTAR scores. These tools have substantial inter-observer agreement and moderate inter-tool correlation. We exposed the current research panorama and pointed out some factors that can contribute to improvements on the topic.

PubMed Disclaimer

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1
Fig 1. Flow diagram.

Similar articles

Cited by

References

    1. Sabesan VJ, Valikodath T, Childs A, Sharma VK. Economic and social impact of upper extremity fragility fractures in elderly patients. Aging Clin Exp Res. 2015. August; 27(4):539–46. 10.1007/s40520-014-0295-y - DOI - PubMed
    1. Higgins JS. Cochrane handbook for systematic reviews of interventions 4.2.4. 2005.
    1. Dijkman BG, Abouali JA, Kooistra BW, Conter HJ, Poolman RW, Kulkarni AV, et al. Twenty years of meta-analyses in orthopaedic surgery: has quality kept up with quantity? J Bone Joint Surg Am. 2010. January; 92(1):48–57. 10.2106/JBJS.I.00251 - DOI - PubMed
    1. Poolman RW, Kerkhoffs GM, Struijs PA, Bhandari M. International Evidence-Based Orthopedic Surgery Working Group. Don't be misled by the orthopedic literature: tips for critical appraisal. Acta Orthop. 2007; 78(2):162–71. 10.1080/17453670710013636 - DOI - PubMed
    1. Moraes VY, Ferrari PM, Gracitelli GC, Faloppa F, Belloti JC. Outcomes in orthopedics and traumatology: translating research into practice. Acta Ortop Bras. 2014; 22: 330–333. 10.1590/1413-78522014220601009 - DOI - PMC - PubMed

Publication types

Grants and funding

The authors received no specific funding for this work.