Systems for grading the quality of evidence and the strength of recommendations I: critical appraisal of existing approaches The GRADE Working Group
- PMID: 15615589
- PMCID: PMC545647
- DOI: 10.1186/1472-6963-4-38
Systems for grading the quality of evidence and the strength of recommendations I: critical appraisal of existing approaches The GRADE Working Group
Abstract
Background: A number of approaches have been used to grade levels of evidence and the strength of recommendations. The use of many different approaches detracts from one of the main reasons for having explicit approaches: to concisely characterise and communicate this information so that it can easily be understood and thereby help people make well-informed decisions. Our objective was to critically appraise six prominent systems for grading levels of evidence and the strength of recommendations as a basis for agreeing on characteristics of a common, sensible approach to grading levels of evidence and the strength of recommendations.
Methods: Six prominent systems for grading levels of evidence and strength of recommendations were selected and someone familiar with each system prepared a description of each of these. Twelve assessors independently evaluated each system based on twelve criteria to assess the sensibility of the different approaches. Systems used by 51 organisations were compared with these six approaches.
Results: There was poor agreement about the sensibility of the six systems. Only one of the systems was suitable for all four types of questions we considered (effectiveness, harm, diagnosis and prognosis). None of the systems was considered usable for all of the target groups we considered (professionals, patients and policy makers). The raters found low reproducibility of judgements made using all six systems. Systems used by 51 organisations that sponsor clinical practice guidelines included a number of minor variations of the six systems that we critically appraised.
Conclusions: All of the currently used approaches to grading levels of evidence and the strength of recommendations have important shortcomings.
Similar articles
-
Grading the quality of evidence and the strength of recommendations in clinical dentistry: a critical review of 2 prominent approaches.J Evid Based Dent Pract. 2010 Jun;10(2):78-85. doi: 10.1016/j.jebdp.2010.01.001. J Evid Based Dent Pract. 2010. PMID: 20466314
-
Grading quality of evidence and strength of recommendations in clinical practice guidelines part 3 of 3. The GRADE approach to developing recommendations.Allergy. 2011 May;66(5):588-95. doi: 10.1111/j.1398-9995.2010.02530.x. Epub 2011 Jan 17. Allergy. 2011. PMID: 21241318 Review.
-
AHRQ series paper 5: grading the strength of a body of evidence when comparing medical interventions--agency for healthcare research and quality and the effective health-care program.J Clin Epidemiol. 2010 May;63(5):513-23. doi: 10.1016/j.jclinepi.2009.03.009. J Clin Epidemiol. 2010. PMID: 19595577
-
Grading quality of evidence and strength of recommendations in clinical practice guidelines: Part 2 of 3. The GRADE approach to grading quality of evidence about diagnostic tests and strategies.Allergy. 2009 Aug;64(8):1109-16. doi: 10.1111/j.1398-9995.2009.02083.x. Epub 2009 May 29. Allergy. 2009. PMID: 19489757 Review.
-
Systems for grading the quality of evidence and the strength of recommendations II: pilot study of a new system.BMC Health Serv Res. 2005 Mar 23;5(1):25. doi: 10.1186/1472-6963-5-25. BMC Health Serv Res. 2005. PMID: 15788089 Free PMC article.
Cited by
-
The effect of sequential embryo transfer on pregnancy outcomes in patients with recurrent implantation failure: a systematic review and meta-analysis of randomized controlled trials.Arch Gynecol Obstet. 2024 Dec;310(6):2767-2781. doi: 10.1007/s00404-024-07764-z. Epub 2024 Oct 23. Arch Gynecol Obstet. 2024. PMID: 39443375
-
Supplemental Oxygen and Acute Myocardial Infarction - A Systematic Review and Meta-Analysis.Circ Rep. 2022 Jul 6;4(8):335-344. doi: 10.1253/circrep.CR-22-0031. eCollection 2022 Aug 10. Circ Rep. 2022. PMID: 36032381 Free PMC article.
-
The effect of non-steroidal anti-inflammatory drugs on postoperative delirium: a meta-analysis.Korean J Anesthesiol. 2024 Oct;77(5):546-554. doi: 10.4097/kja.24325. Epub 2024 Aug 6. Korean J Anesthesiol. 2024. PMID: 39104052 Free PMC article.
-
2022 European Thyroid Association Guidelines for the management of pediatric thyroid nodules and differentiated thyroid carcinoma.Eur Thyroid J. 2022 Nov 29;11(6):e220146. doi: 10.1530/ETJ-22-0146. Print 2022 Dec 1. Eur Thyroid J. 2022. PMID: 36228315 Free PMC article.
-
Effects of respiratory muscular training in post-covid-19 patients: a systematic review and meta-analysis of randomized controlled trials.BMC Sports Sci Med Rehabil. 2024 Aug 27;16(1):181. doi: 10.1186/s13102-024-00954-x. BMC Sports Sci Med Rehabil. 2024. PMID: 39192351 Free PMC article.
References
-
- Sackett DL. Rules of evidence and clinical recommendations on the use of antithrombotic agents. Chest. 1986;89:2S–3S. - PubMed
-
- Sackett DL. Rules of evidence and clinical recommendations on the use of antithrombotic agents. Archives Int Med. 1986;146:464–465.
-
- Sackett DL. Rules of evidence and clinical recommendations on the use of antithrombotic agents. Chest. 1989;95:2S–4S. - PubMed
-
- Cook DJ, Guyatt GH, Laupacis A, Sackett DL. Rules of evidence and clinical recommendations on the use of antithrombotic agents. Antithrombotic Therapy Consensus Conference. Chest. 1992;102:305S–311S. - PubMed
MeSH terms
LinkOut - more resources
Full Text Sources