The_Grading_of_Recommendations_Assessment,_Development_and_Evaluation_(GRADE)_approach

GRADE approach

GRADE approach

Method of assessing the certainty in evidence


The GRADE approach (Grading of Recommendations Assessment, Development and Evaluation) is a method of assessing the certainty in evidence (also known as quality of evidence or confidence in effect estimates) and the strength of recommendations in health care.[1] It provides a structured and transparent evaluation of the importance of outcomes of alternative management strategies, acknowledgment of patients and the public values and preferences, and comprehensive criteria for downgrading and upgrading certainty in evidence. It has important implications for those summarizing evidence for systematic reviews, health technology assessments, and clinical practice guidelines as well as other decision makers.[2]

However, when used to summarize evidence from nutritional science, dietary, lifestyle and environmental exposure, the use of the GRADE approach has been criticized. That is because the GRADE system only allows for randomized controlled trials (RCT) to be rated as high evidence and rates all observational studies as low evidence because of their potential of confounding. This dismisses the strength of observational studies when it comes to long-term effects of dietary and lifestyle factors and does not reflect the key limitations that RCTs have when it comes to long-term effects.[3][4] One example of a slowly progressing disease that should preferably be studied with observational studies but not RCTs is atherosclerosis.[5]

Background and history

The GRADE began in the year 2000 as a collaboration of methodologists, guideline developers, biostatisticians, clinicians, public health scientists and other interested members. GRADE developed and implemented a common, transparent and sensible approach to grading the quality of evidence (also known as certainty in evidence or confidence in effect estimates) and strength of recommendations in healthcare.[6][7]

GRADE components

The GRADE approach separates recommendations following from an evaluation of the evidence as strong or weak. A recommendation to use, or not use an option (e.g. an intervention), should be based on the trade-offs between desirable consequences of following a recommendation on the one hand, and undesirable consequences on the other. If desirable consequences outweigh undesirable consequences, decision makers will recommend an option and vice versa. The uncertainty associated with the trade-off between the desirable and undesirable consequences will determine the strength of recommendations.[8] The criteria that determine this balance of consequences are listed in Table 2. Furthermore, it provides decision-makers (e.g. clinicians, other health care providers, patients and policy makers) with a guide to using those recommendations in clinical practice, public health and policy. To achieve simplicity, the GRADE approach classifies the quality of evidence in one of four levels—high, moderate, low, and very low:

Quality of evidence

GRADE rates quality of evidence as follows:[9][10]

HighThere is a lot of confidence that the true effect lies close to that of the estimated effect.
ModerateThere is moderate confidence in the estimated effect: The true effect is likely to be close to the estimated effect, but there is a possibility that it is substantially different.
LowThere is limited confidence in the estimated effect: The true effect might be substantially different from the estimated effect.
Very lowThere is very little confidence in the estimated effect: The true effect is likely to be substantially different from the estimated effect.

The GRADE working group has developed a software application that facilitates the use of the approach, allows the development of summary tables and contains the GRADE handbook. The software is free for non-profit organizations and is available online.[11] The GRADE approach to assess the certainty in evidence is widely applicable, including to questions about diagnosis,[12][13] prognosis,[14][15] network meta-analysis[16] and public health.[17]

Strength of recommendation

Factors and criteria that determine the direction and strength of a recommendation:

More information Factor and criteria*, How the factor influences the direction and strength of a recommendation ...
  • Factors for which overlap is described are often not shown separately in a decision table.

Usage

Over 100 organizations (including the World Health Organization,[18] the UK National Institute for Health and Care Excellence (NICE), the Canadian Task Force for Preventive Health Care, the Colombian Ministry of Health and Social Protection,[citation needed] and the Saudi Arabian Ministry of Health[19]) have endorsed and/or are using GRADE to evaluate the quality of evidence and strength of health care recommendations.[citation needed]


References

  1. Schünemann, HJ; Best, D; Vist, G; Oxman, AD (2003). "Letters, numbers, symbols, and words: How best to communicate grades of evidence and recommendations?". Canadian Medical Association Journal. 169 (7): 677–80.
  2. Guyatt, GH; Oxman, AD; Vist, GE; Kunz, R; Falck-Ytter, Y; Alonso-Coello, P; Schünemann, HJ (2008). "GRADE: an emerging consensus on rating quality of evidence and strength of recommendation". BMJ. 336 (7650): 924–26. doi:10.1136/bmj.39489.470347.ad. PMC 2335261. PMID 18436948.
  3. Qian, Frank; Riddle, Matthew C.; Wylie-Rosett, Judith; Hu, Frank B. (2020-01-13). "Red and Processed Meats and Health Risks: How Strong Is the Evidence?". Diabetes Care. 43 (2): 265–271. doi:10.2337/dci19-0063. ISSN 0149-5992. PMC 6971786. S2CID 210841441.
  4. Parker-Pope, Tara; O’Connor, Anahad (2019-10-04). "Scientist Who Discredited Meat Guidelines Didn't Report Past Food Industry Ties". The New York Times. ISSN 0362-4331. Retrieved 2022-01-05.
  5. Guyatt, GH; Oxman, AD; Schünemann, HJ; Tugwell, P; Knotterus, A (2011). "GRADE guidelines: A new series of articles in the Journal of Clinical Epidemiology". Journal of Clinical Epidemiology. 64 (4): 380–382. doi:10.1016/j.jclinepi.2010.09.011. PMID 21185693.
  6. "GRADE home". Gradeworkinggroup.org. Retrieved 16 August 2019.
  7. Andrews, J; Guyatt, GH; Oxman, AD; Alderson, P; Dahm, P; Falck-Ytter, Y; Nasser, M; Meerpohl, J; Post, PN; Kunz, R; Brozek, J; Vist, G; Rind, D; Akl, EA; Schünemann, HJ (2013). "GRADE guidelines: 15. Going from evidence to recommendations: the significance and presentation of recommendations". Journal of Clinical Epidemiology. 66 (7): 719–725. doi:10.1016/j.jclinepi.2012.03.013. PMID 23312392.
  8. Balshem, H; Helfand, M; Schünemann, HJ; Oxman, AD; Kunz, R; Brozek, J; Vist, GE; Falck-Ytter, Y; Meerpohl, J; Norris, S; Guyatt, GH (April 2011). "GRADE guidelines 3: rating the quality of evidence - introduction". Journal of Clinical Epidemiology. 64 (4): 401–406. doi:10.1016/j.jclinepi.2010.07.015. PMID 21208779.
  9. Reed Siemieniuk and Gordon Guyatt. "What is GRADE?". BMJ Best Practice. Retrieved 2020-07-02.
  10. "GRADEpro". Gradepro.org. Retrieved 16 August 2019.
  11. Schünemann, HJ; Oxman, AD; Brozek, J; Glasziou, P; Jaeschke, R; Vist, G; Williams, J; Kunz, R; Craig, J; Montori, V; Bossuyt, P; Guyatt, GH (2008). "GRADEing the quality of evidence and strength of recommendations for diagnostic tests and strategies". BMJ. 336 (7653): 1106–1110. doi:10.1136/bmj.39500.677199.ae. PMC 2386626. PMID 18483053.
  12. Brozek, JL; Akl, EA; Jaeschke, R; Lang, DM; Bossuyt, P; Glasziou, P; Helfand, M; Ueffing, E; Alonso-Coello, P; Meerpohl, J; Phillips, B; Horvath, AR; Bousquet, J; Guyatt, GH; Schünemann, HJ (2009). "Grading quality of evidence and strength of recommendations in clinical practice guidelines: part 2 of 3. The GRADE approach to grading quality of evidence about diagnostic tests and strategies". Allergy. 64 (8): 1109–16. doi:10.1111/j.1398-9995.2009.02083.x. PMID 19489757. S2CID 8865010.
  13. Iorio, A; Spencer, FA; Falavigna, M; Alba, C; Lang, E; Burnand, B; McGinn, T; Hayden, J; Williams, K; Shea, B; Wolff, R; Kujpers, T; Perel, P; Vandvik, PO; Glasziou, P; Schünemann, H; Guyatt, G (2015). "Use of GRADE for assessment of evidence about prognosis: rating confidence in estimates of event rates in broad categories of patients". BMJ. 350: h870. doi:10.1136/bmj.h870. PMID 25775931.
  14. Spencer, FA; Iorio, A; You, J; Murad, MH; Schünemann, HJ; Vandvik, PO; Crowther, MA; Pottie, K; Lang, ES; Meerpohl, JJ; Falck-Ytter, Y; Alonso-Coello, P; Guyatt, GH (2012). "Uncertainties in baseline risk estimates and confidence in treatment effects". BMJ. 14: 345. doi:10.1136/bmj.e7401. PMID 23152569.
  15. Puhan, MA; Schünemann, HJ; Murad, MH; Li, T; Brignardello-Petersen, R; Singh, JA; Kessels, AG; Guyatt, GH (2014). "A GRADE Working Group approach for rating the quality of treatment effect estimates from network meta-analysis". BMJ. 24: 349. doi:10.1136/bmj.g5630. PMID 25252733.
  16. Burford, BJ; Rehfuess, E; Schünemann, HJ; Akl, EA; Waters, E; Armstrong, R; Thomson, H; Doyle, J; Pettman, T (2012). "Assessing evidence in public health: the added value of GRADE". J Public Health. 34 (4): 631–5. doi:10.1093/pubmed/fds092. PMID 23175858.
  17. "GRADEpro". Gradepro.org. Retrieved 16 August 2019.

Share this article:

This article uses material from the Wikipedia article The_Grading_of_Recommendations_Assessment,_Development_and_Evaluation_(GRADE)_approach, and is written by contributors. Text is available under a CC BY-SA 4.0 International License; additional terms may apply. Images, videos and audio are available under their respective licenses.