The current issue of the United European Gastroenterology Journal builds on its previous dedication to guidelines and guideline methods by introducing the AGREE‐S methodological guide, an AGREE II extension for surgical interventions. 1 The AGREE‐S methodological guide is further enhanced by a reporting checklist and appraisal tool available at https://agree‐s.org/. 1 The AGREE‐S focuses on ensuring the quality of guidelines that specifically target surgical interventions with their characteristic challenges. Mainly to be used to aid with the completeness of reporting and transparency in de novo development of recommendations, it is also highly valuable in adoption, adaptation or adolopment of existing guidelines.
Clinical practice guidelines provide evidence‐based guidance coupled with expert input and patient perspectives to assist policymakers, clinicians, and patients in making decisions and improving clinical outcomes. Guideline panels often need to formulate recommendations when evidence is not optimal or is completely lacking. Responding to this issue by developing guidelines solely based on consensus without any attempt at systematic searching of the available literature is unsatisfactory and often leads to low uptake. Guideline methodologists, including the Grading of Recommendations Assessment, Development and Evaluation (GRADE) experts, have addressed the issue and solutions and good practice examples are available. 2 , 3 To increase impact, guidelines need to be trustworthy 4 and the United European Gastroenterology (as well as many other organisations) is dedicated to ensuring the highest standard with its relatively recently published guideline framework. 5
One of the central principles underlying trustworthiness is transparency. In other words, the methods used to develop guidelines as well as all the steps surrounding its conception, draughting, review and publication are publicly available and fully reported. Such high level of transparency is also needed to assess when changes in policy should be made, to understand the rationale for such changes, and for the process of adapting guidelines to local contexts. There are many methods and tools designed to support the development, reporting and assessment of trustworthy and transparent guidelines. 6
Among them is the Appraisal of Guidelines for Research & Evaluation (AGREE II) Instrument, an established tool that, although widely used, validated, and respected, may not necessarily, due to its general nature and focus on the clinical setting, address the specifics of certain fields, including surgery. 7 Some of the issues pertaining to surgical guidelines are the need to rely on low‐quality scientific evidence or solely expert evidence, the lack of standardisation among surgeons, the large impact of the level of surgical expertise and skills on the outcomes, and the differences in access to equipment, supplies and infrastructure, among others. 8 This was apparent in the 2019 guidelines on the surgical management of the Crohn's Disease, 9 where the developers felt that using the GRADE methodology (as was done for the medical management part of the same guideline) in the context of low‐quality observational surgical evidence would hamper, if not prevent completely, formulating recommendations, possibly sacrificing guideline quality.
Recent research has shown that 40% of surgical guidelines may not be suitable for clinical use with the median overall quality score of 4 out of 7. 8 This research has also indicated that having dedicated guideline committees, issuing guidelines regularly (to accumulate experience) and using GRADE were associated with the highest quality in surgical guidelines. These findings are in line with other guideline quality assessment studies. 10 In light of such evidence, it seems desirable to accelerate the implementation of the GRADE approach. To increase the number of available GRADE methodologists the Guidelines International Network (GIN) has recently initiated a comprehensive training program.
The AGREE‐S methodological guide, developed through a systematic, structured, evidence‐based and stakeholder‐informed consensus, responds to these challenges by proposing to develop a guideline protocol, to use a guideline development committee with a guideline methodologist, and to give special considerations to surgical expertise, among others. 1 We can underpin these points by our experience with a recently developed (not yet published) surgical guideline, where the panel prioritised the setting of a minimum surgical expertise and other necessary standards for certain considered procedures as one of the guideline key questions.
Moreover, tools such as AGREE‐S can be used for the adoption, adaptation and adolopment of high‐quality existing guidelines, methods that increase efficiency and avoid duplication of effort and are, therefore, preferrable to de novo development, whenever possible. 11 Although coming with its own set of challenges, the basis is to search and appraise existing guidelines and contextualise the recommendations using standardised validated tools. 5 , 12 A dedicated GIN Adaptation group is ready to assist in this area.
CONFLICT OF INTEREST
The authors have a potential intellectual conflict of interest in their involvement with guideline methods groups including the GIN Adaptation Group and the GRADE Working Group. There are no financial conflicts of interest.
DATA AVAILABILITY STATEMENT
Data sharing is not applicable to this article as no new data were created or analysed in this study.
REFERENCES
- 1. Logullo P, Florez I, Antoniou G, Markar S, López‐Cano M, Silecchia G, et al. AGREE‐S: AGREE II extension for surgical interventions – UEG and EAES methodological guide. U Eur Gastroenterol J. 2022;10(4). 10.1002/ueg2.12231 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Mustafa RA, Garcia CAC, Bhatt M, Riva JJ, Vesely S, Wiercioch W, et al. GRADE notes: how to use GRADE when there is “no” evidence? A case study of the expert evidence approach. J Clin Epidemiol. 2021;137:231–5. 10.1016/j.jclinepi.2021.02.026 [DOI] [PubMed] [Google Scholar]
- 3. Schünemann HJ, Zhang Y, Oxman AD. Distinguishing opinion from evidence in guidelines. BMJ. 2019;366:l4606. 10.1136/bmj.l4606 [DOI] [PubMed] [Google Scholar]
- 4. Ford N, Thomas R, Grove J. Transparency: a central principle underpinning trustworthy guidelines. J Clin Epidemiol. 2022;142:246–8. 10.1016/j.jclinepi.2021.11.025 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Skuja V, force UEGQoCT . Guidelines implementation toolbox. U Eur Gastroenterol J. 2020;8(8):984–6. 10.1177/2050640620960289 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Yao X, Xia J, Jin Y, Shen Q, Wang Q, Zhu Y, et al. Methodological approaches for developing, reporting, and assessing evidence‐based clinical practice guidelines: a systematic survey. J Clin Epidemiol. 2022;146:77–85. 10.1016/j.jclinepi.2022.02.015 [DOI] [PubMed] [Google Scholar]
- 7. Tsokani S, Antoniou SA, Moustaki I, López‐Cano M, Antoniou GA, Flórez ID, et al. Guideline assessment project II: statistical calibration informed the development of an AGREE II extension for surgical guidelines. Surg Endosc. 2021;35(8):4061–8. 10.1007/s00464-021-08604-w [DOI] [PubMed] [Google Scholar]
- 8. Antoniou SA, Tsokani S, Mavridis D, López‐Cano M, Antoniou GA, Stefanidis D, et al. Guideline assessment project: filling the GAP in surgical guidelines: quality improvement initiative by an International Working Group. Ann Surg. 2019;269(4):642–51. 10.1097/sla.0000000000003036 [DOI] [PubMed] [Google Scholar]
- 9. Adamina M, Bonovas S, Raine T, Spinelli A, Warusavitarne J, Armuzzi A, et al. ECCO guidelines on therapeutics in Crohn’s disease: surgical treatment. J Crohn's Colitis. 2020;14(2):155–68. 10.1093/ecco-jcc/jjz187 [DOI] [PubMed] [Google Scholar]
- 10. Sun W, An L‐Y, Bao X‐D, Qi Y‐X, Yang T, Li R, et al. Consensus and controversy among severe pancreatitis surgery guidelines: a guideline evaluation based on the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool. Gland Surg. 2020;9(5):1551–63. 10.21037/gs-20-444 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Klugar M, Kantorová L, Pokorná A, Líčeník R, Dušek L, Schünemann HJ, et al. Visual transformation for guidelines presentation of the strength of recommendations and the certainty of evidence. J Clin Epidemiol. 2022;143:178–85. 10.1016/j.jclinepi.2021.11.009 [DOI] [PubMed] [Google Scholar]
- 12. Fervers B, Burgers JS, Voellinger R, Brouwers M, Browman GP, Graham ID, et al. Guideline adaptation: an approach to enhance efficiency in guideline development and improve utilisation. BMJ Qual Saf. 2011;20(3):228–36. 10.1136/bmjqs.2010.043257 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data sharing is not applicable to this article as no new data were created or analysed in this study.