Table 3.
Adaptation methodology/year | Selection of the scope and source CG(s) | Assessment of source materials | Decision-making process | External review and follow-up |
ADAPTE 20109 |
|
|
|
|
Adopt–Contextualise–Adapt Framework 201636 |
|
|
|
|
ACP guidance statement 201934 |
|
|
|
|
ASCO CG endorsement/adaptation methodology 201932 |
|
|
|
|
CCO endorsement protocol 201935 |
|
|
|
|
DynaMed editorial methodology 201933 |
|
|
|
|
DELBI 201938 |
|
|
|
|
GRADE-ADOLOPMENT 20174 |
|
|
|
|
Piloted adaptation framework 20178 |
|
|
|
|
Adaptation experience 2019 |
|
|
|
|
The criteria or clarification for topic/scope/questions selection and source CG screening: 1: Quote: ‘At that time we have identified the top of the conditions for stroke and low back pain. We look at the literature, even at that time, there were so many CGs published already for those two topics.’ (Participant 10) 2: Sources were from PubMed and GIN library in the last five years or current practice, and Web of science. 3: Criteria are: high-quality CG developers, detailed CoI management, and financially independence; or applicant organisations’ preferable. 4: Quote: ‘If the CG adaptation groups plan to develop a new CG, they will search for the existing evidence from published CGs first.’ (Participant 06) 5: Assessed the relevance to stakeholders, proposed by a professional group or prioritised by stakeholders; In addition, GRADE approach and Evidence to Decision frameworks availability are required. 6: Quote: ‘A lot of kind of process will be in a national process, and there will be specific health questions and PICOs. Then we will be asked to conduct SRs. We do have in that particular process is that the SR would include first to look at what CGs are out there, and then we will look at what SRs are out there before we conduct our systematic review.’ (Participant 09) | ||||
The considerations or clarifications for the assessment of source materials: a: Quote: ‘We quickly appraise source CGs using AGREE II to ensure the source CG you are basing on are good quality; … To adapt, we update the search and include new evidence. …It means you take evidence surrounded for instance in the local context settings, there might be a new paper has been published locally, not internationally, but it answers the questions the local context actually asked. Then the recommendation could change.’ (Participant 10) b: Quote: ‘We will look at the evidence and do the assessment ourselves. If we do the quality assessment, we look at the systematic review, and if the systematic review doesn’t make sense, we will look at the primary studies.’ (Participant 07) c: Quote: ‘We do not have a numeric cut-off for AGREE II.’ (Participant 02) d: Criteria: Scope, relevance, and timing, quality and methods, resource availability; acceptability; e: Interpretation and justification, applicability/relevance, qualifications & clarifications. f: Quote: ‘If we see many CGs agree, and we know the evidence is high quality, we don’t need to go into a lot of greater depth because everything is pointing into the right direction. If we see the CGs are disagreeing, then we may have to evaluate and see why they are disagreeing and that where we checked the currency of the content to help us to understand the disagreement.’ (Participant 01) g: Quote: ‘We don’t have a critical cut off to choose which CG to use, we do prioritise by the quality of the CG. The CG adaptation group will create CG synopses, prefer methodologically sound recommendations. …The adaptation group should be transparent if they have appropriate changes in the recommendations when the adaptation process and provide the scientific rationale behind the change.’ (Participant 03) h: We conducted rapid SRs of patient’s value, cost-effectiveness; We considered local data suggested by panel members (patients’ value and preference, cost, resource use, population prevalence and incidence). i: Quote: ‘We request the adaptation group to assess the quality of the CGs using the AGREE II instrument. We do not have a cut-off of the AGREE score, because sometimes there are few source CGs for the consideration of adaptation. … If there are no clear answers for several questions in the source CG(s), they looked at existing Cochrane SRs but do not conduct a new one. No cost-effectiveness evidence was searched, but patients’ values and preferences, yes.’ (Participant 08) j: Quote: ‘If there is a CG of good quality, those are the recommendations. So, if I see a CG from NICE, or from European, our society will have both or do an AGREE appraisal. If there are good quality, I transparently put in my review about what the quality it was, and I pooled out the recommendations that could be relevant for that health question. And then I also look at the underlying evidence from those CGs, also the SRs, that independent of pooling out the if possible, a GRADE evidence table, or something that explains the magnitude of the effect and the certainty of evidence.’ (Participant 09) | ||||
The considerations or clarifications for the decision-making process: α: Quote: ‘In the most recent CG we published, we extracted the source recommendations from the source CGs, we have developed composite recommendations, which is the new recommendation based on the other CG have said…’ (Participant 10) β: ‘Current evidence, current CGs, and clinical expertise’s recommendations to support clinical decision making’. µ: Quote: ‘For people who work in the CG adaptation group they have any Evidence to Decision framework, so they will look at the quality of evidence from source CGs or other SRs.’ (Participant 09) | ||||
The considerations or clarifications for the external review process: * Quote: ‘Our organisation doesn’t do for the CG adaptation group, but they do the external review process by themselves’. (Participant 03) ƚ Quote: ‘The national group I am referring to send the adapted CG out for comment, feedback, and input as external review. We don’t have a specific small external review team broadly.’ (Participant 10) |
DELBI is a CG assessment tool used by adaptation group to inform CG adaptation.
ACP, American College of Physicians; ADAPTE, Resource Toolkit for Guideline Adaptation; AGREE II, Appraisal of Guidelines for Research & Evaluation II; ASCO, American Society of Clinical Oncology; CCO, Cancer Care Ontario; CGs, clinical guidelines; CoI, conflict of interest; DELBI, German Instrument for Methodological Guideline Appraisal; GRADE, Grading of Recommendations, Assessment, Development and Evaluations; NA, not applicable; NICE, National Institute for Health and Care Excellence; SR, systematic review.