Skip to main content
. 2022 Aug 5;4(4):100298. doi: 10.1016/j.ocarto.2022.100298
Author/Year/Country Methods Clear inclusion/exclusion criteria Quality of evidence/LoE SoR
AAOS
2021 [36]
SLR
Delphi consensus
Formulation of workgroup, formulation of PICO questions, systematic literature search and review, recommendation development, review, revision and approval.
GRADE Strong: Evidence from two or more “High” quality studies with consistent findings for recommending for or against the intervention.
Moderate: Evidence from two or more “Moderate” quality studies with consistent findings, or evidence from a single “High” quality study for recommending for or against the intervention
Limited: Evidence from one or more “Low” quality studies with consistent findings or evidence from a single “Moderate” quality study recommending for or against the intervention
Consensus: There is no supporting evidence, or higher quality evidence was downgraded due to major concerns
Strong
Moderate
Limited
Consensus
VADoD
2020 [38]
SLR
Delphi consensus
Formulation and prioritization of key questions and definition of critical outcomes, systematic literature review, patient focus group, development of recommendation and grading, review and submission for approval.
GRADE Not described Strong: high confidence in the quality of the available scientific evidence, a clear difference in magnitude between the benefits and harms of an intervention, similar patient or provider values and preferences, and understood influence of other implications
Weak: work group has less confidence after assessment and believe additional evidence may change the recommendation.
Zhang 2020 [32] SLR
Delphi consensus
Formulation of clinical questions (Delphi techniques), PICO formulation, systematic literature search, GRADE process, recommendation formation
GRADE High: Level A
Moderate: Level B
Low: Level C
Very low: Level D
Strong: Class 1
Weak: Class 2
ACR
2019 [3]
SLR
Formulation of PICO questions, systematic literature search, scoping and clinical question development, interprofessional voting for recommendation formation.
GRADE SLR of RCTs.
Systematic reviews of observational studies were only included if judged by Voting Panel would add critical information for the formulation of recommendation.
Strong: compelling evidence of efficacy and that benefits clearly outweighed harms and burdens
Conditional: quality of the evidence proved low or very low and/or the balance of benefits versus harms and burdens was sufficiently close that warrant a shared decision-making between the patient and the clinician.
OARSI
2019 [4]
SLR
Formulation of clinical questions, systematic literature search, voting and formulation of recommendation
GRADE Recommendation level
Level 1A, 1B: ≥75% vote in favour
Level 2: 60–74% vote in favour
Level 3: 41–59% vote in favour
Level 4B: 26–40% vote in favour
Level 4A, 5: ≤25% vote in favour
Strong: Voting Panel members feel confident that the benefits of a particular intervention outweigh the harms, or that the harms outweigh the benefits.
Conditional: recommendation that carries risks that could potentially outweigh the benefit. Quality of evidence and uncertainty in values and preference are also taken into consideration.
Good clinical practice statement: recommendations made based on expert experience in the absence of direct, supportive RCT evidence
ESCEO
2019 [34]
SLR
Systematic literature search, review of summary of evidence, voting of recommendation.
GRADE Not described Strong: ≥75% vote in favour
Weak
ISR
2019 [29]
SLR
Delphi consensus
Based on framework of the Guidelines International Network Adaptation Working Group to identify, appraise, synthesize and customize the existing international guidelines to the needs of the Italian healthcare context
Defining scope of the guideline and formulation of clinical questions. Systematic review of all guidelines endorsed by international scientific societies, development of recommendation in accordance to AGREE reporting checklist, external peer review and rating.
AGREE II Oxford Levels of Evidence:
1: From meta-analysis of randomised controlled trials or from at least one RCT
2: From ≥1 controlled study without randomisation or from ≥1 cohort study
3: From ≥1 case-control study
4: From case-series or poor-quality cohort and case-control studies
5: From expert committee reports or opinions and/or clinical experience of respected authorities.
Not described
RACGP
2018 [37]
SLR
Systematic literature search build upon the literature in the first edition of the guideline, grading of recommendation, formulation of recommendation, voting, endorsement by NHMRC.
Searches: systematic reviews and RCTs
GRADE Quality of evidence
High
Moderate
Low
Very low
Strong: The working group is very confident that the benefits of an intervention clearly outweigh the harms (or vice versa)
Conditional: Denotes uncertainty over the balance of benefits or harms, such as when the evidence quality is low or very low, or when personal preferences or costs are expected to impact the decision, and as such refer to decisions where consideration of personal preferences is essential for decision making
EULAR
2018 [28]
SLR
EULAR standard Operating Procedure (SOP) (according to AGREEII)
Performed according to AGREEII. Formulation of research questions, systematic literature review, formulation of overarching principles, presentation of evidence from SLR and voting.
AGREEII Oxford Centre for Evidence-Based Medicine
1a: systematic review of RCTs
1b: individual RCT
2a: systematic review of cohort studies
2b: individual cohort study (including low-quality RCT; eg,<80% follow-up)
3a: systematic review of case-control studies
3b: individual case-control study
4: case-series (and poor quality cohort and case-control studies)
5: expert opinion without explicit critical appraisal, or based on physiology, bench research or ‘first principles’
Grade of recommendation
A: based on consistent level 1 evidence
B: based on consistent level 2 or 3 evidence or extrapolations from level 1 evidence
C: based on level 4 evidence or extrapolations from level 2 or 3 evidence
D: based on level 5 evidence or on troublingly inconsistent or inconclusive studies of any level
Level of Agreement: anonymous votes for LOA, on a numeric rating scale from 0 (total disagreement) to 10 (total agreement) for each recommendation. Mean and 95% CI of scores were presented.
AAOS
2017 [35]
SLR
Delphi consensus
Formulation of PICO questions, systematic literature search, review of evidence and integration of evidence to formulate recommendations and voting
Searches: full peer-reviewed published report of a clinical study.
GRADE Prognostic Study Design Quality Key:
High quality study: <2 flaws
Moderate quality study: ≥2 and ​< ​4 flaws
Low quality study: ≥4 and ​< ​6 flaws
Very low quality study: ≥6 flaws
Strong: Evidence from two or more “High” quality studies with consistent findings for recommending for or against the intervention.
Moderate: Evidence from two or more “Moderate” quality studies with consistent findings, or evidence from a single “High” quality study for recommending for or against the intervention
Limited: Evidence from two or more “Low” quality studies with consistent findings or evidence from a single “Moderate” quality study recommending for against the intervention or diagnostic or the evidence is insufficient or conflicting and does not allow a recommendation for or against the intervention
Consensus: There is no supporting evidence. Recommendation is based on clinical opinion
TLAR
2017 [30]
SLR
Delphi consensus
Systematic literature search, development of recommendation according to evidence, voting, reviewed and finalised draft.
Search: preference for meta-analysis, systematic reviews and RCTs.
Oxman-Guyatt index and Jadad Scale Ia: meta-analysi of RCTs
Ib: ≥ 1 RCT
IIa: ≥ well-designed
IIIb: ≥ 1 well-designed quasi-IV: expert committee
Oxman-Guyatt index (or metanalysis and systematic reviews);
Jadad scale: RCTs
PANLAR
2016 [31]
SLR
Delphi consensus
SLR performed by literature search team, expert consensus through Delphi technique, approval by members of working groups.
Not available in manuscript Oxford Centre for Evidence-Based Medicine Level A: Information from various randomised clinical trials or meta-analyses.
Level B: Information from a randomised clinical trial or nonrandomized studies.
Level C: Experts' consensus, case studies, or care standards
Jadad scale
I: There is evidence and/or general agreement that a procedure or treatment is beneficial, useful, or effective.
II: Conflicting evidence and/or differing opinions about the efficacy of a procedure or treatment.
IIa: Evidence and/or agreement favour usefulness or efficacy.
IIb: Usefulness or efficacy is not established by evidence or opinion.
III: Conditions for which there is evidence, general agreement, or both that the procedure treatment is not useful/effective and in some cases may be harmful.
NICE
2014 [39]
SLR
Expert consensus if absence of proof.
Economic considerations
Formulation of PICO questions by guideline development group, generation of summaries of evidence according to GRADE profiles, quality appraisal and grading of clinical evidence, review of evidence of cost-effectiveness, development of recommendations, peer review.
GRADE Overall quality of outcome evidence in GRADE:
High: Future research is very unlikely to change the estimate of effect
Moderate: Future research is likely to have an important impact in the estimate of effect and may change the estimate
Low: Future research is very likely to have an important impact in the estimate of effect and is likely to change the estimate
Very low: Any estimate of effect is very uncertain.
Not described
EULAR
2013 [27]
SLR
Delphi consensus
Delphi consensus. Systematic literature reviews, extensive discussion on recommendations with data from SLR, voting for level of agreement.
EULAR standard Operating Procedure (SOP) Ia: meta-analysis of RCTs
Ib: ≥ 1 RCT
IIa: ≥ 1 controlled trial without randomisation
IIIb: ≥ 1 well-designed quasi- experiment study
IV: expert committee reports or opinions and/or clinical experience of respected authorities.
Level of agreement: anonymous votes for LOA, on a numeric rating scale from 0 (total disagreement) to 10 (total agreement) for each recommendation. Mean and 95% CI of scores were presented.
MSR
2013 [33]
SLR
Development of clinical questions, systematic literature review, grading of evidence, external review of drafted guideline.
US/Canadian Preventive Services Task Force I: evidence from ≥1 properly RCT
II-1: Evidence from well-designed controlled trials without randomisation
II-2: Evidence from well-designed cohort or case-control analytic studies, preferably from >1 centre or group.
II-3: Evidence from multiple time series with or without intervention
III: Opinions of respected authorities based on clinical experience; descriptive studies and case reports; or reports of expert committees
Modified from the Scottish Intercollegiate Guidelines Network
A: ≥ 1 meta analysis, systematic review or RCT or evidence rated as good and directly applicable to the target population
B: Evidence from well conducted clinical trials, directly applicable to the target population, and demonstrating overall consistency of results, or evidence extrapolated from meta-analysis, systematic review or RCT
C: Evidence from expert committee reports or opinions and/or clinical experience of respected authorities; indicates absence of directly applicable clinical studies of good quality

Abbreviation:

AAOS: American Academy of Orthopaedic Surgeons.

ACR: American College of Rheumatology.

AGREE II: Appraisal of Guidelines Research and Evaluation II.

ESCEO: European Society for Clinical and Economic Aspects of Osteoporosis, Osteoarthritis and Musculoskeletal Diseases.

EULAR: European League Against Rheumatism.

GRADE: Grading of Recommendations Assessment, Development and Evaluation.

ISR: Italian Society for Rheumatology.

LoE: Level of evidence.

NHMRC: National Health and Medical Research Council.

NICE: National Institute for Health and Care Excellence.

MSR: Malaysian Society of Rheumatology.

OARSI: Osteoarthritis Research Society International.

PANLAR: Pan American League of Associations for Rheumatology.

RACGP: Royal Australasian College of General Practitioners.

RCT: randomised controlled trial.

SLR: systematic literature review.

SoR: strength of recommendation.

TLAR: Turkish League Against Rheumatism.

VADoD: Department of Veterans Affairs and Department of Defence.