Skip to main content
. 2024 Jan 12;13:25. doi: 10.1186/s13643-023-02388-x

Table 2.

Characteristics of tools, checklists or journal standards (n = 12)

First author, year of publication # items Type of instrument Name Type of assessment Objective(s) Research institute Designed for a specific topic area Domains within the tool Rating of items and/or domains Methods used to develop the tool Guidance document
Ades 2012 [47] 42 Checklist NICE DSU checklist Reporting and methodological quality Framework for determining whether a convincing argument has been made based on data presented NICE Standard meta-analysis, indirect comparisons and NMA Definition of the decision problem, methods of analysis and presentation of results, issues specific to network synthesis, embedding the synthesis in a probabilistic cost-effectiveness analysis 3 domains: Definition of the decision problem, methods of analysis and presentation of results, issues specific to network synthesis, Embedding the synthesis in a probabilistic cost-effectiveness model NR No
Al Khalifah 2018 [48] 11 Checklist Guide for appraising NMA evidence Reporting and methodological quality Users’ guide for pediatricians considering the application of the results of NMA McMaster University NMA Credibility of NMA methods, certainty of NMA evidence, were results consistent across studies, how trustworthy are the indirect comparisons, applicability NA NR No
Dias 2018 [49] 14 Checklist Validity of NMAs Introduce and discuss validity of NMAs University of Bristol NMA Question formulation, trial inclusion/ exclusion and network connectivity; heterogeneity and bias management; reporting NA NR No
Hutton 2015 [14] 32 Checklist PRISMA NMA Reporting Present the NMA PRISMA extension and provide examples of good reporting Ottawa Hospital Research Institute Systematic reviews with NMA Title, abstract, introduction, methods, results, discussion, funding NA Overview of reviews, Delphi, expert opinion No
Jansen 2011 [50] 21 Checklist Simplified checklist to assist decision makers in evaluating a reported NMA Reporting and methodological quality Provide guidance on the interpretation of indirect treatment comparisons and NMA to assist policymakers and health-care professionals in using its findings for decision making ISPOR NMA Introduction, methods, results, discussion NA NR No
Jansen 2014 [15] 26 Questionnaire ISPOR Reporting and methodological quality Help decision makers assess the relevance and credibility of indirect treatment comparisons and NMA ISPOR NMA Evidence base, analysis, reporting quality and transparency, interpretation, conflict of interest 3 levels: yes, no, cannot answer Expert opinion, literature search, pilot testing No
Kiefer 2015 [51] 9 Checklist Checklist for evaluation of indirect comparisons and network meta-analyses Reporting and methodological quality Describe the underlying assumptions and methods used in indirect comparisons and NMA and explain what evaluation of such publications should include

Institute for Quality and Efficiency in Health Care

(IQWiG)

NMA Methods, statistical analysis, reporting, limitations NA NA No
Nikolakopoulou 2020 [23], Papakonstantinou 2020 [39], Salanti 2014 [40] 6 Framework CINeMA Confidence in results from NMA Evaluate confidence in the results from network meta-analyses Cochrane and the Campbell collaboration NMA Within-study bias, reporting bias, indirectness, imprecision, heterogeneity and incoherence 3 levels: no concerns, some concerns or major concerns (within); 4 levels: high, moderate, low, very low (summary) Developed based on three previous studies, and participant feedback Yes
Ortega 2014 [46] 20 Checklist Checklist for critical appraisal of indirect comparisons Reporting and methodological quality Critical appraisal of indirect comparisons of drugs, considering clinical, methodological/statistical and quality aspects, applied in drug evaluation in the decision-making Clinica Universidad de Navarra Indirect comparisons Quality, clinical aspects, methodology/statistics 3 levels: high, acceptable, low Review of literature, group consensus, expert guidance No
Page 2020 [25] 27 Checklist PRISMA 2020 Statement Reporting Describe and justify changes made to the guideline Monash University Systematic reviews Title, abstract, introduction, methods, results, discussion, other information NA Review, survey, expert meeting Yes

CINeMA Confidence in Network Meta-Analysis, DSU Decision Support Unit, GRADE-NMA Grading of Recommendations Assessment, Development and Evaluation for Network Meta-Analysis, ISPOR International Society for Pharmacoeconomics and Outcomes Research, NA not applicable, NICE National Institute for Health and Care Excellence, NR not reported, OQAQ Overview Quality Assessment Questionnaire, PRISMA Preferred Reporting Items for Systematic Reviews and Meta-Analyses