Abstract
Introduction
Patients with minor ischemic stroke or transient ischemic attack represent a high-risk population for recurrent stroke. No direct comparison exists comparing dual antiplatelet therapy regimens—namely, Ticagrelor and Aspirin versus Clopidogrel and Aspirin. This systematic review and network meta-analysis (NMA) will examine the efficacy of these two different antiplatelet regimens in preventing recurrent stroke and mortality up to 30 days.
Methods and analysis
MEDLINE, EMBASE, and the Cochrane Central Register of Controlled Trials (CENTRAL) will be searched with the assistance of a medical information specialist. Two independent reviewers will screen studies for inclusion; eligible studies will include randomized controlled trials that enrolled adults presenting with acute minor ischemic stroke or transient ischemic attack and compared one or more of the interventions against each other and/or a control. The primary outcomes will be recurrent ischemic stroke up to 30 days from symptom onset. Secondary outcomes will include safety outcomes (I.e. major bleeding and mortality), functional disability, and outcomes up to 90 days from symptom onset. A Bayesian approach to NMA will be implemented using the BUGSnet function in R Software. Between group comparisons for time-to-event (TTE) and dichotomous outcomes will be presented in terms of hazard ratios and odds ratios with 95% credible intervals, respectively. Secondary effect measures of treatment ranking will also be estimated.
Ethics and dissemination
No formal research ethics approval are necessary. We will disseminate our findings through scientific conference presentations, peer-reviewed publications, and social media/the press. The findings from this review will aid clinicians in decision-making on the choice of antithrombotic therapy in a high-risk stroke population and could be important in the development of future treatment trials and guidelines.
Registration ID with Open Science Framework: 10.17605/OSF.IO/XDJYZ.
Introduction
Patients with minor ischemic stroke or transient ischemic attack (TIA) represent a population at high risk for recurrent stroke [1–3]. The recurrent stroke rate in the next 3 months following an initial event has been suggested to be anywhere between 10–20% [4]. Clinical worsening with a subsequent event is common, and may result from progression of the initial infarct, or recurrent ischemic events [4]. Identifying optimal secondary prevention strategies in this high-risk population is crucial as it may reduce morbidity and mortality [5].
Recent clinical trials involving high-risk stroke subjects such as the POINT and CHANCE trials have established the superior efficacy of dual antiplatelet therapy (DAPT) with Clopidogrel and Aspirin compared to single antiplatelet therapy with Aspirin alone [6,7]. These trials have necessitated changes to multiple stroke treatment guidelines, recommending treatment with dual antiplatelet therapy for patients presenting with high-risk minor stroke/TIA [8,9]. Clopidogrel is a prodrug that is activated in two steps to irreversibly inhibit the binding of ADP to the P2Y12-receptor [10]. In the literature, significant variability in response to Clopidogrel exists, largely due to the prevalence of genetic polymorphisms (i.e.CYP2C19 loss of function alleles *2, *3, and *8) that render the metabolism of Clopidogrel ineffectively [11]. The prevalence of such genetic polymorphisms is reported to be especially high in Asian populations—up to 60% [12]. Clinically, this has been associated with an increased risk for “treatment failure” leading to recurrent ischemic events [12].
An alternative antiplatelet medication is Ticagrelor—an antiplatelet agent that does not require metabolic activation, but rather directly binds and inhibits platelet P2Y12 receptors [13,14]. A recent trial evaluated the use of Ticagrelor and Aspirin in the treatment of the same high-risk patient population [14]. It was found that the combination of Ticagrelor and Aspirin was superior to Aspirin monotherapy in reducing the risk for stroke or death—the event rate was 6.6% in the DAPT group compared to 5.5% in the Aspirin only group. However, the efficacy of DAPT with Ticagrelor and Aspirin has never been directly compared to an alternative regimen of Clopidogrel and Aspirin.
While traditional pairwise meta-analysis is of great value and familiarity, network meta-analysis (NMA) is a vital methodology that is able to cohesively analyze multiple comparators of relevance based on indirect evidence which does not exist in the primary literature. This protocol describes the methodology for a systematic review and network meta-analysis that will assess the relative effects of competing treatments for patients with acute minor ischemic stroke or TIA in terms of prevention of recurrent ischemic events, death, safety profiles (including major hemorrhage rates [15] and mortality), and the proportion of patients achieving functional independence.
Materials & methods
Study question, registration, and reporting
The review will address the following research question: What is the efficacy of ticagrelor and aspirin in preventing recurrent ischemic strokes compared to clopidogrel and aspirin?
The review protocol has been submitted to the Open Science Framework for registration (https://osf.io/xdjyz). Reporting of the completed review will be prepared in consultation of the PRISMA Extension Statement for Network Meta-Analysis. Any protocol deviations incurred will be described in the final study report.
Search strategy
The search strategy for this review will utilize the following databases: Medline (OVID interface), EMBASE (OVID interface), and Cochrane (OVID interface). The search will include articles from database inception until the February 2021. The search strategy, developed with the assistance of a health science librarian with expertise in systematic reviews, can be found in the S2 File. Additionally, we will search the abstracts database from the World Stroke Congress and International Stroke Conference in the last 20 years for potentially relevant abstracts. If such is found, we will contact the authors of the abstract to inquire about obtaining data.
Inclusion and exclusion criteria
Detailed inclusion and exclusion criteria are listed in Table 1.
Table 1. Inclusion/exclusion criteria for the planned systematic review.
Inclusion Criteria | Population:
Intervention:
Comparator:
Outcomes:
Study Factors:
|
Exclusion Criteria | Population:
Intervention:
Comparator:
Outcomes:
Study Factors:
|
Data management
All study records will be stored in a Sharepoint folder shared amongst the review team for simultaneous access to data and study files. This will include study protocol, documentation of screening, eligibility, search terms as well as completed data extraction forms and risk of bias assessments. Covidence Systematic Review Software (Covidence, Melbourne, VIC, Australia) will be used for screening and data extraction, as well as deletion of duplicate studies.
Selection process
Data will be collected by two independent reviewers for each phase of the review including screening, eligibility and extraction. Study selection will be done in two phases—the first will comprise of title and abstract screening only, and the second will comprise of full-text screening. If a study meets all of the inclusion criteria and none of the exclusion criteria, it will be included for extraction. At each phase, reviewers will evaluate the completeness, content and quality of the studies. If data is missing/unclear for a study, reviewers will contact the study investigators to obtain further information. The data collection will be done using a standardized electronic data collection form (S1 File) shared amongst the review team. Trial authors may be contacted if there are inadequate details allowing clear judgement of bias in a domain.
Data extraction
Data extraction will be undertaken by both content experts and methodologists. For each study/article, there will be two reviewers independently extracting the appropriate data. Any disagreements regarding the extracted data will be resolved via discussion between the reviewers, with consultation of a third party if necessary, to resolve the discrepancy. Where encountered, multiple reports for a single study will be extracted separately during the data extraction process, but will be collated and linked together for the analysis.
Data items
The data items extracted will be from the following categories:
Study Characteristics: Title, First author, Publication year, Journal, Country of origin, Funding
Study Methodology: Study Design, Study Setting, Allocation Sequence Concealment, Inclusion/Exclusion
Participant Characteristics: sample size, age, sex, country, % of previous stroke, follow-up period and % of TIA or minor ischemic stroke
Intervention/Comparator: number of participants in each group, drug, route of administration, drug dose, drug loading dose, drug maintenance dose, treatment frequency, duration
- Outcomes: recurrent stroke (yes or no), mortality (yes or no), bleeding events (yes or no), modalities used for diagnosis, definitions
- Ischemic stroke definition: neurologic dysfunction caused by focal cerebral infarction confirmed by neuroimaging or pathology [16]
- Bleeding definition: bleeding events and method used to ascertain the bleeding event will be recorded for each study. If definitions vary between studies, we will assess heterogeneity across studies as needed.
Results: number of participants included in analysis, number of participants lost to follow-up, % of outcome(s) in intervention/comparator groups, number of adverse events, at two separate time points (30 days and 90 days), person-time at risk for each outcome
The final data extraction dataset will be reviewed by two other reviewers to ensure the data was entered correctly.
Risk of bias assessment
In this systematic review, risk of bias of individual studies will be assessed using the Cochrane Risk of Bias tool for randomized trials (RoB2) [17]. If there are any crossover or cluster designed randomized trials, we will use the respective RoB variant for these trials (RoB2 for crossover trials and RoB2 for cluster-randomized trials). To implement the risk of bias assessment, we will use the RoB2 excel tool which is to be done by two independent raters. If there is disagreement in the rating that cannot be resolved by discussion, the final decision will be made by consulting a third team member. The RoB2 assessment will consider the effect of assignment (also known as the intention to treat effect) as the effect of interest in which will target the results of the primary outcome: recurrent stroke. The main domains of the RoB2 assessment tool include: random sequence generation, effect of assignment, missing outcome data, measurement of the outcome and selective outcome reporting. These domains will be judged using “high, some concerns or low” risk of bias measures. The overall risk of bias will be determined by the measures of the domains. If all domains are judged low risk, the overall measure of bias will be low for this study. If there are some concerns in at least one domain with no high risk judged domains, the overall measure of bias will remain as “some concerns”. If a domain is judged as high risk or has many domains judged to have some concerns, this study will receive an overall score of high risk of bias. Raters will also be reviewing the studies for other possible biases such as sponsorship or publication bias. Trial authors may be contacted if there are inadequate details allowing clear judgement of bias in a domain.
Statistical analysis
Descriptive analysis
Population characteristics and methodological homogeneity for all eligible RCTs will be reviewed and summarized descriptively by the research team. If the trials are judged to be sufficiently homogenous, a pairwise meta-analysis per treatment comparison will be performed to evaluate homogeneity. We assume that patients who are included in studies that are eligible for this review are equally likely to be randomized to either of the dual anti-platelet therapies that we plan to compare.
Primary outcome
The primary outcome of interest will be recurrent ischemic stroke (Time-To-Event) up to 30 days. 30 days was chosen as the primary outcome because the majority of recurrent ischemic stroke events in this population occur within the first 21 days; data from trials investigating DAPT in this population have found that DAPT does not significantly reduce stroke risk during days 22–90 [18]. Time-To-Event (TTE) data will be presented as hazard ratios within intention-to-treat populations with 95% confidence intervals. If hazard ratios are not available for a study, they will be estimated using hazard ratio extrapolation methods presented by Guyot et al [19]. The proportion of patients with the primary outcome at 30 days will be compared between treatments using a chi-square test with logistic regression modeling to control for covariates.
Secondary outcomes
Secondary outcomes will include safety outcomes such as major bleeding, mortality (both TTE) and functional disability (dichotomous). We will additionally look at recurrent ischemic stroke events and bleeding events up to 90 days as secondary outcomes. TTE and dichotomous endpoints will be expressed as hazard ratios and odds ratios, respectively, with 95% confidence intervals.
Pairwise meta-analysis
A standard meta-analysis will be performed for each pairwise comparison of antiplatelet combinations. Hazard ratios for time-to-event outcomes and odds ratios for dichotomous outcomes, with 95% confidence intervals, will be obtained and between-study heterogeneity will be quantified using the I2 measure.
Methods for network meta-analyses
The transitivity assumption
A key underlying assumption of NMA is transitivity (otherwise referred to as homogeneity and similarity), such that competing interventions are jointly randomizable and effect modifiers do not differ between them [20,21]. In collaboration with our clinical experts, age, stroke severity, baseline mRS, and history of hypertension and diabetes have been identified as important effect modifiers that will be appraised for homogeneity by the study team. The distribution of these variables across studies will be investigated, and we will further explore whether other patient characteristics are balanced across trials. We will assess the impact of covariates through subgroup analyses and/or meta-regression adjustments, chosen in collaboration with clinical experts in the field. These may include but are not limited to: stroke severity and onset to randomization according to inclusion criteria of the initial trial, country of publication, and year of publication.
Transitivity will be attenuated by only including studies for which methodology and characteristics are as similar as possible [22]. This decision will be informed by careful consideration of study methods (eg. follow-up, etc) and patient characteristics (eg. eligibility and demographics such as stroke severity, age, baseline mRS, etc) by the research team. We will also perform pairwise meta-analyses for each direct comparison of interventions using the available studies to quantify statistical heterogeneity using the I2 measures to assess further heterogeneity between studies. If heterogeneity is judged to be excessive, findings will be presented via a narrative summary with supporting tables and figures. If homogeneity is sufficient, both fixed- and random-effects NMAs will be performed to compare interventions contained within the included studies and account for any effect modification [23].
Consistency
Consistency (also ‘Coherence’) is the statistical manifestation of transitivity and assesses whether the direct and indirect effect estimates from closed loops in the network are in agreement [20,24,25]. The relative effects on an appropriate scale must “add-up”; for example, the log-hazard ratio for the comparison of antiplatelet therapies A vs C is the sum of the log-hazard ratio for therapies A vs B and B vs C. Consistency will be evaluated by fitting an unrelated means model and comparing the model fit statistics and residuals with the consistency model.
Network meta-analysis
Network meta-analyses (NMA) allow synthesis of results from trials of interventions that form a connected network so that direct and indirect evidence can be statistically combined [21]. All analyses will be performed within Bayesian framework using BUGSnet 1.0.4, and evaluated with Markov Chain Monte Carlo simulation [23,24,26]. We will compare residual deviance with the number of unconstrained data points to assess model fit and, if quantities are approximately equal, the model fit will be deemed adequate. The selection between models will be based on deviance information criteria (DIC), with smaller values indicative of a greater fit and a difference greater than five points suggesting an important difference [27,28]. Convergence will be assessed using Gelman and Rubin criteria and by inspecting trace plots [26,28]. NMA also enables ranking of treatments according to the probability that each is the best, second best, and so on, for a given outcome. Probabilistic statistics will be calculated for each intervention and results will be plotted [29].
Ethics and dissemination
No formal research ethics approval will be necessary for this study as primary data will not be collected. The findings from this review and network meta-analysis will aid clinicians in decision-making on the choice of antithrombotic therapy in a high-risk stroke population and could be important in the development of future treatment trials and guidelines. Therefore, we will disseminate our findings through a combination of scientific conference presentations, peer-reviewed publications, and social media/the press.
Conclusions
This review is planned as there is evolving evidence suggesting variable effectiveness of antiplatelet therapies for patients with minor ischemic stroke or TIA. Traditional systematic reviews and meta-analyses exist that compare Ticagrelor or Clopidogrel against Aspirin alone; however, no network meta-analyses enabling the comparison of both indirect and direct evidence have been performed [6,7,14]. This review will be the first to compare both DAPT therapies head-to-head and provide relative effectiveness, thus facilitating evidence-based management of patients suffering from a minor ischemic stroke or TIA, and identifying key areas for future research. We will prioritize patient-important outcomes such as recurrent strokes, mortality, and bleeding events.
Supporting information
Acknowledgments
We would like to express our sincere gratitude to our professors, Dr. Dean Fergusson, MHA, PhD, FCAHS, Full Professor, Departments of Medicine & Surgery, & School of Epidemiology and Public Health, University of Ottawa, and Dr. Matthew McInnes, MD, FRCPC, BSc, PhD, Professor, Departments of Radiology, & School of Epidemiology and Public Health, University of Ottawa, for teaching us about systematic reviews and providing guidance throughout this protocol development.
Funding Statement
The authors received no specific funding for this work.
References
- 1.Hao Q, Tampi M, O’Donnell M, Foroutan F, Siemieniuk RA, Guyatt G. Clopidogrel plus aspirin versus aspirin alone for acute minor ischaemic stroke or high risk transient ischaemic attack: systematic review and meta-analysis. BMJ. 2018;363: k5108. 10.1136/bmj.k5108 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Khare S. Risk factors of transient ischemic attack: An overview. J -Life Health. 2016;7: 2–7. 10.4103/0976-7800.179166 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Amarenco P, Lavallée PC, Monteiro Tavares L, Labreuche J, Albers GW, Abboud H, et al. Five-Year Risk of Stroke after TIA or Minor Ischemic Stroke. N Engl J Med. 2018;378: 2182–2190. 10.1056/NEJMoa1802712 [DOI] [PubMed] [Google Scholar]
- 4.Coutts Shelagh B., Hill Michael D., Campos Cynthia R., Choi Young B., Subramaniam Suresh, Kosior Jayme C., et al. Recurrent Events in Transient Ischemic Attack and Minor Stroke. Stroke. 2008;39: 2461–2466. 10.1161/STROKEAHA.107.513234 [DOI] [PubMed] [Google Scholar]
- 5.Wang Y, Johnston SC, Bath PM, Grotta JC, Pan Y, Amarenco P, et al. Acute dual antiplatelet therapy for minor ischaemic stroke or transient ischaemic attack. BMJ. 2019;364: l895. 10.1136/bmj.l895 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Wang Y, Wang Y, Zhao X, Liu L, Wang D, Wang C, et al. Clopidogrel with Aspirin in Acute Minor Stroke or Transient Ischemic Attack. N Engl J Med. 2013;369: 11–19. 10.1056/NEJMoa1215340 [DOI] [PubMed] [Google Scholar]
- 7.Johnston SC, Easton JD, Farrant M, Barsan W, Conwit RA, Elm JJ, et al. Clopidogrel and Aspirin in Acute Ischemic Stroke and High-Risk TIA. N Engl J Med. 2018;379: 215–225. 10.1056/NEJMoa1800410 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Powers William J., Rabinstein Alejandro A., Teri Ackerson, Adeoye Opeolu M., Bambakidis Nicholas C., Kyra Becker, et al. Guidelines for the Early Management of Patients With Acute Ischemic Stroke: 2019 Update to the 2018 Guidelines for the Early Management of Acute Ischemic Stroke: A Guideline for Healthcare Professionals From the American Heart Association/American Stroke Association. Stroke. 2019;50: e344–e418. 10.1161/STR.0000000000000211 [DOI] [PubMed] [Google Scholar]
- 9.Boulanger J, Lindsay M, Gubitz G, Smith E, Stotts G, Foley N, et al. Canadian Stroke Best Practice Recommendations for Acute Stroke Management: Prehospital, Emergency Department, and Acute Inpatient Stroke Care, 6th Edition, Update 2018. Int J Stroke. 2018;13: 949–984. 10.1177/1747493018786616 [DOI] [PubMed] [Google Scholar]
- 10.Hasan MS, Basri HB, Hin LP, Stanslas J. Genetic Polymorphisms and Drug Interactions Leading to Clopidogrel Resistance: Why the Asian Population Requires Special Attention. Int J Neurosci. 2013;123: 143–154. 10.3109/00207454.2012.744308 [DOI] [PubMed] [Google Scholar]
- 11.Laurent Bonello, Tantry Udaya S., Rossella Marcucci, Ruediger Blindt, Angiolillo Dominick J., Richard Becker, et al. Consensus and Future Directions on the Definition of High On-Treatment Platelet Reactivity to Adenosine Diphosphate. J Am Coll Cardiol. 2010;56: 919–933. 10.1016/j.jacc.2010.04.047 [DOI] [PubMed] [Google Scholar]
- 12.Pan Y, Chen W, Xu Y, Yi X, Han Y, Yang Q, et al. Genetic Polymorphisms and Clopidogrel Efficacy for Acute Ischemic Stroke or Transient Ischemic Attack: A Systematic Review and Meta-Analysis. Circulation. 2017;135: 21–33. 10.1161/CIRCULATIONAHA.116.024913 [DOI] [PubMed] [Google Scholar]
- 13.Dobesh PP, Oestreich JH. Ticagrelor: Pharmacokinetics, Pharmacodynamics, Clinical Efficacy, and Safety. Pharmacotherapy. 2014;34: 1077–1090. 10.1002/phar.1477 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Johnston SC, Amarenco P, Denison H, Evans SR, Himmelmann A, James S, et al. Ticagrelor and Aspirin or Aspirin Alone in Acute Ischemic Stroke or TIA. N Engl J Med. 2020;383: 207–217. 10.1056/NEJMoa1916870 [DOI] [PubMed] [Google Scholar]
- 15.Schulman S, Kearon C. Definition of major bleeding in clinical investigations of antihemostatic medicinal products in non-surgical patients. J Thromb Haemost. 2005;3: 692–694. 10.1111/j.1538-7836.2005.01204.x [DOI] [PubMed] [Google Scholar]
- 16.Sacco Ralph L., Kasner Scott E., Broderick Joseph P., Caplan Louis R., (Buddy) Connors J.J., Antonio Culebras, et al. An Updated Definition of Stroke for the 21st Century. Stroke. 2013;44: 2064–2089. 10.1161/STR.0b013e318296aeca [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366: l4898. 10.1136/bmj.l4898 [DOI] [PubMed] [Google Scholar]
- 18.Pan Y, Elm JJ, Li H, Easton JD, Wang Y, Farrant M, et al. Outcomes Associated With Clopidogrel-Aspirin Use in Minor Stroke or Transient Ischemic Attack: A Pooled Analysis of Clopidogrel in High-Risk Patients With Acute Non-Disabling Cerebrovascular Events (CHANCE) and Platelet-Oriented Inhibition in New TIA and Minor Ischemic Stroke (POINT) Trials. JAMA Neurol. 2019;76: 1466. 10.1001/jamaneurol.2019.2531 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Guyot P, Ades AE, Ouwens MJNM, Welton NJ. Enhanced secondary analysis of survival data: reconstructing the data from published Kaplan-Meier survival curves. BMC Med Res Methodol. 2012;12: 9. 10.1186/1471-2288-12-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Watt J, Tricco AC, Straus S, Veroniki AA, Naglie G, Drucker AM. Research Techniques Made Simple: Network Meta-Analysis. J Invest Dermatol. 2019;139: 4–12.e1. 10.1016/j.jid.2018.10.028 [DOI] [PubMed] [Google Scholar]
- 21.Chaimani A, Caldwell DM, Li T, Higgins JPT, Salanti G. Chapter 11: Undertaking network meta-analyses. Cochrane Handbook for Systematic Reviews of Interventions version 61 (updated September 2020). Cochrane; 2020. www.training.cochrane.org/handbook.
- 22.Salanti G, Giovane CD, Chaimani A, Caldwell DM, Higgins JPT. Evaluating the Quality of Evidence from a Network Meta-Analysis. PLOS ONE. 2014;9: e99682. 10.1371/journal.pone.0099682 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Harrer M, Cuijpers P, Furukawa TA, Ebert DD. Doing Meta-Analysis in R. https://bookdown.org/MathiasHarrer/Doing_Meta_Analysis_in_R/.
- 24.Tonin FS, Rotta I, Mendes AM, Pontarolo R. Network meta-analysis: a technique to gather evidence from direct and indirect comparisons. Pharm Pract. 2017;15: 943. 10.18549/PharmPract.2017.01.943 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Efthimiou O, Debray TPA, van Valkenhoef G, Trelle S, Panayidou K, Moons KGM, et al. GetReal in network meta-analysis: a review of the methodology. Res Synth Methods. 2016;7: 236–263. 10.1002/jrsm.1195 [DOI] [PubMed] [Google Scholar]
- 26.Béliveau A, Boyne DJ, Slater J, Brenner D, Arora P. BUGSnet: an R package to facilitate the conduct and reporting of Bayesian network Meta-analyses. BMC Med Res Methodol. 2019;19: 196. 10.1186/s12874-019-0829-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Dias S, Welton NJ, Sutton AJ, Caldwell DM, Lu G, Ades AE. NICE DSU Technical Support Document 4: Inconsistency in Networks of Evidence Based on Randomised Controlled Trials. 2011 [cited 10 Mar 2021]. https://research-information.bris.ac.uk/en/publications/nice-dsu-technical-support-document-4-inconsistency-in-networks-o. [PubMed]
- 28.Toft N, Innocent GT, Gettinby G, Reid SWJ. Assessing the convergence of Markov Chain Monte Carlo methods: An example from evaluation of diagnostic tests in absence of a gold standard. Prev Vet Med. 2007;79: 244–256. 10.1016/j.prevetmed.2007.01.003 [DOI] [PubMed] [Google Scholar]
- 29.Salanti G, Ades AE, Ioannidis JPA. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. 2011;64: 163–171. 10.1016/j.jclinepi.2010.03.016 [DOI] [PubMed] [Google Scholar]