Supplemental Digital Content is available in the text
Keywords: antiplatelet therapy, cardiac surgery, coronary artery bypass grafting, coronary artery disease, network meta-analysis
Abstract
Introduction:
Saphenous vein graft (SVG) is the most common conduit used for coronary artery bypass grafting (CABG) surgery. Unfortunately, SVG are associated with poor long-term patency rates; a significant predictor of re-operation rates and survival. As such, medical therapy to prevent SVG narrowing or occlusion is of paramount importance. Aspirin (ASA) monotherapy is the standard of care after CABG, to improve long-term major adverse cardiovascular events (MACE) and graft patency. Benefits of dual antiplatelet therapy (DAPT) have not been well established in all CABG patients. We present a protocol for a network meta-analysis (NMA) comparing the effects of various antiplatelet therapy regimens on SVG patency, mortality, and bleeding among adult patients following CABG.
Methods:
We will search CENTRAL, MEDLINE, EMBASE, CINAHL ACPJC, and grey literature sources (AHA, ACC, ESC, and CCC conference proceedings, ISRCTN Register, and WHO ICTRP) for randomized controlled trials (RCTs) which fit our criteria. RCTs that evaluate different antiplatelet regimens at least 3-months after CABG and have any of SVG patency, mortality, MACE, and major bleeding as outcomes will be selected. We will perform title and abstract screening, full-text screening, and data extraction independently and in duplicate. Two independent reviewers will also assess risk of bias (ROB) for each study, as well as evaluate quality of evidence using the GRADE framework. We will use R to perform the NMA and use low-dose ASA as reference within our network. We will report results as odds ratios with confidence intervals for direct comparisons, and credible intervals for indirect or mixed comparisons. We will use the surface under the cumulative ranking curve (SUCRA) to estimate the ranking of interventions.
Discussion:
Given the limited direct comparison of various antiplatelet regimens, a network approach is ideal to clarify the optimum antiplatelet therapy after CABG. We hope that our NMA will be the largest quantitative synthesis evaluating antiplatelet regimens among patients requiring CABG. It should inform clinicians and guideline developers in selecting the most effective and safest antiplatelet regimen.
Systematic Review registration: International Prospective Register for Systematic Reviews (PROSPERO)—CRD42019127695.
1. Introduction
Saphenous vein graft (SVG) remains the most commonly used conduit for coronary artery bypass grafting (CABG) surgery, with patency rates as low as 50% at 10 years.[1,2] Graft patency is a significant predictor of re-operation rates and survival; therefore, medical therapy to prevent SVG narrowing or occlusion is of paramount importance.[3,4]
Antiplatelet therapy, specifically acetylsalicylic acid (ASA), is standard of care after CABG, and has repeatedly been demonstrated to improve long-term major adverse cardiovascular events (MACE) and graft patency.[5–8] Based on data from large randomized controlled trials (RCTs), dual antiplatelet therapy (DAPT)—a combination of ASA and P2Y12 inhibitors—is recommended for patients with acute coronary syndrome (ACS) regardless of revascularization modality.[9–11] More potent antiplatelet agents (P2Y12 inhibitors; clopidogrel, prasugrel, and ticagrelor) have been evaluated in patients undergoing CABG after an ACS. A meta-analysis of RCTs and sub-groups of larger RCTs analyzed 4887 CABG patients, suggested a significant reduction in all-cause mortality using DAPT with ASA and ticagrelor or prasugrel (relative risk [RR] 0.49, 95% CI 0.33–0.71) compared to clopidogrel and ASA.[12] However, this meta-analysis is restricted by limited inclusion criteria, direct comparisons, and does not include more recent studies. For instance, most recently, Zhao et al evaluated P2Y12 inhibitors in all CABG patients. After surgery, they randomized CABG patients to ASA, ticagrelor, or DAPT with ticagrelor and ASA. SVG patency was improved with DAPT compared to ASA only (80.6% vs 89.9%, P = .006) with no significant difference in major bleeding.[13]
Despite encouraging data, evidence examining the optimal antiplatelet therapy choice after CABG is lacking. RCTs comparing DAPT with antiplatelet monotherapy in the CABG population are limited by small sample sizes or focus on patients undergoing CABG after an ACS only.[12,13] Given the variety of antiplatelet agents available, along with the different possible combinations, we propose to conduct a multiple treatment comparison meta-analysis (a network meta-analysis [NMA]) evaluating the efficacy and harms of DAPT in patients following CABG. Different antiplatelet agents will be compared using direct and indirect data.[14] Our question is: What are the comparative effects (in terms of SVG patency, mortality, MACE, and major bleeding) of different antiplatelet agents on patients after CABG.
2. Methods
We will conduct the systematic review and NMA in adherence with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Extension for NMA of healthcare interventions guidelines.[15]
We registered our review and NMA protocol with the International Prospective Register for Systematic Reviews (PROSPERO)—CRD42019127695 Eligibility criteria (studies have to meet all inclusion criteria and none of the exclusion criteria to be included).
2.1. Types of participants
Adult patients (18 years or older) following any CABG surgery (including on and off-pump cases, minimally invasive and conventional sternotomy cases, any types and number of venous, and/or arterial grafts).
2.2. Types of studies
Parallel-groups RCTs (including factorial design RCTs).
2.3. Types of interventions
Any antiplatelet therapy or combination of antiplatelet therapies administered within 1 month after CABG and continued for a minimum of 3 months. Given the variation in ASA dosing, we will divide ASA into high-dose (>325 mg daily) or low-dose (≤325 mg daily). The intervention groups will include but may not be limited to: ASA, clopidogrel, prasugrel, ticagrelor, cangrelor, clopidogrel + ASA, prasugrel + ASA, ticagrelor + ASA, cangrelor + ASA, with placebo or no antiplatelet agent as a node as well.
2.4. Types of outcome measures
2.4.1. All-cause mortality
We will evaluate mortality in-hospital, within 30 days, within 6 months, at 1-year, and at latest follow-up.
2.4.2. SVG patency
Assessed by either CT angiography or catheter-based angiography at any time during the observation period of the study. If data are available, we will evaluate graft patency rates at any time within 3 months, within 6 months, at 1 year, and at latest follow-up.
2.4.3. MACE
This will be a composite of all-cause mortality, stroke, systemic thromboembolic events, and myocardial infarction (MI). Whenever data are available, we will evaluate MACE at any time within 3 months, within 6 months, at 1 year, and at latest follow-up.
2.4.4. Major bleeding
This will be defined as per individual study criteria. Whenever data are available, we will evaluate major bleeding rates at any time within 3 months, within 6 months, at 1 year, and at latest follow-up.
2.5. Search methods for identification of studies
2.5.1. Electronic searches
We will search Cochrane Central Register of Controlled Trials (CENTRAL), Medical Literature Analysis and Retrieval System Online (MEDLINE), Excerpta Medica Database (EMBASE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), American College of Physicians Journal Club (ACPJC) from inception to January 2019. Our search strategy was created in discussion with a librarian to ensure use of appropriate and broad Medical Subject Headings (MeSH) terms, to be as inclusive in the title and abstract phase as possible (Appendix 1).
2.5.2. Searching other resources
We will review the reference lists of all included full-text articles and previous meta-analyses. We will review clinical trials data registry (clinicaltrials.gov, ISRCTN Register, and WHO ICTRP) for registered published or unpublished studies. We will search conference proceedings for the European Society of Cardiology Congress, American Heart Association Scientific Sessions, American College of Cardiology Conference, and Canadian Cardiovascular Congress within the last 2 years.
2.6. Data collection and analysis
2.6.1. Selection of studies
We will perform title and abstract screening independently and in duplicate using the Covidence online software.[16] If either reviewer deems a study relevant, it will be retrieved for full-text review. Full-text review will also be done in duplicate. We will resolve disagreements through discussion or third-party arbitration.
2.6.2. Data collection and management
We will carry out data extraction independently and in duplicate using pre-piloted forms. If there is discrepancy, a third-party reviewer will assess the data.
2.6.3. Risk of bias assessment for randomized controlled trials
Risk of bias will be evaluated as either low risk or high risk using the Cochrane Collaboration tool.[17] Two independent reviewers will analyze each trial in six domains: random sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome assessment, selective reporting, and other sources of bias. If all aspects are considered to have low or probably low risk of bias, the study will be considered at low risk. If even one aspect or more has probably high risk of bias, the study will be considered at high risk.
2.7. Data extraction
Bibliometric information: Author, year of publication, countries where studies were conducted, publication journal, contact information, and funding source (s).
2.7.1. Details of population
Mean age, sex, past medical history (hypertension, diabetes, dyslipidemia, previous MI, congestive heart failure, peripheral vascular disease, ACS presentation), surgical details (off-pump CABG, on-pump CABG, concomitant procedures).
Methodology: Design of RCT; risk of bias
Details of intervention and comparator: doses and frequencies, different comparisons made.
Details of outcome: mortality, SVG patency, major bleeding and criteria used to assess major bleeding, MACE (including mortality, MI, stroke, and systemic thromboembolic events).
2.8. Statistical analysis: indirect and mixed comparisons
We will perform conventional meta-analyses with a random effects model for all direct comparisons, and then a random effects Bayesian NMA in order to include both direct and indirect evidence. Since ASA monotherapy is the standard of care after CABG, we will use this as the reference for baseline risk, with the data originating from the ASA monotherapy arm of the RCTs.[18,19] To assess the transitivity assumption, we will qualitatively assess patient distribution and evaluate study characteristics that modify treatment effects across comparisons by presenting tabulated results of these characteristics. We will evaluate the consistency assumption statistically by performing a global test for inconsistency (design-by-treatment interaction model) and a local test (inconsistency plot). We will report results as odds ratios with corresponding 95% credible intervals (95% CrI)—a Bayesian analog of 95% confidence intervals (CIs).[15] We will run all models for a minimum of 100,000 iterations to ensure convergence. We will analyze data using R version 3.5.3.[20] We will perform meta-regression to see if the length of follow-up is correlated with the outcome.
2.8.1. Direct comparisons
We will use Review Manager 5.3 to perform the analyses.[21] We will use a random effects model (DerSimonian and Laird method) as we expect heterogeneity among the studies due to differences in methodology.[22] We will present the pooled results as RR with 95% CIs for dichotomous outcomes and as mean difference (MD) with 95% CI for continuous outcomes. Before pooling outcomes, we will assess the clinical and methodological heterogeneity, including population characteristics, definition, and utilized assessment tools. Should they be inappropriate for pooling, we will describe the results of each study independently.
2.8.2. Multiple treatment groups
Studies with multiple treatment arms will be included and treated as multiple two-arm studies in a direct comparison. For the NMA, the patients in each treatment arm will be allocated to the respective node in the network.
2.8.3. Treatment ranking
We will use the surface under the cumulative ranking curve (SUCRA) to estimate the probability of each intervention being ranked first. The more efficacious a treatment node, the higher the expected SUCRA score.[23] We will also provide a rank of the treatment with the lowest overall (combined) complications.
2.8.4. Dealing with missing data
Whenever appropriate, we will contact authors of primary studies to identify missed or unpublished data. We will assess and record how each trial handled missing data.
2.8.5. Heterogeneity assessment
We will qualitatively assess heterogeneity by comparing the study population characteristics, interventions and outcomes of included trials within each pairwise comparison. To assess methodological heterogeneity, we will qualitatively compare the risk of bias within each pairwise comparison. We will assess statistical heterogeneity within each pairwise comparison using the I2 index, the Cochrane Q-test and visual inspection of the forest plots. We will assume a common heterogeneity variance (τ2 estimated using restricted maximum likelihood approach, across the different comparisons in the network).
2.8.6. Publication bias
For direct comparisons in each outcome, we will inspect the funnel plots for publication bias by evaluating asymmetry if 10 or more studies are pooled.[24] We will use an Egger's regression test for assessment if we identify possible publication bias.[25] In order to assess for small-study effect within the network, we will use a comparison-adjusted funnel plot.[26]
2.8.7. Assessment of certainty in pooled effect estimates
We will use the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to evaluate the certainty of the evidence for each outcome.[27] Our confidence assessment will address the risk of bias in individual studies, imprecision, inconsistency (heterogeneity in estimates of effect across studies), indirectness (related to the question or due to intransitivity), and publication bias.[28] The certainty in indirect estimates will be inferred by examining the dominant first-order loop associated with the particular comparison and will be the lowest of the direct estimates contributing to the indirect comparison. If there are issues with intransitivity (important difference between studies forming the indirect loop), we will further lower the certainty in the indirect estimate. If there is incoherence between direct and indirect estimates, we will include the one with the higher certainty rather than the network estimate. For certainty in NMA estimates, we will use the higher of the direct and indirect (assuming they are coherent). Imprecision will be assessed at the NMA level and not at the level of the direct or indirect estimate.[29]
2.8.8. Subgroup analysis and investigation of heterogeneity
We plan to have two subgroups: post-ACS versus not post-ACS and off-pump CABG versus on-pump. We hypothesize that post-ACS population will show a greater benefit with the different DAPT regimens than antiplatelet monotherapy. Similarly, the off-pump CABG population will also show a greater benefit with the different DAPT regimens than the various monotherapies. If a sufficient number of studies report these outcomes to create a non-sparse NMA, we will perform the analysis for that subgroup.
3. Discussion
While several studies have demonstrated the benefit on graft patency of a more intense antiplatelet therapy regimen, especially with DAPT using ASA and ticagrelor, the available evidence for mortality and morbidity is restricted by the small sample size of RCTs and sub-studies of larger RCTs.[12,13] This study aims to qualitatively and quantitatively synthesize the available evidence comparing the efficacy and safety of different antiplatelet agents among patients undergoing CABG. Although this will not be the first review to evaluate the relative effects of multiple antiplatelet agents among CABG patients using an NMA approach, it will be the first to evaluate graft patency, mortality, MACE and major bleeding as protocolized outcomes of interest.[30]
Our review will have several strengths. First, we will conduct a comprehensive literature search to identify published and unpublished studies, restrict the evidence to RCTs, perform duplicate assessment of eligibility, risk of bias, and data extraction. Furthermore, we will use the GRADE framework to assess the quality of evidence. Our study will also have limitations; due to a broad range of publication dates (potentially from 1980s onwards), some of the studies may not reflect current clinical and surgical practices or expected outcomes. We also expect there to be significant variation in definition of MACE and major bleeding between studies. The analysis will also be limited in terms of subgroup analyses by using study-level data.
Despite these limitations, our NMA will be the largest quantitative synthesis assessing antiplatelet therapy among patients after CABG surgery to date. It should inform clinicians and guideline developers in selecting the most effective and safest antiplatelet regimen. Our study may also highlight gaps in the evidence on this topic, triggering further research to improve patient-important outcomes.
Acknowledgments
None.
Author contributions
SG made substantial contributions to conception and design of the work, drafted the work, and substantially reviewed it. EBC and RW made substantial contributions to conception of the work, and substantially reviewed it. BR made contributions to the design and methodology of the work, and substantially reviewed it. AB, PP, and AP made contributions to the methodology of the work. LM, SM, and JS made revisions to the final work. All authors read and approved the final manuscript.
Conceptualization: Saurabh Gupta, Emilie P Belley-Côté, Bram Rochwerg, Richard P Whitlock.
Data curation: Saurabh Gupta, Emilie P Belley-Côté, Puru Panchal, Arjun Pandey.
Formal analysis: Saurabh Gupta, Anthony Bozzo.
Funding acquisition: Saurabh Gupta, Emilie P Belley-Côté, Richard P Whitlock.
Investigation: Saurabh Gupta, Emilie P Belley-Côté, Bram Rochwerg.
Methodology: Saurabh Gupta, Emilie P Belley-Côté, Bram Rochwerg, Anthony Bozzo, Lawrence Mbuagbaw, Richard P Whitlock.
Project administration: Saurabh Gupta, Emilie P Belley-Côté, Richard P Whitlock.
Resources: Saurabh Gupta, Emilie P Belley-Côté, Bram Rochwerg, Richard P Whitlock.
Software: Saurabh Gupta, Anthony Bozzo.
Supervision: Emilie P Belley-Côté, J-D Schwalm, Richard P Whitlock.
Validation: Saurabh Gupta, Emilie P Belley-Côté, Richard P Whitlock.
Visualization: Saurabh Gupta, Emilie P Belley-Côté, Richard P Whitlock.
Writing – original draft: Saurabh Gupta.
Writing – review & editing: Saurabh Gupta, Emilie P Belley-Côté, Bram Rochwerg, Anthony Bozzo, Puru Panchal, Arjun Pandey, Shamir Mehta, J-D Schwalm, Richard P Whitlock.
Saurabh Gupta orcid: 0000-0002-0114-0027.
Supplementary Material
Footnotes
Abbreviations: ASA = acetylsalicylic acid (aspirin), ACS = acute coronary syndrome, ACPJC = American College of Physicians Journal Club, CENTRAL = Cochrane Central Register of Controlled Trials, CI = confidence intervals, CABG = coronary artery bypass grafting surgery, CrI = credible intervals, CINAHL = Cumulative Index to Nursing and Allied Health Literature, DAPT = dual antiplatelet therapy, EMBASE = Excerpta Medica Database, GRADE = Grading of Recommendations Assessment, Development and Evaluation, PROSPERO = International Prospective Register for Systematic Reviews, MACE = major adverse cardiovascular events, MD = mean difference, MEDLINE = Medical Literature Analysis and Retrieval System Online, MI = myocardial infarction, NMA = network meta-analysis, PRISMA = Preferred Reporting Items for Systematic Reviews and Meta-Analyses, RCTs = randomized controlled trials, SVG = saphenous vein graft, SUCRA = surface under the cumulative ranking curve.
Ethics approval and consent to participate: The need for ethics approval was waived as the study is a protocol for a meta-analysis and does not require patient-level data.
Competing interests: Dr. Shamir Mehta has grant support from Astra-Zeneca, and is a consultant for them. The other authors do not have any financial or non-financial competing interests.
Funding: Dr Richard Whitlock is supported by a career award from the Heart and Stroke Foundation. Dr Saurabh Gupta is supported by a New Investigator's Fund from the Hamilton Health Sciences.
Supplemental Digital Content is available for this article.
References
- [1].Papakonstantinou NA, Baikoussis NG, Goudevenos J, et al. Novel no touch technique of saphenous vein harvesting: Is great graft patency rate provided? Ann Card Anaesth 2016;19:481–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [2].Raja SG, Haider Z, Ahmad M, et al. Saphenous vein grafts: to use or not to use? Heart Lung Circ 2004;13:403–9. [DOI] [PubMed] [Google Scholar]
- [3].Fitzgibbon GM, Kafka HP, Leach AJ, et al. Coronary bypass graft fate and patient outcome: angiographic follow-up of 5,065 grafts related to survival and reoperation in 1,388 patients during 25 years. J Am Coll Cardiol 1996;28:616–26. [DOI] [PubMed] [Google Scholar]
- [4].Gaudino M, Benedetto U, Fremes S, et al. Radial-artery or saphenous-vein grafts in coronary-artery bypass surgery. N Engl J Med 2018;378:2069–77. [DOI] [PubMed] [Google Scholar]
- [5].Kulik A, Le May MR, Voisine P, et al. Aspirin plus clopidogrel versus aspirin alone after coronary artery bypass grafting the clopidogrel after surgery for coronary artery disease (CASCADE) trial. Circulation 2010;122:2680–7. [DOI] [PubMed] [Google Scholar]
- [6].Mangano DT. Multicenter study of perioperative ischemia research G. Aspirin and mortality from coronary bypass surgery. N Engl J Med 2002;347:1309–17. [DOI] [PubMed] [Google Scholar]
- [7].Goldman S, Copeland J, Moritz T, et al. Long-term graft patency (3 years) after coronary artery surgery. Effects of aspirin: results of a VA Cooperative study. Circulation 1994;89:1138–43. [DOI] [PubMed] [Google Scholar]
- [8].Kulik A, Ruel M, Jneid H, et al. Secondary prevention after coronary artery bypass graft surgery: a scientific statement from the American Heart Association. Circulation 2015;131:927–64. [DOI] [PubMed] [Google Scholar]
- [9].Wiviott SD, Steg PG. Clinical evidence for oral antiplatelet therapy in acute coronary syndromes. Lancet 2015;386:292–302. [DOI] [PubMed] [Google Scholar]
- [10].Van de Werf F, Bax J, Betriu A, et al. Management of acute myocardial infarction in patients presenting with persistent ST-segment elevation: the Task Force on the Management of ST-Segment Elevation Acute Myocardial Infarction of the European Society of Cardiology. Eur Heart J 2008;29:2909–45. [DOI] [PubMed] [Google Scholar]
- [11].Canadian Cardiovascular Society, American Academy of Family Physician, American College of Cardiology. 2007 focused update of the ACC/AHA 2004 guidelines for the management of patients with ST-elevation myocardial infarction: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol 2008;51:210–47. [DOI] [PubMed] [Google Scholar]
- [12].Verma S, Goodman SG, Mehta SR, et al. Should dual antiplatelet therapy be used in patients following coronary artery bypass surgery? A meta-analysis of randomized controlled trials. BMC Surg 2015;15:112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [13].Zhao Q, Zhu Y, Xu Z, et al. Effect of ticagrelor plus aspirin, ticagrelor alone, or aspirin alone on saphenous vein graft patency 1 year after coronary artery bypass grafting: a randomized clinical trial. JAMA 2018;319:1677–86. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [14].Mills EJ, Ioannidis JP, Thorlund K, et al. How to use an article reporting a multiple treatment comparison meta-analysis. JAMA 2012;308:1246–53. [DOI] [PubMed] [Google Scholar]
- [15].Hutton B, Salanti G, Caldwell DM, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med 2015;162:777–84. [DOI] [PubMed] [Google Scholar]
- [16].Covidence systematic review software VHI, Melbourne, Australia. Available at https://support.covidence.org/help/how-can-i-cite-covidence. [Google Scholar]
- [17].Higgins JP, Altman DG, Gotzsche PC, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [18].Mehta SR, Bainey KR, Cantor WJ, et al. 2018 Canadian Cardiovascular Society/Canadian Association of Interventional Cardiology focused update of the guidelines for the use of antiplatelet therapy. Can J Cardiol 2018;34:214–33. [DOI] [PubMed] [Google Scholar]
- [19].Valgimigli M, Bueno H, Byrne RA, et al. 2017 ESC focused update on dual antiplatelet therapy in coronary artery disease developed in collaboration with EACTS: The Task Force for dual antiplatelet therapy in coronary artery disease of the European Society of Cardiology (ESC) and of the European Association for Cardio-Thoracic Surgery (EACTS). Eur Heart J 2018;39:213–60. [DOI] [PubMed] [Google Scholar]
- [20].Team RC. R: A language and environment for statistical computing; 2015. [Google Scholar]
- [21].Review Manager (RevMan) [Computer program]. Version 5.3. Copenhagen: The Nordic Cochrane Centre TCC; 2014. https://community.cochrane.org/sites/default/files/uploads/inline-files/RevMan_5.3_User_Guide.pdf. [Google Scholar]
- [22].DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986;7:177–88. [DOI] [PubMed] [Google Scholar]
- [23].Mbuagbaw L, Rochwerg B, Jaeschke R, et al. Approaches to interpreting and choosing the best treatments in network meta-analyses. Syst Rev 2017;6:79. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [24].Sedgwick P, Marston L. How to read a funnel plot in a meta-analysis. BMJ 2015;351:h4718. [DOI] [PubMed] [Google Scholar]
- [25].Peters JL, Sutton AJ, Jones DR, et al. Comparison of two methods to detect publication bias in meta-analysis. JAMA 2006;295:676–80. [DOI] [PubMed] [Google Scholar]
- [26].Chaimani A, Salanti G. Using network meta-analysis to evaluate the existence of small-study effects in a network of interventions. Res Synth Methods 2012;3:161–76. [DOI] [PubMed] [Google Scholar]
- [27].Guyatt GH, Oxman AD, Vist GE, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008;336:924–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [28].Puhan MA, Schunemann HJ, Murad MH, et al. A GRADE Working Group approach for rating the quality of treatment effect estimates from network meta-analysis. BMJ 2014;349:g5630. [DOI] [PubMed] [Google Scholar]
- [29].Brignardello-Petersen R, Bonner A, Alexander PE, et al. Advances in the GRADE approach to rate the certainty in estimates from a network meta-analysis. J Clin Epidemiol 2018;93:36–44. [DOI] [PubMed] [Google Scholar]
- [30].Chakos A, Jbara D, Singh K, et al. Network meta-analysis of antiplatelet therapy following coronary artery bypass grafting (CABG): none versus one versus two antiplatelet agents. Ann Cardiothorac Surg 2018;7:577–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
