Skip to main content
BMJ Open logoLink to BMJ Open
. 2022 Apr 5;12(4):e049778. doi: 10.1136/bmjopen-2021-049778

Comparative efficacy of different types of acupuncture as adjuvant therapy on carotid atherosclerosis: a protocol for systematic review and network meta-analysis

Xianming Wu 1,#, Qian Mo 2,#, Zhihong Yang 2, Xiaolou Huang 2, Jiao Liu 2, Shuangmei Xu 2, Ning Zhang 2,✉, Xiaofang Yang 1,2,✉
PMCID: PMC8987791  PMID: 35387805

Abstract

Introduction

Carotid atherosclerosis (CAS) is a disease of the aorta caused by lipid metabolism disorders and local inflammation. Acupuncture combined with traditional western medicine (such as aspirin or atorvastatin) for the treatment of CAS has been widely applied in clinical practice, but there is still a lack of supporting evidence for its efficacy and safety on CAS. Therefore, this systematic review and network meta-analysis (NMA) will summarise the effects of different types of acupuncture treatments on CAS, and a ranking of the therapeutic classes will also be presented, aiming to provide evidence-based medicine for its extensive clinical application.

Methods and analysis

Systematic and NMA searches will be conducted in seven electronic databases: PubMed, EMBASE, Medline, Cochrane Library, Chinese National Knowledge Infrastructure, Wanfang Database and Chongqing VIP databases. The search time is from their inception to December 2020, regardless of language and publication type. Randomised controlled trials and controlled clinical trials that include patients with CAS receiving acupuncture therapy compared with a control group will be considered eligible. The primary outcomes include the carotid intima-media thickness and vessel plaque quantification; the secondary outcomes include the carotid plaque Crouse score, greyscale median, lipid levels, the incidence of cardiovascular events, safety and adverse events. The selection of studies, data extraction, quality assessment and risk of bias assessment will be conducted by two independent reviewers. The NMA will be analysed with Stata V.15.0, RevMan V.5.3 software and WinBUGS V.1.4.3.

Ethics and dissemination

Ethical approval will not be required for this study as it will be based on de-identified, aggregated published data. We will publish the findings in a peer-reviewed journal.

PROSPERO registration number

CRD42020207260.

Keywords: carotid atherosclerosis, acupuncture, adjuvant therapy, systematic review, network meta-analysis


Strengths and limitations of this study.

  • This study will be the first comprehensive analysis of the efficacy of acupuncture as an adjuvant therapy in the treatment of atherosclerosis. A ranking of the therapeutic classes will also be presented.

  • The data report will follow the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines.

  • This study only includes English and Chinese trials, which may lead to the potential risk of ignoring some studies.

  • The heterogeneity of different studies may affect the final results of this study.

Introduction

Atherosclerosis (AS) is a series of pathological changes in the vascular intima through lipid infiltration, platelet activation, thrombosis, intimal injury, inflammatory response, oxidative stress and activation of vascular smooth muscle cells. It is manifested by cell metabolism disorder and product accumulation, which causes the vessel wall to harden and thicken, and lose its elasticity; the inner diameter of the lumen becomes smaller, blood flow is blocked, and finally, the diseased blood vessel blood supply organs and even life are endangered.1–3 The WHO reports that non-communicable diseases cause 41 million deaths each year, equivalent to 71% of the total global deaths. Among them, cardiovascular diseases cause 17.9 million deaths each year.4 Globally, the number of people dying from cardiovascular disease is still increasing. The WHO plans to reduce premature mortality from non-communicable diseases by one-third by 2030 through treatment and prevention.4 Among them, carotid AS (CAS) has common risk factors and pathological basis with AS of the coronary arteries of the heart, cerebral blood vessels and renal arteries.5–7 A study has found that 93% of cerebral infarctions are accompanied by CAS, and 18%–25% of ischaemic strokes can be attributed to thromboembolism caused by CAS.8 Carotid intima-media thickness (cIMT) is related to the risk of cardiovascular events in the general population, and cIMT measurement is essential for assessing the risk and incidence of cardiovascular disease.9 Of course, vessel plaque quantification (VPQ) is a non-invasive evaluation method for observing the morphological characteristics of plaques, and it is also regarded as the main observation in clinical practice.10

The current conventional western medicine treatments for carotid AS mainly consist of lifestyle modification, drug therapy, etc. Lifestyle modification includes smoking cessation, control of energy intake, etc. The drug therapy includes hypolipidaemic and antiplatelet drugs (such as aspirin or atorvastatin).11 Statins can treat AS by regulating blood lipids, improving vascular endothelial function, inhibiting thrombosis, anti-inflammatory and anti-oxidation, and stabilising plaque.12 Acupuncture is part of the characteristic treatment of traditional Chinese medicine. Its main feature is to stimulate the meridians and acupoints and regulate the qi and blood of the viscera to achieve the purpose of disease prevention and treatment. It has the effects of anti-inflammation, immunity activation and nervous system modulation.13 14 At present, acupuncture is widely used as an adjuvant treatment of AS as a characteristic treatment method of Chinese medicine.15 16 One of the mechanisms of electroacupuncture treatment of AS may be by reducing the expression of CD36 protein and mRNA in AS rabbit macrophages.17

Although there have been randomised controlled trials (RCTs) and controlled clinical trials (CCTs) to study the efficacy of acupuncture intervention on AS, due to sample size and insufficient randomisation methods in clinical trial studies, and the different objectives and outcome evaluation indicators used, the results of the research are not consistent. What type of acupuncture method is better to prevent, stabilise and reverse CAS is still inconclusive. Therefore, this study uses a network meta-analysis (NMA) to summarise the effects of different types of acupuncture treatments on CAS and aims to provide evidence-based medicine for the extensive clinical use of acupuncture as an adjuvant therapy to treat AS.

Objective

The objectives of our study are as follows:

  1. To evaluate the efficacy and safety of acupuncture as adjuvant therapy in the treatment of AS.

  2. To present the ranking of therapeutic classes.

Methods

Study registration

This NMA will be performed according to the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement.18 The protocol has been registered on the PROSPERO website (https://www.crd.york.ac.uk/prospero/) and the PROSPERO registration number is CRD42020207260.

Patient and public involvement

No patient or member of the public will be involved in the study directly.

Data sources and search strategy

Seven electronic databases including PubMed, EMBASE, Medline, Cochrane Library, CNKI, Wanfang Database and CQVIP will be searched from inception to December 2020. The search strategy will be adjusted according to the characteristics of the database. The detailed search strategy for PubMed will be shown in table 1, while other databases are shown in online supplemental appendix 1.

Table 1.

Search strategy for PubMed database

Number Search items
#1 Atherosclerosis [MeSH]
#2 Atheroscleroses [Title/Abstract]
#3 Atherogenesis [Title/Abstract]
#4 Carotid atherosclerosis [Title/Abstract]
#5 #1 or #2 or #3 or #4
#6 Acupuncture [MeSH]
#7 Acupuncture Therapy [Title/Abstract]
#8 Acupuncture, Ear [Title/Abstract]
#9 Acupuncture Points [Title/Abstract]
#10 Electroacupuncture [Title/Abstract]
#11 Auricular point [Title/Abstract]
#12 #6 or #7 or #8 or #9 or #10 or #11
#13 Statins [Title/Abstract]
#14 atorvastatin [Title/Abstract]
#15 aspirin [Title/Abstract]
#16 #13 or #14 or #15
#17 randomized controlled trial [Publication Type]
#18 randomized [Title/Abstract]
#19 randomly [Title/Abstract]
#20 controlled clinical trial [Title/Abstract]
#21 clinical trial [Title/Abstract]
#22 trial [Title/Abstract]
#23 #17 or #18 or #19 or #20 or #21 or #22
#24 #5 and #12 and #16 and #23

MeSH, Medical Subject Headings.

Supplementary data

bmjopen-2021-049778supp001.pdf (84.9KB, pdf)

Inclusion and exclusion criteria

Types of studies

All RCTs and CCTs will be included if the full text is available; conference proceedings and dissertations might be included if feasible, irrespective of language and publication. Retrospective studies, case reports, reviews or studies on the mechanism of action will be excluded.

Participants

Studies that enrolled patients who were diagnosed with CAS, without serious liver and kidney dysfunction, and patients with tumour; while gender, age, ethnicity and nationality will not be limited. The baseline data of the observation group and the control group are comparable. We will follow the relevant standards of the guidelines for atherosclerotic vascular ultrasound examination.11

Types of interventions

Both the observation group and the control group were treated with conventional western medicine, including aspirin or atorvastatin. The intervention of the observation group was to add acupuncture to the conventional western medicine treatment. Acupuncture therapies included acupuncture, electroacupuncture, auricular acupuncture, warm acupuncture, etc, without restrictions on acupuncture operation methods, acupoint selection, duration of treatment and follow-up period.

Types of comparison

The control group will include treatments of placebo or the same western medicine treatment in the observation group, such as aspirin or atorvastatin.

Outcomes

The primary outcome indicator will be the changes of cIMT and VPQ before and after treatment.

The secondary outcomes include the changes of carotid plaque Crouse score, greyscale median and lipid levels. Safety outcomes include the type and frequency of occurrence of adverse reactions, such as subcutaneous haematoma, fatigue, palpitations, etc.

Selection of studies

Based on the inclusion and exclusion criteria, two independent reviewers (XW and QM) will remove duplicates and unqualified articles after reading the titles and abstract. For articles that meet the inclusion criteria, the full texts will be evaluated for eligibility. If there is any disagreement between the two reviewers, the third reviewer (XY) will make a final decision after discussion. If the data or information is incomplete, the authors will be contacted. The PRISMA flow diagram (figure 1) will be used to show the research screening process.

Figure 1.

Figure 1

Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow chart of study selection process.

Data extraction and management

All reviewers discussed and developed data extraction forms based on the Cochrane Handbook, and two independent reviewers (XW and QM) will extract data from the included studies. The extracted data include general information (author, publication year, journal, etc), participant, sample size, intervention methods, duration, outcomes and follow-up time (table 2). If the data are incomplete, the corresponding author will be contacted. Multiarm trials will be assigned into two-arm trials to ensure that the results can be combined.19

Table 2.

Characteristics of included studies

Reference Country Study design Population Intervention Outcomes Adverse event Follow-up
Sample age Sample size I C Duration

C, control; I, intervention.

Risk of bias assessment

Two reviewers (XW and QM) will use the ‘risk of bias’ tool from the Cochrane Handbook (V.5.1.0) to assess the quality of the included studies.18 20 The contents of the evaluation include random sequence generation, allocation concealment, and implementation of blinding, incomplete outcome data, selective reports, and other issues. Any inconsistencies will be decided through discussion with the third reviewer (XY). The risk of bias will be classified as ‘high risk of bias’, ‘low risk of bias’ or ‘unclear risk of bias’.

Statistical analysis

Standard pairwise meta-analysis

Standard pairwise meta-analysis was performed using Stata V.15.0 software. The OR was used as the effect size for count data, the mean difference was used for measurement data and 95% CI was used for interval estimation. According to the Cochrane Handbook, the Mantel-Haenszel χ2 test and Higgins I2 test will analyse the heterogeneity. A p value of <0.10 or I2 >50% indicates that the heterogeneity is statistically significant, and the source of heterogeneity is analysed. Based on the possible heterogeneity factors, conduct subgroup analysis, and then sensitivity analysis, were carried out to ascertain the reliability of the data, find abnormal studies that lead to significant heterogeneity and analyse the reasons. Heterogeneity also depends on the size of the impact, the direction of the results and the strength of the evidence.

NMA and network geometry

WinBUGS V.1.4.3 will be used for network statistical analysis,21 with a random-effects model containing direct comparison and indirect comparison, and the calculation will be performed by the Bayesian Markov chain Monte Carlo methods. The number of iterations is 50 000, the 10 000 is used for annealing to eliminate the influence of the initial value, and sampling starts after 10 001. We calculate the surface under cumulative ranking area to predict the curative effect of each treatment measure and rank it. The result is expressed as a percentage; the larger the value, the better the curative effect of the intervention.22

Stata V.15.0 draws the network geometry. The results of different types of acupuncture effects will be demonstrated: the line between the two circles indicates that there is a direct correlation between the two interventions, and the absence of a line means that there is no direct correlation, and only indirect comparisons can be made. The thickness of the line represents the number of direct comparison studies, the area of the circle represents the number of intervention studies evaluated.23 24 The comparison-adjusted funnel plot was used to compare sample effects between studies and evaluate the publication bias of the included studies.

Assessment of inconsistency

The basic principle of NMA is that the included studies are consistent, and the results of indirect comparison and direct comparison should be similar. We will use loop-specific methods to detect loops of evidence that may have important inconsistencies.25 A node split model is used to compare the consistency of direct comparison and indirect comparison.26 P>0.05 means that the consistency between direct and indirect comparisons is better, thus a consistency model is used for analysis. Otherwise, the inconsistency model is used. For those that have not generated node split, the consistency model is used for analysis.

Subgroup and sensitivity analyses

To assess the impact of covariates in heterogeneity, such as gender and disease severity, we will explore subgroup analysis.

Subgroup analysis still has obvious heterogeneity, thus sensitivity analysis will be performed. We then eliminate low-quality studies one by one, and then merge the data. The meta-analysis will be repeated and we will compare the results of the two meta-analyses to identify the impact of each study on the overall results.

Assessment of publication biases

If more than 10 trials are included, a Deek’s funnel plot will be used to evaluate publication bias. If the angle between the regression line and the x-axis is closer to 90°, it means that there will be less possibility of publication bias.27

Ethics and dissemination

Since the study will be based on de-identified, aggregated published data, ethical approval is not required. The final report of this review will be disseminated through peer-reviewed publications or conference reports.

Discussion

CAS is a common multiple disease that endangers human health. The common pathological basis of cardiovascular and cerebrovascular diseases has become the main cause of death in the world. Clinically, the treatment of AS is roughly divided into drug and non-drug treatments. Among them, drug treatments include statins, which have antiplatelet, anti-inflammatory and lipid-regulating effects, and inhibit angiogenesis effects in plaques.28 29 Although great progress has been made in the treatment of AS, the complex and diverse causes and mechanisms of AS (closely related to metabolic, environmental, genetic and other factors) make the existing clinical intervention methods. The treatment of AS is still insufficient, and diseases caused by AS still bring huge health and economic burden to society.30 In recent years, acupuncture has been widely used as an adjuvant treatment for AS. However, there is no research to rank acupuncture intervention and evaluate the optimal acupuncture method. Therefore, this NMA will conduct a detailed summary and analysis of acupuncture as adjuvant therapy for CAS to determine the optimal acupuncture therapy.

The comparison between therapies in the NMA is based on direct comparisons of interventions within RCTs and indirect comparisons across trials based on a common comparator, such as placebo or some standard treatment. The inter-relationship between multiple interventions can be analysed, and dealt with factors that may have an impact due to the number of included articles, heterogeneity and inconsistency.31 32

Nevertheless, this NMA still has limitations. Some low-quality trials may affect the final results of the NMA. In addition, the heterogeneity of different studies may affect the final results of this study. Finally, this study only includes English and Chinese trials, which may lead to the potential risk of ignoring some studies.

Despite the limitations, the latest data should be systematically reviewed. It is concluded that different types of acupuncture can assist patients with CAS to better improve cIMT, and can provide evidence-based medicine for clinical evidence.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

XW and QM contributed equally.

Contributors: XW and QM conceived of the protocol and drafted the manuscript. XW and JL registered the protocol review in the PROSPERO. ZY and XH developed the search strategy. NZ revised the manuscript for methodological and intellectual content. XY contributed to and approved the final manuscript of the protocol review.

Funding: This study is supported by the National Natural Science Foundation of China (grant number: 82160941, 82160937).

Competing interests: None declared.

Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Ethics statements

Patient consent for publication

Not required.

References

  • 1.Xu S, Kamato D, Little PJ, et al. Targeting epigenetics and non-coding RNAs in atherosclerosis: from mechanisms to therapeutics. Pharmacol Ther 2019;196:15–43. 10.1016/j.pharmthera.2018.11.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Zhu Y, Xian X, Wang Z, et al. Research progress on the relationship between atherosclerosis and inflammation. Biomolecules 2018;8. 10.3390/biom8030080. [Epub ahead of print: 23 08 2018]. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Tall AR, Yvan-Charvet L, Cholesterol Y-CL. Cholesterol, inflammation and innate immunity. Nat Rev Immunol 2015;15:104–16. 10.1038/nri3793 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.WHO . Noncommunicable diseases, 2021. Available: https://www.who.int/zh/news-room/fact-sheets/detail/noncommunicable-diseases
  • 5.Zhao D, Liu J, Wang M, et al. Epidemiology of cardiovascular disease in China: current features and implications. Nat Rev Cardiol 2019;16:203–12. 10.1038/s41569-018-0119-4 [DOI] [PubMed] [Google Scholar]
  • 6.Kobiyama K, Ley K. Atherosclerosis. Circ Res 2018;123:1118–20. 10.1161/CIRCRESAHA.118.313816 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Libby P, Buring JE, Badimon L, et al. Atherosclerosis. Nat Rev Dis Primers 2019;5:56. 10.1038/s41572-019-0106-z [DOI] [PubMed] [Google Scholar]
  • 8.Ooi YC, Gonzalez NR. Management of extracranial carotid artery disease. Cardiol Clin 2015;33:1–35. 10.1016/j.ccl.2014.09.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Cao JJ, Arnold AM, Manolio TA, et al. Association of carotid artery intima-media thickness, plaques, and C-reactive protein with future cardiovascular disease and all-cause mortality: the cardiovascular health study. Circulation 2007;116:32–8. 10.1161/CIRCULATIONAHA.106.645606 [DOI] [PubMed] [Google Scholar]
  • 10.Zhou J, Zhao L, Meng L, et al. Acupuncture treatment for carotid atherosclerotic plaques: study protocol for a pilot randomized, single blinded, controlled clinical trial. Trials 2020;21:768. 10.1186/s13063-020-04709-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Kinoshita M, Yokote K, Arai H, et al. Japan atherosclerosis Society (JAS) guidelines for prevention of atherosclerotic cardiovascular diseases 2017. J Atheroscler Thromb 2018;25:846–984. 10.5551/jat.GL2017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Liu M, Liu G, Wang M. Comparison and analysis of the therapeutic effect of different statins in the treatment of atherosclerosis. Pak J Pharm Sci 2018;31:1737–42. [PubMed] [Google Scholar]
  • 13.Zhang YP, Li Y, Xu Y. Preliminary analysis on anti-inflammatory mechanism of acupuncture. J Clin Acupunct Moxibustion 2018;34:77–80. [Google Scholar]
  • 14.Han Z, Zhang Y, Wang P, et al. Is acupuncture effective in the treatment of COVID-19 related symptoms? Based on bioinformatics/network topology strategy. Brief Bioinform 2021;22. 10.1093/bib/bbab110. [Epub ahead of print: 02 09 2021]. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Shen Y, Cheng Z-D, Chen Y-G, et al. Electroacupuncture inhibits atherosclerosis through regulating intestinal flora and host metabolites in rabbit. Evid Based Complement Alternat Med 2020;2020:1–10. 10.1155/2020/5790275 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Huang F, Yao G-X, Huang XL. Clinical observation on acupuncture treatment of carotid atherosclerosis of Phlegm-Damp constitution. Guang Med J 2018;39:2070–3. [Google Scholar]
  • 17.Cheng Z, Ning Y, Wang R. [Effects of electroacupuncture on expression of CD36 in peritoneal macrophages of rabbits with atherosclerosis]. Zhongguo Zhen Jiu 2018;38:179–84. 10.13703/j.0255-2930.2018.02.020 [DOI] [PubMed] [Google Scholar]
  • 18.Julian PT, Higgins SG. Cochrane Handbook for systematic reviews of interventions version 5.1.0, 2011. [Google Scholar]
  • 19.Zhang C, Yan JZ, Sun F. Dif erentiation and handling of homogeneity in network meta-analysis. Chin J Evid-Based Med 2014;14:884–8. [Google Scholar]
  • 20.Guyatt G, Busse J. Tools to assess risk of bias in randomized controlled trials, 2015. [Google Scholar]
  • 21.Dave V, Yadav RB, Yadav S, et al. A critique of computer simulation software's used in pharmacokinetics and pharmacodynamics analysis. Curr Clin Pharmacol 2018;13:216–35. 10.2174/1574884713666181025144845 [DOI] [PubMed] [Google Scholar]
  • 22.Cope S, Jansen JP. Quantitative summaries of treatment effect estimates obtained with network meta-analysis of survival curves to inform decision-making. BMC Med Res Methodol 2013;13:147. 10.1186/1471-2288-13-147 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.van Valkenhoef G, Lu G, de Brock B, et al. Automating network meta-analysis. Res Synth Methods 2012;3:285–99. 10.1002/jrsm.1054 [DOI] [PubMed] [Google Scholar]
  • 24.Nyaga VN, Aerts M, Arbyn M. ANOVA model for network meta-analysis of diagnostic test accuracy data. Stat Methods Med Res 2018;27:1766–84. 10.1177/0962280216669182 [DOI] [PubMed] [Google Scholar]
  • 25.Bucher HC, Guyatt GH, Griffith LE, et al. The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J Clin Epidemiol 1997;50:683–91. 10.1016/S0895-4356(97)00049-8 [DOI] [PubMed] [Google Scholar]
  • 26.Dias S, Welton NJ, Caldwell DM. Checking consistency in mixed treatment comparison meta-analysis. Stat Med 2010;29:932–44. 10.1002/sim.3767 [DOI] [PubMed] [Google Scholar]
  • 27.Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol 2005;58:882–93. 10.1016/j.jclinepi.2005.01.016 [DOI] [PubMed] [Google Scholar]
  • 28.Kirichenko TV, Sobenin IA, Nikolic D, et al. Anti-Cytokine therapy for prevention of atherosclerosis. Phytomedicine 2016;23:1198–210. 10.1016/j.phymed.2015.12.002 [DOI] [PubMed] [Google Scholar]
  • 29.Khosravi M, Poursaleh A, Ghasempour G, et al. The effects of oxidative stress on the development of atherosclerosis. Biol Chem 2019;400:711–32. 10.1515/hsz-2018-0397 [DOI] [PubMed] [Google Scholar]
  • 30.Bubnova MG, Kukharchuk VV. [Recommendations of the European Society of Cardiology and the European Atherosclerosis Society on Cardiovascular Disease Prevention and Management of Dyslipidemias. for the Diagnosis of Atherosclerosis and Dyslipidemia Treatment (2016): Basic S.G.]. Kardiologiia 2017;57:85–9. [PubMed] [Google Scholar]
  • 31.Li T, Puhan MA, Vedula SS, et al. Network meta-analysis-highly attractive but more methodological research is needed. BMC Med 2011;9:79. 10.1186/1741-7015-9-79 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Mills EJ, Thorlund K, Ioannidis JPA. Demystifying trial networks and network meta-analysis. BMJ 2013;346:f2914. 10.1136/bmj.f2914 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2021-049778supp001.pdf (84.9KB, pdf)

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES