Skip to main content
PLOS One logoLink to PLOS One
. 2019 Aug 29;14(8):e0221750. doi: 10.1371/journal.pone.0221750

Aspirin better than clopidogrel on major adverse cardiovascular events reduction after ischemic stroke: A retrospective nationwide cohort study

Amelia Nur Vidyanti 1,2, Lung Chan 3,4, Cheng-Li Lin 5, Chih-Hsin Muo 5, Chung Y Hsu 6,7, You-Chia Chen 4,8, Dean Wu 4,9, Chaur-Jong Hu 3,4,8,10,*
Editor: Aristeidis H Katsanos11
PMCID: PMC6715172  PMID: 31465467

Abstract

Background

Several clinical trials reported that clopidogrel was superior to aspirin in secondary stroke prevention by reducing the risk of major adverse cardiovascular events (MACE). We aimed to compare the efficacy of clopidogrel with aspirin in reducing one-year risk of MACE based on real-world evidence from Taiwan Health Insurance Database.

Methods

We identified ischemic stroke patients between 2000 and 2012 who took aspirin or clopidogrel within 7 days of stroke onset for 1-year follow-up. The primary outcome was one-year MACE including recurrent stroke, acute myocardial infarction, and death. Propensity score matching and conditional Cox proportional hazards regression were conducted to control the confounding factors.

Results

From 9,089 ischemic stroke patients, we found 654 patients on aspirin and 465 patients on clopidogrel who met the selective inclusion criteria. After propensity score matching, 379 patients were selected from each group. The clopidogrel group had a 1.78-fold MACE risk compared with the aspirin group at one-year follow-up (95% CI = 1.41–2.26, p<0.01). The MACE-free rate in the aspirin group was 15.74% higher than in the clopidogrel group at one-year follow-up. Sub-analysis of the three components of MACE showed that clopidogrel conferred higher risk of recurrent stroke (OR 1.43, 95% CI = 1.06–1.92, p 0.02) and acute myocardial infarction (OR 3.72, 95% CI = 1.04–13.3, p 0.04), but no different risk of death than that of aspirin.

Conclusions

Among first-ever ischemic stroke patients, secondary stroke prevention using clopidogrel was associated with higher rates of MACE than aspirin. Aspirin might have better efficacy in secondary stroke prevention and was associated with lower risk of MACE. The real-world evidence raises the need to re-assess the current therapeutic options in secondary stroke prevention applying aspirin vs. clopidogrel.

Introduction

People with first-ever stroke, especially ischemic stroke have higher risk of recurrence not only within 90 days after the stroke onset but also in life-long follow-up [1, 2]. Secondary prevention strategy is critical and the use of antiplatelet agents for these patients should always be carefully assessed on the safety and efficacy issues. Dual anti-platelets therapy is recently recommended only in early stage for short period and the long-term use of single antiplatelet agent is still the standard therapy for patients with ischemic stroke after acute stage [3]. Therefore, to choose the most appropriate single antiplatelet agent is a very important issue.

Aspirin is the most frequently recommended antiplatelet agent for secondary stroke prevention after ischemic stroke. However, a recent meta-analysis of 6 randomized trials (CAPRIE, ESPS-2, MATCH, CHARISMA, ESPRIT, and PRoFESS) conducted to compare the efficacy and safety of different antiplatelet agent for long-term secondary prevention after non-cardioembolic stroke or TIA demonstrated that clopidogrel and combination of aspirin-dipyridamole have a favorable efficacy and safety than the other antiplatelet agents (aspirin alone or a combination of aspirin-clopidogrel) [4]. Moreover, previous systematic review assessing the effectiveness and safety of thienopyridine derivatives (clopidogrel and ticlopidine) versus aspirin concluded that clopidogrel and ticlopidine were modestly more effective than aspirin for preventing serious vascular events in patients at high risk [5]. Although the two studies show that clopidogrel has favorable efficacy than aspirin, most of the study population involved are from Caucasian ethnicity. Study that compares the efficacy of aspirin and clopidogrel in preventing major adverse cardiovascular events (MACE) after ischemic stroke in Asian population is very limited.

Previous clinical trial, CAPRIE, is the only trial which directly comparing the efficacy of aspirin and clopidogrel in patients at risk of ischemic events. The trial reported that long term administration of clopidogrel had better efficacy than aspirin for reducing a composite vascular events of ischemic stroke, acute myocardial infarction (AMI), or vascular death among all groups of patients with atherosclerotic vascular diseases. However, clopidogrel was not more effective than aspirin among the subgroup of stroke patients [6]. Therefore, the comparison of efficacy between these two antiplatelets for secondary stroke prevention remains open for discussion.

Major adverse cardiovascular events (MACE) is a composite outcome of recurrent stroke, AMI, and all cause of death. The risk of MACE after first-ever stroke can be reduced by appropriate antiplatelet agents. The recent meta-analysis study about comparison of efficacy between some antiplatelets in secondary stroke prevention aforementioned above derived from six large clinical trials [4]. Noteworthy that in clinical trials it might be impossible to recruit the patients with extremely old age, and high severity of vascular diseases with complex vascular comorbidities. For these reasons, about 75% of stroke patients from clinical practice (real-world practice) could not be enrolled based on the selective inclusion/exclusion criteria in those randomized-controlled trials [7, 8]. The limitation of those trials with restricted patient populations raises the need to explore real-world evidence to assess the safety and efficacy of aspirin vs. clopidogrel in the large patient population who have been prescribed aspirin or clopidogrel. By searching real-world evidence, the safety and efficacy of antiplatelet agents can be more reliably measured. In this study, we aimed to evaluate the efficacy of clopidogrel compared to aspirin by calculating the MACE risk between the two groups based on real-world evidence from the National Health Insurance Research Database (NHIRD) in Taiwan.

Materials and methods

Study design and population

We used Taiwan’s NHIRD for this retrospective cohort study. NHIRD contained one million insured patients randomly selected from the 2000-Registry for Beneficiaries in a National Health Insurance Program which has been established by the National Health Insurance Administration, Ministry of Health and Welfare in Taiwan. The data include patients’ personal characteristics from all outpatient and inpatient medical services in Taiwan.

We identified 35.396 ischemic stroke patients between 2000–2012. There were 9089 patients who were prescribed aspirin or clopidogrel within 7 days after stroke onset. The final number was 1119 which met the inclusion criteria. The inclusion criteria: A. Ischemic stroke patients admitted in 2000–2012; B. Received aspirin 100 mg/day or clopidogrel 75 mg/day within 7 days of stroke onset. The exclusion criteria: Age <20 years; treatment with combination of aspirin and dipyridamole, cilostazol, ticlopidine, or warfarin during hospitalization or within 7 days of stroke onset; both aspirin and clopidogrel were prescribed within 7 days of stroke onset; with any antithrombotic (including aspirin, clopidogrel, combination of aspirin and dipyridamole, cilostazol, ticlopidine, and warfarin) before stroke admission; with aspirin use < 6 month within one year after discharge; with clopidogrel use < 6 month within one year after discharge. This study has received ethical approval from Taipei Medical University-Joint Institutional Review Board (TMU-JIRB 057/20140202). Informed consent was waived owing to the retrospective nature of the study.

Propensity score matching

For reducing the selection bias, we used propensity score (PS) matching analysis for selected comparisons. The algorithm of propensity score matching used “best” matched subjects with the highest digit (8 digits) sequentially to the lowest digits (1 digit). If a case does not have a matched control, it is removed from this study.

Outcome

The primary outcome was MACE including recurrent stroke, AMI, and all cause of death which occurred within one year after stroke admission. All study subjects were followed from the stroke admission until MACE occurred. Those without MACE were followed until one year after stroke admission, or were withdrawn from the program.

Statistical analysis

Chi-square test was used to test the different of gender and baseline comorbidities between the aspirin and clopidogrel groups. Student’s t-test was used to measure the age difference Wilcoxon Rank sum test was used to test the different of hospitalization days. Incidence of MACE was the sum of MACE occurred divided by the sum of follow-up periods between the two groups. Cox proportional hazard model was used to estimate the MACE risk before the PS matching. After matching, we used Cox proportional hazard model to adjust matched pairs. Cumulative incidence of MACE was plotted by Kaplan-Meier analysis. All statistical analyses were assessed by SAS software Version 9.4 (SAS Institute Inc., Cary, NC, USA). The significant level was set with p < 0.05 in two-tailed tests.

Results

Before PS matching

We collected 1119 ischemic stroke patients including 654 patients on aspirin and 465 on clopidogrel. Compared with the aspirin group, the clopidogrel group was older on age (69.9 ± 11.8 vs. 66.7 ± 12.1 years, p < 0.001), had more hospitalization days (median 9 vs. 8 days, p < 0.001), and higher incidence of hypertension (84.7% vs. 77.1%, p 0.002), dyslipidemia (51.8% vs. 40.3%, p < 0.001), heart disease (60.4% vs. 50.5%, p 0.001), and ulcer (62.2% vs. 39.2%, p < 0.001) (Table 1). During one-year follow-up, there were 178 (27.3%) and 213 (45.8%) patients with MACE in the aspirin and clopidogrel groups (Table 2). The MACE-free rate in the aspirin group was 11.98% higher than that in the clopidogrel group at one-year follow-up (Fig 1A). Compared with the aspirin group, the clopidogrel group had a 2.05-fold MACE risk (95% CI = 1.68–2.50), 1.69-fold risk of recurrent stroke (95% CI = 1.32–2.17), and a 3.41-fold risk of AMI (95% CI = 1.21–9.68). For the safety profile, clopidogrel group had a 2.52-fold risk (95% CI = 1.88–3.39) of gastrointestinal (GI) bleeding than aspirin group (Table 2).

Table 1. Baseline Characteristics before and after Propensity Score (PS) Matching.

Characteristic Before PS matching After PS matchinga
Aspirin
(N = 654)
Clopidogrel
(N = 465)
p value Aspirin
(N = 379)
Clopidogrel
(N = 379)
p value
Age ─ year; means ± SD 66.7 (12.1) 69.9 (11.8) <0.001 68.9 (11.2) 68.9 (12.2) 0.98
Hospitalization days ─
median (interquartile range)
8 (7) 9 (11) <0.001 8 (9) 9 (10) 0.11
Male ─ no. (%) 372 (57.1) 257 (55.3) 0.53 198 (52.2) 217 (57.3) 0.17
Baseline comorbidity ─ no. (%)
    Obesity 4 (0.61) 5 (1.08) 0.50 3 (0.79) 4 (1.06) 1.00
    Hypertension 502 (77.1) 394 (84.7) 0.002 308 (81.3) 314 (82.9) 0.57
    Diabetes mellitus 253 (38.9) 202 (43.4) 0.13 168 (44.3) 161 (42.5) 0.61
    Dyslipidemia 262 (40.3) 241 (51.8) <0.001 192 (50.7) 183 (48.3) 0.51
    Previous CVA / TIA 68 (10.5) 40 (8.60) 0.30 45 (11.9) 35 (9.23) 0.24
    Heart disease 329 (50.5) 281 (60.4) 0.001 212 (55.9) 215 (56.7) 0.83
    Atrial fibrillation 25 (3.84) 24 (5.16) 0.29 16 (4.22) 22 (5.80) 0.32
    Ischemic heart 228 (35.0) 219 (47.1) <0.001 159 (42.0) 165 (43.5) 0.66
    Heart failure 52 (8.00) 69 (14.8) <0.001 41 (10.8) 49 (12.9) 0.37
    Smoking 5 (0.77) 9 (1.94) 0.08 4 (1.06) 9 (2.37) 0.26
    Alcohol use 24 (3.69) 27 (5.81) 0.09 15 (3.96) 21 (5.54) 0.31
    Ulcer 255 (39.2) 289 (62.2) <0.001 218 (57.5) 210 (55.4) 0.56
    Malignancy 22 (3.38) 19 (4.09) 0.54 12 (3.17) 17 (4.49) 0.34

aBefore PS matching, the baseline characteristics between two groups were significantly different (p < 0.05) due to possible sampling bias (population ratio: aspirin/clopidogrel = 5.05/1). After PS matching, there were no significant differences among two groups for any variables.

PS, propensity score; CVA, cerebrovascular accident; TIA, transient ischemic attack.

Table 2. Major adverse cardiovascular events, intracerebral haemorrhage, and GI bleeding before and after PS matching.

Before PS Matching After PS Matching
Aspirin
(N = 651)
Clopidogrel
(N = 465)
HRa (95% CI) p value Aspirin
(N = 379)
Clopidogrel
(N = 379)
HRb (95% CI) p value
Major adverse cardiovascular events within 12 months after stroke onset 178 (27.3) 213 (45.8) 2.05 (1.68–2.50) <0.001 115 (30.3) 172 (45.4) 1.78 (1.41–2.26) <0.001
Recurrent stroke (any type) 117 (18.0) 132 (28.4) 1.69 (1.32–2.17) <0.0001 77 (20.3) 104 (27.4) 1.43 (1.06–1.92) 0.02
AMI 5 (0.77) 12 (2.58) 3.41 (1.21–9.68) 0.02 3 (0.79) 11 (2.90) 3.72 (1.04–13.3) 0.04
Death (all cause of death) 8 (1.23) 9 (1.94) 1.59 (0.61–4.12) 0.34 3 (0.79) 7 (1.85) 2.53 (0.61–9.09) 0.22
Intracerebral hemorrhage 18 (2.76) 17 (3.66) 1.33 (0.69–2.58) 0.40 8 (2.11) 15 (3.96) 1.89 (0.79–4.51) 0.15
GI bleeding 71 (10.9) 115 (24.7) 2.52 (1.88–3.39) <0.001 44 (11.6) 102 (26.9) 2.60 (2.82–3.70) <0.001

PS, propensity score; HR, hazard ratio; CI, confidence interval; GI, gastrointestinal.

aUnadjusted HR.

bAdjusted HR for matched pairs.

Fig 1.

Fig 1

MACE-free rate between aspirin and clopidogrel groups before (A) and after (B) PS matching.

After PS matching

There were 379 ischemic stroke patients on clopidogrel and 379 matched-patients on aspirin. There were comparable distributions of age, gender, hospitalization days, and baseline comorbidity between the two groups (Table 1). During one-year follow-up, there were 115 (30.3%) and 172 (45.4%) patients with MACE in aspirin and clopidogrel groups respectively (Table 2). The MACE-free rate in the aspirin group was 15.74% higher than in the clopidogrel group at one-year follow-up (Fig 1B). Compared with the aspirin group, the clopidogrel group had a 1.78-fold MACE risk (95% CI = 1.41–2.26), 1.43-fold risk of recurrent stroke (95% CI = 1.06–1.92), and a 3.72-fold risk of AMI (95% CI = 1.04–13.3) (Table 2). For the safety profile, clopidogrel group had a 2.60-fold risk (95% CI = 2.82–3.70) of gastrointestinal (GI) bleeding than aspirin group. However, the risks of intracerebral haemorrhage and death were not different between groups before and after matching.

Discussion

The present study shows the MACE rate was significantly higher in the clopidogrel group than the aspirin group after one-year follow-up. Patients on clopidogrel had higher risk of recurrent stroke and AMI than those on aspirin. However, the risk of death was similar either in patients on clopidogrel or aspirin.

The higher MACE rate in the clopidogrel group was unexpected. The CAPRIE trial reported that patients treated with clopidogrel had lower risk of composite vascular events (ischemic stroke, AMI, or death) than aspirin (5.32% vs 5.83%), with a relative risk reduction (RRR) of 8.7% in favor of clopidogrel (95% CI = 0.3–16.5, p 0.043). However, this finding might be due to the clopidogrel action which conferred the most significant efficacy mainly in the subgroup of patients with peripheral artery disease (PAD) with relative risk reduction (RRR) of 23.8% (95% CI = 8.9–36.2, P<0.01), but not in subgroups of stroke and AMI [6]. Approximately 33% patients with PAD were recruited in the CAPRIE trial to raise the possibility that clopidogrel appeared to be of greater benefit than aspirin in the overall results. Although the number of patients with PAD was not well documented in the present study, it should be low since the prevalence of PAD is much lower in Asian than in Western countries [9]. The prevalence of PAD in Taiwan is approximately 7.2% as previously reported [10].

The reasons why aspirin could have higher efficacy than clopidogrel in the present study could be multi-factorial. First, there is a possibility for clopidogrel resistance in our study subject. Antiplatelet resistance in ischemic stroke patients has emerged as a focus of interest in recent years [11]. Both clopidogrel and aspirin could have a resistance or non-responsiveness causing treatment failure in ischemic stroke patients [11, 12]. Aspirin resistance could be related to genetic polymorphisms of COX-1, COX-2 or thromboxane A2 synthase, while clopidogrel resistance could be due to polymorphisms of receptor P2Y12, enzymes CYP3A4, CYP1A2, CYP2C19, or ABCB1 [11]. There has been no prior study to compare the genetic polymorphisms of aspirin in Asian and Caucasian population. However, the genetic polymorphisms of clopidogrel in Asian, particularly in Chinese population, is reported to be higher than Caucasian. Carriers of the CYP2C19 loss-of-function allele account for 50% to 60% of Chinese population, while they account for 15% to 30% of Caucasian [1316]. Carriers of this allele will have poor metabolic rate of clopidogrel. This might confer higher risk of clopidogrel resistance in our study subject. A recent meta-analysis study reported that the prevalence of high on-treatment platelet reactivity (HTPR), which is associated with the efficacy of antiplatelet therapy in patients with ischemic stroke or TIA, on aspirin was 23% (95% CI: 20–28%) and on clopidogrel was 27% (95% CI: 22–32%) [17]. It shows that aspirin might be a little more effective than clopidogrel for antiplatelet therapy in secondary stroke prevention.

Furthermore, in addition to its antiplatelet properties, aspirin also exhibits pharmacological benefit in reducing vascular injury by its antioxidant effect via inhibition of lipid peroxidation and DNA damage to reduce the generation of *OH free radicals [18]. Aspirin also has anti-inflammatory effects by inhibiting cyclooxygenase to lessen the progression of vascular injury in patients with cardiovascular and cerebrovascular diseases [19].

In the present study, the MACE rates for aspirin and clopidogrel are 30.3% and 45.4% respectively. They are substantially higher than those reported in previous studies showing the MACE rates around 10% for both antiplatelet agents [20, 21]. The study of Lee et al (2014) also reported higher rates of MACE, it was 23.7% for clopidogrel and 38% for aspirin [22]. Although this study also used the same database of Taiwan NHID, the inclusion criteria was totally different as the objective was to compare clopidogrel initiation vs aspirin re-initiation for vascular risk reduction among patients with ischemic stroke and aspirin resistance. Hence, the result of this study favored clopidogrel than aspirin re-initiation for reducing the MACE rates [22].

Another study using Taiwan Stroke Registry (TSR) found different results. Although this study applying TSR did not measure the MACE rate, the recurrent stroke rates were quite low, 3.46% for aspirin and 3.79% for clopidogrel [23]. TSR program is a government-funded project of 64 stroke centers in academic and community hospitals in Taiwan (most tertiary hospitals). TSR data has been acknowledged as representative of the national stroke population in the NHIRD [23]. However, NHIRD actually covers the population of outpatient and inpatient services from the local and primary hospitals around Taiwan, but not only tertiary ones [22]. Hence, the characteristics and outcomes of the patients between these two databases might be different. Nevertheless, the reason for the higher rates of MACE in the present study remains to be further explored with more detailed analyses of big data bases between NHIRD and TSR.

Another issue in the present study was about the safety profile of aspirin and clopidogrel. Although the risk of intracerebral haemorrhage was similar between the two groups, GI bleeding was more commonly found in patients on clopidogrel than those on aspirin. It showed contradictory with previous studies [6, 24]. Yet, we could not address the reasons behind this finding. This finding, altogether with the higher rates of MACE among clopidogrel group in the present study, might reflect the gaps between the real-world practice and clinical trials.

In the present study, we used real-world data derived from real-world practice that are more in accord with the real-world condition, not under the more stringent selection of the study population in randomized controlled trials (RCTs). Therefore, the efficacy and safety of antiplatelets might yield different results. Real-world data and real-world evidence (RWE) are increasingly recognized to be of value in health care decisions. USA Food and Drug Administration (FDA) uses real-world data and RWE to monitor post-market safety and adverse events of drugs as well as to make regulatory decisions. Medical product developers also use real-world data and RWE to support clinical trials and observational studies to produce innovative new treatment approaches [25].

Due to its effectiveness, low cost and availability worldwide, aspirin is still recommended as the first-line antiplatelet agent for secondary stroke prevention [3]. However, the pharmacoeconomic analysis of aspirin versus clopidogrel thus far in favor of clopidogrel based on the data derived from the CAPRIE trial [26, 27]. The cost-effectiveness of both drugs should also be further redefined by using RWE. Based on our findings in addition to the notion that aspirin has much lower cost than clopidogrel, we suggest that the efficacy of aspirin is superior to clopidogrel for ischemic stroke on MACE prevention. Results derived from the present study may be of value to assist clinicians in making decision to choose the more appropriate antiplatelet agent for better longer-term outcome.

There are several limitations in the present study. First, this is a retrospective cohort study with the clinical decision for choosing aspirin or clopidogrel were not well documented. Second, even with PS matching, inherent biases might still exist including confounding factors associated with highly variable health profiles and concurrent use of a variety of medications other than antiplatelet agents. Those variables might affect the safety and efficacy of antiplatelets agent and proclivity for developing MACE. Third, the findings derived from the present study may not be applicable to other races since this study was mostly on ethnic Chinese patients. Fourth, there were no adverse events available from the database to enrich the safety profile of both antiplatelets used. Hence, this issue could not be discussed further. Finally, the present study covers a follow-up period of only 1 year for determining the risk of MACE. Follow-up for longer period is likely to strengthen the apparent difference in long-term risk of developing MACE between 2 patient populations taking aspirin and clopidogrel for secondary stroke prevention.

Conclusions

Compared with clopidogrel, aspirin was associated with a reduced risk of MACE at one-year follow up among ischemic stroke patients. This real-world evidence from Taiwan NHIRD raises the need to re-assess the current therapeutic options related to antiplatelet agents used in secondary stroke prevention.

Acknowledgments

This study is based on data provided by the Bureau of National Health Insurance of Taiwan's Ministry of Health and Welfare, and managed by the National Health Research Institutes. The authors' interpretations and conclusions do not represent those of the Bureau of National Health Insurance, the Ministry of Health and Welfare, or the National Health Research Institutes.

Data Availability

All relevant data are within the manuscript.

Funding Statement

This study was supported in part by Taiwan Ministry of Health and Welfare Clinical Trial Center (MOHW108-TDU-B-212-133004), China Medical University Hospital, Academia Sinica Stroke Biosignature Project (BM10701010021), MOST Clinical Trial Consortium for Stroke (MOST 108-2321-B-039-003), Tseng-Lien Lin Foundation, Taichung, Taiwan, and Katsuzo and Kiyo Aoshima Memorial Funds, Japan. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Burn J, Dennis M, Bamford J, Sandercock P, Wade D, Warlow C. Long-term risk of recurrent stroke after a first-ever stroke. The Oxfordshire Community Stroke Project. Stroke. 1994;25(2):333–7. 10.1161/01.str.25.2.333 [DOI] [PubMed] [Google Scholar]
  • 2.Hankey GJ, Jamrozik K, Broadhurst RJ, Forbes S, Burvill PW, Anderson CS, et al. Long-term risk of first recurrent stroke in the Perth Community Stroke Study. Stroke. 1998;29(12):2491–500. 10.1161/01.str.29.12.2491 [DOI] [PubMed] [Google Scholar]
  • 3.Kernan WN, Ovbiagele B, Black HR, Bravata DM, Chimowitz MI, Ezekowitz MD, et al. Guidelines for the prevention of stroke in patients with stroke and transient ischemic attack: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2014;45(7):2160–236. 10.1161/STR.0000000000000024 [DOI] [PubMed] [Google Scholar]
  • 4.Greving JP, Diener HC, Reitsma JB, Bath PM, Csiba L, Hacke W, et al. Antiplatelet Therapy After Noncardioembolic Stroke. Stroke. 2019;50(7):1812–8. 10.1161/STROKEAHA.118.024497 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Sudlow CL, Mason G, Maurice JB, Wedderburn CJ, Hankey GJ. Thienopyridine derivatives versus aspirin for preventing stroke and other serious vascular events in high vascular risk patients. Cochrane Database Syst Rev. 2009(4):Cd001246 10.1002/14651858.CD001246.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.CAPRIE Steering Committee. A randomised, blinded, trial of clopidogrel versus aspirin in patients at risk of ischaemic events (CAPRIE). The Lancet. 1996;348(9038):1329–39. [DOI] [PubMed] [Google Scholar]
  • 7.Caro JJ, Migliaccio-Walle K. Generalizing the results of clinical trials to actual practice: the example of clopidogrel therapy for the prevention of vascular events. The American journal of medicine. 1999;107(6):568–72. 10.1016/s0002-9343(99)00295-8 [DOI] [PubMed] [Google Scholar]
  • 8.Maasland L, van Oostenbrugge RJ, Franke CF, Scholte op Reimer WJ, Koudstaal PJ, Dippel DW. Patients enrolled in large randomized clinical trials of antiplatelet treatment for prevention after transient ischemic attack or ischemic stroke are not representative of patients in clinical practice: the Netherlands Stroke Survey. Stroke. 2009;40(8):2662–8. 10.1161/STROKEAHA.109.551812 [DOI] [PubMed] [Google Scholar]
  • 9.Criqui MH, Aboyans V. Epidemiology of peripheral artery disease. Circulation research. 2015;116(9):1509–26. 10.1161/CIRCRESAHA.116.303849 [DOI] [PubMed] [Google Scholar]
  • 10.Huang K-C, Chen C-C, Su Y-C, Lin J-S, Chang C-T, Wang T-Y, et al. The relationship between stasis-stagnation constitution and peripheral arterial disease in patients with type 2 diabetes. Evidence-Based Complementary and Alternative Medicine. 2014;2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Topçuoglu MA, Arsava EM, Ay H. Antiplatelet resistance in stroke. Expert review of neurotherapeutics. 2011;11(2):251–63. 10.1586/ern.10.203 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Mijajlovic M, Shulga O, Bloch S, Covickovic‐Sternic N, Aleksic V, Bornstein N. Clinical consequences of aspirin and clopidogrel resistance: an overview. Acta Neurologica Scandinavica. 2013;128(4):213–9. 10.1111/ane.12111 [DOI] [PubMed] [Google Scholar]
  • 13.Desta Z, Zhao X, Shin J-G, Flockhart DA. Clinical significance of the cytochrome P450 2C19 genetic polymorphism. Clinical pharmacokinetics. 2002;41(12):913–58. 10.2165/00003088-200241120-00002 [DOI] [PubMed] [Google Scholar]
  • 14.Mega JL, Close SL, Wiviott SD, Shen L, Hockett RD, Brandt JT, et al. Cytochrome p-450 polymorphisms and response to clopidogrel. New England Journal of Medicine. 2009;360(4):354–62. 10.1056/NEJMoa0809171 [DOI] [PubMed] [Google Scholar]
  • 15.Wang Y, Zhao X, Lin J, Li H, Johnston SC, Lin Y, et al. Association between CYP2C19 loss-of-function allele status and efficacy of clopidogrel for risk reduction among patients with minor stroke or transient ischemic attack. Jama. 2016;316(1):70–8. 10.1001/jama.2016.8662 [DOI] [PubMed] [Google Scholar]
  • 16.Pan Y, Chen W, Xu Y, Yi X, Han Y, Yang Q, et al. Genetic polymorphisms and clopidogrel efficacy for acute ischemic stroke or transient ischemic attack: a systematic review and meta-analysis. Circulation. 2017;135(1):21–33. 10.1161/CIRCULATIONAHA.116.024913 [DOI] [PubMed] [Google Scholar]
  • 17.Fiolaki A, Katsanos AH, Kyritsis AP, Papadaki S, Kosmidou M, Moschonas IC, et al. High on treatment platelet reactivity to aspirin and clopidogrel in ischemic stroke: a systematic review and meta-analysis. Journal of the neurological sciences. 2017;376:112–6. 10.1016/j.jns.2017.03.010 [DOI] [PubMed] [Google Scholar]
  • 18.Shi X, Ding M, Dong Z, Chen F, Ye J, Wang S, et al. Antioxidant properties of aspirin: characterization of the ability of aspirin to inhibit silica-induced lipid peroxidation, DNA damage, NF-κB activation, and TNF-α production. Molecular and cellular biochemistry. 1999;199(1–2):93–102. 10.1023/a:1006934612368 [DOI] [PubMed] [Google Scholar]
  • 19.Association AD. Cardiovascular disease and risk management: standards of medical care in diabetes—2018. Diabetes care. 2018;41(Supplement 1):S86–S104. [DOI] [PubMed] [Google Scholar]
  • 20.Lee M, Saver JL, Hong K-S, Rao NM, Wu Y-L, Ovbiagele B. Antiplatelet regimen for patients with breakthrough strokes while on aspirin: a systematic review and meta-analysis. Stroke. 2017;48(9):2610–3. 10.1161/STROKEAHA.117.017895 [DOI] [PubMed] [Google Scholar]
  • 21.Inzitari D, Piccardi B, Sarti C. A critical review of aspirin in the secondary prevention of noncardioembolic ischaemic stroke. International Journal of Stroke. 2010;5(4):306–18. 10.1111/j.1747-4949.2010.00443.x [DOI] [PubMed] [Google Scholar]
  • 22.Lee M, Wu Y-L, Saver JL, Lee H-C, Lee J-D, Chang K-C, et al. Is clopidogrel better than aspirin following breakthrough strokes while on aspirin? A retrospective cohort study. Bmj Open. 2014;4(12):e006672 10.1136/bmjopen-2014-006672 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Chi NF, Wen CP, Liu CH, Li JY, Jeng JS, Chen CH, et al. Comparison Between Aspirin and Clopidogrel in Secondary Stroke Prevention Based on Real‐World Data. Journal of the American Heart Association. 2018;7(19):e009856 10.1161/JAHA.118.009856 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.McQuaid KR, Laine L. Systematic review and meta-analysis of adverse events of low-dose aspirin and clopidogrel in randomized controlled trials. The American journal of medicine. 2006;119(8):624–38. 10.1016/j.amjmed.2005.10.039 [DOI] [PubMed] [Google Scholar]
  • 25.Sherman RE, Anderson SA, Dal Pan GJ, Gray GW, Gross T, Hunter NL, et al. Real-world evidence—what is it and what can it tell us. N Engl J Med. 2016;375(23):2293–7. 10.1056/NEJMsb1609216 [DOI] [PubMed] [Google Scholar]
  • 26.Durand-Zaleski I, Bertrand M. The value of clopidogrel versus aspirin in reducing atherothrombotic events: the CAPRIE study. Pharmacoeconomics. 2004;22(4):19–27. [DOI] [PubMed] [Google Scholar]
  • 27.Logman JFS, Heeg BM, Herlitz J, van Hout BA. Costs and consequences of clopidogrel versus aspirin for secondary prevention of ischaemic events in (high-risk) atherosclerotic patients in Sweden. Applied health economics and health policy. 2010;8(4):251–65. 10.2165/11535520-000000000-00000 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Aristeidis H Katsanos

15 Jul 2019

PONE-D-19-17386

Aspirin better than clopidogrel on major adverse cardiovascular events reduction after ischemic stroke: a retrospective nationwide cohort study

PLOS ONE

Dear Dr. Hu,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Aug 29 2019 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Aristeidis H. Katsanos, MD, PhD

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors tackled a very challenging subject of the most appropriate antiplatelet medication in secondary stroke prevention. The choice of the most appropriate antiplatelet agent is an unmet need. The literature is varied and makes the option difficult. The new revised stroke guidelines 2018 assumed that the selection of the antiplatelet agent depends on the clinicians’ preference, risk factors, cost, tolerance, and clinical characteristics.

The present scientific work is a retrospective study, including patients from the Taiwan Health Insurance Database. The authors invested a significant effort to compare aspirin with clopidogrel in preventing recurrent vascular events. This was a very thought provoking topic to investigate.

The study is clearly presented and described. The conclusion supported by the results. Nonetheless, there are several limitations that should be addressed and discussed.

1. The authors aimed to demonstrate that aspirin might have better efficacy than clopidogrel in secondary stroke prevention; however, the previous data does not support this conclusion. The findings are not consensus with the previous mentioned study of Lee et al, where the data derived from the same database. Specifically, the authors may wish to comment on how and why the findings are inconsistent with the previous mentioned study.

2. Moreover, the authors should identify more related literature that clarifies and justifies their findings and the controversies over the secondary antiplatelet treatment in stroke patients. Especially, a very recently published meta-analysis of Greving et al (2019) concluded that clopidogrel and aspirin/dipyridamole combination seemed to be the most appropriate choices with a favorable balance between efficacy and safety. Another previous review of the Cochrane Stroke Group trials register and the Antithrombotic Trialists' database concluded that the thienopyridine derivatives (ticlopidine and clopidogrel) are modestly but significantly more effective than aspirin in preventing serious vascular events in patients at high risk (and specifically in TIA/ischemic stroke patients)(Hankey et al 2000).

3. Additionally, the authors referred that the CAPRIE study failed to show a better efficacy of clopidogrel compared to aspirin; however the CAPRIE trial was not designed to determine whether clopidogrel was superior or equivalent to aspirin among stroke patients.

4. The authors mentioned that diabetic patients have higher rates of high on treatment platelet reactivity (HTPR) on clopidogrel and that could be associated with increased risk of MACE. The authors should include more information about the non-responsiveness of antiplatelets in stroke patients with diabetes mellitus. There are many scientific reports indicating higher rates of non-responsiveness to both antiplatelets (aspirin and clopidogrel) in diabetic patients and higher rates of recurrent strokes. In addition, as the authors referred to genes associated with HTPR on clopidogrel, a recent popular view is the potential relation of genetic factors with the prevalence of HTPR in both antiplatelets. There are many studies in the literature on that subject. It is also noteworthy, the black box warning from the US Food and Drug Administration that recommends patients to be tested for the possibility of reduced efficacy of clopidogrel in individuals carrying the CYP2C19*2 loss-of-function allele.

5. While the study appears to be sound, the language is unclear at some points, making it difficult to follow. There are some minor elements of grammar that would improve the article’s presentation. In the abstract, on page 2, line 38 “in 2000-2012”, the word “between” may work better. In the same page, line 46 “inclusion/exclusion criteria”, the sentence “patients on aspirin or clopidogrel who met the inclusion criteria” may work more effectively. On page 4, line 88 the authors should include references of trials comparing the efficacy of aspirin with clopidogrel. On page 5, line 133 referring to the primary outcome including all cause of hospitalization, the authors may wish to consider stating what cause of hospitalization they meant. On Table 1, there is a missing abbreviation for the CVA. At many points in the article, MACE refers to both cardiovascular and cerebrovascular disease. Lastly, the authors should revise the language in the section of “Conclusions” at page 13 to improve readability.

Reviewer #2: The study conducted by Vidyanti et al. had a retrospective design and aimed to evaluate the effect of clopidogrel when compared to aspirin on a combined clinical outcome – Major Adverse Cardiovascular Events (MACE).

The data provided by the author partially support their conclusion. This is a retrospective cohort study and the results should provide insights for another type of design, if relevant for specific population/ethnicity. The chosen design has limitations regarding biases and confounding variables prevented definite conclusions regarding drug efficacy.

The authors stated that all relevant data are within the manuscript and the statistical analysis was performed properly using Propensity score matching, a technique which minimize differences between two groups. This statistical tool was associated with conditional Cox proportional hazards regression for the same purpose.

The manuscript was written in an intelligible fashion and using standard English.

Comments:

1. How was ischemic stroke defined to qualify as an event in the retrospective cohort?

2. Regarding the inclusion criteria, specify the generic name of the substance (e.g., say “combination of Aspirin and Dipyridamole” instead of “Aggrenox”, “Cilostazol” instead of “Pletaal”). It is better to be consistent, as the other drugs were described using generic names.

3. In the lines 83 and 84 of introduction the authors state that Major Adverse Cerebrovascular Events include death, stroke, acute myocardial infarction, bleeding, symptomatic pulmonary embolism, and cardiovascular hospitalization. The definition of MACE usually varies from study to study.

4. In the Outcome session, the authors chose MACE as they defined previously, but they included all causes of hospitalization instead of cardiovascular hospitalization. Please clarify.

5. The authors defined Major Adverse Cerebrovascular Events as including death, stroke, acute myocardial infarction, bleeding, symptomatic pulmonary embolism and cardiovascular hospitalization. I would suggest a detailed description of each component of MACE that make it possible to classify the events.

6. It should be interesting to see the results of the comparison if we include the three most classical MACE events: 1) any type of stroke, including non-fatal primary intracranial hemorrhage; acute myocardial infarction; or death from any cause, including fatal bleeding. In this way the MACE events still will give us an idea of efficacy and safety. It is possible that the higher MACE rates found in the present study compared to other studies are due to a broader definition regarding MACE outcomes.

7. This analysis, including many types of MACE, might have increased the number of factors not related to atherosclerosis that could explain the outcomes considering what was included; for example, all causes of hospitalization.

8. Regarding the MACE events the authors included all-cause of bleeding. Which exact type(s) of bleeding was identified? It would be interesting to specify different types of bleeding separately as part of the safety profile. For instance, the authors only reported rates of intracerebral hemorrhage in table 2. The authors included all causes of bleeding as major cardiovascular events.

9. Is “recurrent stroke” the same as “recurrent ischemic stroke?” Please specify. The same for death; was it all causes of death or only cardiovascular death? Please specify.

10. There is missing report of adverse events regarding aspirin and clopidogrel groups.

11. In a subgroup analysis of the CAPRIE study, the diabetic population benefits more from clopidogrel compared with non-diabetic (Relative Risk Reduction of 13.1% in favour of clopidogrel versus 8.7% overall). However, the authors proposed that the higher proportion of patients with diabetes in the study might explain the findings.

It is also worth to address that there is evidence against this explanation (see above) and clopidogrel showed even more benefit compared to aspirin in higher risk population as per hypercholesterolemia, diabetes, previous coronary bypass surgery, history of more than 1 ischemic event and multiple vascular beds involvement in CAPRIE study. It is possible that higher prevalence of diabetes in the present study is not what has driven the results in favor to aspirin as raised in the discussion.

12. What was the average period of time that patients were on medication in each group?

13. One limitation is that if patients used aspirin or clopidogrel for less than one year and the MACE was calculated within one year, then it is likely that the patient was not under drug protection/effect anymore at the time that some MACE occurred.

Additional suggestions:

1. Line 95 : “ In this study, we aimed to compare the efficacy of clopidogrel with aspirin with MACE included to assess safety between groups based on real-world evidence form the…”. Did the authors mean “In this study, we aimed to evaluate the efficacy of clopidogrel compared to aspirin with MACE included to assess safety between groups based on real-world evidence...” ?

2. Table 1. Hospitalization days – median (interquartile range). There is no range demonstrated. Please clarify variable used

3. “HPR of clopidogrel could also be associated with increased risk of MACE.” Clarify this sentence. Did the authors mean HPR on clopidogrel treatment…

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2019 Aug 29;14(8):e0221750. doi: 10.1371/journal.pone.0221750.r002

Author response to Decision Letter 0


31 Jul 2019

We thank the reviewers for the valuable critiques and comments. These really improve very much the quality of this manuscript. We have made a major revision on this manuscript according to the requests of reviewers. In the mean time, we add one co-author because of her contribution to this revision process. Below is our point-to-point responses.

Response to Reviewer #1

1. The authors aimed to demonstrate that aspirin might have better efficacy than clopidogrel in secondary stroke prevention; however, the previous data does not support this conclusion. The findings are not consensus with the previous mentioned study of Lee et al, where the data derived from the same database. Specifically, the authors may wish to comment on how and why the findings are inconsistent with the previous mentioned study.

Response 1: Although derived from a same database, the study conducted by Lee et al (2014) included patients with different inclusion criteria based on the aim of their study. The aim of their study was to compare clopidogrel initiation vs aspirin re-initiation for vascular risk reduction among patients with ischemic stroke on aspirin at the time of their index stroke (index stroke was defined as the first ischemic stroke during the study period from 2003-2009). Only patients with ischemic stroke who received continuous aspirin treatment >30 days before the index stroke were included in their study cohort. In other words, they included ischemic stroke patients with aspirin-failure treatment, in terms of aspirin-resistant patients. For that reason, the MACE rate in that study was higher in aspirin group than clopidogrel, make it different with our study finding.

Nevertheless, we thank reviewer for the comments for this issue. We realize that the statement written in our manuscript was not fully corrected. Hence, we revise the statement about this issue in the discussion part (line 225):

“The study of Lee et al (2014) also reported higher rates of MACE, it was 23.7% for clopidogrel and 38% for aspirin. Although this study also used the same database of Taiwan NHID, the inclusion criteria was totally different as the objective was to compare clopidogrel initiation vs aspirin re-initiation for vascular risk reduction among patients with ischemic stroke and aspirin resistance. Hence, the result of this study favored clopidogrel than aspirin re-initiation for reducing the MACE rates.”

2. Moreover, the authors should identify more related literature that clarifies and justifies their findings and the controversies over the secondary antiplatelet treatment in stroke patients. Especially, a very recently published meta-analysis of Greving et al (2019) concluded that clopidogrel and aspirin/dipyridamole combination seemed to be the most appropriate choices with a favorable balance between efficacy and safety. Another previous review of the Cochrane Stroke Group trials registers and the Antithrombotic Trialists' database concluded that the thienopyridine derivatives (ticlopidine and clopidogrel) are modestly but significantly more effective than aspirin in preventing serious vascular events in patients at high risk (and specifically in TIA/ischemic stroke patients) (Hankey et al 2000).

Response 2: We thank the reviewer for the suggestions. We have revised the literature review to justify our wording. Here it is the revised statements:

“Aspirin is the most frequently recommended antiplatelet agent for secondary stroke prevention after ischemic stroke. However, a recent meta-analysis of 6 randomized trials (CAPRIE, ESPS-2, MATCH, CHARISMA, ESPRIT, and PRoFESS) conducted to compare the efficacy and safety of different antiplatelet agent for long-term secondary prevention after non-cardioembolic stroke or TIA demonstrated that clopidogrel and combination of aspirin-dipyridamole have a favorable efficacy and safety than the other antiplatelet agents (aspirin alone or a combination of aspirin-clopidogrel) (1). Moreover, previous systematic review assessing the effectiveness and safety of thienopyridine derivatives (clopidogrel and ticlopidine) versus aspirin concluded that clopidogrel and ticlopidine were modestly more effective than aspirin for preventing serious vascular events in patients at high risk (2). Although the two studies show that clopidogrel has favorable efficacy than aspirin, most of the study population involved are from Caucasian ethnicity. Study that compares the efficacy of aspirin and clopidogrel in preventing major adverse cardiovascular events (MACE) after ischemic stroke in Asian population is very limited.”

3. Additionally, the authors referred that the CAPRIE study failed to show a better efficacy of clopidogrel compared to aspirin; However, the CAPRIE trial was not designed to determine whether clopidogrel was superior or equivalent to aspirin among stroke patients.

Response 3: Yes, we agree with that. We realize that CAPRIE was designed to assess relative efficacy of clopidogrel and aspirin in reducing MACE risk among patients not only with ischemic stroke, but also with AMI, or symptomatic PAD. Therefore, we have revised that statement as below:

“Previous clinical trial, CAPRIE, is the only trial which directly comparing the efficacy of aspirin and clopidogrel in patients at risk of ischemic events. The trial reported that long term administration of clopidogrel had better efficacy than aspirin for reducing a composite vascular events of ischemic stroke, acute myocardial infarction (AMI), or vascular death among all groups of patients with atherosclerotic vascular diseases. However, clopidogrel was not more effective than aspirin among the subgroup of stroke patients (3). Therefore, the comparison of efficacy between these two antiplatelets for secondary stroke prevention remains open for discussion.”

4. The authors mentioned that diabetic patients have higher rates of high on treatment platelet reactivity (HTPR) on clopidogrel and that could be associated with increased risk of MACE. The authors should include more information about the non-responsiveness of antiplatelets in stroke patients with diabetes mellitus. There are many scientific reports indicating higher rates of non-responsiveness to both antiplatelets (aspirin and clopidogrel) in diabetic patients and higher rates of recurrent strokes. In addition, as the authors referred to genes associated with HTPR on clopidogrel, a recent popular view is the potential relation of genetic factors with the prevalence of HTPR in both antiplatelets. There are many studies in the literature on that subject. It is also noteworthy, the black box warning from the US Food and Drug Administration that recommends patients to be tested for the possibility of reduced efficacy of clopidogrel in individuals carrying the CYP2C19*2 loss-of-function allele.

Response 4: Yes, we totally agree for that. Diabetic patients could have non-responsiveness to antiplatelets, either aspirin or clopidogrel. However, a recent meta-analysis study in 2017 reported that the prevalence of high on-treatment platelet reactivity (HTPR) in patients with ischemic stroke or TIA on aspirin was 23% (95%CI: 20-28%) and on clopidogrel was 27% (95%CI: 22-32%) (4). It shows that aspirin might be a little more effective than clopidogrel. Nevertheless, we realize our statement about the higher percentage of diabetic patients in our study subjects as one of the reasons why aspirin has higher efficacy than clopidogrel might not be appropriate. Therefore, we have omitted this statement and revised it by giving more information about the non-responsiveness or resistance of antiplatelet in ischemic stroke patients in general, also added the literature about HTPR on aspirin and clopidogrel as mentioned above.

Another reason is, carriers of the CYP2C19 loss-of-function allele account for 59% in the Asians especially Chinese population (compared to around 30% in the Caucasians). This genetic polymorphism has been associated with reduced efficacy of clopidogrel (5). Unfortunately, study about the genetic polymorphism of aspirin in Asian population compared with Caucasians are not well documented. Therefore, the possibility of genetic polymorphism of CYP2C19 in our study subject might also be considered as one of the reasons why in our finding aspirin has more favorable effect in reducing MACE risk than clopidogrel.

Here is the revised version (from line 197):

“The reasons why aspirin could have higher efficacy than clopidogrel in the present study could be multi-factorial. First, there is a possibility for clopidogrel resistance in our study subject. Antiplatelet resistance in ischemic stroke patients has emerged as a focus of interest in recent years (6). Both clopidogrel and aspirin could have a resistance or non-responsiveness causing treatment failure in ischemic stroke patients (6, 7). Aspirin resistance could be related to genetic polymorphisms of COX-1, COX-2 or thromboxane A2 synthase, while clopidogrel resistance could be due to polymorphisms of receptor P2Y12, enzymes CYP3A4, CYP1A2, CYP2C19, or ABCB1 (6). There has been no prior study to compare the genetic polymorphisms of aspirin in Asian and Caucasian population. However, the genetic polymorphisms of clopidogrel in Asian, particularly in Chinese population, is reported to be higher than Caucasian. Carriers of the CYP2C19 loss-of-function allele account for 50% to 60% of Chinese population, while they account for 15% to 30% of Caucasian (5, 8-10). Carriers of this allele will have poor metabolic rate of clopidogrel. This might confer higher risk of clopidogrel resistance in our study subject. A recent meta-analysis study reported that the prevalence of high on-treatment platelet reactivity (HTPR), which is associated with the efficacy of antiplatelet therapy in patients with ischemic stroke or TIA, on aspirin was 23% (95% CI: 20-28%) and on clopidogrel was 27% (95% CI: 22-32%) (4). It shows that aspirin might be a little more effective than clopidogrel for antiplatelet therapy in secondary stroke prevention.”

“Furthermore, in addition to its antiplatelet properties, aspirin also exhibits pharmacological benefit in reducing vascular injury by its antioxidant effect via inhibition of lipid peroxidation and DNA damage to reduce the generation of *OH free radicals (11). Aspirin also has anti-inflammatory effects by inhibiting cyclooxygenase to lessen the progression of vascular injury in patients with cardiovascular and cerebrovascular diseases (12).”

5. While the study appears to be sound, the language is unclear at some points, making it difficult to follow. There are some minor elements of grammar that would improve the article’s presentation. In the abstract, on page 2, line 38 “in 2000-2012”, the word “between” may work better. In the same page, line 46 “inclusion/exclusion criteria”, the sentence “patients on aspirin or clopidogrel who met the inclusion criteria” may work more effectively. On page 4, line 88 the authors should include references of trials comparing the efficacy of aspirin with clopidogrel. On page 5, line 133 referring to the primary outcome including all cause of hospitalization, the authors may wish to consider stating what cause of hospitalization they meant. On Table 1, there is a missing abbreviation for the CVA. At many points in the article, MACE refers to both cardiovascular and cerebrovascular disease. Lastly, the authors should revise the language in the section of “Conclusions” at page 13 to improve readability.

Response 5:

Thank you for your valuable correction. We have revised the language as you suggest.

Line 38 “in 2000-2012” changed into “between 2000 and 2012”

Line 46 “patients on aspirin or clopidogrel who met the inclusion/exclusion criteria” changed into “patients on aspirin or clopidogrel who met the inclusion criteria”

Line 88: We omitted the statement from line 84 to 88 since we have made revision about the newest literature about antiplatelet comparison in secondary stroke prevention (a recent meta-analysis study).

Line 133: We apologize for the mistake we made here. The definition of MACE that we used in the analysis was only a composite outcome of recurrent stroke, AMI, and all cause of death. Other than that, we did not use it.

On Table 1, we have already added the abbreviation for CVA in the revised manuscript.

It was our mistake to type an abbreviation for MACE as “major adverse cerebrovascular events” (page 4 line 84). It was a typo and supposed to be “major adverse cardiovascular events”. Thank you for your correction about this terminology.

Conclusion has been revised into: “Compared with clopidogrel, aspirin was associated with a reduced risk of MACE at one-year follow up among ischemic stroke patients. This real-world evidence from Taiwan NHIRD raises the need to re-assess the current therapeutic options related to antiplatelet agents used in secondary stroke prevention.”

Response to Reviewer #2

1. How was ischemic stroke defined to qualify as an event in the retrospective cohort?

Response 1: We used the classification of ischemic stroke according to the code of diagnosis from ICD-9-CM (The International Classification of Diseases, Ninth Revision, Clinical Modification). Those with the code of ICD-9-CM 433-438 were classified as ischemic stroke. This code is the official system of assigning codes to diagnoses and procedures associated with hospital utilization.

2. Regarding the inclusion criteria, specify the generic name of the substance (e.g., say “combination of Aspirin and Dipyridamole” instead of “Aggrenox”, “Cilostazol” instead of “Pletaal”). It is better to be consistent, as the other drugs were described using generic names.

Response 2: Thank you for your valuable suggestions. We have revised the generic name of the drugs. Here is the revised version:

“….; treatment with a combination of aspirin and dipyridamole, cilostazol,…..”

3. In the lines 83 and 84 of introduction the authors state that Major Adverse Cerebrovascular Events include death, stroke, acute myocardial infarction, bleeding, symptomatic pulmonary embolism, and cardiovascular hospitalization. The definition of MACE usually varies from study to study.

Response 3: We apologize for the mistake we made. The terminology of MACE in line 83 is supposed to be Major Adverse Cardiovascular Events, not Cerebrovascular. It was a mistake. In addition to that, we have re-checked our definition of MACE and the data we have. The definition of MACE in our study only consists of recurrent stroke, AMI, and all cause of death (including major bleeding). We did not include those with symptomatic pulmonary embolism. Cardiovascular hospitalization was only limited to those with AMI. Hence, we have revised the statement regarding the definition of MACE into (line 83): “Major adverse cardiovascular events (MACE) is a composite outcome of all cause of death, any type of recurrent stroke, and AMI”

4. In the Outcome session, the authors chose MACE as they defined previously, but they included all causes of hospitalization instead of cardiovascular hospitalization. Please clarify.

Response 4: We thank the reviewer for reminding this. As we answered the critiques of reviewer 1 that it was our mistake about our previous definition of MACE. Here is the revised version:

“The primary outcome was MACE including recurrent stroke, acute myocardial infarction (AMI), and all cause of death which occurred within one year after stroke admission”

5. The authors defined Major Adverse Cerebrovascular Events as including death, stroke, acute myocardial infarction, bleeding, symptomatic pulmonary embolism and cardiovascular hospitalization. I would suggest a detailed description of each component of MACE that make it possible to classify the events.

Response 5: Death here refers to all cause of death since we are not able to identify the real causes of death for every one patient. Recurrent stroke refers to any types of recurrent stroke (ischemic and/or hemorrhagic).

6. It should be interesting to see the results of the comparison if we include the three most classical MACE events: 1) any type of stroke, including non-fatal primary intracranial hemorrhage; acute myocardial infarction; or death from any cause, including fatal bleeding. In this way the MACE events still will give us an idea of efficacy and safety. It is possible that the higher MACE rates found in the present study compared to other studies are due to a broader definition regarding MACE outcomes.

Response 6: Thank you for your suggestions. This is a great idea. Actually, the data we presented in the original manuscript already included these three efficacy-related MACE. We apologize for leading you to misinterprete due to our mistake in the MACE definition. We have revised the definition of MACE and added the sub-analysis of each three components of MACE as below. Regarding the safety-related outcomes, we also have listed both the risks of intracranial hemorrhage and gastrointestinal bleeding but we do not have the data of fatal bleeding.

Table 2. Major adverse cardiovascular events, intracerebral haemorrhage, and GI bleeding before and after PS matching.

Before PS Matching After PS Matching

Aspirin

(N = 651) Clopidogrel

(N = 465) HRa (95% CI) p value Aspirin

(N = 379) Clopidogrel

(N = 379) HRb (95% CI) p value

Major adverse cardiovascular events within 12 months after stroke onset 178 (27.3) 213 (45.8) 2.05 (1.68-2.50) <0.001 115 (30.3) 172 (45.4) 1.78 (1.41-2.26) <0.001

Recurrent stroke (any type) 117 (18.0) 132 (28.4) 1.69 (1.32-2.17) <0.0001 77 (20.3) 104 (27.4) 1.43 (1.06-1.92) 0.02

AMI 5 (0.77) 12 (2.58) 3.41 (1.21-9.68) 0.02 3 (0.79) 11 (2.90) 3.72 (1.04-13.3) 0.04

Death (all cause of death) 8 (1.23) 9 (1.94) 1.59 (0.61-4.12) 0.34 3 (0.79) 7 (1.85) 2.53 (0.61-9.09) 0.22

Intracerebral hemorrhage 18 (2.76) 17 (3.66) 1.33 (0.69-2.58) 0.40 8 (2.11) 15 (3.96) 1.89 (0.79-4.51) 0.15

GI bleeding 71 (10.9) 115 (24.7) 2.52 (1.88-3.39) <0.001 44 (11.6) 102 (26.9) 2.60 (2.82-3.70) <0.001

PS, propensity score; HR, hazard ratio; CI, confidence interval; GI, gastrointestinal.

aUnadjusted HR, bAdjusted for matched pairs.

7. This analysis, including many types of MACE, might have increased the number of factors not related to atherosclerosis that could explain the outcomes considering what was included; for example, all causes of hospitalization.

Response 7: We agree with the reviewer’s opinion, even after analyzing the outcome of MACE into sub-analysis of recurrent stroke, AMI, and all cause of death, the rates are still higher than previous clinical trials. These differences might reflect the gaps between the real-world practice and clinical trials.

8. Regarding the MACE events the authors included all-cause of bleeding. Which exact type(s) of bleeding was identified? It would be interesting to specify different types of bleeding separately as part of the safety profile. For instance, the authors only reported rates of intracerebral hemorrhage in table 2. The authors included all causes of bleeding as major cardiovascular events.

Response 8: We have revised table 2 with the additional safety profile consists of the rates of ICH and GI bleeding as shown above. Unexpectedly, the rates of GI bleeding for clopidogrel was higher than aspirin. It shows contradictory with previous studies. Again, this might reflect the gaps between the real-world practice and clinical trials. Yet, we could not address the reasons behind this. We also have listed this point in our discussion.

9. Is “recurrent stroke” the same as “recurrent ischemic stroke?” Please specify. The same for death; was it all causes of death or only cardiovascular death? Please specify.

Response 9: Recurrent stroke is defined as any type of recurrent stroke (ischemic and/or hemorrhagic). The death means all cause of death. We have clarified these definitions in the revised version.

10. There is missing report of adverse events regarding aspirin and clopidogrel groups.

Response 10: Yes, we agree with that. Unfortunately, we cannot find any adverse events from the database. Therefore, we have listed this issue as one of the limitations in our study.

11. In a subgroup analysis of the CAPRIE study, the diabetic population benefits more from clopidogrel compared with non-diabetic (Relative Risk Reduction of 13.1% in favour of clopidogrel versus 8.7% overall). However, the authors proposed that the higher proportion of patients with diabetes in the study might explain the findings.

It is also worth to address that there is evidence against this explanation (see above) and clopidogrel showed even more benefit compared to aspirin in higher risk population as per hypercholesterolemia, diabetes, previous coronary bypass surgery, history of more than 1 ischemic event and multiple vascular beds involvement in CAPRIE study. It is possible that higher prevalence of diabetes in the present study is not what has driven the results in favor to aspirin as raised in the discussion.

Response 11: We thank the reviewer for this valuable comment. It improves the quality of this study very much. We totally agree with that and we are sorry for the misleading. . Therefore, we have revised the discussion part related to this issue.

Here is the revised version (from line 197):

“The reasons why aspirin could have higher efficacy than clopidogrel in the present study could be multi-factorial. First, there is a possibility for clopidogrel resistance in our study subject. Anti-platelet resistance in ischemic stroke patients has emerged as a focus of interest in recent years (1). Both clopidogrel and aspirin could have a resistance or non-responsiveness causing treatment failure in ischemic stroke patients (1, 2). Aspirin resistance could be related to genetic polymorphisms of COX-1, COX-2 or thromboxane A2 synthase, while clopidogrel resistance could be due to polymorphisms of receptor P2Y12, enzymes CYP3A4, CYP1A2, CYP2C19, or ABCB1 (1). There has been no prior study to compare the genetic polymorphisms of aspirin in Asian and Caucasian population. However, the genetic polymorphisms of clopidogrel in Asian, particularly in Chinese population, is reported to be higher than Caucasian. Carriers of the CYP2C19 loss-of-function allele account for 50% to 60% of Chinese population, while they account for 15% to 30% of Caucasian (3-6). Carriers of this allele will have poor metabolic rate of clopidogrel. This might confer higher risk of clopidogrel resistance in our study subject. A recent meta-analysis study reported that the prevalence of high on-treatment platelet reactivity (HTPR), which is associated with the efficacy of antiplatelet therapy in patients with ischemic stroke or TIA, on aspirin was 23% (95%CI: 20-28%) and on clopidogrel was 27% (95%CI: 22-32%) (7). It shows that aspirin might be a little more effective than clopidogrel for antiplatelet therapy in secondary stroke prevention.”

“Furthermore, in addition to its antiplatelet properties, aspirin also exhibits pharmacological benefit in reducing vascular injury by its antioxidant effect via inhibition of lipid peroxidation and DNA damage to reduce the generation of *OH free radicals (8). Aspirin also has anti-inflammatory effects by inhibiting cyclooxygenase to lessen the progression of vascular injury in patients with cardiovascular and cerebrovascular diseases (9).”

12. What was the average period of time that patients were on medication in each group?

Response 12: The following are the number of average period of time of drug used from the time of discharge up to one year.

Mean SD median Q1, Q3

Aspirin 298 69.8 320 238, 358

Clopidogrel 314.8 65.4 340 276, 362

13. One limitation is that if patients used aspirin or clopidogrel for less than one year and the MACE was calculated within one year, then it is likely that the patient was not under drug protection/effect anymore at the time that some MACE occurred.

Response 13: Again, we thank the reviewer for this comment. As the table mentioned above, the anti-platelet treatment covered almost but not all the whole period of MACE analysis, in terms of the whole year. We have listed this critical point into our limitations. Nevertheless, even though the average duration of aspirin use was shorter than that of clopidogrel, the MACE risk in aspirin group was lower than in clopidogrel group. It could enhance the finding that aspirin had better efficacy than clopidogrel.

Additional suggestions:

1. Line 95 : “ In this study, we aimed to compare the efficacy of clopidogrel with aspirin with MACE included to assess safety between groups based on real-world evidence form the…”. Did the authors mean “In this study, we aimed to evaluate the efficacy of clopidogrel compared to aspirin with MACE included to assess safety between groups based on real-world evidence...” ?

Response: Yes, that was what we meant. Thank you for your correction. Here is the revised version:

“In this study, we aimed to evaluate the efficacy of clopidogrel compared to aspirin by calculating the MACE risk between the two groups based on real-world evidence from the National Health Insurance Research Database (NHIRD) in Taiwan.”

2. Table 1. Hospitalization days – median (interquartile range). There is no range demonstrated. Please clarify variable used

Response: Interquartile range (IQR) is calculated by the formula= Q3-Q1; Hence there would be no range needed.

3. “HPR of clopidogrel could also be associated with increased risk of MACE.” Clarify this sentence. Did the authors mean HPR on clopidogrel treatment…

Response: Yes, we meant HPR on clopidogrel treatment. Nevertheless, this statement is no longer available because we have revised the discussion part as we mentioned above (response 11). Thank you for your correction.

Reference:

1. Greving JP, Diener HC, Reitsma JB, Bath PM, Csiba L, Hacke W, et al. Antiplatelet Therapy After Noncardioembolic Stroke. Stroke. 2019;50(7):1812-8.

2. Sudlow CL, Mason G, Maurice JB, Wedderburn CJ, Hankey GJ. Thienopyridine derivatives versus aspirin for preventing stroke and other serious vascular events in high vascular risk patients. Cochrane Database Syst Rev. 2009(4):Cd001246.

3. CAPRIE Steering Committee. A randomised, blinded, trial of clopidogrel versus aspirin in patients at risk of ischaemic events (CAPRIE). The Lancet. 1996;348(9038):1329-39.

4. Fiolaki A, Katsanos AH, Kyritsis AP, Papadaki S, Kosmidou M, Moschonas IC, et al. High on treatment platelet reactivity to aspirin and clopidogrel in ischemic stroke: a systematic review and meta-analysis. Journal of the neurological sciences. 2017;376:112-6.

5. Pan Y, Chen W, Xu Y, Yi X, Han Y, Yang Q, et al. Genetic polymorphisms and clopidogrel efficacy for acute ischemic stroke or transient ischemic attack: a systematic review and meta-analysis. Circulation. 2017;135(1):21-33.

6. Topçuoglu MA, Arsava EM, Ay H. Antiplatelet resistance in stroke. Expert review of neurotherapeutics. 2011;11(2):251-63.

7. Mijajlovic M, Shulga O, Bloch S, Covickovic‐Sternic N, Aleksic V, Bornstein N. Clinical consequences of aspirin and clopidogrel resistance: an overview. Acta Neurologica Scandinavica. 2013;128(4):213-9.

8. Desta Z, Zhao X, Shin J-G, Flockhart DA. Clinical significance of the cytochrome P450 2C19 genetic polymorphism. Clinical pharmacokinetics. 2002;41(12):913-58.

9. Mega JL, Close SL, Wiviott SD, Shen L, Hockett RD, Brandt JT, et al. Cytochrome p-450 polymorphisms and response to clopidogrel. New England Journal of Medicine. 2009;360(4):354-62.

10. Wang Y, Zhao X, Lin J, Li H, Johnston SC, Lin Y, et al. Association between CYP2C19 loss-of-function allele status and efficacy of clopidogrel for risk reduction among patients with minor stroke or transient ischemic attack. Jama. 2016;316(1):70-8.

11. Shi X, Ding M, Dong Z, Chen F, Ye J, Wang S, et al. Antioxidant properties of aspirin: characterization of the ability of aspirin to inhibit silica-induced lipid peroxidation, DNA damage, NF-κB activation, and TNF-α production. Molecular and cellular biochemistry. 1999;199(1-2):93-102.

12. Association AD. Cardiovascular disease and risk management: standards of medical care in diabetes—2018. Diabetes care. 2018;41(Supplement 1):S86-S104.

Attachment

Submitted filename: Response to Reviewers .docx

Decision Letter 1

Aristeidis H Katsanos

15 Aug 2019

Aspirin better than clopidogrel on major adverse cardiovascular events reduction after ischemic stroke: a retrospective nationwide cohort study

PONE-D-19-17386R1

Dear Dr. Hu,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Aristeidis H. Katsanos, MD, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Acceptance letter

Aristeidis H Katsanos

20 Aug 2019

PONE-D-19-17386R1

Aspirin better than clopidogrel on major adverse cardiovascular events reduction after ischemic stroke: a retrospective nationwide cohort study

Dear Dr. Hu:

I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

For any other questions or concerns, please email plosone@plos.org.

Thank you for submitting your work to PLOS ONE.

With kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Aristeidis H. Katsanos

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: Response to Reviewers .docx

    Data Availability Statement

    All relevant data are within the manuscript.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES