Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Mar 4;16(3):e0247358. doi: 10.1371/journal.pone.0247358

Incidence and risk factors for major bleeding among patients undergoing percutaneous coronary intervention: Findings from the Norwegian Coronary Stent Trial (NORSTENT)

Per-Jostein Samuelsen 1,2,*, Anne Elise Eggen 2, Terje Steigen 3,4, Tom Wilsgaard 2, Andreas Kristensen 3, Anne Skogsholm 3, Elizabeth Holme 3, Christian van den Heuvel 3, Jan Erik Nordrehaug 5, Bjørn Bendz 6,7, Dennis W T Nilsen 5,8, Kaare Harald Bønaa 9,10
Editor: Salvatore De Rosa11
PMCID: PMC7932162  PMID: 33661918

Abstract

Introduction

Bleeding is a concern after percutaneous coronary intervention (PCI) and subsequent dual antiplatelet therapy (DAPT). We herein report the incidence and risk factors for major bleeding in the Norwegian Coronary Stent Trial (NORSTENT).

Materials and methods

NORSTENT was a randomized, double blind, pragmatic trial among patients with acute coronary syndrome or stable coronary disease undergoing PCI during 2008–11. The patients (N = 9,013) were randomized to receive either a drug-eluting stent or a bare-metal stent, and were treated with at least nine months of DAPT. The patients were followed for a median of five years, with Bleeding Academic Research Consortium (BARC) 3–5 major bleeding as one of the safety endpoints. We estimated cumulative incidence of major bleeding by a competing risks model and risk factors through cause-specific Cox models.

Results

The 12-month cumulative incidence of major bleeding was 2.3%. Independent risk factors for major bleeding were chronic kidney disease, low bodyweight (< 60 kilograms), diabetes mellitus, and advanced age (> 80 years). A myocardial infarction (MI) or PCI during follow-up increased the risk of major bleeding (HR = 1.67, 95% CI 1-29-2.15).

Conclusions

The 12-month cumulative incidence of major bleeding in NORSTENT was higher than reported in previous, explanatory trials. This analysis strengthens the role of chronic kidney disease, advanced age, and low bodyweight as risk factors for major bleeding among patients receiving DAPT after PCI. The presence of diabetes mellitus or recurrent MI among patients is furthermore a signal of increased bleeding risk.

Clinical trial registration

Unique identifier NCT00811772; http://www.clinicaltrial.gov.

1 Introduction

Dual antiplatelet therapy (DAPT) is mandatory after percutaneous coronary intervention (PCI) with stent implantation in order to prevent ischemic events [1]. The optimal duration of DAPT, however, is debated [2]. The risk of ischemic events must be balanced against the risk of major bleeding imposed by the antithrombotic therapy. For this purpose, several risk prediction tools based on randomized controlled trials (RCTs) [3,4] or observational studies [5], have been developed. Of note, recent European guidelines [1] and other guidelines worldwide [68] recommend or suggest the use of standardized risk scores, e.g., the DAPT and PRECISE-DAPT scores, to optimize the duration of DAPT. However, the validity and clinical utility of such scores have been questioned [9]. Obviously, an assessment of ischemic and bleeding risk relies on valid data. In brief, observational studies, and in particular registry-based studies, often have a high external validity but have methodological challenges, such as the lack of validated endpoints, and confounding. On the other hand, explanatory RCTs often have highly selected study populations that do not necessarily represent the clinical populations in question. Pragmatic RCTs, however, have less strict inclusion and exclusion criteria and produce study populations that more closely resemble clinical practice, still offering the advantage of increased validity through adjudicated clinical endpoints.

The aims of the current analysis were: 1) to estimate the incidence of major bleeding and to identify subgroups with increased bleeding risks among stent naïve patients undergoing PCI with stent implantation and DAPT, 2) to identify risk factors for major bleeding, including risks associated with a new or recurrent MI or PCI during follow-up. This was achieved using data from the Norwegian Coronary Stent Trial (NORSTENT) [10].

2 Materials and methods

2.1 Study population

NORSTENT was a randomized, controlled, open-label, multicenter, pragmatic trial [10]. Eligible participants were stent naïve patients ≥ 18 years with acute coronary syndrome (i.e., MI or unstable angina pectoris) or stable coronary artery disease who were candidates for percutaneous coronary intervention (PCI) with stent implantation. Patients with contraindications towards DAPT, or patients on oral anticoagulants were excluded. Patients were recruited between 2008 and 2011, with a maximum follow-up until December 31, 2014.

The participants were randomized to receive either drug-eluting stent(s) (DES) or bare-metal stent(s) (BMS). Patients were prescribed DAPT with acetylsalicylic acid (ASA) 75 mg daily indefinitely and clopidogrel 75 mg daily for at least nine months after the PCI, regardless of the stent type. Other cardiovascular drugs, e.g., statins, were given according to contemporary clinical guidelines and practice.

2.2 Endpoint

The endpoint was major bleeding, defined as a Bleeding Academic Research Criteria (BARC) bleeding of 3, 4, or 5 [11]. This endpoint included overt bleeding plus hemoglobin drop of 3 to < 5 g/dL, overt bleeding plus hemoglobin drop ≥ 5 g/dL, cardiac tamponade, bleeding requiring surgical intervention, or intravenous vasoactive agents, intracranial or intraocular bleeding, major bleeding related to coronary artery by-pass surgery, or fatal bleeding. Endpoints were collected by means of electronic linkage to the Norwegian Patient Registry with the use of a unique 11-digit Norwegian national identification number for each patient. The patient registry includes the codes of The International Classification of Diseases, 10th Revision (ICD-10), with respect to all the main diagnoses and up to 20 secondary diagnoses and all procedure codes from all hospitalizations in Norway. A broad search was made to identify any hospitalization for cardiovascular disease and any hospitalization for suspected bleeding. The specific search criteria have been published [10]. All outcomes were adjudicated by an endpoint committee based on information in hospital records.

2.3 Statistical analysis

We treated the entire study population as a single cohort, i.e., both study arms were merged.

2.3.1 Definition of variables

Chronic kidney disease was defined as an eGFR < 60 ml/min/1.73 m2 (CKD-EPI, assuming an all-Caucasian study population). Low bodyweight was defined as body weight < 60 kilograms, or underweight as a body mass index < 18.5 kg/m2 in sensitivity analyses. Hypertension, hyperlipidemia, or diabetes mellitus were defined to be present if the patient received pharmacological treatment for any of these conditions. HbA1C was also measured in a subgroup of n = 5,267, and diabetes mellitus defined as HbA1C ≥ 6.5% was also used in sensitivity analyses. Acute coronary syndrome (ACS) was defined as non-ST-elevation MI, ST-elevation MI, or unstable angina pectoris. The stent length refers to the total stent length per patient, i.e., a patient could receive several stents in one or multiple lesions.

2.3.2 Multiple imputation

Among all variables considered (Table 1), the combined proportion of missing observations was 17% with a possible missing at random pattern [12,13]. We therefore used multiple imputation with substantive model compatible fully conditional specification [14]. We recoded or transformed the variables before the imputation [12,13], e.g., chronic kidney disease, and included all variables in our imputation model, and ran 20 imputations. All regressions were thus performed on the imputed datasets (N = 9,013). However, the available case analyses did not differ substantially. Descriptive statistics are based on the original data.

Table 1. Descriptive statistics of patients at baseline.

Original data, i.e., available case analysis.

Variable n (%)
Age < 60 3,438 (38.1)
60–79 5,044 (56.0)
80+ 531 (5.9)
Sex Male 6,757 (75.0)
Low bodyweight (< 60 kg) - 381 (4.3)
Missing 172
Chronic kidney disease - 790 (9.2)
Missing 423
Diabetes mellitus - 1,123 (12.5)
Missing 25
Hypertension - 3,791 (42.4)
Missing 67
Hyperlipidemia - 4,868 (54.8)
Missing 135
Current, daily smoking - 3,147 (38.1)
Missing 758
Prior CABG - 593 (6.6)
Prior stroke - 346 (3.8)
Missing 14
Prior MI - 912 (10.2)
Missing 45
Current ACS - 6,319 (70.2)
Missing 14
Multivessel disease - 3,574 (39.7)
Missing 5
Stent length < 20 mma 4,002 (44.4)
20–40 mm 3,311 (36.7)
≥ 40 mm 1,700 (18.9)
Stent diameter < 3 mma 2,945 (32.7)
3–4 mm 5,437 (60.3)
≥ 4 mm 630 (7.0)
Missing 1
Number of stents 1a 5,251 (58.3)
2 2,374 (26.3)
≥ 3 1,388 (15.4)

ACS: Acute coronary syndrome, CABG: Coronary artery bypass graft, CKD: Chronic kidney disease, MI: Myocardial infarction.

a 70 patients did not receive a stent after randomization and are included in this group.

2.3.3 Survival analysis

We used a competing risks model with all-cause death as the competing risk, i.e., as fatal bleeding is already included in BARC 5 [11], this refers to non-bleeding related deaths. The cumulative incidence of major bleeding was estimated by the non-parametric cumulative incidence function, and we report the cumulative incidence at 30 days, 9 months, 12 months, and at 6 years. We also report the incidence rate per 1,000 person-years.

The associations between the explanatory variables and major bleeding were analyzed by cause-specific, standard Cox proportional hazard (PH) regression. After inspection of scaled Schoenfield residuals and graphs in the original dataset and in four of the imputed datasets, we found strong evidence of violation of the PH assumption for acute coronary syndrome.

We used the modeling strategy and hierarchical backward elimination for interactions as outlined by Kleinbaum and Klein [15]. Variables for the regression model were included based on the literature, biological plausibility, availability and directed acyclic graphs (DAGs). Correlations and unadjusted and adjusted associations informed the DAG for the regression model (S1 Fig in S1 Appendix). The DAG was created using DAGitty 2.3 (www.dagitty.net) [16]. We estimated unadjusted and multivariable adjusted HRs for all included variables; there were no clear indications of multicollinearity. A priori (age x sex, weight x sex) and post hoc (CKD x diabetes mellitus) interaction terms were assessed by the Wald test.

We assessed the risk of major bleeding among patients suffering a myocardial infarction or undergoing a repeat revascularization during follow-up. A failure variable was created that combined spontaneous MI, periprocedural MI, target lesion PCI, or PCI of new lesion in target vessel or non-target vessel. The MI/PCI survival time was set to the minimum survival time of those endpoints, i.e., time to the first event. The major bleeding survival time was split in the case of a MI or PCI, and the resulting time varying indicator variable was included in Cox PH models.

All analyses were performed in Stata 15.1–16.1. A two-side p value <0.05 was considered statistically significant. We report 95% confidence intervals, unadjusted for multiple comparisons.

2.4 Ethics

NORSTENT (ClinicalTrials.gov: NCT00811772) has been approved by the Regional Committee for Medical and Health Research Ethics (Regional komité for medisinsk og helsefaglig forskningsetikk (REK) nord, 40/2008). Participants provided written informed consent. This substudy is a part of a larger research project, approved by the local Data Protection Officer at the University Hospital of North Norway.

3 Results

3.1 Baseline characteristics

Baseline characteristics are shown in Table 1. Of the study population, 4509 participants were randomized to BMS and 4504 participants to DES. The study population was predominantly male (75%) with an average age of 63 (± 11) years. The average weight was 83 (± 15) kilograms and average BMI 27 (± 4) kg/m2. Nine percent of patients had chronic kidney disease, defined solely based on eGFR. The prevalence of pharmacologically treated diabetes mellitus, hypertension, or hyperlipidemia were 12%, 42%, and 55%, respectively. Thirty-eight percent of the study population were current daily smokers. The indication for the index PCI procedure was ACS for 70%, stable coronary artery disease for 29%, and a few patients had ischemic heart failure or hemodynamic instability (0.5%). The majority (58%) had one stent implanted, while multivessel disease occurred among 40% of the patients at baseline.

3.2 Incidence of major bleeding

In the course of the 42,716 person-years (median time at risk: 4.9 years), 454 events of major bleeding occurred. The six-year cumulative incidence of major bleeding was 5.4% (Fig 1). Sixteen percent (n = 74) of the major bleeding cases occurred within the first 30 days after the index PCI (cumulative incidence at 30 days = 0.8%) (Fig 1); half of those cases occurred at the index date or the day after (n = 38). The 12-month cumulative incidence was 2.3% (n = 209).

Fig 1. Cumulative incidence of major bleeding as defined as Bleeding Academic Research Consortium 3–5 according to the non-parametric cumulative incidence function.

Fig 1

Vertical lines in the magnified portion highlight the cumulative incidence at 30 days, 9 months, and 12 months.

The incidence rate of major bleeding was 10.6 per 1,000 person-years overall and was highest during the first six-month-interval of follow-up, while being more stable after the first year (Fig 2). The absolute risks, i.e., crude incidence rates, of major bleeding are shown in Table 2 for selected patient sub groups. The highest absolute rates of major bleeding occurred among patients ≥ 80 years (27.2 per 1,000 person-years), among those with chronic kidney disease (25.6 per 1,000 person-years), and among patients with low bodyweight (23.7 per 1,000 person-years). The incidence rates of major bleeding among those randomized to BMS or DES were 10.7 per 1,000 person-years and 10.6 per 1,000 person-years, respectively.

Fig 2. Incidence rate per 1,000 person-years of major bleeding in consecutive 6-month intervals of the follow-up-period.

Fig 2

Table 2. Absolute risks of major bleeding in selected patient sub groups (crude incidence rate per 1,000 patient-years, available case analysis).

Variable Incidence rate (95% CI)
Overall 10.6 (9.7–11.7)
Age 80+ 27.2 (21.1–35.0)
Chronic kidney disease 25.6 (20.8–31.6)
Low bodyweight (< 60 kg) 23.7 (17.3–32.4)
Prior stroke 18.9 (13.2–27.0)
Diabetes mellitus 16.8 (13.6–20.7)
Prior CABG 16.1 (12.0–21.7)
Female sex 14.9 (12.8–17.5)
Stent length ≥ 40 mm 13.0 (10.7–15.7)
Number of stents ≥ 3 12.8 (10.3–15.9)
Multivessel disease 12.7 (11.1–14.5)
Hypertension 12.7 (11.1–14.5)
Stent diameter < 3 mm 12.0 (10.3–14.0)
Prior MI 11.9 (9.0–15.7)
Current ACS 10.6 (9.5–11.8)
Hyperlipidemia 10.4 (9.1–11.8)

ACS: Acute coronary syndrome, CABG: Coronary artery bypass graft, CKD: Chronic kidney disease, MI: Myocardial infarction.

3.3 Risk factors

3.3.1 Unadjusted associations

The associations of the explanatory variables with major bleeding are shown in Table 3. In unadjusted Cox PH models, chronic kidney disease, low bodyweight (i.e., < 60 kg), female sex, diabetes mellitus, hypertension, prior coronary artery bypass graft, prior stroke, and multivessel disease were statistically significant explanatory variables. Stent properties (total length, diameter, or quantity) were not clearly associated with increased bleeding risk. There were no statistically significant differences in bleeding risk among those randomized to BMS compared to DES for the patient subgroups included in this study (S2 Fig in S1 Appendix).

Table 3. Hazard ratios for major bleeding in unadjusted and mutually adjusted models.

The dataset has been imputed to N = 9,013 by multiple imputation.

Unadjusted Adjusteda
HR 95% CI HR 95% CI
CKD No CKD 1 Ref 1 Ref
CKD 2.65 (2.10–3.35) 1.77 (1.37–2.29)
Hypertension No hypertension 1 Ref 1 Ref
Hypertension 1.39 (1.16–1.67) 1.12 (0.92–1.38)
Diabetes mellitus No diabetes 1 Ref 1 Ref
Diabetes 1.69 (1.33–2.14) 1.56 (1.22–2.00)
CABG No prior CABG 1 Ref 1 Ref
Prior CABG 1.54 (1.12–2.11) 1.25 (0.87–1.79)
Stroke No prior stroke 1 Ref 1 Ref
Prior stroke 1.82 (1.26–2.63) 1.39 (0.95–2.02)
Weight ≥ 60 kg 1 Ref 1 Ref
< 60 kg 2.44 (1.76–3.38) 1.89 (1.32–2.69)
Age < 60 1 Ref 1 Ref
60–79 2.22 (1.76–2.79) 1.97 (1.54–2.52)
80+ 4.60 (3.33–6.35) 3.03 (2.09–4.38)
Sex Female 1 Ref 1 Ref
Male 0.62 (0.51–0.76) 0.82 (0.67–1.03)
Hyperlipidemia No hyperlipidemia 1 Ref 1 Ref
Hyperlipidemia 0.96 (0.80–1.16) 0.85 (0.69–1.06)
Prior MI No prior MI 1 Ref 1 Ref
Prior MI 1.14 (0.85–1.53) 0.88 (0.64–1.21)
Stent length < 20 mm 1 Ref 1 Ref
20–40 mm 0.95 (0.77–1.18) 1.08 (0.82–1.44)
≥ 40 mm 1.25 (0.99–1.59) 1.51 (0.95–2.40)
Stent diameter < 3 mm 1 Ref 1 Ref
3–4 mm 0.87 (0.71–1.04) 0.96 (0.78–1.18)
≥ 4 mm 0.70 (0.46–1.06) 0.90 (0.58–1.40)
Number of stents 1 1 Ref 1 Ref
2 0.99 (0.80–1.24) 0.84 (0.60–1.16)
≥ 3 1.24 (0.97–1.59) 0.79 (0.49–1.27)
Current ACS No ACS - - 1 Ref
ACS *
Multivessel disease No multivessel disease 1 Ref 1 Ref
Multivessel disease 1.34 (1.11–1.61) 1.08 (0.87–1.35)
Current, daily smoking No current smoking 1 Ref 1 Ref
  Current smoking 0.89 (0.74–1.09) 1.19 (0.95–1.47)

a Mutually adjusted for all listed variables as well as PCI hospital.

* Violation of PH assumption. Modeled as a time varying covariate in the complete case dataset, t0: HRt0 = 1.43 (95% CI 1.00–2.05), HRinteraction = 0.85 (95% CI 0.74–0.98), and as a regular variable in the imputation model. ACS: Acute coronary syndrome, CABG: Coronary artery bypass graft, CKD: Chronic kidney disease, MI: Myocardial infarction.

3.3.2 Multivariable adjusted associations

In the multivariable adjusted regression model (Table 3), CKD, diabetes mellitus, and low bodyweight were statistically significant risk factors. There was no statistically significant difference in the bleeding risk between men and women, although the point estimate suggested a reduced risk among men (HR = 0.82, 95% CI 0.67–1.03 among men). The bleeding risk increased with age, with three times increased risk among those aged 80 years or older compared to those below 60 years of age.

Having low bodyweight increased the risk of major bleeding by 89% (HR = 1.89, 95% CI 1.32–2.69). Underweight defined as BMI < 18.5 was statistically non-significant but with a similar point estimate (available case analysis; HR = 1.69, 95% CI 0.75–3.83). Weight showed a non-linear association with bleeding risk. The interaction tests with age (p = 0.555) or sex (p = 0.282) were non-significant, although stratification by sex suggested a trend towards an increase particularly among women (S1 Table in S1Appendix).

Diabetes mellitus increased the risk of major bleeding by 56% (HR = 1.56, 95%CI 1.22–2.00). The sensitivity analysis, with diabetes mellitus being defined as HbA1C ≥ 6.5%, showed a similar point estimate (available case analysis; HR = 1.38, 95% CI 0.96–2.00, n = 4,364,).

Chronic kidney disease increased the risk of major bleeding by 77% (HR = 1.77, 95% CI 1.37–2.29). There was no statistically significant multiplicative interaction between CKD and diabetes mellitus (post hoc analysis, p = 0.359).

3.3.3 Myocardial infarction or revascularization during follow-up

Patients with MI/PCI during follow-up were generally older, and more likely to have CKD, diabetes mellitus, hypertension, hyperlipidemia, previous stroke, CABG, or MI, multivessel disease, as well as longer total stent length, lower mean stent diameter, and higher number of stents (S2 Table in S1 Appendix). The 12-month cumulative incidence among those with MI/PCI during follow-up was 3.9% compared to 2.3% in those without (Kaplan-Meier estimate). MI/PCI during follow-up increased the risk of major bleeding by 67% (HR = 1.67, 95% CI 1.29–2.15), after adjustment (S3 Table in S1 Appendix).

3.4 Adherence

Adherence to antiplatelet therapy was assessed through regular interviews, and these results can be found in the supplement (S4 Table in S1Appendix).

4 Discussion

4.1 Main findings

In this large, pragmatic randomized trial on PCI with stent implantation and subsequent DAPT among stent naïve patients, we found a 12-month cumulative incidence of BARC major bleeding of 2.3%. The presence of chronic kidney disease, diabetes mellitus, low bodyweight, or advanced age increased the risk of major bleeding. A myocardial infarction or a repeat revascularization during follow-up also increased the risk of major bleeding.

4.2 Incidence of major bleeding

The incidence of major bleeding seems higher than reported in previous RCTs, particularly explanatory RCTs, which included selected patient populations with lower bleeding risk [17]. Investigators of the SECURITY RCT report a 12-month cumulative incidence of BARC 3 or 5 (i.e., CABG related bleeding excluded) major bleeding after DAPT with clopidogrel of 1.1% [18]. Other explanatory RCTs report a 12-month cumulative incidence in the range 0.5–1.5%, with differing bleeding definitions [2,17], while the 12-month cumulative incidence of Thrombolysis in Myocardial Infarction (TIMI) major bleeding was around 0.7% (1.3% if minor bleeding is included) in the derivation cohort for the PRECISE-DAPT score; bleeding events in the first seven days were excluded [3]. In the DAPT RCT, 2.7% of patients were excluded before randomization, due to a GUSTO major bleeding during the initial 12 months [19]. In contrast, in all-comer RCTs, such as PRODIGY and GLOBAL LEADERS, which included broader patient populations, the 12-month cumulative incidence of BARC 3 or 5 bleeding were 2.0%, and 1.9%, respectively [17], more similar to our findings.

A lower incidence is reported in some registry-based studies. In a recent registry-based validation study of the DAPT score, major bleeding occurred among 1.2% during the first 12 months of DAPT with mainly clopidogrel [9]. In the EPICOR registry, among patients with ACS, the two-year cumulative incidence of bleeding was 3.6%, where half (1.7%) were deemed clinically significant [20].

A higher incidence has been found in other registry-based studies. The finding of a 12-month cumulative incidence of BARC major bleeding of 2.8% from the PARIS registry [21] is noteworthy. In Danish registry studies, DAPT with clopidogrel after MI or atrial fibrillation was associated with a yearly incidence of bleeding of 3.7% [22] or 5.0% [23], respectively.

In summary, the cumulative incidence of major bleeding in NORSTENT is seemingly higher than in previous explanatory RCTs, more comparable to other all-comers RCTs, and lower than in some, but not all, registry-based studies. A direct comparison is challenging, particularly due to varying bleeding definitions. However, the highly selected, explanatory RCTs include a higher proportion of low-risk patients, while pragmatic RCTs and registry-based studies might be closer to real-life practice. For example, patients with CKD or uncontrolled hypertension were excluded from SECURITY [18].

4.3 Risk factors for major bleeding

We identified chronic kidney disease, diabetes mellitus, low bodyweight, and older age as independent risk factors for major bleeding. Stent properties were, as expected, not apparently associated with the risk of major bleeding. We have previously shown that stent type (DES or BMS) is not associated with major bleeding [10]. Since the study inclusion period (2008–11), there has been a reduction in the use of BMS; the rate of use of BMS was below one percent in 2017 in countries like Norway [24, p. 28] or Italy [25]. As the DAPT duration historically was shorter for BMS, which resulted in a reduced bleeding risk, BMS was preferentially used among patients with high bleeding risk. However, this trend did not influence the findings in this study, since the participants had similar (or close to similar) DAPT duration regardless of stent type. Chronic kidney disease was among the strongest risk factors, both in absolute and relative terms, for major bleeding. Chronic kidney disease is an established risk factor for bleeding [17], possibly due to reduced platelet reactivity [26], and creatinine clearance is incorporated into several risk prediction tools, e.g., the PRECISE-DAPT score [3].

Diabetes mellitus is a well-established ischemic risk factor, although guidelines state that the presence of diabetes mellitus should not affect DAPT duration [1]. The potential role of diabetes mellitus as a risk factor for bleeding is more controversial. In the derivation cohort of the PRECISE-DAPT score, insulin-dependent diabetes mellitus was associated with a 65% increased risk of TIMI major or minor bleeding in unadjusted analyses [3]; diabetes mellitus is, however, not included in the final PRECISE-DAPT score. While in the joint ischemic and bleeding risk “DAPT score”, diabetes mellitus adds to the ischemic side of the equation [4].

Lemesle et al. recently reported findings from the CORONOR registry of an increased risk of bleeding in patients with stable coronary artery disease and diabetes mellitus, treated with aspirin and/or clopidogrel (roughly 40% received clopidogrel; HR = 1.75, 95% CI 1.05–2.91 among diabetic patients with HbA1C level ≥ 7%) [27]. Simek et al., on the contrary, recently report no association between diabetes mellitus and bleeding in MI patients treated with prasugrel or ticagrelor, based on information from the PRAGUE-18 trial [28]. The authors note that the bleeding risk among diabetic patients may be differential among users of clopidogrel and, particularly, prasugrel [28]. The patients included in the CORONOR, NORSTENT, and the aforementioned derivation cohort of the PRECISE-DAPT score, where an association between diabetes mellitus and bleeding has been found, mainly received clopidogrel and ASA. The exact mechanisms whereby diabetes mellitus is associated with bleeding risk is unknown. Careful interpretation is advisable while we await further data on the association between diabetes mellitus, DAPT, and bleeding risk.

Patients weighing less than 60 kg, predominately women, were at increased risk of major bleeding. In the TRITON-TIMI 38 RCT, a body weight < 60 kg was found to be a risk factor for serious bleeding in an ACS population (HR = 2.30, 95% CI 1.74–3.05) [29]. One explanation could be the increased systemic availability of ASA or other antithrombotic drugs in patients with low bodyweight; Rothwell et al. report increased risk of major bleeding only among ASA users with lower body weight (90-kilogram threshold) [30]. Being underweight may also act as a proxy variable for frailty. Frailty is associated with increased bleeding risk after PCI [31], but whether this is causal is controversial [17]. The pre-specified cut-off at < 60 kg was somewhat arbitrarily chosen, but based on literature [29].

Patients who suffered an MI or PCI during follow-up had a 67% increased risk of major bleeding. Bleeding is a common complication of PCI, while an MI or PCI would normally result in a new or extended course of DAPT, increasing the risk of bleeding. As the study period covered the time period of the introduction of prasugrel and ticagrelor in contemporary practice in Norway (~2010) [32], patients with an MI during follow-up would be more likely to receive one of those, with a corresponding increased bleeding risk [1]. Finally, as patients suffering a recurrent MI generally perform worse, and have more comorbidities and risk factors [33], the finding could, partially, be due to residual confounding.

4.4 Strengths

NORSTENT is a researcher-initiated, pragmatic RCT [34], funded by not-for-profit organizations, that recruited more than 70% of the eligible population and nearly 50% of all patients undergoing PCI in Norway during the inclusion period. The study has a long follow-up period, which was complete for all patients by using mandatory national health registries covering the entire population, giving insight into the risk of bleeding in the PCI population beyond the period of DAPT. The bleeding endpoints were clinically adjudicated by a blinded endpoint committee, increasing the validity. The sample size, as opposed to several of the previous RCTs [17], allowed detection of smaller effect sizes (e.g., HR ≈ 1.3–1.5).

4.5 Weaknesses

We lacked information on other risk factors, e.g., anemia, low white blood cell count, use of NSAIDs, and frailty, although age, sex, and weight could to some degree capture the latter [31]. Furthermore, patients with a contraindication against DAPT, e.g., history of bleeding or thrombocytopenia, users of anticoagulants, and patients with known cancer were excluded, leading to a possible underestimation of the bleeding risk compared to contemporary clinical practice.

Since the patients were prescribed clopidogrel for at least nine months according to the protocol, and the introduction of prasugrel and ticagrelor happened midway through the study period, we were unable to compare different P2Y12 inhibitors or durations of DAPT in this analysis. Finally, current PCI procedural techniques have some important differences from 2008–11, including lower use of glycoprotein IIb/IIIa Inhibitors, and higher frequency of radial access site, resulting in a lower risk of bleeding [35,36].

5 Conclusion

In this large, pragmatic RCT, among patients randomized to PCI with BMS or DES, the 12-month cumulative incidence of major bleeding was 2.3%. This is twice as high as in previous explanatory RCTs that included more selected patient populations with lower bleeding risk. Independent risk factor for major bleeding were chronic kidney disease, diabetes mellitus, low bodyweight, and older age, while an MI or PCI during follow-up increased the risk of major bleeding by 67%. Diabetes mellitus is well established as an ischemic risk factor, while its role as a bleeding risk factor warrants further research.

Supporting information

S1 Appendix

(DOCX)

Acknowledgments

We thank the investigators, clinicians, and participants involved in NORSTENT for their invaluable contribution, and colleagues at RELIS, the Epidemiology of Chronic Diseases research group, and Prof. Rune Wiseth for feedback to this manuscript.

Data Availability

The data contain potentially identifying or sensitive patient information. Data cannot be shared publicly because of restriction imposed by the Regional ethics committee (post@helseforskning.etikkom.no) and through the Norwegian data protection legislation. Data can be made available after approval by the NORSTENT executive steering committee (coordinating center: Department of Community Medicine, UiT The Arctic University of Norway, postmottak@uit.no), for researchers who meet the criteria for access to confidential data.

Funding Statement

This work was funded by a grant to PJS from the Northern Norway Regional Health Authority (Helse Nord RHF; https://helse-nord.no/), grant no. HNF1420-18. NORSTENT was funded by Norwegian Research Council and others. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Valgimigli M, Bueno H, Byrne RA, Collet JP, Costa F, Jeppsson A, et al. 2017 ESC focused update on dual antiplatelet therapy in coronary artery disease developed in collaboration with EACTS: The Task Force for dual antiplatelet therapy in coronary artery disease of the European Society of Cardiology (ESC) and of the European Association for Cardio-Thoracic Surgery (EACTS). Eur Heart J. 2018;39(3):213–60. Epub 2017/09/10. 10.1093/eurheartj/ehx419 . [DOI] [PubMed] [Google Scholar]
  • 2.Lugo LM, Ferreiro JL. Dual antiplatelet therapy after coronary stent implantation: individualizing the optimal duration. J Cardiol. 2018. Epub 2018/04/01. 10.1016/j.jjcc.2018.03.001 . [DOI] [PubMed] [Google Scholar]
  • 3.Costa F, van Klaveren D, James S, Heg D, Raber L, Feres F, et al. Derivation and validation of the predicting bleeding complications in patients undergoing stent implantation and subsequent dual antiplatelet therapy (PRECISE-DAPT) score: a pooled analysis of individual-patient datasets from clinical trials. Lancet. 2017;389(10073):1025–34. 10.1016/S0140-6736(17)30397-5 . [DOI] [PubMed] [Google Scholar]
  • 4.Yeh RW, Secemsky EA, Kereiakes DJ, Normand SL, Gershlick AH, Cohen DJ, et al. Development and validation of a prediction rule for benefit and harm of dual antiplatelet therapy beyond 1 year after percutaneous coronary intervention. JAMA. 2016;315(16):1735–49. Epub 2016/03/30. 10.1001/jama.2016.3775 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Baber U, Mehran R, Giustino G, Cohen DJ, Henry TD, Sartori S, et al. Coronary thrombosis and major bleeding after PCI with drug-eluting stents: risk scores from PARIS. J Am Coll Cardiol. 2016;67(19):2224–34. Epub 2016/04/16. 10.1016/j.jacc.2016.02.064 . [DOI] [PubMed] [Google Scholar]
  • 6.Mehta SR, Bainey KR, Cantor WJ, Lordkipanidzé M, Marquis-Gravel G, Robinson SD, et al. 2018 Canadian Cardiovascular Society/Canadian Association of Interventional Cardiology focused update of the guidelines for the use of antiplatelet therapy. Can J Cardiol. 2018;34(3):214–33. Epub 2018/02/25. 10.1016/j.cjca.2017.12.012 . [DOI] [PubMed] [Google Scholar]
  • 7.Nakamura M, Kimura K, Kimura T, Ishihara M, Otsuka F, Kozuma K, et al. JCS 2020 guideline focused update on antithrombotic therapy in patients with coronary artery disease. Circ J. 2020;84(5):831–65. 10.1253/circj.CJ-19-1109 [DOI] [PubMed] [Google Scholar]
  • 8.Levine GN, Bates ER, Bittl JA, Brindis RG, Fihn SD, Fleisher LA, et al. 2016 ACC/AHA guideline focused update on duration of dual antiplatelet therapy in patients with coronary artery disease. Circulation. 2016;134(10):e123–55. Epub 2016/03/31. 10.1161/CIR.0000000000000404 . [DOI] [PubMed] [Google Scholar]
  • 9.Ueda P, Jernberg T, James S, Alfredsson J, Erlinge D, Omerovic E, et al. External validation of the DAPT score in a nationwide population. J Am Coll Cardiol. 2018;72(10):1069–78. Epub 2018/08/31. 10.1016/j.jacc.2018.06.023 . [DOI] [PubMed] [Google Scholar]
  • 10.Bonaa KH, Mannsverk J, Wiseth R, Aaberge L, Myreng Y, Nygard O, et al. Drug-eluting or bare-metal stents for coronary artery disease. N Engl J Med. 2016;375(13):1242–52. Epub 2016/08/31. 10.1056/NEJMoa1607991 . [DOI] [PubMed] [Google Scholar]
  • 11.Mehran R, Rao SV, Bhatt DL, Gibson CM, Caixeta A, Eikelboom J, et al. Standardized bleeding definitions for cardiovascular clinical trials: a consensus report from the Bleeding Academic Research Consortium. Circulation. 2011;123(23):2736–47. Epub 2011/06/15. 10.1161/CIRCULATIONAHA.110.009449 . [DOI] [PubMed] [Google Scholar]
  • 12.Multiple imputation in Stata: UCLA: Institute for Digital Research & Education; [Accessed: Nov 25, 2019]. Available from: https://stats.idre.ucla.edu/stata/seminars/mi_in_stata_pt1_new/.
  • 13.Multiple imputation in Stata: Social Science Computing Cooperative; 2013 [Accessed: Nov 25, 2019]. Available from: https://www.ssc.wisc.edu/sscc/pubs/stata_mi_intro.htm.
  • 14.Bartlett JW, Seaman SR, White IR, Carpenter JR. Multiple imputation of covariates by fully conditional specification: accommodating the substantive model. Stat Methods Med Res. 2015;24(4):462–87. Epub 2014/02/15. 10.1177/0962280214521348 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Kleinbaum DG, Klein M. Logistic regression: a self-learning text. 3rd ed: Springer Science & Business Media; 2010. [Google Scholar]
  • 16.Textor J, van der Zander B, Gilthorpe MS, Liskiewicz M, Ellison GT. Robust causal inference using directed acyclic graphs: the R package ’dagitty’. Int J Epidemiol. 2016;45(6):1887–94. Epub 2017/01/17. 10.1093/ije/dyw341 . [DOI] [PubMed] [Google Scholar]
  • 17.Urban P, Mehran R, Colleran R, Angiolillo DJ, Byrne RA, Capodanno D, et al. Defining high bleeding risk in patients undergoing percutaneous coronary intervention: a consensus document from the Academic Research Consortium for High Bleeding Risk. Eur Heart J. 2019;40(31):2632–53. Epub 2019/05/23. 10.1093/eurheartj/ehz372 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Colombo A, Chieffo A, Frasheri A, Garbo R, Masotti-Centol M, Salvatella N, et al. Second-generation drug-eluting stent implantation followed by 6- versus 12-month dual antiplatelet therapy: the SECURITY randomized clinical trial. J Am Coll Cardiol. 2014;64(20):2086–97. Epub 2014/09/23. 10.1016/j.jacc.2014.09.008 . [DOI] [PubMed] [Google Scholar]
  • 19.Mauri L, Kereiakes DJ, Yeh RW, Driscoll-Shempp P, Cutlip DE, Steg PG, et al. Twelve or 30 months of dual antiplatelet therapy after drug-eluting stents. N Engl J Med. 2014;371(23):2155–66. Epub 2014/11/18. 10.1056/NEJMoa1409312 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Bueno H, Pocock S, Danchin N, Annemans L, Gregson J, Medina J, et al. International patterns of dual antiplatelet therapy duration after acute coronary syndromes. Heart. 2017;103(2):132–8. Epub 2016/08/10. 10.1136/heartjnl-2016-309509 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Mehran R, Baber U, Steg PG, Ariti C, Weisz G, Witzenbichler B, et al. Cessation of dual antiplatelet treatment and cardiac events after percutaneous coronary intervention (PARIS): 2 year results from a prospective observational study. Lancet. 2013;382(9906):1714–22. Epub 2013/09/06. 10.1016/S0140-6736(13)61720-1 . [DOI] [PubMed] [Google Scholar]
  • 22.Sorensen R, Hansen ML, Abildstrom SZ, Hvelplund A, Andersson C, Jorgensen C, et al. Risk of bleeding in patients with acute myocardial infarction treated with different combinations of aspirin, clopidogrel, and vitamin K antagonists in Denmark: a retrospective analysis of nationwide registry data. Lancet. 2009;374(9706):1967–74. Epub 2009/12/17. 10.1016/S0140-6736(09)61751-7 . [DOI] [PubMed] [Google Scholar]
  • 23.van Rein N, Heide-Jorgensen U, Lijfering WM, Dekkers OM, Sorensen HT, Cannegieter SC. Major bleeding rates in atrial fibrillation patients on single, dual, or triple antithrombotic therapy. Circulation. 2019;139(6):775–86. Epub 2018/12/28. 10.1161/CIRCULATIONAHA.118.036248 . [DOI] [PubMed] [Google Scholar]
  • 24.Hovland S, Nygaard E, Løland KH, Rotevatn S. Annual report [Årsrapport for 2018 med plan for forbedringstiltak]. Norwegian registry for invasive cardiology (NORIC); 2019. [Google Scholar]
  • 25.Giannini F, Pagnesi M, Campo G, Donahue M, Ferri LA, Briguori C, et al. Italian multicenter registry of bare metal stent use in modern percutaneous coronary intervention era (AMARCORD): a multicenter observational study. Catheter Cardiovasc Interv. 2020. Epub 2020/03/22. 10.1002/ccd.28798 . [DOI] [PubMed] [Google Scholar]
  • 26.van Bladel ER, de Jager RL, Walter D, Cornelissen L, Gaillard CA, Boven LA, et al. Platelets of patients with chronic kidney disease demonstrate deficient platelet reactivity in vitro. BMC Nephrol. 2012;13:127. Epub 2012/10/02. 10.1186/1471-2369-13-127 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Lemesle G, Meurice T, Tricot O, Lamblin N, Bauters C. Association of diabetic status and glycemic control with ischemic and bleeding outcomes in patients with stable coronary artery disease: the 5-year CORONOR registry. J Am Heart Assoc. 2018;7(10). Epub 2018/05/08. 10.1161/JAHA.117.008354 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Simek S, Motovska Z, Hlinomaz O, Kala P, Hromadka M, Knot J, et al. The effect of diabetes on prognosis following myocardial infarction treated with primary angioplasty and potent antiplatelet therapy. J Clin Med. 2020;9(8):2555. 10.3390/jcm9082555 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Hochholzer W, Wiviott SD, Antman EM, Contant CF, Guo J, Giugliano RP, et al. Predictors of bleeding and time dependence of association of bleeding with mortality: insights from the Trial to Assess Improvement in Therapeutic Outcomes by Optimizing Platelet Inhibition With Prasugrel—Thrombolysis in Myocardial Infarction 38 (TRITON-TIMI 38). Circulation. 2011;123(23):2681–9. 10.1161/CIRCULATIONAHA.110.002683 . [DOI] [PubMed] [Google Scholar]
  • 30.Rothwell PM, Cook NR, Gaziano JM, Price JF, Belch JFF, Roncaglioni MC, et al. Effects of aspirin on risks of vascular events and cancer according to bodyweight and dose: analysis of individual patient data from randomised trials. Lancet. 2018;392(10145):387–99. Epub 2018/07/19. 10.1016/S0140-6736(18)31133-4 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Dodson JA, Hochman JS, Roe MT, Chen AY, Chaudhry SI, Katz S, et al. The association of frailty with in-hospital bleeding among older adults with acute myocardial infarction: insights from the ACTION registry. JACC Cardiovasc Interv. 2018;11(22):2287–96. Epub 2018/11/24. 10.1016/j.jcin.2018.08.028 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Norwegian Prescription Registry: Norwegian Institute of Public Health; [Searched: October 19, 2020]. Available from: http://www.norpd.no/.
  • 33.Radovanovic D, Maurer L, Bertel O, Witassek F, Urban P, Stauffer JC, et al. Treatment and outcomes of patients with recurrent myocardial infarction: a prospective observational cohort study. J Cardiol. 2016;68(6):498–503. Epub 2016/01/19. 10.1016/j.jjcc.2015.11.013 . [DOI] [PubMed] [Google Scholar]
  • 34.Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147. 10.1136/bmj.h2147 WOS:000354415400001. [DOI] [PubMed] [Google Scholar]
  • 35.Olier I, Sirker A, Hildick-Smith DJR, Kinnaird T, Ludman P, de Belder MA, et al. Association of different antiplatelet therapies with mortality after primary percutaneous coronary intervention. Heart. 2018. Epub 2018/02/14. 10.1136/heartjnl-2017-312366 . [DOI] [PubMed] [Google Scholar]
  • 36.Gellatly RM, Connell C, Tan C, Andrianopoulos N, Ajani AE, Clark DJ, et al. Trends of use and outcomes associated with glycoprotein-IIb/IIIa inhibitors in patients with acute coronary syndromes undergoing percutaneous coronary intervention. Ann Pharmacother. 2020;54(5):414–22. Epub 2019/11/27. 10.1177/1060028019889550 . [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Salvatore De Rosa

23 Jul 2020

PONE-D-20-14185

Incidence and risk factors for major bleeding among patients undergoing percutaneous coronary intervention: findings from the Norwegian Coronary Stent Trial (NORSTENT).

PLOS ONE

Dear Dr. Samuelsen,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 06 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Salvatore De Rosa

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

3. We note that you have included the phrase “data not shown” in your manuscript. Unfortunately, this does not meet our data sharing requirements. PLOS does not permit references to inaccessible data. We require that authors provide all relevant data within the paper, Supporting Information files, or in an acceptable, public repository. Please add a citation to support this phrase or upload the data that corresponds with these findings to a stable repository (such as Figshare or Dryad) and provide and URLs, DOIs, or accession numbers that may be used to access these data. Or, if the data are not a core part of the research being presented in your study, we ask that you remove the phrase that refers to these data.

4.Thank you for including your ethics statement:  'NORSTENT (ClinicalTrials.gov: NCT0081177) has been approved by the Regional Ethics Committee

118 (REK Nord 40/2008)'.    

(a) Please amend your current ethics statement to include the full name of the ethics committee/institutional review board(s) that approved your specific study.  

(b) Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”).

For additional information about PLOS ONE ethical requirements for human subjects research, please refer to http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research.

5. Please ensure you have included the correct clinicaltrials.gov registration number for the clinical trial referenced in the manuscript. Currently, the clinicialtrials.gov provided in the manuscript is NCT0081177, whereas the correct registration numbers appears to be NCT00811772.

Additional Editor Comments (if provided):

The authors report original results on predictors of bleeding events in the large NORSTENT cohort.

Data analysis shows no impact by the type of stent implantes (DES vs BMS) on bleeding. This is an important confirmation of previous results in a large study cohort that fit in the lane of previous evidence. A recent nationwide report (Giannini F. et al. Italian Multicenter Registry of Bare Metal Stent Use in Modern Percutaneous Coronary Intervention Era (AMARCORD): A multicenter observational study. Catheter Cardiovasc Interv. 2020 Mar 21. doi: 10.1002/ccd.28798. Online ahead of print.) showed a hyperbolic reducion in BMS use from 2013 to rates lower than 1% in 2016). This phenomenon depicts a trend that was sustanined by a growing body of evidence on the use of DES in different clinical context, including high bleeding risk patients. Please discuss this aspect.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: In this manuscript, Samuelsen investigated potential risk factors of major bleeding in the Norwegian Coronary Stent Trial. More than 9000 patients were included into the randomized control trial and followed for a median of five years. The authors observed a cumulative incidence rate of 2.3%. Additional risk factors were also identified to relate to major bleeding such as CKD, underweight, diabetes and advanced age. Overall, the study is interesting and the manuscript was well written.

Following are some comments to be considered.

• The authors merged both study arms. However, it is unclear how many samples were assigned to each study arm. It would also be useful to compare the risk factors derived from either arm.

• In addition to MI, what other ischemic events were studied?

• Is there any control for medication?

• The authors indicated that “the combined proportion of missing observations was 17% with a missing at random pattern”. How the missing at random pattern was assessed?

• Is there any normalization of the study variables?

• How the baseline was defined for patients with multiple stent implanted? Was it counted since the last stent was implanted?

• Is there any bleeding prior to the stent implantation?

• In figure 1, please list the cumulative number of events under each year of follow-up

Reviewer #2: In the manuscript entitled "Incidence and risk factors for major bleeding among patients undergoing percutaneous coronary intervention: findings from the Norwegian Coronary Stent Trial (NORSTENT) " authors lead by Per-Jostein Samuelsen investigated the major bleeding risk factors in their cohort of 9013 patients.

This analysis shows chronic kidney disease (CKD), advanced age, and underweight as risk factors for major bleeding among patients receiving DAPT after PCI. Moreover, diabetes mellitus or recurrent MI increase bleeding risk during the follow-up.

The authors should be commended in their effort, as this analysis could support prior reports giving insights on this relevant problem. This reviewer has the following comments to raise with respect to the manuscript:

• Impact of the effective duration of DAPT is not presented in the document. Could the authors present this data, if available, and put it into perspective towards the effect of the various predictors? Is longer DAPT duration a predictor for bleeding in this analysis, could the author estimate the increase in bleeding each month of extended DAPT above 9 months?

• PCI or MI during follow-up increased risk of bleeding. This is probably due to extending DAPT after additional procedures and subsequent peri-procedural/intrahospital events. Was this adjusted for overall DAPT duration? If this is not the case this is not interesting and the text dedicated to this result shortened.

• BARC bleeding 3,4 or 5. Why the authors decided to also include BARC 4 in the primary endpoint ? This is hardly a marker of out-of hospital bleeding related to DAPT.

• It would be meaningful to present information on the bleeding sites.

• Was a treatment with clopidogrel made for all patients ? Or novel P2Y12 inhibitors have been also used ? If this is not the case this should be added in the limitation section.

• Could the authors validate PRECISE-DAPT score in their population? A validation of the DAPT score would not be feasible since most patients did not do more than 9 months of DAPT.

• Discussion section, for the PRECISE-DAPT please report the incidence of TIMI Major or minor bleeding, comparison between BARC 3 or 5 and TIMI major bleeding only would be misleading.

• The higher reported event rate could be also due to procedural characteristics than in 2008 -2011 were much different than today (e.g. bulkier access site, higher use of GPI). This should be reported in the study discussion and limitations.

• Discussion, diabetes. "This could lead to diabetic ulcerations of the feet, and retinopathy. 257 The latter could cause intraocular bleeding compromising vision, which is classified as a BARC major 258 bleeding [8]." Could the authors support this statement with prior data from the literature. If this is not the case the conclusion here seems farfetched. In addition, the rate of intraocular bleeding is very low and hardly explain alone the association of diabetes with bleeding.

• Abstract, row 7: the authors repeated the word “randomized” twice.

• Line 31: please state international guidelines: also Canadian guidelines and Japanese guidelines support standardized risk scores for DAPT.

• While citing Rothwell et al. wasn't the threshold used in that manuscript 70kg rather than 90 kg ?

• Supplementary Figure 1 is interesting. DAG is very informative and graphic. Could the authors please explain why older age, that is independently associated to major bleeding, also provide an effect through diabetes and CKD ? is this a clinical assumption or the product of analysis ?

• Figure 2 is really informative. However, I believe that the higher rates of bleeding presented in the first block (0 to 6 months) are driven by intrahospital/periprocedural bleeding (especially considering the practice in 2008-2011 in which femoral access and GPIIb/IIIa were more extensively used). Excluding those events from the analysis would be much more informative to provide a snapshot of the bleeding risk during therapy during out-of-hospital follow-up.

• Table 3 could be simplified shortened eliminating the reference lines. Information about the reference groups could be included in the rows or in the footnotes.

• Table 3 there is a typo for stent length >40mm (1.5q).

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

Salvatore De Rosa

8 Feb 2021

Incidence and risk factors for major bleeding among patients undergoing percutaneous coronary intervention: findings from the Norwegian Coronary Stent Trial (NORSTENT)

PONE-D-20-14185R1

Dear Dr. Samuelsen,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Salvatore De Rosa

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Acceptance letter

Salvatore De Rosa

17 Feb 2021

PONE-D-20-14185R1

Incidence and risk factors for major bleeding among patients undergoing percutaneous coronary intervention: findings from the Norwegian Coronary Stent Trial (NORSTENT).

Dear Dr. Samuelsen:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Salvatore De Rosa

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    The data contain potentially identifying or sensitive patient information. Data cannot be shared publicly because of restriction imposed by the Regional ethics committee (post@helseforskning.etikkom.no) and through the Norwegian data protection legislation. Data can be made available after approval by the NORSTENT executive steering committee (coordinating center: Department of Community Medicine, UiT The Arctic University of Norway, postmottak@uit.no), for researchers who meet the criteria for access to confidential data.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES