Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Sep 11;15(9):e0238640. doi: 10.1371/journal.pone.0238640

Derivation and validation of the J-CTO extension score for pre-procedural prediction of major adverse cardiac and cerebrovascular events in patients with chronic total occlusions

Soichiro Ebisawa 1,*, Shun Kohsaka 2, Toshiya Muramatsu 3, Yoshifumi Kashima 4, Atsunori Okamura 5, Masahisa Yamane 6, Masami Sakurada 7, Shunsuke Matsuno 8, Mikihiro Kijima 9, Maoto Habara 10
Editor: Yoshiaki Taniyama11
PMCID: PMC7485776  PMID: 32915843

Abstract

We developed a prediction model of long-term risk after percutaneous coronary intervention (PCI) for coronary chronic total occlusion (CTO) based on pre-procedural clinical information. A total of 4,139 eligible patients, who underwent CTO-PCI at 52 Japanese centers were included. Specifically, 1,909 patients with 1-year data were randomly divided into the derivation (n = 1,273) and validation (n = 636) groups. Major adverse cardiac and cardiovascular event (MACCE) was the primary endpoint, including death, stroke, revascularization, and non-fatal myocardial infarction. We assessed the performance of our model using the area under the receiver operating characteristic curve (AUC) and assigned a simplified point-scoring system. One-hundred-thirty-eight (10.8%) patients experienced MACCE in the derivation cohort with hemodialysis (HD: odds ratio [OR] = 2.55), left ventricular ejection fractions (LVEF) <35% (OR = 2.23), in-stent occlusions (ISO: OR = 2.27), and diabetes mellitus (DM: OR = 1.72). The AUC of the derivation model was 0.650. The model’s performance was similar in the validation cohort (AUC, 0.610). When assigned a point for each associated factor (HD = 3, LVEF <35%, ISO = 2, and DM = 1 point), the average predicted versus the observed MACCE probability using the Japan-CTO extension score for the low, moderate, high, and very high risk groups was 8.1% vs. 7.3%, 16.9% vs. 15.9%, 22.0% vs. 26.1%, and 56.2% vs. 44.4%, respectively. This novel risk model may allow for the estimation of long-term risk and be useful in disseminating appropriate revascularization procedures.

Introduction

While percutaneous coronary intervention (PCI) remains a valid treatment option for patients with chronic total occlusion (CTO), the outcomes of patients following PCI vary significantly among medical centers. Additionally, the optimal treatment strategies remain controversial despite the technological and methodological advances [1,2]. Particularly, the high incidence of major adverse cardiac and cerebrovascular events (MACCEs) remains problematic. Under the current treatment protocols, over 20.7% of patients who undergo CTO-PCI experience restenosis within 5 years, which is considerably higher compared to the rate of those who have not undergone this procedure [3]. Conversely, the long-term outcome for coronary artery bypass grafting (CABG) for CTO remains favorable, with over 90% patency of the left internal mammary artery [4]. Standardized pre-procedural risk assessment tools may be helpful in identifying patients at high-risk for developing MACCE after CTO-PCI. In particular, identification of patients at risk for restenosis at the treatment selection time would aid in pre-procedural decision-making.

Historically, as CTO-PCI procedures are complex [57], requiring high contrast media volume and radiation during the procedure [8,9], risk models for procedural success have been developed [1012]. However, these risk models do not effectively predict long-term outcomes following the procedure. Recently, the Prospective Global Registry for the Study of CTO Intervention (PROGRESS CTO) [11] score, developed to predict the success of CTO-PCIs, was reported to be a useful tool in predicting long-term outcomes [13], albeit the study population was small and the procedural success rates were lower than that in conventional CTO studies [7].

Therefore, our aim was to develop a pre-procedural risk score for patients with CTO using a multi-institutional dataset from Japan (the Retrograde Summit Registry). Specifically, utilizing pre-procedural information on patients’ backgrounds and angiograms, we compared the performance of the novel outcome-specific risk scores with the traditional procedural scores (Japan-CTO [J-CTO]).

Materials and methods

This study was approved by the ethic committee of all participating facilities of retrograde summit registry (Toyohashi Heart Center, Saitama Sekishinkai Hospital, Tokyo General Hospital, Sakurabashi-Watanabe Hospital, Sapporo Cardio Vascular Clinic, The Cardiovascular Institute, Tokorozawa Heart Center, Hoshi General Hospital, Kyoto Okamoto Memorial Hospital, Saitama Prefecture Cardiovascular and Respiratory Center, Mie Heart Center, Takase Clinic, Nagoya Heart Center, Higashi Takarazuka Satoh Hospital, Hokkaido Social Insurance Hospital, Shiga Medical Center for Adults, Kakogawa East City Hospital, Hokko Memorial Hospital, Yotsuba Circulation Clinic, Yokohama Sakae Kyosai Hospital, Saiseikai Fukuoka General Hospital, Edogawa Hospital, Fukaya Red Cross Hospital, Rinku General Medical Center, Nagoya Daini Red Cross Hospital, Hyogo Prefectural Amagasaki Hospital, Sanda City Hospital, Itabashi Chuo Hospital, Nagoya Tokushukai Hospital, Showa General Hospital, Kanagawa Cardiovascular and Respiratory Center, Seirei Hamamatsu General Hospital, Tokeidai Memorial Hospital, Kyoto Katsura Hospital, Kushiro City General Hospital, Iwate Prefectural Central Hospital, Kusatsu Heart Center, Hamada Medical Center, Tokuyama Chuo Hospital, Showa University Hospital, Osaka Saiseikai Izuo Hospital, Todachuo General Hospital, Nozaki Tokushukai Medical Center, Shinkoga Hospital, Mito Brain Heart Center, Shuuwa General Hospital, Iwaki Kyouritsu Hospital, Hyogo Brain and Heart Center, NTT East Sapporo Hospital, Chikamori Hospital, Mimihara General Hospital, Hokusetsu General Hospital, Kobe Redcross Hospital, Kansai Medical University Takii Hospital, Tokushima Red Cross Hospital, Osaki Citizen Hospital, Tsukuba Memorial Hospital, Yokohama Shintoshi Neurosurgical Hospital, Fukuoka City Hospital, Bellland General Hospital, Matsubara Tokushukai Medical Center, Ohta General Hospital Ohta Nishinouchi Hospital, Sapporo Orthopaedics and Cardiovascular Hospital, Toho University Omori Medical Center) and review board in Shinshu University. Written informed consent was obtained from all participants. All procedures performed in studies involving human participants were in accordance with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

The Retrograde Summit was constructed as a multicenter, prospective, nonrandomized registry of patients treated at 65 Japanese centers between January 2012 and December 2015. Within the study period, 4,909 patients with CTO lesions underwent elective PCIs and had useful initial data. We excluded 770 patients who underwent CTO-PCI in 13 institutions that did not join to collect the 1-year follow-up data, and the final number of baseline participants for the analysis was 4,139. Among them, 1,909 patients had 1-year follow-up data (Fig 1). Emergent cases were excluded from this study. The indication of CTO-PCI or bypass grafting was determined via discussions among the cardiac team at each institution. The PCI-related strategies (e.g., retrograde or antegrade approach, stent deployment, or nothing) depended upon the operators’ discretion.

Fig 1. Study flow.

Fig 1

When the patients had CTO lesions in several vessels, only the vessel that was treated first was analyzed.

The baseline patient characteristics, procedural details and techniques, and in-hospital outcomes were obtained. Procedural success was defined as the guidewire and balloon crossing a completely occluded lesion resulting in the successful dilation of the occluded artery, and restoration of antegrade flow (thrombolysis in myocardial infarction flow grade 3) with <50% residual stenosis on final angiography. The primary endpoint of this analysis was a composite of major adverse cardiac and cerebrovascular events (MACCE) observed at the 1-year follow-up. One-year MACCE was defined as death, myocardial infarction, stroke, and any target lesion revascularization [14].

Neither a centralized event adjudication nor core laboratory assessment was performed. All clinical events were reported by the operator who performed the CTO-PCI procedure.

CTO was defined as a complete occlusion with thrombolysis in myocardial infarction flow grade 0, antegrade through the affected segment, and >3 months in duration, by the opinion of the operator (based on clinical features, angiographic features, and/or previous imaging results). Chronic kidney disease was defined as an estimated glomerular filtration rate <60 ml/min/1.73 m2, calculated using the diet modification in renal disease formula.

The angiographic morphology of the entry point was classified as “blunt” when the occluded segment did not end in a funnel tapered form. Lesion calcification was assigned to one of three categories: mild (spots), moderate, and severe (involving ≤50% and >50% of the reference lesion diameter, respectively). Lesion bending was defined as at least one bend of >45°, assessed by angiography, throughout the occluded segment. Proximal vessel tortuosity was defined as the presence of one bend of >70° in the CTO vessel. The occlusion length was categorized as <20 or ≥20 mm. The collateral connection grade was classified as previously described [15]. The lesion difficulty was classified using the J-CTO score. The retrograde approach was defined as any PCI attempt for CTO, with wiring through the collateral arteries, that did not depend on a successful pass through the collateral root.

We separately performed analyses in the population subsets that were used for derivation (2/3 random sampling group, 1,273 patients) and validation (1/3 random sampling rate, 636 patients) studies (Fig 2). A two-step analysis was used to identify the independent predictors of the 1-year MACCE. First, from the derivation cohort, univariate analysis was performed to identify the clinical and angiographical variables associated with the incidence of the 1-year MACCE. Second, we performed a multivariate logistic regression analysis to determine the configured variables of the final scoring model, the variables that were strongly (p <0.05) associated with the incidence of the 1-year MACCE, from the univariate analysis. In this model, low left ventricular function cases were treated as a categorical variable (left ventricular ejection fraction [LVEF] <35%) to increase the model’s clinical utility. We scored each variable and calculated the overall score for each case, according to the odds ratio (OR) calculated by the multivariate analysis. Subsequently, the derivation and validation groups were divided to four subsets, defined as low, moderate, high, and very high groups according to the scoring model. These four subsets were used to confirm the differences of the stepwise alternations in the 1-year MACCE incidences between the derivation and validation groups.

Fig 2. TREND checklist.

Fig 2

We checked 22 points including TREND statement checklist. All points were included in our study.

The continuous and categorical variables are presented as means ± standard and as numbers and percentages, respectively. They were evaluated using two-sided, unpaired t-tests and using the chi-squared or Fisher’s exact test, where appropriate, respectively. All reported p values were two-sided. The statistically significant level was set at p <0.05. A logistic regression model was performed to determine the predictors of the incidences of MACCE at 1 year after PCI. In the first step, several potential predictors were separately assessed by univariate logistic regression analyses. A multiple logistic regression analysis was, then, conducted using covariates associated with the 2-year incidence of MACCE in the univariate analyses (p ≤0.05). The results are expressed as OR with 95% confidence intervals (CI). Using the validation cohort data, the validities of the two risk models were also evaluated by examining the agreement between the predicted and observed proportions of the MACCE at 1 year after PCI, in the aforementioned four subsets, according to the total points. All analyses were performed using SPSS version 23.0 (IBM Corp., Armonk, NY, USA).

Results and discussion

A total of 211 patients (11.1%) experienced MACCE at the 1-year follow-up, including 44 deaths, two myocardial infarctions, four strokes, and 162 target lesion revascularizations. Regarding the technical issues, a retrograde approach was performed in 606 cases (31.7%); however, this procedure was not associated with the initial success (p = 0.569) and the 1-year MACCE incidence rates (p = 0.368). The latter did not differ between the derivation and validation groups (10.8% vs 11.5%, p = 0.699). We compared the patients’ baseline characteristics in the derivation and validation groups, and the results are presented in Table 1.

Table 1. Comparison of the participants’ baseline characteristics in the validation and derivation groups.

Derivation Group Validation Group p value
n 1,273 (%) 636 (%)
Male sex 1,059 (83.5) 529 (83.4) 1
Age 67.7±10.3 67.7±10.5 0.367
Hypertension 985 (78.35) 511 (80.5) 0.142
Dyslipidemia 904 (71.8) 468 (74.0) 0.326
Diabetes mellitus 557 (44.3) 284 (45.2) 0.694
Smoking 641 (53.8) 328 (53.7) 0.098
Familial history 179 (19.9) 88 (18.7) 0.28
History of myocardial infarction 492 (40.1) 262 (42.9) 0.247
Post PCI 762 (60.1) 386 (61.6) 0.549
Post CABG 101 (8.0) 57 (9.1) 0.427
History of peripheral artery disease 148 (12.4) 71 (11.8) 0.601
Symptomatic 809 (65.9) 409 (66.7) 0.794
Hemodialysis 69 (5.6) 36 (5.9) 0.832
Chronic kidney disease 537 (42.6) 272 (43.0) 0.883
LVEF <35 86 (7.6) 42 (6.9) 1
Target lesion
RCA 582 (45.9) 307 (48.4) 0.399
LAD LMT 406 (32.0) 188 (29.6)
LCX 283 (22.3) 138 (21.8)
In-stent occlusion 181 (14.5) 91 (14.6) 1
Reference size <2.5 mm 398 (33.3) 197 (32.5) 0.348
Collateral grade >2 310 (29.1) 169 (31.2) 0.483
Moderate to severe calcification 416 (32.8) 215 (34.2) 0.568
Retry case 135 (10.7) 60 (9.5) 0.471
Tortuous 114 (9.0) 56 (8.8) 0.932
Lesion length >20 mm 570 (53.2) 272 (50.8) 0.667
Blunt type 688 (54.4) 333 (52.7) 0.494
Value of J-CTO score 1.53±1.09 1.48±1.03 0.443

n, number of patients; PCI, percutaneous coronary intervention; CABG, coronary artery bypass graft; LVEF, left ventricular ejection fraction; RCA, right coronary artery; LMT, left main trunk; LAD, left anterior descending; LCX, left circumflex; CTO, chronic total occlusion

The mean age was 67.7±10.3 and 67.7±10.5 years in the derivation and validation groups (p = 0.367), respectively. All of the other patient’s background variables did not differ between these groups. The angiographic characteristics did not differ between the two groups, and their calculated mean J-CTO scores were equivocal (1.53±1.09 vs 1.48±1.03, p = 0.443).

Table 2 shows the univariate analysis of the incidences of MACCE at the 1-year follow-up in the derivation group. Diabetes mellitus and LVEF <35% were significantly associated with the incidence of MACCE (60% vs 42.4%, p <0.0001 and 13.4% vs 6.3%, p = 0.006 between the patients with and without MACCE, respectively). The peripheral artery disease and hemodialysis histories were also significantly associated with MACCE (21.5% vs 11.3%, p = 0.0008; 20% vs 4.4%, p <0.0001, respectively). Regarding the lesion-related variables, in-stent occlusion lesions were associated with the incidence of MACCE (24.6% vs 13.3%, p <0.0001). Concerning the J-CTO score components, calcification and tortuous lesions were more often observed in the MACCE (+) group (40.4% vs 31.9%, p = 0.031; 13.8% vs 8.4%, p = 0.041). Conversely, the initial patient success was not associated with the incidence of the 1-year MACCE (p = 0.569).

Table 2. Univariate analysis for the incidences of MACCE in the derivation group.

MACCE (+) MACCE (-) p value
n 138 (%) 1135 (%)
Men 119 (86.2) 940 (83.1) 0.329
Age ≥65 years 92 (66.6) 743 (65.5) 0.548
Hypertension 108 (80) 877 (78.1) 0.66
Dyslipidemia 96 (70.0) 808 (72.0) 0.616
Diabetes mellitus 81 (60) 476 (42.4) <0.0001*
Smoking 74 (58.7) 567 (53.2) 0.276
Familial history 17 (17.7) 162 (20.1) 0.811
History of myocardial infarction 58 (43.6) 434 (39.7) 0.4
Post PCI 86 (62.3) 676 (59.9) 0.645
Post CABG 14 (10.2) 87 (7.7) 0.314
History of peripheral artery disease 28 (21.5) 120 (11.3) 0.008*
Symptomatic (CCS ≥1) 88 (67.6) 721 (65.7) 0.696
Hemodialysis 21 (20) 48 (4.4) <0.0001*
Chronic kidney disease 65 (49.6) 472 (41.8) 0.094
LVEF <35 18 (13.4) 68 (6.3) 0.006*
Target lesion LCX 36 (26.0) 247 (21.7) 0.278
In-stent occlusion 33 (24.6) 148 (13.3) 0.001*
Reference size <2.5 mm 46 (37.0) 352 (32.9) 0.118
Collateral grade >2 123 (95.3) 1035 (96.8) 0.991
Moderate to severe calcification 55 (40.4) 361 (31.9) 0.031*
Retry 9 (6.5) 126 (11.2) 0.108
Tortuous 19 (13.8) 95 (8.4) 0.041*
Lesion length >20mm 65 (59.6) 505 (52.4) 0.087
Blunt type 68 (49.2) 620 (55.1) 0.205
Initial procedural success 118 (85.5) 1012 (89.1) 0.200

n, number of patients; CCS, Canadian Cardiovascular Society grade; PCI, percutaneous coronary intervention; CABG, coronary artery bypass graft; LVEF, left ventricular ejection fraction; LCX, left circumflex; MACCE, major adverse cardiac and cardiovascular events.

* statistically significant (p <0.05)

According to the multivariate logistic regression analysis (Table 3) hemodialysis (OR, 2.552; 95% CI, 1.286–5.064; p = 0.007), LVEFs <35% (OR 2.233; 95% CI, 1.191–4.187; p = 0.012), in-stent occlusion lesions (OR, 2.279; 95% CI, 1.407–3.691; p = 0.001), and DM (OR, 1.722; 95% CI, 1.131–2.622; p = 0.011) were significant predictors of MACCE incidence at the 1-year follow-up. The derivation model area under the receiver operating characteristic (ROC) curve (AUC) was 0.650 (95% CI, 0.598–0.703; p <0.0001) and the Hosmer-Lemeshow test result was p = 0.632. The outcomes were similar in the validation cohort; the AUC was 0.610 (95% CI, 0.532–0.688; p = 0.003) and the Hosmer-Lemeshow test result was p = 0.720. We created a scoring model (J-CTO extension score) by assigning a weighted integer based on the calculated OR [16,17] (hemodialysis = 3, LVEF <35% = 2, in-stent occlusion = 2, and DM = 1). This model was successful in predicting the incidence of MACCE at the 1-year follow-up, with stepwise alterations in the derivation and validation groups (Fig 3). To assess the predictive power of this model, the proposed performance scoring system was compared with that of the traditional multivariate regression model (covariates selected from variables in Table 3) and only a small difference in C-statistics between them was observed (0.665 vs. 0.658).

Table 3. Multivariate analysis for the incidences of MACCE and the scoring model.

95% CI Odds ratio p value Score
Diabetes mellitus 1.131–2.622 1.722 0.011* 1
History of PAD 0.761–2.361 1.34 0.311 0
Hemodialysis 1.286–5.064 2.552 0.007* 3
LVEF <35% 1.191–4.187 2.233 0.012* 2
In-stent occlusion 1.407–3.691 2.279 0.001* 2
Calcification 0.732–1.819 1.154 0.539 0
Tortuous lesion 0.946–3.091 1.71 0.076 0

CI, confidence interval; LVEF, left ventricular ejection fraction; MACCE, major adverse cardiac and cardiovascular events; PAD, peripheral artery disease.

* statistically significant (p <0.05)

Fig 3. Incidence of MACCE: Comparison between the derivation and validation groups.

Fig 3

We created a scoring model, named J-CTO extension score, according to the odds ratio of multivariate analysis of MACCE at the 1-year follow-up, as follows: hemodialysis = 3, LVEF <35% = 2, in-stent occlusion = 2, and DM = 1. This model was successful in predicting MACCE incidence at the 1-year follow-up with stepwise alterations in the derivation and validation sets. LVEF, left ventricular ejection fraction; MACCE, major advanced cardiovascular events; J-CTO, Japan-chronic total occlusion.

The average predicted versus observed probabilities of MACCE with the J-CTO extension score for the low, moderate, high, and very high-risk subsets were as follows: 8.1% vs. 7.3%, 16.9% vs. 15.9%, 22.0% vs. 26.1%, and 56.2% vs. 44.4% of the observed and predicted scores, respectively (Fig 4A). The agreements between the observed and predicted risks of MACCE at the 1-year follow-up, with developed risk-scoring methods were assessed across the 10 groups divided according to the risk score in the validation cohort. The correlation between the values of the observed and predicted risk in the 10 groups was significant (r = 0.77) (Fig 4B).

Fig 4. Internal validation of the J-CTO extension score.

Fig 4

A: This figure revealed calibration of the J-CTO extension score in the validation group. The average predicted versus observed probability of MACCE with the J-CTO extension score for each quartile (categorized as low, moderate, high, and very high-risk groups) was: 8.1% vs. 7.3%, 16.9% vs. 15.9%, 22.0% vs. 26.1%, and 56.2% vs. 44.4% of the observed and predicted scores, respectively. B: The agreements between the observed and predicted risks of MACCE at the 1-year follow-up, with developed risk-scoring methods were assessed across the 10 groups divided according to the risk score in the validation cohort. There was a significant correlation between the values of the observed and predicted risk in the 10 groups (r = 0.77). MACCE, major advanced cardiovascular events; J-CTO, Japan-chronic total occlusion.

Fig 5A–5C shows the comparisons of the other predictive CTO scores in this population with the ROC curve. The J-CTO [10], Clinical and lesion-related (CL) [12], and PROGRESS CTO scores have all been previously developed to predict the initial success of CTO-PCI [11]. Fig 5A demonstrates a ROC curve of the whole patient population. The AUC of the J-CTO, CL, and PROGRESS CTO scores were 0.518 (95% CI, 0.473–0.563; p = 0.406), 0.540 (95% CI, 0.496–0.583; p = 0.066), and 0.514 (95% CI, 0.472–0.556; p = 0.509), respectively. The J-CTO extension score was only associated with the incidence of MACCE; the AUC was 0.634 (95% CI, 0.590–0.678; p <0.0001). Fig 5B and 5C shows ROC curves of the derivation and validation groups, respectively. In both groups, only the J-CTO extension score was associated with the incidence of MACCE at 1-year follow-up.

Fig 5. Comparison between the J-CTO extension score and other scoring models of CTO-PCI.

Fig 5

A: ROC curve of the overall population. The AUC of the J-CTO, CL, and PROGRESS scores was 0.518 (95% CI, 0.473–0.563, p = 0.406), 0.540 (95% CI, 0.496–0.583, p = 0.066), and 0.514 (95% CI, 0.472–0.556, p = 0.509), respectively. Conversely, the J-CTO extension score was only associated with the incidence of MACCE at the 1-year follow-up; the AUC was 0.634 (95% CI, 0.590–0.678, p <0.0001). B: ROC curve of the derivation group. The AUC of the J-CTO, CL, and PROGRESS scores was 0.514 (95% CI, 0.459–0.569, p = 0.600), 0.543 (95% CI, 0.489–0.597, p = 0.105), and 0.515 (95% CI, 0.463–0.567, p = 0.585), respectively. Conversely, the J-CTO extension score was only associated with the incidence of MACCE at the 1-year follow-up; the AUC was 0.650 (95% CI, 0.598–0.703, p <0.0001). 4C: ROC curve of the validation group. The AUC the J-CTO, CL, and PROGRESS scores was 0.528 (95% CI, 0.452–0.604, p = 0.44), 0.535 (95% CI, 0.463–0.608 p = 0.33), and 0.512 (95% CI, 0.442–0.581, p = 0.751), respectively. Conversely, the J-CTO extension score was only associated with the incidence of MACCE at the 1-year follow-up; the AUC was 0.610 (95% CI, 0.532–0.688, p <0.003). CI, confidence interval; AUC, area under the curve, ROC, receiver operating characteristic; J-CTO, Japan-chronic total occlusion score; MACCE, major advanced cardiovascular events.

In this study, we created a new score, called the J-CTO extension score, that can predict the chronic outcomes of patients post CTO-PCI. The J-CTO extension score could predict the incidence of MACCE at the 1-year follow-up, with stepwise alternations in the derivation and validation datasets. Furthermore, among other established CTO scores, only the J-CTO extension score predicted the chronic outcomes of patients post CTO-PCI. The novel scoring system was associated with the incidence of all cause death. However, the association with myocardial infarction and stroke was less clear.

The potential benefits of CTO recanalization based on observational studies and meta-analysis include: improvement in symptoms, relief of ischemia, and improvement of left ventricular function. Moreover, the long-term improvements in the clinical outcome of patients post CTO-PCI has been assessed in several reports [1820]. Jones et al. [21] and George et al. [22] reported that successful CTO-PCI improves long-term survival compared with unsuccessful cases. Mehran et al. demonstrated that successful CTO-PCI decreased the need for coronary artery bypass graft surgery (hazard ratio: 0.21; 95% CI, 0.13–0.40; p <0.01) [23]. Our study demonstrated a sufficient predictability of the risk of developing MACCE at 1 year post CTO-PCI according to a model based solely on pre-procedural variables. These findings may lead to a better stratification of patients at risk for developing MACCE at 1 year post CTO-PCI, before performing other procedures. Furthermore, our study might reveal the current incident rate of developing MACCE at 1 year after performing CTO-PCI in a Japanese population.

Previous reports of successful long-term outcomes following CTO-PCI indicated that the mortality and target vessel revascularization (TVR) incidence rates at 5-year follow-up were 4.5% and 11.5%, respectively [19]. Although, the follow-up period was relatively shorter in our population, the outcomes might be similar to that of the previous report, based on our Kaplan-Meier analysis (the death and TVR incidence rates were 2.3% and 8.4% at 1 year post PCI, respectively). Previous investigations of the long-term prognosis following CTO-PCI have focused on comparisons of successful vs. unsuccessful cases and were not designed to assess the long-term prognosis using pre-procedural variables. With our novel strategy, approximately 80% of easy CTO-PCI cases could be passed with a single guidewire and, thus, have a shorter procedural time [24]. Conversely, difficult cases of CTO remain a challenge, and their procedural success rate is lower than that of easy cases [25,26], even when the procedures were performed by expert operators. Thus, owing to the difficulty in conducting the interventional procedures, the initial success rate of CTO-PCI has been inferior to that of CABG [4]. To select between the CTO-PCI and CABG procedures, we should consider the initial success rates and chronic outcomes, including revascularization. The performance of the PROGRESS CTO score for the prediction of long-term outcomes was tested recently, and the score was associated with the MACCE risk, albeit vigorous statistical adjustment was not performed [13]. To clarify the risk estimation of MACCE and refining the indication for CTO-PCI, a universal risk stratification was needed for assessing CTO-PCI as a suitable option for the treatment of ischemic heart disease. Although CTO-PCI has a potential of providing several benefits to patients with coronary artery disease, some of them might not receive such benefits, although the initial procedural success was obtained. Thus, it is important to identify a group of patients in whom CTO-PCI could contribute to their long-term outcome and use this information for the decision making of their therapeutic strategy, despite the difficulty in estimating the long-term outcome before an uncertain intervention like CTO-PCI. In our population, the previous CTO-PCI scoring systems could not predict the chronic outcomes of CTO-PCI (Fig 5). A specialized scoring model is required to predict the chronic outcome of CTO-PCI. This novel scoring system might help in choosing the appropriate revascularization method for patients with CTO lesions, just as the previous scores could help in estimating the initial success of CTO-PCI.

The main strength of our study was the development of a simple scoring model based on common clinical information. The association of the MACCE incidence and the cumulative effect of the variable listed in the score was linear and these variables were independently associated with the risk of MACCE development. The unique demographic characteristics of the patients with incidences of MACCE at 1 year follow-up were also revealed in this study, including the independent predictors of incidences of MACCE at 1 year follow-up (three clinical variables [e.g., hemodialysis, low LVEF, and diabetes mellitus] and one lesion-related variable [in-stent occlusion]). In this population, 1-year survival, non-fatal myocardial infarction, and non-fatal stroke were not different between the in-stent and not in-stent occlusion groups; however, target vessel revascularization was significantly higher in the in-stent occlusion group (p <0.0001). Although the follow-up rate was low, this study benefited from the high initial success rate of CTO-PCI amongst experienced Japanese operators (88.3% and 87.5% procedural and patient success rates, respectively).

However, our study had several limitations. First, core laboratory assessments were not performed. Therefore, all data, including the angiographic data, were obtained from the operators through self-report. Second, the occluded period could not be identified for more than 70% of the population, which is an issue often encountered in CTO research. Third, the low follow-up rate for patients is a significant concern. Sometimes, patients with CTO lesions were transferred from a small institution to a high-volume center; therefore, the patients would often be followed up by another institution after the procedure, which might be the cause of the low follow-up rate. Further analysis might be required in populations with high follow-up rates. Fourth, the follow-up period was relatively short. Finally, an antegrade dissection and the reentry system was not used, which might affect the outcome of CTO-PCI.

Conclusions

In this study we presented the clinical and angiographic parameters that predict the outcome in patients who had undergone CTO-PCI. Their data were obtained from a Japanese multicenter registry and were configured in the creation of a novel scoring model using a logistic regression approach. This model allows the identification of four subgroup scores corresponding to very-high, high, moderate, and low incidences of MACCE at the 1-year follow-up following CTO-PCI. The increased scores were correlated with a high probability of MACCE incidence at the 1-year follow-up, ranging from 5% to more than 35%. The J-CTO extension score was the only scoring system to predict MACCE outcomes following CTO-PCI. However, the applicability of the J-CTO extension score should be validated in other centers.

Supporting information

S1 Study protocol

(DOCX)

Acknowledgments

We are grateful to the members of the cardiac catheterization laboratories of the participating centers and the clinical research coordinators.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

Soichiro Ebisawa belongs to Endowed Department of Cardiovascular Medicine of Shinshu University supported by Medtronic Japan Co.,Ltd. Abbott Vascular Japan Co.,Ltd. Boston Scientific Japan, TERUMO CORPORATION, Cardinal Health Japan and NIPRO CORPORATION. The funders provided support in the form of salaries for Soichiro Ebisawa, but did not have any additional role in the study design, data collection and analysis, decision to publish or preparation of the manuscript.

References

  • 1.Teeuwen K, van der Schaaf RJ, Adriaenssens T, Koolen JJ, Smits PC, Henriques JPS, et al. Randomized multicenter trial investigating angiographic outcomes of hybrid sirolimus-eluting stents with biodegradable polymer compared with everolimus-eluting stents with durable polymer in chronic total occlusions: The PRISON IV trial. JACC Cardiovasc Interv. 2017;10:133–143. [DOI] [PubMed] [Google Scholar]
  • 2.Prasad A, Rihal CS, Lennon RJ, Wiste HJ, Singh M, Holmes DR Jr. Trends in outcomes after percutaneous coronary intervention for chronic total occlusions: a 25-year experience from the Mayo Clinic. J Am Coll Cardiol. 2007;49:1611–1618. [DOI] [PubMed] [Google Scholar]
  • 3.Kato M, Kimura T, Morimoto T, Nishikawa H, Uchida F, Suzuki H, et al. Comparison of five-year outcome of sirolimus-eluting stent implantation for chronic total occlusions versus for non-chronic total occlusion (from the j-Cypher registry). Am J Cardiol. 2012;110:1282–1289. [DOI] [PubMed] [Google Scholar]
  • 4.Weintraub WS, Garratt KN. Should chronic total occlusion be treated with coronary artery bypass grafting? Circulation. 2016;133:1807–1816. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Maeremans J, Dens J, Spratt JC Bagnall AJ, Stuijfzand W, Nap A, et al. Recharge investigators. antegrade dissection and reentry as part of the hybrid chronic total occlusion revascularization strategy: a subanalysis of the RECHARGE Registry (Registry of CrossBoss and Hybrid Procedures in France, the Netherlands, Belgium and United Kingdom). Circ Cardiovasc Interv. 2017;10:e004791. [DOI] [PubMed] [Google Scholar]
  • 6.Karatasakis A, Tarar MN, Karmpaliotis D, Alaswad K, Yeh RW, Jaffer FA, et al. Guidewire and microcatheter utilization patterns during antegrade wire escalation in chronic total occlusion percutaneous coronary intervention: Insights from a contemporary multicenter registry. Catheter Cardiovasc Interv. 2017;89:E90–E98. [DOI] [PubMed] [Google Scholar]
  • 7.Sapontis J, Salisbury AC, Yeh RW, Cohen DJ, Hirai T, Lombardi W, et al. Early procedural and health status outcomes after chronic total occlusion angioplasty: a report from the OPEN-CTO registry (outcomes, patient health status, and efficiency in chronic total occlusion hybrid procedures). J Am Coll Cardiol Interv 2017;10:1523–1534. [DOI] [PubMed] [Google Scholar]
  • 8.Christakopoulos GE, Christopoulos G, Karmpaliotis D, Alaswad K, Yeh RW, Jaffer FA, et al. Predictors of excess patient radiation exposure during chronic total occlusion coronary intervention: insights from a contemporary multicentre registry. Can J Cardiol 2017;33:478–484. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Michael TT, Karmpaliotis D, Brilakis ES, Alomar M, Abdullah SM, Kirkland BL, et al. Temporal trends of fluoroscopy time and contrast utilization in coronary chronic total occlusion revascularization: insights from a multicenter United States registry. Catheter Cardiovasc Interv. 2015;85:393–399. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Morino Y, Abe M, Morimoto T, Kimura T, Hayashi Y, Muramatsu T, et al. Predicting successful guidewire crossing through chronic total occlusion of native coronary lesions within 30 minutes: the J-CTO (Multicenter CTO Registry in Japan) score as a difficulty grading and time assessment tool. JACC Cardiovasc Interv. 2011;4:213–221. [DOI] [PubMed] [Google Scholar]
  • 11.Christopoulos G, Kandzari DE, Yeh RW, Jaffer FA, Karmpaliotis D, Wyman MR, et al. Development and validation of a novel scoring system for predicting technical success of chronic total occlusion percutaneous coronary interventions: the PROGRESS CTO (Prospective Global Registry for the Study of Chronic Total Occlusion Intervention) score. JACC Cardiovasc Interv. 2016;9:1–9. [DOI] [PubMed] [Google Scholar]
  • 12.Alessandrino G, Chevalier B, Lefevre T, Sanguineti F, Garot P, Unterseeh T, et al. Clinical and angiographic scoring system to predict the probability of successful first-attempt percutaneous coronary intervention in patients with total chronic coronary occlusion. JACC Cardiovasc Interv. 2015;8:1540–1548. [DOI] [PubMed] [Google Scholar]
  • 13.Forouzandeh F, Suh J, Stahl E, Ko YA, Lee S, Joshi U, et al. Performance of J-CTO and PROGRESS CTO scores in predicting angiographic success and long-term outcomes of percutaneous coronary interventions for chronic total occlusions. Am J Cardiol. 2018;121:14–20. [DOI] [PubMed] [Google Scholar]
  • 14.Escaned J, Collet C, Ryan N, De Maria GL, Walsh S, Sabate Μ, et al. Clinical outcomes of state-of-the-art percutaneous coronary revascularization in patients with de novo three vessel disease: 1-year results of the SYNTAX II study. Eur Heart J. 2017;38:3124–3134. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Werner GS, Ferrari M, Heinke S, Kuethe F, Surber R, Richartz BM, et al. Angiographic assessment of collateral connections in comparison with invasively determined collateral function in chronic coronary occlusions. Circulation. 2003;107:1972–1977. [DOI] [PubMed] [Google Scholar]
  • 16.Mehran R, Aymong ED, Nikolsky E, Lasic Z, Iakovou I, Fahy M, et al. A simple risk score for prediction of contrast-induced nephropathy after percutaneous coronary intervention: development and initial validation. J Am Coll Cardiol. 2004;44:1393–1389. [DOI] [PubMed] [Google Scholar]
  • 17.Peterson ED, Dai D, DeLong ER, Brennan JM, Singh M, Rao SV, et al. Contemporary mortality risk prediction for percutaneous coronary intervention: results from 588,398 procedures in the national cardiovascular data registry. J Am Coll Cardiol. 2010;55:1923–32. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Teramoto T, Tsuchikane E, Yamamoto M, Matsuo H, Kawase Y, Suzuki Y, et al. Successful revascularization improves long-term clinical outcome in patients with chronic coronary total occlusion. Int J Cardiol Heart Vasc. 2017;14:28–32. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Sanguineti F, Garot P, O'Connor S, Watanabe Y, Spaziano M, Lefevre T, et al. Chronic total coronary occlusion treated by percutaneous coronary intervention: long-term outcome in patients with and without diabetes. EuroIntervention. 2017;12:e1889–e1897. [DOI] [PubMed] [Google Scholar]
  • 20.Kandzari DE, Kini AS, Karmpaliotis D, Moses JW, Tummala PE, Grantham JA, et al. Safety and effectiveness of everolimus-eluting stents in chronic total coronary occlusion revascularization: results from the EXPERT CTO multicenter trial (Evaluation of the XIENCE Coronary Stent, Performance, and Technique in Chronic Total Occlusions). JACC Cardiovasc Interv. 2015;8:761–769. [DOI] [PubMed] [Google Scholar]
  • 21.Jones DA, Weerackody R, Rathod K, Behar J, Gallagher S, Knight CJ, et al. Successful recanalization of chronic total occlusions is associated with improved long-term survival. JACC Cardiol Interv. 2012;5:380–388. [DOI] [PubMed] [Google Scholar]
  • 22.George S, Cockburn J, Clayton TC, Ludman P, Cotton J, Spratt J, et al. British cardiovascular intervention, society national institute for cardiovascular outcomes, research. Long-term follow-up of elective chronic total coronary occlusion angioplasty: analysis from the U.K. central cardiac audit database. J Am Coll Cardiol. 2014;64:235–243. [DOI] [PubMed] [Google Scholar]
  • 23.Mehran R, Claessen BE, Godino C, Dangas GD, Obunai K, Kanwal S, et al. Multinational chronic total occlusion, registry. Long-term outcome of percutaneous coronary intervention for chronic total occlusions. JACC Cardiovasc Interv. 2011;4:952–961. [DOI] [PubMed] [Google Scholar]
  • 24.Ikari Y, Awata M, Mitsudo K, Akasaka T, Saito S, Ishihara T, et al. Efficient distal tip size of primary guidewire for antegrade percutaneous coronary intervention in chronic total occlusion: The G-FORCE study. Int J Cardiol. 2017;227:94–99. [DOI] [PubMed] [Google Scholar]
  • 25.Patel VG, Brayton KM, Tamayo A, Mogabgab O, Michael TT, Lo N, et al. Angiographic success and procedural complications in patients undergoing percutaneous coronary chronic total occlusion interventions: a weighted meta-analysis of 18,061 patients from 65 studies. JACC Cardiovasc Interv. 2013;6:128–136. [DOI] [PubMed] [Google Scholar]
  • 26.Danek BA, Karatasakis A, Karmpaliotis D, Alaswad K, Yeh RW, Jaffer FA, et al. Development and validation of a scoring system for predicting periprocedural complications during percutaneous coronary interventions of chronic total occlusions: The Prospective Global Registry for the Study of Chronic Total Occlusion Intervention (PROGRESS CTO) complications score. J Am Heart Assoc. 2016;5:e004272. [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Yoshiaki Taniyama

1 May 2020

PONE-D-20-00743

Derivation and validation of the J-CTO extension score for pre-procedural prediction of major adverse cardiac and cerebrovascular events in patients with chronic total occlusions

PLOS ONE

Dear Mr. Ebisawa,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The reviewer pointed out the problems, so please response them soon.

We would appreciate receiving your revised manuscript by Jun 15 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Yoshiaki Taniyama, MD, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.Thank you for including your ethics statement:

"This study was approved by the review board of each institution, and written informed consent was obtained from all patients."

a. Please amend your current ethics statement to include the full name of the ethics committee/institutional review board(s) that approved your specific study.

b. Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”).

For additional information about PLOS ONE ethical requirements for human subjects research, please refer to http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research.

3. Thank you for stating the following financial disclosure:

"The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

At this time, please address the following queries:

  1. Please clarify the sources of funding (financial or material support) for your study. List the grants or organizations that supported your study, including funding received from your institution.

  2. If any authors received a salary from any of your funders, please state which authors and which funders.

  3. If you did not receive any funding for this study, please state: “The authors received no specific funding for this work.”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

4. Thank you for stating the following in the Competing Interests section:

"I have read the journal's policy and the authors of this manuscript have the following competing interests: Soichiro Ebisawa; Affiliation with Endowed Department…Medtronic, Abbott Vascular Japan, Boston Scientifics Japan, TERUMO, NIPRO and Cordis."

We note that one or more of the authors are employed by commercial companies: Medtronic, Abbott Vascular Japan, Boston Scientifics Japan, TERUMO, NIPRO.

a. Please provide an amended Funding Statement declaring this commercial affiliation, as well as a statement regarding the Role of Funders in your study. If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study. You can update author roles in the Author Contributions section of the online submission form.

Please also include the following statement within your amended Funding Statement.

“The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.”

If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement.

b. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc. 

Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and  there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

c. Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

5. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

6. Please amend your list of authors on the manuscript to ensure that each author is linked to an affiliation. Authors’ affiliations should reflect the institution where the work was done (if authors moved subsequently, you can also list the new affiliation stating “current affiliation:….” as necessary).

7. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I have read with great interest the manuscript entitled “Derivation and validation of the J-CTO extension score for pre-procedural prediction of major adverse cardiac and cerebrovascular events in patients with chronic total occlusions”. The paper makes a significant contribution to the understanding of potential risk factors affecting the long-term prognosis of patients undergoing PCI for CTO. The article is well written, comprises a large number of patients treated at experienced Japanese centres, and a robust methodology provides a new perspective on the problem. Yet, a couple of issues should be elaborated or explained.

Comment 1

The inclusion/exclusion criteria seem unclear since the authors claim that they excluded from the baseline cohort (4909 patients) 770 subjects due to the lack of one-year follow-up data. From the remaining 4139 patients, they excluded another 2230, again because of the lack of one-year follow-up;

Comment 2

Very few data on PCI techniques were presented in the document. The authors should submit at least the percentage of patients revascularized with antegrade and retrograde technique. Also, it is desirable to mention if the PCI technique had any influence on the clinical outcomes;

Comment 3

One of the most surprising observations is the fact that the initial success of the procedure was not associated with the incidence of one-year MACCE. The authors just mention this very casually; I believe they should present more data on this, at least respective percentages in Table 2;

Comment 4

Another remarkable finding was that in-stent occlusion lesions were associated with the incidence of MACCE; I believe the authors should elaborate on this observation in the Discussion section;

Comment 5

Finally, recently The EuroCTO (CASTLE) Score has been published. Would it be possible to analyze its predictive value, just as the authors did for two other scores (PROGRES and CL score?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Sep 11;15(9):e0238640. doi: 10.1371/journal.pone.0238640.r002

Author response to Decision Letter 0


11 May 2020

Dear Dr. Yoshiaki Taniyama:

Ref. No.: PONE-D-20-00743

Title: Derivation and Validation of the PJ-CTO Score for Pre-Procedural Prediction of Major Coronary and Cerebrovascular Events in Patients with Chronic Total Occlusions.

I, along with my coauthors, would like to re-submit the attached manuscript as an Original Article.

The manuscript has been carefully rechecked and appropriate changes have been made in accordance with the reviewers’ suggestions. The responses to their comments have been prepared and attached herewith.

We thank you and the reviewers for your thoughtful suggestions and insights, which have enriched the manuscript and produced a more balanced and better account of the research. We hope that the revised manuscript is now suitable for publication in your esteemed PLOS ONE:

We look forward to hearing from you at your earliest convenience.

Sincerely,

Soichiro Ebisawa, MD, PhD

Department of Cardiovascular Medicine, Shinshu University School of Medicine

3-1-1 Asahi, Matsumoto-shi 390-8621, Japan

Tel: +81-263-37-3486/Fax: +81-263-37-3489

Email: ebisawa@shinshu-u.ac.jp

Comments from the editors and reviewers:

Reviewer #1: I have read with great interest the manuscript entitled “Derivation and validation of the J-CTO extension score for pre-procedural prediction of major adverse cardiac and cerebrovascular events in patients with chronic total occlusions”. The paper makes a significant contribution to the understanding of potential risk factors affecting the long-term prognosis of patients undergoing PCI for CTO. The article is well written, comprises a large number of patients treated at experienced Japanese centres, and a robust methodology provides a new perspective on the problem. Yet, a couple of issues should be elaborated or explained.

Response

We would like to express our appreciation to the Reviewer for his/her insightful comments, which have helped us to improve the report significantly.

Comment 1

The inclusion/exclusion criteria seem unclear since the authors claim that they excluded from the baseline cohort (4909 patients) 770 subjects due to the lack of one-year follow-up data. From the remaining 4139 patients, they excluded another 2230, again because of the lack of one-year follow-up;

Response

Indeed, I thought it was unclear and difficult to understand the meaning of sentence. It means 770 patients who underwent procedures in institutions that did not join collect follow-up one-year data, and I excluded such institution’s data at first. However, 2230 patients still had no data of one-year follow up and should be excluded.

According to the reviewer’s comment, we change the sentences as “did not join to collect one-year follow-up data” in line 16 page 6.

Comment 2

Very few data on PCI techniques were presented in the document. The authors should submit at least the percentage of patients revascularized with antegrade and retrograde technique. Also, it is desirable to mention if the PCI technique had any influence on the clinical outcomes;

Response

The reviewer raise an important point.

According to the reviewer’s comment, we add the sentences “Regarding with technical issue, retrograde approach was performed in 606 cases (31.7%), however this procedure was not associated with both initial success (p=0.569) and incidence of one-year MACCE (p=0.368)” in line 11 page 10.

Comment 3

One of the most surprising observations is the fact that the initial success of the procedure was not associated with the incidence of one-year MACCE. The authors just mention this very casually; I believe they should present more data on this, at least respective percentages in Table 2;

Response

CTO-PCI has been improved latest 10 years, however initial success might not necessarily reflect the long-term outcome. We think this comment is very important in this field, and we should establish another registry to assess this point.

According to the reviewer’s comment, we add the correlation between initial procedural success and incidence of one-year MACCE in table 2.

Comment 4

Another remarkable finding was that in-stent occlusion lesions were associated with the incidence of MACCE; I believe the authors should elaborate on this observation in the Discussion section;

Response

This comment is also important. Long term outcome of PCI after in stent occlusion case was not favorable. We should assess the indication of revascularization of in stent occlusion lesion.

According to reviewer’s comment, we add the sentence of “In this population, one-year survival, non-fatal myocardial infarction and non-fatal stroke were not different between in-stent occlusion and not in-stent occlusion group, however target vessel revascularization was significantly higher in in-stent occlusion group (p<0.0001)” in line 8 page 23.

Comment 5

Finally, recently The EuroCTO (CASTLE) Score has been published. Would it be possible to analyze its predictive value, just as the authors did for two other scores (PROGRES and CL score?

Response

When, first time, we submit this manuscript, CASTLE score was not established. We also think this score is well-established score in big population data. According to the comment we compare between J-CTO extension score and CASTLE by ROC analysis, CASTLE score was not associated with one-year MACCE (AUC=0.557), while J-CTO extension score was associated with one-year MACCE (AUC=0.647).

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Yoshiaki Taniyama

4 Jun 2020

PONE-D-20-00743R1

Derivation and validation of the J-CTO extension score for pre-procedural prediction of major adverse cardiac and cerebrovascular events in patients with chronic total occlusions

PLOS ONE

Dear Dr. Ebisawa,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We did statistical review, and got some problems. Please response to them.

Please submit your revised manuscript by Jul 19 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Yoshiaki Taniyama, MD, PhD

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors responded to my comments in a satisfactory manner, and I believe that the paper is suitable for publication in its current form.

Reviewer #2: PONE-D-20-00743R1: statistical review

SUMMARY. This paper investigates factors that increase the risk of developing major adverse events (MACCE) among patients with chronic total occlusion who undergo percutaneous coronary intervention (PCI). The statistical analysis is made in two steps. First a battery of logistic regression models is estimated to identify the significant predictors of MACCE. Then the results of the logistic regression are used to define a risk score. I have little to say about the first step: logistic regression is the correct methodology to identify risk factors and it is appropriately developed in the paper. I have however some concerns about the second step (see major issues below). I also list below some specific points that should be addressed.

MAJOR ISSUES

1) The multivariate logistic regression estimates provided in Table 3 provide an optimal way to estimate the probability of a MACCE, through the formula

Prob(MACCE01)= exp(beta_0+beta_1x_1+ ... \\beta_Kx_k)/(1+exp(beta_0+beta_1x_1+ ... \\beta_Kx_k))

where the betas are log-ORs. The proposed score makes sense only if it able to beat the predictive power of the multivariate logistic regression. The only way to prove this is to fit a logistic regression model

logit(Prob(MACCE=1))=beta_0+beta_1 score and compare this model to the multivariate regression of Table 3.

2) Line 8, page 16 "We created a scoring model (J-CTO Extension score) according to the odds ratio". I was not able to understand the rule that has been used to transform the odds ratios into the scores. Please clarify.

3) If I understood correctly (not clear from text), the score is defined by summing the scores in the last column of Table 3. This makes sense if the cumulative effects of hemodialysis, LVEF<35%, in-stent occlusion and DM=1 is additive. However, the multivariate logistic regression of Table 3 clearly tells another story, that the cumulative effect of these factors is nonlinear.

SPECIFIC ISSUES

1) Please clarify that MACCE means "major adverse cardiac and cerebrovascular event" in the abstract.

2) The phrase "the area under the curve" appears often in both the abstract and the main text: it should be replaced by "the are under the ROC curve".

3) page 9, line 15: why "paired" t-test? I guess that the analysis is not based on paired observations. Please check.

4) From Figures 2 and 3A, it seems that the proposed score is treated as a categorical covariate. Why? Cutting a continuous variable in classes is a unnecessary waste of information and it is not generally recommended.

5) I was not able to understand what figure 3B represents. How were the predicted and the observed risks computed? Please clarify.

6) Although the authors declare that the data are fully available without restriction, there is no data attached. The data should be attached to the paper as supplementary file to allow results reproducibility.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Sep 11;15(9):e0238640. doi: 10.1371/journal.pone.0238640.r004

Author response to Decision Letter 1


4 Aug 2020

July 15th, 2020

Dr. Yoshiaki Taniyama

Academic Editor

PLOS ONE

Dear Dr. Yoshiaki Taniyama:

Ref. No.: PONE-D-20-00743

Title: Derivation and Validation of the PJ-CTO Score for Pre-Procedural Prediction of Major Coronary and Cerebrovascular Events in Patients with Chronic Total Occlusions.

I, along with my coauthors, would like to re-submit the attached manuscript as an Original Article in PLOS ONE. The manuscript has been carefully rechecked and appropriate changes have been made in accordance with the reviewers’ suggestions. In particular, we have addressed all the reviewer's comments in a point-by-point manner and revisions are indicated in red font in the revised paper. We would like to thank you and the reviewers for your thoughtful suggestions and insights, which have enriched the manuscript and produced a more balanced and better account of the research.

We hope that the revised manuscript is viewed favorably. We look forward to hearing from you.

Sincerely,

Soichiro Ebisawa, MD, PhD

Department of Cardiovascular Medicine, Shinshu University School of Medicine

3-1-1 Asahi, Matsumoto-shi 390-8621, Japan

Tel: +81-263-37-3486/Fax: +81-263-37-3489

Email: ebisawa@shinshu-u.ac.jp

Reviewer #2: PONE-D-20-00743R1: statistical review

SUMMARY. This paper investigates factors that increase the risk of developing major adverse events (MACCE) among patients with chronic total occlusion who undergo percutaneous coronary intervention (PCI). The statistical analysis is made in two steps. First a battery of logistic regression models is estimated to identify the significant predictors of MACCE. Then the results of the logistic regression are used to define a risk score. I have little to say about the first step: logistic regression is the correct methodology to identify risk factors and it is appropriately developed in the paper. I have however some concerns about the second step (see major issues below). I also list below some specific points that should be addressed.

MAJOR ISSUES

1) The multivariate logistic regression estimates provided in Table 3 provide an optimal way to estimate the probability of a MACCE, through the formula

Prob(MACCE01)= exp(beta_0+beta_1x_1+ ... \\beta_Kx_k)/(1+exp(beta_0+beta_1x_1+ ... \\beta_Kx_k))

where the betas are log-ORs. The proposed score makes sense only if it able to beat the predictive power of the multivariate logistic regression. The only way to prove this is to fit a logistic regression model

logit(Prob(MACCE=1))=beta_0+beta_1 score and compare this model to the multivariate regression of Table 3.

Response

We appreciate the reviewer’s thoughtful suggestion. Following his/her comment, we constructed the multivariate logistic regression model and compared its performance with our scoring system. When the C-stats were calculated for each model, no statistically significant difference between the two models was observed (0.665 vs. 0.658 for the scoring system and multivariate logistic regression model, respectively). We believe that our scoring system has an advantage over the traditional logistic regression model, given, its simplicity and relevance of chosen variables in clinical practice.

Accordingly, we have added the following sentence to the revised manuscript (page 16, line 15)

“To assess the predictive power of this model, the proposed performance scoring system was compared with that of the traditional multivariate regression model (covariates selected from variables in Table 3) and only a small difference in C-statistics between them was observed (0.665 vs. 0.658).”

2) Line 8, page 16 "We created a scoring model (J-CTO Extension score) according to the odds ratio". I was not able to understand the rule that has been used to transform the odds ratios into the scores. Please clarify.

Response

We would like to thank the reviewer for the comment. To construct our scoring model, identified variables (from traditional logistic regression analyses) were assigned a weighted integer based on the calculated odds ratio. This method has been validated in previous reports. For example, R. Mehran, et al. demonstrated that this integer scoring system was useful in prediction of contrast induced nephropathy (J Am Coll Cardiol 2004;44:1393-1389). More recently, the National Cardiovascular Data Registry (from the American College of Cardiology) developed risk estimation models using the same method (J Am Coll Cardiol 2010;55:1923-32 and J Am Coll Cardiol 2013;6:790-799). These methods are simple and perhaps user-friendly. We have changed the aforementioned sentence, as follows:

“We created a scoring model (J-CTO extension score) by assigning a weighted integer based on the calculated OR”

3) If I understood correctly (not clear from text), the score is defined by summing the scores in the last column of Table 3. This makes sense if the cumulative effects of hemodialysis, LVEF<35%, in-stent occlusion and DM=1 is additive. However, the multivariate logistic regression of Table 3 clearly tells another story, that the cumulative effect of these factors is nonlinear.

Response

We would like to thank the reviewer for the valuable comments. The reviewer correctly stated that the score is defined by summing the scores listed in Table 3. To address the reviewer’s concern, we have directly calculated the incidence of MACCE and number of the variables group (variable number = 0, 1, 2 and 3 or 4).

Figure A

As demonstrated in Figure A, the association of MACCE incidence and cumulative effect of the variable listed in the score was indeed linear. We have also looked at the distribution of the aforementioned variables among our patients (Figure B). The majority of the patients with the above variables (hemodialysis [HD], in-stent occlusion [ISO], and low LVEF) did not overlap in patients with or without diabetes (DM).

Figure B

Please also note that HD, in stent occlusion, low LVEF, and DM were independently associated with risk of MACCE within our original logistic regression analysis. We have also compared the performance of this inter scoring system with a traditional logistic regression model (in response to Comment #1), and the c-stats were almost equivocal.

Please note that we have added the following sentence in our revised manuscript (line 14 page 23

“The association of the MACCE incidence and the cumulative effect of the variable listed in the score was linear and these variables were independently associated with the risk of MACCE development.”

SPECIFIC ISSUES

1) Please clarify that MACCE means "major adverse cardiac and cerebrovascular event" in the abstract.

Response

According to the reviewer’s point, we have added the sentence “major adverse cardiac and cerebrovascular event” in the Abstract section.

2) The phrase "the area under the curve" appears often in both the abstract and the main text: it should be replaced by "the are under the ROC curve".

Response

Following the reviewer’s suggestion, we have replaced the phrase “the area under the curve” with “the area under the ROC” in the manuscript.

3) page 9, line 15: why "paired" t-test? I guess that the analysis is not based on paired observations. Please check.

Response

We agree with the reviewer. According to the reviewer’s suggestion, we have revised this point from paired to unpaired.

4) From Figures 2 and 3A, it seems that the proposed score is treated as a categorical covariate. Why? Cutting a continuous variable in classes is a unnecessary waste of information and it is not generally recommended.

Response

The reviewer raised an important point which we agree with.

One of the purposes of this study was to assess the risk stratification of CTO-PCI. To assess the risk of each case simpler, we evaluated the four-risk groups.

5) I was not able to understand what figure 3B represents. How were the predicted and the observed risks computed? Please clarify.

Response

We appreciate the reviewer’s important suggestion.

For calibration of this scoring model performance, we represented Figure 3B.

We have divided the validation cohort into 10 groups according to the risk score and calculated the predicted risks by logistic regression analysis. Then, we compared the observed and the predicted risks in each group.

We have revised the correlation between the observed and predicted risks and there was significant correlation between of them (r = 0.77).

According to this result, we have replaced the Figure 4B in the revised manuscript (below).

Figure 4B

6) Although the authors declare that the data are fully available without restriction, there is no data attached. The data should be attached to the paper as supplementary file to allow results reproducibility.

Response

The data and materials used to conduct this research are available to the researchers to reproduce the results or replicate the procedure on request. The procedure does need to follow the Act on the Protection of Personal Information Law (as of May 2017) and the Ethical Guidelines for Medical and Health Research Involving Human Subjects (as of March 2015) in Japan.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Yoshiaki Taniyama

21 Aug 2020

Derivation and validation of the J-CTO extension score for pre-procedural prediction of major adverse cardiac and cerebrovascular events in patients with chronic total occlusions

PONE-D-20-00743R2

Dear Dr. Ebisawa,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Yoshiaki Taniyama, MD, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: (No Response)

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: (No Response)

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: (No Response)

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Acceptance letter

Yoshiaki Taniyama

25 Aug 2020

PONE-D-20-00743R2

Derivation and validation of the J-CTO extension score for pre-procedural prediction of major adverse cardiac and cerebrovascular events in patients with chronic total occlusions

Dear Dr. Ebisawa:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr Yoshiaki Taniyama

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Study protocol

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES