Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Apr 21;16(4):e0249772. doi: 10.1371/journal.pone.0249772

Effect of different thresholds for CT perfusion volumetric analysis on estimated ischemic core and penumbral volumes

Simo Karhi 1,2,*, Olli Tähtinen 1,2, Joona Aherto 1,2, Hanna Matikka 1, Hannu Manninen 1,2, Ossi Nerg 3,4, Mikko Taina 1,2, Pekka Jäkälä 3,4, Ritva Vanninen 1,2
Editor: Ona Wu5
PMCID: PMC8059822  PMID: 33882098

Abstract

Purpose

This single-center study compared three threshold settings for automated analysis of the ischemic core (IC) and penumbral volumes using computed tomographic perfusion, and their accuracy for predicting final infarct volume (FIV) in patients with anterior circulation acute ischemic stroke (AIS).

Methods

Fifty-two consecutive AIS patients undergoing mechanical thrombectomy (November 2015–March 2018) were included. Perfusion images were retrospectively analyzed using a single CT Neuro perfusion application (syngo.via 4.1, Siemens Healthcare GmbH). Three threshold values (S1–S3) were derived from another commercial package (RAPID; iSchema View) (S1), up-to-date syngo.via default values (S2), and adapted values for syngo.via from a reference study (S3). The results were compared with FIV determined by non-contrast CT.

Results

The median IC volume (mL) was 24.6 (interquartile range: 13.7–58.1) with S1 and 30.1 (20.1–53.1) with S2/S3. After removing the contralateral hemisphere from the analysis, the median IC volume decreased by 1.33(0–3.14) with S1 versus 9.13 (6.24–14.82) with S2/S3. The median penumbral volume (mL) was 74.52 (49.64–131.91), 77.86 (46.56–99.23), and 173.23 (125.86–200.64) for S1, S2, and S3, respectively. Limiting analysis to the affected hemisphere, the penumbral volume decreased by 1.6 (0.13–9.02), 19.29 (12.59–26.52), and 58.33 mL (45.53–74.84) for S1, S2, and S3, respectively. The correlation between IC and FIV was highest in patients with successful recanalization (n = 34, r = 0.784 for S1; r = 0.797 for S2/S3).

Conclusion

Optimizing thresholds significantly improves the accuracy of estimated IC and penumbral volumes. Current recommended values produce diversified results. International guidelines based on larger multicenter studies should be established to support the standardization of volumetric analysis in clinical decision-making.

Introduction

The use of computed tomographic perfusion (CTP) and computed tomographic angiography (CTA) imaging for diagnosis of acute ischemic stroke has increased dramatically over the last decade [1, 2]. Several recent large-scale randomized controlled trials have further established the role of CT to help select patients for endovascular treatment (EVT) and improve their outcomes [39]. Information gained from CTP has also been used to support the clinical decision-making for patients admitted more than 6 h after symptom onset [1012]. The ischemic core (IC) and hypoperfused tissue volumes obtained by CTP were shown to predict final infarct volume (FIV) determined by follow-up non-contrast CT (NCCT) or magnetic resonance imaging [13]. However, a small ischemic area seems to be the only independent predictor of good reperfusion, even after complete recanalization [14] and in some cases, the IC determined by CTP could overestimate the size of the infarct, especially in patients with early reperfusion [15, 16].

Compared with methods based on different visual scoring systems, the quantitative volumetric measurements made using automated software show better correlations with the patient outcomes [17, 18]. Individual scores estimated with the Alberta Stroke Program Early CT Score (ASPECTS), for example, may represent a wide range of absolute IC volumes due to the unequal weighting and inter-individual variability of certain brain regions that may affect patient selection [19]. In the future, fully automated and validated software for volumetric assessment could be utilized in primary treatment centers, supporting earlier decision-making and potentially reducing the time to reperfusion [20].

A comparative study showed that the accuracy of CTP analysis differs between commercial software packages when using the company’s default threshold values for detecting the IC [21]. Another recent post hoc study reported that estimated IC volumes vary greatly between three postprocessing software packages [22]. Thus, the observed differences are not just dependent on the software/hardware company, because the threshold values entered into the software are usually modifiable. However, that study [22] also indicated that utilization of similar threshold levels for measurements might still not provide optimal agreement between software from different companies. In addition to differences in the ability to estimate IC volumes, the software settings recommended by each company may differ in their ability to assess the penumbral volume, another important parameter used in clinical decision-making. Furthermore, semiautomatic CTP analysis may yield results that vary with the distribution of the analyzed parenchyma, including whether the analysis was limited to the ipsilateral parenchyma or included both hemispheres.

The aims of this retrospective single-center study were 1) to evaluate the performance of a single postprocessing tool using three threshold values adapted from the default settings recommended by different software companies, 2) to compare the CTP maps obtained with these three threshold settings, and 3) to compare the CTP maps obtained using data from the ipsilateral hemisphere only vs. CTP maps created using data from bilateral hemispheres.

Materials and methods

Patients and endovascular procedures

The study was approved by the Research Ethics Board of the Kuopio University Hospital (KUH) (no. 5772789) and was conducted according to the principles of the Declaration of Helsinki. Patient data was anonymized prior to conduction of the study. Due to the nature of a retrospective registry study, ethical board waived the need for informed consent. Between December 2015 and March 2018, all patients admitted with AIS (Acute Ischemic Stroke, estimated n = 1400) were scheduled for head CT, CTA, and CTP. A total of 125 patients with CTA-confirmed anterior circulation large artery occlusion (LAO) and a suitable IC/perfusion profile in CTP were selected for endovascular reperfusion procedures. According to international guidelines, individual treatment decisions were based on duration of symptoms, distance to the university hospital, other underlying diseases, and the functional status prior to stroke [23, 24]. For the purpose of this study, we applied the following inclusion criteria: age ≥18 years; LAO of the anterior circulation (distal ICA; MCA M1 or M2 segment), no concomitant carotid artery stenting; and relevant imaging performed at our hospital prior to treatment. Altogether, 73 patients were excluded for the following reasons: 32 patients with no suitable imaging data for the study retrospectively available (imaging performed elsewhere, n = 23; CTP not performed, n = 5; CTP failure, n = 2; control imaging with magnetic resonance imaging, n = 2) and 27 patients for other reasons (fluctuating symptoms, n = 2; chronic intracranial stenosis in angiography, n = 5; proximal ICA stenosis requiring carotid artery stenting, n = 20). Another 14 patients were excluded due to good response to bridging therapy with intravenous thrombolysis.

For the remaining 52 patients, age, gender, and clinical background information were retrospectively collected from medical records. This included data on medically treated hypertension, diabetes, hypercholesterolemia, known atrial fibrillation, or coronary artery disease along with AIS onset, imaging and reperfusion times, and delays. Post-procedural reperfusion was retrospectively evaluated from the patient records and postprocedural angiography images. This was considered successful in patients with TICI (Thrombolysis In Cerebral Infarction) score of 2b or 3 and unsuccessful in patients with a TICI score of ≤2a [25]. The endovascular procedures are described in S1 Fig and S1 Text and S1S3 Tables.

Image acquisition

On admission, the patients were scanned according to a routine clinical CT stroke protocol, which included non-contrast head CT, CTP, and CTA to assess the cervicocranial arteries, followed immediately by scanning of the ascending aorta and heart. SOMATOM Definition Flash or SOMATOM Definition Edge scanners (Siemens Healthcare, Erlangen, Germany) with 64-row Stellar detectors were used with a contrast bolus of 50 mL (Omnipaque 350 mg/mL, 6 mL/s) to assess cerebral perfusion. The perfusion images were acquired every 1.5 s in the sequence shuttle mode (80 kVp, 80 mAs, 64 × 0.6 mm collimation, 0.57 s, CTDIvol = 84 mGy, total scan time 35 s), which enables brain coverage of 10 cm.

CTP volumetric analysis

The CTP images were analyzed using CT Neuroperfusion software (syngo.via 4.1 VB30A; Siemens Healthcare GmbH, Erlangen, Germany) with automated preprocessing for motion correction, brain tissue segmentation (removal of air, bone, and cerebrospinal fluid) and vessel definition. The deconvolution method was used to compile perfusion maps with indicated parameters for cerebral blood flow (CBF), cerebral blood volume (CBV), mean transit time (MTT), time to peak (TTP), and time to maximum (Tmax) [26]. The volumes of tissues at risk (i.e., penumbra, defined as the total hypoperfused tissue − IC) and non-viable tissue (i.e., IC) were derived from these maps. The CTP analysis was first performed using bilateral data of both hemispheres, while the side with the longest time to drain was automatically characterized as the lesion side and the contralateral side was used as a reference for relative values. Then, the analyses were performed for the affected hemisphere only. A single observer (SK) entered the imaging data into the automated processing software using the following three settings:

Setting 1 (S1): Threshold settings adapted from the commercial volumetric analysis package RAPID (iSchema View, Menlo Park, CA), where regions with a Tmax delay of >6 s are registered as hypoperfused tissues and the IC is derived as the volume of tissue with a relative CBF of <30% that of normal tissue [17, 21, 2730].

Setting 2 (S2): Threshold settings where regions with a CBF of <27/100 mL/min are registered as hypoperfused tissue and the IC is derived as the region with CBV <1.2/100 mL [26]. These were also the default values for deconvolution-based calculation in the CT Neuro Perfusion software.

Setting 3 (S3): Thresholds settings recognizing hypoperfused tissue as a region of tissue with a CBF of <35.1/100 mL/min and the IC is defined as in S2: these were prior default setting of the software, also used in a recent reference study [21, 26, 31].

Final infarct volume

The patients underwent a NCCT scan 1–4 days (mean 1 ± 0.75 days) after hospital admission on a SOMATOM Definition Flash scanner (Siemens Healthcare, Erlangen, Germany). The scan protocol was either a regular non–contrast helical head CT (64 × 0.6 mm collimation, 100 kVp with quality ref. mAs 322, 0.55 s rotation time, pitch 0.55, 4D dose modulation (CAREDose) and organ based modulation (X-care) on) or a regular head DECT (40 x 0.6 mm collimation, 80 kVp and 140 kVp with ref. mAs 360 and 180 respectively, 0.5 s rotation time, pitch 0.55 and 4D dose modulation on). The FIV was measured by an independent observer (JA) together with an experienced interventional neuroradiologist (OT), both being blinded to other clinical information. Transversal consecutive 4.5–5.0 mm thick slices of the head CT in the subacute phase were used to measure areas on a Sectra workstation (version 20.1.7.2386; Sectra, Linköping, Sweden). The FIV was calculated using Simpson’s method by multiplying each manually traced infarction area by the section thickness and summing the volumes of the separate sections [32].

Statistical analysis

Statistical analyses were performed using SPSS for Macintosh version 24 (SPSS, Chicago, IL). Continuous variables are presented as the mean and standard deviation (SD), or as the median and interquartile range (IQR) for variables showing skewed distributions. Categorical variables are presented as the absolute frequencies or percentages. When measured values did not show a normal distribution based on the Kolmogorov–Smirnov test, the Mann–Whitney U test was used to compare groups. Wilcoxon’s signed rank test was used to detect paired differences in the IC and penumbral volumes between different threshold settings and FIV, and between differences measured from both hemispheres versus the affected hemisphere data within each setting. Additionally, differences between each setting pair were tested on one sample T-test, and pairs showing non-significant difference were evaluated using Bland Altman Plots. Pearson’s χ2 test was used to determine associations between nominal variables, and Fisher’s exact test was used when appropriate. P-values <0.05 were set to indicate statistically significant results. Pearson’s correlation coefficient was used to evaluate the strength of correlations with FIV in subgroups of patients. In subgroup analyses, the patients were dichotomized into two groups according to the success of the reperfusion (i.e., TICI 2b/3).

Results

Of 125 consecutive EVT patients, 52 were included in the study. The baseline, radiological, and procedural characteristics of these patients are described in the S1 Fig and S1 Text and S1S3 Tables.

Ischemic Core volume

The IC volumes are listed in Table 1. When IC was measured using data from both hemispheres, the median volume was 24.6 mL (IQR 13.7–58.1 mL) with S1 and 30.1 mL (IQR 20.1–53.1 mL) with S2/S3 (paired difference P = 0.231). When the analysis was limited to the affected hemisphere, the median IC volumes were 20.89 mL (IQR 11.11–49.85 mL) with S1 and 19.94 mL (IQR 11.54–28.65 mL) with S2/S3 (Paired difference P = 0.028 in the Wilcoxon test). Differences between S1 and S2/3 volume measurements were further tested on One Sample T-test, and no difference was observed between the IC volumes when using both hemispheres for measurements (P = 0.368). When IC measurements were performed with the affected hemisphere only, IC volumes measured using S1 were significantly larger compared to those measured using setting S2/3 (P = 0.006). A similar result was observed, when performing the tests in a subgroup of patients with successful recanalization only (TICI 2b/3, n = 34) with no difference (P = 0.279) using both hemispheres and a significant difference (P = 0.030) when using the affected hemisphere only. These results are illustrated in Fig 1A–1D. A Bland Altman plot visualizes the pair S1 versus S2/3 using both hemispheres, with no significant difference between these settings on One Sample T-test (Fig 2, panel A).

Table 1. Comparison of ischemic core and penumbral volumes (in mL).

Ischemic Core Volume (mL) Penumbral volume (mL)
Both hemispheres Affected hemisphere P* Both hemispheres Affected hemisphere P*
Median IQR Median IQR Median IQR Median IQR
S1 24.6 13.7–58.1 20.89 11.11–49.8 <0.001 74.52 49.64–131.91 70.51 46.59–121.57 <0.001
S2 30.1 20.1–53.1 19.94 11.54–28.65 <0.001 77.86 46.56–99.23 55.97 31.11–75.00 <0.001
S3 30.1 20.1–53.1 19.94 11.54–28.65 <0.001 173.23 125.86–200.64 110.80 74.69–132.54 <0.001
P*, S1 vs. S2 0.231 0.028 0.316 <0.01
P*, S1 vs. S3 0.231 0.028 <0.01 <0.01
P*, S2 vs. S3 - - <0.01 <0.01

*Wilcoxon test

IQR indicates interquartile range; S1, setting 1; S2, setting 2; and S3, setting 3.

The CTP analysis was first performed using bilateral data of both hemispheres, then from the affected hemisphere only.

Fig 1.

Fig 1

Paired comparisons of the automatically calculated ischemic core volumes (mL) for each patient measured using setting 1 (S1) versus settings 2 or 3 (S2/S3) using data from both hemispheres (A), for S1 versus S2/S3 using data from the affected hemisphere only (B); for S1 using data from the bilateral versus ipsilateral hemispheres (C), and for S2/S3 using data from the bilateral versus ipsilateral hemispheres (D).

Fig 2. Bland Altman plot visualizing the relationship of the differences of measured volumes between those setting pairs with no significant differences detected using One Sample T tests.

Fig 2

A: Measured ischemic core differences between setting 1 (S1) versus setting 2 (S2) using data from both hemispheres. B: Measured penumbral differences using S1 versus S2 with data from both hemispheres. Upper and lower 95% confidence limits for the mean difference in volumes are visualized using thinnest dotted lines.

Penumbral volume

The penumbral volumes are listed in Table 1. When the penumbral volume was measured using data from both hemispheres, the median volume was 74.52 mL (IQR 49.64–131.91 mL) with S1, 77.86 mL (IQR 46.56–99.23 mL) with S2, and significantly larger at 173.23 mL (IQR 125.86–200.64) with S3. When both hemispheres were included, Wilcoxon test showed significant differences in penumbral volume between two setting pairs (S1 vs S3, and S2 vs S3, P<0.01) and non-significant difference between S1 and S2 (P = 0.316). When the analysis was based on the affected hemisphere, the median penumbral volumes were 70.51 mL (IQR 46.59–121.57 mL) with S1, 55.97 mL (IQR 31.11–75.00) with S2, and 110.80 mL (IQR 74.69–132.54 mL) with S3. These results are illustrated in Fig 3A–3C. Using the affected hemisphere, the differences in penumbral volume between each pair (S1 vs S2, S1 vs S3, and S2 vs S3) were statistically significant using the Wilcoxon test (P < 0.001). Additional one Sample T-tests on the difference between the penumbral volumes measured with each setting were performed, and in line with the Wilcoxon test, no significant difference between S1 and S2 using both hemispheres was observed (P = 0.093)—this setting pair is further visualized using Bland Altman plot (Fig 2, Panel B). Difference between all other pairs showed statistically significant differences (P < 0.01).

Fig 3.

Fig 3

Paired comparisons of the automatically calculated penumbral volumes (mL) for each patient for setting 1 (S1) versus setting 2 (S2), S1 versus setting 3 (S3), and S2 versus S3 using data from both hemispheres (A); S1 versus S2, S1 versus S3, and S2 versus S3 using data from the affected hemisphere only (B); and S1, S2, and S3 using data from the bilateral versus ipsilateral affected hemispheres (C).

Bilateral vs. affected hemisphere

In paired comparisons using data from both hemispheres versus data from the affected hemisphere, the IC volumes differed significantly within S1 and S2/S3 (P < 0.001), and the estimated IC volumes were larger when both hemispheres were included. Compared to bilateral measurement, using only the affected hemisphere resulted in a median volume reduction of 1.33 mL (IQR 0–3.14) for S1. For S2/3, the volume difference was 9.13 mL (IQR 6.24–14.82 mL). The penumbral volume was smaller when calculated using the affected hemisphere compared with bilateral hemispheres, with significant differences for each setting (P < 0.001). When comparing the different settings, the volume loss was 1.6 mL (IQR 0.13–9.02 mL) with S1 and 19.29 mL (IQR 12.59–26.52 mL) with S2 and was greatest with S3 at 58.33 mL (IQR 45.53–74.84 mL). The volume distributions can be visualized in Figs 3 and 4.

Fig 4. Illustrative computed tomographic perfusion map images for a patient with ischemic stroke.

Fig 4

(A–C) Data were postprocessed using the threshold values adapted to Syngo.via from another commercial software package (setting 1) (A), up-to-date company-recommended threshold values for Syngo.via (setting 2) (B), and older Syngo.via default parameters used in a reference study (setting 3) (C). (D) Limiting the analysis to the affected hemisphere using setting 3 yields a sensible, but faulty estimate of the penumbra and ischemic core volumes, potentially resulting in inaccurate diagnosis.

Association between estimated IC volume and final infarct volume

The association between IC and FIV was analyzed using the patient group with a successful recanalization (TICI 2b/3, n = 34). Correlation coefficients were also tested on the whole patient population for comparison. Associations between the ischemic core volume and final infarct volume can be found in Table 2.

Table 2. Associations between the ischemic core volume and final infarct volume in all patients and those patients with a successful recanalization (TICI 2b/3).

All patients Patients with TICI 2b/3
IC (mL) FIV−IC (mL) r P* IC (mL) FIV−IC (mL) r P*
S1 both hemispheres 24.6 (13.7–58.1) 0.16 (−14.8 to 19.3) 0.663 0.636 24.0 (13.9–63.7) −3.9 (−16.3 to 20.55) 0.774 0.952
S1 affected hemisphere 20.9 (11.1–49.8) 2.96 (−13.9 to 23.6) 0.693 0.161 20.9 (12.2–58.0) −0.89 (−15.2 to 24.0) 0.784 0.499
S2/3 both hemispheres 30.1 (20.1–53.1) −8.1 (−26.2 to 23.7) 0.639 0.906 33.2 (21.4–63.8) −13.5 (−26.9 to 27.41) 0.751 0.993
S2/3 affected hemisphere 19.9 (11.5–28.7) 3.06 (−8.6 to 33.6) 0.670 0.049 22.7 (12.0–44.2) −1.6 (−12.5 to 37.4) 0.797 0.169

Values are presented as median (interquartile range).

*Wilcoxon test between Ischemic Core Volume vs Final Infarct Volume. IC indicates ischemic core; FIV, final infarct volume; S1, setting 1; S2, setting 2; S3, setting 3; and r, Pearson’s correlation coefficient TICI = Thrombolysis in Cerebral Infarction Scale.

Wilcoxon test comparing both hemispheres vs affected hemisphere only showed significant differences between each of the pairs within each setting (P<0.001).

Including both hemispheres, the median difference between the FIV and IC volume (FIV − IC) was -3.9 mL (IQR −16.30 to 20.55) with S1. In 15 patients with overestimation, the mean overestimation compared to FIV was 64% with a median excess volume of 15 mL (IQR 7.05–27.67 mL). When limited to the affected hemisphere, the median difference was -0.89 mL (IQR −15.24 to 23.98 mL), and in 18 cases with overestimation the mean overestimation in FIV was 63% and the median excess volume was 14.63 mL (IQR 5.84–18.65 mL). Using S2 or S3, the median difference between IC and FIV using data from both hemispheres was -13.53 mL (IQR −26.93 to 27.41). The mean overestimation was 72% in 21 patients with overestimation and the median excess volume was 23.36 mL (15.23–32.86 mL). When measuring the affected side only with these settings, the median difference between the FIV and IC volume was -1.65 mL (IQR –12.48 to 37.38 mL). In 18 patients with overestimation, the average overestimation in FIV was 65% with a median overestimation volume of 11.00 mL (IQR 6.96–19.16 mL).

The correlation between IC volume and FIV was strong (r = 0.774 using both hemispheres and r = 0.784 using the affected hemisphere only) using Setting S1, very similar to S2/S3 (r = 0.751 using both hemispheres and r = 0.797 using the affected hemisphere only). Scatter plot figures visualizing the correlation between IC and FIV can be found in S1 Fig and S1 Text and S1S3 Tables.

Discussion

Significant differences have been reported for the abilities of different commercial perfusion CT software packages to predict the final infarct volume after EVT when using the company-recommended default threshold values [21, 22]. The present study used a fully automated software package with three different threshold settings to quantify CTP data. S1, which used parameters obtained from commercial volumetric software used in several recent studies [5, 7, 11, 12, 13], was tested against company-specified up-to-date values (i.e. S2) and prior default threshold values (i.e. S3) [26]. We compared the performances of these three settings in a population of patients with unilateral AIS who had undergone mechanical thrombectomy with modern recanalization techniques according to international guidelines. We found remarkable differences especially in the estimated penumbral volumes between the three tested threshold values. When assessing the potentially rescuable penumbral volume, we found a 2-fold difference between the widely used setting (i.e. S1) [17, 2730] and the adapted setting (i.e. S3) [21, 26].

Another key finding was the observation of significant differences in results when using data from both hemispheres versus data from the affected hemisphere only. However, the median volume change was only 1.6 mL with S1 versus 58.33 mL with S3 when measuring penumbral tissue–demonstrating that a large proportion of the detected penumbral tissue could be, in fact, an artefact reflecting from the use of the healthy hemisphere when using the latter setting. In general, the threshold levels included in S3 showed inferior results, most likely because the values are based on earlier studies using the maximum slope method rather than the contemporary deconvolution method [33, 34]. These values were recently updated to better correspond to the results obtained using the deconvolution method, to provide a more accurate estimation of penumbral volume [26].

Despite the equally high correlations between the estimated IC volumes determined using each threshold setting and the follow-up FIV, the spatial distributions of the tissue volumes differed visually when the analysis was limited to the affected hemisphere, indicating a variable amount of error in the detected Ischemic tissue between the thresholds (similar to the one visualized when comparing the penumbral volumes). The use of perfusion data from the affected hemisphere only resulted in a significant improvement in the accuracy of the estimated IC when compared to the FIV seen on control imaging. However, including the unaffected hemisphere may increase the reliability of the analysis because this helps the operator visualize the signal noise and can be used to generate a ‘negative control’ for each patient to assist interpretation.

S1 estimated the IC based on a relative CBF of <30% of the CBF in healthy tissue in the same patient–an approach widely addressed as superior to the CBV-based detection of IC [27, 35, 36]. By contrast, S2 and S3 also rely on an absolute threshold level of perfusion, expressed as a CBV of <1.2/100 mL/min. This threshold was originally based on a relative CBV value (<40% of the contralateral hemisphere) for detecting the IC [26]. Despite cerebral autoregulation, cerebral blood flow may vary between individuals even under normal conditions and is affected by pathologies such as hypertension or the degree of cervicocranial artery stenosis [37, 38]. Therefore, measuring the relative perfusion level of the healthy brain parenchyma in the same patient has some advantages compared with relying on the absolute cerebral blood volume in individuals without concomitant diseases. This principle may be adapted to a real-life clinical environment of patients suffering from multiple diseases. Future multicenter studies should describe how the volume of the healthy brain parenchyma is defined by the software used.

However, without international guidelines addressing the relative threshold levels, clinical decision-making should be undertaken with caution owing to the possibility of false-positive CTP results. In the present study, measurements that included the unaffected and affected hemispheres significantly increased the estimated volume of hypoperfused tissue compared with measurements using the affected hemisphere alone. In addition, the IC volumes were overestimated regardless of the setting used, as in prior studies [15, 16]. As expected, the correlation between the estimated IC volumes on CTP and FIV was highest in the subgroup of patients with successful recanalization [37, 11, 12].

All imaging was performed consistently using the same equipment and settings, and postprocessing of the imaging data obtained on admission was done using a single software package. This study design was essential to allow us to focus on the effects of different threshold values when assessing the CTP values in the study population. Potential limitations include the current equipment, which limits brain coverage to 10 cm during CTP imaging and could lead to underestimation of the loss of IC or penumbral volume. Recent studies have also shown that the optimal threshold values could vary depending on the time from the symptom onset [39, 40, 41] which could be used to further improve the accuracy of the results presented. In our study population, DWI-MRI imaging was not available, and the volume of FIV could have been affected by the varying amount of subsequent edema and swelling of he involved tissue between time scale of 1–4 days, during which the follow-up imaging was performed. In addition, the study included a small patient population due to the selection criteria, which involved unilateral EVT-treated AIS patients. Therefore, further studies in larger patient populations are encouraged.

Conclusions

Our findings support the hypothesis that the postprocessing parameters (threshold values that quantify perfusion and hemisphere settings) may significantly affect the IC, hypoperfused tissue, and penumbral volumes determined by CTP. The induced variation was similar to or even greater than the differences observed between commercial software packages. In addition, the estimated volumes were significantly affected by including either bilateral hemispheres or the ipsilateral cerebral hemisphere in the analysis. Further studies and comparisons of commercial software packages are encouraged to develop identical and optimized parameters for CTP. Standardization of CTP parameters is also essential to establish international consensus guidelines to support clinical decision-making in the management of stroke patients.

Supporting information

S1 Fig. Scatter plot chart comparing ischemic core to final infarct volume (mL) in those patients that underwent successful recanalization (n = 34).

S1 = Setting 1 (panel A and B, using both hemispheres and affected hemisphere only and S2/3 = Setting 2 and 3 (Panel C and D, using both hemispheres and affected hemisphere only).

(TIF)

S1 Text. Depiction of endovascular procedures.

(PDF)

S1 Table. Excluded patients.

(PDF)

S2 Table. Patient baseline and admission imaging characteristics.

(PDF)

S3 Table. Procedural and outcome characteristics.

(PDF)

Acknowledgments

We would like to thank Tuomas Selander for statistical guidance.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

This study was supported by governmental funding from the Kuopio University Hospital Research Commission (grant number: 5772789). First author Simo Karhi has also received a personal study grant/stipendium from the Radiological Society of Finland / Finnish neuroradiologist association. Funders did not play any role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. There was no additional external funding received for this study.

References

  • 1.Vagal A, Meganathan K, Kleindorfer DO, et al. Increasing use of computed tomographic perfusion and computed tomographic angiograms in acute ischemic stroke from 2006 to 2010. Stroke. 2014;45:1029–1034. 10.1161/STROKEAHA.113.004332 [DOI] [PubMed] [Google Scholar]
  • 2.Sanossian N, Fu KA, Liebeskind DS, Starkman S, et al. Utilization of emergent neuroimaging for thrombolysis-eligible stroke patients. J Neuroimaging. 2017;27:59–64. 10.1111/jon.12369 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Goyal M, Menon BK, van Zwam WH, et al. Endovascular thrombectomy after large-vessel ischaemic stroke: A meta-analysis of individual patient data from five randomised trials. Lancet. 2016;387:1723–1731. 10.1016/S0140-6736(16)00163-X [DOI] [PubMed] [Google Scholar]
  • 4.Berkhemer OA, Fransen PS, Beumer D, et al. A randomized trial of intraarterial treatment for acute ischemic stroke. N Engl J Med. 2015;372:11–20. 10.1056/NEJMoa1411587 [DOI] [PubMed] [Google Scholar]
  • 5.Campbell BC, Mitchell PJ, Kleinig TJ, et al. Endovascular therapy for ischemic stroke with perfusion-imaging selection. N Engl J Med. 2015;372:1009–1018. 10.1056/NEJMoa1414792 [DOI] [PubMed] [Google Scholar]
  • 6.Goyal M, Demchuk AM, Menon BK, et al. Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med. 2015;372:1019–1030. 10.1056/NEJMoa1414905 [DOI] [PubMed] [Google Scholar]
  • 7.Saver JL, Goyal M, Bonafe A, et al. Stent-retriever thrombectomy after intravenous t-PA vs. t-PA alone in stroke. N Engl J Med. 2015;372:2285–2295. 10.1056/NEJMoa1415061 [DOI] [PubMed] [Google Scholar]
  • 8.Jovin TG, Chamorro A, Cobo E, et al. Thrombectomy within 8 hours after symptom onset in ischemic stroke. N Engl J Med. 2015;372:2296–2306. 10.1056/NEJMoa1503780 [DOI] [PubMed] [Google Scholar]
  • 9.Bill O, Faouzi M, Meuli R, et al. Added value of multimodal computed tomography imaging: Analysis of 1994 acute ischaemic strokes. Eur J Neurol. 2017;24:167–174. 10.1111/ene.13173 [DOI] [PubMed] [Google Scholar]
  • 10.An H, Ford AL, Eldeniz C, et al. Reperfusion beyond 6 hours reduces infarct probability in moderately ischemic brain tissue. Stroke. 2016;47:99–105. 10.1161/STROKEAHA.115.010656 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Albers GW, Marks MP, Kemp S, et al. Thrombectomy for stroke at 6 to 16 hours with selection by perfusion imaging. N Engl J Med. 2018;378:708–718. 10.1056/NEJMoa1713973 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Nogueira RG, Jadhav AP, Haussen DC, et al. Thrombectomy 6 to 24 hours after stroke with a mismatch between deficit and infarct. N Engl J Med. 2018;378:11–21. 10.1056/NEJMoa1706442 [DOI] [PubMed] [Google Scholar]
  • 13.Albers GW, Goyal M, Jahan R, et al. Ischemic core and hypoperfusion volumes predict infarct size in SWIFT PRIME. Ann Neurol. 2016;79:76–89. 10.1002/ana.24543 [DOI] [PubMed] [Google Scholar]
  • 14.Horsch AD, Dankbaar JW, Niesten JM, et al. Predictors of reperfusion in patients with acute ischemic stroke. AJNR Am J Neuroradiol. 2015;36:1056–1062. 10.3174/ajnr.A4283 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Boned S, Padroni M, Rubiera M, et al. Admission CT perfusion may overestimate initial infarct core: The ghost infarct core concept. J Neurointerv Surg. 2017;9:66–69. 10.1136/neurintsurg-2016-012494 [DOI] [PubMed] [Google Scholar]
  • 16.Angermaier A, Khaw AV, Kirsch M, et al. Influence of recanalization and time of cerebral ischemia on tissue outcome after endovascular stroke treatment on computed tomography perfusion. J Stroke Cerebrovasc Dis. 2015;24:2306–2312. 10.1016/j.jstrokecerebrovasdis.2015.06.025 [DOI] [PubMed] [Google Scholar]
  • 17.Dehkharghani S, Bammer R, Straka M, et al. Performance and predictive value of a user-independent platform for CT perfusion analysis: Threshold-derived automated systems outperform examiner-driven approaches in outcome prediction of acute ischemic stroke. AJNR Am J Neuroradiol. 2015;36:1419–1425. 10.3174/ajnr.A4363 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Khaw AV, Angermaier A, Kirsch M, et al. Comparing perfusion CT evaluation algorithms for predicting outcome after endovascular treatment in anterior circulation ischaemic stroke. Clin Radiol. 2015;70:e41–e50. 10.1016/j.crad.2015.02.001 [DOI] [PubMed] [Google Scholar]
  • 19.Haussen DC, Dehkharghani S, Rangaraju S, et al. Automated CT perfusion ischemic core volume and noncontrast CT ASPECTS (Alberta Stroke Program early CT score): Correlation and clinical outcome prediction in large vessel stroke. Stroke. 2016;47:2318–2322. 10.1161/STROKEAHA.116.014117 [DOI] [PubMed] [Google Scholar]
  • 20.Aghaebrahim A, Sauvageau E, Aguilar-Salinas P, et al. Referral facility CT perfusion prior to inter-facility transfer in patients undergoing mechanical thrombectomy. J Neurointerv Surg. 2018;10:818–822. 10.1136/neurintsurg-2017-013492 [DOI] [PubMed] [Google Scholar]
  • 21.Austein F, Riedel C, Kerby T, et al. Comparison of perfusion CT software to predict the final infarct volume after thrombectomy. Stroke. 2016;47:2311–2317. 10.1161/STROKEAHA.116.013147 [DOI] [PubMed] [Google Scholar]
  • 22.Koopman MS, Berkhemer OA, Geuskens RREG, et al. Comparison of three commonly used CT perfusion software packages in patients with acute ischemic stroke. J Neurointerv Surg. 2019; 10.1136/neurintsurg-2019-014822 [DOI] [PubMed] [Google Scholar]
  • 23.Jauch EC, Saver JL, Adams HP Jr, et al. Guidelines for the early management of patients with acute ischemic stroke: A guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2014;44:870–947. [DOI] [PubMed] [Google Scholar]
  • 24.Powers WJ, Derdeyn CP, Biller J, et al. 2015 American Heart Association/American Stroke Association focused update of the 2013 guidelines for the early management of patients with acute ischemic stroke regarding endovascular treatment: A guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2015;46:3020–3035. 10.1161/STR.0000000000000074 [DOI] [PubMed] [Google Scholar]
  • 25.Zaidat OO, Yoo AJ, Khatri P, et al. Recommendations on angiographic revascularization grading standards for acute ischemic stroke: A consensus statement. Stroke 2013;44:2650–2663. 10.1161/STROKEAHA.113.001972 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Abels B, Klotz E, Tomandl BF, et al. Perfusion CT in acute ischemic stroke: A qualitative and quantitative comparison of deconvolution and maximum slope approach. AJNR Am J Neuroradiol 2010;31:1690–1698. 10.3174/ajnr.A2151 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Campbell BC, Christensen S, Levi CR, et al. Cerebral blood flow is the optimal CT perfusion parameter for assessing infarct core. Stroke. 2011;42:3435–3440. 10.1161/STROKEAHA.111.618355 [DOI] [PubMed] [Google Scholar]
  • 28.Olivot JM, Mlynash M, Zaharchuk G, et al. Perfusion MRI (tmax and MTT) correlation with xenon CT cerebral blood flow in stroke patients. Neurology. 2009;72:1140–1145. 10.1212/01.wnl.0000345372.49233.e3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Lansberg MG, Lee J, Christensen S, et al. RAPID automated patient selection for reperfusion therapy: A pooled analysis of the echoplanar imaging thrombolytic evaluation trial (EPITHET) and the diffusion and perfusion imaging evaluation for understanding stroke evolution (DEFUSE) study. Stroke. 2011;42:1608–1614. 10.1161/STROKEAHA.110.609008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Straka M, Albers GW, Bammer R. Real-time diffusion-perfusion mismatch analysis in acute stroke. J Magn Reson Imaging. 2010;32:1024–1037. 10.1002/jmri.22338 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Arakawa S., Wright P. M., Koga M. et al. Ischemic thresholds for gray and white matter: A diffusion and perfusion magnetic resonance study. Stroke. 2006;37(5), 1211–1216. 10.1161/01.STR.0000217258.63925.6b [DOI] [PubMed] [Google Scholar]
  • 32.Graham TP Jr, Jarmakani JM, Atwood GF, et al. Right ventricular volume determinations in children. normal values and observations with volume or pressure overload. Circulation. 1973;47:144–153. 10.1161/01.cir.47.1.144 [DOI] [PubMed] [Google Scholar]
  • 33.Klotz E, Koenig M. Perfusion measurements of the brain: Using dynamic CT for the quantitative assessment of cerebral ischemia in acute stroke. Eur J Radiol. 1999;30:170–184. 10.1016/s0720-048x(99)00009-1 [DOI] [PubMed] [Google Scholar]
  • 34.Koenig M, Kraus M, Theek C, et al. Quantitative assessment of the ischemic brain by means of perfusion-related parameters derived from perfusion CT. Stroke. 2001;32:431–437. 10.1161/01.str.32.2.431 [DOI] [PubMed] [Google Scholar]
  • 35.Kamalian S, et al. CT cerebral blood flow maps optimally correlate with admission diffusion-weighted imaging in acute stroke but thresholds vary by postprocessing platform. Stroke. 2011;42(7):1923–1928. 10.1161/STROKEAHA.110.610618 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Bivard A, Spratt N, Levi C, Parsons M. Perfusion computer tomography: imaging and clinical validation in acute ischaemic stroke. Brain. 2011;134(Pt 11):3408–3416. 10.1093/brain/awr257 [DOI] [PubMed] [Google Scholar]
  • 37.Edvinsson L, MacKenzie ET, McCulloch J. Autoregulation. In: Cerebral Blood Flow and Metabolism. New York, USA: Raven Press. 1993; pp 553–58036. [Google Scholar]
  • 38.Lasjaunias P, Berenstein A. Autoregulation. In: Surgical Neuroangiography 3. Functional Vascular anatomy of Brain, Spinal Cord and Spine. Berlin, Germany: Springer-Verlag Berlin Heidelberg. 1990; pp 298–299 [Google Scholar]
  • 39.Bivard A, Kleinig T, Miteff F, et al. Ischemic core thresholds change with time to reperfusion: A case control study. Ann Neurol. 2017;82(6):995–1003. 10.1002/ana.25109 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Qiu W, et al. Confirmatory Study of Time-Dependent Computed Tomographic Perfusion Thresholds for Use in Acute Ischemic Stroke. Stroke. 2019;50(11):3269–3273. 10.1161/STROKEAHA.119.026281 [DOI] [PubMed] [Google Scholar]
  • 41.Yoshie T, et al. Perfusion Parameter Thresholds That Discriminate Ischemic Core Vary with Time from Onset in Acute Ischemic Stroke [published online ahead of print, 2020 Aug 27]. AJNR Am J Neuroradiol. 2020;10.3174/ajnr.A6744. 10.3174/ajnr.A6744 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Ona Wu

2 Nov 2020

PONE-D-20-23892

Effect of different thresholds for CT perfusion volumetric analysis on estimated ischemic core and penumbral volumes

PLOS ONE

Dear Dr. Karhi,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Dec 17 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Ona Wu

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. In ethics statement in the manuscript and in the online submission form, please provide additional information about the patient records used in your retrospective study. Specifically, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

3.  Thank you for stating in your Funding Statement:

"This study was supported by governmental funding from the Kuopio University Hospital Research Commission (grant number: 5772789). Funders did not play any role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.".

i) Please provide an amended statement that declares *all* the funding or sources of support (whether external or internal to your organization) received during this study, as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now.  Please also include the statement “There was no additional external funding received for this study.” in your updated Funding Statement.

ii) Please include your amended Funding Statement within your cover letter. We will change the online submission form on your behalf.

4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: No

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: In this retrospective study, the authors assessed the differences in the CTP-derived infarction core and ischecmic penumbra volumes using 3 different threshold combinations (1- CBF <30% and Tmax> 6s; 2- CBV<1.2/100 mL and CBF< 27/100 mL/min; and 3- CBV<1.2/100 mL and CBF< 35/100 mL/min) in 52 consecutive patients with acute ischemic stroke and anterior circulation large vessel occlusion who underwent endovascular thrombectomy. They also compared the CTP-derived infarction core volumes with the final infarction size measured on the follow up non-contrast CT performed 1-4 days after admission. 34/52 patients had successful recanalization (TICI-2b or 3).

The manuscript is well-written but I have a few issues with the study aims and methods:

1- The main aim of this study was to assessed the accuracy of the CTP-derived infarction core and ischemic penumbra, which has been extensively studied and reported in the literature (for example see the below references). As expected the authors found large differences in the estimated penumbral volume. I believe the findings of this study neither enhance the current knowledge about the inaccuracy of CTP-derived infarction core and penumbra volumes nor provide a tool to overcome the CTP inaccuracies.

- Kudo K, et al. Differences in CT perfusion maps generated by different commercial software: quantitative analysis by using identical source data of acute stroke patients. Radiology. 2010;254(1):200-209.

- Kamalian S, et al. CT cerebral blood flow maps optimally correlate with admission diffusion-weighted imaging in acute stroke but thresholds vary by postprocessing platform. Stroke. 2011;42(7):1923-1928.

- Kamalian S, et al. CT perfusion mean transit time maps optimally distinguish benign oligemia from true "at-risk" ischemic penumbra, but thresholds vary by postprocessing technique. AJNR Am J Neuroradiol. 2012;33(3):545-549.

- Fahmi F, Marquering HA, Streekstra GJ, et al. Differences in CT perfusion summary maps for patients with acute ischemic stroke generated by 2 software packages. AJNR Am J Neuroradiol. 2012;33(11):2074-2080.

- Kudo K, Christensen S, Sasaki M, et al. Accuracy and reliability assessment of CT and MR perfusion analysis software using a digital phantom. Radiology. 2013;267(1):201-211. doi:10.1148/radiol.12112618

- Copen WA, et al. In patients with suspected acute stroke, CT perfusion-based cerebral blood flow maps cannot substitute for DWI in measuring the ischemic core. PLoS One. 2017;12(11):e0188891.

Further more the CTP thresholds are likely time-dependent:

- Bivard A, Kleinig T, Miteff F, et al. Ischemic core thresholds change with time to reperfusion: A case control study. Ann Neurol. 2017;82(6):995-1003. doi:10.1002/ana.25109

- Qiu W, et al. Confirmatory Study of Time-Dependent Computed Tomographic Perfusion Thresholds for Use in Acute Ischemic Stroke. Stroke. 2019;50(11):3269-3273.

- Yoshie T, et al. Perfusion Parameter Thresholds That Discriminate Ischemic Core Vary with Time from Onset in Acute Ischemic Stroke [published online ahead of print, 2020 Aug 27]. AJNR Am J Neuroradiol. 2020;10.3174/ajnr.A6744.

2- The authors used CBV for infarction core volume estimation in 2 of their 3 threshold combinations. Although they found a relatively high correlation between the estimated infarction core volumes and the follow-up final infarction size, they reported that the spatial distributions of the tissue volumes differed visually (especially when excluding the contralaterl hemisphere for analysis). There are a few issues with their methods in regard to infarction core estimation:

a- More recent studies showed thresholded-CBF is perhaps a better method for infarction core estimation. I suggest updating the results by adding more threshold combinations with inclusion of CBF-derived core volumes based on the recommendations for software used in this study (CT Neuroperfusion software).

- Kamalian S, et al. CT cerebral blood flow maps optimally correlate with admission diffusion-weighted imaging in acute stroke but thresholds vary by postprocessing platform. Stroke. 2011;42(7):1923-1928.

- Campbell BC, Christensen S, Levi CR, et al. Cerebral blood flow is the optimal CT perfusion parameter for assessing infarct core. Stroke. 2011;42(12):3435-3440.

- Bivard A, Spratt N, Levi C, Parsons M. Perfusion computer tomography: imaging and clinical validation in acute ischaemic stroke. Brain. 2011;134(Pt 11):3408-3416. doi:10.1093/brain/awr257

b- I am not sure if a Pearson correlation test is appropriate for analysis of the infarction core volumes in this study in the absence of a figure showing the scatterplots to support the results. A critical presumption for correlation/linear regression models is homoscedasticity. A correlation test can produce an erroneously high correlation coefficient when a few outliers are present, meanwhile the other data-points (usually smaller values near the center of the scatter plot) are poorly correlated. I recommend addition of the correlation scatterplots and consultation with a statistician.

c- Ideally the CTP-derived infarction core volumes should be compared to a closely acquired DWI-MRI as the gold standard test. Because MRI is not always available or not usually performed initially to avoid delay in endovascular treatment, many studies use the final infarct size after endovascular treatment with presumption of minimal or no significant infarct growth following successful recanalization. Therefore, I suggest to redo the correlation study between the CTP-derived infarction core volume and final infarct size only in the 34 patients who achieved successful recanalization (TICI-2b or 3).

Reviewer #2: In this study the authors point out the lack of standardization for measuring ischemic core and penumbra volumes using CT perfusion thresholds and software analysis. Their aim is to show the accuracy for predicting final infarct volume on a CT between one and four days following stroke for each of the CT perfusion outputs which include threshold values that are used by RAPID Ischemia View and in house proprietary methods. They show that with each CTP software output that there is a high degree of variance with respect to the comparison of infarct core penumbra on final infarct volume comparisons for each of these software analyses. The manuscript is of importance but has several major limitations which the authors should address.

1. The authors excluded 73 patients from their analysis. Some of their criteria appear to be less than explanatory for instance 32 patients with “deviant imaging data” were excluded. Do the authors mean that the images are of poor quality and could not be analyzed. Why were patients with fluctuating symptoms excluded as well as those with chronic inter-cranial stenosis. The authors should refine their inclusion and exclusion criteria.

2. It is common for CT type analyses to compare their accuracy of ischemic core and penumbra thresholds with a final infarct volume usually DWI at 24 hours but with respect to this manuscript the issue is not so much how the various techniques relate to final infarct volume but how they compare between each other. Therefore, I would recommend that the authors compare the infarct core volume and penumbra volumes between each imaging software technique. This analysis can be performed by Bland Altman plots.

3. It is not clear whether the authors controlled for recanalization status because the final infarct volume for subjects with early recanalization will be potentially smaller than if they had not recanalized. In order to obtain a more standardized comparison between the software techniques it might be most appropriate to refine the analysis to those patients that have successful recanalization with EVT.

4. The comparison with reported Rapid thresholds, is of course, not the same as comparing directly with CTP outputs provided by Rapid. Can the others explains why this was not done?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Apr 21;16(4):e0249772. doi: 10.1371/journal.pone.0249772.r002

Author response to Decision Letter 0


16 Dec 2020

For a full response letter to the reviewers including the comments and responses, please see the individually uploaded file: "Response to the reviewers".

Reviewer #1:

Comment: "The main aim of this study was to assessed the accuracy of the CTP-derived infarction core and ischemic penumbra, which has been extensively studied and reported in the literature (for example see the below references). As expected the authors found large differences in the estimated penumbral volume. I believe the findings of this study neither enhance the current knowledge about the inaccuracy of CTP-derived infarction core and penumbra volumes nor provide a tool to overcome the CTP inaccuracies."

Response: Although not implemented in our study, we agree that the time dependency of the threshold values is a notable factor, as pointed out by the reviewer. This was added in the discussion chapter focusing on the limitations of the study, including these given references. The goal of the present study is, indeed, to underline the current inaccuracies and differing results produced by the automated analysis using the suggested thresholds given by two large software manufacturers. Although the DWI-based approach to detect ischemic core is currently preferred over CT perfusion, the latter is still widely used in the detection of acute ischaemia due to the speed and practicality. The study presented pursuits to create an objective review on the current situation of the still evolving method of automatically detecting Ischemic Core and Penumbra from diagnostic imaging using CT modality.

Comment: "2- The authors used CBV for infarction core volume estimation in 2 of their 3 threshold combinations. Although they found a relatively high correlation between the estimated infarction core volumes and the follow-up final infarction size, they reported that the spatial distributions of the tissue volumes differed visually (especially when excluding the contralateral hemisphere for analysis). There are a few issues with their methods in regard to infarction core estimation:

a- More recent studies showed thresholded-CBF is perhaps a better method for infarction core estimation. I suggest updating the results by adding more threshold combinations with inclusion of CBF-derived core volumes based on the recommendations for software used in this study (CT Neuroperfusion software)"

Response: In line with the reviewers comment, CBF-based approach of the RAPID-adapted threshold values (Ischemic core is diagnosed if the relative CBF is <30% of that in normal tissue.) showed the best visual/spatial correlation between IC, penumbral area and FIV. The aforementioned references are now added to the Discussion -section of the article. Although the settings within the software used in the study can be altered to match the aforementioned rival software, according to our current knowledge CT Neuroperfusion software for Syngo Via has no other suggested default threshold values for a similar CBFbased approach for detection of IC.

Comment: "b- I am not sure if a Pearson correlation test is appropriate for analysis of the infarction core volumes in this study in the absence of a figure showing the scatterplots to support the results. A critical presumption for correlation/linear regression models is homoscedasticity. A correlation test can produce an erroneously high correlation coefficient when a few outliers are present, meanwhile the other data-points (usually smaller values near the center of the scatter plot) are poorly correlated. I recommend addition of the correlation scatterplots and consultation with a statistician"

Response: Thank you for this comment. Scatterplots have now been created from the subgroup of TICI 2b/3 patients (n=34) with both IC thresholds.The plots can be found in the supplementary materials. A statistician was also consulted with the freshly created scatter plots considering the Pearson’s correlation test. A nonparametrical Spearman’s correlation test was performed with a similar P-value of <0.001 as a result. As we found the data being linear, our statistician supported the use of Pearson’s correlation coefficient in the analysis.

Comment: "c- Ideally the CTP-derived infarction core volumes should be compared to a closely acquired DWI-MRI as the gold standard test. Because MRI is not always available or not usually performed initially to avoid delay in endovascular treatment, many studies use the final infarct size after endovascular treatment with presumption of minimal or no significant infarct growth following successful recanalization. Therefore, I suggest to redo the correlation study between the CTP-derived infarction core volume and final infarct size only in the 34 patients who achieved successful recanalization (TICI-2b or 3):"

Response: The chapter describing the correlation between Ischemic Core and Follow-up infarct size has now been rewritten using only the patient group with a successful recanalization. The table visualizing correlation between Ischemic Core and follow-up findings has now been streamlined and is focused only on the subgroup that achieved successful recanalization (TICI 2b or 3, n=34), leaving out the other additional subgroups, as suggested. However we left the ”All patients” group in the table for comparison, as it seemed to emphazise the effect of successfulness of the treatment.

Reviewer #2:

Comment: "1. The authors excluded 73 patients from their analysis. Some of their criteria appear to be less than explanatory for instance 32 patients with “deviant imaging data” were excluded. Do the authors mean that the images are of poor quality and could not be analyzed. Why were patients with fluctuating symptoms excluded as well as those with chronic inter-cranial stenosis. The authors should refine their inclusion and exclusion criteria."

Response: Thank you for the important comment. The term ”deviant imaging data” on page 4 has now been switched to a phrase: ”no suitable imaging data for the study retrospectively available”. The rest of the explanatory information contained in the same phrase was left unchanged: “(imaging performed elsewhere, n = 23; CTP not performed, n = 5; CTP failure, n = 2; control imaging with magnetic resonance imaging, n = 2”), in the hope of answering the issue presented by the reviewer. The similar explanatory exclusion chart can also be found on our supplementary material provided with the manuscript. It is true that the exclusion of the patients with a chronic intracranial or carotid stenosis or fluctuation of the symptoms takes the study design further away from the optimal “real world” situation. However, we wanted to exclude the patients suffering from “acute-onchronic” type of stroke etiology. In the presence of chronic intracranial artery or internal carotid artery stenosis , cerebral blood flow can be altered either by enhanced collateral circulation or, in contrast, circulation to the ischaemic area can be impaired already prior to the stroke. As our study focused solely on cerebral blood flow and cerebral blood volume on acute anterior circulation large artery occlusion, our goal was to minimize the possible confusing effects of these pathologies to the CT Perfusion imaging results. The same principle was adopted while excluding the patients who had fluctuation of the symptoms.

Liebeskind DS. Collateral circulation. Stroke. 2003 Sep;34(9):2279-84. doi: 10.1161/01.STR.0000086465.41263.06. Epub 2003 Jul 24. PMID: 12881609. https://pubmed.ncbi.nlm.nih.gov/12881609/

Van der Heyden J, Waaijer A, Van Wouter ES, van Neerven D, Sonker U, Suttorp MJ, Bal ET, Prokop M. CT measurement of changes in cerebral perfusion in patients with asymptomatic carotid artery stenosis undergoing carotid stenting prior to cardiac surgery: "proof of principle".

EuroIntervention. 2011 Apr;6(9):1091-7. doi: 10.4244/EIJV6I9A190. PMID: 21518682. Trojanowska A, Drop A, Jargiello T, Wojczal J, Szczerbo-Trojanowska M. Changes in cerebral hemodynamics after carotid stenting: evaluation with CT perfusion studies. J Neuroradiol. 2006 Jun;33(3):169-74. doi: 10.1016/s0150-9861(06)77255-8. PMID: 16840959.

Mosqueira AJ, Pumar JM, Arias S, Rodríguez-Yáñez M, Blanco Ulla M, Vázquez Herrero F, Castillo J. False ischaemic penumbras in CT perfusion in patients with carotid artery stenosis and changes following angioplasty and stenting. Neurologia. 2020 Jan-Feb;35(1):24-31. English, Spanish. doi: 10.1016/j.nrl.2017.06.002. Epub 2017 Sep 1. PMID: 28865944.

Comment: "2. It is common for CT type analyses to compare their accuracy of ischemic core and penumbra thresholds with a final infarct volume usually DWI at 24 hours but with respect to this manuscript the issue is not so much how the various techniques relate to final infarct volume but how they compare between each other. Therefore, I would recommend that the authors compare the infarct core volume and penumbra volumes between each imaging software technique. This analysis can be performed by Bland Altman plots."

Response: Thank you for this valuable comment. Results have now been expanded accordingly, and eligible Bland Altman Plots have now been created based on One Sample T-tests, which found non-significant difference between penumbral volumes measured using S1 and S2 with both hemispheres included (P=0.093) and Ischemic Core volumes measured using S1 and S2/S3 with both hemispheres included (P=0.368). Additionally, we included a Bland Altman plot using only those patients with successful recanalization (Ischemic Core between S1 and S2/S3, P=0.279) as suggested further in comment 3. Rest of the pairs showed significance (P<0.05) when their difference was tested on One Sample T-test, and therefore were not included in the Bland Altman Plot analysis. However, the previously created ladder charts visualizing the paired volume differences are left unchanged to demonstrate also the other significantly different threshold pairs.

Comment: "3. It is not clear whether the authors controlled for recanalization status because the final infarct volume for subjects with early recanalization will be potentially smaller than if they had not recanalized. In order to obtain a more standardized comparison between the software techniques it might be most appropriate to refine the analysis to those patients that have successful recanalization with EVT."

Response: We have now expanded the phrase in page 5 describing the study methods considering retrospective evaluation of the postprocedural reperfusion: ”Post-procedural reperfusion was retrospectively evaluated from the patient records and angiographic x-ray imaging. This was considered successful in patients with TICI (Thrombolysis in Cerebral Infarction Scale) score of 2b or 3 and unsuccessful in patients with a TICI score of ≤2a.” According to the Reviewer’s suggestion, Bland Altman plots of Ischaemic Core volumes have now been created including only the successfully recanalized patient group. Penumbral volume comparison was left unchanged when comparing techniques between each other. In the chapter ”Association Between Estimated IC Volume and Final Infarct Volume” (page 11) we have now focused only on the group that achieved successful recanalization (= TICI 2b/3, n=34), as suggested. Correlation coefficients between Ischemic Core and Final Infarct Volume are calculated with the patient group that achieved successful recanalization (n=34), and scatterplot figures using only successfully recanalized patients have now also been created and can be found in the supplementary material files.

Comment: "4. The comparison with reported Rapid thresholds, is of course, not the same as comparing directly with CTP outputs provided by Rapid. Can the others explains why this was not done?"

Response: We agree on the benefits of using the original RAPID Software for comparison. Unfortunately, the RAPID commercial package is not available at our tertiary hospital. Some comparisons between vendor softwares have been published. Instead, our study aimed to analyze whether it is possible to obtain equivalent results on a single software platform by altering the CTP thresholds. This kind of comparison is clinically important, because different hospitals use different scanners from different vendors for stroke imaging, and showing that different software platforms could run similar measurements would be optimal and could help adopting standardized thresholds for hypoperfused and non-viable tissue, despite different scanners, acquisition techniques, and post-processing software settings.

Attachment

Submitted filename: Response to Reviewers.pdf

Decision Letter 1

Ona Wu

9 Feb 2021

PONE-D-20-23892R1

Effect of different thresholds for CT perfusion volumetric analysis on estimated ischemic core and penumbral volumes

PLOS ONE

Dear Dr. Karhi,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 26 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Ona Wu

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: No

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors responses to the comments and criticism were reasonable and the manuscript is updated appropriately. There is a minor error in the reference section. The items #27 and 36 refer to the same manuscript (Campbell BC, et al).

Reviewer #2: CTP thresholds are used to select stroke patients for EVT. In this revised paper the authors show wide disparities in infarct core and penumbral volumes when different software packages are used. The primary outcome is the accuracy of CTP thresholds with the final infarct volume measure by CT. There remain several important concerns that the authors’ need to address:

1) I would recommend the comparisons between the CTP thresholds be a second aim and not merely added in the supplement. The abstract, methods, results and discussion need to reflect this change.

2) The Bland Altman plots comparing CTP thresholds are incomplete. Typically, a BA plot shows the mean difference, 1.96 SD around that difference and the upper and lower margins. In the supplementary figure plots B and C are a duplicate.

3) When measuring the accuracy of CTP thresholds for core and penumbra with FIV typically a sensitivity analysis is performed not Pearson correlation.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Apr 21;16(4):e0249772. doi: 10.1371/journal.pone.0249772.r004

Author response to Decision Letter 1


9 Mar 2021

Please see the separate document "Response to reviewers" for the full response letter.

Response to Reviewer #1:

Comment: The authors responses to the comments and criticism were reasonable and the manuscript is updated appropriately. There is a minor error in the reference section. The items #27 and 36 refer to the same manuscript (Campbell BC, et al). Response: The authors are thankful for the excellent feedback and comments giving us new viewpoints to our study and manuscript and also for future research on the subject. The error in the reference section has now been fixed.

Response to Reviewer #2:

CTP thresholds are used to select stroke patients for EVT. In this revised paper the authors show wide disparities in infarct core and penumbral volumes when different software packages are used. The primary outcome is the accuracy of CTP thresholds with the final infarct volume measure by CT. There remain several important

concerns that the authors’ need to address:

(The authors wish to point out that the study compares the results produced by a single software package using three different threshold levels.)

Comment: “1) I would recommend the comparisons between the CTP thresholds be a second aim and not merely added in the supplement. The abstract, methods, results and discussion need to reflect this change.” Response: Thank you for the valuable comments. To address the Reviewer’s concern, the comparison between the three CTP threshold settings has now been mentioned as the second aim of the study in Introduction, and furthermore, the Abstract and Discussion have been modified to better reflect the importance of the differences between the CTP thresholds. The suggested supplementary Bland Altman Plots have now been transferred from the supplementary materials to be part of the main manuscript in the Results section.

Comment: “2) The Bland Altman plots comparing CTP thresholds are incomplete. Typically, a BA plot shows the mean difference, 1.96 SD around that difference and the upper and lower margins. In the supplementary figure plots B and C are a duplicate.” Response: Based on the feedback, one of the two Bland Altman plots visualizing the setting pair S1 vs S2 when comparing Ischemic Core Volumes has now been excluded due to the similarities between the original panels B and C.

As requested, the Bland Altman Plot figure now includes the numeral explanation for the lines for mean difference, and the 1.96 SD around the difference. Upper and lower margins for mean difference are now visualized with additional thinner dotted lines. In addition, an alternative and more detailed figure 2 (visualizing also upper and lower 95% confidence limits for the upper and lower “agreement limits”) is included based on a consultation of our biostatistician (see uploaded file titled: Alternative Fig 2). We are willing to use either of these alternative plots according to the Reviewer’s and Editor’s preferences.

Comment: “3) When measuring the accuracy of CTP thresholds for core and penumbra with FIV typically a sensitivity analysis is performed not Pearson correlation.”

Thank you for the comment. The use of sensitivity analysis was considered by the authors when choosing between different methods for statistical analysis. Among these methods, Pearson Correlation was selected and has also been used in earlier literature, for example: Austein F, Riedel C, Kerby T, et al. Comparison of perfusion CT software to predict the final infarct volume after thrombectomy. Stroke. 2016; 47:2311–2317.

Attachment

Submitted filename: Response to Reviewers.pdf

Decision Letter 2

Ona Wu

25 Mar 2021

Effect of different thresholds for CT perfusion volumetric analysis on estimated ischemic core and penumbral volumes

PONE-D-20-23892R2

Dear Dr. Karhi,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Ona Wu

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Ona Wu

6 Apr 2021

PONE-D-20-23892R2

Effect of different thresholds for CT perfusion volumetric analysis on estimated ischemic core and penumbral volumes

Dear Dr. Karhi:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Ona Wu

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Scatter plot chart comparing ischemic core to final infarct volume (mL) in those patients that underwent successful recanalization (n = 34).

    S1 = Setting 1 (panel A and B, using both hemispheres and affected hemisphere only and S2/3 = Setting 2 and 3 (Panel C and D, using both hemispheres and affected hemisphere only).

    (TIF)

    S1 Text. Depiction of endovascular procedures.

    (PDF)

    S1 Table. Excluded patients.

    (PDF)

    S2 Table. Patient baseline and admission imaging characteristics.

    (PDF)

    S3 Table. Procedural and outcome characteristics.

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.pdf

    Attachment

    Submitted filename: Response to Reviewers.pdf

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES