Abstract
Introduction:
Computed tomography perfusion (CTP) imaging has become an important tool in evaluating acute recanalization treatment candidates. Large clinical trials have successfully used RAPID automated imaging analysis software for quantifying ischemic core and penumbra, yet other commercially available software vendors are also on the market. We evaluated the possible difference in ischemic core and perfusion lesion volumes and the agreement rate of target mismatch between OLEA, MIStar, and Syngo.Via versus RAPID software in acute recanalization treatment candidates.
Patients and methods:
All consecutive stroke-code patients with baseline CTP RAPID imaging at Helsinki University Hospital during 8/2018–9/2021 were included. Ischemic core was defined as cerebral blood flow <30% than the contralateral hemisphere and within the area of delay time (DT) >3s with MIStar. Perfusion lesion volume was defined as DT > 3 s (MIStar) and Tmax > 6 s with all other software. A perfusion mismatch ratio of ⩾1.8, a perfusion lesion volume of ⩾15 mL, and ischemic core <70 mL was defined as target mismatch. The mean pairwise differences of the core and perfusion lesion volumes between software were calculated using the Bland-Altman method and the agreement of target mismatch between software using the Pearson correlation.
Results:
A total of 1606 patients had RAPID perfusion maps, 1222 of which had MIStar, 596 patients had OLEA, and 349 patients had Syngo.Via perfusion maps available. Each software was compared with simultaneously analyzed RAPID software. MIStar showed the smallest core difference compared with RAPID (−2 mL, confidence interval (CI) from −26 to 22), followed by OLEA (2 mL, CI from −33 to 38). Perfusion lesion volume differed least with MIStar (4 mL, CI from −62 to 71) in comparison with RAPID, followed by Syngo.Via (6 mL, CI from −94 to 106). MIStar had the best agreement rate with target mismatch of RAPID followed by OLEA and Syngo.Via.
Discussion and conclusion:
Comparison of RAPID with three other automated imaging analysis software showed variance in ischemic core and perfusion lesion volumes and in target mismatch.
Keywords: Ischemic stroke, ischemic core, penumbra, CT perfusion
Introduction
Computed tomography perfusion (CTP) imaging has become an important selection tool for evaluating acute stroke patients in recent years.1–5 Although comprehensive diffusion-weighted magnetic resonance imaging (MRI-DWI) offers the most accurate estimation of early infarction and ischemic core, the main downsides of MRI are low availability outside comprehensive stroke centers, safety issues with implants and possible metallic objects in patients, access to MRI in emergency settings, a possible longer scanning time, and movement artifacts with agitated patients. This makes CTP more feasible in many centers.2,3,6
CTP and especially RAPID automated imaging analysis are increasingly used as selection tools for the endovascular treatment (EVT) of large vessel occlusion (LVO) in a 6-to-24-h time window, for intravenous thrombolysis (IVT) in a 4.5–9 h time window after stroke onset and with wake-up stroke patients.7–14 CTP is also often used when there is suspicion of a stroke mimic or to help in clinical decision making if there are relative contraindications for IVT or EVT. 2
CTP imaging analysis produces brain perfusion maps that indicate several parameters, including cerebral blood volume (CBV), cerebral blood flow (CBF), mean transit time (MTT), and time to peak of the residual function of an injected contrast agent (Tmax). 2 A Tmax delay exceeding 6 s estimates critically hypoperfused brain tissue with RAPID automated imaging software, including both ischemic core and penumbra.12,13 RAPID software has been widely used in several large trials to estimate the volumes of ischemic core and perfusion lesion and several guidelines rely on these trials.2,7–9 Several studies have shown that ischemic core obtained from CTP automated imaging analysis software reliably predicts the final infarct volume estimated from comprehensive MRI-DWI.2,10,12–16 At present, several commercially available CTP automated imaging analysis software (e.g. MIStar, OLEA, and Syngo.Via) exist on the market, some of which have been compared with RAPID with high agreement.13,17–26 Performance of the commonly used CTP software packages (MIStar, OLEA, and Syngo.Via) remain unclear when compared with RAPID in large clinical trials among stroke code candidates.
We aimed to evaluate the possible difference in automatically calculated volumes of ischemic core and perfusion lesion and the agreement of target mismatch between RAPID and three other commercially available CTP automated imaging analysis software (OLEA, MIStar, and Syngo.Via) in acute recanalization treatment candidates imaged with CTP in a single comprehensive stroke center.
Patients and methods
A single-center, retrospective analysis of imaging findings of all consecutive acute stroke patients (Stroke Code) was performed from August 2018 to September 2021 at Helsinki University Hospital (HUS) based on the Helsinki stroke quality registry (HSQR).
We use non-enhanced computed tomography (NCCT) and computed tomography angiography (CTA) as the first-line imaging modalities for stroke code patients at HUS. CTP is required per protocol in the extended time window for IVT (after 4, 5–9 h of symptom onset and with wake-up stoke patients) and for EVT (after 6–24 h of symptom onset) for visualizing the ischemic core and perfusion lesion, as guided by current American Heart Association guidelines and our local guidelines. 9 In the early time window CTP is performed on decision of the treating stroke neurologist.
Inclusion criteria were as follows: suspicion of an acute ischemic stroke within the extended time-window for potential acute recanalization therapy (IVT, EVT, or both) and a successful CTP RAPID imaging performed at baseline. Demographical (sex, age) and clinical parameters (site of acute vessel occlusion), along with a National Institute of Health Stroke Scale (NIHSS) score were registered at baseline. Patients evaluated as acute stroke code candidates with suspicion of an acute ischemic stroke at baseline were considered stroke mimics after comprehensive clinical evaluation and (baseline and follow-up) imaging if no signs of acute ischemia were found or a more likely cause other than acute ischemia for admission was diagnosed.
Imaging protocol
CTP was performed on a Siemens Edge or Force (Siemens, Erlangen, Germany) 128-section scanners. The following parameters were used for CTP acquisition: a slice thickness of 5 mm, a collimator of 32 mm ×1.2 mm, 70 kVp, 135 mA with a total coverage of 100 mm and image coverage of 114 mm and with a radiation dose of 76.4 mGy (milligray) and 1129 mGy * cm. The imaging plane was parallel to the floor of the anterior cranial fossa starting just above the orbits. Thirty cycles were obtained with a total scan time of 46 s. The CTP images were sent without delay immediately after acquisition to RAPID, OLEA, MIStar, and Syngo.Via automated imaging analysis software without any user interaction or forcing classification of affected side to quantify ischemic core and perfusion lesion volumes.
Automated imaging analysis software on computed tomography perfusion
RAPID and MIStar automated imaging analysis software were used to include patients from August 2018 to the end of the study. The OLEA software was available from August 2018 to November 2019 and Syngo.Via software from November 2020 to the end of the study period. The differences between automated imaging analysis software when assessing ischemic core and perfusion lesion volume are shown in Supplemental Table s1. The perfusion lesion is the critically hypoperfused area (prone to infarct), including ideally both penumbra and ischemic core. However, as perfusion lesion and ischemic core are acquired from different parameters, it is technically possible, but biologically not plausible, to have an ischemic core remote form the perfusion lesion. However, MIStar ignores an ischemic core outside the perfusion lesion volume.
Figure 1 illustrates ischemic core and perfusion lesion volumes estimated with each automated imaging software in a 72-year-old male with occlusion of both the internal carotid artery and the proximal middle cerebral artery (tandem occlusion).
RAPID (iSchemaView Inc, Menlo Park, CA) uses a deconvolution method, that is thought to be delay insensitive 26 and defines ischemic core as regions with a relative CBF < 30% than the contralateral hemisphere and perfusion lesion volume as a delayed arrival of an injected contrast agent bolus with a maximum of the residue function exceeding 6 s (Tmax >6 s). 27
AutoMIStar (Apollo Medical Imaging Technology) automatically generates delay time (DT), absolute CBF, CBV, and MTT maps using delay and dispersion-corrected singular value deconvolution (dd-SVD). 24 The study by Lin et al. 19 confirmed that a delay time of >3 s was the optimal threshold for perfusion lesion and a relative CBF of <30% within the area of delay time >3 s was the optimal threshold for ischemic core. Delay time >3 s has been shown to perform equally well as Tmax >6 s. 18
Olea Sphere (OLEA medical Inc., La Ciotat, France) uses an SVD postprocessing method like RAPID and uses CBF < 30% than the contralateral hemisphere and Tmax >2 s which is used to rule out an old infarct and these matches with ischemic core by RAPID software as in our study. The perfusion lesion volume is defined as Tmax >6 s. 20
Syngo.Via (CT Neuro Perfusion VB40, Siemens Healthcare, Erlangen, Germany) relies on a deconvolution model with a delay-insensitive algorithm as well as on interhemispheric comparison. 15 The side with the highest time to drain is automatically characterized as the lesion side and the contralateral side is used as a reference for relative values. Ischemic core is defined by a relative CBF < 30% than the contralateral hemisphere and perfusion lesion volume by Tmax> 6 s.
Criteria for target mismatch were met if (a) the volume of perfusion lesion divided by ischemic core volume (mismatch ratio) was 1.8 or more, (b) the perfusion lesion volume was ⩾15 mL, and (c) the ischemic core volume was <70 mL. 9 Outliers with a difference in ischemic core or perfusion lesion volumes of >300 mL between the two software visually inspected for quality and plausibility. Perfusion maps suggesting diffuse ischemia in both hemispheres or not bound to vascular territories, or outside the brain area were classified as artifactual.
Statistics
Descriptive statistics were performed using SPSS, version 25.0 (IBM Corp., Armonk, NY, USA). The Shapiro-Wilk test was used to assure normality of the continuous variables. Categorical variables are presented as absolute values and percentages, continuous variables as the mean ± standard deviation (SD) if normally distributed or as the median (interquartile range, IQR) if skewed. Pearson’s correlation coefficient was calculated to estimate the correlation of ischemic core, perfusion lesion, and agreement on target mismatch between RAPID and other CTP imaging analysis software. The mean pairwise differences between RAPID and other software with corresponding 95% limits of agreement (confidence interval, CI) for both core volume and perfusion lesion volume estimates were calculated using the one-sample T-test.
Bland-Altman plots were used to illustrate the distribution of the difference in volumetric measurements (mL) between RAPID and other CTP software. The Bland-Altman plots enable visual assessment of the mean difference in values obtained between the paired measurements, data scatter, and the relationship between the magnitude of difference and size of measurement. 28 The horizontal lines above and below the difference line represent 95% limits of agreement of the core volume and perfusion lesion volume and are defined with limits of agreement = difference ± 1.96 SD.
Results
Study population
We screened 11 118 consecutive acute stroke code patients (Figure 2). Of those, 1657 (15%) patients had baseline CTP imaging with RAPID software. Fifty-one (3%) patients were excluded due to inadequacy in image acquisition (poor or absent bolus or excessive patient motion) that led to missing RAPID perfusion maps. Of the 51 excluded patients with missing RAPID perfusion maps, only one patient had artifact-free MIStar and OLEA perfusion maps. Among the 1606 patients with successful RAPID scans, scans were not successful in 42 patients with MIStar software, in 19 patients with OLEA and in 60 patients with Syngo.Via software. The general server of MIStar software was out of order or under service several (days) during study inclusion period resulting in missing perfusion scans during these periods.
The final cohort consisted of 1606 patients with CTP RAPID perfusion maps, 1222 (76%) of which had with MIStar, 596 (37%) had OLEA, and 349 (22%) had Syngo.Via perfusion maps available These three cohorts were used for head-to-head comparison (RAPID vs MIStar, RAPID vs OLEA, and RAPID vs Syngo.Via; Figure 2). Noteworthy, not all four software programs were in use at the same time. The overlapping cohort of three software was used for analysis of 593 (37%) patients (RAPID, MIStar, and OLEA) and of 211 (13%) patients for the three other software (RAPID, MIStar, and Syngo.Via). Baseline characteristics (Table 1) were similar for all cohorts although the Syngo.Via cohort had fewer patients with IVT and EVT and more patients with wake-up stroke than the OLEA and MIStar cohorts.
Table 1.
RAPID | MIStar | OLEA | Syngo.Via | |
---|---|---|---|---|
N = 1606 | N = 1222 | N = 596 | N = 349 | |
Age in years, mean (SD) | 66 (±15) | 66 (±15) | 66 (±15) | 66 (±14) |
IVT alone | 309 (20) | 251 (21) | 113 (19) | 54 (15) |
IVT + EVT | 131 (8) | 92 (8) | 50 (8) | 26 (7) |
EVT alone | 146 (9) | 133 (11) | 72 (12) | 28 (8) |
Occlusion site (EVT), n | ||||
MCA (M1) | 116 | 84 | 47 | 17 |
ICA + M1 (tandem) | 21 | 19 | 9 | 5 |
Basilar/vertebralis | 21 | 19 | 8 | 2 |
other | 50 | 36 | 15 | 13 |
Unknown time of symptom onset but last seen well,* | 813 (51) | 614 (50) | 293 (49) | 184 (53) |
Known time of symptom onset | 793 (49) | 608 (50) | 303 (51) | 165 (47) |
Time from symptom onset to imaging in patients with known time of symptom onset, minutes | 122 (75–22) | 124 (75–238) | 127 (75–248) | 110 (77–205) |
Wake-up stoke | 435 (27) | 327 (27) | 150 (25) | 108 (31) |
Stroke or TIA | 1349 (84) | 1024 (84) | 487 (82) | 303 (87) |
Stroke Mimic | 257 (16) | 198 (16) | 109 (18) | 46 (13) |
Stroke mimic IVT | 2 (0) | 1 (0) | 1 (0) | 0 (0) |
CTP after initiation of IVT | 89 (20) | 66 (19) | 40 (25) | 13 (16) |
Baseline NIHSS | 5 (3–10) | 5 (3–10) | 5 (2–10) | 5 (2–10) |
IVT: intravenous thrombolysis; EVT: endovascular treatment; MCA: middle cerebral artery; ICA: internal carotid artery; TIA: transient ischemic attack; Stroke mimic: no signs of acute ischemia after comprehensive clinical evaluation and imaging nor transient ischemic attack; NIHSS; NIH Stroke Scale.
Data are n (%) or median (interquartile range, IQR) unless otherwise stated.
Unknown time from symptom onset but last seen well within the time window for acute recanalization treatment.
Head-to-head comparison of RAPID with other automated imaging analysis software
Figure 3 depicts the number of patients with target mismatch identified by RAPID and other automated imaging analysis software. The proportion of cases was small, where a target mismatch was classified by RAPID only, but classified as no target mismatch by the software of comparison (MIStar 5%, OLEA 1%, and Syngo.Via 4%; Figure 3). However, for cases where RAPID classified absence of target mismatch while the software of comparison classified presence of target mismatch was small only for MIStar (3%), while larger for Syngo.via (17%) and OLEA (23%). Out of these patients with absent target mismatch with RAPID software, but present mismatch on the other software, 22% (OLEA) and 15% (Syngo.Via) were later classified as stroke mimics. Table 2 compares the results of each software with RAPID results. The number of patients with any perfusion lesion in stroke mimics versus RAPID software in each cohort are also shown in Table 2. OLEA and Syngo.Via classified perfusion lesion in stroke mimics more often and MIStar less often than RAPID software.
Table 2.
RAPID | MIStar | OLEA | Syngo.Via | |
---|---|---|---|---|
Target mismatch | 546 (34) | 410 (34) | 352 (59) | 156 (45) |
Target mismatch classified with RAPID | 546 (100) | 371 (90) | 214 (61) | 96 (62) |
Agreement (P§) on target mismatch with RAPID | 1 | 0.82 | 0.60 | 0.59 |
Ischemic core volume mL | 0 (0–2) | 0 (0–7) | 1 (0–4) | 5 (0–19) |
P§ ischemic core | 1 | 0.92 | 0.80 | 0.43 |
Core difference mL (CI†) | NA | −2 (from −26 to 22) | 2 (from −33 to 38) | −12 (from −116 to 92) |
Perfusion lesion volume mL | 0 (0–49) | 0 (0–2) | 25 (6–75) | 15 (2–50) |
Perfusion lesion >2 mL | 771 (48) | 598 (49) | 530 (89) | 265 (76) |
P§ Perfusion lesion volume | 1 | 0.88 | 0.73 | 0.76 |
Perfusion lesion volume difference mL (CI†) | NA | 4 (from −62 to 71) | −18 (from −132 to 97) | 6 (from −94 to 106) |
Perfusion lesion versus RAPID | 788 (49) | 605 (50) | 582 (98) | 298 (85) |
NA | 625 (51) | 332 (56) | 198 (57) | |
Ischemic core >70 mL versus RAPID | 55 (3) | 43 (4) | 13 (2) | 21 (4) |
NA | 43 (4) | 21 (4) | 11 (3) | |
Perfusion lesion (>0 mL) in stroke mimics versus RAPID | 61 (24) | 31 (16) | 52 (48) | 7 (15) |
NA | 52 (26) | 40 (37) | 37 (80) |
Data are n (%) or median (interquartile range, IQR) unless otherwise stated.
C†: 95% limits of agreement by Bland-Altman, confidence interval; IQR: interquartile range; P§: Pearson’s Rank; NA: not applicable.
The agreement on target mismatch between MIStar and RAPID software was very strong (Pearson correlation = 0.92, P). MIStar classified the presence of large ischemic cores (>70 mL) similarly with RAPID (both 4%) while the presence of perfusion lesion volume was larger (51% vs 50%). The agreement on target mismatch between OLEA and Syngo.Via software versus RAPID software was strong (p = 0.60 and 0.59, respectively). Out of the 596 patients with OLEA and RAPID perfusion maps, OLEA showed fewer large ischemic cores (2% vs 4%, respectively) than RAPID but classified the presence of perfusion lesion volume more often than RAPID (98% vs 56%, respectively). Similarly, out of the 349 patients in Syngo.Via cohort, Syngo.Via classified both large ischemic cores (4% vs 3%, respectively) and presence of perfusion lesion volumes (85% vs 57%, respectively) more often than RAPID software.
Figure 4 visualizes with Bland-Altman plots the volume differences between ischemic core and perfusion lesion volume (±1 SD) to evaluate agreement of volumes of ischemic core and perfusion lesion with MIStar, OLEA, and Syngo.Via in comparison with RAPID. Differences in ischemic core and perfusion lesion volumes are restricted to ±300 for illustrative reasons. Supplemental Figure s2 shows the difference and mean for ischemic core and perfusion lesion volumes on the whole scale and perfusion parameters of individual patients with a more than ±300 mL difference in core and/or perfusion lesion volumes between RAPID and other CTP software.
MIStar gave smaller estimates for ischemic core volume (±1 SD 12 mL) and a larger estimate for perfusion lesion volume (±1 SD 34 mL). OLEA gave a larger estimate for ischemic core volume (±1 SD 18 mL) and a smaller estimate for perfusion lesion volume (±1 SD 58 mL) compared with RAPID software. Syngo.Via, like MIStar, gave smaller estimate for ischemic core volume (±1 SD 53 mL) and a larger estimate for perfusion lesion volume (±1 SD 51 mL) compared with RAPID software.
As RAPID and MIStar software usually do not report very small perfusion lesions (⩽2 mL) in contrast to OLEA and Syngo.Via software, we made an additional comparison of the volume of perfusion lesions >2 mL in each cohort. A perfusion lesion exceeding 2 mL was found with OLEA software in 89% of patients followed by Syngo.Via (76%), MIStar (49%), and finally RAPID (48%).
Patient comparison with three perfusion software
A total of 593 patients had three simultaneous perfusion maps from RAPID, MIStar, and OLEA software available (Supplemental Figure s3). We found agreement on existence of a target mismatch in 37% of the cohort and agreement on absence of a target mismatch in 31% for all three software, while there was disagreement in 32% of the cases.
A total of 211 patients had three perfusion maps from RAPID, MIStar and Syngo.Via software available (Supplemental Figure s3). We found agreement on existence of a target mismatch in 27% of the cohort and agreement on absence of a target mismatch in 49% for all three software, while there was disagreement in 24% of the cases.
Discussion
RAPID software has successfully been used in several large clinical trials, and it has predicted final infarct volume at follow-up imaging after EVT.7–9,14 Our aim was to compare commercially available CTP software head-to-head with RAPID software. Our results showed only small differences in ischemic core volumes between the software, whereas volume differences of the perfusion lesion were larger. MIStar classified target mismatch with a similar rate when compared with RAPID software, whereas both OLEA and Syngo.Via classified target mismatch more frequently than RAPID. The results of the head-to-head comparison did not differ between individual software in the subcohort of patients with perfusion maps from three vendors.
In general, our results are in line with previous studies comparing RAPID with other commercially available CTP software.14,17–26 The differences in ischemic core volume and perfusion lesion volume between RAPID and MIStar software were small in our study. Biswas et al. 23 and Park et al. 26 have previously also shown that RAPID and MIStar exhibit a small difference in ischemic core volume estimates and a larger difference in perfusion lesion volume estimates especially at small volumes and the agreement of RAPID and MIStar on these estimates was higher at larger volumes.
The study by Psychogios et al., comparing RAPID software with both OLEA and Syngo.Via, demonstrated differences in ischemic core estimates and especially in perfusion lesion volume estimates between these software. Psychogios et al. 21 showed that the ischemic core volume estimate for OLEA was smaller but rather similar with RAPID, while there were relevant and a larger difference between RAPID and Syngo.Via software. In our study, the correlation of ischemic core between OLEA and RAPID software was strong but only moderate with Syngo.Via. We also found a similar core difference between RAPID and OLEA as in the study by Psychogios et al. (2 vs 3 mL). The smaller difference in perfusion lesion volume between RAPID and OLEA software (41.9 vs 25 mL) and in ischemic core volume between RAPID and Syngo.Via software (30 vs 12 mL) in our study compared with the study by Psychogios et al. may be due to larger sample size in our study.
Syngo.Via software has previously shown larger ischemic core volume estimates compared with RAPID using similar settings in a small cohort in a subset of MR CLEAN trial patients. 17 Bathla et al. suggested a lower rCBF (<20%) than in our study, and Tmax > 6 s with Syngo.Via software provides high correlation for both ischemic core and for perfusion lesion volume in comparison with RAPID software. 29 Our results are in line with these studies, as Syngo.Via software showed largest difference of ischemic core in comparison with RAPID software. In our study, the correlation of ischemic core volume between RAPID and Syngo.Via software was only moderate, but the same threshold for CBF (<30%) was used with both Syngo.Via and RAPID software. Although we did not have follow-up infarct volumes, a recent study by Muehlen et al., 22 showed that the highest correlation between ischemic core volume and follow-up infarct between RAPID and Syngo.Via software in fully recanalized EVT patients was achieved indeed at different rCBF thresholds (<38% and <25% for the RAPID and Syngo.Via software, respectively).
Xiong et al. have previously shown that main drawback of RAPID is its numerically higher failure rate to detect ischemic brain regions compared with OLEA. Nevertheless, RAPID had a better accuracy for ischemic core volume and infarcts ⩾70 mL when compared with MRI-DWI infarct volume in this study. 20 In our study, OLEA classified less and Syngo.Via more frequently large cores (>70 mL) than RAPID software. Both OLEA and Syngo.Via software classified also target mismatch, perfusion lesion and ischemic core lesion in stroke mimics more often than RAPID software. Whether the perfusion lesions detected with RAPID or other CTP software represent true ischemia, oligoemia, or artifacts cannot be answered in our study setting.
Austein et al. 14 showed that RAPID had the highest precision and a good predictive accuracy for final infarct volume especially in early and fully recanalized EVT patients in comparison with Phillips and Syngo.Via software. In the study by Austein et al., RAPID also showed less overestimation of follow-up infarct volume in EVT patients and predicted perfusion lesion volume better in nonsuccessfully recanalized patients while Syngo.Via software significantly overestimated the perfusion lesion volume. Both resulted in false-positive estimates for a target mismatch profile and a respective large follow-up infarct volume (<70 mL). This could be one possible explanation for our results as Syngo.Via classified target mismatch more often than the RAPID software, and the estimates for perfusion lesion volume was larger than with the RAPID software. The number of patients in the study by Austein et al. was lower than in our Syngo.Via cohort and follow-up imaging took place between 24 h and 8 days which could induce variance in follow-up infarct estimation. Finally, the study by Gunasekera et al. 25 has previously shown that delay- and dispersion corrected single-value decomposition of MIStar correlates better with MRI-DWI follow-up infarct volume than delay and dispersion insensitive deconvolution does with RAPID software in EVT patients with successful recanalization. This suggests that RAPID software may overestimate large ischemic cores when compared with MIStar which may lead to patient exclusion from EVT based on core volume selection. Despite this, our study showed high volumetric agreement in ischemic core volume between MIStar and RAPID software and the number of large cores (>70 mL) were similar with both software.
The major strength of our study is the large number of acute stroke code candidates imaged with CTP and the high proportion of patients treated with acute recanalization treatments (IVT, EVT, or both). Automated imaging analysis software were compared head-to-head in a clinical setting with subgroup analyses of patients with three perfusion software. The decision to proceed to acute recanalization treatment relied on current guidelines of acute recanalization treatment, which are based on large clinical trials.7–9 Patients who turned out to be stroke mimics were not excluded from the study, as they form an important group for CTP imaging in a clinical setting. All included patients were imaged with CTP solely at HUS, increasing the homogeneity of the study cohort.
The major limitation of our study is its retrospective nature. We did not have a consecutive cohort of patients with all four software vendors due to the OLEA software license expiring in September 2019 during the study inclusion period and failure of the Syngo.Via software to provide volumetric measures from raw CTP data from the RAPID, OLEA and MIStar cohorts before software upgrade in November 2020. RAPID, like other CTP software, may sometimes also underestimate or overestimate ischemic core volumes sand perfusion lesion volumes in individual patients. 13 We did not measure the baseline ischemic core volume with comprehensive MRI, nor did we have final infarct volume measurements to assess the accuracy of ischemic core estimation for each automated imaging analysis software which is a major limitation. However, the CBF < 30% threshold in CTP imaging used by RAPID software in our study is extensively validated for core measurement 30 although on average it may underestimate rather than overestimate MRI-DWI lesion but has greater specificity for predicting DWI positive voxels compared to the rCBF < 38% threshold. 31 In the study by Nogueira et al. 7 and Albers et al. 8 RAPID also overestimated less often final infarct volume compared to Syngo.Via software and in large clinical trials concerning acute recanalization treatment it has predicted final infarct volume accurately when compared to MRI-DWI in EVT patients. Acquiring ischemic core volumes with MRI-DWI in addition to CTP at baseline could on the other hand delay the decision of proceeding to possible recanalization treatment. The MRI-DWI scan would have to be performed timely very close to the CTP imaging at baseline for accurate measurements between MRI-DWI and CTP imaging as the core often evolves after imaging and recanalization treatments interfere with the ischemic core progression.
CTP imaging has become an important part of acute stroke care especially after 4.5 h of symptom onset as the large clinical trials showed the EVT and IVT efficacy in late presenting patients.7–10 Although several automated imaging analysis software are on the market, only RAPID has been successfully used in these trials. Although we showed a small core difference and a larger difference in the perfusion lesion volume between three automated imaging software and RAPID, the more liberal classification of perfusion lesion as target mismatch by different software can lead to variance in the number of patients included in acute recanalization treatment. Further clinical trials confirming clinically relevant CTP measures are required.
Conclusions
A comparison of three commonly used automated imaging software with RAPID showed a small core difference and a larger difference in perfusion lesion volume resulting in variance with the agreement rate of target mismatch when compared with RAPID software.
Supplemental Material
Supplemental material, sj-docx-1-eso-10.1177_23969873221135915 for Comparative analysis of core and perfusion lesion volumes between commercially available computed tomography perfusion software by Olli P Suomalainen, Nicolas Martinez-Majander, Gerli Sibolt, Katariina Bäcklund, Juha Järveläinen, Antti Korvenoja, Marjaana Tiainen, Nina Forss and Sami Curtze in European Stroke Journal
Acknowledgments
The RAPID package (iSchemaView Inc, Menlo Park, CA) was provided to screen and include patients for the EXTEND trial from 2015 to 2019 and for the CHARM trial (252LH301 Study) from 11.11.2019 to the end of this study. The MiSTAR package (Apollo Medical Imaging Technology) was provided to screen and include patients for the TASTE trial from 25.8.2018 to the end of the study. A clinical license was available for the usage of the OLEA packages (OLEA medical Inc., La Ciotat, France) from 25.8.2018 to 27.9.2019 and the Syngo.Via (CT Neuro Perfusion VB40, Siemens Healthcare, Erlangen, Germany packages from 2.11.2020 to the end of the study.
Footnotes
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This project has been granted funding for 2020 and 2021 from Helsinki University Hospital governmental subsidiary funds for clinical research (Y1249NEUR1), Maire Taponen foundation, South Carelia Medical Association, Orion foundation and Finnish Medical Association.
Informed consent: Informed consent was not sought for the present study because its monocentric and retrospective character.
Ethical approval: Ethical approval was not sought for the present study because local regulations This study was completed in accordance with the Helsinki Declaration as revised in 2013.
Guarantor: OPS.
Contributorship: OPS, NF, and SC were involved in study concept and design. OPS and KB and were involved in data acquisition and analysis, OPS, NM-M, GS, KB, JJ, AK, MT, NF, and SC and were responsible for drafting the manuscript and figures.
ORCID iDs: Olli P Suomalainen https://orcid.org/0000-0003-1620-051X
Marjaana Tiainen https://orcid.org/0000-0001-5107-1990
Supplemental material: Supplemental material for this article is available online.
References
- 1. Campbell BCV, Stroke Khatri P.. Lancet 2020; 396: 129–142. [DOI] [PubMed] [Google Scholar]
- 2. Campbell BC, Parsons MW. Imaging selection for acute stroke intervention. Int J Stroke 2018; 13: 554–567. [DOI] [PubMed] [Google Scholar]
- 3. Heit JJ, Wintermark M. Imaging selection for reperfusion therapy in acute ischemic stroke. Curr Treat Options Neurol 2015; 17: 332. [DOI] [PubMed] [Google Scholar]
- 4. Heit JJ, Wintermark M. Perfusion computed tomography for the evaluation of acute ischemic stroke: strengths and pitfalls. Stroke 2016; 47: 1153–1158. [DOI] [PubMed] [Google Scholar]
- 5. Campbell BCV, Mitchell PJ, Kleinig TJ, et al. Endovascular therapy for ischemic stroke with perfusion-imaging selection. N Engl J Med 2015; 372: 1009–1018. [DOI] [PubMed] [Google Scholar]
- 6. Yoo AJ, Verduzco LA, Schaefer PW, et al. MRI-Based selection for intra-arterial stroke therapy. Stroke 2009; 40: 2046–2054. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Nogueira RG, Jadhav AP, Haussen DC, et al. Thrombectomy 6 to 24 hours after stroke with a mismatch between deficit and infarct. N Engl J Med 2018; 378: 11–21. [DOI] [PubMed] [Google Scholar]
- 8. Albers GW, Marks MP, Kemp S, et al. Thrombectomy for stroke at 6 to 16 hours with selection by perfusion imaging. New Engl J Med 2018; 378: 708–718. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Campbell BCV, Ma H, Ringleb PA, et al. Extending thrombolysis to 4·5–9 h and wake-up stroke using perfusion imaging: a systematic review and meta-analysis of individual patient data. Lancet 2019; 394: 139–214. [DOI] [PubMed] [Google Scholar]
- 10. Albers GW, Goyal M, Jahan R, et al. Ischemic core and hypoperfusion volumes predict infarct size in SWIFT PRIME. Ann Neurol 2016; 79: 76–89. [DOI] [PubMed] [Google Scholar]
- 11. Saver JL, Goyal M, Bonafe A, et al. Stent-retriever thrombectomy after intravenous t-PA vs.t-PA alone in stroke. New Engl J Med 2015; 372: 2285–2295. [DOI] [PubMed] [Google Scholar]
- 12. Lansberg MG, Lee J, Christensen S, et al. RAPID automated patient selection for reperfusion therapy. Stroke 2011; 42: 1608–1614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Olivot JM, Mlynash M, Thijs VN, et al. Optimal tmax threshold for predicting penumbral tissue in acute stroke. Stroke 2009; 40: 469–475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Austein F, Riedel C, Kerby T, et al. Comparison of perfusion CT software to predict the final infarct volume after thrombectomy. Stroke 2016; 47: 2311–2317. [DOI] [PubMed] [Google Scholar]
- 15. Sakai Y, Delman BN, Fifi JT, et al. Estimation of ischemic core volume using computed tomographic perfusion. Stroke 2018; 49: 2345–2352. [DOI] [PubMed] [Google Scholar]
- 16. Schramm P, Schellinger PD, Klotz E, et al. Comparison of perfusion computed tomography and computed tomography angiography source images with perfusion-weighted imaging and diffusion-weighted imaging in patients with acute stroke of less than 6 hours’ duration. Stroke 2004; 35: 1652–1658. [DOI] [PubMed] [Google Scholar]
- 17. Koopman MS, Berkhemer OA, Geuskens RREG, et al. Comparison of three commonly used CT perfusion software packages in patients with acute ischemic stroke. J Neurointerv Surg 2019; 11: 1249–1256. [DOI] [PubMed] [Google Scholar]
- 18. Lin L, Chen C, Tian H, et al. Perfusion computed tomography accurately quantifies collateral flow after acute ischemic stroke. Stroke 2020; 51: 1006–1009. [DOI] [PubMed] [Google Scholar]
- 19. Lin L, Bivard A, Levi CR, et al. Comparison of computed tomographic and magnetic resonance perfusion measurements in acute ischemic stroke: back-to-back quantitative analysis. Stroke 2014; 45: 1727–1732. [DOI] [PubMed] [Google Scholar]
- 20. Xiong Y, Huang CC, Fisher M, et al. Comparison of automated CT perfusion softwares in evaluation of acute ischemic stroke. J Stroke Cerebrovasc Dis 2019; 28: 104392. [DOI] [PubMed] [Google Scholar]
- 21. Psychogios MN, Sporns PB, Ospel J, et al. Automated perfusion calculations vs.Visual scoring of collaterals and CBV-ASPECTS : has the machine surpassed the eye? Clin Neuroradiol 2021; 31: 499–506. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Muehlen I, Sprügel M, Hoelter P, et al. Comparison of two automated computed tomography perfusion applications to predict the final infarct volume after thrombolysis in cerebral infarction 3 recanalization. Stroke 2022; 53: 1657–1664. [DOI] [PubMed] [Google Scholar]
- 23. Biswas V, McVerry F, MacDougall N, et al. A comparison of hypoperfusion lesion volumes on CT perfusion derived from different software programs, ESOC 2019; May 22-44, 10.26226/morressier.5cb58cf4c668520010b564ec [DOI]
- 24. Lin L, Bivard A, Krishnamurthy V, et al. Whole-brain CT perfusion to quantify acute ischemic penumbra and Core. Radiology 2016; 279: 876–887. [DOI] [PubMed] [Google Scholar]
- 25. Gunasekera L, Churilov L, Mitchell P, et al. Automated estimation of ischemic core prior to thrombectomy: comparison of two current algorithms. Neuroradiol 2021; 63: 1645–1649. [DOI] [PubMed] [Google Scholar]
- 26. Park PSW, Chan R, Senanayake C, et al. Large vessel occlusion sites affect agreement between outputs of three computed tomography perfusion software packages. J Stroke Cerebrovasc Dis 2022; 31: 106482. [DOI] [PubMed] [Google Scholar]
- 27. Campbell BC, Christensen S, Levi CR, et al. Cerebral blood flow is the optimal CT perfusion parameter for assessing infarct core. Stroke 2011; 42: 3435–3440. [DOI] [PubMed] [Google Scholar]
- 28. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986; 1: 307–310. [PubMed] [Google Scholar]
- 29. Bathla G, Ortega-Gutierrez S, Klotz E, et al. Comparing the outcomes of two independent computed tomography perfusion softwares and their impact on therapeutic decisions in acute ischemic stroke. J Neurointerv Surg 2020; 12: 1028–1032. [DOI] [PubMed] [Google Scholar]
- 30. Demeestere J, Wouters A, Christensen S, et al. Review of perfusion imaging in acute ischemic stroke: from time to tissue. Stroke 2020; 51: 1017–1024. [DOI] [PubMed] [Google Scholar]
- 31. Cereda CW, Christensen S, Campbell BC, et al. A benchmarking tool to evaluate computer tomography perfusion infarct core predictions against a DWI standard. J Cereb Blood Flow Metab 2015; 36: 1780–1789. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplemental material, sj-docx-1-eso-10.1177_23969873221135915 for Comparative analysis of core and perfusion lesion volumes between commercially available computed tomography perfusion software by Olli P Suomalainen, Nicolas Martinez-Majander, Gerli Sibolt, Katariina Bäcklund, Juha Järveläinen, Antti Korvenoja, Marjaana Tiainen, Nina Forss and Sami Curtze in European Stroke Journal