Skip to main content
Neurology logoLink to Neurology
. 2022 Sep 6;99(10):e1009–e1018. doi: 10.1212/WNL.0000000000200815

Multivariable Prediction Model for Futile Recanalization Therapies in Patients With Acute Ischemic Stroke

Thomas Raphael Meinel 1,, Christine Lerch 1, Urs Fischer 1, Morin Beyeler 1, Adnan Mujanovic 1, Christoph Kurmann 1, Bernhard Siepen 1, Adrian Scutelnic 1, Madlaine Müller 1, Martina Goeldlin 1, Nebiyat Filate Belachew 1, Tomas Dobrocky 1, Jan Gralla 1, David Seiffge 1, Simon Jung 1, Marcel Arnold 1, Roland Wiest 1, Raphael Meier 1,*, Johannes Kaesmacher 1,*
PMCID: PMC9519255  PMID: 35803722

Abstract

Background and Objectives

Very poor outcome despite IV thrombolysis (IVT) and mechanical thrombectomy (MT) occurs in approximately 1 of 4 patients with ischemic stroke and is associated with a high logistic and economic burden. We aimed to develop and validate a multivariable prognostic model to identify futile recanalization therapies (FRTs) in patients undergoing those therapies.

Methods

Patients from a prospectively collected observational registry of a single academic stroke center treated with MT and/or IVT were included. The data set was split into a training (N = 1,808, 80%) and internal validation (N = 453, 20%) cohort. We used gradient boosted decision tree machine learning models after k-nearest neighbor imputation of 32 variables available at admission to predict FRT defined as modified Rankin scale 5–6 at 3 months. We report feature importance, ability for discrimination, calibration, and decision curve analysis.

Results

A total of 2,261 patients with a median (interquartile range) age of 75 years (64–83 years), 46% female, median NIH Stroke Scale 9 (4–17), 34% IVT alone, 41% MT alone, and 25% bridging were included. Overall, 539 (24%) had FRT, more often in MT alone (34%) as compared with IVT alone (11%). Feature importance identified clinical variables (stroke severity, age, active cancer, prestroke disability), laboratory values (glucose, C-reactive protein, creatinine), imaging biomarkers (white matter hyperintensities), and onset-to-admission time as the most important predictors. The final model was discriminatory for predicting 3-month FRT (area under the curve 0.87, 95% CI 0.87–0.88) and had good calibration (Brier 0.12, 0.11–0.12). Overall performance was moderate (F1-score 0.63 ± 0.004), and decision curve analyses suggested higher mean net benefit at lower thresholds of treatment (up to 0.8).

Conclusions

This FRT prediction model can help inform shared decision making and identify the most relevant features in the emergency setting. Although it might be particularly useful in low resource healthcare settings, incorporation of further multifaceted variables is necessary to further increase the predictive performance.


Even with the outstanding efficacy of mechanical thrombectomy (MT) for treatment of large-vessel acute ischemic stroke (AIS), 1 in 5 patients in the randomized controlled trials1 and 1 in 3 patients in real-world settings2 have very poor long-term outcome (modified Rankin Scale [mRS] 5–6 at 90 days) despite a technically successful intervention. The term futile intervention was coined to elucidate this issue.3-5 Similarly, 1 in 5 patients receiving IV thrombolysis (IVT) has very poor long-term outcome despite best available treatment with even higher prevalence rates in elderly patients.6

Given the need for informed shared decision making and the high societal and health economics burden of both treatments, there is a need to proof that MT remains (cost-)effective in patients at high risk for futile recanalization therapies (FRTs).4,7 Although individual patients' preferences may vary, the 5-year quality-adjusted life expectancy in stroke survivors reaching mRS 5 is minimal (0.06).8-10 Several clinical and imaging biomarkers associated with FRT have been identified.4,11-18 However, the models developed for MT are insufficient to reliably inform patient and proxies and to guide the decision-making in individual patients.19-22 Besides the MR PREDICT tool,23 which can be used for patients undergoing bridging IVT, no model for IVT-only patients not fulfilling endovascular trial criteria has been developed in the context of contemporary MT. A reliable prediction algorithm to identify patients who will have FRT with variables available at baseline is missing. Such an algorithm is needed to realistically inform patient and proxies about the potential risk/benefits of treatment and facilitate patient-oriented informed decision (e.g., withholding maximal therapy if advanced directives state that the patient does not wish to live with severe dependency). In addition, because, in several countries, access to MT and qualified personnel is limited,24 but with rising strain and workload,25 reliable FRT prediction could accommodate the rising demand and increasing healthcare costs.

We hypothesized that the combination of several clinical, laboratory, imaging, and workflow variables would enable accurate prediction of FRT after both IVT and MT to better inform shared decision making and possibly even to avoid futile therapies. In addition, we wanted to perform internal validation of the developed model, analyze the clinical utility of the final model, and analyze potential differences in predictors of FRT between patients with and without detectable vessel occlusion.

Methods

This study adheres to the transparent reporting of a multivariable prediction model for individual prognosis or diagnosis statement.26,27

We included consecutive adult patients from the registry treated with IVT and/or MT between January 2015 and October 2020 and excluded patients with missing outcome at 3 months (12%, n = 322). Patients with missing outcome had a slightly worse prognostic profile with a higher stroke severity, more history of transient ischemic attack, longer onset-to-admission times, and more frequent MT (see eTable 1, links.lww.com/WNL/C129 for full comparison). Patients had to receive IVT alone, MT alone, or a combination (bridging approach). At our center, we have a liberal approach of IVT and/or MT indications performing treatment also in borderline indications such as low stroke severity, distal occlusions, extended time window, and prestroke impairment (see our guidelines for detailed indications/contraindications).28

The purpose of the developed model is the prospective prediction of very poor 3-month functional outcome in patients with AIS who are potential candidates for IVT and/or MT. The intended use of the machine learning (ML) algorithm in the acute stroke workflow has been published and is presented in Figure 1.29 In brief, it is intended to inform shared decision making with the patient and next of kin based on the probability of FRT, after the decision for IVT and/or MT treatment has been made, but before treatment has been actually started.

Figure 1. Intended Use of the Model in a Stroke Workflow.

Figure 1

IVT = IV thrombolysis; ML = machine learning; mRS = modified Rankin scale; MT = mechanical thrombectomy. The ML model outputs a probability (risk score) for mRS 5–6 based on variables available ahead of recanalization therapies. This information is provided to the treating physicians after selection of patient for recanalization and could serve as a marker for futile recanalization. Workflow derived from Meier et al. with permission.29

Standard Protocol Approvals, Registrations, and Patient Consents

Approval by local ethics committee was granted (Kantonale Ethikkommission, Bern, Switzerland: ID 231/2014 and ID 2020-01696) waiving consent of participants in accordance with Swiss Law.

We randomly split the final data set (n = 2,261) in the training set (80%, n = 1,808) used for development and internal validation (20%, n = 453). The flowchart showing patient inclusion and the study design is shown in eFigure 1 (links.lww.com/WNL/C129).

Clinical, laboratory, imaging, and workflow variables were collected prospectively by dedicated research staff, and missing values completed by using the clinical information system. Initially, 32 baseline admission variables were considered, but we dropped input variables (features) that were not routinely registered when more than 25% of the values were missing. Dropped variables included D-dimer, high-density lipoprotein cholesterol, hemoglobin A1c, triglycerides, troponin, and activated partial thromboplastin time. See eTable 2 (links.lww.com/WNL/C129) for a full list of features considered and their respective definitions. The choice of independent variables was based on existing literature on pathophysiologically plausible associations with FRT that were available and documented in a sufficiently high data quality at our institution.

FRT was defined as mRS 5–6 at 3 months dichotomizing the outcome as a binary target variable and was assessed by certified physicians during routine clinical visits or certified study nurses by semistructured telephone interviews. Death was assessed through linkage with the national mortality registry. Assessors were not blinded but unaware of this project at the time of assessment. Classes of FRT were imbalanced (24% mRS ≥5, 76% mRS <5, ratio 3.2:1). We imputed missing data with k-nearest neighbor (k = 15 neighbors) imputation on normalized data of the training and validation separately. We normalized features to [0,1] interval with min-max normalization.

We implemented Gradient Boosting (XGBoost classifier) by means of Python (3.7.7) scikit learn30 (0.22.1), XGBoost31 (1.2.0, for XGBoost classifier) based on a previous project showing that this algorithm had good overall performance and high robustness.29

We used a nested, stratified 10-fold cross-validation strategy for model development (XGBoost classifier).29 In the outer cross-validation loop, the training data set was split into 10 equally sized subsets.29 Nine of the 10 subsets were used for training and 1 for validation. In the inner loop, hyperparameter optimization was performed based on maximization of F1-score in a 10-fold randomized grid search using the data of the previously formed 9 folds.29

For validation, we trained ML algorithms using the setting of the nested cross-validation's inner loop on the complete training data (10-fold randomized grid search) and applied the resulting ML model to separate validation data (n = 453).29 We repeated this process 20 times using a different random seed for algorithm initialization in each run.

Statistical Analysis

We assessed univariate associations of clinical variables with FRT in the overall cohort as well as training and validation data separately using standard descriptive statistics: χ2 and Fisher exact tests for categorical variables, the Mann-Whitney U test for non-normally continuous or ordinally scaled variables, and the Welsch t test for independent normally distributed data. We used the pmsampsize Stata Package (Stata Statistical Software: Release 16; StataCorp, College Station, TX) to calculate the minimum sample size required using 40 candidate predictors based on an assumed outcome prevalence of 25% and a lower bound for the new model's R2 value of 0.25.32 This resulted in a final sample size of 1,230 patients.

We report model discrimination, calibration, and clinical utility. For discrimination of the models at the threshold of p = 0.5, we report precision, recall, F1-score, accuracy, balanced accuracy, specificity, and Matthew correlation. Furthermore, we report the area under the curve (AUC) of the receiver operating characteristic (ROC) and the average precision score throughout all possible thresholds. For calibration of the model, we report Brier score and expected calibration error grounded on 10 bins. We computed feature importance using Shapley values for the XGBClassifier. Permutation feature importance was defined as a decrease in F1-score by shuffling the values of a single feature randomly. Decision curve analysis33 is reported to quantify the clinical utility of the model on validation data. Because the a priori probability threshold will vary according to healthcare resources, we did not define a fix a priori threshold for risk of FRT to assess the net benefit. The results are reported as mean and CI based on 10-fold cross-validation (model development). Performance on validation data was reported as mean ±1 SD over 20 runs with different random seeds for algorithm initialization.

Data Availability

Investigators may request access to anonymized individual patient data including analysis-ready data sets, and data set specifications, after publication. Before using the data, proposals need to be approved by an independent review panel at swissethics.ch/basec, and a signed data sharing agreement will then be approved.

Results

Baseline Characteristics

The final cohort included 2,261 patients: median (interquartile range) age 75 years (64–83 years), 46% female, and median NIH Stroke Scale 9 (4–17). In total, 34% of patients received IVT alone, 41% MT alone, and 25% both acute recanalization treatments (bridging approach). FRT occurred overall in 24% of patients and more often in patients receiving MT alone (34%) as compared with bridging patients (26%) and IVT alone (11%).

Baseline characteristics of patients in training and validation set are presented in Table 1. Taken together, older age, higher stroke severity, active cancer, and a higher cardiovascular risk profile were associated with FRT on univariate analysis.

Table 1.

Baseline Characteristics of all Included Patients

graphic file with name WNL-2022-200789T1.jpg

Discrimination of ML methods was good. Performance and a complete overview of the results are presented in Table 2. Overall, discrimination for predicting FRT (AUC 0.87 95% CI 0.87–0.88) and calibration (Brier 0.12, 0.11–0.12) was good, and overall performance was moderate (F1-score 0.63 ± 0.004) in the validation data set (see eFigures 2 and 3, links.lww.com/WNL/C129, for ROC curves of the full model in the derivation and validation cohort).

Table 2.

Performance of the Model for mRS 5–6 Prediction

graphic file with name WNL-2022-200789T2.jpg

Shapley values feature importance revealed that the most important features included clinical variables (higher stroke severity, older age, active cancer, prestroke disability), laboratory values (higher glucose, higher C-reactive protein [CRP], less dyslipidemia), imaging biomarkers (more white matter hyperintensities), and longer onset-to-admission time. The feature importances are shown in Figure 2 (see eFigures 4 and 5, links.lww.com/WNL/C129, for all features in patients with and without detectable vessel occlusion).

Figure 2. Shapley Values Feature Importance.

Figure 2

Computed for the XGBoost (mean values of 10 feature permutations and 20 random initializations). (A) All patients, (B) only patients with detectable vessel occlusion, and (C) only patients without detectable vessel occlusion. See the Supplement (links.lww.com/WNL/C129) for full model and features. Frame indicates the 10 most important variables. NIHSS = NIH Stroke Scale.

In patients without detectable vessel occlusion, higher international normalized ratio and atrial fibrillation seemed to be more important, whereas white matter hyperintensity severity and active cancer seemed to be less important.

The decision curve for XGBClassifier is shown in Figure 3. The mean net benefit for p = 0.8 was minimal (0.02 ± 0.01), and relevant net benefit was only present in lower a priori thresholds. The net benefit—in this context—is weighing the profit obtained by classifying an individual with the outcome and the loss caused by falsely classifying an individual without the outcome.34 No evidence for harm was present throughout all thresholds.

Figure 3. Decision Curve Analysis for XGBClassifier.

Figure 3

The blue line indicates the mean over 20 random initializations. The rug plot shows the samples used for computation of the decision curve. No risk denotes the trivial strategy of always predicting mRS 0–4, and All risk denotes the strategy of always predicting mRS 5–6. mRS = modified Rankin scale.

Discussion

The development and validation of a multivariable prediction model for futile thrombolysis and thrombectomy showed the following main findings: (1) FRT overall occurs in 1 in 4 patients and more often in patients receiving MT alone (34%) as compared with IVT alone (11%). (2) The most relevant predictors of FRT included clinical variables (higher stroke severity, older age, active cancer, prestroke disability), laboratory values (higher glucose, higher CRP, higher creatinine), imaging biomarkers (more white matter hyperintensities), and longer onset-to-admission time. (3) The combination of several clinical, laboratory, neuroimaging, and workflow variables at baseline showed good discrimination for prediction of FRT. (4) Our model will help to inform shared decision making, but its usability to withhold treatment is uncertain and depends on healthcare resources. (5) Potential differences for prediction of FRT between patients with and without detectable vessel occlusion were identified.

Despite the success of IVT and MT in improving stroke outcome, rates of FRT remain considerable for both treatments.26 Given more liberal indications in the real-world as compared with the patients included in the original randomized controlled studies,35,36 for both treatments, there is a gradual shift from selecting patients to deselecting patients. However, this development is likely to cause an increase in FRT. Although the costs of IVT and EVT are much lower as compared with established treatments, for example, for palliative cancer, the treatments pose enormous logistic, economic, and ethical challenges in acute stroke treatment.

With this analysis, we have developed and internally validated a multivariable prediction algorithm to discriminate between patients who are likely or unlikely to have a very poor clinical outcome despite best available treatment with IVT and/or MT.

The lower rate of FRT in IVT patients might be related to the fact that patients meeting IVT criteria are early presenters, without extensive hemorrhagic changes. Some features included in our model have been partially described before,14,37-40 but several are novel and their relative importance can now be estimated (Figure 2). This allows clinicians to rapidly clarify the most relevant features in the emergency setting. All variables considered in our model are available on admission or can be obtained within a few minutes until the decision to perform IVT/MT has to be taken.

The intended use of our model is ischemic stroke patients before treatment has been started, but the decision for treatment with IVT and/or MT has been made. The derivation cohort is from a high-volume academic stroke center with low restrictions to perform those treatments. For clear-cut indications for MT, such as patients presenting early with severe stroke, the updated MR CLEAN predict tool23 might be more useful, but it cannot be applied to borderline indications or to inform decision on IVT-only patients not fulfilling endovascular trial criteria.

Our model has good discrimination and reasonable calibration, both in the derivation as well as the validation cohort. The model output can be used to inform and discuss with patients and/or next of kin the high risk of poor outcome and help to set realistic expectations.41 However, in high-resource healthcare systems, the algorithm will probably not be used because no patients will be excluded from acute recanalization treatments despite high chances for FRT. In addition, false positives (classifying patients as FRT, despite the fact that they might gain functional independence) should be weighted more than false-negative classifications. In other words, the positive predictive value of any FRT algorithm has to be as great as possible to evade skipping an evidence-based treatment from appropriate patients which may benefit from IVT/MT. Hence, we caution colleagues to apply the appealing AUC reported here and by others37,42 to individual patients regarding the clinical utility in excluding patients from reperfusion therapies.29 However, there was no evidence of harm as shown by the decision curve analysis. Randomized controlled trials need to clarify whether the cost-effectiveness of MT is preserved in patients with high risk of poor outcome.

Nevertheless, the situation might be very different in low-income and mid-income countries where access to IVT/MT is limited by shortage of MT devices, IVT medication, staff, or other hurdles. Fittingly, our models exhibited net benefit in the lower probability thresholds. This means that they might be most useful in settings of very limited healthcare resources. Cultural perception and individual preferences might also influence which a priori cutoff will be chosen in an individual scenario.

In addition, this rather simple algorithm provides evidence that prediction of FRT is possible when different information sources (clinical, laboratory, imaging, time metrics) are combined. Further and more sophisticated information sources are promising additions for refinement of this algorithm. Those include ischemic core volume,43 ischemic core location,44 penumbra volume, covert brain infarctions, brain atrophy,45 masseter muscle,46 and oxygen saturation among others have not been accounted for. Reliable identification of FRT ahead of treatment is of utmost importance,47 and this model and proposed refinements can serve as a starting point to reach the intended use. However, a recent study found that a large part of the variance in outcome after MT is explained by variables that are only known after the treatment decision has been made challenging the possibility to predict FRT in the emergency setting before knowing the outcome of the intervention—at least for MT patients.48 Regarding the model performance, previous studies have shown that for most tabulated data sets, the differences in performance between different analytical ML methods and conventional logistic regression are minimal or nonexistent.21,29,37

Strengths of this analysis include its large sample size with good quality data of predictors easily obtained in an emergency setting. This study has the limitations of a single center, retrospective registry potentially limiting its generalizability to other settings. Most importantly, no medical comparison group was available. Hence, inference on a potential residual clinical benefit even in a patient with high probability for FRT is not possible. In addition, 12% (322 patients) of the cohort had missing 3-month outcome and those had a slightly worse prognostic profile. Moreover, several advanced imaging parameters such as ischemic core volume, ischemic core location,44 penumbra volume and mismatch profile,49 covert brain infarctions, brain atrophy,45 masseter muscle volume, and oxygen saturation among others have not been accounted for. Another limitation is the choice/availability of independent variables, for example, information on dementia/prestroke cognitive impairment was unavailable. Information on medical history was obtained prospectively in the registry and includes variables obtained during hospital stay, so it is uncertain how many of the predictors incorporated could be obtained within a short time in an emergency setting. Hence, our results need to be replicated by other groups and verified by upcoming randomized controlled trials on this issue in several subgroups with high risk for FRT, such as low ASPECTS (NCT03805308, NCT03811769).

In conclusion, FRT occurs in 1 in 4 patients and more often in patients receiving MT alone (34%) as compared with IVT alone (11%). We identified clinical variables (higher stroke severity, older age, active cancer, prestroke disability), laboratory values (higher glucose, higher CRP, higher creatinine), imaging biomarkers (white matter hyperintensities), and time from onset-to-admission as the most relevant predictors of FRT. The prediction algorithm will help to inform shared decision making and to set realistic expectations. Although the clinical benefit and usability of this algorithm for withholding treatments in settings with high healthcare resources is to be established in future studies, the development of a reliable algorithm for prediction of FRT seems to be within reach and should incorporate more advanced admission imaging features.

Glossary

AIS

acute ischemic stroke

AUC

area under the curve

CRP

C-reactive protein

FRT

futile recanalization therapy

IVT

IV thrombolysis

ML

machine learning

MT

mechanical thrombectomy

ROC

receiver operating characteristic

Appendix. Authors

Appendix.

Study Funding

This study was supported by funding received from Swiss National Science Foundation (Grant No. 320030L_170060 STRAY-CATS), the Swiss Heart Foundation (Grant No. FF17033 and FF18059) and the University of Bern (a digital reference network platform for clinical and experimental neuroscience—deep phenotyping and data integration).

Disclosure

U. Fischer has received research grants from Medtronic (SWIFT DIRECT and BEYOND SWIFT) and does consultancy for Medtronic, Stryker and CSL Behring outside the submitted work. J. Gralla has received research grants from Medtronic (SWIFT DIRECT and BEYOND SWIFT) and does consultancy for Medtronic outside the submitted work. M. Goeldlin: grants from Bangerter-Rhyner-Foundation, Swiss Stroke Society, Mittelbauvereinigung der Universität Bern. Congress grant from Pfizer. All other authors report no relevant disclosures. Go to Neurology.org/N for full disclosures.

References

  • 1.Goyal M, Menon BK, Van Zwam WH, et al. Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet. 2016;387(10029):1723-1731. doi: 10.1016/S0140-6736(16)00163-X. [DOI] [PubMed] [Google Scholar]
  • 2.Jansen IGH, Mulder MJHL, Goldhoorn RJB. Endovascular treatment for acute ischaemic stroke in routine clinical practice: prospective, observational cohort study (MR CLEAN Registry). BMJ. 2018;360:k949. doi: 10.1136/bmj.k949. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Lindsberg PJ, Sairanen T, Nagel S, Salonen O, Silvennoinen H, Strbian D. Recanalization treatments in basilar artery occlusion—systematic analysis. Eur Stroke J. 2016;1(1):41-50. doi: 10.1177/2396987316629889. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Hussein HM, Saleem MA, Qureshi AI. Rates and predictors of futile recanalization in patients undergoing endovascular treatment in a multicenter clinical trial. Neuroradiology. 2018;60(5):557-563. doi: 10.1007/s00234-018-2016-2. [DOI] [PubMed] [Google Scholar]
  • 5.Ganesh A, Al-Ajlan FS, Sabiq F, et al. Infarct in a new territory after treatment administration in the ESCAPE randomized controlled trial (endovascular treatment for small core and anterior circulation proximal occlusion with emphasis on minimizing CT to recanalization times). Stroke. 2016;47(12):2993-2998. doi: 10.1161/STROKEAHA.116.014852. [DOI] [PubMed] [Google Scholar]
  • 6.Mishra NK, Ahmed N, Andersen G, et al. Thrombolysis in very elderly people: controlled comparison of SITS international stroke thrombolysis registry and virtual international stroke trials archive. BMJ. 2010;341(7783):1144. doi: 10.1136/bmj.c6046. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Molina CA. Editorial: futile recanalization in mechanical embolectomy trials: a call to improve selection of patients for revascularization. Stroke. 2010;41(5):842-843. doi: 10.1161/STROKEAHA.110.580266. [DOI] [PubMed] [Google Scholar]
  • 8.Ganesh A, Luengo-Fernandez R, Pendlebury ST, Rothwell PM. Weights for ordinal analyses of the modified Rankin scale in stroke trials: a population-based cohort study. EClinicalMedicine. 2020;23:100415. doi: 10.1016/j.eclinm.2020.100415. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Deb-Chatterji M, Konnopka A, Flottmann F, et al. Patient-reported, health-related, quality of life after stroke thrombectomy in clinical practice. Neurology. 2020;95(12):e1724-e1732. doi: 10.1212/WNL.0000000000010356. [DOI] [PubMed] [Google Scholar]
  • 10.Rangaraju S, Haussen D, Nogueira RG, Nahab F, Frankel M. Comparison of 3-month stroke disability and quality of life across modified Rankin scale categories. Interv Neurol. 2017;6(1-2):36-41. doi: 10.1159/000452634. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Lee SH, Kim BJ, Han MK, et al. Futile reperfusion and predicted therapeutic benefits after successful endovascular treatment according to initial stroke severity. BMC Neurol. 2019;19(1):1-9. doi: 10.1186/s12883-019-1237-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Alawieh A, Vargas J, Fargen KM, et al. Impact of procedure time on outcomes of thrombectomy for stroke. J Am Coll Cardiol. 2019;73(8):879-890. doi: 10.1016/j.jacc.2018.11.052. [DOI] [PubMed] [Google Scholar]
  • 13.Gilberti N, Gamba M, Premi E, et al. Leukoaraiosis is a predictor of futile recanalization in acute ischemic stroke. J Neurol. 2017;264(3):448-452. doi: 10.1007/s00415-016-8366-y. [DOI] [PubMed] [Google Scholar]
  • 14.de Havenon A, Castonguay A, Nogueira R, et al. Prestroke disability and outcome after thrombectomy for emergent anterior circulation large vessel occlusion stroke. Neurology. 2021;97(19):e1914-e1919. doi: 10.1212/WNL.0000000000012827. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Deng G, Xiao J, Yu H, Chen M, Shang K, Qin C. Predictors of futile recanalization after endovascular treatment in acute ischemic stroke : a meta-analysis. J Neurointerv Surg. 2021;2021:1-6. doi: 10.1136/neurintsurg-2021-017963. [DOI] [PubMed] [Google Scholar]
  • 16.Pan H, Lin C, Chen L, et al. Multiple-factor analyses of futile recanalization in acute ischemic stroke patients treated with mechanical thrombectomy. Front Neurol. 2021;12:704088. doi: 10.3389/fneur.2021.704088. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Zhou T, Yi T, Li T, et al. Predictors of futile recanalization in patients undergoing endovascular treatment in the DIRECT-MT trial. J Neurointerv Surg. 2021;2021:neurintsurg-2021-017765. doi: 10.1136/neurintsurg-2021-017765. [DOI] [PubMed] [Google Scholar]
  • 18.Mohammaden MH, Stapleton CJ, Brunozzi D, et al. Predictors of poor outcome despite successful mechanical thrombectomy of anterior circulation large vessel occlusions within 6 h of symptom onset. Front Neurol. 2020;11:907. doi: 10.3389/fneur.2020.00907. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Rangaraju S, Liggins JTP, Aghaebrahim A, et al. Pittsburgh outcomes after stroke thrombectomy score predicts outcomes after endovascular therapy for anterior circulation large vessel occlusions. Stroke. 2014;45(8):2298-2304. doi: 10.1161/STROKEAHA.114.005595. [DOI] [PubMed] [Google Scholar]
  • 20.Kent DM, Ruthazer R, Decker C, et al. Development and validation of a simplified stroke–thrombolytic predictive instrument. Neurology. 2015;85(11):942-949. doi: 10.1212/WNL.0000000000001925. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Van Os HJA, Ramos LA, Hilbert A, et al. Predicting outcome of endovascular treatment for acute ischemic stroke: potential value of machine learning algorithms. Front Neurol. 2018;9:1-8. doi: 10.3389/fneur.2018.00784. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Alaka SA, Menon BK, Brobbey A, et al. Functional outcome prediction in ischemic stroke: a comparison of machine learning algorithms and regression models. Front Neurol. 2020;11:889. doi: 10.3389/fneur.2020.00889. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Venema E, Roozenbeek B, Mulder MJHL, et al. Prediction of outcome and endovascular treatment benefit: validation and update of the MR PREDICTS decision tool. Stroke. 2021;52(9):2764-2772. doi: 10.1161/STROKEAHA.120.032935. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Aguiar de Sousa D, von Martial R, Abilleira S, et al. Access to and delivery of acute ischaemic stroke treatments: a survey of national scientific societies and stroke experts in 44 European countries. Eur Stroke J. 2019;4(1):13-28. doi: 10.1177/2396987318786023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Fargen KM, Arthur AS, Leslie-Mazwi T, et al. A survey of burnout and professional satisfaction among United States neurointerventionalists. J Neurointerv Surg. 2019;11(11):1100-1104. doi: 10.1136/neurintsurg-2019-014833. [DOI] [PubMed] [Google Scholar]
  • 26.Heus P, Reitsma JB, Collins GS, et al. Transparent reporting of multivariable prediction models in journal and conference abstracts: TRIPOD for abstracts. Ann Intern Med. 2020;173(1):42‐47. doi: 10.7326/M20-0193. [DOI] [PubMed] [Google Scholar]
  • 27.Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med. 2015;162(1):55-63. doi: 10.7326/M14-0697. [DOI] [PubMed] [Google Scholar]
  • 28.Jung S, Mattle H, Horvath T, et al. Stroke Guidelines of the Bern Stroke Network. 2021. Accessed December 31, 2021. neurologie.insel.ch/fileadmin/Neurologie/Dokumente/Stroke_Center/Stroke_Guidelines_2021_English.pdf. [Google Scholar]
  • 29.Meier R, Burri M, Fischer S, et al. Beyond accuracy: investigating the potential clinical utility of predicting functional dependency and severe disability or death in successfully reperfused patients using machine learning. medRxiv. 2020. doi: 10.1101/2020.11.17.20232280. [DOI] [Google Scholar]
  • 30.Pedregosa F, Varoquaux G, Gramfort A, et al. Scikit-learn: machine learning in Python. J Mach Learn Res. 2011;12:2825-2830. [Google Scholar]
  • 31.Chen T, Guestrin C. XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM; 2016:785-794. doi: 10.1145/2939672.2939785. [DOI] [Google Scholar]
  • 32.Riley RD, Ensor J, Snell KIE, et al. Calculating the sample size required for developing a clinical prediction model. BMJ. 2020;368:m441. doi: 10.1136/bmj.m441. [DOI] [PubMed] [Google Scholar]
  • 33.Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Mak. 2006;26(6):565-574. doi: 10.1177/0272989X06295361. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Vickers AJ, van Calster B, Steyerberg EW. A simple, step-by-step guide to interpreting decision curve analysis. Diagn Progn Res. 2019;3(1):18. doi: 10.1186/s41512-019-0064-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Leischner H, Brekenfeld C, Meyer L, et al. Study criteria applied to real life—a multicenter analysis of stroke patients undergoing endovascular treatment in clinical practice. J Am Heart Assoc. 2021;10(22):e017919. doi: 10.1161/JAHA.120.017919. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Nguyen TN, Abdalkader M, Nagel S, et al. Noncontrast computed tomography vs computed tomography perfusion or magnetic resonance imaging selection in late presentation of stroke with large-vessel occlusion. JAMA Neurol. 2022;79(1):22-31. doi: 10.1001/jamaneurol.2021.4082. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Ramos LA, Kappelhof M, van Os HJA, Chalos V. Predicting poor outcome before endovascular treatment in patients with acute ischemic stroke. Front Neurol. 2020;11:580957. doi: 10.3389/fneur.2020.580957. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Xu H, Jia B, Huo X, et al. Predictors of futile recanalization after endovascular treatment in patients with acute ischemic stroke in a multicenter registry study. J Stroke Cerebrovasc Dis. 2020;29(10):105067. doi: 10.1016/j.jstrokecerebrovasdis.2020.105067. [DOI] [PubMed] [Google Scholar]
  • 39.Ryu WS, Woo SH, Schellingerhout D, et al. Stroke outcomes are worse with larger leukoaraiosis volumes. Brain. 2017;140(1):158-170. doi: 10.1093/brain/aww259. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Su M, Zhou Y, Chen Z, et al. Cystatin C predicts futile recanalization in patients with acute ischemic stroke after endovascular treatment. J Neurol. 2022;269(2):966-972. doi: 10.1007/s00415-021-10680-w. [DOI] [PubMed] [Google Scholar]
  • 41.Ruiz A, Longstreth WT, Tirschwell DL, Creutzfeldt CJ. What defines success following reperfusion after mechanical thrombectomy for older patients in the real world? J Neurol. 2022;269(4):2214-2218. doi: 10.1007/s00415-021-10859-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Xie Y, Jiang B, Gong E, et al. Journal club: use of gradient boosting machine learning to predict patient outcome in acute ischemic stroke on the basis of imaging, demographic, and clinical information. Am J Roentgenol. 2019;212(1):44-51. doi: 10.2214/AJR.18.20260. [DOI] [PubMed] [Google Scholar]
  • 43.Abdelkhaleq R, Kim Y, Khose S, et al. Automated prediction of final infarct volume in patients with large-vessel occlusion acute ischemic stroke. Neurosurg Focus. 2021;51(1):1-5. doi: 10.3171/2021.4.FOCUS21134. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Haranhalli N, Mbabuike N, Grewal SS, et al. Topographic correlation of infarct area on CT perfusion with functional outcome in acute ischemic stroke. J Neurosurg. 2020;132(1):33-41. doi: 10.3171/2018.8.JNS181095. [DOI] [PubMed] [Google Scholar]
  • 45.Schirmer MD, Donahue KL, Nardin MJ, et al. Brain volume: an important determinant of functional outcome after acute ischemic stroke. Mayo Clin Proc. 2020;95(5):955-965. doi: 10.1016/j.mayocp.2020.01.027. [DOI] [PubMed] [Google Scholar]
  • 46.Lindström I, Protto S, Khan N, Hernesniemi J, Sillanpää N, Oksala N. Association of masseter area and radiodensity with three-month survival after proximal anterior circulation occlusion. J Neurointerv Surg. 2021;13(1):25-29. doi: 10.1136/neurintsurg-2020-015837. [DOI] [PubMed] [Google Scholar]
  • 47.Chen M. Why futile recanalization matters. J Neurointerv Surg. 2020;12(10):925-926. doi: 10.1136/neurintsurg-2020-016789. [DOI] [PubMed] [Google Scholar]
  • 48.Ospel JM, Ganesh A, Kappelhof M, et al. Evaluating outcome prediction models in endovascular stroke treatment using baseline, treatment, and posttreatment variables. Stroke Vasc Interv Neurol. 2021;1(1):e000167. doi: 10.1161/svin.121.000167. [DOI] [Google Scholar]
  • 49.Heit JJ, Mlynash M, Christensen S, et al. What predicts poor outcome after successful thrombectomy in early time window? J Neurointerv Surg. 2021;13(5):421-425. doi: 10.1136/neurintsurg-2020-016125. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Investigators may request access to anonymized individual patient data including analysis-ready data sets, and data set specifications, after publication. Before using the data, proposals need to be approved by an independent review panel at swissethics.ch/basec, and a signed data sharing agreement will then be approved.


Articles from Neurology are provided here courtesy of American Academy of Neurology

RESOURCES