Abstract
Objective
The aim of this study was to identify and analyze all the relevant literature regarding the use of machine learning to predict response to neuromodulation therapies in patients diagnosed with drug-resistant epilepsy.
Material and methods
We systematically search PubMed, Embase, Scopus and Cochrane databases to identify all the studies that used machine learning models to predict response to neuromodulations. Prior to the search, the study was registered at the International prospective register of systematic reviews (PROSPERO, CRD42024543952). Quality assessment and risk of bias was done using PROBAST. A random effects model was used to calculate the pooled value of the AUROC. A sub-analysis was performed for population-specific scenarios.
Results
A total of 4,451 studies were identified after our initial search, from those, only 12 papers were included in the final analysis. The total number of patients across all the cohorts was 535. 11 studies focused on VNS and only one on ctDCS. Only five out of the 12 studies included an external cohort to validate the results. The most common population was pediatric (n = 7). The most common ML model used was the support vector machine. The pooled area under the receiver operating characteristic curve (AUROC) was 0.84 (95% IC, 079–0.88).
Conclusions
Our study suggests that multimodal ML approaches show promising performance in predicting response to neuromodulation strategies in patients with drug-resistant epilepsy. However, the limited number of studies, the scarcity of external validation and small cohorts highlight the need for larger, high-quality prospective investigations to confirm these findings and improve the generalizability of ML-based prediction models.
Supplementary Information
The online version contains supplementary material available at 10.1186/s42234-025-00191-8.
Keywords: Drug-resistant epilepsy, Neurostimulation, Machine learning, Vagus nerve stimulation, Artificial intelligence
Background
Epilepsy, as defined by the International League Against Epilepsy (ILAE) in 2014, is a disorder of the brain characterized by an enduring predisposition to epileptic seizures (Fisher et al. 2014). It is estimated that around 1.2% of the United States population has active epilepsy, which accounts to approximately 3,500,000 cases (3,000,000 adults and 500,000 children) for 2021 (Zack and Kobau 2017; Epilepsy Facts and Stats | Epilepsy | CDC n.d.), with annual costs as high as 30,000USD per person, annually (Begley and Durgin 2015). Of relevance, these figures may underestimate the current burden of epilepsy. The estimate of 3.5 million cases reported by the CDC was derived using the 2021 U.S. population of about 331 million, whereas the 2024 census reports a population of 342,787,750 (Kobau et al. 2024). Of all the patients diagnosed with epilepsy, around 15–30% will not respond to at least two trials of antiseizure medication (ASM), a scenario known as drug-resistant epilepsy (DRE) (Kwan et al. 2010). In a 2021 meta-analysis by Sultana et al., the prevalence of DRE was estimated at 13.7% (95% CI: 9.2–19.0) in population- or community-based samples, but was substantially higher 36.3% (95% CI: 30.4–42.4) in clinic-based cohorts (Sultana et al. 2021). This is significant, as DRE is associated with increased costs (Ngan Kee et al. 2023; Sheikh et al. 2020), disability (Sarkis et al. 2018) and mortality (Rheims et al. 2022), compared to non-DRE patients.
While the mainstay of treatment for these patients is surgical removal of the epileptogenic focus, not every patient is candidate for this type of intervention (Jehi et al. 2022). In those cases, a palliative approach is warranted, which could include different neuromodulation techniques, in an attempt to reduce the number of seizures and improve the patient outcomes and quality of life (Englot et al. 2017). Of the available options, vagus nerve stimulation (VNS) is the most common, however, other types of neuromodulation techniques include deep brain stimulation (DBS), responsive neurostimulation (RNS), either cortical (RCS) or subcortical (RScS), and cathodal transcranial direct current stimulation (ctDCS) (Ghosh et al. 2023; San-Juan, 2021).
These techniques involve the use of different devices that deliver electrical impulses directly to the central nervous system (CNS) or to the vagus nerve (VN), to modify neuronal and field activity in order to reduce the frequency and seizure severity (Boon et al. 2018). Of relevance, due to the fact that less than 5% of the patients achieve actual seizure freedom, response to neuromodulation treatment is usually defined as a reduction in 50% in the number of seizures (Ryvlin et al. 2021).
In recent years, machine learning (ML) and deep learning (DL) have shown potential to revolutionize various aspects of healthcare (Habehh and Gohel 2021). By leveraging multimodal datasets, these models have been used to predict seizure events (Rasheed et al. 2021), determine the probability of a given patient to response to ASM (Kaushik et al. 2024; Wu et al. 2022), and enhance the efficacy and safety of neuromodulation interventions by creating closed-loop circuits (Ramgopal et al. 2014; Dümpelmann 2019).
This review aims to identify all previous studies focused on training and validating ML models to predict response to neuromodulation techniques in patients with DRE.
Materials and methods
Search strategy and registration
The search strategy was designed and conducted by an experienced medical librarian (J.M.) with input from study investigators. PubMed, Embase, Scopus, and Cochrane Library were searched from inception through July 15, 2024. Search strategies were formulated using controlled vocabularies and keyword capabilities in each database. A complementary manual search was performed on additional databases (Google Scholar) on August 15, 2024, and by checking the references of all main review articles on this topic to identify possible additional eligible studies. The detailed strategies are reported in Supplementary Table 1. Before starting, the study protocol was registered and published in the online International Prospective Register of Systematic Reviews (PROSPERO) database (ID: CRD42024543952).
Eligibility criteria
We only included studies focusing on human research. To be eligible, patients should have been diagnosed with DRE following the ILAE guidelines (Kwan et al. 2010). We included both pediatric and adults patients treated with any type of neuromodulation technique. We only included peer-reviewed English original publications, encompassing clinical trials, cohorts, case–control studies, systematic reviews and meta-analysis. Other types of publications like narratives reviews, case series, case reports, editorials, conference abstract, non-peer-reviewed and grey literature were excluded.
Regarding the models of interest, we focused on supervised classification ML and DL models that looked at response prediction. No restrictions were placed on the type or number of features included. However, all models used a common outcome label, since response to neuromodulation therapies is typically defined as a ≥ 50% reduction in seizures. Unsupervised or reinforcement learning models were excluded. For more details on the selection criteria see Table 1.
Table 1.
Selection criteria
| Inclusion criteria |
| Population: human population, pediatric and adults patients with diagnosis of DRE by the ILAE 2014 criteria |
| Intervention: VNS, DBS, RNS, ctDCS, TMS, TNS |
| Studies: peer-reviewed studies, clinical trials, prospective and retrospective cohorts, case–control studies, systematic reviews and meta-analysis |
| Models: supervised classification ML or DL models |
| Exclusion criteria |
| Population: non-human population, diagnosis of DRE by other criteria |
| Intervention: neuromodulations techniques used alongside surgery |
| Studies: non-peer reviewed publications, articles in languages other than English, case series, case reports, narrative reviews, editorials and expert opinion; and grey literature |
| Models: unsupervised machine learning models, regression architectures |
ctDCS Cathodal Transcranial Direct Current Stimulation, DBS Deep-brain stimulation, DL Deep learning, DRE Drug resistant epilepsy, ILAE International league against epilepsy, ML Machine learning, TMS Transcranial magnetic stimulation, TNS Trigeminal nerve stimulation, VNS Vagus nerve stimulation
Data extraction
The selection process involved two phases, an initial screening based on titles and abstracts, followed by a full-text review to confirm eligibility based on the predefined inclusion and exclusion criteria. Two investigators (AQ and FF) independently evaluated the studies for eligibility and resolved any disagreements through discussion and consensus. When no agreement could be reached, a third investigator (TZ) determined the eligibility.
For eligible studies, a standardized data extraction process using Convidence software was utilized. For each study, the primary outcome was the area under the receiver operating characteristic curve (AUROC). As secondary outcomes, we also extracted the following performance metrics of each model: sensitivity (recall), specificity, precision, accuracy, and f1 score. In the case of studies using the same cohort but with different features, we considered each of them as individual models. In articles that did not report these metrics but reported confusion matrices, the metrics were calculated based on them. Furthermore, in case of not reporting the standard errors (se) of the AUROC, we calculated using previously published formulas (Olender et al. 2023).
Quality and risk of bias assessment
The extracted studies were analyzed using the Prediction Model Risk of Bias Assessment Tool (PROBAST). This tool assesses the risk of bias in four domains: participants, predictors, outcome and analysis. PROBAST also determines the applicability of prediction model studies based on three domains, participants, predictors and outcomes.
Each domain was rated for risk of bias or applicability concern in “low,” “high,” or “unclear.” Two reviewers independently applied the PROBAST tool to all included studies, with discrepancies resolved through discussion or adjudication by a third reviewer.
Statistical analysis
Data synthesis and meta-analysis was conducted using the metafor package version 4.6–0 (Viechtbauer and metafor 2025) in R version 4.4.2. Heterogeneity among studies was evaluated using the I2 and Cochran’s Q test. A random-effects model was used to account for potential heterogeneity across studies. Forest plots were generated to visually display the weighted AUROC values with a 95% interval confidence (IC), as well as the pooled AUROC of all the models. Population-specific analysis was also performed as a possible source of heterogeneity.
Results
Study identification
Our search identified 4,451 studies. After removing duplicates, a total of 3,362 studies underwent title and abstract screening. From the title and abstract screen, 2,838 studies were considered irrelevant and 524 progressed to full-text review. From the full-text review, 512 studies were excluded and only 12 studies progressed to data extraction. The reasons for exclusion were wrong patient population (n = 40), wrong intervention (n = 42), wrong study design (n = 212), wrong setting (n = 210), non-peer-reviewed (n = 1) and publications in another language other than English (n = 7). Figure 1 shows the study selection flowchart based on the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) 2020 flow diagram.
Fig. 1.
PRISMA selection flowchart
Studies characteristics and modalities
With the 12 extracted studies, the total number of patients was 535, including both the initial training and testing cohort (referred to as train-test), as well as the external validation cohort (referred to as external), when available. All studies focused on VNS with the exception of one that analyzed response to ctDCS (Hao et al. 2021). Some of the studies had the same model trained on different features which we considered separately for the analysis, and thus, the total number of models was 17, with five studies (a total of seven models) including an external cohort for validation. Seven of the studies included a pediatric-only population, four adult-only and one included both pediatric and adult populations. None of the studies included DL models.
Regarding study modalities, most studies incorporated at least one modality. Electroencephalography (EEG) was the most frequently used (n = 5), followed by diffusion tensor imaging (DTI), functional magnetic resonance imaging (fMRI), and magnetoencephalography (MEG) (each n = 2). The most common type of cross-validation (CV) was fivefold (n = 8), followed by tenfold (n = 5) and finally leave-one-out (LOO) CV (n = 4). The smallest train-test cohort included 17 patients, while the biggest included 70. The majority of the trained models were support vector machines (SVM; n = 10), and the second most common being the random forest (RF) classifier with four models from the same cohort but trained with different features. Other types of models included extreme-gradient boosting machine (XGB), linear discriminant analysis (LDA) and naïve Bayes classifier (NBC; Table 2).
Table 2.
Summary
| Author | Population | Intervention | Data type | Features | Set | n | CV | Model |
|---|---|---|---|---|---|---|---|---|
| Ibrahim et al. (2017) | Pediatric | VNS | fMRI | Correlation coefficients of connectivity | Train-test | 21 | 5 | SVM |
| External | 8 | - | SVM | |||||
| Babajani-Feremi et al. (2018) | Pediatric | VNS | MEG | Transitivity and modularity from PLV values of theta, alpha, and beta bands | Train-test | 23 | 10 | NBC |
| Brázdil et al. (2019) | Adult | VNS | EEG | Theta, alpha, beta, and gamma band power | Train-test 1 | 60 | LOO | SVM |
| Train-test 2 | - | LOO | LDA | |||||
| `External 1 | 22 | - | SVM | |||||
| External 2 | - | - | LDA | |||||
| Mithani et al. (2019) | Pediatric | VNS | EHR, DTI, MEG | wPLI of broad band (2–20 Hz), low gamma 1 (30–40 Hz), and low gamma 2 (40–50 Hz), mean FA and clinical characteristics of the seizures | Train-test | 38 | 10 | SVM |
| Mithani et al. (2020) | Pediatric | VNS | MEG | Spatial deviation, amplitude and latency of SEFs; and wPLI | Train-test | 36 | 10 | SVM |
| External | 12 | - | SVM | |||||
| Fang et al. (2021) | Mixed | VNS | ECG | Slope, HF LF, and VLF HRV metrics | Train-test 1 | 59 | 5 | RF |
| Train-test 2 | - | 5 | RF | |||||
| Train-test 3 | - | 5 | SVM | |||||
| Train-test 4 | - | 5 | SVM | |||||
| Hao et al. (2021) | Adult | ctDCS | fMRI | Clustering coefficient, mean shortest path length, and local efficiency | Train-test | 20 | 5 | SVM |
| Ma et al. (2022) | Pediatric | VNS | EHR, EEG | Clinical characteristics and PLV, PLI, and wPLI calculated in six bandwidths (delta, theta, alpha, beta, low beta and high beta) | Train-test | 70 | 10 | SVM |
| External | 18 | - | SVM | |||||
| Chen et al. (2023) | Pediatric | VNS | EEG | Edges calculated from partial correlation connectivity analysis | Train-test 1 | 16 | 5 | SVM |
| Train-test 2 | - | 5 | XGB | |||||
| External 1 | 7 | - | SVM | |||||
| External 2 | - | - | XGB | |||||
| Berger et al. (2023) | Adult | VNS | EEG | Slope, charge output and saturation of laryngeal motor evoked potentials | Train-test | 42 | LOO | SVM |
| Cheng et al. (2024) | Pediatric | VNS | EHR, EEG | Clinical characteristics, alpha band PLI, and entropy values | Train-test | 65 | 10 | SVM |
| Berger et al. (2024) | Adult | VNS | DTI | Mean and radial diffusivity | Train-test | 18 | LOO | SVM |
| Overall | 535 |
ctDCS CV Cross-validation, DTI Diffusion Tensor Imaging, ECG Electrocardiogram, EEG Electroencephalogram, EHR Electronic health record, fMRI functional magnetic resonance imaging, HF High frequency, HRV Heart rate variability, LF Low frequency, LOO Leave-one-out, MEG Magnetoencephalography, NBC Naïve bayes classifier, LDA Linear discriminant analysis, PLI Phase lag index, PLV Phase lag value, RF Random forest, SD Standard deviation, SEF Somatosensory evoked field, SVM Support vector machine, VLF Very low frequency, VNS Vagus nerve stimulation, wPLI weighted phase lag index
Risk of bias and applicability
Only half of the studies (n = 6) were considered with low risk of bias, with the Analysis domain being the most prevalent one with high risk. The applicability was low risk in half the studies, with the Outcome domain having the greatest number of unclear categories and the Participants the one with the highest risk (Table 3).
Table 3.
Risk of bias and applicability
Green indicates low risk of bias (RoB) and good applicability; yellow with a question mark indicates unclear RoB and/or applicability; red indicates high RoB and/or limited applicability
Model performance
The pooled AUC of all the studies, including both train-test and external cohorts, was 0.84 (95% CI, 0.79–0.88), with moderate heterogeneity (I2 = 43.8%; Fig. 2). The highest performances in the train-test cohorts were achieved using SVM models in pediatric populations by Mithani et al. 2019 (AUROC of 0.93, 95% CI 0.87–0.99) and Mithani et al. 2020 (AUROC = 0.93, 95% CI 0.85–1.01), whereas the highest performance in the external cohort was achieved by Chen et al. 2023 with both SVM (AUROC = 0.91, 95% CI 0.67–1.15) and XGB (AUROC = 0.90, 95% CI 0.77–1.03) models, however the standard error (se) of the AUROC was high in the SVM (se = 0.12). When focusing on specific populations we can observe a reduction in heterogeneity (I2 = 20.2% in pediatrics and 18.2% in adults), with a similar AUROC for the pediatric population (0.88, CI 0.84–0.92) and lower for the adult population (0.76, CI 0.70–0.83) when comparing with overall pooled AUROC (Fig. 3 and 4).
Fig. 2.
Forest Plot of the AUC for all the models and cohorts. Red dashed line marks 0.5 AUROC (random chance of classification). NBC: naïve bayes classifier, LDA: linear discriminant analysis, SVM: support vector machine
Fig. 3.
Forest Plot of pediatric-only studies. Red dashed line marks 0.5 AUROC (random chance of classification). NBC: naïve bayes classifier, LDA: linear discriminant analysis, SVM: support vector machine, XGB: external gradient boosting
Fig. 4.
Forest Plot of adult-only studies. Red dashed line marks 0.5 AUROC (random chance of classification). LDA: linear discriminant analysis, SVM: support vector machine. Forest Plot of adult-only studies. Red dashed line marks 0.5 AUROC (random chance of classification). LDA: linear discriminant analysis, SVM: support vector machine
The overall accuracy across train-test and external models was 0.76 ± 0.11, the recall of 0.77 ± 0.19, precision 0.83 ± 0.08, specificity 0.76 ± 0.22 and F1 score of 0.83 ± 0.10 (Table 4). The performance in the train-test-only and external-only models did not vary widely from the overall metrics and can be found in the supplementary tables (Supp Table 2 and 3).
Table 4.
Summary of the performance metrics
| Author | Set (model) | AUROC | Accuracy | Recall | Precision | Specificity | F1 score |
|---|---|---|---|---|---|---|---|
| Ibrahim et al. (2017) | Train-test (SVM) | 0.86 ± 0.08 | 0.86 | 0.91 | 0.83 | 0.80 | 0.87 |
| External (SVM) | 0.88 ± 0.16 | 0.88 | 1.0 | 0.87 | 0.00 | 0.93 | |
| Babajani-Feremi et al. (2018) | Train-test (NBC) | 0.89 ± 0.07 | 0.87 | 0.80 | - | 0.89 | - |
| Brázdil et al. (2019) | Train-test (SVM) | 0.77 ± 0.06 | 0.75 | 0.63 | - | 0.92 | - |
| Train-test (LDA) | 0.68 ± 0.07 | 0.65 | 0.49 | - | 0.88 | - | |
| `External (SVM) | 0.79 ± 0.10 | 0.77 | 0.58 | - | 1.0 | - | |
| External (LDA) | 0.48 ± 0.13 | 0.45 | 0.17 | - | 0.80 | - | |
| Mithani et al. (2019) | Train-test (SVM) | 0.93 ± 0.03 | 0.89 | 0.96 | 0.89 | 0.72 | 0.92 |
| Mithani et al. (2020) | Train-test (SVM) | 0.93 ± 0.04 | 0.89 | 0.67 | - | 0.95 | - |
| External (SVM) | 0.66 ± 0.16 | 0.67 | 0.83 | - | 0.50 | - | |
| Fang et al. (2021) | Train-test (RF 1) | - | 0.75 | 0.71 | 0.80 | - | 0.75 |
| Train-test (RF 2) | - | 0.65 | 0.70 | 0.66 | - | 0.68 | |
| Train-test (SVM 1) | - | 0.73 | 0.86 | 0.80 | - | 0.78 | |
| Train-test (SVM 2) | - | 0.69 | 0.76 | 0.74 | - | 0.69 | |
| Hao et al. (2021) | Train-test (SVM) | 0.75 ± 0.10 | 0.67 | 0.70 | - | - | - |
| Ma et al. (2022) | Train-test (SVM) | 0.77 ± 0.06 | 0.76 | 0.73 | 0.81 | 0.79 | 0.76 |
| External (SVM) | - | 0.61 | - | - | - | - | |
| Chen et al. (2023) | Train-test (SVM) | 0.88 ± 0.07 | 0.81 | 0.91 | 0.79 | 0.84 | 0.86 |
| Train-test (XGB) | 0.85 ± 0.15 | - | 0.88 | - | 0.79 | - | |
| External (SVM) | 0.91 ± 0.12 | 0.71 | 0.87 | 1.0 | 0.79 | 1.0 | |
| External (XGB) | 0.90 ± 0.06 | 0.79 | 0.92 | - | 0.74 | - | |
| Berger et al. (2023) | Train-test (SVM) | 0.82 ± 0.06 | 0.80 | 0.75 | 0.86 | 0.86 | 0.80 |
| Cheng et al. (2024) | Train-test (SVM) | 0.84 ± 0.05 | 0.81 | 0.92 | 0.79 | 0.67 | 0.85 |
| Berger et al. (2024) | Train-test (SVM) | 0.88 ± 0.08 | 0.94 | 1.0 | 0.92 | 0.83 | 0.96 |
| Overall (mean ± SD)* | 0.84 ± 0.09 | 0.76 ± 0.11 | 0.77 ± 0.19 | 0.83 ± 0.08 | 0.76 ± 0.22 | 0.83 ± 0.10 |
AUROC Area under the receiver operating characteristic curve, NBC Naïve bayes classifier, LDA Linear discriminant analysis, RF Random forest, SD Standard deviation, SVM Support vector machine
*AUROC expressed as weighted AUROC mean and se
Discussion
Developing an accurate model to predict response to neuromodulation therapies can be beneficial for patients with DRE. Currently, response to these therapies is varying, normally ranging between 30% in low-risk of bias papers and up to 70% in high bias risk publications (Ryvlin et al. 2021), with brain-invasive therapies, such as RNS, tending to have higher rates of response than non-brain-invasive therapies such as VNS (70% vs 50% in previous studies) (Alcala-Zermeno et al. 2022; Khan et al. 2022; Englot et al. 2016). In addition to the low responder rates, all these therapies have intrinsic risks, with adverse events reported in up to one-third of the patients (Ryvlin et al. 2021; Lim et al. 2024; Heck et al. 2014). Moreover, these procedures generate important costs for the patients, with an average of $88,000 per patient for VNS and around $100,000 for DBS and RNS (Vincent et al. 2022), highlighting the importance of identifying responders, preventing unnecessary exposure to risk of surgical complications, and costs to potentially unresponsive patients.
A critical focus when building reliable predictive models for neuromodulation outcomes is considering the complexity of these patients. DRE is heterogeneous by nature, with multiple pathophysiological pathways, and usually caused by a combination of different mechanisms like pharmacokinetic alterations, genetic polymorphisms and mutations, altered cellular ASM’s targets, inadequate remodeling and plasticity in neuronal networks, and increased inflammation; among many others (Pérez-Pérez et al. 2021; Tang et al. 2017). Taking this into consideration, multimodal approaches could potentially encompass this complexity in a better way than unimodal ones. However, acquiring and training models with a fully multimodal approach is complex. In our review, the analyzed studies normally leveraged clinical data records and an additional type of data, that included electrocardiograms (Fang et al. 2021), electroencephalograms (Ma et al. 2022; Chen et al. 2023; Cheng et al. 2024), and connectomics via diffusion tract imaging (Mithani et al. 2019), but to our knowledge no previous study have incorporated a truly multimodal approach with easily accessible studies, as some diagnostic modalities like magnetoencephalogram and diffusion tract imaging are not easily accessible in the clinical practice, limiting their applicability.
Most studies examined functional and structural connectivity parameters as predictors, and several of these have been proposed as potential biomarkers of VNS response. In particular, increased connectivity has been associated with better clinical outcomes after VNS (Germany et al. 2023; Danthine et al. 2025), possibly related to the desynchronization effect of VNS in the brain (Vespa et al. 2021). Other focus was on heart rate variability (HRV) and laryngeal motor evoked potentials, which reflect intact vagal function through the parasympathetic autonomic nervous system and adequate transmission of signals from the laryngeal nerves to higher cortical areas (Ottaviani and Macefield 2022; Neuhuber and Berthoud 2021). These three approaches have been explored in multiple studies, with several iterations depending on the modality used. Connectivity can be assessed with EEG, MEG, and fMRI, and these modalities provide the most direct information about brain network organization. In parallel, HRV through the use of ECG and laryngeal motor evoked potentials through EEG have been used to evaluate vagal integrity, function, and brain–body communication.
Interestingly, the AUROC was on average higher in models trained only in pediatric cohorts, compared to adult-only or mixed populations. One of the models developed by Brazdil (Brázdil et al. 2019) had an AUROC of 0.48, which skews the results. Additionally, population differences between adults and children may pose challenges for ML models. In adults, epilepsy often arises from more identifiable and heterogeneous etiologies, encompassing both functional and structural causes (e.g., neoplasms and cerebrovascular disease). In contrast, pediatric epilepsy more commonly involves age-dependent syndromes and genetic etiologies (Babunovska et al. 2021; Vikin et al. 2025).
Moreover, these studies relied on relatively small, single-center or dual-center cohorts. These limited sample sizes restrict statistical power, are prone to overfitting and may reduce performance in different populations. While the features used in these models are diverse and sometimes not easily accessible, preliminary studies demonstrate the feasibility of machine learning approaches for predicting treatment or neuromodulation response, even when based on heterogeneous and multimodal data, based on the performance on the external validation cohorts, however, there is an impending need for additional large-scale, multicenter studies, which are essential to refine these models, identify the most clinically relevant predictors, and make them generalizable for the daily clinical practice.
Conclusion
Multimodal ML presents as a valuable tool for current neurology, as it allows the leverage of different types of data to more accurately predict different outcomes. In the present study we analyzed the performances of different multimodal ML models to predict response to neuromodulation techniques (mainly VNS) as treatment for patients diagnosed with DRE. The overall performance of the models was good, with a pooled AUROC of 0.84 (0.79–0.88), which did not differ significantly when comparing between populations. However, we acknowledge that the risk of bias was high or unclear in more than half of the studies and the studies included small cohorts, which entails their own risks during the training of these architectures.
Supplementary Information
Acknowledgements
Not applicable.
Abbreviations
- ASM
Antiseizure Medication
- AUROC
Area Under the Receiver Operating Characteristic Curve
- CNS
Central Nervous System
- ctDCS
Cathodal Transcranial Direct Current Stimulation
- CV
Cross-validation
- DBS
Deep Brain Stimulation
- DL
Deep Learning
- DRE
Drug-resistant epilepsy
- ILAE
International League Against Epilepsy
- LDA
Linear discriminant analysis
- LOO
Leave-one-out
- MESH
Medical Subject Headings
- ML
Machine Learning
- MRI
Magnetic Resonance Imaging
- NBC
Naïve bayes classifier
- PRISMA
Preferred Reporting Items for Systematic reviews and Meta-Analyses
- PROBAST
Prediction Model Risk of Bias Assessment Tool
- RCS
Responsive Cortical Stimulation
- RF
Random forest
- RNS
Responsive Neurostimulation
- RScS
Responsive Subcortical Stimulation5
- SE
Standard error
- SVM
Support vector machine
- VN
Vagus Nerve
- VNS
Vagus Nerve Stimulation
Authors’ contributions
**A.Q.V.** and **F.F** conducted the screening of articles, performed data extraction, and carried out the statistical and meta-analytic analyses. **J.M** conducted the initial literature search, compiled the preliminary database of studies, provided expert guidance as the research librarian, and performed a specialized database search. **T.Z.** supervised the overall project, resolved conflicts during screening and data extraction, and contributed to the theoretical framework and interpretation of the findings.
Funding
No funding was required for this study.
Data availability
No datasets were generated or analysed during the current study.
Declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- Alcala-Zermeno JL, Gregg NM, Starnes K, Mandrekar JN, Van Gompel JJ, Miller K, et al. Invasive neuromodulation for epilepsy: comparison of multiple approaches from a single center. Epilepsy Behav. 2022;137:108951. 10.1016/j.yebeh.2022.108951. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Babajani-Feremi A, Noorizadeh N, Mudigoudar B, Wheless JW. Predicting seizure outcome of vagus nerve stimulation using MEG-based network topology. NeuroImage: Clinical. 2018;19:990–9. 10.1016/j.nicl.2018.06.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Babunovska M, Boskovski B, Kuzmanovski I, Tanovska N, Kiteva Trencevska G, Cvetkovska E. Risk factors associated with new-onset epilepsy in young adults: population-based study. Epilepsy Behav. 2021;124:108353. 10.1016/j.yebeh.2021.108353. [DOI] [PubMed] [Google Scholar]
- Begley CE, Durgin TL. The direct cost of epilepsy in the United States: a systematic review of estimates. Epilepsia. 2015;56:1376–87. 10.1111/epi.13084. [DOI] [PubMed] [Google Scholar]
- Berger A, Carapancea E, Vespa S, Danthine V, Doguet P, Delbeke J, et al. Vagus nerve stimulation-induced laryngeal motor evoked potentials for response prediction and intensity titration in drug-resistant epilepsy. Clin Neurophysiol. 2023;147:99–107. 10.1016/j.clinph.2023.01.009. [DOI] [PubMed] [Google Scholar]
- Berger A, Cerra M, Joris V, Danthine V, Macq B, Dricot L, et al. Identifying responders to vagus nerve stimulation based on microstructural features of thalamocortical tracts in drug-resistant epilepsy. Neurotherapeutics. 2024;21:e00422. 10.1016/j.neurot.2024.e00422. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boon P, De Cock E, Mertens A, Trinka E. Neurostimulation for drug-resistant epilepsy: a systematic review of clinical evidence for efficacy, safety, contraindications and predictors for response. Curr Opin Neurol. 2018;31:198–210. 10.1097/WCO.0000000000000534. [DOI] [PubMed] [Google Scholar]
- Brázdil M, Doležalová I, Koritáková E, Chládek J, Roman R, Pail M, et al. EEG reactivity predicts individual efficacy of vagal nerve stimulation in intractable epileptics. Front Neurol. 2019;10:392. 10.3389/fneur.2019.00392. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen H, Wang Y, Ji T, Jiang Y, Zhou X-H. Brain functional connectivity-based prediction of vagus nerve stimulation efficacy in pediatric pharmacoresistant epilepsy. CNS Neurosci Ther. 2023;29:3259–68. 10.1111/cns.14257. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cheng T-Y, Hu Y, Qin X, Ma J, Zha D, Xie H, et al. A predictive model combining connectomics and entropy biomarkers to discriminate long-term vagus nerve stimulation efficacy for pediatric patients with drug-resistant epilepsy. CNS Neurosci Ther. 2024;30:e14751. 10.1111/cns.14751. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Danthine V, Germany Morrison EI, Cottin L, Liberati G, Cakiroglu I, Joris V, et al. Effect of Vagus Nerve Stimulation on Electroencephalogram Synchronization: A Longitudinal Study Using a Clinical-Research Response Scale. Neuromodulation. 2025;S1094–7159(25):00132–41. 10.1016/j.neurom.2025.03.068. [DOI] [PubMed] [Google Scholar]
- Dümpelmann M. Early seizure detection for closed loop direct neurostimulation devices in epilepsy. J Neural Eng. 2019;16:041001. 10.1088/1741-2552/ab094a. [DOI] [PubMed] [Google Scholar]
- Englot DJ, Rolston JD, Wright CW, Hassnain KH, Chang EF. Rates and predictors of seizure freedom with vagus nerve stimulation for intractable epilepsy. Neurosurgery. 2016;79:345–53. 10.1227/NEU.0000000000001165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Englot DJ, Hassnain KH, Rolston JD, Harward SC, Sinha SR, Haglund MM. Quality-of-life metrics with vagus nerve stimulation for epilepsy from provider survey data. Epilepsy Behav. 2017;66:4–9. 10.1016/j.yebeh.2016.10.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Epilepsy Facts and Stats | Epilepsy | CDC (n.d.) https://www.cdc.gov/epilepsy/data-research/facts-stats/index.html. Accessed 7 Nov 2025.
- Fang X, Liu H-Y, Wang Z-Y, Yang Z, Cheng T-Y, Hu C-H, et al. Preoperative heart rate variability during sleep predicts vagus nerve stimulation outcome better in patients with drug-resistant epilepsy. Front Neurol. 2021;12:691328. 10.3389/fneur.2021.691328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fisher RS, Acevedo C, Arzimanoglou A, Bogacz A, Cross JH, Elger CE, et al. ILAE official report: a practical clinical definition of epilepsy. Epilepsia. 2014;55:475–82. 10.1111/epi.12550. [DOI] [PubMed] [Google Scholar]
- Germany E, Teixeira I, Danthine V, Santalucia R, Cakiroglu I, Torres A, et al. Functional brain connectivity indexes derived from low-density EEG of pre-implanted patients as VNS outcome predictors. J Neural Eng. 2023. 10.1088/1741-2552/acf1cd. [DOI] [PubMed] [Google Scholar]
- Ghosh S, Sinha JK, Ghosh S, Sharma H, Bhaskar R, Narayanan KB. A comprehensive review of emerging trends and innovative therapies in epilepsy management. Brain Sci. 2023;13:1305. 10.3390/brainsci13091305. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Habehh H, Gohel S. Machine learning in healthcare. Curr Genomics. 2021;22:291–300. 10.2174/1389202922666210705124359. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hao J, Luo W, Xie Y, Feng Y, Sun W, Peng W, et al. Functional network alterations as markers for predicting the treatment outcome of cathodal transcranial direct current stimulation in focal epilepsy. Front Hum Neurosci. 2021;15:637071. 10.3389/fnhum.2021.637071. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heck CN, King-Stephens D, Massey AD, Nair DR, Jobst BC, Barkley GL, et al. Two-year seizure reduction in adults with medically intractable partial onset epilepsy treated with responsive neurostimulation: final results of the RNS System pivotal trial. Epilepsia. 2014;55:432–41. 10.1111/epi.12534. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ibrahim GM, Sharma P, Hyslop A, Guillen MR, Morgan BR, Wong S, et al. Presurgical thalamocortical connectivity is associated with response to vagus nerve stimulation in children with intractable epilepsy. Neuroimage Clin. 2017;16:634–42. 10.1016/j.nicl.2017.09.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jehi L, Jette N, Kwon C-S, Josephson CB, Burneo JG, Cendes F, et al. Timing of referral to evaluate for epilepsy surgery: expert consensus recommendations from the Surgical Therapies Commission of the International League Against Epilepsy. Epilepsia. 2022;63:2491–506. 10.1111/epi.17350. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kaushik M, Mahajan S, Machahary N, Thakran S, Chopra S, Tomar RV, et al. Predicting efficacy of antiseizure medication treatment with machine learning algorithms in North Indian population. Epilepsy Res. 2024;205:107404. 10.1016/j.eplepsyres.2024.107404. [DOI] [PubMed] [Google Scholar]
- Khan M, Paktiawal J, Piper RJ, Chari A, Tisdall MM. Intracranial neuromodulation with deep brain stimulation and responsive neurostimulation in children with drug-resistant epilepsy: a systematic review. J Neurosurg Pediatr. 2022;29:208–17. 10.3171/2021.8.PEDS21201. [DOI] [PubMed] [Google Scholar]
- Kobau R, Luncheon C, Greenlund KJ. About 1.5 million community-dwelling US adults with active epilepsy reported uncontrolled seizures in the past 12 months, and seizure control varied by annual family income—National Health Interview Survey, United States 2021 and 2022. Epilepsy Behav. 2024. 10.1016/j.yebeh.2024.109852. [DOI] [PubMed] [Google Scholar]
- Kwan P, Arzimanoglou A, Berg AT, Brodie MJ, Allen Hauser W, Mathern G, et al. Definition of drug resistant epilepsy: consensus proposal by the ad hoc Task Force of the ILAE Commission on Therapeutic Strategies. Epilepsia. 2010;51:1069–77. 10.1111/j.1528-1167.2009.02397.x. [DOI] [PubMed] [Google Scholar]
- Lim YG, Ker JRX, Tan YL, Chan DWS, Low DCY, Ng WH, et al. Adverse events and complications associated with vagal nerve stimulation: an analysis of the manufacturer and user facility device experience database. Neuromodulation. 2024;27:781–8. 10.1016/j.neurom.2023.04.474. [DOI] [PubMed] [Google Scholar]
- Ma J, Wang Z, Cheng T, Hu Y, Qin X, Wang W, et al. A prediction model integrating synchronization biomarkers and clinical features to identify responders to vagus nerve stimulation among pediatric patients with drug-resistant epilepsy. CNS Neurosci Ther. 2022;28:1838–48. 10.1111/cns.13923. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mithani K, Mikhail M, Morgan BR, Wong S, Weil AG, Deschenes S, et al. Connectomic profiling identifies responders to vagus nerve stimulation. Ann Neurol. 2019;86:743–53. 10.1002/ana.25574. [DOI] [PubMed] [Google Scholar]
- Mithani K, Wong SM, Mikhail M, Pourmotabbed H, Pang E, Sharma R, et al. Somatosensory evoked fields predict response to vagus nerve stimulation. Neuroimage Clin. 2020;26:102205. 10.1016/j.nicl.2020.102205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Neuhuber WL, Berthoud H-R. Functional anatomy of the vagus system - emphasis on the somato-visceral interface. Auton Neurosci. 2021;236:102887. 10.1016/j.autneu.2021.102887. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ngan Kee N, Foster E, Marquina C, Tan A, Pang SST, O’Brien TJ, et al. Systematic review of cost-effectiveness analysis for surgical and neurostimulation treatments for drug-resistant epilepsy in adults. Neurology. 2023;100:e1866–77. 10.1212/WNL.0000000000207137. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Olender RT, Roy S, Nishtala PS. Application of machine learning approaches in predicting clinical outcomes in older adults – a systematic review and meta-analysis. BMC Geriatr. 2023;23:561. 10.1186/s12877-023-04246-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ottaviani MM, Macefield VG. Structure and functions of the vagus nerve in mammals. Compr Physiol. 2022;12:3989–4037. 10.1002/cphy.c210042. [DOI] [PubMed] [Google Scholar]
- Pérez-Pérez D, Frías-Soria CL, Rocha L. Drug-resistant epilepsy: from multiple hypotheses to an integral explanation using preclinical resources. Epilepsy Behav. 2021;121:106430. 10.1016/j.yebeh.2019.07.031. [DOI] [PubMed] [Google Scholar]
- Ramgopal S, Thome-Souza S, Jackson M, Kadish NE, Sánchez Fernández I, Klehm J, et al. Seizure detection, seizure prediction, and closed-loop warning systems in epilepsy. Epilepsy Behav. 2014;37:291–307. 10.1016/j.yebeh.2014.06.023. [DOI] [PubMed] [Google Scholar]
- Rasheed K, Qayyum A, Qadir J, Sivathamboo S, Kwan P, Kuhlmann L, et al. Machine learning for predicting epileptic seizures using EEG signals: a review. IEEE Rev Biomed Eng. 2021;14:139–55. 10.1109/RBME.2020.3008792. [DOI] [PubMed] [Google Scholar]
- Rheims S, Sperling MR, Ryvlin P. Drug-resistant epilepsy and mortality-why and when do neuromodulation and epilepsy surgery reduce overall mortality. Epilepsia. 2022;63:3020–36. 10.1111/epi.17413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ryvlin P, Rheims S, Hirsch LJ, Sokolov A, Jehi L. Neuromodulation in epilepsy: state-of-the-art approved therapies. Lancet Neurol. 2021;20:1038–47. 10.1016/S1474-4422(21)00300-8. [DOI] [PubMed] [Google Scholar]
- San-Juan D. Cathodal transcranial direct current stimulation in refractory epilepsy: a noninvasive neuromodulation therapy. J Clin Neurophysiol. 2021;38:503–8. 10.1097/WNP.0000000000000717. [DOI] [PubMed] [Google Scholar]
- Sarkis RA, McGinnis S, Rushia SN, Park S, Ansari EE, Willment KC. Growing older with drug-resistant epilepsy: cognitive and psychosocial outcomes. J Neurol. 2018;265:1059–64. 10.1007/s00415-018-8805-z. [DOI] [PubMed] [Google Scholar]
- Sheikh SR, Kattan MW, Steinmetz M, Singer ME, Udeh BL, Jehi L. Cost-effectiveness of surgery for drug-resistant temporal lobe epilepsy in the US. Neurology. 2020;95:e1404–16. 10.1212/WNL.0000000000010185. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sultana B, Panzini MA, Veilleux Carpentier A, Comtois J, Rioux B, Gore G, et al. Incidence and prevalence of drug-resistant epilepsy: a systematic review and meta-analysis. Neurology. 2021;96:805–17. 10.1212/WNL.0000000000011839. [DOI] [PubMed] [Google Scholar]
- Tang F, Hartz AMS, Bauer B. Drug-resistant epilepsy: multiple hypotheses, few answers. Front Neurol. 2017;8:301. 10.3389/fneur.2017.00301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vespa S, Heyse J, Stumpp L, Liberati G, Ferrao Santos S, Rooijakkers H, et al. Vagus nerve stimulation elicits sleep EEG desynchronization and network changes in responder patients in epilepsy. Neurotherapeutics. 2021;18:2623–38. 10.1007/s13311-021-01124-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Viechtbauer W. metafor: Meta-Analysis Package for R 2025
- Vikin T, Lossius MI, Brandlistuen RE, Chin RF, Aaberg KM. Incidence of childhood and youth epilepsy: a population-based prospective cohort study utilizing current International League Against Epilepsy classifications for seizures, syndromes, and etiologies. Epilepsia. 2025;66:776–89. 10.1111/epi.18238. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vincent T, Li Q, Zhang L, Stokes M, Danielson V, Murphy J, et al. Comparison of utilization and cost of healthcare services and pharmacotherapy following implantation of vagus nerve stimulation vs. responsive neurostimulation or deep brain stimulation for the treatment of drug-resistant epilepsy: analyses of a large United States healthcare claims database. J Med Econ. 2022;25:1218–30. 10.1080/13696998.2022.2148680. [DOI] [PubMed] [Google Scholar]
- Wu J, Wang Y, Xiang L, Gu Y, Yan Y, Li L, et al. Machine learning model to predict the efficacy of antiseizure medications in patients with familial genetic generalized epilepsy. Epilepsy Res. 2022;181:106888. 10.1016/j.eplepsyres.2022.106888. [DOI] [PubMed] [Google Scholar]
- Zack MM, Kobau R. National and state estimates of the numbers of adults and children with active epilepsy - United States, 2015. MMWR Morb Mortal Wkly Rep. 2017;66:821–5. 10.15585/mmwr.mm6631a1. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
No datasets were generated or analysed during the current study.





