Abstract
Objective:
Localization of focal epilepsy is critical for surgical treatment of refractory seizures. There remains a great need for noninvasive techniques to localize seizures for surgical decision-making. We investigate the use of deep learning using resting state functional magnetic resonance imaging (RS-fMRI) to identify the hemisphere of seizure onset in temporal lobe epilepsy (TLE) patients.
Methods:
A total of 2132 healthy controls and 32 preoperative TLE patients were studied. All participants underwent structural MRI and RS-fMRI. Healthy control data were used to generate training samples for a three-dimensional convolutional neural network (3DCNN). RS-fMRI was synthetically altered in randomly lateralized regions in the healthy control participants. The model was then trained to classify the hemisphere containing synthetic noise. Finally, the model was tested on TLE patients to assess its performance for detecting biological seizure onset zones, and gradient-weighted class activation mapping (Grad-CAM) identified the strongest predictive regions.
Results:
The 3DCNN classified healthy control hemispheres known to contain synthetic noise with 96% accuracy, and TLE hemispheres clinically identified to be seizure onset zones with 90.6% accuracy. Grad-CAM identified a range of temporal, frontal, parietal, and subcortical regions that were strong anatomical predictors of the seizure onset zone, and the resting state networks that colocalized with Grad-CAM results included default mode, medial temporal, and dorsal attention networks. Lastly, in an analysis of a subset of patients with postsurgical outcomes, the 3DCNN leveraged a more focal set of regions to achieve classification in patients with Engel Class >I compared to Engel Class I.
Significance:
Noninvasive techniques capable of localizing the seizure onset zone could improve presurgical planning in patients with intractable epilepsy. We have demonstrated the ability of deep learning to identify the correct hemisphere of the seizure onset zone in TLE patients using RS-fMRI with high accuracy. This approach represents a novel technique of seizure lateralization that could improve preoperative surgical planning.
Keywords: epilepsy, machine learning, resting state functional connectivity
1 |. INTRODUCTION
Epilepsy is one of the most common neurologic disorders, affecting 1.5–2.3 million people in the United States and 50 million people worldwide.1 Epilepsy not fully responsive to antiepileptic medications, known as intractable epilepsy, leads to substantial morbidity, mortality, and socioeconomic burden.2 Noninvasive methods of lateralization or localization of the seizure onset zone are crucial for diagnosis and disease stratification, and of critical interest in a preoperative workup for epilepsy surgery. Conventional noninvasive methods of localization, beyond analysis of seizure semiology, typically include long-duration scalp video-assisted electroencephalography (video-EEG), high-resolution structural magnetic resonance imaging (MRI), positron emission tomography (PET), single photon emission computed tomography (SPECT), magnetoencephalography, and neuropsychological assessment, as well as other less commonly used modalities. Consensus on seizure localization, especially for the purposes of presurgical assessment, is typically achieved after considering all available diagnostic information obtained via these techniques. However, noninvasive methods are not always concordant or able to provide definitive seizure onset zone localization. In this situation, more invasive approaches, such as intracranial EEG, are required prior to proceeding to a definitive surgical treatment, such as a resection or ablation of the cerebral cortex. Noninvasive techniques that can localize the seizure onset zone without the need for more invasive methods thus continue to be greatly needed and could significantly improve surgical decision-making.
Machine learning (ML) refers to a form of artificial intelligence that leverages exposure to data rather than explicit instructions to develop models. Broadly speaking, ML algorithms compute a mapping function that isolates and selects features of a given input and maps them to an output prediction, with the mapping function being progressively updated and improved with greater exposure to input data. In the case of deep learning, the algorithm is organized in a neural network composed of layers of nodes, with multiple layers between the input and output layers, or hidden layers, that perform feature selection and mapping automatically by updating node weights as the network is exposed to data.
ML algorithms have been applied to multiple domains, including neurophysiology of healthy controls and patients with neurologic disorders.3 In the case of epilepsy, most applications of ML have focused on seizure detection, prognosis, or automated analysis and/or recognition of neuroimaging data. Some approaches, for instance, have developed classifiers for heterotopias or focal cortical dysplasias,4,5 in one instance leading to prediction of seizure freedom.6 In a very recent study, for instance, Larivière et al.7 used a supervised pattern learning algorithm to predict surgical outcome by analyzing resting state functional MRI (RS-fMRI) connectivity distance in patients with intractable focal epilepsy. Gleichgerrcht et al.8 was also able to predict surgical outcome after epilepsy surgery using deep learning with a high positive predictive value. An attractive feature of ML algorithms is that they can potentially extract hidden properties of a dataset. In a study by Pardoe et al.,9 an ML network was trained on a group of structural brain MRIs of healthy controls to estimate biological age. When applied to brain MRIs of epilepsy patients, the network yielded estimates that were older than the actual biological age of the patients, suggesting that the network was able to capture the premature aging effect of the disease.
There have been few attempts at using ML methods to lateralize or localize seizure onset. They have primarily been applied to conventional sources of noninvasive data typically available as part of a presurgical epilepsy workup, such as structural MRI, PET, or SPECT.10–13 RS-fMRI connectivity is typically used only for localization of eloquent cortex in preoperative surgical planning in epilepsy, but has shown promise in lateralizing seizure foci in patients with intractable focal epilepsy at the group level.14 Multiple papers have attempted to use functional connectivity to localize seizure foci,15–18 although as of now none of these methods has gained wide clinical acceptance. A technique that lateralizes the seizure onset zone at the individual patient level using RS-fMRI could be of significant value to the goals of a presurgical workup. ML approaches are beginning to be applied to the analysis of RS-fMRI connectivity for the purpose of seizure onset localization. Because the literature describes decreased connectivity in patients with epilepsy as compared to controls,19 we hypothesized that by augmenting functional connectivity data in normal controls with different types of noise, we could train an ML algorithm to identify the lateralization of seizure onset in patients with temporal lobe epilepsy (TLE).
In this study, we developed a novel deep learning approach to seizure onset lateralization that applies a three-dimensional convolutional neural network (3DCNN) to preoperative RS-fMRI data in patients with TLE. The neural network was trained on RS-fMRI data from healthy controls with superimposed noise and/or random permutations as ground truth. When applied to RS-fMRI data from a well-characterized set of TLE patients,14 the network achieved a preoperative seizure onset zone lateralization accuracy of 90.1%. Furthermore, gradient-weighted class activation mapping (Grad-CAM) applied to the 3DCNN identified both structural regions and functional networks, which were the strongest predictors of the seizure onset zone. Lastly, an analysis of a subset of patients with postsurgical outcomes identified differences between Engel Class I and Engel Class >I outcomes.
2 |. MATERIALS AND METHODS
2.1 |. Participants
Thirty-two patients with TLE (20 with left TLE [LTLE], 12 with right TLE [RTLE]) were retrospectively and consecutively enrolled through the Washington University Adult Epilepsy Center. These data have been well characterized in previous studies.14 Patients were screened for enrollment based on reported clinical semiology of their seizures and confirmed unilateral TLE by video-EEG monitoring. Clinical semiology for study inclusion included auras of epigastric rising, experiential phenomena (most commonly fear), and gustatory or olfactory sensations.20 Patients with auras suggestive of lateral temporal onset seizures, including auditory hallucinations, visual misperceptions, or language disturbance, were excluded from the study group. Video-EEG monitoring recorded all subjects having focal impaired awareness seizures. Ictal scalp EEG patterns either showed focal anterior temporal distribution slowing at EEG seizure onset, or showed progression to rhythmic focal slowing over the involved region in most seizures. Exclusion criteria included clinical or electrographic evidence of bitemporal or extratemporal seizures, developmental anomalies, cortical malformations, or other focal lesion on structural MRI, age < 18 years, inability to perform MRI, suspected pregnancy, history of substance or alcohol abuse, and nonproficiency in the English language. A subset of the patients had MRI evidence of medial temporal sclerosis (MTS) and/or hippocampal atrophy assessed via MRI image properties. No patients showed bilateral pathologic changes.
RS-fMRI data from healthy control participants (n = 2132) was acquired through ongoing research studies conducted at Washington University School in St Louis, as well as the Brain Genomics Superstruct Project.21 Normative cognitive status for the control participants was confirmed by a structured clinical rating scale (i.e., the Clinical Dementia Rating Scale22) or online cognitive test protocol.21 The appropriate institutional review boards approved all studies, and all participants provided written informed consent.
2.2 |. MRI acquisition and processing
Images from TLE participants were acquired with a Siemens MAGNETOM Trio 3-T scanner. A high-resolution (.42 × .42 × .9 mm) T1-weighted magnetization-prepared rapid gradient echo (MPRAGE; inversion time [TI] = 800 ms, echo time [TE] = 3.29 ms) structural scan was obtained for each participant for the purpose of anatomic segmentation, registration to the functional images, and atlas transformation. Two blood oxygen level-dependent (BOLD) resting state functional scans (echoplanar, repetition time [TR] = 2200 ms, TE = 27 ms, flip angle [FA] = 90°, 4 × 4 × 4-mm voxels) were also acquired for each participant. Each of the two functional runs was comprised of 164 volumes (approximately 6 min in duration). Study participants were asked to relax while fixating on a crosshair. fMRI BOLD data were preprocessed in several steps using standard methods.23 Motion was corrected with rigid-body realignment. Spurious variance was minimized by removal of the linear trend, temporal low-pass filtering, spatial smoothing, and regression of nuisance parameters (head motion, white matter, ventricular and global signals) and their temporal derivatives.24
Imaging from healthy controls was performed on 3-T Siemens magnetic resonance scanners (models varied between studies) equipped with a standard 12-channel head coil. A high-resolution, three-dimensional, sagittal, T1-weighted, MPRAGE scan was acquired (TE = 16 ms, TR = 2400 ms, TI = 1000 ms, FA = 8°, 256 × 256 acquisition matrix, 1-mm3 voxels). RS-fMRI scans were collected using an echo planar sequence (voxel size = 3–4 mm3, TR = 2200–3000 ms, FA = 80°–90°). Each participant had approximately 14 min of RS-fMRI data. Preprocessing methods were identical to those described above.
2.3 |. Analysis
A 3DCNN with a densely connected architecture25 was used for our analysis and was trained to classify which hemisphere contained the seizure onset zone. The 3DCNN consisted of 72 layers and 55 680 450 learnable parameters. Layers within the network included 3 × 3 × 3 and 1 × 1 × 1 convolutions (Stride 1), batch normalization, swish activation, 2 × 2 × 2 max pooling (Stride 2), concatenations, and dropout (50%). Input to the model was a 48 × 64 × 48 × 180 BOLD time series (height, width, depth, time). A total of 200 000 training instances were generated for each hemisphere. A minibatch size of four was used during training, and minibatches were shuffled after every full epoch. The model learn rate was initialized at .01 and was reduced by 50% at every epoch. Twenty percent of the generated training data were reserved for validation. Validation occurred at the completion of every epoch, and training was terminated if the accuracy did not improve after three validations. The output of the model represented the probability of the training sample having a seizure onset zone located in each hemisphere of the brain. All analysis and models were implemented in MATLAB R2020b (www.mathworks.com).
Training data were generated by augmenting data from healthy control participants. Specifically, to generate any single instance of training data, a single seed voxel was selected at random in the brain. Then, three integer values ranging from 0 to 3 were generated at random that would represent the height, width, and depth of the three-dimensional region of the simulated seizure onset zone in the brain centered around the seed voxel (i.e., if the random integers chosen were [2, 1, 3], the dimension of the seizure onset zone would be 5 × 3 × 7). Next, any voxel contained within the simulated seizure onset zone would have its time series modified by various means to create anomalous data in that region of the brain. Numerous methods were uniformly used to modify the time series, including (1) adding normally distributed noise, (2) adding uniformly distributed noise, (3) adding power-law noise, (4) adding Brownian noise, (5) adding noise generated by a Levy walk process, (6) randomly permuting the time series, (7) replacing the time series with cosine waves with various periods, or (8) replacing the whole time series with constant values. The choice of using multiple noise models was made because (1) using a single noise model would lead to the 3DCNN being overfit to that specific noise model; and (2) we do not know what an epileptic “signature” looks like in BOLD data, and are therefore unable to choose a single noise model that is most reflective of epilepsy (assuming such a noise model exists). Therefore, the use of multiple noise models leads to a nonspecific anomaly detector. Each voxel within the simulated seizure onset zone was modified independently, and every voxel in a sample was perturbed with the same noise model. This process was repeated for the healthy control data until there were 200 000 training samples in each hemisphere. Notably, only modified heathy control data were used to train the 3DCNN. After training was complete, the model was then tested on TLE data. Figure 1 shows an example of noise injection on BOLD data from a healthy control participant.
FIGURE 1.

Top left shows a single frame of blood oxygen level-dependent (BOLD) functional magnetic resonance imaging from a healthy control participant. Top right shows the same frame after noise injection via randomly permuting the BOLD time series within the highlighted circle. Bottom panel shows the BOLD time series from a single voxel (Raw) versus the same time series after noise injection or random permutation
Features used by the 3DCNN to appropriately classify TLE data were identified using Grad-CAM.26 Grad-CAM determines the important features in data by evaluating the gradients of the target within the 3DCNN. Specifically, Grad-CAM computes the gradient with respect to the class score and the convolutional features of a specified layer. After spatially pooling the gradients, the weights are used to combine the activation maps and determine which features are most relevant to the classification goal. The final concatenation layer of the 3DCNN was used to extract features with Grad-CAM. Voxelwise Grad-CAM weights were averaged based on FreeSurfer27-defined regions of interest (ROIs) to identify the anatomical regions that were typically of greatest importance for classification. Grad-CAM weights were also averaged across predefined ROIs28 to identify which resting state networks (RSNs) contributed most to the classification. The RSNs evaluated included dorsal somatomotor (SMD), ventral somatomotor (SMV), cingulo-opercular (CON), auditory (AUD), default mode (DMN), parietal memory (PMN), visual (VIS), frontoparietal (FPN), salience (SAL), ventral attention (VAN), dorsal attention (DAN), medial temporal (MTL), basal ganglia (BGA), and thalamus (THA). Averaging Grad-CAM weights based on both anatomical and RSN parcellations was performed to summarize the voxelwise results produced by Grad-CAM and place our results in the context of past research.
3 |. RESULTS
3.1 |. Participant demographics
Demographics for TLE and healthy control participants are presented in Table 1.
Table 1.
Demographics
| Controls | Left TLE | Right TLE | |
|---|---|---|---|
| N | 2132 | 20 | 12 |
| Age (mean±STD) | 37.8±21.5 | 42.4±13.9 | 42.4±13.3 |
| % Female | 58% | 55% | 75% |
| Age at onset (mean±STD) | - | 27.3 (17.5) | 13.7 (14.9) |
| % MTS/Atrophy | - | 40% | 67% |
| % Surgical outcomes | - | 45% | 50% |
| % Engel Class 1 | - | 55% | 100% |
MTS, Mesial temporal sclerosis, STD, standard deviation
3.2 |. Model results
The 3DCNN classified healthy control hemispheres known to contain synthetic noise with 96% accuracy. These results required 17 training epochs. Once training was complete, the model was then tested on TLE data. These results can be seen in Figure S1. The overall accuracy of the model on TLE patients was 90.6% (90% accuracy classifying LTLE and 91.7% accuracy classifying RTLE).
Figure 2 shows the mean feature maps identified with Grad-CAM for LTLE and RTLE. This figure demonstrates that the areas used for identification of the LTLE versus RTLE are, as expected, more weighted toward the left versus right side. However, identification of RTLE is more focused on information from the right temporal lobe as compared with LTLE, which is more diffusely spread beyond just the left temporal lobe, involving areas of the left > right frontal lobes (see Figures S2 and S3). The asymmetry is also illustrated in Figure 3, which shows the average Grad-Cam weights based on anatomical parcellations. In RTLE, the strongest features were primarily localized to the middle and inferior temporal lobe. Comparatively, Grad-CAM weights in LTLE were less localized and covered more regions of the brain, including temporal, frontal, and subcortical (anterior cingulate, insula, entorhinal cortex) regions. Asymmetry between the two sides is also seen in Figure 4, which shows the average Grad-CAM weights for individual RSNs based on predefined ROIs. Overall, the highest average weights were seen in the DMN, MTL, and DAN. Lastly, a subset of LTLE patients with different postsurgical Engel outcomes were compared. Grad-CAM feature maps for four patients with Engel Class I were averaged, and maps from four patients with Engel Class >I were averaged. Figure 5 depicts the results. The mean Grad-CAM map for Engel Class >I, that is, with poorer postsurgical outcome, shows greater focality when compared to the more diffuse extent seen in Engel Class I patients.
FIGURE 2.

Gradient-weighted class activation mapping for left and right seizure onset zones (radiological convention, slices shown are focused on the temporal lobes). Larger values represent stronger predictors. Depending on the lateralization, the three-dimensional convolutional neural network learns features in the ipsilateral hippocampus, amygdala, insula, neocortical temporal lobe, orbitofrontal cortex, and ipsilateral and contralateral parietal regions. TLE, temporal lobe epilepsy
FIGURE 3.

Average gradient-weighted class activation mapping (Grad-CAM) weights and variance for top 12 structural FreeSurfer regions. Left image shows the average Grad-CAM weights calculated for left (L) temporal lobe epilepsy (TLE), and right image shows average Grad-CAM weights for right (R) TLE. Anatomical regions most useful for classification were found in temporal, frontal, parietal, and insular regions
FIGURE 4.

Average gradient-weighted class activation mapping (Grad-CAM) weights and variance for resting state networks. The resting state networks (RSNs) most predictive overall include the default mode (DMN), dorsal attention (DAN), and medial temporal (MTL) networks. Left image shows the primary RSNs predictive for left temporal lobe epilepsy (TLE), including DMN, MTL, and frontal parietal network (FPN). Right image shows the primary RSNs predictive for right TLE, which include DAN, DMN, and MTL. Note the difference in scale of the two plots. AUD, auditory; BGA, basal ganglia; CON, cingulo-opercular; PMN, parietal memory; SAL, salience; SMD, dorsal somatomotor; SMV, ventral somatomotor; THA, thalamus; VAN, ventral attention; VIS, visual
FIGURE 5.

Mean gradient-weighted class activation mapping (Grad-CAM) results (radiological convention) comparing Engel Class I and Engel Class >I in left temporal lobe epilepsy patients. The mean Grad-CAM map for Engel Class >I shows more localized regions on the left contributing to the lateralization score with higher magnitude when compared to Engel Class I
4 |. DISCUSSION
In this study, we used a novel data augmentation methodology and a 3DCNN to classify the hemisphere containing the seizure onset zone in preoperative TLE patients with high accuracy (Figure S1). This degree of accuracy is substantial and, if confirmed in larger studies, could be sufficient for clinical use and could potentially improve treatment outcomes for patients with TLE. Furthermore, features extracted from the 3DCNN were used to identify both anatomical regions and RSNs that contributed most to the classification. At the region level, temporal, frontal, parietal, and insular regions were identified as the strongest predictors, and at the level of RSNs, the strongest predictors of lateralization included DMN, MTL, and DAN networks (Figures 3 and 4). Lastly, in an analysis of a subset of patients with postsurgical outcomes, our model indicates that patients with poorer outcomes (Engel Class >I) had a more focal set of left regions affecting classification compared to patients with Engel Class I outcomes (Figure 5), for whom classification leveraged a diffuse area across both hemispheres.
Our analysis revealed notable differences when comparing LTLE and RTLE (Figures 2–4). In LTLE, mean Grad-CAM maps showed strong contributions to the lateralization by numerous regions, including the medial occipitotemporal gyrus, frontal lobe, temporal lobe, and anterior cingulate cortex. In contrast, strong activations in RTLE were more localized, and primarily encompassed the temporal lobe and some parietal regions. The asymmetries seen in Figure 2 are also reflected in the numerical results presented in Figure 3. The more diffuse spread of Grad-CAM weights in the LTLE is clearly seen in comparison with the values in the RTLE patients, which are more focused in the right temporal lobe area. Past studies of TLE using multiple imaging modalities have revealed similar imbalances with respect to the effect of LTLE and RTLE in the brain.29–32 Besson et al.33 compared LTLE, RTLE, and controls using diffusion-weighted imaging. Their results showed a significant reduction in connectivity between LTLE patients and controls, whereas loss of connectivity in RTLE patients was less pronounced and restricted to fewer regions. Both these and our findings may at least in part reflect the commonly observed difference in semiology between temporal seizures that involve the dominant versus nondominant hemisphere, with the former typically leading to much greater ictal disruption of awareness and cognitive function.34 The 3DCNN analysis may thus have revealed a group-specific difference in extent of the epileptogenic network reflected in a typically observed clinical phenotype.
Similarly, differences between LTLE and RTLE were observed with regard to the contribution of different RSNs to classification. In general, LTLE showed stronger contributions by most networks (Figure 4). Again, differences in LTLE and RTLE at the RSN level have also been observed in other work.35 Haneef et al.30 showed LTLE had greater alterations in hippocampal networks when compared to RTLE. Their study also found no significant changes in frontal connectivity in RTLE patients. As seen in Figure 2, some of the largest differences seen in the Grad-CAM feature maps between LTLE and RTLE were observed in frontal regions, with orbitofrontal cortex contributing significantly to lateralization in LTLE but not in RTLE patients. These results are consistent with past research, which suggests that LTLE leads to more prominent frontal lobe dysfunction.30 Haneef et al.36 also showed the DMN was more effected in LTLE compared to RTLE. In all, our results may reflect the commonly observed finding that LTLE appears to cause more extensive network impairment than RTLE, which may be of relevance for preoperative planning.
The primary RSNs associated with greater Grad-CAM feature weights (i.e., that were of greater impact on classification) included the DMN, DAN, and MTL networks in addition to subcortical regions, such as the BGA. The DMN spans a large portion of the brain and is most active when an individual is not engaged in goal-directed tasks.28 The DMN has been implicated in numerous neurological disorders,37 including epilepsy.38,39 The literature is consistent in reporting decreases in DMN connectivity in patients with epilepsy,19,40 although contralateral increases have been reported.41 In TLE, alterations in the DMN have been associated with greater postsurgical memory decline.42 However, the literature is inconsistent on whether changes in the DMN due to TLE are dependent43 or independent of duration of illness.44 In direct opposition to the DMN, the DAN is most associated with task-positive brain activity (primarily top-down, goal-directed attention processes).28 Studies have shown that TLE decreases functional connectivity in the DAN, and as a result, leads to poorer performance on cognitive tests associated with top-down attention processes.45,46 The MTL and BGA encompass deep gray structures, including regions encompassing the hippocampus, parahippocampal regions, and entorhinal cortex,28 all regions that are either typically or often adversely affected by TLE. The disease has thus also been shown to be associated with alterations in functional connectivity in regions spanned by the MTL.30,47–50 In our study, the 3DCNN identified functional and structural regions of the brain known to be affected by TLE. That the model was trained only on health control data augmented with synthetic noise and was still able to identify regions known to associate with TLE suggests that TLE causes chronic perturbations in brain dynamics that are critically relevant to lateralization/localization of the seizure onset zone.
Figure 5 depicts the presurgical mean Grad-CAM maps for LTLE patients with Engel Class I versus Engel Class >I postsurgical outcome. The map for Engel Class I showed more diffuse but weaker contribution across the brain to the lateralization score when compared to Engel Class >I, which is more focused on the left temporal and frontal lobes with relatively higher contribution levels. A potential interpretation of these results is that patients who do better postoperatively have a more diffuse set of regions with mild abnormal connectivity, and the 3DCNN is still able to detect them and leverage them for the purpose of lateralization. If confirmed in a larger dataset, the spatial degree and magnitude of features identified by the 3DCNN could serve as a biomarker to aid in surgical planning. An alternative hypothesis would posit that the group of patients with poorer postsurgical outcome had more intense focal connectivity changes that spanned a more local set of regions, which in turn contributed more on average to the classification score.
The main limitation of our study is the small size of the test set and the number of patients with post-surgical outcomes. A possible consequence is potential asymmetry between the LTLE and RTLE groups (with lower MTS and poorer Engel class outcomes in the LTLE group). Further work with larger datasets will be required for validation of this technique prior to clinical applications. Because the training method is general, and not specific to TLE, future work could involve designing models that are not specific to TLE and can generalize to multiple other forms of epilepsy. Finally, we hypothesize that models capable of segmenting individual regions, rather than just hemisphere classification, could be trained to facilitate fine-grained localization of seizure onset zones, of potential use for individually tailored presurgical planning.
5 |. CONCLUSIONS
Noninvasive techniques capable of localizing the seizure onset zone could significantly improve the evaluation of patients with intractable TLE. In this work, we have demonstrated the ability of deep learning to identify the correct hemisphere of the seizure onset zone in TLE patients using RS-fMRI. The model was able to make accurate predictions after training exclusively on healthy control data augmented with synthetic noise. This data-driven approach represents a novel noninvasive technique for seizure lateralization in TLE that could improve preoperative surgical planning and patient outcomes.
Supplementary Material
Key Points.
Deep learning was able to accurately classify the correct hemisphere of the seizure onset zone in TLE patients using RS-fMRI
The strongest predictive anatomical regions included temporal, frontal, parietal, and insular regions
The strongest predictive resting state networks included default mode, medial temporal, and dorsal attention networks
Engel Class I showed more diffuse contributions across the brain to the lateralization score compared to Engel Class >I.
ACKNOWLEDGMENTS
Research reported in this publication was supported by the National Institutes of Health under award numbers P50 HD103525, P01 AG003991, P01 AG026276, R01 CA203861, R01 DA054009, R01 AG057680, R01 MH118031, R01 NR015738, and R01 NR014449.
Furthermore, we acknowledge the Paula and Rodger O. Riney fund and the Daniel J. Brennan fund.
Funding information
National Institutes of Health, Grant/Award Number: P01 AG003991, P01 AG026276, P50 HD103525, R01 AG057680, R01 CA203861, R01 DA054009, R01 MH118031, R01 NR014449 and R01 NR015738
Footnotes
CONFLICT OF INTEREST
None of the authors has any conflict of interest to disclose. We confirm that we have read the Journal’s position on issues involved in ethical publication and affirm that this report is consistent with those guidelines.
SUPPORTING INFORMATION
Additional supporting information may be found in the online version of the article at the publisher’s website.
REFERENCES
- 1.Ivanova JI, Birnbaum HG, Kidolezi Y, Qiu Y, Mallett D, Caleo S. Economic burden of epilepsy among the privately insured in the US. Pharmacoeconomics 2010;28(8):675–85. [DOI] [PubMed] [Google Scholar]
- 2.Begley CE, Famulari M, Annegers JF, Lairson DR, Reynolds TF, Coan S, et al. The cost of epilepsy in the United States: an estimate from population-based clinical and survey data. Epilepsia 2000;41(3):342–51. [DOI] [PubMed] [Google Scholar]
- 3.Rajkomar A, Dean J, Kohane I. Machine learning in medicine. N Engl J Med 2019;380(14):1347–58. [DOI] [PubMed] [Google Scholar]
- 4.El Azami M, Hammers A, Jung J, Costes N, Bouet R, Lartizien C. Detection of lesions underlying intractable epilepsy on T1-weighted MRI as an outlier detection problem. PLoS One 2016;11(9):e0161498. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Jin B, Krishnan B, Adler S, Wagstyl K, Hu W, Jones S, et al. Automated detection of focal cortical dysplasia type II with surface-based magnetic resonance imaging postprocessing and machine learning. Epilepsia 2018;59(5):982–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Hong S-J, Bernhardt BC, Schrader DS, Bernasconi N, Bernasconi Whole-brain MRI phenotyping in dysplasia-related frontal lobe epilepsy. Neurology 2016;86(7):643–50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Larivière S, Weng Y, Vos de Wael R, Royer J, Frauscher B, Wang Z, et al. Functional connectome contractions in temporal lobe epilepsy: microstructural underpinnings and predictors of surgical outcome. Epilepsia 2020;61(6):1221–33. [DOI] [PubMed] [Google Scholar]
- 8.Gleichgerrcht E, Munsell B, Bhatia S, Vandergrift WA, Rorden C, McDonald C, et al. Deep learning applied to whole-brain connectome to determine seizure control after epilepsy surgery. Epilepsia 2018;59(9):1643–54. [DOI] [PubMed] [Google Scholar]
- 9.Pardoe HR, Cole JH, Blackmon K, Thesen T, Kuzniecky R. Structural brain changes in medically refractory focal epilepsy resemble premature brain aging. Epilepsy Res 2017;133:28–32. [DOI] [PubMed] [Google Scholar]
- 10.Rudie JD, Colby JB, Salamon N. Machine learning classification of mesial temporal sclerosis in epilepsy patients. Epilepsy Res 2015;117:63–9. [DOI] [PubMed] [Google Scholar]
- 11.Keihaninejad S, Heckemann RA, Gousias IS, Hajnal JV, Duncan JS, Aljabar P, et al. Classification and lateralization of temporal lobe epilepsies with and without hippocampal atrophy based on whole-brain automatic MRI segmentation. PLoS One 2012;7(4):e33096. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Kerr WT, Nguyen ST, Cho AY, Lau EP, Silverman DH, Douglas PK, et al. Computer-aided diagnosis and localization of lateralized temporal lobe epilepsy using interictal FDG-PET. Front Neurol 2013;4:31. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Lopes R, Steinling M, Szurhaj W, Maouche S, Dubois P, Betrouni N. Fractal features for localization of temporal lobe epileptic foci using SPECT imaging. Comput Biol Med 2010;40(5):469–77. [DOI] [PubMed] [Google Scholar]
- 14.Maccotta L, He BJ, Snyder AZ, Eisenman LN, Benzinger TL, Ances BM, et al. Impaired and facilitated functional networks in temporal lobe epilepsy. Neuroimage Clin 2013;2:862–72. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Boerwinkle VL, Mirea L, Gaillard WD, Sussman BL, Larocque D, Bonnell A, et al. Resting-state functional MRI connectivity impact on epilepsy surgery plan and surgical candidacy: prospective clinical work. J Neurosurg Pediatr 2020;25(6):574–81. [DOI] [PubMed] [Google Scholar]
- 16.Stufflebeam SM, Liu H, Sepulcre J, Tanaka N, Buckner RL, Madsen JR. Localization of focal epileptic discharges using functional connectivity magnetic resonance imaging. J Neurosurg 2011;114(6):1693–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Weaver KE, Chaovalitwongse WA, Novotny EJ, Poliakov A, Grabowski TG, Ojemann JG. Local functional connectivity as a pre-surgical tool for seizure focus identification in non-lesion, focal epilepsy. Front Neurol 2013;4:43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Bettus G, Bartolomei F, Confort-Gouny S, Guedj E, Chauvel P, Cozzone PJ, et al. Role of resting state functional connectivity MRI in presurgical investigation of mesial temporal lobe epilepsy. J Neurol Neurosurg Psychiatry 2010;81(10):1147–54. [DOI] [PubMed] [Google Scholar]
- 19.Voets NL, Beckmann CF, Cole DM, Hong SJ, Bernasconi A, Bernasconi N. Structural substrates for resting network disruption in temporal lobe epilepsy. Brain 2012;135(8):2350–7. [DOI] [PubMed] [Google Scholar]
- 20.Hogan RE. Mesial temporal sclerosis: clinicopathological correlations. Arch Neurol 2001;58(9):1484–6. [DOI] [PubMed] [Google Scholar]
- 21.Holmes AJ, Hollinshead MO, O’Keefe TM, Petrov VI, Fariello GR, Wald LL, et al. Brain Genomics Superstruct Project initial data release with structural, functional, and behavioral measures. Sci Data 2015;2(1):1–16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Morris JC. The clinical dementia rating (CDR): current version and scoring rules. Neurology 2012;41(1):1588–92. [DOI] [PubMed] [Google Scholar]
- 23.Snyder AZ. Difference image vs ratio image error function forms in PET—PET realignment. In: Quantification of brain function using PET New York, NY: Elsevier; 1996. p. 131–7. [Google Scholar]
- 24.Fox MD, Zhang D, Snyder AZ, Raichle ME. The global signal and observed anticorrelated resting state brain networks. J Neurophysiol 2009;101(6):3270–83. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2017. p. 4700–8. [Google Scholar]
- 26.Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-cam: visual explanations from deep networks via gradient-based localization In: Proceedings of the IEEE International Conference on Computer Vision; 2017. p. 618–26. [Google Scholar]
- 27.Fischl B FreeSurfer. NeuroImage 2012;62(2):774–81. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Seitzman BA, Snyder AZ, Leuthardt EC, Shimony JS. The state of resting state networks. Top Magn Reson Imaging 2019;28(4):189–96. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Kemmotsu N, Girard HM, Bernhardt BC, Bonilha L, Lin JJ, Tecoma ES, et al. MRI analysis in temporal lobe epilepsy: cortical thinning and white matter disruptions are related to side of seizure onset. Epilepsia 2011;52(12):2257–66. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Haneef Z, Lenartowicz A, Yeh HJ, Levin HS, Engel J, Stern JM. Functional connectivity of hippocampal networks in temporal lobe epilepsy. Epilepsia 2014;55(1):137–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Keller SS, Wieshmann UC, Mackay CE, Denby CE, Webb J, Roberts N. Voxel based morphometry of grey matter abnormalities in patients with medically intractable temporal lobe epilepsy: effects of side of seizure onset and epilepsy duration. J Neurol Neurosurg Psychiatry 2002;73(6):648–55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Riederer F, Lanzenberger R, Kaya M, Prayer D, Serles W, Baumgartner C. Network atrophy in temporal lobe epilepsy: a voxel-based morphometry study. Neurology 2008;71(6):419–25. [DOI] [PubMed] [Google Scholar]
- 33.Besson P, Dinkelacker V, Valabregue R, Thivard L, Leclerc X, Baulac M, et al. Structural connectivity differences in left and right temporal lobe epilepsy. NeuroImage 2014;100:135–44. [DOI] [PubMed] [Google Scholar]
- 34.Kerling F, Mueller S, Pauli E, Stefan H. When do patients forget their seizures? An electroclinical study. Epilepsy Behav 2006;9(2):281–5. [DOI] [PubMed] [Google Scholar]
- 35.Tracy JI, Doucet GE. Resting-state functional connectivity in epilepsy: growing relevance for clinical decision making. Curr Opin Neurol 2015;28(2):158–65. [DOI] [PubMed] [Google Scholar]
- 36.Haneef Z, Lenartowicz A, Yeh HJ, Engel J, Stern JM. Effect of lateralized temporal lobe epilepsy on the default mode network. Epilepsy Behav 2012;25(3):350–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Mohan A, Roberto AJ, Mohan A, Lorenzo A, Jones K, Carney MJ, et al. Focus: the aging brain: the significance of the default mode network (DMN) in neurological and neuropsychiatric disorders: a review. Yale J Biol Med 2016;89(1):49. [PMC free article] [PubMed] [Google Scholar]
- 38.Gonen OM, Kwan P, O’Brien TJ, Lui E, Desmond PM. Resting-state functional MRI of the default mode network in epilepsy. Epilepsy Behav 2020;111:107308. [DOI] [PubMed] [Google Scholar]
- 39.Parsons N, Bowden SC, Vogrin S, D’Souza WJ. Default mode network dysfunction in idiopathic generalised epilepsy. Epilepsy Res 2020;159:106254. [DOI] [PubMed] [Google Scholar]
- 40.Maccotta L, Lopez MA, Adeyemo B, Ances BM, Day BK, Eisenman LN, et al. Postoperative seizure freedom does not normalize altered connectivity in temporal lobe epilepsy. Epilepsia 2017;58(11):1842–51. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Bettus G, Guedj E, Joyeux F, Confort-Gouny S, Soulier E, Laguitton V, et al. Decreased basal fMRI functional connectivity in epileptogenic networks and contralateral compensatory mechanisms. Hum Brain Mapp 2009;30(5):1580–91. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.McCormick C, Quraan M, Cohn M, Valiante TA, McAndrews MP. Default mode network connectivity indicates episodic memory capacity in mesial temporal lobe epilepsy. Epilepsia 2013;54(5):809–18. [DOI] [PubMed] [Google Scholar]
- 43.Kay BP, DiFrancesco MW, Privitera MD, Gotman J, Holland SK, Szaflarski JP. Reduced default mode network connectivity in treatment-resistant idiopathic generalized epilepsy. Epilepsia 2013;54(3):461–70. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.James GA, Tripathi SP, Ojemann JG, Gross RE, Drane DL. Diminished default mode network recruitment of the hippocampus and parahippocampus in temporal lobe epilepsy. J Neurosurg 2013;119(2):288–300. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Zhang Z, Lu G, Zhong Y, Tan Q, Yang Z, Liao W, et al. Impaired attention network in temporal lobe epilepsy: a resting FMRI study. Neurosci Lett 2009;458(3):97–101. [DOI] [PubMed] [Google Scholar]
- 46.Liao W, Zhang Z, Pan Z, Mantini D, Ding J, Duan X, et al. Altered functional connectivity and small-world in mesial temporal lobe epilepsy. PLoS One 2010;5(1):e8525. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Vaughan DN, Rayner G, Tailby C, Jackson GD. MRI-negative temporal lobe epilepsy: a network disorder of neocortical connectivity. Neurology 2016;87(18):1934–42. [DOI] [PubMed] [Google Scholar]
- 48.Doucet GE, Sharan A, Pustina D, Skidmore C, Sperling MR, Tracy JI. Early and late age of seizure onset have a differential impact on brain resting-state organization in temporal lobe epilepsy. Brain Topogr 2015;28(1):113–26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Yang Z, Choupan J, Reutens D, Hocking J. Lateralization of temporal lobe epilepsy based on resting-state functional magnetic resonance imaging and machine learning. Front Neurol 2015;6:184. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50..Larivière S, Rodríguez-Cruces R, Royer J, Caligiuri ME, Gambardella A, Concha L, et al. Network-based atrophy modeling in the common epilepsies: a worldwide ENIGMA study. Sci Adv 2020;6(47):eabc6457. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
