Abstract
It is necessary to develop reliable biomarkers for epileptogenesis and cognitive impairment after traumatic brain injury when searching for novel antiepileptogenic and cognition-enhancing treatments. We hypothesized that a multiparametric magnetic resonance imaging (MRI) analysis along the septotemporal hippocampal axis could predict the development of post-traumatic epilepsy and cognitive impairment. We performed quantitative T2 and T2* MRIs at 2, 7 and 21 days, and diffusion tensor imaging at 7 and 21 days after lateral fluid-percussion injury in male rats. Morris water maze tests conducted between 35–39 days post-injury were used to diagnose cognitive impairment. One-month-long continuous video-electroencephalography monitoring during the 6th post-injury month was used to diagnose epilepsy. Single-parameter and regularized multiple linear regression models were able to differentiate between sham-operated and brain-injured rats. In the ipsilateral hippocampus, differentiation between the groups was achieved at most septotemporal locations (cross-validated area under the receiver operating characteristic curve (AUC) 1.0, 95% confidence interval 1.0–1.0). In the contralateral hippocampus, the highest differentiation was evident in the septal pole (AUC 0.92, 95% confidence interval 0.82–0.97). Logistic regression analysis of parameters imaged at 3.4 mm from the contralateral hippocampus’s temporal end differentiated between the cognitively impaired rats and normal rats (AUC 0.72, 95% confidence interval 0.55–0.84). Neither single nor multiparametric approaches could identify the rats that would develop post-traumatic epilepsy. Multiparametric MRI analysis of the hippocampus can be used to identify cognitive impairment after an experimental traumatic brain injury. This information can be used to select subjects for preclinical trials of cognition-improving interventions.
Keywords: epilepsy, traumatic brain injury, magnetic resonance imaging, cognitive dysfunction, hippocampus
1. Introduction
Annually, 3.5 million people in the USA, 2.5 million people in Europe, and 69 million people globally suffer a traumatic brain injury (TBI) [1,2]. A TBI leads to post-traumatic epilepsy (PTE) in 1.3% to 53% of patients [3]. It also evokes a range of cognitive impairments (CI), including deficiencies in learning, as well as deficits in both short- and long-term memory [4]. A large number of proof-of-concept trials have demonstrated that it is possible to achieve treatment effects with antiepileptogenic, neuroprotective as well as behavior or cognition-improving compounds in animal models of TBI; nonetheless, none of these antiepileptogenic or recovery-enhancing treatments have successfully passed through clinical trials [5,6]. One major reason for this dismal situation is the lack of epilepsy biomarkers that would allow efficient stratification of patients, thus decreasing the cost of clinical trials [7].
Magnetic resonance imaging (MRI) is a safe imaging method [8], enabling repeated in vivo investigations of the evolving pathologies evoked by a TBI [9]. For this reason, diagnostic and prognostic MRI biomarkers of epileptogenesis are being actively investigated in preclinical and clinical settings [10,11].
A lateral fluid-percussion injury (FPI) in rodents is a model of TBI and PTE [12,13]. It evokes several cellular changes in the hippocampus proper and the dentate gyrus, including a loss of principal cells and interneurons, mossy fiber sprouting, vascular abnormalities, and gliosis. These changes have been proposed to underlie the evolution of hyperexcitability and the subsequent cognitive decline [14,15,16]. Typically, abnormalities have been detected as being located ipsilateral to the injury, but some investigators have also identified a milder injury in the contralateral hippocampus [15,17]. Importantly, in different animal models of epilepsy, some hippocampal pathologies have shown promise as biomarkers of epileptogenesis [18,19,20,21]. However, the diagnostic accuracy of most of these findings remain to be explored in more detail.
In an effort to expand on the previous observations in a larger animal cohort, we investigated the hypothesis that early quantitative T2, T2*, and diffusion tensor imaging (DTI) MRI measures in different parts of the septotemporal hippocampal axis would be able to predict the development of CI or PTE after a lateral FPI. The different quantitative MRI measures that were used offer complementary information on the evolving tissue pathology and were also used in regularized multivariable logistic regression analyses. The multivariable approach may help to elicit diagnostic information from the complex ongoing pathophysiological changes that occur in the hippocampus after the TBI that would be inaccessible to single-variable approaches. The analysis was performed at different locations along the septotemporal axis of the hippocampus, and thus accounted for the possible spatial dependence of hippocampal function or pathology along this axis. As a severe lateral FPI causes an expansion of the lateral ventricles and evokes hippocampal atrophy, it decreases the accuracy of standard image registration procedures. Thus, in order to conduct an accurate between-subject comparison of quantitative MRI parameters within the hippocampus, we utilized convolutional neural network-based segmentations of the hippocampi to improve the accuracy of the image registrations.
2. Materials and Methods
2.1. Study Design
Study design, animal numbers, and exclusions related to the present analysis are summarized in Figure 1. The data derives from the large EPITARGET rat cohort (n = 257, male) that has been described in detail before [22,23]. Due to imaging or image-analysis-related challenges, only 87 of the 144 (60%) MRI-imaged rats were included in the analysis of the hippocampus (16 sham, 71 TBI).
2.1.1. Diagnosis of Post-Traumatic Epilepsy
At five months post-TBI, on day (D) 147, the rats were anesthetized and implanted with three skull electrodes. Starting on D154 (one week after electrode implantation), rats underwent a continuous (24/7) video-EEG monitoring for 4 weeks to diagnose the presence of post-traumatic epilepsy (for details, see [22]). Rats were defined as having epilepsy if at least one unprovoked electrographic seizure was detected. A seizure was defined as a high-amplitude rhythmic discharge, representing an atypical EEG pattern (repetitive spikes, spike-and-wave discharges, poly-spike-and-wave, or slow-waves, frequency and amplitude modulation), that lasted longer than 10 s [13]. The prevalence of epilepsy in the entire EPITARGET cohort was 27% (31/115) and in the subcohort of the 68 TBI animals included in the present analysis 22% (15/68).
2.1.2. Cognitive Impairment
The Morris water maze test was performed on D35–39 after the injury to assess spatial learning and memory (for details, see [22]). Briefly, the test started with a habituation day (D0), during which the rat was allowed to habituate to the maze during a 60 s swimming trial (no platform present). During the following 3 d (D1–3 of acquisition learning), the rat was placed into the pool at 1 of the 4 designated starting points (South, West, North, East), facing the wall. Each rat underwent 5 consecutive trials per day (60 s/trial) for 3 d. If the rat did not find the platform within 60 s, it was gently guided to the platform by the experimenter. At the end of testing on D3, a probe trial was performed without the platform present. The probe trial was repeated on D5. As outcome measures, we recorded (1) path length (swimming distance) for each trial (cm), (2) swimming speed (velocity, cm/s), (3) time to reach the platform (latency, s), (4) latency to the platform zone in probe trials on D3 and D5, (4) learning speed on D1-D3 (the difference between the escape latency in trials 1 and 5, normalized to the escape latency in trial 1 on each testing day) [21], and (5) speed of forgetting (the escape latency measured during the last training session of each day vs. the escape latency measured during the first session of the subsequent day) [21]. The outcome parameters were obtained using EthoVision® XT (v. 7.1, Noldus Information Technology, Wageningen, The Netherlands).
The cut-point analysis of Morris water maze data of the entire EPITARGET animal cohort, including 23 sham-operated and 118 rats with TBI, was performed to identify the best parameter that could be used to differentiate cognitively impaired (CI+) from non-impaired (CI−) animals [22]. The analysis revealed that the latency cut-off value of 19.2 sec to reach the platform on the third testing day (D37 post-TBI) distinguished TBI animals from sham-operated experimental controls with an AUC value of 0.94 (84% sensitivity, 100% specificity, p < 0.001). In the entire EPITARGET cohort, 70% (98/141) of the rats with TBI were categorized into the CI+ and 30% (20/141) into the CI− group. In the present subcohort, 81% (55/68) of the TBI animals belonged to CI+ and 19% (13/68) to CI− groups.
All experiments were approved by the Animal Ethics Committee of the Provincial Government of Southern Finland and performed in accordance with the guidelines of the European Community Council Directives 2010/63/EU.
2.2. MRI Acquisition
2.2.1. Equipment
The animals were anesthetized with isoflurane (1.5–2.5%; carrier gas comprising 70% N2, 30% O2) during MRI, ensuring that the breathing rate was maintained at 50–70 breaths/min. Their body temperature was monitored using a rectal probe and kept at 36–37 °C. Imaging was done using a 7-tesla Bruker PharmaScan MRI scanner (Bruker BioSpin MRI GmbH, Ettlingen, Germany) with a volume transmitter coil and a quadrature surface receiver coil designed for the rat head.
2.2.2. T2 MRI
Twenty-four axial slices (thickness 0.50 mm) with a resolution of 0.20 × 0.20 mm2 were imaged using a multi-slice-multi-spin-echo pulse sequence with six echoes (echo times 14.6–87.6 ms) and repetition time 3.0 s. Two signal averages were acquired. The partial Fourier-accelerated encoding matrix size was 212 × 160, and the reconstructed image matrix size was 212 × 212. The imaging time for the sequence was 16 min 5 s. The T2 relaxation time was estimated in each imaging voxel using non-linear least squares.
2.2.3. T2* MRI
The data for T2* relaxation time estimation was acquired using a multi-slice-multi-gradient-echo sequence. Twenty-four 0.50 mm-thick axial slices were acquired with a resolution of 0.15 × 0.15 mm2. Twelve equally spaced gradient echoes were acquired (echo times 4–59 ms) with a repetition time of 1.6 s and four signal averages were collected. The partial Fourier-accelerated encoding matrix size was 96 × 106, and the reconstructed image matrix size was 96 × 142. The imaging time for the sequence was 11 min 37 s.
Consecutive gradient echo images were registered to the first echo image with a rigid transformation using Advanced Normalization Tools (ANTs version 2.3.5, http://stnava.github.io/ANTs/, accessed on 6 December 2021) [24]. Then, the non-linear least squares estimation was used to estimate the T2* relaxation time in each imaging voxel by fitting a two-parameter monoexponential signal decay model (relaxation time T2*, signal intensity at zero echo time).
2.2.4. Diffusion Tensor Imaging (DTI)
Diffusion-weighted images were acquired with a three-dimensional diffusion-weighted segmented spin echo echo-planar imaging sequence. Sixty diffusion-weighted (b-value 2000 s/mm2) and four non-diffusion-weighted images were acquired at a physical resolution of 0.15 × 0.15 × 0.50 mm3. Then, after eddy current and motion correction as well as diffusion volume outlier removals, the following parameters were estimated: diffusion tensor eigenvalues (λ1, λ2, λ3), fractional anisotropy (FA), mean diffusivity (MD), radial diffusivity (RD), and Westin parameters (linear (cl), planar (cp), and spherical (cs) component of the diffusion tensor).
2.3. MRI Analysis
2.3.1. Summary
The MRI analysis is summarized in Figure 2. Briefly, convolutional neural network-based hippocampal segmentation was used to improve image registration accuracy within the hippocampi of the individual animals. Then, quantitative MRI parameter maps of each animal were transformed to the same reference space. In this reference space, each voxel within the hippocampus was projected to a location on a skeleton defining the septotemporal axis of the hippocampus. Finally, the weighted mean and standard deviation (SD) were calculated for each MRI parameter along the hippocampus.
2.3.2. Hippocampal Segmentation
Due to the presence of notable atrophy and disorientation of the hippocampi of rats with TBI, the use of conventional co-registration tools would have resulted in inaccurate registrations between the hippocampi. Therefore, a convolutional neural network, termed MU-Net-R, was trained to segment the ipsilateral (left) and contralateral (right) hippocampi of each animal at all three imaging time points (D2, D7, D21 after TBI or sham-operation). MU-Net-R, as well as its training and validation, have been described earlier [23]. MU-Net-R has been shown to produce accurate hippocampal segmentations, which are not biased by the presence of a brain injury [23]. Briefly, the individual echo images of the T2* imaging sequence were averaged to obtain anatomical images with high T2*-weighted contrast and a high signal-to-noise ratio. Then, a trained investigator (E.H) manually segmented the left (ipsilateral to the lesion) and right hippocampus from MRIs of 4 TBI and 2 sham-operated rats at each time point, generating a training set of images that was used to train MU-Net-R. MU-Net-R exhibits an encoder/decoder structure and optimizes the generalized Dice loss [25] using the RAdam optimizer [26] for training. After training, MU-Net-R segmented the hippocampi in the multi-gradient-echo images of each rat at the 3 time points.
Instead of training separate neural networks for the different imaging sequences, we used image registration to transfer the hippocampal segmentation (mask) from the T2* sequence to the T2 and DTI sequences. The three sequences were matched for slice thicknesses and locations and were imaged during the same session, allowing us to perform slice-by-slice 2D image registration. Slice-by-slice registration was chosen because it outperformed 3D registration. The slices were registered with an affine and a symmetric image normalization (SyN) registration using ANTs. Then, the segmented hippocampal masks were transformed from the T2* images to the T2 and DTI images.
Hippocampal segmentations were visually verified. Animals with clear mis-segmentations were excluded from the analysis (sham: 1/23, 4.3%; TBI: 13/114, 11%). Examples of mis-segmentations are shown in Figure S1.
2.3.3. Registration of Hippocampal Images
The hippocampal segmentations were used to create hippocampal images (i.e., images from which the signals originating from outside the hippocampus were removed) registered to the same reference space. First, a template for the sham brain was formed by registering the b0 (non-diffusion-weighted) images of the DTI scans to one of the sham animals, and subsequently, the transformed images were averaged. Then, the brain image of each animal was transformed to the template brain using an affine transformation (Figure 3A). The affine transformation was applied separately to the ipsilateral and contralateral hippocampal masks, which were registered to the corresponding hippocampal masks of the template using SyN (Figure 3B). Finally, the computed affine (brain-to-brain) and SyN (hippocampus-to-hippocampus) transformations were applied to each parametric MRI map after the removal of the contribution of non-hippocampal voxels.
Image registration accuracy was inspected visually. Animals with clear mis-registrations were excluded from the analysis (sham: 0/22, 0.0%; TBI: 3/101, 3.0%). Examples of mis-registrations are shown in Figure S2.
2.3.4. Parameter Extraction
The hippocampus was skeletonized to assess hippocampal abnormalities along its septotemporal axis [27] (Figure 4A). A pixelized midline skeleton was first formed using the MATLAB (MATLAB Release 2018b, The MathWorks, Inc., Natick, MA, USA) function “bwskel”. Equidistantly positioned pixels (spacing 1 mm) on the skeleton were selected to create a continuous, parameterized skeleton using a piecewise cubic interpolating polynomial (MATLAB function “pchip”). Each voxel within the hippocampus was projected to its nearest position on the skeleton and then spatially smoothed (Gaussian filter, full width at half maximum 1.5 mm). Using the spatially smoothed voxel weights, the weighted mean (Figure 4B) and SD (Figure 4C) along the hippocampal length were computed for each animal and MRI parameter map. Voxels near the hippocampal surface were excluded to avoid the partial volume effect. In addition, voxels that exhibited image artifacts and the most caudal imaging slices with lower signal-to-noise ratios were excluded from the analyses (for details, see Supplementary Materials Figures S3 and S4).
2.4. Statistics
2.4.1. Single-Variable Predictors
The Mann–Whitney U test (MATLAB function “ranksum”) was used to analyze whether the weighted mean or SD calculated for each MRI parameter map along the septotemporal axis of the hippocampus differed between the following groups: (a) sham and TBI, (b) TBI− (rats without epilepsy) and TBI+ (rats with epilepsy), and (c) CI− (rats without a cognitive impairment) and CI+ (rats with a cognitive impairment). The Benjamini–Hochberg procedure [28] was used to control for multiple comparisons, using an average false discovery rate of 0.05.
2.4.2. Multi-Variable Regularized Logistic Regression Analysis
We performed a multi-predictor quantitative MRI analysis along the septotemporal axis of the hippocampus after experimental TBI, which was made possible by the improved registration accuracy enabled by convolutional neural network-based hippocampal segmentations. We fitted elastic net-based regularized logistic regression models to distinguish (a) sham and TBI animals, (b) TBI− (rats without epilepsy) and TBI+ (rats with epilepsy) animals, and (c) CI− (rats with no cognitive impairment) and CI+ (rats with cognitive impairment) animals. Elastic net combines least absolute shrinkage selector operator (LASSO) and ridge regularization to reduce model overfitting by forcing the coefficients of unnecessary predictor variables towards zero. We used the MATLAB implementation of Glmnet software (version 11 March 2015) for fitting the logistic regression models (https://hastie.su.domains/glmnet_matlab/, accessed on 31 October 2019) [29,30].
At each location of the hippocampus, we included all the MRI variables (mean and SD of each MRI parameter map at each time point) as predictor variables. We chose equal weighting for LASSO and ridge regularization [31]. The observations were weighted to adjust for the class imbalance, such as the difference between the number of sham and TBI animals. Model fitting was performed by minimizing the binomial deviance within a nested (externally validated) leave-one-out cross-validation framework [32]. The value of the regularization parameter was set based on the inner cross-validation loop and the evaluation was performed in the outer cross-validation loop. We computed the cross-validated area under the receiver operating characteristic curve (AUC) as a measure of goodness-of-fit using the pooling method [33]. A 95% confidence interval for the AUC was estimated using a bias-corrected and accelerated bootstrap method with 10,000 samples.
2.4.3. Analysis of the Hippocampal Volume
For each animal and time point, the volume of the ipsilateral and the contralateral hippocampus was computed from the segmentation. The volumes of both the ipsilateral and the contralateral hippocampus at each time point were used as predictor variables in elastic net-regularized logistic regression models. The models attempted to distinguish (a) sham and TBI animals, (b) TBI− (rats without epilepsy) and TBI+ (rats with epilepsy) animals, and (c) CI− (rats with no cognitive impairment) and CI+ (rats with cognitive impairment) animals.
3. Results
3.1. Study Flow, Number of Animals, and Exclusions
Animals with missing data or poor segmentation, registration, or image quality were excluded from the analysis (sham: 8/24, 33%; TBI: 52/120, 43%) (Figure 1B). After the exclusions, 16 sham and 68 TBI animals were included in the analyses. Of the 68 TBI animals, 15 (22%) had post-traumatic epilepsy (TBI+), and 55 (81%) had cognitive impairment (CI+). Of the 15 rats with epilepsy, 12 (80%) belonged to the CI+ group. Thus, 58 of the 68 TBI animals had either epilepsy, a cognitive impairment, or both.
3.2. MRI Analysis
3.2.1. Single-Parameter Differences between the Groups
Sham vs. TBI
First, we investigated the differences in the distributions of individual MRI parameters along the septotemporal axis of the ipsilateral and contralateral hippocampus between the sham and TBI groups (Figure 5A).
We detected group differences along the ipsilateral hippocampus on all analysis days (Mann–Whitney U test, false discovery rate-corrected q < 0.05). On D2, the sham and TBI groups differed in the mean T2 and T2*. On D7, they differed in the mean T2, T2*, FA, MD, RD, λ1, λ2, λ3, cl, cp, and cs. On D21, we found group differences in the mean T2, T2*, FA, RD, λ2, cl, cp, and cs. In addition, there were differences in the SD of T2 and T2* on D2, SD of T2, T2*, FA, MD, RD, cl, λ1, λ2, λ3, and cs on D7, and SD of T2, T2*, FA, MD, RD, λ1, λ2, λ3, cl, cp, and cs on D21 (Mann–Whitney U test, false discovery rate-corrected q < 0.05).
Furthermore, along the contralateral hippocampus, we detected group differences at all three time points (Mann–Whitney U test, false discovery rate-corrected q < 0.05). On D2, the groups differed in the mean T2 and T2*. On D7, there were group differences in the mean T2, T2*, FA, λ1, λ2, cl, and cs. On D21, a group difference was found in the mean T2*, FA, cl, and cs. There were also group differences in the SD of T2* on D2, SD of FA, λ3, cl, and cs on D7, and SD of T2*, FA, cl, cp, and cs on D21.
We computed the area under the receiver-operating characteristic curve (AUC) for each parameter at a given position. In the ipsilateral hippocampus, the mean of T2 on D2 at position 2 mm from the temporal end was able to distinguish between the sham and TBI animals with an AUC value of 1.0 (95% confidence interval 1.0–1.0). In the contralateral hippocampus, the SD of FA on D21 at position 11 mm from the temporal end (being close to the septal end) differentiated between the sham and TBI animals with an AUC value of 0.84 (95% confidence interval 0.74–0.91).
Rats with (TBI+) vs. Those without (TBI−) Post-Traumatic Epilepsy
No statistically significant differences were found in the distributions of any of the single MRI parameters between the TBI− and TBI+ groups (Figure 5B) (Mann–Whitney U test, false discovery rate-corrected q > 0.05). In the ipsilateral hippocampus, the highest AUC value for distinguishing between the TBI− and TBI+ animals was 0.70 (95% confidence interval 0.52–0.83) for mean T2* at the septal end on D7. In the contralateral hippocampus, the highest AUC value was 0.71 (95% confidence interval 0.52–0.85) for SD of λ1 at the temporal pole on D21.
Rats with (CI+) vs. Those without (CI−) Cognitive Impairment
No statistically significant differences were found in the distributions of any of the single MRI parameters between CI− and CI+ groups (Figure 5C) (Mann–Whitney U test, false discovery rate-corrected q > 0.05). In the ipsilateral hippocampus, the highest AUC value for distinguishing between the CI− and CI+ animals was 0.77 (95% confidence interval 0.61–0.88) for SD of λ3 at 9.6 mm from the temporal end on D21. In the contralateral hippocampus, the highest AUC value was 0.77 (95% confidence interval 0.58–0.89) for mean cp at 5.4 mm from the temporal end on D7.
3.2.2. Regularized Logistic Regression Analysis
As single hippocampal parameters performed poorly as biomarkers for post-traumatic epilepsy or cognitive impairment, we next assessed whether a combination of parameters would achieve a better performance. We fitted elastic net-based regularized logistic regression models to distinguish (a) TBI from sham animals, (b) TBI+ from TBI− animals, and (c) CI+ from CI− animals. Cross-validated AUC values computed from the fits at different positions along the septotemporal axis of the ipsilateral and contralateral hippocampus (Figure 6A) are shown in Figure 6B.
Sham vs. TBI
A combination of parameters at positions more than 3 mm from the temporal end towards the septal end of the ipsilateral hippocampus differentiated TBI rats from sham-operated controls with an AUC value of 1.0 (95% confidence interval 1.0–1.0) (Figure 6 and Figure 7). The AUC value was high even at the temporal pole of the ipsilateral hippocampus (AUC 0.96, 95% confidence interval 0.85–0.99).
Surprisingly, the contralateral hippocampal parameters were able to differentiate between sham and TBI rats both at the temporal (AUC 0.91, 95% confidence interval 0.81–0.96) and septal ends (AUC 0.92, 95% confidence interval 0.82–0.97). Even the lowest AUC value at 3.9 mm from the temporal end of the contralateral hippocampus was moderate (AUC 0.72, 95% confidence interval 0.56–0.83).
Rats with (TBI+) vs. Those without (TBI−) Post-Traumatic Epilepsy
The hippocampal parameters did not differentiate TBI+ from TBI− rats at any location along the ipsilateral or contralateral hippocampus as the lower bound of the 95% confidence interval of the cross-validated AUC was smaller than 0.5. The highest AUC value (0.59, 95% confidence interval 0.40–0.75) was evident at the temporal end in the contralateral hippocampus.
Rats with (CI+) vs. Those without (CI−) Cognitive Impairment
In the ipsilateral hippocampus, CI+ rats could not be distinguished from CI− rats (lower bound of the 95% confidence interval of the cross-validated AUC smaller than 0.5). The highest AUC value (0.69, 95% confidence interval 0.48–0.84) was achieved at 9.1 mm from the temporal end.
In the contralateral hippocampus, however, the lower bound of the 95% confidence interval of the AUC was larger than 0.5 at 3.4, 3.9, and 5.9 mm from the temporal end of the hippocampus. This suggests that it may be possible to distinguish those rats with CI from those without any impairment. The highest AUC value (0.72, 95% confidence interval 0.55–0.84) was achieved at 3.4 mm from the temporal end.
3.2.3. Volume of the Hippocampus
The distributions of hippocampal volumes in the different groups of animals are shown in Figure S5. A regularized logistic regression model that used the ipsilateral and the contralateral hippocampal volume at each time point as predictor variables differentiated TBI from sham animals (AUC 0.99, 95% confidence interval 0.96–1.0), but could not differentiate TBI+ from TBI− rats (AUC 0.59, 95% confidence interval 0.42–0.74), nor CI+ from CI− rats (AUC 0.56, 95% confidence interval 0.38–0.74).
3.2.4. Summary of the Findings
A diagram summarizing the main findings is presented in Figure 8.
4. Discussion
The hippocampus undergoes molecular and cellular pathologies over the weeks to months after a TBI in an experimental model as well as in humans suffering this kind of injury [34]. These abnormalities have been proposed to associate with the development of PTE and cognitive impairments [16,17]. The present study was designed to test a hypothesis that acute alterations in hippocampal MRI parameters can be used as prognostic biomarkers for epileptogenesis and the evolution of the cognitive decline.
4.1. Both Ipsilateral and Contralateral Hippocampal Abnormalities Differentiate TBI Animals from Sham-Operated Controls
The contribution of hippocampal pathology to epileptogenicity can differ along the septotemporal axis in experimental models and humans with epilepsy [18,35,36,37]. The septal (posterior hippocampus in primates) rather than the temporal (anterior) hippocampus appears to be more involved in the formation of spatial memory. Furthermore, epileptogenic injuries such as TBI can affect the hippocampus bilaterally [15,17]. Therefore, we quantified T2, T2*, and DTI MRI parameters along the septotemporal axis of both the ipsilateral and the contralateral hippocampus. At various times after the injury, we examined whether it would be possible to predict if an animal would develop post-injury epileptogenesis. Therefore, we determined MRI abnormalities at both acute and subacute post-TBI time points (D2, D7, D21 post-TBI). It is during this time frame that the initial hippocampal vasogenic edema evolves and then subsides, and several secondary injury mechanisms (e.g., apoptosis, axonal injury) become activated [34].
Interestingly, TBI rats exhibited pathological MRI features in both the ipsilateral and the contralateral hippocampus when compared to the sham-operated experimental controls. On D2 after TBI, we detected increased T2 values throughout the ipsilateral hippocampus. By D7, T2 had either normalized (temporal end) or decreased (septal end). By D21, T2 in the injured rats had decreased throughout the ipsilateral hippocampus except at its temporal end. This is indicative of the presence of vasogenic edema within the first days after TBI and its resolution thereafter. The decreased T2 values at D7 and D21 also suggest a reduced free water pool, possibly due to increased cellularity, or increased susceptibility differences due to iron accumulation.
We did not acquire diffusion data on D2 as we were worried about increased mortality at this early post-TBI time-point related to the lengthy anesthesia required in this imaging modality. On D7, mean diffusivity was increased throughout the septotemporal axis of the ipsilateral hippocampus, and returned to normal by D21. This could be a sign of the presence of cytotoxic edema still on D7 that had resolved by D21. The mean or variance of FA was decreased over distances of 1–5 mm from the septal end on D7; this is suggestive of interneuron loss [15,17]. On D21, the linear component of the diffusion tensor had decreased, and the planar component increased in the septal end of the ipsilateral hippocampus. This might reflect the emergence of differently oriented fibers, for example due to axonal sprouting, which shifted the mode of anisotropy from linear to planar in each imaging voxel [38].
An analysis of the contralateral hippocampus also demonstrated the presence of pathological features, which were, however, less pronounced than in the ipsilateral region. For example, on D7, we observed decreased T2 at the septal end. As speculated above for the ipsilateral hippocampus, this could be attributable to increased cellularity or the presence of iron or calcium accumulation. On D21, we observed decreased FA, a reduced linear diffusion component (cl), and increased spherical diffusion component (cs) at the septal end. These findings point to some degree of interneuron loss as observed in earlier studies [15,17]. The findings also suggest that—unlike in the ipsilateral hippocampus—there was no substantial axonal sprouting.
As revealed in the regularized logistic regression analysis, quantitative MRI was effective at distinguishing between sham and TBI rats, especially in the ipsilateral hippocampus. Interestingly, this technique also detected the presence of TBI-induced damage in the contralateral hippocampus; however, this was subtle, as indicated by the only slight differences in the individual MRI parameters between the sham and TBI rats. Importantly, in most cases, our multivariable regularized logistic regression analysis was able to distinguish between sham and TBI.
4.2. Contralateral Hippocampal Abnormalities Display a Moderate Performance in Differentiating Cognitively Impaired Animals from Those without a Cognitive Impairment
In the present animal cohort, 81% of the rats were cognitively impaired and 19% did not display any signs of cognitive impairment at 37 days after TBI as assessed using a cut-off point of 19.2 sec to find the hidden platform in the Morris water maze test. Interestingly, the multivariable regularized logistic regression MRI analysis along the septotemporal axis of the contralateral hippocampus distinguished between the cognitively impaired TBI rats and the animals with normal cognitive functioning. This finding agrees with previous studies that rats exhibited an impaired Morris water maze performance after a lateral FPI [14,15,39,40]. The impairment was already evident on D2 after the injury [14] and endured for up to one year [39]. This disturbed performance was related to both impaired learning as well as to memory retention [40]. In previous studies, impaired Morris water maze performance has been associated with hilar neuronal cell loss both in the ipsilateral and contralateral hippocampus [14,15].
Unexpectedly, MRI analysis of the contralateral but not the ipsilateral hippocampus differentiated between the TBI rats with and those without a cognitive impairment. However, the lower bounds of the 95% confidence interval of the ROC AUC values were close to being higher than 0.5 at the septal end of the ipsilateral hippocampus. The apparent failure of ipsilateral septal hippocampal damage to impact on the animals’ performance in the water maze could be related to the small sample size.
4.3. Hippocampal Abnormalities Do Not Differentiate Epileptic from Non-Epileptic Animals
The hippocampus has been claimed to be involved in epileptogenesis and ictogenesis in human patients and also in animal models of epilepsy [16,41]. We investigated whether our quantitative MRI analysis along the septotemporal axis of the hippocampus could identify the rats that would or would not develop post-traumatic epilepsy after a TBI. Although prior studies have associated pathological hippocampal features with post-traumatic epileptogenesis [18,41,42], neither individual MRI parameters nor regularized logistic regression models utilizing these parameters could identify the rats that would develop post-traumatic epileptogenesis.
4.4. Methodological Considerations
Progressively expanding abnormalities in internal structure, shape, and orientation of the hippocampus after lateral FPI complicate the image registration of the specific intrahippocampal subfields (dentate gyrus, CA3, CA2, CA1). This could have been further exacerbated by the low 0.5-mm rostral–caudal image resolution used. Therefore, we analyzed MRI measures in cross-sectional slices rather than in different hippocampal subfields along the septotemporal axis of the hippocampus. Consequently, based on the shape of the segmented hippocampi, we considered the gross hippocampus-to-hippocampus image registration to be sufficiently accurate.
An analysis of MRI hippocampal subfield abnormalities could help to detect associations between post-TBI abnormalities and epileptogenesis and/or cognitive impairment. However, this kind of approach would work best in those cases in which there was negligible hippocampal atrophy such as mild TBI. In the presence of substantial hippocampal atrophy, accurate segmentation or image registration of hippocampal subfields requires high image resolution and good contrast between the different subfields.
Our analysis included MRI data acquired between 2 and 21 days after TBI, i.e., the optimal time period for the initiation and progression of secondary pathologies [34]. However, as the exact time of post-traumatic epileptogenesis remains to be determined, an analysis of hippocampal MRI parameters at more chronic post-TBI time points could produce valuable information for predicting the emergence of epilepsy.
5. Conclusions
After an experimental TBI, quantitative multiparametric MRI of the hippocampus can be used to differentiate rats that will develop cognitive impairments from those that will remain cognitively normal. The prognostic biomarker parameter set could be used to enrich a study cohort for interventions aimed at restoring memory functions. However, the analysis could not differentiate between the rats that would develop post-traumatic epilepsy and those not showing evidence of late spontaneous seizures.
Acknowledgments
We thank Jarmo Hartikainen for his excellent technical help. We thank Niina Lapinlampi for managing the database. Part of the work was carried out with the support of Kuopio Biomedical Imaging Unit, University of Eastern Finland, Kuopio, Finland (part of Biocenter Kuopio, Finnish Biomedical Imaging Node, and EuroBioImaging).
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/biomedicines10112721/s1, Supplementary methods; Figure S1: Examples of exclusions due to poor hippocampal segmentation; Figure S2: Exclusions due to poor image registration results; Figure S3: Hippocampal outlining and artefact removal; Figure S4: Examples of image artefact removal in the hippocampus; Figure S5: Volume of the hippocampus in the different groups of animals.
Author Contributions
Conceptualization, A.P., O.G. and A.S.; methodology, E.M., R.D.F., J.T., O.G. and A.P.; software, E.M., R.D.F., P.A. and T.P.; formal Analysis, E.M., P.A. and T.P.; investigation, E.M., K.C., E.H. and P.A.; resources, O.G., A.P.; writing—original draft preparation, E.M. and A.P.; writing—review & editing, J.T. and O.G.; visualization, E.M.; supervision, O.G. and A.P.; project administration, A.P.; funding acquisition, A.P., O.G. and A.S. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
All experiments were approved by the Animal Ethics Committee of the Provincial Government of Southern Finland (ESAVI/5146/04.10.07/2014, 19.6.2014) and performed in accordance with the guidelines of the European Community Council Directives 2010/63/EU.
Informed Consent Statement
Not applicable.
Data Availability Statement
The data presented in this study are available on request from the corresponding author.
Conflicts of Interest
The authors declare no conflict of interest.
Funding Statement
This research was supported by the European Union’s Seventh Framework Programme (FP7/2007-2013) under grant agreement n°602102 (EPITARGET)(AP), the Academy of Finland (AP: Grants 272249, 273909, and 2285733-9; AS: Grants 275453, 284544, and 312686; JT: Grant 316258; OG: Grant 298007), the National Institute of Neurological Disorders and Stroke (NINDS) Center without Walls of the National Institutes of Health (NIH) under award U54NS100064 (EpiBioS4Rx)(AP), the Sigrid Jusélius Foundation (AP), and the Alfred Kordelin Foundation (EM: Grant 200276).
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Maas A.I.R., Menon D.K., Adelson P.D., Andelic N., Bell M.J., Belli A., Bragge P., Brazinova A., Büki A., Chesnut R.M., et al. Traumatic brain injury: Integrated approaches to improve prevention, clinical care, and research. Lancet Neurol. 2017;16:987–1048. doi: 10.1016/S1474-4422(17)30371-X. [DOI] [PubMed] [Google Scholar]
- 2.Dewan M.C., Rattani A., Gupta S., Baticulon R.E., Hung Y.-C., Punchak M., Agrawal A., Adeleye A.O., Shrime M.G., Rubiano A.M., et al. Estimating the global incidence of traumatic brain injury. J. Neurosurg. 2019;130:1080–1097. doi: 10.3171/2017.10.JNS17352. [DOI] [PubMed] [Google Scholar]
- 3.Xu T., Yu X., Ou S., Liu X., Yuan J., Huang H., Yang J., He L., Chen Y. Risk factors for posttraumatic epilepsy: A systematic review and meta-analysis. Epilepsy Behav. 2017;67:1–6. doi: 10.1016/j.yebeh.2016.10.026. [DOI] [PubMed] [Google Scholar]
- 4.Semple B.D., Zamani A., Rayner G., Shultz S.R., Jones N.C. Affective, neurocognitive and psychosocial disorders associated with traumatic brain injury and post-traumatic epilepsy. Neurobiol. Dis. 2019;123:27–41. doi: 10.1016/j.nbd.2018.07.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Saletti P., Ali I., Casillas-Espinosa P.M., Semple B.D., Lisgaras C.P., Moshe S., Galanopoulou A.S. In search of antiepileptogenic treatments for post-traumatic epilepsy. Neurobiol. Dis. 2019;123:86–99. doi: 10.1016/j.nbd.2018.06.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Ng S.Y., Lee A.Y.W. Traumatic Brain Injuries: Pathophysiology and Potential Therapeutic Targets. Front. Cell. Neurosci. 2019;13:528. doi: 10.3389/fncel.2019.00528. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Engel J. Epileptogenesis, traumatic brain injury, and biomarkers. Neurobiol. Dis. 2019;123:3–7. doi: 10.1016/j.nbd.2018.04.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Fagan A.J., Bitz A.K., Björkman-Burtscher I.M., Collins C.M., Kimbrell V., Raaijmakers A.J.E. 7T MR Safety. J. Magn. Reson. Imaging. 2021;53:333–346. doi: 10.1002/jmri.27319. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Agoston D.V., Vink R., Helmy A., Risling M., Nelson D., Prins M. How to translate time: The temporal aspects of rodent and human pathobiological processes in traumatic brain injury. J. Neurotrauma. 2019;36:1724–1737. doi: 10.1089/neu.2018.6261. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Reddy S.D., Younus I., Sridhar V., Reddy D.S. Neuroimaging Biomarkers of Experimental Epileptogenesis and Refractory Epilepsy. Int. J. Mol. Sci. 2019;20:220. doi: 10.3390/ijms20010220. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Garner R., La Rocca M., Vespa P., Jones N., Monti M.M., Toga A.W., Duncan D. Imaging biomarkers of posttraumatic epileptogenesis. Epilepsia. 2019;60:2151–2162. doi: 10.1111/epi.16357. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Thompson H.J., Lifshitz J., Marklund N., Grady M.S., Graham D.I., Hovda D.A., McIntosh T.K. Lateral fluid percussion brain injury: A 15-year review and evaluation. J. Neurotrauma. 2005;22:42–75. doi: 10.1089/neu.2005.22.42. [DOI] [PubMed] [Google Scholar]
- 13.Kharatishvili I., Nissinen J.P., McIntosh T.K., Pitkänen A. A model of posttraumatic epilepsy induced by lateral fluid-percussion brain injury in rats. Neuroscience. 2006;140:685–697. doi: 10.1016/j.neuroscience.2006.03.012. [DOI] [PubMed] [Google Scholar]
- 14.Smith D.H., Okiyama K., Thomas M.J., Claussen B., McIntosh T.K. Evaluation of Memory Dysfunction Following Experimental Brain Injury Using the Morris Water Maze. J. Neurotrauma. 1991;8:259–269. doi: 10.1089/neu.1991.8.259. [DOI] [PubMed] [Google Scholar]
- 15.Smith D.H., Lowenstein D.H., Gennarelli T.A., McIntosh T.K. Persistent memory dysfunction is associated with bilateral hippocampal damage following experimental brain injury. Neurosci. Lett. 1994;168:151–154. doi: 10.1016/0304-3940(94)90438-3. [DOI] [PubMed] [Google Scholar]
- 16.Klein P., Dingledine R., Aronica E., Bernard C., Blümcke I., Boison D., Brodie M.J., Brooks-Kayal A.R., Engel J., Jr., Forcelli P.A., et al. Commonalities in epileptogenic processes from different acute brain insults: Do they translate? Epilepsia. 2018;59:37–66. doi: 10.1111/epi.13965. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Lowenstein D.H., Thomas M.J., Smith D.H., McIntosh T.K. Selective vulnerability of dentate hilar neurons following traumatic brain injury: A potential mechanistic link between head trauma and disorders of the hippocampus. J. Neurosci. 1992;12:4846–4853. doi: 10.1523/JNEUROSCI.12-12-04846.1992. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Shultz S.R., Cardamone L., Liu Y.R., Hogan R.E., Maccotta L., Wright D.K., Zheng P., Koe A., Gregoire M.-C., Williams J.P., et al. Can structural or functional changes following traumatic brain injury in the rat predict epileptic outcome? Epilepsia. 2013;54:1240–1250. doi: 10.1111/epi.12223. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Kharatishvili I., Shan Z.Y., She D.T., Foong S., Kurniawan N.D., Reutens D.C. MRI changes and complement activation correlate with epileptogenicity in a mouse model of temporal lobe epilepsy. Brain Struct. Funct. 2014;219:683–706. doi: 10.1007/s00429-013-0528-4. [DOI] [PubMed] [Google Scholar]
- 20.Filibian M., Frasca A., Maggioni D., Micotti E., Vezzani A., Ravizza T. In vivo imaging of glia activation using 1H-magnetic resonance spectroscopy to detect putative biomarkers of tissue epileptogenicity. Epilepsia. 2012;53:1907–1916. doi: 10.1111/j.1528-1167.2012.03685.x. [DOI] [PubMed] [Google Scholar]
- 21.Pascente R., Frigerio F., Rizzi M., Porcu L., Boido M., Davids J., Zaben M., Tolomeo D., Filibian M., Gray W.P., et al. Cognitive deficits and brain myo-Inositol are early biomarkers of epileptogenesis in a rat model of epilepsy. Neurobiol. Dis. 2016;93:146–155. doi: 10.1016/j.nbd.2016.05.001. [DOI] [PubMed] [Google Scholar]
- 22.Lapinlampi N., Andrade P., Paananen T., Hämäläinen E., Ndode-Ekane X.E., Puhakka N., Pitkänen A. Postinjury weight rather than cognitive or behavioral impairment predicts development of posttraumatic epilepsy after lateral fluid-percussion injury in rats. Epilepsia. 2020;61:2035–2052. doi: 10.1111/epi.16632. [DOI] [PubMed] [Google Scholar]
- 23.De Feo R., Hämäläinen E., Manninen E., Immonen R., Valverde J.M., Ndode-Ekane X.E., Gröhn O., Pitkänen A., Tohka J. Convolutional Neural Networks Enable Robust Automatic Segmentation of the Rat Hippocampus in MRI After Traumatic Brain Injury. Front. Neurol. 2022;13:820267. doi: 10.3389/fneur.2022.820267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Avants B.B., Tustison N.J., Song G., Cook P.A., Klein A., Gee J.C. A reproducible evaluation of ANTs similarity metric performance in brain image registration. NeuroImage. 2011;54:2033–2044. doi: 10.1016/j.neuroimage.2010.09.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Sudre C.H., Li W., Vercauteren T., Ourselin S., Jorge Cardoso M. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support. Volume 10553. Springer; Cham, Switzerland: 2017. Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations; pp. 240–248. Lecture Notes in Computer Science. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Liu L., Jiang H., He P., Chen W., Liu X., Gao J., Han J. On the Variance of the Adaptive Learning Rate and Beyond. arXiv. 2019 doi: 10.48550/ARXIV.1908.03265.1908.03265 [DOI] [Google Scholar]
- 27.Lee T.C., Kashyap R.L., Chu C.N. Building Skeleton Models via 3-D Medial Surface Axis Thinning Algorithms. CVGIP Graph. Model. Image Process. 1994;56:462–478. doi: 10.1006/cgip.1994.1042. [DOI] [Google Scholar]
- 28.Benjamini Y., Hochberg Y. Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. J. R. Stat. Soc. B. 1995;57:289–300. doi: 10.1111/j.2517-6161.1995.tb02031.x. [DOI] [Google Scholar]
- 29.Zou H., Hastie T. Regularization and variable selection via the elastic net. J. R. Stat. Soc. B. 2005;67:301–320. doi: 10.1111/j.1467-9868.2005.00503.x. [DOI] [Google Scholar]
- 30.Friedman J., Hastie T., Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 2010;33:1–22. doi: 10.18637/jss.v033.i01. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Tohka J., Moradi E., Huttunen H., Alzheimer’s Disease Neuroimaging Initiative Comparison of feature selection techniques in machine learning for anatomical brain MRI in dementia. Neuroinformatics. 2016;14:279–296. doi: 10.1007/s12021-015-9292-3. [DOI] [PubMed] [Google Scholar]
- 32.Ambroise C., McLachlan G.J. Selection bias in gene extraction on the basis of microarray gene-expression data. Proc. Natl. Acad. Sci. USA. 2002;99:6562–6566. doi: 10.1073/pnas.102102699. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Bradley A.P. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognit. 1997;30:1145–1159. doi: 10.1016/S0031-3203(96)00142-2. [DOI] [Google Scholar]
- 34.Bramlett H.M., Dietrich W.D. Long-term consequences of traumatic brain injury: Current status of potential mechanisms of injury and neurological outcomes. J. Neurotrauma. 2015;32:1834–1848. doi: 10.1089/neu.2014.3352. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Lutkenhoff E.S., Shrestha V., Tejeda J.R., Real C., McArthur D.L., Duncan D., La Rocca M., Garner R., Toga A.W., Vespa P.M., et al. Early brain biomarkers of post-traumatic seizures: Initial report of the multicentre epilepsy bioinformatics study for antiepileptogenic therapy (EpiBioS4Rx) prospective study. J. Neurol. Neurosurg. Psychiatry. 2020;91:1154–1157. doi: 10.1136/jnnp-2020-322780. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Dedeurwaerdere S., Fang K., Chow M., Shen Y.-T., Noordman I., van Raay L., Faggian N., Porritt M., Egan G., O’Brien T. Manganese-enhanced MRI reflects seizure outcome in a model for mesial temporal lobe epilepsy. NeuroImage. 2013;68:30–38. doi: 10.1016/j.neuroimage.2012.11.054. [DOI] [PubMed] [Google Scholar]
- 37.Amhaoul H., Hamaide J., Bertoglio D., Reichel S.N., Verhaeghe J., Geerts E., Van Dam D., De Deyn P.P., Kumar-Singh S., Katsifis A., et al. Brain inflammation in a chronic epilepsy model: Evolving pattern of the translocator protein during epileptogenesis. Neurobiol. Dis. 2015;82:526–539. doi: 10.1016/j.nbd.2015.09.004. [DOI] [PubMed] [Google Scholar]
- 38.Parekh M.B., Carney P.R., Sepulveda H., Norman W., King M., Mareci T.H. Early MR diffusion and relaxation changes in the parahippocampal gyrus precede the onset of spontaneous seizures in an animal model of chronic limbic epilepsy. Exp. Neurol. 2010;224:258–270. doi: 10.1016/j.expneurol.2010.03.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Pierce J.E.S., Smith D.H., Trojanowski J.Q., McIntosh T.K. Enduring cognitive, neurobehavioral and histopathological changes persist for up to one year following severe experimental brain injury in rats. Neuroscience. 1998;87:359–369. doi: 10.1016/S0306-4522(98)00142-0. [DOI] [PubMed] [Google Scholar]
- 40.Thompson H.J., LeBold D.G., Marklund N., Morales D.M., Hagner A.P., McIntosh T.K. Cognitive evaluation of traumatically brain-injured rats using serial testing in the Morris water maze. Restor. Neurol. Neurosci. 2006;24:109–114. [PMC free article] [PubMed] [Google Scholar]
- 41.Gupta P.K., Sayed N., Ding K., Agostini M.A., Van Ness P.C., Yablon S., Madden C., Mickey B., D’Ambrosio R., Diaz-Arrastia R. Subtypes of Post-Traumatic Epilepsy: Clinical, Electrophysiological, and Imaging Features. J. Neurotrauma. 2014;31:1439–1443. doi: 10.1089/neu.2013.3221. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Vespa P.M., McArthur D.L., Xu Y., Eliseo M., Etchepare M., Dinov I., Alger J., Glenn T.P., Hovda D. Nonconvulsive seizures after traumatic brain injury are associated with hippocampal atrophy. Neurology. 2010;75:792–798. doi: 10.1212/WNL.0b013e3181f07334. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data presented in this study are available on request from the corresponding author.