Abstract
No single neuroimaging technique or sequence is capable of reflecting the functional deficits manifest in MS. Given the interest in imaging biomarkers for short- to medium-term studies, we aimed to assess which imaging metrics might best represent functional impairment for monitoring in clinical trials. Given the complexity of functional impairment in MS, however, it is useful to isolate a particular functionally relevant pathway to understand the relationship between imaging and neurological function. We therefore analyzed existing data, combining multiparametric MRI and OCT to describe MS associated visual impairment. We assessed baseline data from fifty MS patients enrolled in ReBUILD, a prospective trial assessing the effect of a remyelinating drug (clemastine). Subjects underwent 3T MRI imaging, including Neurite Orientation Dispersion and Density Imaging (NODDI), myelin content quantification, and retinal imaging, using OCT. Visual function was assessed, using low-contrast letter acuity. MRI and OCT data were studied to model visual function in MS, using a partial, least-squares, regression analysis. Measures of neurodegeneration along the entire visual pathway, described most of the observed variance in visual disability, measured by low contrast letter acuity. In those patients with an identified history of ON, however, putative myelin measures also showed correlation with visual performance. In the absence of clinically identifiable inflammatory episodes, residual disability correlates with neurodegeneration, whereas after an identifiable exacerbation, putative measures of myelin content are additionally informative.
Introduction
Functional impairment can take a long time to manifest in multiple sclerosis (MS) [1, 2]. Shorter-term clinical trials are needed to assess therapeutic efficacy over reasonable time scales. Imaging methods have been employed for this purpose [3, 4], but the correlation between imaging metrics and functional impairment remains uncertain and the specific imaging techniques that are best suited for measurement have not yet been defined [5, 6]. This is particularly important for investigations of neuroprotective and reparative therapies.
The visual pathway is anatomically well defined and functionally discrete, with well-validated measures that are both quantifiable and reliable. For these reasons, the visual pathway has long been used as a model for understanding pathological processes (e.g. inflammation, demyelination, and neurodegeneration) that underlie neurological dysfunction in the disease [7, 8].
ReBUILD, a double-blind, placebo-controlled trial, demonstrated the effectiveness of clemastine fumarate in improving visual-evoked, potential latency and visual function [9]. To further explore the relationship between imaging and function, and in particular to overcome the mismatch between conventional MRI and clinical deficit in MS [6], we performed an analysis based on optical coherence tomography (OCT) and advanced MRI assessments from the baseline assessment of the ReBUILD trial cohort [9]. To describe visual impairment in MS, we specifically implemented a multimodal approach, combining OCT and novel MRI techniques capable of estimating both metrics for myelin content, such as myelin water fraction (MWF) [10, 11] and metrics for neurite organization (neurite density (NDI) and orientation dispersion indexes (ODI)) [12].
Methods
Subjects and clinical evaluation
Fifty relapse-remitting (RRMS) patients underwent baseline assessments as part of the ReBUILD trial prior to the initiation of treatment (32 females, average age of 40.1 years ± 10.3 SD, median EDSS 2.0 (range 0 to 5.5), and median disease duration of 3.2 years (range 0.4 to 30.4). Either a clinically evident, optic neuritis that had occurred within 6 months before screening or more than 5 years prior to enrollment in the qualifying eye for the Rebuild study was an exclusion criterion. For the purpose of this study we considered all patients’ eyes for which data was available, including those eyes with ON older than 5 years (i.e. eyes that were not basis for qualification in the study). Visual impairment was measured by low contrast letter acuity (LCLA; Sloan 2.5% low contrast vision chart; Precision Vision, La Salle, IL, USA). The single eye measures were averaged with the fellow eye ones to have a single value for each patient. The study was approved by the UCSF Institutional Review Board and all participants provided informed consent. The trial was registered at ClinicalTrials.gov (number NCT02040298) before initiation of patient enrolment. All research was performed in accordance with relevant guidelines/regulations.
MRI acquisition
Each subject underwent brain MRI acquisitions on a 3T Siemens Skyra scanner. The MRI protocol included standard sagittal T1-weigthed, 3D MPRAGE (1 mm3 cubic voxel), a two-shell, neurite-orientation dispersion and density imaging (NODDI) [12] protocol (30 & 64 directions at b = 700 & 2000 s/mm2, 2.2 mm3 cubic voxel) and a multi-echo gradient-echo (MEGE) sequence for myelin content quantification [10, 11]. Details of the MRI protocol were previously reported [9].
MRI analysis
Automated parcellation of T1-weighted volumes was performed using Freesurfer Image Analysis Suite Version 5.6. Total cortex, primary visual area (V1, Brodman area 17), thalami and cerebellar cortex were parcellated as volumes of interest (VOIs) from T1-weigthed, 3D MPRAGE image (Fig 1) [13–15]. Computed volumes were normalized by intracranial volume. Optic radiation (OR) VOIs were obtained from the JHU DTI-based (MNI space) white-matter atlases [16] and co-registered to the single subject space using linear and nonlinear transformations (FLIRT/FNIRT) [17, 18]. After correcting for distortions due to eddy current and head motion, maps of mean diffusivity (MD) were calculated by fitting the diffusion tensor model within each voxel, using dipy fit tensor [19]. The NODDI model was fitted to the diffusion datasets in MATLAB (http://mig.cs.ucl.ac.uk/Tutorial.NODDImatlab) and maps of ODI were therefore computed [12]. MEGE data were instead processed to obtain quantification of the MWF [10, 11]. MD, ODI and MWF maps were co-registered to T1 space, using linear and nonlinear transformations (FLIRT/FNIRT) [17, 18]. The mean value of each MRI metric was calculated for each VOI (V1, thalami and cerebellar cortex) averaging left and right hemispheres.
Lesion burden
An expert neuroradiologist (EC) assessed the number of occipital cortical lesions and also segmented the total white-matter-lesion burden within the OR, using the available FLAIR and T1-weigthed 3D MPRAGE images. We confirmed the location of lesions by using occipital lobes masks derived by Freesurfer and JHU DTI-based OR registered in the single subject space.
OCT
Retinal imaging was performed using spectral-domain OCT (Heidelberg Engineering, Heidelberg, Germany, eye explorer software version 1.9.10.0) as previously described [7]. Peripapillary, retinal-nerve-fiber-layer (pRNFL) thickness and macular volume (MV) were obtained. Intra-retinal-layer segmentation was executed to quantify the Ganglion Cell Layer (GCL) through the Viewing Module 6.0. We followed the APOSTEL guidelines for reporting OCT studies (see S1 and S2 Tables) [20].
Statistical analysis
Using a two-tailed t-test, we tested comparisons of demographic characteristics between ON negative and ON positive groups. To describe the variability in MS-associated visual impairment (LCLA), we performed a PLS to model baseline LCLA. using demographic (age at disease onset, and at MRI), MRI (normalized volumes, MD, myelin, ODI) and OCT metrics (GCL, pRNFL, MV), separately considering negative and positive history of ON. The significance of each predictor was established once the “Variable Importance in the Projection” (VIP) parameter was greater than 0.8 [21]. Random-forest approach was also used to test the reliability of the variable selected in the model. K-fold, cross-validation analysis was performed to test the reliability of each identified model by 4-fold cross-validation with 100 repeats between least absolute shrinkage and selection operator (LASSO) and PLS. The predictive accuracy was measured by root-mean-square error (RMSE) on both training data and test data. Model selection, using PLS has the advantage of avoiding co-linearity-related data inflation, although this approach lacks an efficient method for subset selection. LASSO was therefore applied to confirm the importance of the identified variables.
Results
Twenty-eight patients had a prior history of optic neuritis (ON), whereas 22 did not. Demographic and clinical characteristics are reported in Table 1. LCLA scores for the 2 groups (22.9±10.1 and 23.1±9.2) were lower than the LCLA values for healthy controls in literature (45.48±11.22) [22]. There was a difference in age between the ON negative and ON positive groups (p <0.05). MRI and OCT metrics data are reported in S1 Table.
Table 1. Demographic and clinical characteristics of the groups with negative and positive history of optic neuritis (ON).
ON negative history group | ON positive history group | |
---|---|---|
N# | 22 | 28 |
Age | 43.9 (9.7) | 37.1 (9.9) |
Sex | 14 F (64%) | 18 F (64%) |
Disease duration (years) | 3.5 (0.7 to 14.2) | 2.9 (0.45 to 30.4) |
Time from ON (years) | / | 3.0 (0.2 to 15.8) |
EDSS | 2.0 ± (0 to 5.5) | 2.0 (0 to 4) |
LCLA | 22.9 (10.1) | 23.1 (9.2) |
VEP | 125.7 (8.6) | 129.0 (11.4) |
Demographic data, LCLA abd VEP are reported as mean (SD) or n (%). Disease duration, time from ON and EDSS are reported at median (range).
Using partial least squares regression analysis (PLS), we identified model predictors of LCLA with R-squared values up to 0.43 and 0.39 with or without ON respectively (Table 2). GCL proved to be the best OCT-related, partial predictor in particularly in cases of a negative history of ON (Variable Importance in the Projection (VIP) = 1.12 and 0.84 without and with previous ON, respectively) (S1 and S2 Tables). Lesion burden and OCT metrics appeared to be more informative for patients with no history of ON. Measures of cortical neurodegeneration seemed equally informative in both negative and positive history of optic neuritis, contributing to clinical disability. Thalamic volume was more informative in patients without ON. Measures of myelin content (MWF) within the OR and thalamus instead gained importance when we evaluated patients with ON. A random-forest approach confirmed all variables of the two models except for the whole-brain, cortical, gray matter in the ON positive history model.
Table 2. Schematic representations of the LCLA model results in subjects with negative and positive history of optic neuritis.
LCLA MODEL | Variable | VIP | Scale Coefficient | |
---|---|---|---|---|
LCLA IN NEGATIVE HISTORY OF ON | R squared 42.8 | GCL | 1.12 | 0.2364 |
OR lesion volume | 1.01 | -0.2123 | ||
pRNFL | 1.00 | 0.2105 | ||
Thalamic volumes | 0.93 | 0.1961 | ||
V1 volume | 0.92 | 0.1929 | ||
LCLA IN POSITIVE HISTORY OF ON | R squared 39.3 | Thalamic MWF | 1.19 | 0.22 |
OR MWF | 1.11 | 0.21 | ||
Cortical GM volume | 0.96 | 0.18 | ||
V1 volume | 0.86 | -0.16 | ||
GCL | 0.84 | 0.16 |
We reported the R squared of each model. The significance of each variable selected by PLS is reported as “Variable Importance in the Projection” (VIP). The scale coefficient, representative of the effect size for each variable, is also shown. ON = optic neuritis; MWF = myelin water fraction; GCL = Ganglion Cell Layer; OR = optic radiation; pRNFL = peripapillary retinal nerve fiber layer; GM = gray matter.
Model cross-validation analysis
PLS models showed low RMSE variability on both training data and test data, suggesting that they yielded stable predictions. Among the two PLS models, 9 out of 10 predictors selected by PLS also survived in the LASSO models’ subset selection.
Discussion
Evaluating the ReBUILD baseline data set, we identified MRI and OCT metrics-based models that showed a strong correlation with visual performance and demonstrated good reliability. Our results employ a more complete analysis of a single pathway because of the depth of data acquisition, the focus on myelin metrics and the capacity to assess structural injury to the visual system.
These data indicate that in patients with a history of ON, myelin loss is the main contributor to clinical, visual disability in MS. In this group, both MRI markers for putative myelin content (MWF) and neurodegeneration are significantly associated with visual function. By contrast, in patients without prior episodes of optic neuritis, axonal neurodegeneration appears to be responsible for most of the clinical disability, together with white matter lesions within the optic radiations.
There are different potential explanations for these observations. One is that separate processes underlie neurodegeneration and myelin damage; i.e. there is a degenerative process acting in MS that is independent of myelin loss. Alternatively, myelin loss and neuroaxonal loss could be time-disassociated (i.e. neurodegeneration may follow myelin loss by a prolonged period—even years - and therefore functional impairment from an asymptomatic episode in the more distant past may be more likely to be related to neuroaxonal loss). The differences between the models might also be due to damage in the posterior pathway (OR lesions, V1 neurodegeneration), contributing to visual disability particularly in patients without ON.
The strength of our models is their demonstrated robustness. A weakness of our study, however, is that some of the data may have been influenced by the criteria for inclusion in the clinical trial [9]. For example, patients with mild visual disability or dysfunction were likely excluded.
We attempted to address limitations related to sample size and lack of an independent dataset for validation by using a nested cross-validation of the identified models. The size of the cohort also forced us to select a subset of the available MRI metrics before performing our analysis to minimize the risk of redundancy (e.g. using diffusion MRI ODI versus fractional anisotropy). This means that other similar metrics may perform similarly or better in future cohorts evaluating the same outcomes. Our failure to identify GM lesion burden as a meaningful factor might also be due to the study design that did not include dedicated cortical MRI sequences [23] and therefore resulted in poor sensitivity in detecting cortical lesions [24]. In order to be applied in observational and clinical studies, the obtained predictive models need to be replicated in larger populations.
In conclusion, we have demonstrated that combinations of advanced multiparametric MRI sequences within the visual network and OCT correlate with visual performance, adding to our understanding of the underlying pathological mechanisms responsible for clinical dysfunction. These measures should be candidates for observational and clinical studies in the visual pathways in MS, as our field shifts its focus on regenerative medicine.
Supporting information
Data Availability
All relevant data are within the manuscript and its Supporting Information files.
Funding Statement
Author CC was supported by a Training Fellowship FISM (Fondazione Italiana Sclerosi Multipla) - Cod. 2013/B/4. AB received travel fees from Actelion and speaker fees from Biogen, and has received research support from the Freiwillige Akademische Gesellschaft, Switzerland, and the Gottfried and Julia Bangerter-Rhyner Stiftung, Switzerland. JMG received research support via UCSF from Genentech for a clinical trial and consulting for Biogen and Alexion. In the past 36 months, BACC has received personal compensation for consulting from Akili, Alexion, Atara, Biogen, EMD Serono, Novartis, Sanofi and TG Therapeutics. SLH was supported by funding from the National Institute of Neurological Disorders and Stroke (R35NS111644) and the Valhalla Foundation. AJG was supported by funding from University of California, San Francisco and the Rachleff Family. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.
References
- 1.Cerqueira JJ, Compston DAS, Geraldes R, Rosa MM, Schmierer K, Thompson A, et al. Time matters in multiple sclerosis: can early treatment and long-term follow-up ensure everyone benefits from the latest advances in multiple sclerosis? J Neurol Neurosurg Psychiatry. 2018;89: 844–850. 10.1136/jnnp-2017-317509 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.University of California, San Francisco MS‐EPIC Team, Cree BAC, Hollenbach JA, Bove R, Kirkish G, Sacco S, et al. Silent progression in disease activity–free relapsing multiple sclerosis. Ann Neurol. 2019;85: 653–666. 10.1002/ana.25463 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Comi G, Jeffery D, Kappos L, Montalban X, Boyko A, Rocca MA, et al. Placebo-Controlled Trial of Oral Laquinimod for Multiple Sclerosis. N Engl J Med. 2012;366: 1000–1009. 10.1056/NEJMoa1104318 [DOI] [PubMed] [Google Scholar]
- 4.Fox RJ, Coffey CS, Conwit R, Cudkowicz ME, Gleason T, Goodman A, et al. Phase 2 Trial of Ibudilast in Progressive Multiple Sclerosis. N Engl J Med. 2018;379: 846–855. 10.1056/NEJMoa1803583 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Filippi M. MRI measures of neurodegeneration in multiple sclerosis: implications for disability, disease monitoring, and treatment. J Neurol. 2015;262: 1–6. 10.1007/s00415-014-7340-9 [DOI] [PubMed] [Google Scholar]
- 6.Barkhof F. The clinico-radiological paradox in multiple sclerosis revisited. Curr Opin Neurol. 2002;15: 239–245. 10.1097/00019052-200206000-00003 [DOI] [PubMed] [Google Scholar]
- 7.Martinez-Lapiscina EH, Arnow S, Wilson JA, Saidha S, Preiningerova JL, Oberwahrenbrock T, et al. Retinal thickness measured with optical coherence tomography and risk of disability worsening in multiple sclerosis: a cohort study. Lancet Neurol. 2016;15: 574–584. 10.1016/S1474-4422(16)00068-5 [DOI] [PubMed] [Google Scholar]
- 8.Martínez-Lapiscina EH, Fraga-Pumar E, Gabilondo I, Martínez-Heras E, Torres-Torres R, Ortiz-Pérez S, et al. The multiple sclerosis visual pathway cohort: understanding neurodegeneration in MS. BMC Res Notes. 2014;7: 910 10.1186/1756-0500-7-910 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Green AJ, Gelfand JM, Cree BA, Bevan C, Boscardin WJ, Mei F, et al. Clemastine fumarate as a remyelinating therapy for multiple sclerosis (ReBUILD): a randomised, controlled, double-blind, crossover trial. Lancet Lond Engl. 2017;390: 2481–2489. 10.1016/S0140-6736(17)32346-2 [DOI] [PubMed] [Google Scholar]
- 10.Neeb H, Schenk J. Multivariate prediction of multiple sclerosis using robust quantitative MR-based image metrics. Z Med Phys. 2018. 10.1016/j.zemedi.2018.10.004 [DOI] [PubMed] [Google Scholar]
- 11.Neeb H, Schenk J, Weber B. Multicentre absolute myelin water content mapping: Development of a whole brain atlas and application to low-grade multiple sclerosis. NeuroImage Clin. 2012;1: 121–130. 10.1016/j.nicl.2012.09.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Zhang H, Schneider T, Wheeler-Kingshott CA, Alexander DC. NODDI: Practical in vivo neurite orientation dispersion and density imaging of the human brain. NeuroImage. 2012;61: 1000–1016. 10.1016/j.neuroimage.2012.03.072 [DOI] [PubMed] [Google Scholar]
- 13.Dale AM, Fischl B, Sereno MI. Cortical surface-based analysis. I. Segmentation and surface reconstruction. NeuroImage. 1999;9: 179–194. 10.1006/nimg.1998.0395 [DOI] [PubMed] [Google Scholar]
- 14.Fischl B, Salat DH, Busa E, Albert M, Dieterich M, Haselgrove C, et al. Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron. 2002;33: 341–355. 10.1016/s0896-6273(02)00569-x [DOI] [PubMed] [Google Scholar]
- 15.Hinds OP, Rajendran N, Polimeni JR, Augustinack JC, Wiggins G, Wald LL, et al. Accurate prediction of V1 location from cortical folds in a surface coordinate system. NeuroImage. 2008;39: 1585–1599. 10.1016/j.neuroimage.2007.10.033 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Mori S, Oishi K, Faria AV. White matter atlases based on diffusion tensor imaging: Curr Opin Neurol. 2009;22: 362–369. 10.1097/WCO.0b013e32832d954b [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Jenkinson M, Smith S. A global optimisation method for robust affine registration of brain images. Med Image Anal. 2001;5: 143–156. 10.1016/s1361-8415(01)00036-6 [DOI] [PubMed] [Google Scholar]
- 18.Jenkinson M, Beckmann CF, Behrens TEJ, Woolrich MW, Smith SM. FSL. NeuroImage. 2012;62: 782–790. 10.1016/j.neuroimage.2011.09.015 [DOI] [PubMed] [Google Scholar]
- 19.Garyfallidis E, Brett M, Amirbekian B, Rokem A, van der Walt S, Descoteaux M, et al. Dipy, a library for the analysis of diffusion MRI data. Front Neuroinformatics. 2014;8 10.3389/fninf.2014.00008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Cruz-Herranz A, Balk LJ, Oberwahrenbrock T, Saidha S, Martinez-Lapiscina EH, Lagreze WA, et al. The APOSTEL recommendations for reporting quantitative optical coherence tomography studies. Neurology. 2016;86: 2303–2309. 10.1212/WNL.0000000000002774 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Afanador NL, Tran TN, Buydens LMC. Use of the bootstrap and permutation methods for a more robust variable importance in the projection metric for partial least squares regression. Anal Chim Acta. 2013;768: 49–56. 10.1016/j.aca.2013.01.004 [DOI] [PubMed] [Google Scholar]
- 22.Ayadi N, Dörr J, Motamedi S, Gawlik K, Bellmann-Strobl J, Mikolajczak J, et al. Temporal visual resolution and disease severity in MS. Neurol—Neuroimmunol Neuroinflammation. 2018;5: e492 10.1212/NXI.0000000000000492 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Petracca M, Cordano C, Cellerino M, Button J, Krieger S, Vancea R, et al. Retinal degeneration in primary-progressive multiple sclerosis: A role for cortical lesions? Mult Scler Houndmills Basingstoke Engl. 2017;23: 43–50. 10.1177/1352458516637679 [DOI] [PubMed] [Google Scholar]
- 24.Calabrese M, De Stefano N, Atzori M, Bernardi V, Mattisi I, Barachino L, et al. Detection of cortical inflammatory lesions by double inversion recovery magnetic resonance imaging in patients with multiple sclerosis. Arch Neurol. 2007;64: 1416–1422. 10.1001/archneur.64.10.1416 [DOI] [PubMed] [Google Scholar]