Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2024 Apr 23.
Published in final edited form as: Mult Scler. 2023 Dec 13;30(1):25–34. doi: 10.1177/13524585231214360

A multicenter pilot study evaluating simplified central vein assessment for the diagnosis of multiple sclerosis

Lynn Daboul 1,2, Carly M O’Donnell 3, Moein Amin 4, Paulo Rodrigues 5, John Derbyshire 6, Christina Azevedo 7, Amit Bar-Or 8, Eduardo Caverzasi 9, Peter A Calabresi 10, Bruce AC Cree 9, Leorah Freeman 11, Roland G Henry 9, Erin E Longbrake 12, Jiwon Oh 13, Nico Papinutto 9, Daniel Pelletier 7, Vesna Prchkovska 5, Praneeta Raza 2, Marc Ramos 5, Rohini D Samudralwar 14, Matthew K Schindler 8, Elias S Sotirchos 10, Nancy L Sicotte 15, Andrew J Solomon 16, Russell T Shinohara 3, Daniel S Reich 1, Pascal Sati 1,15, Daniel Ontaneda 17
PMCID: PMC11037932  NIHMSID: NIHMS1979381  PMID: 38088067

Abstract

Background:

The central vein sign (CVS) is a proposed MRI biomarker for multiple sclerosis (MS); the optimal method for abbreviated CVS scoring is not yet established.

Objective:

To evaluate the performance of a simplified approach to CVS assessment in a multicenter study of patients being evaluated for suspected MS.

Methods:

Adults referred for possible MS to ten sites were recruited. A post-Gd 3D T2*-weighted MRI sequence (FLAIR*) was obtained in each subject. Trained raters at each site identified up to 6 CVS positive lesions per FLAIR* scan. Diagnostic performance of CVS was evaluated for a diagnosis of MS which had been confirmed using 2017 McDonald criteria at thresholds including 3 positive lesions (Select-3*) and 6 positive lesions (Select-6*). Inter-rater reliability assessments were performed.

Results:

78 participants were analyzed; 37 (47%) were diagnosed with MS and 41 (53%) were not. Mean age of participants was 45 years (range: 19-64), and most were female (n=55, 71%). The AUROC for the simplified counting method was 0.83 (95% CI: 0.73-0.93). Select-3* and Select-6* had sensitivity of 81% and 65% and specificity of 68% and 98%, respectively. Inter-rater agreement was 78% for Select-3* and 83% for Select-6*.

Conclusion:

A simplified method for CVS assessment in patients referred for suspected MS demonstrated good diagnostic performance and inter-rater agreement.

Introduction

Early initiation of treatment in patients with multiple sclerosis (MS) improves clinical outcomes, making prompt diagnosis essential.1 However, accurately diagnosing MS remains challenging in some cases due to radiological and clinical mimickers,2,3 leading to a high incidence of misdiagnosis, primarily overdiagnosis.4 Unnecessary morbidity associated with disease-modifying therapies (DMTs) is associated with misdiagnosis.5 While the 2017 McDonald criteria6 allow for a shorter time to diagnosis,7,8 this comes at the cost of reduced specificity.911

The central vein sign (CVS) is a sensitive and specific radiologic biomarker for distinguishing MS from other causes of white matter lesions, including small vessel ischemic disease, migraine, and vasculitides,1215 in single-center cohorts12,13,15 or retrospective/cross-sectional multicenter studies.16,17 The CVS can be visualized with different imaging sequences; FLAIR*, combining T2*-weighted segmented echo-planar imaging (segEPI) with fluid-attenuated inversion recovery (FLAIR),18 has been shown to be more sensitive compared to susceptibility weighted imaging (SWI) methods at CVS detection.17,19

A key limitation of CVS studies to date is use of retrospective design, comparing participants with well-established MS diagnoses against participants with other well-established diagnoses. This type of study design likely amplifies differences between groups and is inadequate to inform clinical practice. Additionally, while there is consensus on defining a CVS-positive lesion,2 the optimal approach for measuring CVS positivity of a given brain scan for an MS diagnosis remains unclear. Percentage-based methods, which calculate a proportion of CVS-positive lesions using thresholds (35-50%), are highly specific for MS12,13,17,19,20; however, this is time-consuming, especially for individuals with many lesions. More efficient methods have been developed using simplified clinical algorithms, such as simplified counts of CVS+ lesions.21 These simplified methods offer promise as easy-to-use clinical tools. However, how these simplified methods perform in individuals at time of presentation to MS centers is unknown.

Using 3-tesla (T) 3D FLAIR* MRI, we conducted a multicenter pilot study under the auspices of the North American Imaging in Multiple Sclerosis Cooperative (NAIMS) to investigate: 1) feasibility of multicenter deployment of FLAIR* imaging and multi-rater CVS assessment, to inform a larger-scale multicenter prospective study, and 2) diagnostic performance of a simplified CVS method in accurately diagnosing MS using FLAIR* imaging in patients presenting for MS evaluation.

Materials and Methods:

Participants:

The Central Vein Sign in MS (CAVS-MS) Pilot was a multicenter observational study aimed at examining the feasibility of CVS using 3T FLAIR* imaging to diagnose MS. Local IRB approval was obtained at 10 NAIMS sites. Individuals referred for a clinical/radiological suspicion of MS across the 10 sites were identified and approached for study participation. Written informed consent was obtained from all participants. Key inclusion criteria were age 18-65 years, referral to the academic site for new clinical/radiological suspicion of MS, and brain MRI scan demonstrating focal white matter T2 hyperintensities. Exclusion criteria were use of DMTs, contraindications to or intolerance of MRI or Gadolinium (Gd), and treatment with systemic corticosteroids in the 4 weeks preceding enrollment. Recruitment occurred between April 2018-February 2020.

97 participants in total were recruited. MRIs from 92 participants passed quality assessment by an MR physicist (PS). Four participants were removed from analysis due to excessive image artifacts. One participant was removed due to absent post-Gd imaging. In the analysis, only participants with a diagnosis of MS or an alternate diagnosis were included, and those diagnosed with clinically isolated syndrome or radiologically isolated syndrome were excluded, given the study’s cross-sectional design limiting longitudinal assessment of MS development.

Study Design and Outcomes:

After informed consent, participants completed a study visit which included a research MRI. Subjects with MS were confirmed to fulfill 2017 McDonald criteria (MC) including the exclusion of other diagnoses.6 MS diagnosis was assessed by subspecialty-trained neurologists using data from clinical practice including clinical history, neurological exam, standard MRI studies, and additional testing such as cerebrospinal fluid tests as deemed clinically relevant. Assessment of MS diagnosis was blinded to CVS status. For patients not diagnosed with MS, the alternate diagnosis was reported.

Image Acquisition:

All participants underwent a single brain MRI on a 3T scanner. Siemens [Siemens, Germany] scanners were used at 7 sites (Prisma Fit [n=2], Prisma [n=1], Biograph mMR [n=1], and Skyra [n=3]). Philips [Philips, Netherlands] scanners were used at 3 sites (Ingenia, Ingenia Elition X, and Achieva dStream). A detailed MRI manual and a prespecified imaging protocol were utilized to ensure uniform acquisitions across sites; protocol details are presented in Table 1. Examinations used a single dose (0.1 mmol/kg) of a macrocyclic gadolinium-based contrast agent (gadoterate, gadoteridol, or gadobutrol, depending on the site’s routine practice).

Table 1.

Brain MRI protocol used at all participating sites.

Sequence Isotropic Resolution (mm) TR/TE Acquisition Time Contrast Media Other
T2-weighted FLAIR 1.0 4800/352 7 min, 9 s Pre TI: 1800 ms
T2*-weighted segmented EPI obtained pre- and post-contrast 0.65 64/35 5 min, 48 s Pre and post Flip angle: 10°, EPI factor: 15
T1-weighted imaging 1.0 7.8/3.0 3 min, 16 s Pre and post Flip angle: 18°

Note: All sequences comprised a 3D sagittal acquisition of entire brain.

EPI = echoplanar imaging, TI = inversion time

Image Analysis:

Images were uploaded and post-processed on a dedicated MRI cloud platform (QMENTA® [Boston, MA]). Three postprocessing steps were used to generate FLAIR* images as previously reported.18 Creation of FLAIR* images was automated, taking less than 30 minutes.

All CVS raters were trained on a standardized dataset of annotated images with CVS+ and CVS− lesions curated from a prior study.21 For the simplified CVS method (select-n* analysis), neurologists served as site raters and independently evaluated up to 12 participant MRIs for CVS on the QMENTA cloud platform. Raters identified up to 6 CVS+ lesions that met NAIMS CVS criteria2 (Table 2) on post-Gd FLAIR* scans. Diagnostic performance of the CVS for MS was evaluated at counts of 1 CVS+ lesion (Select-1*) up to 6 CVS+ lesions (Select-6*). Detailed analyses focused on Select-3* and Select-6* as previous data supported these thresholds.15,21 For an inter-rater reliability (IRR) evaluation of the simplified method, two central raters (LD, a fourth-year medical student, and MA, a neuroimmunology fellow), both blinded to clinical information, evaluated the scans (LD: all scans, MA: 30 scans).

Table 2.

NAIMS CVS Criteria2

Central Vein Requirements Exclusion criteria for lesion
1. Appears as a thin hypointense line or small hypointense dot 1. Lesion is <3 mm in diameter in any plane
2. Can be visualized in at least two perpendicular MRI planes, and appears as a thin line in at least one plane 2. Lesion merges with another lesion (confluent lesions)
3. Has a small apparent diameter (<2 mm) 3. Lesion has multiple distinct veins
4. Runs partially or entirely through the lesion 4. Lesion is poorly visible (owing to motion or other MRI-related artifacts)
5. Is positioned centrally in the lesion

For the percentage-based CVS evaluation, FLAIR images were used to create a lesion mask using ITK-SNAP. Subsequently, post-Gd FLAIR* images were masked, and a central rater (LD) evaluated each scan. Lesion coordinates, location category, and CVS category were recorded for each lesion. Location categories included juxtacortical, periventricular, infratentorial, and subcortical/deep white matter. The following CVS categories were utilized: (1) CVS-positive (CVS+) if a central vein was identified on at least two of three planes, meeting NAIMS criteria2; (2) CVS-negative (CVS−) if there was no identifiable central vein; (3) CVS-indeterminate if there was the appearance of a vein on one plane with insufficient clarity to confidently identify it as CVS+ or CVS−; and (4) Excluded if it met a NAIMS exclusion criteria.2 The percentage of CVS+ lesions on each scan was calculated as the total number of CVS+ lesions divided by the sum of CVS+ and CVS− lesions. Thresholds were dichotomized using cutoffs from 35% up to 50%, with a 5% step size, based on past literature identifying these thresholds as being useful in discriminating MS from non-MS patients.12,13,17,20,22 For an IRR evaluation of the percentage-based method, the second central rater (MA) evaluated 30 scans.

Statistical Analysis:

Receiver operating characteristic (ROC) curves were constructed to visualize discriminative performance of the CVS for MS via the area under the ROC curve (AUROC). Youden’s J index was used to assess the optimal cutoff value for predicting MS. A chi-square test was used to compare differences in distributions of brain lesions based on MS diagnosis. The Mann-Whitney U Test was used to determine differences in CVS detection between MS participants and non-MS participants.

IRR for the simplified method was determined at the Select-3* and Select-6* thresholds between a central rater (LD) and site raters using Cohen’s Kappa as a weighted average for the entire cohort as well as between two central raters (LD and MA) for a subset of 30 participants chosen randomly. For this calculation, raters had to agree that at least 3 lesions in a scan were CVS+ for Select-3*, or 6 for Select-6*. IRR for the percentage-based method was conducted between two central raters (LD and MA) on a subset of 30 participants chosen randomly using Cohen’s Kappa by evaluating lesions classified as CVS-positive or CVS-negative by both raters; agreement for 1) classifying WMLs as CVS-positive versus CVS-negative as well as 2) patient-level CVS-positivity at the 40% threshold were calculated. For statistical analysis, GraphPad Prism 8 and JMP Pro 14 software was used.

Results

Demographics and Clinical Characteristics

78 participants were included in the analysis (see Figure 1). Demographics and clinical characteristics of participants are presented in Table 3. Thirty-seven (47%) participants (mean age ± SD: 41±11) were diagnosed with MS. Two participants were diagnosed with primary-progressive MS; the remainder had relapsing-remitting MS. The most common presentations were sensory symptoms in a CNS pattern (15/37), acute unilateral optic neuritis (6/37), double vision due to an internuclear ophthalmoplegia or 6th nerve palsy (4/37), and partial myelopathy (4/37). 41 (53%) participants (mean age 49±10) did not have MS and were diagnosed with alternative diagnoses (non-MS). The most common diagnoses in this group were small vessel ischemic disease (n=10), migraine (n=7) and nonspecific white matter changes (n=4); a full list is in Supplemental Table 1. Non-MS participants were on average older (p<0.001, two-tailed t-test) with a higher prevalence of hypertension compared to MS participants (p=0.028, Fisher’s exact test). Time since symptom onset was a median of 52 weeks in MS participants and 109 weeks in non-MS participants. Oligoclonal bands were tested for in 53 participants and were positive in 18/23 (78%) of MS participants and 5/21 (24%) of non-MS participants. For details on how participants fulfilled 2017 McDonald criteria, see Supplemental Table 2.

Figure 1:

Figure 1:

Flow diagram for study participants

Table 3.

Demographics and clinical characteristics of study participants.

All Participants with MS Participants without MS
Number (%) 78 37 (47) 41 (53)
Age, mean ± SD 45 ± 12 41 ± 11 49 ± 10
Female, no. (%) 55 (71) 21 (57) 34 (83)
Race, white, no. (%) 67 (88) 32 (86) 35 (85)
Hypertension, no. (%) 12 (15) 2 (5) 10 (24)
Diabetes, no. (%) 3 (4) 2 (5) 1 (2)
Hyperlipidemia, no. (%) 12 (15) 3 (8) 9 (22)
Past or current tobacco use, no. (%) 22 (28) 11 (30) 11 (27)
EDSS, mean ± SD 1.4 ± 1.0 1.3 ± 1.0 1.5 ± 1.1
Time since symptom onset in weeks, median [IQR]* 94 [244] N=71 52 [229] N=37 109 [225] N=34
Oligoclonal bands positive / number tested (%) 23 / 44 (52) 18 / 23 (78) 5 / 21 (24)
*

Duration from onset of symptoms to study visit. Not all patients had symptoms, number provided for those with clinical symptoms.

T25FW= Timed 25-foot walk test. EDSS= Expanded Disability Status Scale. 9-HPT= 9-Hole Peg Test (completed with dominant hand). SDMT= Symbol Digit Modalities Test. CSF= Cerebrospinal fluid. OCB= oligoclonal bands. MS = Multiple sclerosis

Site-Rater Simplified CVS Analysis

Examples of CVS-positive lesions as identified by the Select-n* technique are shown in Figure 2. For site ratings, the AUROC was 0.83 (95% CI: 0.73-0.93) (Figure 3). Table 4 demonstrates the performance of Select-n* at different thresholds. Diagnostic performance was optimized with Select-6* based on Youden’s J Index (sensitivity 65%, specificity 98%, accuracy 82%). Diagnostic performance for Select-3* showed a sensitivity of 81%, specificity of 68%, and accuracy of 74%.

Figure 2: Example of central vein sign positive lesions on FLAIR* contrast obtained on different scanners.

Figure 2:

Examples of Central Vein Sign (CVS) Positive lesions as visualized with FLAIR* imaging. A) Axial slice demonstrating multiple CVS+ lesions in a participant with MS; magnified view of representative CVS+ lesions in different participants obtained on a: B) Siemens Prisma Fit scanner, C) Philips Ingenia scanner, and a D) Siemens Skyra scanner.

Figure 3: Diagnostic Performance of Select-n* Method.

Figure 3:

Receiver Operating Curve (ROC) for diagnosing MS using different select-n* thresholds based on the ratings of ten institutional raters (red line) and a central rater (black line) using post-Gd FLAIR* imaging of 78 scans. For the ratings of a single rater, the AUROC is 0.80 (95% CI: 0.71-0.90). For the ratings of the aggregate of ten raters, the AUROC is 0.83 (95% CI: 0.73-0.93). For both sets of ratings, Youden’s J Index was maximized with Select-6*.

Table 4.

Diagnostic performance of the CVS at different select-n* thresholds based on the ratings of the 10 site raters using post-Gd FLAIR* imaging.

Sensitivity Specificity NPV PPV LR+ LR−
Select-1* 89% 34% 78% 55% 1.35 0.32
Select-2* 86% 51% 81% 62% 1.77 0.26
Select-3* 81% 68% 80% 70% 2.56 0.28
Select-4* 73% 76% 76% 73% 2.99 0.36
Select-5* 68% 85% 74% 81% 4.62 0.38
Select-6* 65% 98% 75% 96% 26.59 0.36

NPV= Negative Predictive Value, PPV= Positive Predictive Value, LR+ = Positive Likelihood Ratio, LR− = Negative Likelihood Ratio

IRR for Select-3* on the entire cohort between a central rater and site raters demonstrated 78% agreement (Cohen’s Kappa, as a weighted average, was 0.54, indicating moderate agreement). IRR for Select-3* on a subset of 30 participants between two central raters demonstrated 70% agreement (κ = 0.45, indicating moderate agreement). For Select-6*, IRR between a central rater and site raters on the entire cohort was 83% (Cohen’s Kappa, as a weighted average, was 0.59, indicating moderate agreement). IRR for Select-6* on the subset of 30 participants between two central raters demonstrated 83% agreement (κ =0.62, indicating substantial agreement). See Supplemental Table 3 for further details.

Central Rater Analysis

Single rater analysis using the select-n* method showed an AUROC of 0.81 (90% CI: 0.71-0.90) (Figure 3). With Select-3*, sensitivity was 84% and specificity was 59% for diagnosing MS, with an accuracy of 71%; with Select-6*, sensitivity was 68%, specificity 83%, and accuracy 76%. Youden’s J Index was maximized with Select-6*. Diagnostic performance was similar using pre- or post-Gd FLAIR* images (Supplemental Table 4).

For the percentage-based analysis, a total of 5169 white matter lesions were assessed. Of these, 3471 lesions (67%) were excluded from CVS assessment based on NAIMS criteria.2 The median numbers of CVS-eligible lesions per MRI was 15 (IQR: 22, range 1-100) for MS participants and 14 (IQR: 34.5, range 0-111) for non-MS participants (p=0.94, Mann-Whitney U-Test). Of the CVS-eligible lesions, in the MS cohort, 496 (64%) were CVS+, 204 (27%) CVS−, and 71 (9%) CVS-indeterminate. In the non-MS cohort, 108 (12%) lesions were CVS+, 781 (84%) CVS−, and 38 (4%) CVS-indeterminate; see Supplemental Table 5 for details. MS participants had higher CVS+% (median [IQR]: 79% [39%]) compared to non-MS participants (12% [39%]), (p<0.0001, Mann-Whitney U Test); see Figure 4. Figure 5 shows the ROC for diagnosing MS using the percentage-based method; the AUROC is 0.90 (95% CI: 0.83-0.97). Using a percentage-based threshold of 40%, sensitivity was 92% and specificity 76%, while when using a percentage-based threshold of 50%, sensitivity was 89% and specificity 80% (See Supplemental Table 6 for comparison of percentage-based vs simplified analysis methods). Using Youden’s J Index, diagnostic performance was optimized at a threshold of 43%, with a sensitivity of 92% and specificity of 80%. IRR for classifying WMLs as CVS-positive versus CVS-negative was 87% (κ = 0.73, indicating substantial agreement). IRR for patient-level CVS-positivity at the 40% threshold showed 80% agreement (κ = 0.60, moderate agreement).

Figure 4: Central Vein Sign Percentage by Site and Diagnosis.

Figure 4:

Central vein sign detection using post-Gd FLAIR* imaging of the 78 participants. Participants who met 2017 McDonald Criteria for MS had significantly higher percentage of CVS positive lesions (median [IQR] 79% [39%]) compared to non-MS participants (12% [39%]), (p<0.0001, Mann-Whitney U Test). The different sites that participants were recruited from are denoted by the color key.

Figure 5: Diagnostic Performance of Percentage Threshold-based Method.

Figure 5:

Receiver Operating Curve (ROC) for predicting MS through use of the central vein sign using the percentage-based method and post-Gd FLAIR* scans. The AUROC is 0.90 (95% CI: 0.83-0.97, p <0.0001). Using Youden’s J Index, the diagnostic performance was optimized at a threshold of 43% (highlighted in red on the graph).

Discussion

The CAVS-MS pilot study was a multicenter study examining real-world performance of the CVS in patients presenting to an MS clinic for evaluation of MS. The study population at enrollment was a heterogeneous sample reflecting the range of cases referred to MS centers across North America. We utilized the FLAIR* sequence, which incorporates 3D T2*-weighted and 3D T2-weighted FLAIR images for a single easy-to-use sequence, with optimized sensitivity for the CVS.17,19 We demonstrated feasibility of using FLAIR* across different sites and MRI scanners for simplified CVS rating, addressing a need for standardizing CVS imaging for clinical use.23 We also compared CVS quantification methods, demonstrating that simplified lesion counting has similar diagnostic performance to percentage-based methods (AUROC of 0.83 vs 0.90), with the advantage of being time-efficient, an important characteristic for clinical utility. Inter-rater reliability was good across sites for simplified CVS rating (83% agreement for Select-6*, with moderate agreement per Cohen’s Kappa), demonstrating clinical feasibility.

The optimal tested threshold was Select-6* with a sensitivity of 65% and a specificity of 98%. With this high specificity, Select-6* could be useful in differentiating MS from mimickers, as it increases the likelihood of an MS diagnosis over 26-fold when positive. Our observed sensitivity for Select-6* was lower than that observed in prior studies, which reported sensitivities as high as 80%.12 This could be explained by participants in prior studies having more lesions and longer disease duration. The McDonald criteria already have a high sensitivity for MS,911 therefore implementation of a CVS method with high specificity would complement current diagnostic methods.

In comparison to Select-6*, the Select-3* method had a higher sensitivity (82%) but reduced specificity (68%). A previous study by our group in a smaller sample found a similar sensitivity (83%) but higher specificity for Select-3* (81%).21 Because the acquisition and rating of lesions was similar, this difference in specificity may relate to cohort differences. A recent European multicenter study showed a lower sensitivity of 69% for Select-3*.24 Some of this difference in sensitivity likely relates to use of SWI in the European study.19,25 Indeed, when 3D T2*-weighted imaging was analyzed separately in that study, sensitivity for Select-3* was 93%.17,24 In our study, diagnostic performance of the select-n method was largely unchanged based on Gd usage (Supplemental Table 4), supporting use of this method in CVS analysis of pre-Gd FLAIR* scans.

Overall, the percentage-based assessment showed that approximately two-thirds of lesions were CVS-positive in MS patients, similar to other published reports.17 When applying a diagnostic threshold, we found an optimal balance between sensitivity and specificity at around a 40% threshold (43% using Youden’s J Index), similar to prior experience.16,19

While replicating findings of smaller, single-center trials,1215 our current study is unique in investigating participants presenting for a diagnostic investigation for MS. Our findings support the notion that the CVS can be detected at time of initial presentation, corresponding well to findings described in RIS.26 Using this simple, quick CVS assessment as part of the standard MRI for first-time MS evaluation could serve as an adjunct diagnostic. The ability of the CVS to expedite diagnosis was not formally explored here and is a future direction in an ongoing prospective study conducted by our group.

This study provides evidence that implementation of FLAIR* for CVS detection is feasible across sites. Only 4 studies were rejected due to image artifacts, and overall image quality was high. Acquisition times were clinically feasible with combined scan duration for FLAIR and T2*-weighted imaging of approximately 12 minutes. Future directions include a larger multicenter longitudinal prospective study (U01NS116776-02, NCT04495556), which aims to provide additional evidence on CVS performance in diagnosing MS while evaluating both simplified and emerging automated methods of CVS detection.27,28

Our study has several limitations. While counting-based CVS quantification performed well in this cohort compared to percentage-based methods, there may be certain populations for whom these methods work less well. Our cohort had few vasculopathies, and prior work had demonstrated that percentage-based thresholds performed better in distinguishing MS from inflammatory CNS vasculitides.12 Furthermore, our study only included patients referred to an academic center for possible MS; more atypical/challenging cases are likely referred to these centers, limiting generalizability to the broader MS patient population. Another limitation to generalizability is exclusion of patients prescribed DMTs; though intended to exclude patients later in the disease course, it may bias towards selection of patients with lower T2 lesion loads. Additionally, though some MS patients at disease onset do not yet have brain MRI lesions, we did include brain lesions as a requirement for enrollment, given the aim of this study to analyze the CVS.

Of note, the interrater agreement was not perfect; it was rated as moderate by Cohen’s kappa. In deploying the CVS clinically, ensuring homogeneity of CVS interpretation by clinicians will be important. Automated methods, not explored in this study, could be helpful tools for time-efficient, homogeneous CVS evaluation.29 Additionally, our study only examined dedicated 3D T2*-weighted imaging at 3T; this may not be available at all sites. Dedicated studies comparing SWI and T2*-weighted imaging for CVS detection are needed, which will be evaluated in the CAVS-MS study.27 Finally, median time from symptom onset to presentation to an MS center in this study was long; this is unfortunately representative of current dynamics given ongoing neurologist shortages (in previous studies, the delay to see an MS-trained neurologist in various countries ranges from 7 months to 3.9 years).3033 We did not place artificial restraints on time from symptom onset to enrollment, to allow the study to reflect real-world CVS utilization.

In conclusion, this multicenter pilot study demonstrates the feasibility of utilizing the CVS in a real-world setting. This work demonstrates that simplified CVS methods rated by neurologists can accurately discriminate MS cases from non-MS cases in a cohort of patients newly referred to an MS center. The Select-6* method demonstrated high specificity for MS; future work will aim to establish if its use can aid in more accurately diagnosing MS.

Supplementary Material

Supplementary Table 1.
Supplementary Table 2.
Supplementary Table 3.
Supplementary Table 4.
Supplementary Table 5.
Supplementary Table 6.
Supplementary Table 7.

Acknowledgments

We thank the Race to Erase MS, the North American Imaging in MS Cooperative, the National Institute of Neurological Disorders and Stroke, and the National Institutes of Health Medical Research Scholars Program for providing the funding and support for this investigation.

Below is a list of each author with corresponding disclosures.

Disclosures

Lynn Daboul: None

Carly M O’Donnell: None

Moein Amin: None

Paulo Rodrigues: Employed by and holds stocks in QMENTA

John Derbyshire: None

Christina Azevedo: consulting fees for scientific advisory boards for Genentech, EMD Serono, Alexion Pharmaceuticals, and Sanofi Genzyme

Amit Bar-Or: Has received personal fees for advisory board participation and/or consulting from Abata, Accure, Atara Biotherapeutics, Biogen, BMS/Celgene/Receptos, GlaxoSmithKline, Gossamer, Horizon Therapeutics, Immunic, Janssen/Actelion, Medimmune, Merck/EMD Serono, Novartis, Roche/Genentech, Sangamo, Sanofi-Genzyme, Viracta; and grant support to the University of Pennsylvania from Biogen Idec, Roche/Genentech, Merck/EMD Serono and Novartis.

Eduardo Caverzasi: None

Peter A Calabresi: PI on grants to JHU from Biogen and Annexon. Serves on scientific advisory boards for Disarm Therapeutics and Biogen

Bruce AC Cree: Compensation for consulting from: Alexion, Atara, Biogen, EMD Serono, Novartis, Sanofi, and TG Therapeutics

Leorah Freeman: Received fees for consultancy and/or advisory board participation from Genentech, Novartis, Celgene/Bristol Myers Squibb, EMD Serono, and TG Therapeutics; Received fees for educational activities from Medscape, LLC, and the MS Association of America; program sponsorship to UT from EMD Serono; and grant support to UT from NIH/NINDS, PCORI, Genentech, and EMD Serono.

Roland G Henry: Research support from Roche, Genentech, Atara, Medday. Consulting for Novartis, Sanofi/Genzyme, Roche/Genentech, QIA, and Neurona.

Erin E Longbrake: Research support from Genentech, Biogen; consulting for Genentech, Janssen, TG Therapeutics, NGM Bio, Bristol Myers Squibb, EMD Serono

Jiwon Oh: Research support from Biogen-Idec, Roche, and EMD-Serono; consulting compensation from EMD-Serono, Sanofi-Genzyme, Biogen-Idec, Roche, Celgene, and Novartis

Nico Papinutto: Research support from the Race to Erase MS Foundation

Daniel Pelletier: Consulting compensation from EMD-Serono, Sanofi Genzyme, Roche, and Novartis

Vesna Prchkovska: Employed by and holds stocks in QMENTA

Praneeta Raza: None

Marc Ramos: Employed by and holds stock options in QMENTA

Rohini D Samudralwar: Advisory board participation (Biogen, EMD Serono, Sanofi Genzyme); Consulting (EMD Serono, Biogen)

Matthew K. Schindler: None

Elias Sotirchos: Scientific advisory boards and/or consulting for Alexion, Viela Bio, Horizon Therapeutics, Genentech and Ad Scientiam; speaking honoraria from Alexion, Viela Bio and Biogen.

Nancy L Sicotte: Research support from the National Institutes of Health, National Multiple Sclerosis Society, Patient Centered Outcomes Research Institute, Race to Erase MS Foundation and Biogen-Idec

Andrew J Solomon: Consulting: Greenwich Biosciences, Horizon Therapeutics, Kiniksa Pharmaceuticals, Octave Bioscience, TG Therapeutics, Non-promotional speaking: EMD Serono; Research Funding: Bristol Myers Squibb; Contracted Research: Sanofi, Novartis, Actelion, Genentech/Roche

Russell T Shinohara: Supported NIH R01NS112274, R01MH112847, R01MH123550. Consulting income from Octave Bioscience.

Daniel S Reich: Supported by the Intramural Research Program of NINDS; additional research support from Vertex Pharmaceuticals, Sanofi-Genzyme, and Abata Therapeutics.

Pascal Sati: Research support from the National Institutes of Health and the National Multiple Sclerosis Society.

Daniel Ontaneda: Research support from the National Institutes of Health, National Multiple Sclerosis Society, Patient Centered Outcomes Research Institute, Race to Erase MS Foundation, Genentech, Genzyme, and Novartis. Consulting fees from Biogen Idec, Genentech/Roche, Genzyme, Novartis, and Merck.

References

  • 1.Kavaliunas A, Manouchehrinia A, Stawiarz L, et al. Importance of early treatment initiation in the clinical course of multiple sclerosis. Mult Scler. 2016;23(9):1233–1240. doi: 10.1177/1352458516675039 [DOI] [PubMed] [Google Scholar]
  • 2.Sati P, Oh J, Constable RT, et al. The central vein sign and its clinical evaluation for the diagnosis of multiple sclerosis: a consensus statement from the North American Imaging in Multiple Sclerosis Cooperative. Nat Rev Neurol. 2016;12:714–722. doi: 10.1038/nrneurol.2016.166 [DOI] [PubMed] [Google Scholar]
  • 3.Solomon AJ, Arrambide G, Brownlee WJ, et al. Differential diagnosis of suspected multiple sclerosis: an updated consensus approach. Lancet Neurol. 2023;22(8):750–768. doi: 10.1016/S1474-4422(23)00148-5 [DOI] [PubMed] [Google Scholar]
  • 4.Kaisey M, Solomon AJ, Luu M, Giesser BS, Sicotte NL. Incidence of multiple sclerosis misdiagnosis in referrals to two academic centers. Mult Scler Relat Disord. 2019;30:51–56. doi: 10.1016/j.msard.2019.01.048 [DOI] [PubMed] [Google Scholar]
  • 5.Solomon AJ, Bourdette DN, Cross AH, et al. The contemporary spectrum of multiple sclerosis misdiagnosis: A multicenter study. Neurology. 2016;87(13):1393–1399. doi: 10.1212/WNL.0000000000003152 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Thompson AJ, Banwell BL, Barkhof F, et al. Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria. Lancet Neurol. 2018;17(2):162–173. doi: 10.1016/S1474-4422(17)30470-2 [DOI] [PubMed] [Google Scholar]
  • 7.Tintore M, Cobo-Calvo A, Carbonell P, et al. Effect of changes in MS diagnostic criteria over 25 years on time to treatment and prognosis in patients with clinically isolated syndrome. Neurology. 2021;97(17):e1641–e1652. doi: 10.1212/WNL.0000000000012726 [DOI] [PubMed] [Google Scholar]
  • 8.Gaetani L, Prosperini L, Mancini A, et al. 2017 revisions of McDonald criteria shorten the time to diagnosis of multiple sclerosis in clinically isolated syndromes. J Neurol. 2018;265(11):2684–2687. doi: 10.1007/s00415-018-9048-8 [DOI] [PubMed] [Google Scholar]
  • 9.van der Vuurst de Vries RM, Mescheriakova JY, Wong YYM, et al. Application of the 2017 Revised McDonald Criteria for Multiple Sclerosis to Patients With a Typical Clinically Isolated Syndrome. JAMA Neurol. 2018;75(11):1392–1398. doi: 10.1001/jamaneurol.2018.2160 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Habek M, Pavičić T, Ruška B, et al. Establishing the diagnosis of multiple sclerosis in Croatian patients with clinically isolated syndrome: 2010 versus 2017 McDonald criteria. Mult Scler Relat Disord. 2018;25:99–103. doi: 10.1016/j.msard.2018.07.035 [DOI] [PubMed] [Google Scholar]
  • 11.Hyun JW, Kim W, Huh SY, et al. Application of the 2017 McDonald diagnostic criteria for multiple sclerosis in Korean patients with clinically isolated syndrome. Mult Scler. 2019;25(11):1488–1495. doi: 10.1177/1352458518790702 [DOI] [PubMed] [Google Scholar]
  • 12.Maggi P, Absinta M, Grammatico M, et al. Central vein sign differentiates Multiple Sclerosis from central nervous system inflammatory vasculopathies. Ann Neurol. 2018;83(2):283–294. doi: 10.1002/ana.25146 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Tallantyre EC, Dixon JE, Donaldson I, et al. Ultra-high-field imaging distinguishes MS lesions from asymptomatic white matter lesions. Neurol. 2011;76(6):534–539. doi: 10.1212/WNL.0b013e31820b7630 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Kilsdonk ID, Wattjes MP, Lopez-Soriano A, et al. Improved differentiation between MS and vascular brain lesions using FLAIR* at 7 Tesla. Eur Radiol. 2014;24(4):841–849. doi: 10.1007/s00330-013-3080-y [DOI] [PubMed] [Google Scholar]
  • 15.Mistry N, Abdel-Fahim R, Samaraweera A, et al. Imaging central veins in brain lesions with 3-T T2*-weighted magnetic resonance imaging differentiates multiple sclerosis from microangiopathic brain lesions. Mult Scler. 2016;22(10):1289–1296. doi: 10.1177/1352458515616700 [DOI] [PubMed] [Google Scholar]
  • 16.Suh CH, Kim SJ, Jung SC, Choi CG, Kim HS. The “Central Vein Sign” on T2*-weighted Images as a Diagnostic Tool in Multiple Sclerosis: A Systematic Review and Meta-analysis using Individual Patient Data. Sci Rep. 2019;9(1):18188. doi: 10.1038/s41598-019-54583-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Sinnecker T, Clarke MA, Meier D, et al. Evaluation of the Central Vein Sign as a Diagnostic Imaging Biomarker in Multiple Sclerosis. JAMA Neurol. 2019;76(12):1446–1456. doi: 10.1001/jamaneurol.2019.2478 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Sati P, George IC, Shea CD, Gaitan MI, Reich DS. FLAIR*: a combined MR contrast technique for visualizing white matter lesions and parenchymal veins . Radiology. 2012;265(3):926–932. doi: 10.1148/radiol.12120208 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Castellaro M, Tamanti A, Pisani AI, Pizzini FB, Crescenzo F, Calabrese M. The Use of the Central Vein Sign in the Diagnosis of Multiple Sclerosis: A Systematic Review and Meta-analysis. Diagnostics. 2020;10(12):1025. doi: 10.3390/DIAGNOSTICS10121025 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Maggi P, Absinta M, Sati P, et al. The “central vein sign” in patients with diagnostic “red flags” for multiple sclerosis: A prospective multicenter 3T study. Mult Scler. 2020;26(4):421–432. doi: 10.1177/1352458519876031 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Solomon AJ, Watts R, Ontaneda D et al. Diagnostic performance of central vein sign for multiple sclerosis with a simplified three-lesion algorithm. Mult Scler J. 2018;24(6). doi: 10.1177/1352458517726383 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Clarke MA, Samaraweera APR, Falah Y et al. Single Test to Arrive at Multiple Sclerosis (STAR-MS) diagnosis: A prospective pilot study assessing the accuracy of the central vein sign in predicting multiple sclerosis in cases of diagnostic uncertainty. Mult Scler J. 2019;26(4): 433–441. doi: 10.1177/1352458519882282 [DOI] [PubMed] [Google Scholar]
  • 23.Filippe M, Rocca MA, Ciccarelli O, et al. MRI Criteria for the Diagnosis of Multiple sclerosis: MAGNIMS Consensus Guidelines. Lancet Neurol 2016;15(3): 292–303. doi: 10.1016/S1474-4422(15)00393-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Sinnecker T; Clarke M; Meier D et al. Evaluation of the “Three Lesions with a Central Vein Sign” Criteria for the Differentiation between Multiple Sclerosis and Its Imaging Mimics. Neurol. 2019;92(15 Supplement) S6.002. [Google Scholar]
  • 25.Samaraweera APR, Clarke MA, Whitehead A, et al. The Central Vein Sign in Multiple Sclerosis Lesions Is Present Irrespective of the T2* Sequence at 3 T. J Neuroimaging. 2017;27(1):114–121. doi: 10.1111/jon.12367 [DOI] [PubMed] [Google Scholar]
  • 26.Suthiphosuwan S, Sati P, Guenette M, et al. The Central Vein Sign in Radiologically Isolated Syndrome. Am J Neuroradiol. 2019;40(5):776–783. doi: 10.3174/ajnr.A6045 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Ontaneda D, Sati P, Raza P, et al. Central vein sign: A diagnostic biomarker in multiple sclerosis (CAVS-MS) study protocol for a prospective multicenter trial. NeuroImage Clin. 2021;32. doi: 10.1016/J.NICL.2021.102834 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Dworkin JD, Sati P, Solomon A, et al. Automated Integration of Multimodal MRI for the Probabilistic Detection of the Central Vein Sign in White Matter Lesions. Am J Neuroradiol. 2018;39(10):1806–1813. doi: 10.3174/ajnr.A5765 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Maggi P, Fartaria MJ, Jorge J, et al. CVSnet: A machine learning approach for automated central vein sign assessment in multiple sclerosis. NMR in Biomedicine. 2020; 33e4283. doi: 10.1002/nbm.4283 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Thormann A, Sørensen PS, Koch-Henriksen N, Laursen B, Magyari M. Comorbidity in multiple sclerosis is associated with diagnostic delays and increased mortality. Neurology. 2017;89(16):1668–1675. doi: 10.1212/WNL.0000000000004508 [DOI] [PubMed] [Google Scholar]
  • 31.Patti F, Chisari CG, Arena S, et al. Factors driving delayed time to multiple sclerosis diagnosis: Results from a population-based study. Mult Scler Relat Disord. 2022;57:103361. doi: 10.1016/j.msard.2021.103361 [DOI] [PubMed] [Google Scholar]
  • 32.Khedr EM, El Malky I, Hussein HB, Mahmoud DM, Gamea A. Multiple sclerosis diagnostic delay and its associated factors in Upper Egyptian patients. Sci Rep. 2023;13(1):2249. Published 2023 Feb 8. doi: 10.1038/s41598-023-28864-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Mobasheri F, Jaberi AR, Hasanzadeh J, Fararouei M. Multiple sclerosis diagnosis delay and its associated factors among Iranian patients. Clin Neurol Neurosurg. 2020;199:106278. doi: 10.1016/j.clineuro.2020.106278 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Table 1.
Supplementary Table 2.
Supplementary Table 3.
Supplementary Table 4.
Supplementary Table 5.
Supplementary Table 6.
Supplementary Table 7.

RESOURCES