Abstract
In this paper, we explore the potential of using the multivoxel proton magnetic resonance spectroscopy (1H-MRS) to diagnose neuropsychiatric systemic lupus erythematosus (NPSLE) with the assistance of a support vector machine broad learning system (BL-SVM). We retrospectively analysed 23 confirmed patients and 16 healthy controls, who underwent a 3.0 T magnetic resonance imaging (MRI) sequence with multivoxel 1H-MRS in our hospitals. One hundred and seventeen metabolic features were extracted from the multivoxel 1H-MRS image. Thirty-three metabolic features selected by the Mann-Whitney U test were considered to have a statistically significant difference (p < 0.05). However, the best accuracy achieved by conventional statistical methods using these 33 metabolic features was only 77%. We turned to develop a support vector machine broad learning system (BL-SVM) to quantitatively analyse the metabolic features from 1H-MRS. Although not all the individual features manifested statistics significantly, the BL-SVM could still learn to distinguish the NPSLE from the healthy controls. The area under the receiver operating characteristic curve (AUC), the sensitivity, and the specificity of our BL-SVM in predicting NPSLE were 95%, 95.8%, and 93%, respectively, by 3-fold cross-validation. We consequently conclude that the proposed system effectively and efficiently working on limited and noisy samples may brighten a noinvasive in vivo instrument for early diagnosis of NPSLE.
1. Introduction
Systemic lupus erythematosus (SLE) is an autoimmune disease involving multiple organs or systems, such as the central nervous system (CNS), peripheral nervous system (PNS), skin, joints, and kidneys [1]. Up to 75% of SLE patients suffer from CNS and PNS disorder [2]. The neuropsychiatric systemic lupus erythematosus (NPSLE) is closely related to a worse prognosis and a serious mortality [3–5]. In 1999, a classification criterion for NPSLE has been developed by the American College of Rheumatology (ACR), which included case definitions for 19 neuropsychiatric syndromes, significant exclusions, and recommendation of ascertainment [6]. It is still a tough task to ascribe a specific symptom or sign to NPSLE.
Magnetic resonance imaging (MRI) is widely considered a promising noninvasive tool for SLE diagnosis [7]. Conventional MRI sequences, including T1-weighted, T2-weighted, T2 fluid-attenuated inversion recovery (T2-FLAIR) images, and diffusion-weighted imaging (DWI) can sensitively reveal abnormal changes caused by axonal damage, cortical damage, cerebral atrophy, cerebral infarctions, inflammatory-like lesions, and small vessel disease [8–10]. However, there were about 50% of NPSLE patients that had normal intensities in the structural MRI [11], displaying the limitation of conventional MRI.
Proton magnetic resonance spectroscopy (1H-MRS) is accessible to the levels of tissue metabolites including N-acetylaspartate (NAA), creatine (Cr), choline (Cho), glutamate (Glu), Glu-glutamine (Gln), myo-inositol (mI), and lactate (Lac) [12–14].
N-Acetylaspartate (NAA) is a special character of neural cells, and a decreased peak of NAA in MRS spectra represents the reduction of neurons [15–17]. Choline (Cho) plays an important role in generating the phospholipid of the cell membrane. An elevated Cho peak shows the increased cell membrane synthesis, which reflects that the cell structure is in a mess [16]. Glutamate (Glu) and Glu-glutamine (Gln) are related to glutamatergic neurotransmitters, and increased Glu and Gln represent a high risk in psychosis [17]. Myo-inositol (mI) is involved in glial metabolism, and increased mI reflects glial involvement [18]. Moreover, 1H-MRS enables quantifying metabolic concentration noninvasively in vivo [19]. Thus, it has been widely explored in pioneering researches of noninvasively diagnosing NPSLE [9, 20, 21]. In previous studies, a reduction in NAA was observed, whereas total Cho (tCho) and mI are raised, in normal appearing brain tissue of NPSLE patients [20], which demonstrated that neural biomarkers were able to predict the early involvement of the central nervous system in SLE. However, Zimny et al. found that the levels of mI and Cho were almost normal in their patients with SLE or NPSLE [22].
Therefore, these changes detected by single-voxel MRS in the above studies may not be specific enough, since there is limitation of one voxel which is not included in all the regions that may have pathological changes. In this regard, the conventional statistical methods easily fail to distinguish NPSLE due to the individual difference of metabolic features among limited samples. The accuracy of diagnosing NPSLE by 1H-MRS required further improvement by emerging machine learning techniques.
Deep neural networks have been successfully applied in a great number of applications [23], including medical image processing [24–26]. However, there are some unavoidable systematic errors, such as relaxation and partial-volume effects, which resulted in missing metabolic values. Consequently, a sufficient and consistent training set can hardly be constructed, which makes a great challenge to apply deep techniques to this task, since the samples are too small to train a deep structure with a great number of parameters. Moreover, the metabolic features mingling with missing values and noise also burden the classifier to make a correct judgement.
To develop a robust and effective model to quantitatively analyse the metabolic features or the nonlinear combination of metabolic features of the NPSLE patients, we rethink the potential of a support vector machine (SVM), which has been regarded as a succinct model to separate complicated data in limited samples and able to optimize convexly [27]. We also draw the idea of the broad learning system [28] to construct a shallow but effective learning system to extract discriminable features by shallow structures in a layer-wise mechanism. The proposed support vector machine broad learning system (BL-SVM) was applied to a retrospective analysis of the metabolic features screened by 1H-MRS quantitatively. Although the samples in the training set were limited, the SVMs embedded in the BL-SVM can still learn from the metabolic features layer-wise optimally. The diversity of each SVM is increased by resampling the training using the bootstrap method to enhance the robustness of the learning system. The results have confirmed that the metabolic features screened by multivoxel magnetic resonance spectroscopy can be used to quantitatively distinguish NPSLE patients from the healthy controls. Our findings may brighten an automatic and noninvasive computer-aided diagnostic instrument for NPSLE at an early stage.
2. Materials and Methods
2.1. Patients and Controls
This retrospective study has been approved by the Research Ethics Committee of the 2nd Affiliated Hospital, Shantou University Medical College. Informed consent was obtained from all subjects previously. The identifiers of the subjects were removed before analysis. The 1H-MRS data from 23 NPSLE patients and 16 age-matched healthy controls (HCs) were obtained at the Department of Rheumatology and Immunology of Shantou Central Hospital and the Department of Endocrinology and the Medical Examination Center of the 2nd Affiliated Hospital, Medical College of Shantou University, during April 2014 to March 2015. The inclusion criteria were as follows: (1) The group of NPSLE patients was diagnosed according to the revised 1997 American College of Rheumatology (ACR) criteria and the 1999 ACR definitions for NPSLE. All clinical manifestations were obtained at the baseline visit by a careful medical record review. In this group, patients had at least one neuropsychiatric complaints. (2) HCs did not have any neurologic, psychiatric, or systemic diseases, which would influence the results of multivoxel 1H-MRS, and none of them uses any psychoactive medication. (3) All the subjects underwent both conventional MRI examination and multivoxel 1H-MRS examination in our hospitals. (4) The clinical characteristics of all patients were available.
2.2. Magnetic Resonance Imaging
All subjects underwent MR imaging using a 3.0 T system (SIGNA, General Electric Medical Systems) with an eight-channel standard head coil. The repetition time (TR) of T2-weighted imaging was 4420 ms. The echo time (TE) was 112.1 ms. The slice thickness was 5 mm with a 1 mm gap. The matrix size was 512 × 512. The field of view (FOV) was 160 × 160 mm2. The parameters of T2-weighted imaging are listed in Table 1.
Table 1.
The parameters of T2-weighted imaging.
| Parameters | Value |
|---|---|
| Repetition time (TR) | 4420 ms |
| Echo time (TE) | 112.1 ms |
| Slice thickness | 5 mm |
| Slice gap | 1 mm |
| Matrix size | 512 × 512 |
| Field of view (FOV) | 160 × 160 mm2 |
The multivoxel 1H-MRS was based on a point-resolved spectroscopy sequence (PRESS) with a two-dimensional multivoxel technique. The TR of the multivoxel 1H-MRS was 1500 ms. The TE was 35 ms. The number of excitations (NEX) was 1. The phase × frequency = 18 × 18, and the volumesofinterest(VOIs) = 10 × 8 × 2cm3. The VOIs of 1H-MRS were placed on the T2-weighted images including the entire basal ganglion level. The parameters of multivoxel 1H-MRS are listed in Table 2.
Table 2.
The parameters of multivoxel 1H-MRS.
| Parameters | Value |
|---|---|
| Repetition time (TR) | 1500 ms |
| Echo time (TE) | 35 ms |
| Number of excitations (NEX) | 1 |
| Phase | 18 |
| Frequency | 18 |
| Volumes of interest (VOIs) | 10 × 8 × 2 cm3 |
2.3. Imaging Processing
The acquired spectroscopy data were firstly preprocessed by a SAGE software package (GE Healthcare) to correct the phase and frequency. Then, commercially available automatic LCModel software (LCModel Inc., Canada, version 6.2-2B) was used to fit the spectra, correct the baseline, relaxation, and partial-volume effects, and quantify the concentration of metabolites. Furthermore, we used the absolute NAA concentration in single-voxel MRS as the standard to gain the absolute concentration of metabolites. After that, the NAA concentration of the corresponding voxel of multivoxel MRS was collected consistently. The spectra would be accepted if the signal-to-noise ratio (SNR) is greater than or equal to 10 and the metabolite concentration with standard deviations (SD) is less than or equal to 20%. Notice that every individual metabolite has its basis spectra, even if the metabolites are hardly separated, such as NAA and N-acetylaspartylglutamate (NAAG). However, the linear combination of similar spectra of metabolic concentrations is more accurate than the individual concentrations. In this regard, we list the linear combination, together with their %SD values, in the concentration table. Concentration ratios are not easily affected by water scaling and less sensitive to relaxation and partial-volume effects. Thus, we extracted the absolute metabolic concentrations, the corresponding ratio, and the linear combination of the spectra from different brain regions, which were RPCG, LRCG, RDT, RDT, LDT, RLN LLN, RPWM, and LPWM.
2.4. Quantitative Analysis via a SVM-Based Broad Learning System
The computer-aided analysis not only is user-friendly, rapid, and low-cost for learning and operation but also avoids clinical subjective judgment [25]. Building deeper neural networks has attracted increasing interests from academies and industries [23]. However, the neural network-based deep models still suffer from nonconvex optimization, unfriendly paralleling, and uninterpretable issues [27]. In particular, when the training samples are limited, the neural network-based deep models tend to overfit the training set; e.g., the model remembers what all training samples are exactly alike but fails to distinguish the samples which they have never seen. In this regard, the conventional deep neural networks are not compatible with this task. Thus, we formulate this retrospective analysis as a classification problem, so we develop a support vector machine broad learning system (BL-SVM) for quantitative analysis to distinguish the NPSLE patients from control ones. Unlike backpropagate deep stacked architecture, the BL-SVM organizes support vector machines (SVMs) in a shallow but broad scheme. The SVMs in each layer optimally extract the data representation layer-wise even if the training samples are limited, which ensures the antisaturation property. Different from a BP-like tuning scheme developed by Wang et al. [27], our BL-SVM enables fast learning for each SVM in each layer simultaneously and without time consumption for backpropagating iteratively.
The features involved in this model were selected by recursive feature elimination (see [29] for more details). Then, we construct a training set T = {(xk, yk}, where x ∈ ℝn, y ∈ {−1, +1}, k = 1 ⋯ K, and K is the total number of training samples. We denote the ith SVM in the lth layer as svm(l, i), which can be trained by optimizing
| (1) |
For each SVM, the further away from a sample from its corresponding hyperplane, the more confident the SVM makes the classification decision. Different from Wang et al. [27], we design a new confidence function, e.g., equation (2), for the ith SVM in the lth layer, since tanh(·) is continuously differentiable everywhere.
| (2) |
The input of the SVMs in l + 1th layer is the initial input concatenating the confidence values of all SVMs in previous layers.
| (3) |
The ith SVM in the l + 1th layer takes x(l + 1) as input to calculate the confidence value y(l + 1, i). Then, we train the SVMs layer-wise. In each layer, we resample the training set for each SVM to increase the diversity of the individual SVM using the bootstrap method proposed by Zhou et al. [30].
In this study, the number of layers is set to 5. We use 3-fold cross-validation, which is a common resampling procedure in machine learning, to evaluate the performance of our metabolism-based diagnosis model, since it generally results in a less biased or less optimistic estimate of the model skill than other methods, such as a simple train/test split, especially on a dataset with limited samples. Twenty-three NPSLE patients and sixteen healthy controls were randomly divided into 3-fold. The cross-validation was conducted 50 times. For each run, 2 out of 3 subjects were selected for training, and the rest was used for testing, using different random seeds. We calculated the accuracy, sensitivity, and specificity to evaluate the performance of our model.
3. Results
3.1. Demographics
Twenty-three NPSLE patients and sixteen healthy controls met the inclusion criteria and satisfied the spectra quality detailed in our previous study [9]. Table 3 summarizes the number of NPSLE patients presenting with neuropsychiatric manifestations, including myelitis, seizure disorder, severe headache, stroke, peripheral polyneuropathy, acute confusional state, and anxiety in this study.
Table 3.
The neuropsychiatric manifestations occurring in NPSLE patients.
| Neuropsychiatric manifestations | Number |
|---|---|
| Myelitis | 1 |
| Seizure disorder | 9 |
| Severe headache | 5 |
| Stroke | 3 |
| Peripheral polyneuropathy | 2 |
| Acute confusional state | 1 |
| Anxiety | 2 |
There was no significant difference in age between NPSLE patients and the HC set (p = 0.765). Obviously, SLE was closely related to gender (p = 0.018), and 79% of the patients were females in our study. Although there was a significant difference between NPSLE and HCs, the performance of predicting NPSLE would not be influenced. As we used 3-fold cross-validation to evaluate the accuracy of our BL-SVM system, every subject had the chance to be one of the training set. Results for their demographic characters are summarized in Table 4.
Table 4.
The demographic characters of the NPSLE patients and healthy controls.
| Number | Mean age (year) | Sex (male/female) | |
|---|---|---|---|
| NPSLE | 23 | 31.71 | 2/14 |
| HC | 16 | 29.5 | 5/18 |
| p value | — | 0.765∗ | 0.018∗ |
∗Student's t-test.
3.2. Metabolic Features from Multivoxel 1H-MRS
We collected metabolic data from the bilateral posterior cingulate gyrus (PCG), dorsal thalamus (DT), lentiform nucleus (LN), and posterior paratrigonal white matter (PWM), as well as from the right insula (RI) in all subjects. The metabolic features include creatine (Cr), phosphocreatine (PCr), Cr+PCr, NAA, N-acetylaspartylglutamate (NAAG), NAA+NAAG, NAA+NAAG/Cr+PCr ratio, myo-inositol (mI), mI/Cr+PCr, glycerophosphocholine (GPC/Cho)+phosphocholine (Pch), Cho+Pch/Cr+PCr, glutamate (Glu)+glutamine (Gln), and Glu+Gln/Cr+PCr. All brain regions and metabolic features were combined into 117 metabolic features as shown in Table 5. Thirty-three features were found with significant difference (p < 0.05) between NPSLE patients and HCs: PCr and Cho+PCh in the right PCG; NAA+NAAG, NAA+NAAG/Cr+PCr, and mI in the left PCG; PCr, Cr+PCr, NAA, NAA+NAAG/Cr+PCr, mI/Cr+PCr, and Cho+PCh in the right DT; NAAG, NAA+NAAG/Cr+PCr, mI, mI/Cr+PCr, Cho+PCh, and Glu+Gln in the left DT; Cr, PCr, mI, Cho+PCh, and Cho+PCh/Cr+PCr in the right LN; PCr, mI/Cr+PCr, Cho+PCh, and Cho+PCh/Cr+PCr in the left LN; Cr and NAA in RI; PCr and Cho+PCh/Cr+PCr in the right PWM; and Cr, NAAG, and mI in the left PWM. The corresponding AUC values using these features for quantitative analysis are listed in Table 5. The AUC values generated by mI/Cr+PCr in LDT and the mI/Cr+PCr in RDT are 0.77 and 0.76, respectively, which achieve the best performance for diagnosing NPSLE among the evaluated features. Obviously, as shown in Figure 1, it is hard to distinguish the NPSLE patients and the HCs, whether by structure images or MRS alone.
Table 5.
Changes of major metabolite features detected in 1H-MRS in NPSLE patients vs. healthy controls.
| Brain region | Metabolites | HCs (n = 16) | NPSLE (n = 23) | p value | AUC |
|---|---|---|---|---|---|
| RPCG | Cr | 2.304 ± 0.473 | 3.124 ± 0.418 | 0.274 | 0.591 |
| PCr∗ | 4.184 ± 0.651 | 2.479 ± 0.583 | 0.035 | 0.588 | |
| Cr+PCr | 3.465 ± 0.506 | 2.900 ± 0.491 | 0.391 | 0.432 | |
| NAA | 4.457 ± 0.428 | 3.935 ± 0.419 | 0.478 | 0.457 | |
| NAAG∗∗ | 3.604 ± 0.550 | 3.782 ± 0.581 | 0.848 | 0.548 | |
| NAA+NAAG | 6.222 ± 0.728 | 4.996 ± 0.692 | 0.183 | 0.283 | |
| NAA+NAAG/Cr+PCr | 3.622 ± 0.776 | 5.316 ± 0.649 | 0.086 | 0.62 | |
| mI | 2.075 ± 0.388 | 2.535 ± 0.335 | 0.274 | 0.557 | |
| mI/Cr+PCr∗∗ | 2.626 ± 0.473 | 3.437 ± 0.399 | 0.165 | 0.567 | |
| Cho+PCh∗ | 5.151 ± 0.477 | 3.892 ± 0.502 | 0.039 | 0.492 | |
| Cho+PCh/Cr+PCr∗∗ | 4.138 ± 0.535 | 4.867 ± 0.377 | 0.249 | 0.466 | |
| Glu+Gln | 4.799 ± 0.503 | 4.452 ± 0.407 | 0.322 | 0.398 | |
| Glu+Gln/Cr+PCr | 4.296 ± 0.494 | 4.253 ± 0.456 | 0.953 | 0.389 | |
|
| |||||
| LPCG | Cr | 4.211 ± 0.591 | 3.452 ± 0.491 | 0.442 | 0.485 |
| PCr | 4.248 ± 0.758 | 4.125 ± 0.602 | 0.825 | 0.435 | |
| Cr+PCr∗∗ | 2.803 ± 0.620 | 3.788 ± 0.506 | 0.225 | 0.41 | |
| NAA | 4.208 ± 0.340 | 3.395 ± 0.319 | 0.104 | 0.401 | |
| NAAG | 4.681 ± 0.321 | 3.817 ± 0.437 | 0.249 | 0.444 | |
| NAA+NAAG∗∗∗ | 7.005 ± 0.497 | 6.009 ± 0.333 | 0.005 | 0.66 | |
| NAA+NAAG/Cr+PCr∗∗∗ | 7.655 ± 0.199 | 6.571 ± 0.259 | 0.006 | 0.658 | |
| mI∗ | 7.284 ± 0.207 | 6.273 ± 0.293 | 0.009 | 0.62 | |
| mI/Cr+PCr∗∗ | 6.893 ± 0.167 | 6.513 ± 0.159 | 0.132 | 0.413 | |
| Cho+PCh | 6.303 ± 0.354 | 6.395 ± 0.369 | 0.636 | 0.391 | |
| Cho+PCh/Cr+PCr | 8.776 ± 0.201 | 7.673 ± 0.486 | 0.076 | 0.457 | |
| Glu+Gln∗∗ | 5.625 ± 0.898 | 6.886 ± 0.513 | 0.595 | 0.682 | |
| Glu+Gln/Cr+PCr | 5.601 ± 0.174 | 5.385 ± 0.264 | 0.745 | 0.457 | |
|
| |||||
| RDT | Cr | 5.898 ± 0.163 | 5.931 ± 0.226 | 0.859 | 0.535 |
| PCr∗ | 9.658 ± 0.691 | 8.485 ± 0.431 | 0.008 | 0.694 | |
| Cr+PCr∗ | 10.614 ± 0.269 | 9.178 ± 0.316 | 0.001 | 0.747 | |
| NAA∗ | 8.094 ± 0.265 | 6.612 ± 0.314 | 0.002 | 0.76 | |
| NAAG | 8.705 ± 0.266 | 7.739 ± 0.382 | 0.058 | 0.576 | |
| NAA+NAAG | 7.660 ± 0.333 | 7.239 ± 0.427 | 0.636 | 0.435 | |
| NAA+NAAG/Cr+PCr∗ | 9.645 ± 0.271 | 7.703 ± 0.529 | 0.004 | 0.639 | |
| mI | 7.552 ± 1.146 | 8.459 ± 0.549 | 0.496 | 0.66 | |
| mI/Cr+PCr∗ | 8.821 ± 0.195 | 7.907 ± 0.331 | 0.041 | 0.766 | |
| Cho+PCh∗ | 9.435 ± 0.245 | 7.537 ± 0.374 | 0.001 | 0.776 | |
| Cho+PCh/Cr+PCr | 0.753 ± 0.173 | 0.852 ± 0.207 | 0.79 | 0.5 | |
| Glu+Gln | 0.830 ± 0.268 | 0.896 ± 0.219 | 0.767 | 0.478 | |
| Glu+Gln/Cr+PCr | 0.501 ± 0.197 | 0.618 ± 0.217 | 0.767 | 0.457 | |
|
| |||||
| LDT | Cr | 2.163 ± 0.388 | 1.821 ± 0.378 | 0.221 | 0.591 |
| PCr | 0.429 ± 0.263 | 0.776 ± 0.247 | 0.188 | 0.435 | |
| Cr+Cr | 1.005 ± 0.343 | 0.744 ± 0.326 | 0.274 | 0.457 | |
| NAA∗∗ | 0.923 ± 0.344 | 1.594 ± 0.275 | 0.076 | 0.639 | |
| NAAG∗∗∗ | 1.242 ± 0.161 | 0.559 ± 0.118 | 0.002 | 0.673 | |
| NAA+NAAG | 1.272 ± 0.214 | 1.010 ± 0.223 | 0.255 | 0.598 | |
| NAA+NAAG/Cr+PCr∗ | 10.263 ± 0.725 | 9.027 ± 0.449 | 0.003 | 0.735 | |
| mI∗ | 11.241 ± 0.256 | 9.843 ± 0.341 | 0.002 | 0.60 | |
| mI/Cr+PCr∗ | 8.411 ± 0.204 | 6.993 ± 0.349 | 0.002 | 0.779 | |
| Cho+PCh∗∗ | 10.063 ± 0.258 | 8.924 ± 0.224 | 0.002 | 0.685 | |
| Cho+PCh/Cr+PCr | 7.884 ± 0.328 | 7.748 ± 0.465 | 0.929 | 0.435 | |
| Glu+Gln∗ | 10.173 ± 0.233 | 8.251 ± 0.492 | 0.001 | 0.548 | |
| Glu+Gln/Cr+PCr | 8.047 ± 1.213 | 9.348 ± 0.544 | 0.615 | 0.629 | |
|
| |||||
| RLN | Cr∗ | 9.868 ± 0.231 | 8364 ± 0.362 | 0.005 | 0.648 |
| PCr∗∗∗ | 10.409 ± 0.309 | 8.383 ± 0.389 | 0.001 | 0.673 | |
| Cr+PCr∗∗ | 1.394 ± 0.098 | 1.555 ± 0.068 | 0.478 | 0.5 | |
| NAA | 1.501 ± 0.055 | 1.556 ± 0.068 | 0.359 | 0.5 | |
| NAAG | 1.163 ± 0.024 | 1.112 ± 0.029 | 0.515 | 0.5 | |
| NAA+NAAG | 1.508 ± 0.047 | 1.410 ± 0.047 | 0.225 | 0.5 | |
| NAA+NAAG/Cr+PCr | 1.323 ± 0.066 | 1.215 ± 0.079 | 0.478 | 0.5 | |
| mI∗ | 1.170 ± 0.029 | 1.044 ± 0.058 | 0.036 | 0.5 | |
| mI/Cr+PCr | 1.118 ± 0.172 | 1.358 ± 0.077 | 0.701 | 0.603 | |
| Cho+PCh∗∗∗ | 1.801 ± 0.032 | 1.611 ± 0.048 | 0.003 | 0.588 | |
| Cho+PCh/Cr+PCr∗∗∗ | 1.800 ± 0.067 | 1.461 ± 0.067 | 0.003 | 0.598 | |
| Glu+Gln | 5.246 ± 0.447 | 4.649 ± 0.582 | 0.231 | 0.482 | |
| Glu+Gln/Cr+PCr∗∗ | 5.429 ± 0.512 | 5.604 ± 0.313 | 0.836 | 0.432 | |
|
| |||||
| LLN | Cr | 4.839 ± 0.442 | 5.584 ± 0.395 | 0.107 | 0.457 |
| PCr∗ | 4.220 ± 0.296 | 5.574 ± 0.390 | 0.008 | 0.641 | |
| Cr+PCr | 3.167 ± 0.687 | 4.850 ± 0.692 | 0.076 | 0.501 | |
| NAA | 5.630 ± 0.443 | 5.205 ± 0.608 | 0.953 | 0.504 | |
| NAAG | 3.816 ± 0.642 | 5.529 ± 0.545 | 0.124 | 0.526 | |
| NAA+NAAG | 5.370 ± 0.249 | 5.819 ± 0.503 | 0.722 | 0.557 | |
| NAA+NAAG/Cr+PCr | 5.729 ± 0.304 | 5.901 ± 0.366 | 0.88 | 0.651 | |
| mI∗ | 0.703 ± 0.055 | 5.674 ± 0.071 | 0.894 | 0.5 | |
| mI/Cr+Cr∗∗ | 0.708 ± 0.628 | 5.838 ± 0.034 | 0.036 | 0.478 | |
| Cho+PCh∗∗∗ | 0.655 ± 0.061 | 0.883 ± 0.061 | 0.007 | 0.601 | |
| Cho+PCh/Cr+PCr∗∗∗ | 0.610 ± 0.038 | 0.844 ± 0.055 | 0.001 | 0.541 | |
| Glu+Gln | 0.480 ± 0.094 | 1.033 ± 0.395 | 0.132 | 0.435 | |
| Glu+Gln/Cr+PCr | 0.611 ± 0.029 | 0.667 ± 0.085 | 0.344 | 0.5 | |
|
| |||||
| RI | Cr∗ | 0.532 ± 0.095 | 0.786 ± 0.062 | 0.005 | 0.603 |
| PCr | 0.944 ± 0.037 | 1.109 ± 0.067 | 0.193 | 0.5 | |
| Cr+PCr | 0.982 ± 0.047 | 1.016 ± 0.044 | 0.478 | 0.5 | |
| NAA∗ | 1.322 ± 0.093 | 1.179 ± 0.072 | 0.023 | 0.457 | |
| NAAG | 1.667 ± 0.050 | 1.548 ± 0.078 | 0.124 | 0.5 | |
| NAA+NAAG | 2.107 ± 0.071 | 2.051 ± 0.019 | 0.615 | 0.5 | |
| NAA+NAAG/Cr+PCr∗∗ | 1.983 ± 0.061 | 1.893 ± 0.063 | 0.261 | 0.5 | |
| mI | 1.561 ± 0.094 | 1.668 ± 0.012 | 0.209 | 0.466 | |
| mI/Cr+PCr | 2.285 ± 0.696 | 2.153 ± 0.131 | 0.626 | 0.5 | |
| Cho+PCh∗∗ | 1.496 ± 0.240 | 1.872 ± 0.138 | 0.329 | 0.603 | |
| Cho+PCh/Cr+PCr | 2.056 ± 0.088 | 1.895 ± 0.098 | 0.425 | 0.5 | |
| Glu+Gln | 2.127 ± 0.068 | 2.034 ± 0.076 | 0.461 | 0.5 | |
| Glu+Gln/Cr+PCr | 0.176 ± 0.012 | 0.201 ± 0.011 | 0.359 | 0.5 | |
|
| |||||
| RPWM | Cr | 0.220 ± 0.008 | 0.232 ± 0.008 | 0.442 | 0.5 |
| PCr∗ | 0.292 ± 0.007 | 0.330 ± 0.011 | 0.008 | 0.5 | |
| Cr+PCr | 0.292 ± 0.006 | 0.292 ± 0.005 | 0.859 | 0.5 | |
| NAA | 0.253 ± 0.011 | 0.261 ± 0.018 | 0.657 | 0.5 | |
| NAAG | 0.260 ± 0.006 | 0.274 ± 0.017 | 0.274 | 0.5 | |
| NAA+NAAG | 0.201 ± 0.030 | 0.263 ± 0.013 | 0.174 | 0.5 | |
| NAA+NAAG/Cr+PCr | 0.381 ± 0.015 | 0.372 ± 0.018 | 0.723 | 0.5 | |
| mI | 0.369 ± 0.012 | 0.355 ± 0.013 | 0.329 | 0.5 | |
| mI/Cr+PCr | 15.876 ± 1.396 | 14.623 ± 0.850 | 0.165 | 0.622 | |
| Cho+PCh | 15.208 ± 1.396 | 14.357 ± 0.687 | 0.132 | 0.495 | |
| Cho+PCh/Cr+PCr∗∗∗ | 15.249 ± 0.636 | 11.941 ± 1.002 | 0.01 | 0.576 | |
| Glu+Gln | 11.651 ± 0.901 | 13.566 ± 0.755 | 0.261 | 0.432 | |
| Glu+Gln/Cr+PCr∗∗ | 8.923 ± 1.758 | 12.151 ± 1.041 | 0.104 | 0.535 | |
|
| |||||
| LPWM | Cr∗ | 17.459 ± 0.726 | 14.326 ± 1.757 | 0.005 | 0.726 |
| PCr∗∗ | 10.796 ± 1.628 | 14.001 ± 0.975 | 0.375 | 0.735 | |
| Cr+PCr | 11.579 ± 0.701 | 10.167 ± 0.996 | 0.79 | 0.704 | |
| NAA | 11.621 ± 0.585 | 11.756 ± 0.604 | 0.813 | 0.457 | |
| NAAG∗ | 2.113 ± 0.163 | 2.569 ± 0.145 | 0.036 | 0.5 | |
| NAA+NAAG∗∗ | 2.028 ± 0.149 | 2.267 ± 0.138 | 1 | 0.5 | |
| NAA+NAAG/Cr+PCr∗∗ | 2.089 ± 0.083 | 1.855 ± 0.154 | 0.225 | 0.5 | |
| mI∗ | 1.668 ± 0.119 | 2.094 ± 0.116 | 0.033 | 0.516 | |
| mI/Cr+PCr | 1.526 ± 0.288 | 1.788 ± 0.147 | 0.679 | 0.548 | |
| Cho+PCh | 2.007 ± 0.097 | 1.875 ± 0.244 | 0.132 | 0.603 | |
| Cho+PCh/Cr+PCr | 1.499 ± 0.236 | 1.996 ± 0.117 | 0.091 | 0.603 | |
| Glu+Gln | 2.004 ± 0.077 | 1.925 ± 0.159 | 0.515 | 0.5 | |
| Glu+Gln/Cr+PCr | 2.028 ± 0.079 | 2.153 ± 0.158 | 0.813 | 0.5 | |
∗Metabolites with significant difference (p < 0.05). ∗∗Metabolites for our model. ∗∗∗Metabolites for our model and metabolites with significant difference (p < 0.05).
Figure 1.

(a) and (b) are the axial view of the basal ganglion slice obtained by multivoxel MRS from HCs, whereas (c) and (d) are from NPSLE patients. (e) and (f) are the attained spectra of the volumes by LCModel from HCs corresponding to the axial view (a) and (b), respectively, whereas (g) and (h) are from NPSLE patients corresponding to the axial view (c) and (d), respectively. NAA is the abbreviation for N-acetylaspartate, NAAG is the abbreviation for N-acetylaspartylglutamate, Cho is the abbreviation for choline, tCr is the abbreviation for total creatine, mI is the abbreviation for myo-inositol, and Glx is the abbreviation for glutamine+glutamate. The chemical shift values in (e)–(h) ranging from 4.0 ppm (leftmost) to 0.2 ppm (rightmost) are divided into 38 equally spaced intervals, e.g., 1 ppm per interval. From (a) to (h), the visual differences of the axial view of the basal ganglion slices and the spectra of the volumes from NPSLE patients and HCs are subtle.
3.3. Metabolic Features for the BL-SVM System
We employed a feature selection method, e.g., recursive feature elimination [29], to analyse which metabolite or combination of metabolites was closely related to NPSLE and filter out weak features to avoid overfitting. We first built the model on the entire set of metabolite features and computed an importance score for each feature. Then, the least important feature was removed from the current feature set. We retrained the model and computed the important score again. We repeat this step on the feature set until the specified number of features were selected. In the end, we found 26 features that were of the highest importance, as shown in Figure 2. The 26 features were as follows: NAAG, mI/Cr+PCr, and Glu+Gln/Cr+PCr in the right PCG; Cr+PCr, NAA+NAAG, NAA+NAAG/Cr+PCr, mI/Cr+PCr, and Glu+Gln in the left PCG; NAA, NAAG, and Cho+PCh in the left DT; PCr, Cr+PCr, Cho+PCh, Cho+PCh/Cr+PCr, and Glu+Gln/Cr+PCr in the right LN; mI/Cr+PCr, Cho+PCh, and Cho+PCh/Cr+PCr in the left LN; NAA+NAAG/Cr+PCr and Cho+PCh in RI; Cho+PCh/Cr+PCr and Glu+Gln/Cr+PCr in the right PWM; and PCr, NAAG, and NAA+NAAG/Cr+PCr in the left PWM.
Figure 2.

Cross-validation score by the number of features selected by recursive feature elimination.
However, these features had a complex nonlinear relationship, which made our diagnosis quite challenging. This motivated us to leverage the kernel tricks of the SVM classifier to map the features into a higher dimensional space to make the samples linearly separable. With the selected features, we evaluated the performance of our BL-SVM system on a ROC curve as shown in Figure 3. The AUC, sensitivity, and specificity were 95%, 95.8%, and 93%, respectively.
Figure 3.

The receiver operating characteristic of the BL-SVM system for diagnosing NPSLE.
To estimate the generalization capacity of the proposed model, we perform the cross-validation for 50 times. In each run, we feed a different random seed for the resampling procedure. Two-thirds of samples are for training, and the rest is for testing. The scores of the AUC, sensitivity, and specificity are plotted in a box diagram in Figure 4. The box plot demonstrates that the model is capable of unseeing samples in each run.
Figure 4.

The score of the AUC, sensitivity, and specificity referring to the cross-validation for 50 times.
4. Discussions
In this study, we retrospectively analysed the diagnosis of the NPSLE using multivoxel 1H-MRS. Each metabolic feature hardly identified the NPSLE patients from the HCs precisely and was even insignificant to NPSLE. We introduced a support vector machine-based deep-stacked network to quantitatively analyse the metabolic features. The result has shown that this model has good robustness, even there were several missing values of metabolic features caused by the noise of spectra. Furthermore, this model can accurately distinguish NPSLE patients from the HCs, although individual feature does not even manifest statistics significantly, which is better than any single metabolic feature. The results indicated that this model can be a helpful noninvasive computer-aided diagnostic tool for quantitative analysis of NPSLE.
The clinical complications of NPSLE severely affect the patients in their quality of work and life, which also consume a large amount of money. Therefore, the examination methods of early diagnosis and prediction of NPSLE have aroused wide attention; increasingly, laboratory biomarkers and neuroimaging tools have been proposed [31–34].
The production of autoantibodies was used to be a diagnostic biomarker of SLE, and 116 autoantibodies had been found in a literature review using the keywords autoantibodies and systemic lupus erythematosus [35]. Various autoantibodies are reported that can be used as diagnostic biomarkers, since one of these autoantibodies had a significant difference between NPSLE and SLE patients and healthy controls. Most studies were explorative studies, which were short of repeatability. Segovia-Miranda et al. [36] have confirmed that the antiribosomal P (RP) antibody is related to cognitive dysfunction and other diffuse neuropsychiatric manifestations of NPSLE by altering glutamatergic synaptic transmission in the hippocampus. However, there was a recent study conflicted with their results, which suggested that the anti-P ribosomal antibodies have limited diagnostic value for NPSLE [37].
In this case, advanced neuroimaging technologies were needed urgently. In vivo multivoxel MRS allows simultaneously measuring the level of metabolites in several brain regions within a single slice [8] However, a standard for the choice of metabolites and brain regions is not available until now. Single metabolite or the ratio between two metabolites have been used to diagnose NPSLE in most studies [22, 38–40]. There will be numerous exploratory biomarkers for diagnosing NPSLE by applying the previous laboratory and neuroimaging methods. However, accuracy needs to be further improved. Thus, more advanced machine learning methodologies are urgently required.
Broad learning systems are an alternative way to address the time-consuming training process and nonconvex issues, especially when the structure is insufficient to model the system [28]. Support vector machines are a succinct model with convexity optimization property to learn sample-limited data with complicated features [27]. We rethink the potential of SVM in diagnosing NPSLE, and we reconstruct the broad learning system to increase the diversity of features that the SVMs learned. To demonstrate the advantage of SVM-based broad learning systems for diagnosing NPSLE, we compared the BL-SVM with traditional statistical methods that were frequently used for diagnosing NPSLE. Guillen-Del Castillo et al. [41] suggested that the increased mI in normal parietal white matter and parietal white matter demonstrates a strong relationship to the deteriorated prognosis in NPSLE. In our study, the best accuracy of mI in parietal white matter was only 51.6%. For other single metabolites described in previous studies, such as NAA [42], Cho, and Cr [43], used in our model, the best accuracy was 75% in the right DT, 72% in the left PWM, and 77% in the right DT, respectively. It is also not known whether metabolite ratios could improve diagnostic accuracy. Cagonoli et al. proposed that NAA/Cr ratios and Glu/Cr ratios in RI might be biomarkers for NPSLE patients [44]. However, in our study, the accuracy of NAA/Cr ratios and Glu/Cr ratios in RI was both only 50%. Overall, thirty-three features were selected using conventional statistical methods, and the best accuracy among them was only 77%, whereas the BL-SVM system with the metabolic features from multivoxel 1H-MRS achieved 95% AUC, 95.8% sensitivity, and 93% specificity, respectively. To confirm that no overfitting occurred in our experiment, we performed 3-fold cross-validation to demonstrate the generalization ability of our BL-SVM system. It is worth noting that there were 26 features of eight brain regions of NPSLE patients that showed the optimal performance to diagnose NPSLE. So we should realize that single 1H-MRS may not suitably be used to diagnose NPSLE, because it was restricted to one small region, which missed important pieces of information. What is more, our study confirmed that not only should the absolute concentration of metabolites be considered but also the combination between them, such as NAA+NAAG, Glu+Gln/Cr+Pcr, and mI/Cr+Pcr. The BL-SVM system with the metabolic features from multivoxel 1H-MRS as a novel tool should be popularized in the diagnosis of NPSLE, though some studies have combined machine learning and 1H-MRS to increase the sensitivity and specificity for distinguishing diseases [14, 45, 46]. However, to the best of our knowledge, the current study is the first to use machine learning-based metabolic features to improve the accuracy of 1H-MRS to diagnose NPSLE. Our BL-SVM has achieved a specific performance for the following reasons. First, the kernels map the features into a higher dimensional space to empower the SVMs to split the samples linearly [47], which enables the BL-SVM system to distinguish NPSLE patients from HCs. Secondly, the BL-SVM system can learn to deal with the unavoidable absent metabolic feature value caused by patients moving, partial-volume effect, and overlapping among metabolites, which demonstrated the good robustness of our model. The BL-SVM learning system is general and can be extended to other applications, such as intelligent transportation systems [48–55], intelligent computing [56, 57], and emotion computing [58–60].
4.1. Limitations
However, there were some limitations in our study. First, the samples are limited. Although the number of samples is important for evaluating the generalization ability of a model, cross-validation is one of the alternative techniques by resampling to evaluate the generalization capacity of a machine learning model, when we have limited samples. We apply 3-fold cross-validation to evaluate the performance of the presented model 50 times. The results indicate the proposed model capable of unseeing samples. Besides, we have been collecting new samples to evaluate our model and develop new models. Secondly, other advanced medical imaging technologies should be considered to combine with 1H-MRS in this system, such as voxel-based morphometry, diffusional kurtosis imaging, and chemical exchange saturation transfer [61–65].
5. Conclusion
In this retrospective study, we confirm that the metabolic features obtained by multivoxel proton magnetic resonance spectroscopy can be used to diagnose neuropsychiatric systemic lupus erythematosus by a well-trained support vector machine broad learning system. The support vector machine broad learning system achieves satisfactory AUC, sensitivity, and specificity as 95%, 95.8%, and 93%, respectively. We have also found that the support vector machine broad learning system can even leverage the metabolic features that were not regarded as statistically significant to distinguish the NPSLE patients from HC ones. Furthermore, our support vector machine broad learning system overcame the situation of limited samples with missing metabolic feature values.
In conclusion, the multivoxel proton magnetic resonance spectroscopy enhanced by our support vector machine broad learning system may brighten the computer-aided noninvasive diagnostic instrument for neuropsychiatric systemic lupus erythematosus in vivo.
Acknowledgments
This work was supported by the NSFC (Nos. 81471730, 82020108016, 61902232 and 31870981), the Natural Science Foundation of Guangdong Province (No. 2018A030313291), the Education Science Planning Project of Guangdong Province (2018GXJK048), the Grant for Key Disciplinary Project of Clinical Medicine under the Guangdong High-Level University Development Program (002-18120302), the 2020 Li Ka Shing Foundation Cross-Disciplinary Research Grant (No. 2020LKSFG05D), the STU Scientific Research Foundation for Talents (NTF18006), and the Guangdong Special Cultivation Funds for College Students' Scientific and Technological Innovation (No. pdjh2020b0222).
Contributor Information
Teng Zhou, Email: zhouteng@stu.edu.cn.
Renhua Wu, Email: rhwu@stu.edu.cn.
Data Availability
The 1H-MRS data used to support the findings of this study have not been made available for the private protection of patient information.
Conflicts of Interest
The authors declare that they have no conflict of interest.
Authors' Contributions
Yan Li and Zuhao Ge contribute equally to this work.
References
- 1.Kaul A., Gordon C., Crow M. K., et al. Systemic lupus erythematosus. Nature Reviews Disease Primers. 2016;2(1) doi: 10.1038/nrdp.2016.39. [DOI] [PubMed] [Google Scholar]
- 2.Costallat B. L., Ferreira D. M., Lapa A. T., Rittner L., Costallat L. T. L., Appenzeller S. Brain diffusion tensor MRI in systematic lupus erythematosus: a systematic review. Autoimmunity Reviews. 2018;17(1):36–43. doi: 10.1016/j.autrev.2017.11.008. [DOI] [PubMed] [Google Scholar]
- 3.Papadaki E., Fanouriakis A., Kavroulakis E., et al. Neuropsychiatric lupus or not? Cerebral hypoperfusion by perfusion-weighted MRI in normal-appearing white matter in primary neuropsychiatric lupus erythematosus. Annals of the Rheumatic Diseases. 2018;77(3):441–448. doi: 10.1136/annrheumdis-2017-212285. [DOI] [PubMed] [Google Scholar]
- 4.Duarte-Delgado N. P., Vásquez G., Ortiz-Reyes B. L. Blood-brain barrier dis-ruption and neuroinflammation as pathophysiological mechanisms of the diffuse manifestations of neuropsychiatric systemic lupus erythematosus. Autoimmunity Reviews. 2019;18(4):426–432. doi: 10.1016/j.autrev.2018.12.004. [DOI] [PubMed] [Google Scholar]
- 5.Govoni M., Bortoluzzi A., Padovan M., et al. The diagnosis and clinical management of the neuropsychiatric manifestations of lupus. Journal of Autoimmunity. 2016;74:41–72. doi: 10.1016/j.jaut.2016.06.013. [DOI] [PubMed] [Google Scholar]
- 6.Corzillius M., Bae S. C., Lew R. A., et al. The American College of Rheumatology nomenclature and case definitions for neuropsychiatric lupus syndromes. Arthritis and Rheumatism. 1999;42(4):599–608. doi: 10.1002/1529-0131(199904)42:4<599::AID-ANR2>3.0.CO;2-F. [DOI] [PubMed] [Google Scholar]
- 7.Silvagni E., Bortoluzzi A., Borrelli M., Padovan M., Furini F., Govoni M. Conventional brain magnetic resonance imaging in the longitudinal evaluation of newly diagnosed systemic lupus erythematosus patients: a retrospective analysis from a single-centre cohort. Lupus. 2020;29(5):499–504. doi: 10.1177/0961203320909955. [DOI] [PubMed] [Google Scholar]
- 8.Li H., Xu H., Zhang Y., et al. Differential neurometabolite alterations in brains of medication-free individuals with bipolar disorder and those with unipo-Lar depression: a two-dimensional proton magnetic resonance spectroscopy study. Bipolar Disorders. 2016;18(7):583–590. doi: 10.1111/bdi.12445. [DOI] [PubMed] [Google Scholar]
- 9.Zhang Z., Wang Y., Shen Z., et al. The neurochemical and microstructural changes in the brain of systemic lupus erythematosus patients: a multimodal MRI study. Scientific Reports. 2016;6(1) doi: 10.1038/srep19026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Magro-Checa C., Ercan E., Wolterbeek R., et al. Changes in white matter microstructure suggest an Inflammatory origin of neuropsychiatric systemic lupus erythematosus. Arthritis & Rheumatology. 2016;68(8):1945–1954. doi: 10.1002/art.39653. [DOI] [PubMed] [Google Scholar]
- 11.al-Obaidi M., Saunders D., Brown S., et al. Evaluation of magnetic resonance imaging abnormalities in juvenile onset neuropsychiatric systemic lupus erythematosus. Clinical Rheumatology. 2016;35(10):2449–2456. doi: 10.1007/s10067-016-3376-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Wang S., Tan S., Gao Y., et al. Learning joint-sparse codes for calibration-free parallel MR imaging. IEEE Transactions on Medical Imaging. 2018;37(1):251–261. doi: 10.1109/TMI.2017.2746086. [DOI] [PubMed] [Google Scholar]
- 13.Chen Q., Xie G., Luo C., et al. A dedicated 36-channel receive array for fetal MRI at 3t. IEEE Transactions on Medical Imaging. 2018;37(10):2290–2297. doi: 10.1109/TMI.2018.2839191. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Qi C., Li Y., Fan X., et al. A quantitative SVM approach potentially improves the accuracy of magnetic resonance spectroscopy in the preoperative evaluation of the grades of diffuse gliomas. NeuroImage: Clinical. 2019;23:p. 101835. doi: 10.1016/j.nicl.2019.101835. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Krahe J., Binkofski F., Schulz J. B., Reetz K., Romanzetti S. Neurochemical profiles in hereditary ataxias: a meta-analysis of magnetic resonance spectroscopy studies. Neuroscience & Biobehavioral Reviews. 2020;108:854–865. doi: 10.1016/j.neubiorev.2019.12.019. [DOI] [PubMed] [Google Scholar]
- 16.Mora P., Pons A., Cos M., et al. Magnetic resonance spectroscopy in posterior fossa tumours: the tumour spectroscopic signature may improve discrimination in adults among haemangioblastoma, ependymal tumours, medulloblastoma, and metastasis. European Radiology. 2019;29(6, article 5879):2792–2801. doi: 10.1007/s00330-018-5879-z. [DOI] [PubMed] [Google Scholar]
- 17.Jelen L. A., King S., Horne C. M., Lythgoe D. J., Young A. H., Stone J. M. Functional magnetic resonance spectroscopy in patients with schizophrenia and bipolar affective disorder: glutamate dynamics in the anterior cingulate cortex during a working memory task. European Neuropsychopharmacology. 2019;29(2):222–234. doi: 10.1016/j.euroneuro.2018.12.005. [DOI] [PubMed] [Google Scholar]
- 18.Zeng G., Penninkilampi R., Chaganti J., Montagnese S., Brew B. J., Danta M. A meta-analysis of magnetic resonance spectroscopy in the diagnosis of hepatic encephalopathy. Neurology. 2020;94(11):e1147–e1156. doi: 10.1212/WNL.0000000000008899. [DOI] [PubMed] [Google Scholar]
- 19.Wilson M., Andronesi O., Barker P. B., et al. Methodological consensus on clinical proton MRS of the brain: review and recommendations. Magnetic Resonance in Medicine. 2019;82(2):527–550. doi: 10.1002/mrm.27742. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Hanly J. G., Kozora E., Beyea S. D., Birnbaum J. Nervous system disease in systemic lupus erythematosus: current status and future directions. Arthritis & Rheumatology. 2018;71(1):33–42. doi: 10.1002/art.40591. [DOI] [PubMed] [Google Scholar]
- 21.Son C.-N., Kim S.-H., Chang H. W., Kim J.-M. A neurometabolite study of chronic daily headache in patients with systemic lupus erythematosus using magnetic resonance spectroscopy: comparison with fibromyalgia patients and healthy controls. The Korean Journal of Internal Medicine. 2016;31(6):1171–1177. doi: 10.3904/kjim.2015.196. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Zimny A., Szmyrka-Kaczmarek M., Szewczyk P., et al. In vivo evaluation of brain damage in the course of systemic lupus erythematosus using magnetic resonance spectroscopy, perfusion-weighted and diffusion-tensor imaging. Lupus. 2013;23(1):10–19. doi: 10.1177/0961203313511556. [DOI] [PubMed] [Google Scholar]
- 23.LeCun Y., Bengio Y., Hinton G. Deep learning. Nature. 2015;521(7553):436–444. doi: 10.1038/nature14539. [DOI] [PubMed] [Google Scholar]
- 24.Zhou T., Han G., Li B. N., et al. Quantitative analysis of patients with celiac disease by video capsule endoscopy: a deep learning method. Computers in Biology and Medicine. 2017;85:1–6. doi: 10.1016/j.compbiomed.2017.03.031. [DOI] [PubMed] [Google Scholar]
- 25.Li B. N. N., Wang X., Wang R., et al. Celiac disease detection from Videocapsule endoscopy images using strip principal component analysis. IEEE/ACM Transactions on Computational Biology and Bioinformatics. 2020:1–10. doi: 10.1109/tcbb.2019.2953701. [DOI] [PubMed] [Google Scholar]
- 26.Song Y., Yu Z., Zhou T., et al. CNN in CT image segmentation: beyond loss function for exploiting ground truth images. 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI); April 2020; Iowa City, IA, USA. pp. 1–4. [DOI] [Google Scholar]
- 27.Wang J., Feng K., Wu J. SVM-based deep stacking networks. 2019. http://arxiv.org/abs/1902.05731.
- 28.Chen C. P., Liu Z. Broad learning system: an effective and efficient incremental learning system without the need for deep architecture. IEEE Transactions on Neural Networks and Learning Systems. 2018;29(1):10–24. doi: 10.1109/TNNLS.2017.2716952. [DOI] [PubMed] [Google Scholar]
- 29.Guyon I., Weston J., Barnhill S., Vapnik V. Gene selection for cancer classification using support vector machines. Machine Learning. 2002;46(1/3):389–422. doi: 10.1023/A:1012487302797. [DOI] [Google Scholar]
- 30.Zhou T., Han G., Xu X., et al. δ-agree AdaBoost stacked autoencoder for short-term traffic flow forecasting. Neurocomputing. 2017;247:31–38. doi: 10.1016/j.neucom.2017.03.049. [DOI] [Google Scholar]
- 31.Li X., Xiang X., Sun J., et al. Prevalence, outcome and prognostic factors of neuropsychiatric systemic lupus erythematosus: a real world single center study. Modern Rheumatology. 2020;30(2):321–326. doi: 10.1080/14397595.2019.1589912. [DOI] [PubMed] [Google Scholar]
- 32.Lu F., Lu H., Xie M., et al. Limited preventive effect of prednisone on neuropsychiatric symptoms in murine systemic lupus erythematosus. Inflammopharmacology. 2019;27(3):511–520. doi: 10.1007/s10787-019-00587-4. [DOI] [PubMed] [Google Scholar]
- 33.Jia J., Xie J., Li H., et al. Cerebral blood flow abnormalities in neuropsychiatric systemic lupus erythematosus. Lupus. 2019;28(9):1128–1133. doi: 10.1177/0961203319861677. [DOI] [PubMed] [Google Scholar]
- 34.Magro-Checa C., Steup-Beekman G. M., Huizinga T. W., van Buchem M. A., Ronen I. Laboratory and neuroimaging biomarkers in neuropsychiatric systemic lupus erythematosus: where do we stand, where to go? Frontiers in Medicine. 2018;5:p. 340. doi: 10.3389/fmed.2018.00340. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Colasanti T., Delunardo F., Margutti P., et al. Autoantibodies involved in neuropsychiatric manifestations associated with systemic lupus erythematosus. Journal of Neuroimmunology. 2009;212(1-2):3–9. doi: 10.1016/j.jneuroim.2009.05.003. [DOI] [PubMed] [Google Scholar]
- 36.Segovia-Miranda F., Serrano F., Dyrda A., et al. Pathogenicity of lupus anti–ribosomal p antibodies: role of ccross-reacting neuronal surface p antigen in glutamatergic transmission and plasticity in a mouse model. Arthritis & Rheumatology. 2015;67(6):1598–1610. doi: 10.1002/art.39081. [DOI] [PubMed] [Google Scholar]
- 37.Hirohata S., Sakuma Y., Matsueda Y., Arinuma Y., Yanagida T. Role of serum autoantibodies in blood brain barrier damages in neuropsychiatric systemic lupus erythematosus. Clinical and Experimental Rheumatology. 2018;36(6):1003–1007. [PubMed] [Google Scholar]
- 38.Peterson P., Howe F., Clark C., Axford J. Quantitative magnetic resonance imaging in neuropsychiatric systemic lupus erythematosus. Lupus. 2016;12(12):897–902. doi: 10.1191/0961203303lu499oa. [DOI] [PubMed] [Google Scholar]
- 39.Govoni M., Castellino G., Padovan M., Borrelli M., Trotta F. Recent advances and future perspective in neuroimaging in neuropsychiatric systemic lupus erythematosus. Lupus. 2004;13(3):149–158. doi: 10.1191/0961203304lu1000rr. [DOI] [PubMed] [Google Scholar]
- 40.Donaldson M. J., Lim L., Harper C. A., Mackenzie J., G Campbell W. Primary treatment of choroidal amelanotic melanoma with photodynamic therapy. Clinical & Experimental Ophthalmology. 2005;33(5):548–549. doi: 10.1111/j.1442-9071.2005.01083.x. [DOI] [PubMed] [Google Scholar]
- 41.Guillen-del Castillo A., Alonso J., Martínez-Valle F., et al. Increased myoinositol in parietal white and gray matter as a biomarker of poor prognosis in neuropsychiatric lupus: a case report. Lupus. 2014;23(10):1073–1078. doi: 10.1177/0961203314534303. [DOI] [PubMed] [Google Scholar]
- 42.Kim H. K., Han M., Lee H. J. Corticobulbar tract involvement in neuropsychiatric systemic lupus erythematosus: a case report. Iranian Journal of Radiology. 2016;13(3) doi: 10.5812/iranjradiol.32927. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Brooks W. M., Sibbitt W. L., Jr., Kornfeld M., Jung R. E., Bankhurst A. D., Roldan C. A. The histopathologic associates of neurometabolite abnormalities in fatal neuropsychiatric systemic lupus erythematosus. Arthritis and Rheumatism. 2010;62(7):2055–2063. doi: 10.1002/art.27458. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Cagnoli P., Harris R. E., Frechtling D., et al. Reduced insular glutamine and n-acetylaspartate in systemic lupus Erythematosus. Academic radiology. 2013;20(10):1286–1296. doi: 10.1016/j.acra.2013.07.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Zhang W., Nery F. G., Tallman M. J., et al. Individual prediction of symptomatic converters in youth offspring of bipolar parents using proton magnetic resonance spectroscopy. European Child & Adolescent Psychiatry. 2020 doi: 10.1007/s00787-020-01483-x. [DOI] [PubMed] [Google Scholar]
- 46.Tsuda M., Asano S., Kato Y., Murai K., Miyazaki M. Differential diagnosis of multiple system atrophy with predominant parkinsonism and Parkinson's disease using neural networks. Journal of the Neurological Sciences. 2019;401:19–26. doi: 10.1016/j.jns.2019.04.014. [DOI] [PubMed] [Google Scholar]
- 47.Lyu J., Nakarmi U., Liang D., Sheng J., Ying L. Kernl: kernel-based nonlinear approach to parallel MRI reconstruction. IEEE Transactions on Medical Imaging. 2019;38(1):312–321. doi: 10.1109/TMI.2018.2864197. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Zhou T., Han G., Xu X., Han C., Huang Y., Qin J. A learning-based multimodel integrated framework for dynamic traffic flow forecasting. Neural Processing Letters. 2019;49(1):407–430. doi: 10.1007/s11063-018-9804-x. [DOI] [Google Scholar]
- 49.Zhou T., Jiang D., Lin Z., Han G., Xu X., Qin J. Hybrid dual Kalman filtering model for short-term traffic flow forecasting. IET Intelligent Transport Systems. 2019;13(6):1023–1032. doi: 10.1049/iet-its.2018.5385. [DOI] [Google Scholar]
- 50.Cai L., Chen Q., Cai W., Xu X., Zhou T., Qin J. Svrgsa: a hybrid learning based model for short-term traffic flow forecasting. IET Intelligent Transport Systems. 2019;13(9):1348–1355. doi: 10.1049/iet-its.2018.5315. [DOI] [Google Scholar]
- 51.Cai L., Zhang Z., Yang J., Yu Y., Zhou T., Qin J. A noise-immune Kalman filter for short-term traffic flow forecasting. Physica A: Statistical Mechanics and its Applications. 2019;536:p. 122601. doi: 10.1016/j.physa.2019.122601. [DOI] [Google Scholar]
- 52.Zhang S., Song Y., Jiang D., Zhou T., Qin J. Noise-identified Kalman filter for short-term traffic flow forecasting. 2019 15th International Conference on Mobile Ad-Hoc and Sensor Networks (MSN); Dec. 2019; Shenzhen, China. pp. 1–5. [DOI] [Google Scholar]
- 53.Cai W., Yang J., Yu Y., Song Y., Zhou T., Qin J. PSO-ELM: a hybrid learning model for short-term traffic flow forecasting. IEEE Access. 2020;8:6505–6514. doi: 10.1109/ACCESS.2019.2963784. [DOI] [Google Scholar]
- 54.Cai L., Yu Y., Zhang S., Song Y., Xiong Z., Zhou T. A Sample-Rebalanced Outlier-Rejected k -Nearest Neighbor Regression Model for Short-Term Traffic Flow Forecasting. IEEE Access. 2020;8:22686–22696. doi: 10.1109/access.2020.2970250. [DOI] [Google Scholar]
- 55.Lu H., Huang D., Song Y., Jiang D., Zhou T., Qin J. St-trafficnet: a spatial-temporal deep learning network for traffic forecasting. Electronics. 2020;9(9):p. 1474. doi: 10.3390/electronics9091474. [DOI] [Google Scholar]
- 56.Jiang D., Liu Z., Zheng L., Chen J. Factorization meets neural networks: a scalable and efficient recommender for solving the new user problem. IEEE Access. 2020;8:18350–18361. doi: 10.1109/ACCESS.2020.2968297. [DOI] [Google Scholar]
- 57.Liu C., Cao W., Wu S., et al. Asymmetric graph-guided multitask survival analysis with self-paced learning. IEEE Transactions on Neural Networks and Learning Systems. 2020:1–13. doi: 10.1109/TNNLS.2020.3028453. [DOI] [PubMed] [Google Scholar]
- 58.Jiang D., Wu K., Chen D., et al. A probability and integrated learning based classification algorithm for high-level human emotion recognition problems. Measurement. 2020;150:p. 107049. doi: 10.1016/j.measurement.2019.107049. [DOI] [Google Scholar]
- 59.Xiao G., Tu G., Zheng L., et al. Multimodality sentiment analysis in social internet of things based on hierarchical attentions and csattcn with mbm network. IEEE Internet of Things Journal. 2020 doi: 10.1109/JIOT.2020.3015381. [DOI] [Google Scholar]
- 60.Jiang D., Tu G., Jin D., et al. A hybrid intelligent model for acute hypotensive episode prediction with large-scale data. Information Sciences. 2021;546:787–802. doi: 10.1016/j.ins.2020.08.033. [DOI] [Google Scholar]
- 61.Wu R., Xiao G., Zhou I. Y., Ran C., Sun P. Z. Quantitative chemical exchange saturation transfer (qCEST) MRI - omega plot analysis of RF-spillover-corrected inverse CEST ratio asymmetry for simultaneous determination of labile proton ratio and exchange rate. NMR in biomedicine. 2015;28(3):376–383. doi: 10.1002/nbm.3257. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Lin G., Zhuang C., Shen Z., et al. Apt weighted MRI as an effective imaging protocol to predict clinical outcome after acute ischemic stroke. Frontiers in Neurology. 2018;9:p. 901. doi: 10.3389/fneur.2018.00901. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Jia Y., Wang C., Zheng J., et al. Novel nanomedicine with a chemical-exchange saturation transfer effect for breast cancer treatment in vivo. Journal of Nanobiotechnology. 2019;17(1):p. 123. doi: 10.1186/s12951-019-0557-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Guan J., Ding Y., Rong Y., et al. Early life stress increases brain glutamate and induces neurobehavioral manifestations in rats. ACS Chemical Neuroscience. 2020 doi: 10.2139/ssrn.3546019. [DOI] [PubMed] [Google Scholar]
- 65.Li X., Bai L., Ge Z., Lin Z., Yang X., Zhou T. Early diagnosis of neuropsychiatric systemic lupus erythematosus by deep learning enhanced magnetic resonance spectroscopy. Journal of Medical Imaging and Health Informatics. 2021;5 [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The 1H-MRS data used to support the findings of this study have not been made available for the private protection of patient information.
