Skip to main content
Disease Markers logoLink to Disease Markers
. 2021 Jun 9;2021:9963824. doi: 10.1155/2021/9963824

Machine Learning of Schizophrenia Detection with Structural and Functional Neuroimaging

Dafa Shi 1, Yanfei Li 1, Haoran Zhang 1, Xiang Yao 1, Siyuan Wang 1, Guangsong Wang 1, Ke Ren 1,
PMCID: PMC8208855  PMID: 34211615

Abstract

Schizophrenia (SZ) is a severe psychiatric illness, and it affects around 1% of the general population; however, its reliable diagnosis is challenging. Functional MRI (fMRI) and structural MRI (sMRI) are useful techniques for investigating the functional and structural abnormalities of the human brain, and a growing number of studies have reported that multimodal brain data can improve diagnostic accuracy. Machine learning (ML) is widely used in the diagnosis of neuroscience and neuropsychiatry diseases, and it can obtain high accuracy. However, the conventional ML which concatenated the features into a longer feature vector could not be sufficiently effective to combine different features from different modalities. There are considerable controversies over the use of global signal regression (GSR), and few studies have explored the role of GSR in ML in diagnosing neurological diseases. The current study utilized fMRI and sMRI data to implement a new method named multimodal imaging and multilevel characterization with multiclassifier (M3) to classify SZs and healthy controls (HCs) and investigate the influence of GSR in SZ classification. We found that when we used Brainnetome 246 atlas and without performed GSR, our method obtained a classification accuracy of 83.49%, with a sensitivity of 68.69%, a specificity of 93.75%, and an AUC of 0.8491, respectively. We also got great classification performances with different processing methods (with/without GSR and different brain parcellation schemes). We found that the accuracy and specificity of the models without GSR were higher than that of the models with GSR. Our findings indicate that the M3 method is an effective tool to distinguish SZs from HCs, and it can identify discriminative regions to detect SZ to explore the neural mechanisms underlying SZ. The global signal may contain important neuronal information; it can improve the accuracy and specificity of SZ detection.

1. Introduction

Schizophrenia (SZ) is a severe psychiatric illness characterized by aberrant sensory perceptions, cognition, concrete thinking, and a restricted range of emotion, and it affects about 1% of the general population [15]. SZ is a heterogeneous disorder, and current diagnoses are based on subjective indicators such as self-report, observation, and clinical history, and its reliable diagnosis is challenging [1, 4, 6, 7], and the pathological mechanism is still unclear [4].

Functional MRI (fMRI) and structural MRI (sMRI) are gaining importance and becoming more widely acceptable techniques with the potential to help diagnose neurological illnesses [811], including schizophrenia [5, 12, 13]. An increasing number of studies have reported that multimodal brain data can improve diagnostic accuracy by combining the information obtained from different MRI imaging modalities [8, 1416]. The machine learning (ML) technique is a new approach that can extract relevant information from images and construct models to determine the probability of disease onset, and it can make a higher accurate prediction compared with conventional methods [5, 6, 13, 17, 18]. Salvador et al. [15] achieved 75.76% accuracy in schizophrenia diagnosis, and de Filippis et al. [5] reported that support vector machine associated with other ML techniques could achieve accuracy close to 100%.

In conventional ML methods, most studies usually concatenated the features into a longer feature vector [1921]. However, these methods may be insufficiently effective to combine different features from different modalities. Some studies [16, 22, 23] have introduced novel methods to convey comprehensive and complementary information more effectively. Dai et al. [16] proposed a new method named multimodal imaging and multilevel characterization with multiclassifier (M3), which can effectively integrate different information from different modalities and can achieve higher classification accuracy than traditional feature combination methods and any single modality feature.

Global signal regression (GSR) is widely used to remove the effects of global BOLD signal variations in the analysis of fMRI studies; however, there are considerable controversies over its implementation [2426], and few studies have explored the effect of GSR in ML of diagnosing neurological diseases [19, 27]. Different studies have reported inconsistent results on the effect of GSR on SZ [2830]. As far as we know, very few studies reported the effect of GSR on ML of SZ classification [31]. However, the sample size of that study was limited, and it did not specifically discuss the effect of GSR on SZ classification. The brain parcellation is likely to affect classification accuracy [19, 27]. However, the influence of those factors in SZ classification is not very clear.

In this study, our goals are to classify SZ patients and healthy controls (HCs) using the M3 method and find the most relevant brain regions to explore its potential pathological mechanism. Furthermore, we investigate the influence of GSR and brain parcellation strategy in SZ classification.

2. Materials and Methods

2.1. Participants

The data in this study were selected from the Center for Biomedical Research Excellence (COBRE) (http://fcon_1000.projects.nitrc.org/indi/retro/cobre.html), an open neuroimaging dataset which includes fMRI and sMRI data from 71 SZs and 74 HCs with complete clinical and imaging information. Diagnostic information was collected by the Structured Clinical Interview used for DSM Disorders (SCID). Subjects were excluded if they had a history of neurological disorder, intellectual disability, severe head trauma with more than 5-minute loss of consciousness, substance abuse, or dependence within the last 12 months. Details of the diagnostic procedure and clinical information are available online (http://fcon_1000.projects.nitrc.org/indi/retro/cobre.html). To rule out the influence of handedness, we only included right-handed participants, so 15 subjects were excluded. And 21 subjects with maximum head motion larger than 2 mm or 2° were removed from the analysis. In the end, 109 subjects (64 HCs and 45 SZs) were included in this study. Demographic information of subjects is summarized in Table 1. Ethical approval was obtained by COBRE investigators; all participants provided written informed consent.

Table 1.

Demographic and clinical data.

Items SZs HCs Statistic P value
Sample size 45 64
Gender (M/F) 36/9 44/20 1.71a 0.19
Age (years) 37.42 ± 13.55 35.22 ± 11.40 0.92b 0.26

aThe chi-squared value was obtained by the chi-square test. bThe t value was obtained by the two-sample two-tailed t-test. SZ: schizophrenia; HC: healthy control.

2.2. Data Acquisition

All subjects' resting-state fMRI (rs-fMRI) and sMRI data were collected from a 3.0 T Siemens TrioTim scanner. The sMRI data were acquired with T1-weighted magnetization prepared rapid acquisition gradient echo (MPRAGE) sequences: 176 slices, TR = 2530 ms, TE = 1.64, 3.5, 5.36, 7.22, and 9.08 ms, TI = 900 ms, flip angle = 7°, FOV = 256 mm × 256 mm, matrix = 256 × 256, and voxel size = 1 × 1 × 1 mm3. Rs-fMRI scans were acquired single-shot echo-planar imaging sequence with the following parameters: 150 volumes, 33 slices, TR = 2000 ms, TE = 29 ms, matrix = 64 × 64, and voxel size = 3.75 × 3.75 × 4.55 mm3.

2.3. Data Preprocessing, fMRI, and sMRI Index Calculation

All data standard preprocessing was performed by Data Processing & Analysis of Brain Imaging (DPABI, http://rfmri.org/DPABI) [32], which is based on the Statistical Parametric Mapping (SPM12) package (http://www.fil.ion.ucl.ac.uk/spm) and the toolbox for Data Processing Assistant for Resting-State fMRI (DPARSF) toolbox [33] (http://rfmri.org/DPARSF).

The fMRI data preprocessing steps were as follows: (1) The first ten volumes of each subject were removed to ensure a steady-state condition. (2) Slice timing and realignment were carried out, and we excluded the subjects with maximum translation more than 2.0 mm or maximum rotation more than 2.0° in our study. (3) The T1 structural images were segmented into grey matter (GM), white matter (WM), and cerebrospinal fluid (CSF) and were coregistered to the mean functional image by using the Diffeomorphic Anatomical Registration Through Exponentiated Lie Algebra (DARTEL). (4) Functional data were spatially normalized to the Montreal Neurological Institute (MNI) space and resampled to 3 × 3 × 3 mm3 voxels. (5) The WM, CSF, 24 head motion parameters, and linear drift were removed as nuisance covariates by a multiple linear regression analysis. (6) Bandpass filter (0.01–0.10 Hz) was used to reduce the effects of low-frequency drift and high-frequency physiological noise.

We calculated the following fMRI measurements: amplitude of low-frequency fluctuations (ALFF) [34, 35], regional homogeneity (ReHo) [35, 36], degree centrality (DC) [37, 38], and voxel-mirrored homotopic connectivity (VMHC) [19, 39]. We used the DPARSF software default settings to calculate these indices. It is worth noting that we did not perform bandpass filter before calculating ALFF, and we set the connection's correlation coefficient threshold of r > 0.25 for DC calculation, and the individual functional data was registered to a symmetric template and smoothed with a Gaussian kernel of 4 mm before calculating VMHC. Those functional maps were then performed Fisher-Z transformation. Eventually, we smoothed these Z maps with a Gaussian kernel of 4 mm except for WMHC.

The GM images obtained from the previous segmentation step were then spatially normalized into standard space, smoothed with a Gaussian kernel of 8 mm, and resampled to 3 × 3 × 3 mm3 voxels, and we got grey matter density (GMD) images.

2.4. Feature Extraction

The fMRI and sMRI maps were segmented into 246 regions of interest (ROIs) using the Brainnetome (BN) 246 atlas (see Table S1) [40], which consists of 210 cortical and 36 subcortical subregions in the cerebrum. Each ROI from the brain parcellation atlas was used to mask each individual's fMRI and sMRI map, and the signal value of each ROI was obtained by averaging the fMRI and sMRI signals of all the voxels included in the ROI. This process was repeated for all individuals and regions. Finally, we got 246 features for each fMRI and sMRI map and a total of 1230 features for each individual, as shown in Figure 1. This ROI-based feature extraction method is widely used in neuroimaging ML studies [4144]. It is an effective method to reduce feature dimensionality and improve computational efficiency [45]. Previous studies have shown that ROI-based feature extraction could denote pathological changes in brain regions, identify abnormal brain regions, and assist in the diagnosis of the disease [20, 41, 4648]. Then, these features were used in the subsequent analysis.

Figure 1.

Figure 1

The flowchart of feature extraction. The data preprocessing and index calculation of fMRI and sMRI were performed by the DPABI toolbox, and then, functional maps were then performed Fisher-Z transformation. Finally, we obtained fMRI and sMRI measurement maps, including zALFF, zDC, zReHo, zVMHC, and GMD. The fMRI and sMRI maps were segmented into 246 regions of interest using the Brainnetome 246 atlas, and then, we got 246 features for each fMRI and sMRI map. ALFF: amplitude of low-frequency fluctuations; ReHo: regional homogeneity; DC: degree centrality; VMHC: voxel-mirrored homotopic connectivity.

2.4.1. Discriminative Analysis and Identification of the Most Discriminative Features

We constructed the model according to the method introduced by Dai et al. [16], which mainly includes feature selection, maximum uncertainty linear discriminate analysis- (MLDA-) based classification, and multiclassifier. Leave-one-out crossvalidation (LOOCV) was conducted to estimate the performance of our classifier (Figure 2).

Figure 2.

Figure 2

The flowchart of the optimal P value threshold selection and M3 method used in our study. We used leave-one-out crossvalidation (LOOCV) to estimate the performance of our classifier. All features in the training and test sets were standardized by z-score, and then, two-sample two-tailed t-tests with P threshold from 0.001 to 0.05 with a 0.001 interval (50 iterations) were performed to select discriminative features. We used MLDA with five category features (ALFF, ReHo, DC, VMHC, and GMD) to obtain five base classifiers, and then, we combined five classifiers into one classifier by weighted voting. Subsequently, we evaluate the performance of the classifier and obtained 50 classification accuracies, and the P threshold with the highest classification accuracy was defined as the optimal threshold.

The feature selection process was carried out on the training set only. First, all features were standardized by z-score, the normalization of the training and test datasets was performed, respectively, and then, two-sample two-tailed t-tests were performed to determine the features that showed differences between the SZ patients and HC groups. LOOCV was conducted to estimate the performance of our classifier and to determine the optimal P value threshold, as shown in Figures 2 and 3. In brief, we used each subject as the test set to test the performance of the model and the remaining subjects as the training set to train the model, repeated N times in turn, where N represented the number of subjects. We calculate the performance of the model based on the predicted labels (SZ or HC) and the actual labels of N iterations, including accuracy, sensitivity, and specificity. We applied the P threshold from 0.001 to 0.05 with a 0.001 interval (50 iterations) and obtained 50 classification accuracies, and the P threshold with the highest classification accuracy was defined as the optimal P threshold based on the classification accuracy values of the 50 iterations (Figures 2 and 3) [20, 44].

Figure 3.

Figure 3

Selection of the optimal P threshold via the grid search and LOOCV method. (a–d) Represent the classification accuracy versus the P value with BN-246 atlas+noGSR (a), Power-264 atlas+noGSR (b), BN-246 atlas+GSR (c), and Power-264 atlas+GSR (d). BN: Brainnetome atlas; GSR: global signal regression; noGSR: no global signal regression.

We performed the MLDA-based classifier, multiclassifier, crossvalidation, and identification of the most discriminative feature procedures as previously described [16]. Briefly, we used MLDA with five-category features (ALFF, ReHo, DC, VMHC, and GMD) to obtain five base classifiers. Then, we combined five classifiers into one classifier by weighted voting. Subsequently, LOOCV was used to evaluate the performance of the classifier. For each of the 5 base classifiers, we could obtain the coefficients of the features, and we normalized the coefficients by dividing by the maximum coefficient value. We multiplied the absolute value of normalized coefficients by the base classifier's weight of voting as feature weights. The feature weight of each base classifier is the average of each fold of LOOCV, and finally, we summed the feature weights of each base classifier to obtain the final feature weights of multiclassifier. The most discriminative features were restricted to features that appeared in each fold of LOOCV.

A permutation test was applied 1000 times to test the significance of the prediction performance [20, 44, 47]. First, the class label of each subject was randomly permutated 1000 times without replacement and assigned to all the subjects, and then, the entire M3 procedure was reapplied each time to obtain the permutated classification accuracy, and at last, the P value for the accuracy was calculated by dividing the number of permutations that showed a higher accuracy than the actual accuracy for the real sample by the total number of permutations. We applied the same method to calculate the P value of AUC by permutating the value of the sum predicted label randomly.

2.5. Validating the Influences of GSR and Brain Parcellation

To evaluate the influence of GSR and brain parcellation on our classifier, we did additional analysis: (1) we did regress out global signal in the regressing out nuisance covariate step and (2) we use another additional brain parcellation atlas (Power-264 atlas [49]) to segment brain ROIs. For Power-264 atlas, to be consistent with BN-246 atlas (without cerebellum), we did not include the ROIs of the cerebellum. We performed the same M3 method and evaluated the classification performance. We compare the classification performance of the models with the AUC to determine the effect of GSR and brain parcellation on classifiers with the Delong test.

3. Results

3.1. Classification Performance

To optimize the P threshold value to select the features of the classifier, we performed the grid search method using the training set. We applied the P threshold from 0.001 to 0.05 with a 0.001 interval, we found that the optimal P threshold was 0.027, and the corresponding classifier obtained a classification accuracy of 83.49%, with a sensitivity of 68.69%, a specificity of 93.75%, and an AUC of 0.8491, respectively (Table 2, Figures 3(a) and 4(a)). The P values of the model accuracy and AUC both were P < 0.001 (Figure 4(b), Figure S1a), which suggests that the classifier prediction performance was significantly higher than chance.

Table 2.

Classification performance of the M3 classifiers.

Items Optimal P threshold AUC Accuracy (%) Sensitivity (%) Specificity (%)
BN-246_noGSR 0.027 0.8491 83.49 68.89 93.75
Power-264_noGSR 0.029 0.7785 79.82 73.33 84.38
BN-246_GSR 0.013 0.8215 83.49 86.67 81.25
Power-264_GSR 0.032 0.8165 77.98 71.11 82.81

M3: multimodal imaging and multilevel characterization with multiclassifier; BN: Brainnetome atlas; GSR: global signal regression; noGSR: no global signal regression.

Figure 4.

Figure 4

Classification performance of the classifiers without GSR. (a) The ROC curve of the classifiers based on BN-246 atlas and Power-264 atlas without GSR. The distributions of the permutated accuracy values of BN-246 atlas (b) and Power-264 atlas (c) without GSR. The red line indicates the values obtained using the real labels. BN: Brainnetome atlas; noGSR: no global signal regression.

3.2. Discriminative Brain Regions

To determine which brain regions contributed to single-subject classification, we computed the model feature weights and obtained the order of feature contribution of the classification [16]. The most discriminative features were restricted to features that appeared in each fold of LOOCV. The top 15 brain regions with the highest feature weights are reported in Table 3 and Figure 5. The most discriminative regions included the left superior parietal lobule, inferior parietal lobule, inferior temporal gyrus, middle frontal gyrus, lateral occipital cortex, fusiform gyrus, right basal ganglia, cingulate gyrus, superior frontal gyrus, posterior superior temporal sulcus, bilateral medioventral occipital cortex, and parahippocampal gyrus (Table 3; Figure 5).

Table 3.

Top 15 most discriminative features for classification.

Regions ALFF DC ReHo VMHC GMD Weight
SPL_L_5_2 t = −3.22 (P = 0.0017) t = −2.69 (P = 0.0082) NS t = −2.62 (P = 0.0102) NS 1.3275
IPL_L_6_2 NS t = 2.70 (P = 0.0080) t = 2.97 (P = 0.0037) NS NS 1.2037
MVOcC_L_5_1 t = −2.77 (P = 0.0066) t = −4.49 (P < 0.0001) t = −3.75 (P = 0.0002) t = −3.82 (P = 0.0002) NS 1.1467
ITG_L_7_3 t = 4.78 (P < 0.0001) t = 4.18 (P < 0.0001) t = 3.66 (P = 0.0004) NS NS 1.0778
MFG_L_7_5 t = 2.66 (P = 0.0091) t = 3.54 (P = 0.0006) t = 2.83 (P = 0.0056) t = 2.88 (P = 0.0048) t = −2.42 (P = 0.0172) 0.9969
MVOcC _R_5_1 NS t = −2.85 (P = 0.0053) t = −3.94 (P = 0.0001) t = −3.44 (P = 0.0008) NS 0.9484
PhG_L_6_5 NS t = 3.10 (P = 0.0025) NS t = 2.86 (P = 0.0051) t = −2.96 (P = 0.0037) 0.9476
LOcC_L_2_2 t = −3.18 (P = 0.0019) t = −3.57 (P = 0.0005) t = −2.69 (P = 0.0084) t = −4.00 (P = 0.0001) NS 0.9099
FuG_L_3_2 t = −2.81 (P = 0.0058) t = −4.55 (P < 0.0001) t = −3.49 (P = 0.0007) t = −3.56 (P = 0.0006) NS 0.8904
BG_R_6_5 NS t = 2.70 (P = 0.0081) t = 3.40 (P = 0.0010) t = 2.39 (P = 0.0188) t = −3.84 (P = 0.0002) 0.8877
MVOcC_R_5_3 t = −2.46 (P = 0.016) t = −2.89 (P = 0.0046) t = −3.12 (P = 0.0023) t = −3.75 (P = 0.0003) NS 0.8413
CG_R_7_7 NS NS t = −3.07 (P = 0.0027) t = −2.35 (P = 0.0204) NS 0.7860
SFG_R_7_2 t = 3.89 (P = 0.0002) t = 3.45 (P = 0.0008) t = 3.95 (P = 0.0001) t = 2.60 (P = 0.0107) NS 0.7672
PhG_R_6_5 NS t = 3.59 (P = 0.0005) NS t = 2.61 (P = 0.0104) NS 0.7664
pSTS_R_2_2 NS t = −4.05 (P < 0.0001) t = −2.28 (P = 0.0246) t = −2.76 (P = 0.0068) t = −2.78 (P = 0.0064) 0.7283

NS: not significant, P > 0.027 (optimal P threshold); positive t value means increased values in the SZ group. ALFF: amplitude of low-frequency fluctuations (ALFF); ReHo: regional homogeneity; DC: degree centrality; VMHC: voxel-mirrored homotopic connectivity; SPL: superior parietal lobule; IPL: inferior parietal lobule; MVOcC: medioventral occipital cortex; ITG: inferior temporal gyrus; MFG: middle frontal gyrus; PhG: parahippocampal gyrus; LOcC: lateral occipital cortex; FuG: fusiform gyrus; BG: basal ganglia; CG: cingulate gyrus; SFG: superior frontal gyrus; pSTS: posterior superior temporal sulcus; L: left; R: right.

Figure 5.

Figure 5

The most discriminative brain regions. The most discriminative regions included the left superior parietal lobule, inferior parietal lobule, inferior temporal gyrus, middle frontal gyrus, lateral occipital cortex, fusiform gyrus, right basal ganglia, cingulate gyrus, superior frontal gyrus, posterior superior temporal sulcus, bilateral medioventral occipital cortex, and parahippocampal gyrus. The color bar value represents the weight value of the brain regions.

3.3. Influence of Brain Regional Parcellation Schemes

To evaluate the influence of the parcellation schemes on our M3 classifier, we performed our analysis approach with Power-264 atlas to test the classification performance of the model. We obtained a high classification performance with AUC of 0.7785, and the accuracy, sensitivity, and specificity were 79.82%, 73.33%, and 84.38%, respectively (Table 2, Figures 3(b), 4(a), and 4(c), Figure S1b). We compared the AUC of two classifier performances using the Delong test, and we did not find a significant difference between them (z = 0.095, P = 0.92).

3.4. Influence of Global Signal Regression

In order to evaluate the influence of global signal regression, we performed the above M3 methods with GSR. We found that the accuracy and specificity of the classifiers without GSR were equal or higher than that of the classifiers with GSR both with BN-246 atlas and Power-264 atlas (Table 2; Figures 3(c), 3(d), and 6 and Figure S2), but we did not find significant differences between them (BN-246_GSR vs. BN-246_noGSR: z = −0.74, P = 0.46; Power-264_GSR vs. Power-264_noGSR: z = 0.93, P = 0.35).

Figure 6.

Figure 6

Classification performance of the classifiers with GSR. (a) The ROC curve of the classifiers based on BN-246 atlas and Power-264 atlas with GSR. The distributions of the permutated accuracy values of BN-246 atlas (b) and Power-264 atlas (c) with GSR. The red line indicates the values obtained using the real labels. BN: Brainnetome atlas; AAL: automated anatomical labeling; GSR: global signal regression.

4. Discussion

In the current study, we combined functional and structural MRI measures to distinguish SZs from HCs by the M3 method. We found that we got great classification performances using different processing methods (with/without GSR and different brain regional parcellation schemes) and a set of discriminative regions to distinguish SZs from HCs. Our study demonstrates that the M3 method is a great tool to effectively distinguish SZs from HCs and explore the neural mechanisms underlying SZ.

Previous neuroimaging ML studies focused on a single modal image [50, 51] or concatenated multimodal features into a longer feature vector [19, 21, 44, 47]. Recent studies have shown that multimodal imaging using integrated information can significantly improve the classification accuracy [16, 20, 21, 23, 47]. And conventional multimodal direct feature concatenation method may not be sufficiently effective in combining features from different modalities [16, 52]. Previous studies have shown that the M3 method can improve classification performance than any single-modal feature and conventional multimodal feature combination methods [16]. Our study also found that the M3 method can effectively distinguish SZs from HCs. Dai et al. [16] found that the M3 method can identify the most discriminative features to classify Alzheimer's disease patients and HCs which are consistent with previous studies that have used conventional univariate statistical analysis of structural and functional MRI. It may be able to explore the underlying mechanisms of neuropsychiatric diseases. Our results are consistent with the previous study.

In previous studies, most researchers empirically chose P < 0.01 or P < 0.05 as the threshold for feature selection in the data dimensionality reduction step [16, 18, 19]. In our study, we performed grid search [20, 44, 53] to select the optimal P threshold to obtain the relatively highest prediction accuracy of the classifier. Most current ML studies [8, 19, 21, 47] usually concatenated the features into a longer feature vector. However, these methods are insufficiently effective to combine different features from different modalities. It has been confirmed that the M3 method can effectively integrate different information from different modalities and can achieve higher classification accuracy than traditional feature combination methods and any single modality features [16]. In our study, we used the BN-246 atlas and M3 method with five types of modality features (ALFF, ReHo, DC, VMHC, and GMD), and we obtained a classification accuracy of 83.49%, a sensitivity of 68.69%, and a specificity of 93.75%, respectively. In addition, we obtained close classification performance using different preprocessing methods (with/without GSR) and different brain regional parcellation schemes. Our classification accuracy is close to or even higher than the results of SZ ML studies [1, 2, 5, 6, 14, 18] and other disease studies [9, 19, 44, 51]. These results are consistent with a previous study which reported that the M3 method can obtain great classification accuracy [16].

The debate about the complex composition of global signals and the necessity of GSR in data preprocessing and data analysis always exists in most cases [24, 54, 55]. Some studies reported that the global signal was likely to reflect important neuronal components in rs-fMRI data [17, 18, 39]. Qing et al. [26] reported that GSR effects are region-specific and suggested that it is great to report results both with and without GSR in ReHo study. Li et al. [56] reported that GSR strengthens association between resting-state functional connectivity and behavior in young healthy adults. And in some studies [57, 58], the authors regressed out global signal as a nuisance variable to reduce the effects of nonneuronal BOLD fluctuations.

Controversies also root in the influence of the global signal in distinguishing SZs from HCs. Yang et al. [28] reported that the variance of the global BOLD signal was significantly higher in patients with SZ as compared to HCs, but not in bipolar disorder, they pointed that the global signal had important biological significance for SZ, and its effects were disease-specific. Similarly, Hahamy et al. [29] reported that GSR reduced variance in subjects with SZ. On the contrary, a recent study showed that there was no overall increase or reduction in resting-state global signal in SZ patients [30]. In our study, we did not find a significant difference in classification performance between the classifiers with and without GSR, which is consistent with a previous study [19]. These results indicated that our model was robust, but we found that the accuracy and specificity of the models without GSR were higher than that of the models with GSR both with BN-246 atlas and Power-264 atlas (Table 2, Figures 4 and 6), which are consistent with previous studies [27, 28]. This could facilitate accurate SZ patient identification and early intervention. Chen et al. reported [27] that the model without GSR enhanced the sensitivity of the detection of differences between Alzheimer's disease and HCs. A recent study also found that global network metrics without GSR have more significant differences than that with GSR between major depression patients and HCs. For SZ, previous studies reported that the global signal was of functional relevance, as it differentiated between SZs and HCs [28, 29], which are consistent with our result, but Umeh et al. [30] reported a contradictory finding. However, in that study, the sample size was limited (38 SZs and 35 HCs). All these findings suggest that the global signal may contain important neuronal information, at least in the case of SZ.

We repeated our M3 pipeline using Power-264 atlas to evaluate whether our results were affected by brain parcellation. Previous studies reported that functionally defined parcellation or high spatial resolution parcellation is probably to detect more significant differences, and anatomical boundaries do not necessarily match functional ones [27, 59]. Therefore, we utilized functional atlas in our study (BN-246 and Power-264 atlas). In our study, we got high classification performances and did not find any significant difference in different brain regional parcellation schemes, which suggested that brain parcellation did not influence our prediction performance, and it is consistent with previous studies [19, 60]. The result indicated that our model had good robustness and generalizability.

Many studies reported abnormal structures and functional brain regions of SZ. In the current study, we found that the most discriminate regions between SZs and HCs mainly locate in the left superior parietal lobule, inferior parietal lobule, inferior temporal gyrus, middle frontal gyrus, lateral occipital cortex, fusiform gyrus, right basal ganglia, cingulate gyrus, superior frontal gyrus, posterior superior temporal sulcus, bilateral medioventral occipital cortex, and parahippocampal gyrus (Figure 5). A meta-analysis that included 79 studies reported that SZ was associated with structural and functional abnormalities in the bilateral anterior cingulate gyrus and middle frontal gyrus [61]. Ren et al. [62] also reported the abnormalities in bilateral anterior cingulate gyrus cortex, occipital gyrus, and left inferior parietal lobule in drug-naive first-episode SZ patients. Zhao et al. [63] reported that SZ patients had extensive structural and functional abnormalities, including bilateral occipital lobe, left orbital frontal cortex, bilateral superior parietal lobule, right middle temporal gyrus, gyrus rectus and superior frontal gyrus, bilateral inferior parietal lobule, and precuneus. Machine learning studies also reported that the bilateral fusiform gyrus, superior parietal lobule, superior temporal gyrus, cingulate gyrus, middle frontal gyrus, inferior parietal lobule, parahippocampal gyrus, and right medial superior frontal gyrus contributed to discrimination between SZ patients and HCs [3, 5, 7, 18, 6466]. Our results are consistent with these previous studies.

Our study has some limitations. First, although the sample size is limited, it is relatively larger when compared to previous studies [1, 21, 31, 50, 65]. A larger sample size should be recruited in the future to replicate and enrich our findings. Second, some studies [5, 67] have reported differences in the cerebellum between SZ patients and HCs, but in some cases, in our study, the cerebellum was not fully covered during rs-fMRI scanning, so the cerebellum was not considered in our study, and we selected the atlas that does not contain the cerebellum or excluded the cerebellar ROI in the brain atlas. Third, the head motion in subjects with SZ was greater than that in subjects with HC (mean framewise displacement Jenkinson: SZ, 0.19 ± 0.10 mm; HC, 0.14 ± 0.08 mm). Although we adopted strict control inclusion criteria (less than 2 mm and 2.0°), regressed out head motion (with 24 head motion parameters), we cannot guarantee the complete removal of the head motion effect.

5. Conclusion

In conclusion, our findings indicated that the M3 method is a great tool to distinguish SZs from HCs effectively with high classification accuracy; it can be generalized in different brain parcellation schemes. The global signal may contain important neuronal information; it can improve the accuracy and specificity to detect SZ patients. The M3 method without GSR is helpful to identify patient accuracy and early intervention, and it can identify discriminative regions to detect SZ to explore the neural mechanisms underlying SZ.

Acknowledgments

The authors thank the data authors for providing open data. This work is supported by the Scientific Research Foundation for Advanced Talents, Xiang'an Hospital of Xiamen University (No. PM201809170011).

Data Availability

Publicly available datasets were analyzed in this study. This data can be found here: http://fcon_1000.projects.nitrc.org/indi/retro/cobre.html. The code is available on request to the corresponding author.

Conflicts of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Authors' Contributions

DS conducted the experiment, performed the data processing and analysis, and wrote the manuscript. YL and HZ collected the data and performed the data processing and analysis and edited the manuscript. XY, GW, and SW collected the data and performed the data processing and analysis. KR supervised the whole including experiments and manuscript writing. All authors contributed to the article and approved the submitted version.

Supplementary Materials

Supplementary Materials

Table S1: cortical and subcortical regions of interest defined in Brainnetome atlas. Figure S1: the distributions of the permutated AUC values without GSR. The distributions of the permutated AUC values of BN-246 atlas (a) and Power-264 atlas (b) without GSR. The red line indicates the values obtained using the real sum predicted label. Figure S2: the distributions of the permutated AUC values with GSR. The distributions of the permutated AUC values of BN-246 atlas (a) and Power-264 atlas (c) with GSR. The red line indicates the values obtained using the real sum predicted label.

References

  • 1.Bae Y., Kumarasamy K., Ali I. M., Korfiatis P., Akkus Z., Erickson B. J. Differences between schizophrenic and normal subjects using network properties from fMRI. Journal of Digital Imaging. 2018;31(2):252–261. doi: 10.1007/s10278-017-0020-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Skåtun K. C., Kaufmann T., Doan N. T., et al. Consistent functional connectivity alterations in schizophrenia spectrum disorder: a multisite study. Schizophrenia Bulletin. 2017;43(4):914–924. doi: 10.1093/schbul/sbw145. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Calhoun V. D., Sui J., Kiehl K., Turner J., Allen E., Pearlson G. Exploring the psychosis functional connectome: aberrant intrinsic networks in schizophrenia and bipolar disorder. Frontiers in Psychiatry. 2012;2:p. 75. doi: 10.3389/fpsyt.2011.00075. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Wang M., Hao X., Huang J., et al. Hierarchical structured sparse learning for schizophrenia identification. Neuroinformatics. 2020;18(1):43–57. doi: 10.1007/s12021-019-09423-0. [DOI] [PubMed] [Google Scholar]
  • 5.de Filippis R., Carbone E. A., Gaetano R., et al. Machine learning techniques in a structural and functional MRI diagnostic approach in schizophrenia: a systematic review. Neuropsychiatric Disease and Treatment. 2019;15:1605–1627. doi: 10.2147/NDT.S202418. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Oh K., Kim W., Shen G., et al. Classification of schizophrenia and normal controls using 3D convolutional neural network and outcome visualization. Schizophrenia Research. 2019;212:186–195. doi: 10.1016/j.schres.2019.07.034. [DOI] [PubMed] [Google Scholar]
  • 7.Chyzhyk D., Savio A., Grana M. Computer aided diagnosis of schizophrenia on resting state fMRI data by ensembles of ELM. Neural Networks. 2015;68:23–33. doi: 10.1016/j.neunet.2015.04.002. [DOI] [PubMed] [Google Scholar]
  • 8.Hojjati S. H., Ebrahimzadeh A., Khazaee A., Babajani-Feremi A., Alzheimer's Disease Neuroimaging Initiative Predicting conversion from MCI to AD by integrating rs-fMRI and structural MRI. Computers in Biology and Medicine. 2018;102:30–39. doi: 10.1016/j.compbiomed.2018.09.004. [DOI] [PubMed] [Google Scholar]
  • 9.Gosnell S. N., Fowler J. C., Salas R. Classifying suicidal behavior with resting-state functional connectivity and structural neuroimaging. Acta Psychiatrica Scandinavica. 2019;140(1):20–29. doi: 10.1111/acps.13029. [DOI] [PubMed] [Google Scholar]
  • 10.Kiryu S., Yasaka K., Akai H., et al. Deep learning to differentiate parkinsonian disorders separately using single midsagittal MR imaging: a proof of concept study. European Radiology. 2019;29(12):6891–6899. doi: 10.1007/s00330-019-06327-0. [DOI] [PubMed] [Google Scholar]
  • 11.Yang X., Hu X., Tang W., et al. Multivariate classification of drug-naive obsessive-compulsive disorder patients and healthy controls by applying an SVM to resting-state functional MRI data. BMC Psychiatry. 2019;19(1):p. 210. doi: 10.1186/s12888-019-2184-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Plis S. M., Amin M. F., Chekroud A., et al. Reading the (functional) writing on the (structural) wall: multimodal fusion of brain structure and function via a deep neural network based translation approach reveals novel impairments in schizophrenia. NeuroImage. 2018;181:734–747. doi: 10.1016/j.neuroimage.2018.07.047. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Dillon K., Calhoun V., Wang Y. P. A robust sparse-modeling framework for estimating schizophrenia biomarkers from fMRI. Journal of Neuroscience Methods. 2017;276:46–55. doi: 10.1016/j.jneumeth.2016.11.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Sui J., He H., Yu Q., et al. Combination of resting state fMRI, DTI, and sMRI data to discriminate schizophrenia by N-way MCCA + jICA. Frontiers in Human Neuroscience. 2013;7:p. 235. doi: 10.3389/fnhum.2013.00235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Salvador R., Canales-Rodríguez E., Guerrero-Pedraza A., et al. Multimodal integration of brain images for MRI-based diagnosis in schizophrenia. Frontiers in Neuroscience. 2019;13:p. 1203. doi: 10.3389/fnins.2019.01203. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Dai Z., Yan C., Wang Z., et al. Discriminative analysis of early Alzheimer's disease using multi-modal imaging and multi-level characterization with multi-classifier (M3) NeuroImage. 2012;59(3):2187–2195. doi: 10.1016/j.neuroimage.2011.10.003. [DOI] [PubMed] [Google Scholar]
  • 17.Orban P., Dansereau C., Desbois L., et al. Multisite generalizability of schizophrenia diagnosis classification based on functional brain connectivity. Schizophrenia Research. 2018;192:167–171. doi: 10.1016/j.schres.2017.05.027. [DOI] [PubMed] [Google Scholar]
  • 18.Li J., Sun Y., Huang Y., Bezerianos A., Yu R. Machine learning technique reveals intrinsic characteristics of schizophrenia: an alternative method. Brain Imaging and Behavior. 2019;13(5):1386–1396. doi: 10.1007/s11682-018-9947-4. [DOI] [PubMed] [Google Scholar]
  • 19.Wang Y., Sun K., Liu Z., et al. Classification of unmedicated bipolar disorder using whole-brain functional activity and connectivity: a radiomics analysis. Cerebral Cortex. 2020;30(3):1117–1128. doi: 10.1093/cercor/bhz152. [DOI] [PubMed] [Google Scholar]
  • 20.Zhou B., An D., Xiao F., et al. Machine learning for detecting mesial temporal lobe epilepsy by structural and functional neuroimaging. Frontiers in Medicine. 2020;14(5):630–641. doi: 10.1007/s11684-019-0718-4. [DOI] [PubMed] [Google Scholar]
  • 21.Sun H., Chen Y., Huang Q., et al. Psychoradiologic utility of MR imaging for diagnosis of attention deficit hyperactivity disorder: a radiomics analysis. Radiology. 2018;287(2):620–630. doi: 10.1148/radiol.2017170226. [DOI] [PubMed] [Google Scholar]
  • 22.Zhang D., Shen D., Alzheimer's Disease Neuroimaging Initiative Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer's disease. NeuroImage. 2012;59(2):895–907. doi: 10.1016/j.neuroimage.2011.09.069. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Sui J., Qi S., van Erp T. G. M., et al. Multimodal neuromarkers in schizophrenia via cognition-guided MRI fusion. Nature Communications. 2018;9(1):p. 3028. doi: 10.1038/s41467-018-05432-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Liu T. T., Nalci A., Falahpour M. The global signal in fMRI: nuisance or information? NeuroImage. 2017;150:213–229. doi: 10.1016/j.neuroimage.2017.02.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Shahsavarani S., Abraham I. T., Zimmerman B. J., Baryshnikov Y. M., Husain F. T. Comparing cyclicity analysis with pre-established functional connectivity methods to identify individuals and subject groups using resting state fMRI. Frontiers in Computational Neuroscience. 2020;13:p. 94. doi: 10.3389/fncom.2019.00094. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Qing Z., Dong Z., Li S., Zang Y., Liu D. Global signal regression has complex effects on regional homogeneity of resting state fMRI signal. Magnetic Resonance Imaging. 2015;33(10):1306–1313. doi: 10.1016/j.mri.2015.07.011. [DOI] [PubMed] [Google Scholar]
  • 27.Chen X., Liao X., Dai Z., et al. Topological analyses of functional connectomics: a crucial role of global signal removal, brain parcellation, and null models. Human Brain Mapping. 2018;39(11):4545–4564. doi: 10.1002/hbm.24305. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Yang G. J., Murray J. D., Repovs G., et al. Altered global brain signal in schizophrenia. Proceedings of the National Academy of Sciences of the United States of America. 2014;111(20):7438–7443. doi: 10.1073/pnas.1405289111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Hahamy A., Calhoun V., Pearlson G., et al. Save the global: global signal connectivity as a tool for studying clinical populations with functional magnetic resonance imaging. Brain Connectivity. 2014;4(6):395–403. doi: 10.1089/brain.2014.0244. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Umeh A., Kumar J., Francis S. T., Liddle P. F., Palaniyappan L. Global fMRI signal at rest relates to symptom severity in schizophrenia. Schizophrenia Research. 2020;220:281–282. doi: 10.1016/j.schres.2020.03.035. [DOI] [PubMed] [Google Scholar]
  • 31.Bohaterewicz B., Sobczak A. M., Podolak I., et al. Machine learning-based identification of suicidal risk in patients with schizophrenia using multi-level resting-state fMRI features. Frontiers in Neuroscience. 2021;14:p. 605697. doi: 10.3389/fnins.2020.605697. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Yan C. G., Wang X. D., Zuo X. N., Zang Y. F. DPABI: data processing & analysis for (resting-state) brain imaging. Neuroinformatics. 2016;14(3):339–351. doi: 10.1007/s12021-016-9299-4. [DOI] [PubMed] [Google Scholar]
  • 33.Yan C. G., Zang Y. F. DPARSF: a MATLAB toolbox for "pipeline" data analysis of resting-state fMRI. Frontiers in Systems Neuroscience. 2010;4:p. 13. doi: 10.3389/fnsys.2010.00013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Lin L., Zheng L. J., Joseph Schoepf U., et al. Uric acid has different effects on spontaneous brain activities of males and females: a cross-sectional resting-state functional MR imaging study. Frontiers in Neuroscience. 2019;13:p. 763. doi: 10.3389/fnins.2019.00763. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Chen Z., Wang Q., Liang M., et al. Visual cortex neural activity alteration in cervical spondylotic myelopathy patients: a resting-state fMRI study. Neuroradiology. 2018;60(9):921–932. doi: 10.1007/s00234-018-2061-x. [DOI] [PubMed] [Google Scholar]
  • 36.Zhang J., Su J., Wang M., et al. The sensorimotor network dysfunction in migraineurs without aura: a resting-state fMRI study. Journal of Neurology. 2017;264(4):654–663. doi: 10.1007/s00415-017-8404-4. [DOI] [PubMed] [Google Scholar]
  • 37.Zhang Q., Shu Y., Li X., et al. Resting-state functional magnetic resonance study of primary open-angle glaucoma based on voxelwise brain network degree centrality. Neuroscience Letters. 2019;712:p. 134500. doi: 10.1016/j.neulet.2019.134500. [DOI] [PubMed] [Google Scholar]
  • 38.Li M., Liu Y., Chen H., et al. Altered global synchronizations in patients with Parkinson's disease: a resting-state fMRI study. Frontiers in Aging Neuroscience. 2019;11:p. 139. doi: 10.3389/fnagi.2019.00139. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Jiang W., Lei Y., Wei J., et al. Alterations of interhemispheric functional connectivity and degree centrality in cervical dystonia: a resting-state fMRI study. Neural Plasticity. 2019;2019:11. doi: 10.1155/2019/7349894.7349894 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Fan L., Li H., Zhuo J., et al. The human Brainnetome atlas: a new brain atlas based on connectional architecture. Cerebral Cortex. 2016;26(8):3508–3526. doi: 10.1093/cercor/bhw157. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Jin D., Wang P., Zalesky A., et al. Grab‐AD: generalizability and reproducibility of altered brain activity and diagnostic classification in Alzheimer's disease. Human Brain Mapping. 2020;41(12):3379–3391. doi: 10.1002/hbm.25023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Zhao K., Ding Y., Han Y., et al. Independent and reproducible hippocampal radiomic biomarkers for multisite Alzheimer’s disease: diagnosis, longitudinal progress and biological basis. Science Bulletin. 2020;65(13):1103–1113. doi: 10.1016/j.scib.2020.04.003. [DOI] [PubMed] [Google Scholar]
  • 43.Wottschel V., Chard D. T., Enzinger C., et al. SVM recursive feature elimination analyses of structural brain MRI predicts near-term relapses in patients with clinically isolated syndromes suggestive of multiple sclerosis. Neuroimage Clin. 2019;24:p. 102011. doi: 10.1016/j.nicl.2019.102011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Cui Z., Xia Z., Su M., Shu H., Gong G. Disrupted white matter connectivity underlying developmental dyslexia: a machine learning approach. Human Brain Mapping. 2016;37(4):1443–1458. doi: 10.1002/hbm.23112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Wang L., Liu Y., Zeng X., Cheng H., Wang Z., Wang Q. Region-of-interest based sparse feature learning method for Alzheimer’s disease identification. Computer Methods and Programs in Biomedicine. 2020;187:p. 105290. doi: 10.1016/j.cmpb.2019.105290. [DOI] [PubMed] [Google Scholar]
  • 46.Peng B., Wang S., Zhou Z., et al. A multilevel-ROI-features-based machine learning method for detection of morphometric biomarkers in Parkinson’s disease. Neuroscience Letters. 2017;651:88–94. doi: 10.1016/j.neulet.2017.04.034. [DOI] [PubMed] [Google Scholar]
  • 47.Tang Z., Liu Z., Li R., et al. Identifying the white matter impairments among ART-naïve HIV patients: a multivariate pattern analysis of DTI data. European Radiology. 2017;27(10):4153–4162. doi: 10.1007/s00330-017-4820-1. [DOI] [PubMed] [Google Scholar]
  • 48.Mo J., Liu Z., Sun K., et al. Automated detection of hippocampal sclerosis using clinically empirical and radiomics features. Epilepsia. 2019;60(12):2519–2529. doi: 10.1111/epi.16392. [DOI] [PubMed] [Google Scholar]
  • 49.Power J. D., Cohen A. L., Nelson S. M., et al. Functional network organization of the human brain. Neuron. 2011;72(4):665–678. doi: 10.1016/j.neuron.2011.09.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Hou Y., Luo C., Yang J., et al. Prediction of individual clinical scores in patients with Parkinson's disease using resting-state functional magnetic resonance imaging. Journal of the Neurological Sciences. 2016;366:27–32. doi: 10.1016/j.jns.2016.04.030. [DOI] [PubMed] [Google Scholar]
  • 51.Zhang T., Zhao Z., Zhang C., Zhang J., Jin Z., Li L. Classification of early and late mild cognitive impairment using functional brain network of resting-state fMRI. Frontiers in Psychiatry. 2019;10:p. 572. doi: 10.3389/fpsyt.2019.00572. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Zhang D., Wang Y., Zhou L., Yuan H., Shen D., Alzheimer's Disease Neuroimaging Initiative Multimodal classification of Alzheimer's disease and mild cognitive impairment. NeuroImage. 2011;55(3):856–867. doi: 10.1016/j.neuroimage.2011.01.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Sun H., Jiang R., Qi S., et al. Preliminary prediction of individual response to electroconvulsive therapy using whole-brain functional magnetic resonance imaging data. NeuroImage: Clinical. 2020;26:p. 102080. doi: 10.1016/j.nicl.2019.102080. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Xu H., Su J., Qin J., et al. Impact of global signal regression on characterizing dynamic functional connectivity and brain states. NeuroImage. 2018;173:127–145. doi: 10.1016/j.neuroimage.2018.02.036. [DOI] [PubMed] [Google Scholar]
  • 55.Murphy K., Fox M. D. Towards a consensus regarding global signal regression for resting state functional connectivity MRI. NeuroImage. 2017;154:169–173. doi: 10.1016/j.neuroimage.2016.11.052. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Li J., Kong R., Liégeois R., et al. Global signal regression strengthens association between resting-state functional connectivity and behavior. NeuroImage. 2019;196:126–141. doi: 10.1016/j.neuroimage.2019.04.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Yu H., Chen L., Li H., et al. Abnormal resting-state functional connectivity of amygdala subregions in patients with obstructive sleep apnea. Neuropsychiatric Disease and Treatment. 2019;15:977–987. doi: 10.2147/NDT.S191441. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Mu X., Wang Z., Nie B., et al. Altered regional and circuit resting-state activity in patients with occult spastic diplegic cerebral palsy. Pediatrics and Neonatology. 2018;59(4):345–351. doi: 10.1016/j.pedneo.2017.10.003. [DOI] [PubMed] [Google Scholar]
  • 59.Rosenberg M. D., Finn E. S., Scheinost D., et al. A neuromarker of sustained attention from whole-brain functional connectivity. Nature Neuroscience. 2016;19(1):165–171. doi: 10.1038/nn.4179. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Jiang R., Calhoun V. D., Cui Y., et al. Multimodal data revealed different neurobiological correlates of intelligence between males and females. Brain Imaging and Behavior. 2020;14(5):1979–1993. doi: 10.1007/s11682-019-00146-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Bora E., Fornito A., Radua J., et al. Neuroanatomical abnormalities in schizophrenia: a multimodal voxelwise meta-analysis and meta-regression analysis. Schizophrenia Research. 2011;127(1-3):46–57. doi: 10.1016/j.schres.2010.12.020. [DOI] [PubMed] [Google Scholar]
  • 62.Ren W., Lui S., Deng W., et al. Anatomical and functional brain abnormalities in drug-naive first-episode schizophrenia. The American Journal of Psychiatry. 2013;170(11):1308–1316. doi: 10.1176/appi.ajp.2013.12091148. [DOI] [PubMed] [Google Scholar]
  • 63.Zhao C., Zhu J., Liu X., et al. Structural and functional brain abnormalities in schizophrenia: a cross-sectional study at different stages of the disease. Progress in Neuro-Psychopharmacology & Biological Psychiatry. 2018;83:27–32. doi: 10.1016/j.pnpbp.2017.12.017. [DOI] [PubMed] [Google Scholar]
  • 64.Hanlon F. M., Houck J. M., Pyeatt C. J., et al. Bilateral hippocampal dysfunction in schizophrenia. NeuroImage. 2011;58(4):1158–1168. doi: 10.1016/j.neuroimage.2011.06.091. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Chyzhyk D., Graña M., Öngür D., Shinn A. K. Discrimination of schizophrenia auditory hallucinators by machine learning of resting-state functional MRI. International Journal of Neural Systems. 2015;25(3):p. 1550007. doi: 10.1142/S0129065715500070. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Xiao Y., Yan Z., Zhao Y., et al. Support vector machine-based classification of first episode drug-naïve schizophrenia patients and healthy controls using structural MRI. Schizophrenia Research. 2019;214:11–17. doi: 10.1016/j.schres.2017.11.037. [DOI] [PubMed] [Google Scholar]
  • 67.Pinaya W. H., Gadelha A., Doyle O. M., et al. Using deep belief network modelling to characterize differences in brain morphometry in schizophrenia. Scientific Reports. 2016;6(1):p. 38897. doi: 10.1038/srep38897. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Materials

Table S1: cortical and subcortical regions of interest defined in Brainnetome atlas. Figure S1: the distributions of the permutated AUC values without GSR. The distributions of the permutated AUC values of BN-246 atlas (a) and Power-264 atlas (b) without GSR. The red line indicates the values obtained using the real sum predicted label. Figure S2: the distributions of the permutated AUC values with GSR. The distributions of the permutated AUC values of BN-246 atlas (a) and Power-264 atlas (c) with GSR. The red line indicates the values obtained using the real sum predicted label.

Data Availability Statement

Publicly available datasets were analyzed in this study. This data can be found here: http://fcon_1000.projects.nitrc.org/indi/retro/cobre.html. The code is available on request to the corresponding author.


Articles from Disease Markers are provided here courtesy of Wiley

RESOURCES