Skip to main content
NeuroImage : Clinical logoLink to NeuroImage : Clinical
. 2017 Jun 9;15:719–731. doi: 10.1016/j.nicl.2017.06.014

Distinct multivariate brain morphological patterns and their added predictive value with cognitive and polygenic risk scores in mental disorders

Nhat Trung Doan a,, Tobias Kaufmann a, Francesco Bettella a, Kjetil Nordbø Jørgensen a,b, Christine Lycke Brandt a, Torgeir Moberget a, Dag Alnæs a, Gwenaëlle Douaud d, Eugene Duff d, Srdjan Djurovic e,f, Ingrid Melle a, Torill Ueland a,c, Ingrid Agartz a,b, Ole A Andreassen a, Lars T Westlye a,c
PMCID: PMC5491456  PMID: 28702349

Abstract

The brain underpinnings of schizophrenia and bipolar disorders are multidimensional, reflecting complex pathological processes and causal pathways, requiring multivariate techniques to disentangle. Furthermore, little is known about the complementary clinical value of brain structural phenotypes when combined with data on cognitive performance and genetic risk. Using data-driven fusion of cortical thickness, surface area, and gray matter density maps (GMD), we found six biologically meaningful patterns showing strong group effects, including four statistically independent multimodal patterns reflecting co-occurring alterations in thickness and GMD in patients, over and above two other independent patterns of widespread thickness and area reduction. Case-control classification using cognitive scores alone revealed high accuracy, and adding imaging features or polygenic risk scores increased performance, suggesting their complementary predictive value with cognitive scores being the most sensitive features. Multivariate pattern analyses reveal distinct patterns of brain morphology in mental disorders, provide insights on the relative importance between brain structure, cognitive and polygenetic risk score in classification of patients, and demonstrate the importance of multivariate approaches in studying the pathophysiological substrate of these complex disorders.

Abbreviations: SZ, Schizophrenia; BD, Bipolar Disorder; HC, Controls; LICA, Linked Independent Component Analysis; VBM, Voxel Based Morphometry; GMD, Gray Matter Density; PGRS, Polygenic Risk Score; GLM, General Linear Model; AUC, Area Under The Receiver-Operating-Characteristic Curve

Keywords: Multimodal MRI, Clinical prediction, Classification, Brain structure, Schizophrenia, Bipolar disorder, Cognition, Polygenic risk

Highlights

  • Linked ICA showed six independent multivariate morphology patterns sensitive to SZ.

  • Machine learning used to compare brain structure, cognitive and genetic scores.

  • Cognition showed highest prediction of SZ, boosted by brain structure or genetics.

1. Introduction

Schizophrenia and bipolar disorder are complex disorders with high heritability (van Os and Kapur, 2009), and are along with other mental and behavioral disorders the largest global contributors to years lived with disability (Vos et al., 2013). Whereas recent large-scale collaborative efforts have provided some clues about the genetic underpinnings (Psychiatric Genomics Consortium, 2014), the search for genes or single-nucleotide polymorphisms (SNPs) with strong impact on clinical expression has largely proven unsuccessful. This has reinforced the search for distinct intermediate phenotypes, quantitative biological traits that are reasonably heritable (Preston and Weinberger, 2005), which may be more strongly associated to gene function compared to diagnostic categories (Gottesman and Gould, 2003).

Both clinical expression and empirical evidence suggest molecular, neurochemical, and macrostructural brain abnormalities in severe mental disorders (van Os and Kapur, 2009). In line with the clinical and pathophysiological heterogeneity evident in these disorders, the brain underpinnings are multidimensional, reflecting a myriad of complex pathological processes and environmental effects. Multivariate techniques are well suited to disentangle the different sources of variability in brain imaging data, where each source presumably reflects independent biological pathways with unique genetic and environmental determinants. Using these methods to determine the underlying structure of brain morphology changes in severe mental disorders could provide novel clues about disease mechanisms and candidate avenues for novel and personalized interventions (Insel and Cuthbert, 2015). Partial least squares methods, for instance, which are based on the hypotheses of a linear relationship between the observations (predictor variables) and dependent variables and maximize the covariance between the two set of variables (Sui et al., 2012), have been used for multimodal fusion of function magnetic resonance imaging (MRI) and EEG (Martınez-Montes et al., 2004) as well as PET and structural MRI (Chen et al., 2009). Supervised machine learning regression approach was used to predict brain development index and assess the relevant multiparametric imaging patterns from T1 and diffusion tensor images (Erus et al., 2015). Linked independent component analysis (LICA), a probabilistic technique based on Bayesian framework, is a promising data-driven multimodal fusion technique for modeling co-variances across modalities (Groves et al., 2011). Its potential application has been demonstrated in multimodal studies of healthy subjects (Douaud et al., 2014, Groves et al., 2012), Alzheimer's disease spectrum (Doan et al., 2017) and patients with attention deficit hyperactivity disorder (Francx et al., 2016) and schizophrenia (Brandt et al., 2015).

To identify distinct brain morphology patterns in schizophrenia and bipolar disorder, we performed data-driven fusion of brain imaging phenotypes including cortical thickness, surface area and gray matter density maps using LICA (Groves et al., 2011, Groves et al., 2012). This multivariate technique enables data-driven decomposition of multimodal imaging features into a linear combination of independent components, each of which may represent a biologically interpretable mode of brain variation. Cortical surface area and thickness are important morphological indices of the brain cerebral cortex. Although the exact neurobiological constituents remain unclear, surface area and cortical thickness may be determined by the number and the laminar patterning of cortical columns, respectively (Chen et al., 2013, Rakic, 2009), thus providing a biologically relevant decomposition of cortical volume. Gray matter density map provides a mixed measure of gray matter that may partly reflect interactions between cortical thickness and surface area, but which is also likely reflecting relevant brain morphological variance that is not modeled by the surface-based thickness and area measures (Hutton et al., 2009). Surface-based thickness and area contribute to only a proportion of the gray matter density alterations in SZ and considering both surface-based and voxel-based measures in SZ studies may therefore both increase sensitivity (Palaniyappan and Liddle, 2012), and provide important information about the inter-dependence between the three measures across the brain.

We next applied machine learning, or multivariate pattern analysis, to identify robust combinations of multivariate brain morphology patterns that were most discriminative between groups. Here, our primary aim was not to build a classification model with maximal performance compared to existing models. Instead, by means of multivariate machine learning classification, we aimed to gain further insights regarding the most discriminative combinations of features and the importance of each feature with respect to the others in such combinations. To study their sensitivity to clinical and cognitive traits, we tested for associations with diagnosis, in addition to a range of cognitive domains and clinical variables. Polygenic risk score (PGRS) quantifies the additive effects of a large number of genetic variants with individually weak effects on complex traits. It is computed for each individual by summing up the effect sizes of a set of SNPs, selected based on a p-value threshold and weighted by the number of individual risk alleles (Purcell et al., 2009, Tesli et al., 2014). PGRS has been used as a useful genetic marker for evaluating the effect of cumulative genetic risks on the brain phenotypes (Kanai and Rees, 2011, Kauppi et al., 2015). Therefore, we also assessed to which degree the multivariate brain morphology patterns are modulated by PGRS for schizophrenia and bipolar disorder. Finally, to test the added predictive value provided by multivariate brain imaging features when used in combination with cognitive performance and polygenic risk, we performed and compared group classification using the different combinations of these feature sets. Based on previous reports on brain morphometric alterations in schizophrenia and bipolar disorders (Elvsåshagen et al., 2013, Hibar et al., 2017, Hibar et al., 2016, Kuperberg et al., 2003, Moberget et al., 2017, Rimol et al., 2012, van Erp et al., 2016a, van Erp et al., 2016b), we hypothesized that LICA would reveal morphological patterns that not only converge with univariate findings such as the characteristic pattern of fronto-temporal thinning in the patient groups, but also show novel modes of brain morphometric variability involving multiple morphometric measures sensitive to diagnosis. Based on the previously reported brain structural heterogeneity in patients relative to controls (Kambeitz et al., 2015, Nenadic et al., 2012), we expected to observe moderate discriminative power of the resulting multivariate features at an individual level. Lastly, we hypothesized that combining brain morphology, polygenic and cognitive scores would yield improved predictive value compared to using each of these feature sets alone.

2. Material and methods

2.1. Participants

Participant demographics are summarized in Table 1. Briefly, we included 223 participants with schizophrenia spectrum disorders (age = 32.1 ± 9.3 years, 95 women, 168 schizophrenia, 22 schizophreniform, 33 schizoaffective), 190 with bipolar spectrum disorders (age = 35.0 ± 11.3 years, 111 women, 117 bipolar disorder I, 64 bipolar disorder II, and 9 bipolar disorder not otherwise specified), and 284 healthy controls (age = 35.2 ± 9.6 years, 134 women). All participants were recruited as part of the Thematically Organized Psychosis (TOP) study, which was approved by the Regional Committee for Medical Research Ethics and the Norwegian Data Inspectorate. Written informed consent was obtained from all participants. Patients were recruited from both inpatient and outpatient clinics (but mostly outpatient) at major psychiatric hospitals in the Oslo area with the following criteria: aged between 18 and 65 years, understood and spoke a Scandinavian language, had no history of severe head trauma, and obtained an IQ score of above 70. Healthy controls were excluded if they or any of their first-degree relatives had a lifetime history of a severe psychiatric disorder (schizophrenia, bipolar disorder or major depression). Patients were clinically characterized through a personal interview conducted by trained physicians or clinical psychologists. The assessment covered diagnostics, symptomatology, neurocognition, drug use and medication status (Simonsen et al., 2011). Psychiatric diagnosis was established using the Structured Clinical Interview for DSM-IV Axis I Disorders (SCID) (First et al., 1996). An overview regarding family history of the patients is presented in Supplementary Table 3. The controls were randomly sampled from national registries from the same catchment area and age range as the patients, and had no psychiatric or alcohol/substance use disorder, as well as no cannabis use the last 3 months.

Table 1.

Sample characteristics.

Group SZ BD HC Group comparisons
SZ vs. BD SZ vs. HC BD vs. HC
Demographics, education
Total N 223 190 284
Sex (% female) 95 (42.6) 111 (58.4) 134 (47.2) χ2 = 9.65, p = 1.89E-03 χ2 = 5.32, p = 2.11E-02 χ2 = 0.88, p = 3.48E-01
Age (years) 32.10 ± 9.31 34.99 ± 11.31 35.22 ± 9.60 t = − 2.73, p = 1.96E-02 t = − 3.42, p = 1.99E-03 t = − 0.37, p = 1
Education (years) 12.75 ± 2.49 13.50 ± 2.27 14.15 ± 2.26 t = − 2.36, p = 5.62E-02 t = − 5.43, p < 1E-04 t = − 2.81, p = 1.54E-02
Ethnicity (% caucasian) 180 (80.7) 171 (90) 280 (98.5)



Cognitive domains mean z ± sd (n)
g − 1.64 ± 2.45 (181) − 0.01 ± 2.20 (177) 1.08 ± 1.58 (278) t = − 7.58, p < 1E-04 t = − 14.59, p < 1E-04 t = − 6.19, p < 1E-04
Processing speed − 0.63 ± 0.92 (193) − 0.13 ± 0.92 (177) 0.51 ± 0.82 (283) t = − 5.76, p < 1E-04 t = − 14.90, p < 1E-04 t = − 8.33, p < 1E-04
Verbal learning/memory − 0.45 ± 0.83 (194) 0.06 ± 0.90 (178) 0.25 ± 0.72 (284) t = − 6.07, p < 1E-04 t = − 9.83, p < 1E-04 t = − 2.99, p = 8.56E-03
Executive function − 0.53 ± 0.87 (193) − 0.01 ± 0.69 (178) 0.37 ± 0.49 (284) t = − 7.08, p < 1E-04 t = − 14.41, p < 1E-04 t = − 6.41, p < 1E-04
Working memory/attention − 0.35 ± 0.89 (194) − 0.07 ± 1.01 (177) 0.28 ± 0.99 (284) t = − 3.17, p = 4.79E-03 t = − 7.33, p < 1E-04 t = − 3.72, p = 6.5E-04



Symptomsamean ± sd (n)
Duration of illnessb 10.33 ± 8.15 (220) 13.69 ± 9.91 (188) na t = − 3.7, p = 2.4E-04
PANSS negative 15.55 ± 6.59 (220) 10.11 ± 3.60 (186) na t = 10.5, p < 1E-04
PANSS positive 14.86 ± 5.38 (219) 10.08 ± 3.64 (187) na t = 10.6, p < 1E-04
PANSS total 62.18 ± 17.21 (217) 45.59 ± 10.12 (186) na t = 12, p < 1E-04



Drug use n (%)
Alcohol use last month 131 (58.7) 139 (73.2) 213 (75.0)
Amphetamine last month 8 (3.6) 2 (1.1) 1 (0.4)
Cocaine use last month 4 (1.8) 3 (1.6) 2 (0.7)
Cannabis use last month 17 (7.6) 16 (8.4) 3 (1.1)
AUDIT score mean ± sd (n) 6.51 ± 5.87 (198) 8.05 ± 5.83 (178) 6.10 ± 2.93 (247)



Medication n (%)
Antipsychotic 179 (80.3) 74 (38.9) na
Lithium 2 (0.9) 35 (18.4) na
Antiepileptic 29 (13.0) 82 (43.2) na
Antidepressant 57 (25.6) 52 (27.4) na
Hospitalization (mean ± sd) 2.4 (3.3) 1.6 (2.3) na



Polygenic risk scores (PGRS) (total N = 505)
N 145 144 216
SZ PGRS (mean ± sd) 0.34 ± 0.94 0.11 ± 1.01 − 0.30 ± 0.94 t = 1.72, p = 2.57E-01 t = 6.05, p < 1E-04 t = 4.13, p = 1.26E-04
BD PGRS (mean ± sd) 0.03 ± 0.99 0.22 ± 0.96 − 0.17 ± 1.01 t = − 1.62, p = 3.16E-01 t = 1.84, p = 2E-01 t = 3.61, p = 1E-03

AUDIT: Alcohol Use Disorders Identification Test. SZ = Schizophrenia, BD = Bipolar Disorder, HC = Controls.

a

The median time period between the clinical assessment and MRI scan was 155 days.

b

Defined as years between age at the first occurrence of any psychiatric illness episode (psychotic, affective, or other) and date of MRI scan.

2.2. MR acquisition

Magnetic resonance imaging data were obtained on a 1.5 Tesla Siemens MAGNETOM Sonata scanner (Siemens Medical Solutions, Erlangen, Germany) supplied with a standard head coil. For each participant, two T1-weighted images were acquired using a repeated 3D T1-weighted magnetization prepared rapid acquisition gradient echo (MPRAGE) sequence with the following parameters: repetition time (TR) = 2730 ms, echo time (TR) = 3.93 ms, inversion time (TI) = 1000 ms, field of view (FOV) = 240 mm, flip angle (FA) = 7o, matrix = 192 × 256, voxel size = 1.33 × 0.94 × 1 mm, 160 sagittal slices. The two T1-weighted scans obtained for each participant were averaged after rigid registration to improve signal-to-noise ratio (SNR).

2.3. Image pre-processing

T1-weighted scans were processed using FreeSurfer (http://surfer.nmr.mgh.harvard.edu) to estimate vertex-wise cortical thickness and surface arealization (Dale et al., 1999). Surface maps were resampled to a common coordinate system (fsaverage5, 10,242 vertices) using a non-rigid high-dimensional spherical averaging method to align cortical folding patterns (Fischl and Dale, 2000). FSL-VBM (Douaud et al., 2007) was used to derive gray matter density (GMD) maps (see Supplementary Information (SI)).

Thickness maps were smoothed using a Gaussian kernel with a commonly used full width of half maximum (FWHM) of 15 mm, resulting in a smoothness of 20.8 mm. To match smoothness across surfaces, the surface area maps were smoothed with different values of FWHM (ranging from 10 mm to 15 mm) and maps having approximately the same smoothness as cortical thickness (corresponding to a FWHM of 11 mm) were used for further processing. In accordance with the preprocessing steps described in (Groves et al., 2012), the GMD maps were resampled to have an isotropic voxel size of 4 × 4 × 4 mm3 using a trilinear interpolator, and smoothed with a FWHM of 10.5 mm (sigma = 4.5 mm).

2.4. Linked independent component analysis

We performed a data-driven decomposition of the imaging features obtained from all subjects into independent components using the LICA implementation by FMRIB, University of Oxford (http://fsl.fmrib.ox.ac.uk/fsl/fslwiki/FLICA (Groves et al., 2012). LICA was developed based on the conventional ICA technique, which assumes the signal to be a linear mixture of statistically independent spatial patterns that are non-Gaussian. The subject weights, or mixing parameters, are unknown. During the optimization process, ICA searches for maximally non-Gaussian patterns by iteratively updating the subject weights. To model covariance patterns across modalities, LICA allows simultaneous ICA decompositions on different modalities but constrains the subject weights to be the same across modalities. Furthermore, LICA balances the information content from different modalities, allowing a modality to be absent from a component. A LICA component is thus characterized by its spatial maps (one per modality) and the subject weights that are shared across measures, and may involve multiple (hereafter generally referred to as multimodal components) or only one measure (unimodal components). Whereas the group spatial maps indicate the spatial variability at the group level, the subject weights indicate the relative contribution of a subject to the component. For instance, for a given modality in a component, if its spatial map shows positive pseudo z-score, then larger subject weights would reflect relative increases in the corresponding modality; and vice versa, for a spatial map with negative values, larger subject weights would reflect relative decreases. To aid visualization and interpretation of the anatomical distribution of an effect of interest in subsequent analyses on the subject weights, we thresholded the spatial maps (3 < | z | < 10), in line with previous publications (Brandt et al., 2015, Groves et al., 2012), with stronger effects implicated in regions with larger z-scores. Model order selection procedures based on cophenetic coefficient (Ray et al., 2013) suggested that fifty components provided a good fit with the data (see SI), with each component representing a distinct mode of brain variation.

2.5. Statistical analyses

2.5.1. Univariate analyses of the LICA subject weights

We applied general linear models (GLM) to test for the main effects of group, age and sex, as well as of the interaction between age and group, on the subject weights of each LICA component (group and sex coded as categorical variables R's lm function). The group pairwise contrasts were computed using the lsmeans R package (Lenth, 2016). We assessed the effect of intracranial volume (ICV) on the main findings by additionally including this measure as a covariate in the group effect analyses, accounting for age and sex. We further checked for the association between the components and total lateral ventricular volume, accounting for age, sex and ICV. We studied the pairwise correlations between all components by means of full and partial correlation.

Further, we assessed the associations between LICA subject weights and cognitive domain scores (g factor, processing speed, verbal learning/memory, executive function, working memory/attention), symptom domain (duration of illness, negative, positive and total PANSS) and polygenic risk scores (Table 1 and SI). We included measures of cognitive domains previously found to be impaired in schizophrenia and bipolar disorder (Bowie and Harvey, 2005, Simonsen et al., 2011). Possible confounding roles of ethnicity and subject motion, quantified using signal-to-noise ratio as a proxy, on the main effect and cognitive analyses were assessed and presented in SI. For the LICA components showing significant group effects, we explored possible effects of medication, substance use (drug, alcohol), and education within either schizophrenia or bipolar disorder group by including each of these variables in the GLM.

Correction for multiple testing across all LICA components was performed using permutation testing. The subject weights were permuted 10,000 times with respect to age, sex, and group, as well as cognitive, polygenic risk, and symptom scores when applicable. In particular, for the main group effect analysis, in each permutation, the maximum value of the f statistics associated to the main group effect across all components was computed and stored. This entire process resulted in a null distribution of the f statistics consisting of 10,000 values and the original f statistic obtained from the non-permuted data. The corrected p value was computed as the ratio between the number of values in the null distribution greater or equal to the original f statistic and the number of values in the null distribution. A similar permutation procedure was applied to obtain the corrected p values for the group pairwise comparisons. Unless specified otherwise, the p values reported throughout the manuscript are corrected for multiple comparisons using permutation testing as this non-parametric procedure only make weak assumptions and can provide the exact control of false positives from the data (Winkler et al., 2014). However, to facilitate comparisons with previous literature in which FDR correction is commonly used, for the main effect analyses, we also report FDR-corrected values (Benjamini and Hochberg, 1995) (Supplementary Table 1).

2.5.2. Multivariate machine learning analyses

Finally, we performed pairwise group classification based on a leave-one-out cross-validation approach using as features the LICA components after regressing out the linear effect of age and sex. We used the random forest classifier as implemented in the randomForest R package (Liaw and Wiener, 2002). For each classification, one subject was left out as a testing set and a classifier was trained on the remaining subjects. During training, the optimal number of features that should be randomly chosen for splitting at each tree was estimated such that it minimized the out-of-bag error (Breiman, 2001) on the training data using the tuneRF function (the testing set remained untouched). The trained classifier was then used to predict the class of the testing set. This process was repeated for each and every subject. Due to the imbalanced sample sizes across groups, to alleviate biased performance towards higher accuracy on the majority class, during training of the random forest classifier, we repeatedly sampled with replacement an equal number of subjects per class, and additionally, we used the area under the receiver-operating-characteristic curve (AUC) as the main performance measure. We repeated this classification using only data from subjects with a diagnosis of schizophrenia (N = 168) in the schizophrenia group, subjects with a diagnosis of bipolar I (N = 117) in the bipolar group, and the controls. On a subset of the sample for which imaging, cognitive and genetic data are available (schizophrenia = 122, bipolar disorder = 132, controls = 212), we performed group classifications using the different combinations of these different feature sets in the same cross-validation framework as described above to assess their complementary predictive value. Significance in terms of classification improvement was evaluated using permutation testing (more details can be found in SI).

LICA decomposition was performed using Matlab (version R2014a). All statistical analyses and classification were performed in R (http://cran.r-project.org, version 3.2.1).

3. Results

3.1. Univariate analyses of the LICA subject weights

3.1.1. Association with diagnosis

Six components (IC1,2,5,8,12,25 explaining 15.5%, 12.3%, 1.7%, 1.6%, 1.3%, 0.95% of the data variance (Supplementary Fig. 1), respectively) showed significant (p < 0.05, corrected) main effects of diagnosis (Fig. 1). Eleven (IC1,2,3,5,8,9,11,12,16,20,22) showed significant main effects of age (see SI, Supplementary Fig. 3), and nine (IC1,5,8,9,11,12,14,25,28) showed significant main effects of sex. Detailed results are presented in Supplementary Table 1.

Fig. 1.

Fig. 1

(a) Spatial maps of six LICA components showing significant group effects. Volumetric map is presented for GMD, whereas surface maps are presented for cortical thickness and surface area. Only spatial maps of modalities with considerable contribution to the components are shown. All maps were thresholded with | z | > 3. SA = surface area, CT = cortical thickness. Whereas IC1,2,12,25 were unimodal, i.e. dominated by a single modality, IC5,8 were multimodal and driven by variation in both CT and GMD maps. (b) Subject weight distribution of the above six components. The diamond signs represent the group means. The plotted values are the residuals obtained by regressing out age and sex effects. SZ = Schizophrenia, BD = Bipolar Disorder, HC = Controls.

IC1 reflects global cortical surface area with schizophrenia showing smaller subject weights than bipolar disorder (t = − 4.26, p = 3.8E-03) and controls (t = − 4.71, p = 5E-04). This component correlated positively with ICV (Buckner et al., 2004) (t = 31.70, p < 1E-04). Importantly, however, the group effect remained when including ICV in the GLM (F = 10.04, p = 2.6E-03, schizophrenia < bipolar disorder: t = − 4.15, p = 6.2E-03, schizophrenia < controls: t = − 3.61, p = 4.7E-02). IC2 reflects global cortical thickness. Schizophrenia and bipolar disorder patients showed decreased subject weights compared to controls (schizophrenia < controls: t = − 7.31, p = 1E-04, bipolar disorder < controls: t = − 4.88, p = 2E-04), indicating global cortical thinning in both patient groups.

IC5 is a multimodal component mainly driven by thickness (54% weight) and GMD (38% weight), implicating cingulate, insular and medial frontal thickness, as well as global variation with an opposite weighting in GM and WM. Schizophrenia (t = 5.4, p = 1E-04) and bipolar disorder (t = 5.31, p = 1E-04) had larger subject weights than controls, indicating increased thickness and GMD and decreased white matter density (WMD) in the patient groups. This component showed a negative association with total WM volume (t = − 13.88, p < 1E-03).

IC8 reflects multimodal involvement of lateral temporal, parietal and medial frontal thickness (27% weight) as well as a bilateral pattern of temporal occipital fusiform cortex, lingual cortex, precentral, postcentral gyrus and hippocampus GMD (65% weight). Compared to controls, schizophrenia (t = − 4.28, p = 3.7E-03) and bipolar disorder (t = − 3.63, p = 4.35E-02) showed decreased subject weights, indicating reduced thickness and GMD in these regions.

IC12 revealed a distinct gradient in thickness along the anterior-posterior axis with positive and negative weights in the frontal and posterior lobes, respectively. Compared to controls, schizophrenia (t = − 3.84, p = 1.97E-02) and bipolar disorder patients (t = − 3.34, p = 1.2E-01) showed smaller subject weights, indicating a shift in thickness distribution across the brain surface with relatively less anterior compared to posterior thickness in patients relative to controls.

IC25 reveals reduced cerebellar GMD in schizophrenia compared to controls (t = − 3.43, p = 8.75E-02, FDR corrected p = 1.19E-02).

ICV also showed an association on IC5 and IC12 (IC5: t = − 6.8, p < 1E-03, IC12: t = − 3.8, p < 1E-03). However, the results on group differences did not change when including ICV as an additional covariate in the GLM. Ventricular volume showed an association with IC1,2,5,8 (IC1: t = − 6.3, p < 1E-03, IC2: t = − 2.8, p = 5E-03, IC5: t = 2.5, p = 1.3E-02, IC8: t = − 8.6, p < 1E-03, uncorrected), accounting for age, sex and ICV, reflecting larger ventricular GMD regions in the patient groups. Although IC1 and IC2 were mainly dominated by surface area and thickness (Fig. 1), they were also subtly influenced by the GMD measure (Supplemental Fig. 10).

In general, weak correlations were observed between the components (maximum partial correlation = 0.26, full correlation = 0.23), and only a small subset of components was significantly correlated with at least one other component (IC2 with IC5,8,9,20,26; IC4 with IC40; IC0 with IC1,5) (Supplementary Fig. 6).

3.1.2. Associations with cognitive domain scores, PGRS and symptom domain scores

Groups were significantly different in all cognitive domains with lower performance in patients (schizophrenia < bipolar disorder < controls). Bipolar disorder had higher PGRS for bipolar disorder than controls, and both schizophrenia and bipolar disorder had higher PGRS for schizophrenia than controls. PGRS for schizophrenia and bipolar disorder explained ~ 13% and 6% of the variance in diagnostic status (Nagelkerke pseudo R2), respectively (Table 1).

Permutation testing revealed no significant univariate associations between the brain morphology patterns and any of the cognitive, PGRS, or symptom scores. However, our results showed several nominally significant associations with cognitive scores and PGRS, which warrant replication analyses in independent samples. Among others, processing speed showed a positive association with IC8 in schizophrenia (t = 3.31, p = 1.1E-03, uncorrected) and in bipolar disorder (t = 2.1, p = 3.73E-02, uncorrected), indicating that reduced processing speed may be related to reduced lateral temporal and medial frontal cortical thickness and specific local GMD regions in the patient groups (Fig. 4). IC1, reflecting global surface area, and IC5, reflecting cerebellar GDM, also showed a trend association with processing speed and working memory/attention, respectively (see SI for more details and other results).

Fig. 4.

Fig. 4

Scatter plot of processing speed as a function of IC8's subject weights. Linear effects of age and sex on both IC8 and processing speed were regressed out before plotting. SZ = Schizophrenia, BD = Bipolar Disorder, HC = Controls.

3.1.3. Post-hoc analyses with medication, substance use, education

Post-hoc analyses on the set of six components with significant diagnosis effect showed no significant associations with clinical variables, or with education, within the patient groups.

3.2. Multivariate machine learning classification analyses

Classification of schizophrenia and controls using all LICA components yielded an AUC of 0.75 (Fig. 2) (accuracy = 69%, specificity = 74%, sensitivity = 62%). Classification of bipolar disorder and controls, and schizophrenia and bipolar disorder yielded lower performance (bipolar disorder vs. controls: AUC = 0.67, accuracy = 66%, specificity = 72%, sensitivity = 58%; schizophrenia vs. bipolar disorder: AUC = 0.59, accuracy = 58%, specificity = 52% and sensitivity = 62%). Fig. 2B showed that IC1,2,5,8,12,25 are the most important features for both schizophrenia vs. controls and bipolar disorder vs. controls, and IC1 and IC39 (reflecting hippocampal GMD) for schizophrenia vs. bipolar disorder. This performance remained unchanged when classifying only subjects with schizophrenia diagnosis (excluding those with schizoaffective and schizophreniform), bipolar disorder I and controls (AUC = 0.76, 0.67 and 0.53 for schizophrenia vs. controls, bipolar I vs. controls, and schizophrenia vs. bipolar I, respectively).

Fig. 2.

Fig. 2

Performance of the pairwise group classification on the whole sample: A. ROC plot; B. Spider plot indicating the relative importance of all features included (1 = most important, 0 = least important). SZ = Schizophrenia, BD = Bipolar Disorder, HC = Controls.

Further, we evaluated the complementary predictive value of brain patterns, cognitive scores and PGRS (Fig. 3). In classification of schizophrenia and controls, cognitive scores gave a higher performance than LICA features (AUC = 0.81 vs. 0.67). Using the combined set of cognitive and LICA features yielded significantly higher results (AUCcognitive + LICA = 0.85, p = 7.4E-03, permutation testing keeping the original ordering of cognitive features while permuting randomly LICA features, repeated 5000 times) compared to using cognitive features alone (AUCcognitive only = 0.81) or using LICA alone (AUCLICAonly = 0.67, p = 2E-04, permutation testing keeping the original ordering of LICA features while randomly permuting cognitive features). PGRS when used alone yielded a modest performance (AUC = 0.6), but when used in addition to either LICA features or cognitive scores also led to an improved performance (AUC = 0.73, p = 2E-04; 0.84, p = 1E-02, respectively). However, additionally including PGRS to the combination of LICA and cognitive scores did not improve performance. The relative feature importance plot (Fig. 3D) showed that the cognitive features are more informative than LICA and PGRS features. IC1,2 and 5 are the most informative features among the LICA components. Similar patterns were observed for bipolar disorder vs. controls, although accuracies were generally lower. Classification between schizophrenia and bipolar disorder showed a low performance even when using all feature sets together (AUC < 0.63).

Fig. 3.

Fig. 3

Performance of the pairwise group classification performed on a subset where imaging, cognitive and polygenic risk score are available: A,B,C. ROC plots for classification schizophrenia (SZ) and controls (HC), bipolar disorder (BD) and HC, SZ and BD, respectively; D. Spider plot indicating the relative importance in case all feature sets were included (1 = most important, 0 = least important). PS = Processing speed, VL/mem = Verbal learning/memory, EF = Executive function, WM/att = Working memory/attention.

4. Discussion

Using a data-driven multivariate approach for multimodal fusion of brain morphometric properties, we identified six novel distinct multivariate patterns of complex brain variability, showing significant differences in schizophrenia and bipolar disorder compared to controls. Two independent patterns reflected anatomically distributed cortical thickness and surface area, suggesting global cortical thinning in the patient groups, and area reduction in schizophrenia compared to bipolar disorder and controls. Beyond these global effects, four multimodal regional brain patterns also showed strong effects, capturing 1) correlated increases in cingulate thickness and decreases in white matter volume, 2) fronto-parietal and temporal thickness, 3) cerebellar gray matter density, and 4) a distinct anterior-posterior gradient in cortical thickness. Group classification revealed high accuracy for diagnostic prediction using cognitive data alone. Adding polygenic risk and imaging features significantly increased accuracy, suggesting complementary predictive value of brain imaging, cognitive performance and polygenic risk in classifying between patients with severe mental illness and healthy controls.

LICA allowed us to isolate a relatively small number of distinct and biologically interpretable patterns of brain structure variability, each of which may explain just a small portion of the total variation in brain phenotypes underlying severe mental disorders. One important aspect of this approach is that it is fully data-driven and unbiased, i.e. no other information (age, sex or diagnosis) than the imaging data was used to derive the patterns. Furthermore, by means of simultaneous modeling of both global and regional features linking complementary morphological measures (thickness, surface area, GMD maps), we were able to untangle global from regional effects that would have been difficult to disentangle when considering each of the measures separately using univariate approaches. Such a multivariate approach focuses on interrelated patterns across multimodal measures, allowing the identification of complex and weak effects hidden in high-dimensional data not previously shown in studies applying standard univariate methods (Calhoun and Sui, 2016, Douaud et al., 2014).

4.1. Case-control difference in LICA subject weights

We identified six distinct multivariate patterns of brain structure variations showing significant group differences. IC1 reflected global variability in surface area, and the strong correlation with ICV supports its global properties. Schizophrenia showed smaller subject weights than bipolar disorder and controls, indicating that this component is specific to schizophrenia. This finding is also consistent with recent meta-analyses confirming reduced ICV in schizophrenia (van Erp et al., 2016a) but not in bipolar disorder (Hibar et al., 2016). Compared to controls, we also observed reduced subject weights in schizophrenia and bipolar disorder in a component reflecting global cortical thickness (IC2), in line with evidence of widespread cortical thinning in schizophrenia (Goldman et al., 2009, Kuperberg et al., 2003, Rimol et al., 2010a), and also thinning in bipolar disorder (Elvsåshagen et al., 2013, Lyoo et al., 2006, Rimol et al., 2010a), although to a lesser extent.

Since IC1 and IC2 modeled the global effects, which accounted for a large amount of data variance, subtler and more anatomically specific variance potentially related to disease processes can be revealed. We identified four other components (each explaining < 2% variance) showing strong main effects of group. Each of these components potentially represents independent pathogenic mechanisms, as supported by the weak pairwise correlation (Supplementary Fig. 6).

IC5 revealed a distinct pattern of distributed GMD and WMD voxels, reflecting decreasing WMD with increasing GMD, in addition to localized and positively weighted lateral fronto-parietal and cingulate thickness variation. IC5 is similar to a component recently suggested to reflect a network of gray matter regions involved in transmodal processing (Douaud et al., 2014), with estimated age-trajectories that mirrored both healthy developmental and aging processes, and with heightened vulnerability to schizophrenia and Alzheimer's disease by spatially recapitulating the pattern of macrostructural abnormalities seen in both disorders. In line with this recent study, we observed increased subject weights in schizophrenia, indicating a correlated pattern of increased cortical GMD, increased cortical thickness along the cingulate gyrus, along with decreased WMD. This specific component captured a source of variation over and above global effects, and the focal pattern of increased GMD and cortical thickness was identifiable since the variability related to global cortical thickness was accounted for in IC2.

The brain pattern observed in IC5 is in line with the balloon model hypothesis (Harasty et al., 2003, Seldon, 2005), which proposes that as the WM grows, the cortical columns stretch and become thinner. This tangential cortical expansion caused by WM growth is hypothesized to increase the capacity of the cortex to differentiate afferent signals (Seldon, 2005). In accordance with this, the increased subject weights in schizophrenia and bipolar disorder compared to controls may reflect decreased WM volume along with decreased cortical column differentiation as captured in increased thickness and GMD.

IC8 implicated the lateral temporal, parietal and medial frontal thickness along with GMD map. The GMD pattern largely comprises temporal and occipito-parietal regions, including the occipital fusiform, lingual cortex, precentral and postcentral gyrus and hippocampus. Schizophrenia and bipolar disorder showed significantly reduced subject weights compared to controls, indicating reduced cortical thickness and GMD in the implicated regions. Our GMD findings in this component are consistent with several previous studies reporting GMD reduction in schizophrenia at the precentral, postcentral, parahippocampus gyrus (Glahn et al., 2008, Gupta et al., 2015), fusiform (Onitsuka et al., 2003, van Erp et al., 2016b) and lingual cortex (Antonova et al., 2005). In our study, all of these structures are implicated in the same independent component, suggesting coordinated volumetric alterations in the patient groups. The thickness pattern reflected in this component is in line with previous reports on cortical thinning in schizophrenia and bipolar disorder (Kuperberg et al., 2003, Lyoo et al., 2006, Rimol et al., 2010a). Beyond findings in univariate studies, IC8 further revealed co-occurring alterations of thickness and GMD at partially non-overlapping brain regions, which may be influenced by the same aspects of the etiology in mental disorder. Furthermore, association results with cognitive scores, although only nominally significant, revealed a positive correlation between IC8 and processing speed (stronger in schizophrenia than in bipolar disorder), suggesting that regional cortical thinning and GMD reduction is associated with reduced processing speed in patients.

IC12 revealed a distinct anterior-posterior gradient in cortical thickness with increasing frontal thickness along with decreasing posterior thickness, thus reflecting the relative thickness increase along the posterior-anterior axis over and above all other components. The observed decreased subject weights in schizophrenia and bipolar disorder compared to controls reflects a shift of the thickness distribution towards a stronger posterior compared to anterior weighting. The decreased frontal distribution corresponds with the characteristic fronto-temporal cortical thinning in schizophrenia and bipolar disorder (Elvsåshagen et al., 2013, Kuperberg et al., 2003, Rimol et al., 2012), but extends previous findings by suggesting that this pattern of effects reflects a shift in the anterior-posterior distribution of cortical thickness, over and above global thinning. The linear combination of IC12 and the global cortical thinning component (IC2), would likely result in a net effect of frontal-temporal thinning, as obtained using mass-univariate analyses on the observed absolute thickness values (SI, Supplementary Fig. 9). An important strength of LICA was the ability to model the global thickness reduction effect into a separate independent component (IC2), and thus more subtle patterns of relative thickness changes as reflected by IC12 can be revealed. The spatial distribution of IC12, which was derived solely from the imaging data in a data-driven manner, is consistent with patterns implicating anterior-posterior gradients of gene expression shown in animal studies (Kudo et al., 2007, O'Leary et al., 2007), and partially overlaps with a gradient pattern of cortical thickness genetic correlation revealed in a seed-based analysis seeding from the primary visual cortex (Rimol et al., 2010b). This pattern is also in line with a genetically informed two-cluster solution of cortical morphology, although more closely resembling an anterior-posterior arealization pattern than a ventral-dorsal cortical thickness gradient (Chen et al., 2013).

IC25 reflected a specific cerebellar pattern. Group analyses revealed reduced subject weights in schizophrenia compared to controls indicating reduced cerebellar GMD in this patient group. While the cerebellum has not been among the brain regions most consistently reported in studies of brain structure in schizophrenia (Honea et al., 2005, Shenton et al., 2001), this subcortical structure is increasingly seen as relevant to several brain disorders with marked cognitive changes and distinct patterns of cerebro-cortical degeneration, such as Alzheimer's disease and frontotemporal dementia (Guo et al., 2016). Moreover, both structural (Bostan et al., 2013, Palesi et al., 2015) and functional (Buckner et al., 2011) data suggest extensive connectivity between the cerebellum and associative cerebral cortex. Importantly, the current well-powered study supports previous reports of altered cerebellar structure in schizophrenia (Okugawa et al., 2007) and bipolar disorder (Johnson et al., 2015, Laidi et al., 2015). Our results for IC25 are also in line with two recent large-scale VBM-based analyses of schizophrenia (Gupta et al., 2015, Moberget et al., 2017), underscoring the relevance of the cerebellum for the pathophysiology of severe mental disorders (Watson et al., 2014). The fact that IC25 is specific to the cerebellum, despite that LICA is able to probe co-occurring variation across multiple measures, and the low correlation between this component and other components, may support the notion of a complex interaction between this structure and other brain regions (Andreasen and Pierson, 2008, Barch, 2014). However, a recent study identified robust associations between regional cerebellar volumes and cortical thickness, in particular in patients with schizophrenia(Moberget et al., 2017). Interestingly, the observed patterns cortical thickness associations with cerebellar volumes mirrored the case-control differences in cortical thickness, suggesting coordinated cortico-cerebellar reductions in schizophrenia (Moberget et al., 2017).

Ventricle volume showed an association with IC1,2,5 and 8, reflecting increased ventricular GMD in the patient groups. Ventricle enlargement is among the most robust brain structural findings in schizophrenia (Moberget et al., 2017, van Erp et al., 2016a). Our results showed that ventricular volumetric alteration is not implicated in one single independent mode of variability, but rather distributed and co-occurring with global alteration pattern of surface area and thickness in schizophrenia.

4.2. Associations with cognitive domain and polygenic risk

Whereas the rationale for a close link between the brain structure and inter-individual differences in performance on cognitive tests is sound (Kanai and Rees, 2011), empirical results have been mixed. Previous studies have reported either null association (Killgore et al., 2009) or mixed results (Van Petten, 2004), and have proven difficult to replicate (Boekel et al., 2015). Our results suggest moderate yet potentially interesting associations between the derived multivariate brain morphology patterns and neuropsychological performance. For instance, we found a nominal positive association between IC8 and processing speed within the patient groups. Previous studies have reported an association between processing speed and white matter in schizophrenia involving occipital regions (Antonova et al., 2005, Karbasforoushan et al., 2015), as well as gray matter volume in several frontal, parietal and occipital regions in healthy subjects (Chee et al., 2009). Our results may complement these findings by suggesting that reduced processing speed is associated with a coordinated pattern of reduced medial frontal, lateral temporal, parietal thickness and regional GMD, comprising the precentral gyrus, postcentral gyrus, hippocampus and occipital fusiform, lingual cortices. In accordance with previous findings on a positive correlation between processing speed and total brain volume (Betjemann et al., 2010), the global surface area component (IC1), strongly correlated with ICV, showed a positive association with processing speed. Our results also showed a nominal association between the cerebellar component (IC5) and working memory/attention, in line with studies indicating that the cerebellum underwent rapid phylogenetic increases in size compared to the neocortex (Barton and Venditti, 2013), lesion studies demonstrating that cerebellar alterations produce deficits in verbal working memory (Ravizza et al., 2006) and VBM studies reporting positive correlations between GM volume in cerebellar subregions and working memory (Ding et al., 2012) and IQ (Moberget et al., 2017). It should be noted however that the current associations were non-significant after stringent multiple testing correction and thus replications in future studies are warranted.

Our results revealed no robust associations between brain structure and schizophrenia or bipolar disorder PGRS. This may partly be explained by the fact that PGRS is a cumulative composite score (Psychiatric GWAS Consortium Bipolar Disorder Working Group, 2011, Schizophrenia Psychiatric Genome-Wide Association Study Consortium, 2011) which only explained a moderate amount of variance in diagnostic status in the current sample, and further refinements may increase their sensitivity to brain variability. Although some evidence suggests common genetic variance in brain anatomy and schizophrenia (Lee et al., 2016), our results correspond with a recent large-scale study which reported no evidence for genetic overlaps between schizophrenia risk and volumes of several brain structures (Franke et al., 2016). It is therefore conceivable that the genetic variants influencing individual differences in brain structure is only weakly overlapping with the variants modulating risk for severe mental illness, and thus the hidden heritability of severe mental disorders needs to be revealed elsewhere.

4.3. Classification analysis

4.3.1. Pairwise group classifications using LICA features

To gain further insights on the multivariate combinations of the LICA patterns as well as the sensitivity of such combinations to diagnosis at an individual level, we submitted the LICA components' subject weights to multivariate classification using a cross-validated approach. Classification analysis revealed moderate predictive value for the schizophrenia versus controls in a two-class classification. This performance is comparable to previous findings in a sample with equivalent size using VBM and support vector machine (Nieuwenhuis et al., 2012). In this study, the authors applied VBM and feature selection to use the most predictive sets of voxels for optimal group classification. Our study has a slightly different focus. With the primary aim on finding covariance patterns across complementary brain morphological measures, we applied the LICA approach for feature extraction and applied machine learning classification as a means to further evaluate the resulting features in terms of their discriminative power. Classification of schizophrenia from controls showed slightly lower performance compared to other studies (Kambeitz et al., 2015). There are however several factors, including sample characteristics, that may influence the classification performance. In this study, we originally investigated the entire spectrum of schizophrenia and bipolar disorder, which may show increased heterogeneity within the patient groups and phenotypic overlap with the control group than e.g. schizophrenia and bipolar I disorder. The classification performance obtained was very similar when we excluded patients with schizophreniform and schizoaffective disorders. However, the latter two subgroups comprised a very small number of subjects compared to schizophrenia. The heterogeneity within schizophrenia spectrum remains to be explored in future studies with more reasonably sized subgroups.

Compared to the classification between schizophrenia and controls, the performance of the two-class classifications of bipolar disorder was less accurate versus controls and rather low versus schizophrenia. Schnack et al. reported substantially higher accuracy for classification of schizophrenia versus bipolar disorder (88%) and lower for bipolar disorder versus controls (59%) (Schnack et al., 2014). Several factors may explain the differences in performance. In addition to the difference in sample size, where our sample was significantly larger and included a wide range of schizophrenia and bipolar patients, the schizophrenia group included in that study showed longer duration of illness and higher symptom severity, as reflected by the higher PANSS scores. Furthermore, most of the bipolar disorder patients received lithium treatment (68%) compared to 18% in our sample. These differences may in turn imply that the brain phenotypes of our bipolar group showed lower and higher discriminative power compared to schizophrenia and controls, respectively, as compared to those used in (Schnack et al., 2014), leading to lower classification performance of bipolar disorder versus schizophrenia and higher for bipolar disorder versus controls. This is in accordance with a recent systematic assessment on the relation between sample size and classification in psychiatric disorders, where the authors reported that studies with larger sample size are more likely to show lower accuracy than those with smaller sample sizes, possibly attributed to the increased clinical heterogeneity of the sample, but studies with smaller sample size may show lower generalizability to other samples (Schnack and Kahn, 2016). The difference in classification algorithms used, random forest versus support vector machine, may also have an influence, although most likely to a lesser extent than the patient clinical profiles as the utility of both classifiers in clinical studies has been validated (Greenstein et al., 2012, Kambeitz et al., 2015, Schnack et al., 2014). The difference in feature extraction approaches may also partly explain the difference in performance.

Other structural MRI-based studies documented in a recent review (Wolfers et al., 2015) reported comparable performance with our results on classification of bipolar disorder and controls (Serpa et al., 2014). A higher performance was reported by Rocha-Rego et al. (Rocha-Rego et al., 2014) (72% and 73%) and Bansal et al. (Bansal et al., 2012) (98.2%). However, the considerable differences in sample size (much smaller number of patients (N ≤ 26 versus N = 190 in our study)) and sample characteristics (e.g. older patients (Bansal et al., 2012, Rocha-Rego et al., 2014) with our study showing larger sample heterogeneity likely explain the difference in performance. In general, although some previous studies have reported relatively high classification accuracies, our results of a low classification performance between the schizophrenia and bipolar groups are in line with the reported clinical, genetic, and neurobiological overlaps between these disorders (Cross-Disorder Group of the Psychiatric Genomics Consortium et al., 2013, Karege et al., 2012).

Our results documented moderate classification performance, which is accordance with the notion that MRI-based machine learning for prediction of diagnosis is still in its infancy and has not yet reached the level of accuracy required in a clinical setting (Wolfers et al., 2015). Nevertheless, the multivariate structural patterns sensitive to diagnosis as well as the added discriminative value they carried, as reported in our study, motivate further research on the extraction of novel brain phenotypes using multivariate multimodal fusion techniques to improve the prediction performance.

4.3.2. Assessing added discriminative values of LICA, cognitive and polygenic risk features

The cognitive scores showed a higher classification performance than LICA features, suggesting that cognitive performance has higher clinical sensitivity than imaging features, which is in line with the notion of an intimate link between cognitive function and the underlying pathophysiology (Keefe and Harvey, 2012). Adding cognitive to LICA features and vice versa, LICA to cognitive features, yielded a significantly improved performance, indicating that the two feature sets contain complementary predictive information. This increased performance may reflect added specificity provided by the brain features, a hypothesis that should be addressed in future studies including data from patients with a range of different brain disorders. Whereas the neurocognitive test scores may be non-specific to biological pathways underlying psychiatric diseases, neuroimaging may yield novel insights in the neural mechanisms underlying psychiatric symptoms to inform new interventions (Linden, 2012). Our results support that combining complementary feature sets from different domains improves prediction sensitivity. Similarly, PGRS showed complementary predictive value together with LICA or cognitive features. Adding PGRS to the combined sets of LICA and cognitive features did however not improve performance implying that the predictive value of PGRS is captured by a multivariate combination of brain and cognitive variables. For classification between schizophrenia and bipolar disorder, adding the LICA features did not improve the performance, indicating that the multivariate morphological features, as derived using LICA, did not provide added predictive value. More research using different approaches such as partial least squares and on cohorts with different clinical/cognitive profiles is needed to assess the added value of the brain morphological phenotype in distinguishing between these two disorders.

4.4. Limitations

LICA performs joint analysis of multiple measures and relies on the assumption that the same subject weights are shared across measures. Alternatively, one could consider running conventional ICA separately for each group and subsequently perform post-hoc analyses. However, this would not allow for a joint modeling of the shared variance across features, and it is not clear how one would couple the components (Groves et al., 2011). LICA has the ability to automatically balance information across measures, allowing a component to be only driven by one measure or jointly driven by multiple measures depending on how strongly related the information of a measure to the underlying pattern of the component. It is possible that LICA would return unimodal components that resemble components obtained using separate ICA results. In this case, LICA is still preferred over separate ICA decompositions since its joint analysis framework allows for better interpretation in terms of specificity. In particular, such unimodal components, when found together with other multimodal components in the LICA context, i.e. those driven by multiple measures, may reflect disease or environmental mechanism that is specific to the relevant measure. This is in principle different from post-hoc correlation analysis of the components resulting from separate ICAs. Nevertheless, like with other multivariate methods, the results obtained with LICA should be interpreted with caution, keeping in mind the inherent limitations of the technique, including the assumption of the similar spatial maps across groups and of shared subject weights across measures (Groves et al., 2011).

We included all three groups in the same decomposition. One could consider performing separate analyses for schizophrenia vs. controls, and bipolar disorder vs. controls, and subsequently compare the two patient groups by means of post-hoc analyses. However, such a comparison requires that the components involved are the same across group pairs, which may not be possible to ensure. To compare between schizophrenia and bipolar disorder in relation to controls, which would allow us to assess the specificity of the patterns, one approach is to include all groups in the same decomposition. Unlike supervised techniques such as partial least squares, which maximize the covariance between the input variables and diagnosis label, LICA is a fully data-driven technique that makes use of no diagnosis information, and decomposes the data into independent modes of brain variability. The resulting pattern may reflect different biological and environmental factors, or a combination of them. Whereas data-driven analysis has the potential to reveal novel patterns best describing the data structure that could be sensitive to diagnosis effect, given the high overlap between schizophrenia and bipolar disorder, it may be more sensitive to treat them as separate groups and search for patterns that best differentiate between the two disorders in a supervised analysis framework.

We consistently used random forest as a tool for validating the discriminative power of the LICA features and their added value when used in combination with cognitive and PGRS scores. Whereas the classification performance was in line with the literature, this classifier may however not represent the optimal choice across all feature sets, particularly the PGRS feature set with only two features included.

Lastly, we included a large sample size covering the entire spectrum of schizophrenia and bipolar disorder, since we aimed to find morphological patterns generalized to the psychosis spectrum instead of specific to a subgroup. Whereas the large sample size is a strength, the clinical heterogeneity of the sample may likely partly explain the relatively low classification performance (Schnack and Kahn, 2016).

4.5. Future directions

A possible extension of this work could be to include the genetic data and/or cognitive domain scores as additional “modalities” in LICA decomposition, which may present an effective way to model common variances between genetic, cognitive data and brain morphometry. Furthermore, using multivariate techniques such as LICA to combine structural MRI, functional MRI and diffusion MRI may reveal novel sensitive imaging markers characterizing the potentially complicated relationships among these modalities. Any analysis making use of the diagnosis information may be limited by the potential caveat of the current diagnosis. Another future direction would be to utilize unsupervised clustering or machine learning techniques to identify subgroups that may be more sensitive to clinical or cognitive profiles.

5. Conclusions

Using a data-driven approach for multimodal fusion of brain morphometric features, we identified six distinct multivariate brain patterns underlying strong effects of schizophrenia and bipolar disorder. We provided evidence of complementary diagnostic predictive value of brain imaging, cognitive and genetic features with cognitive performance measures being most sensitive to classification of patients. Although the classification accuracy does not support a direct clinical utility, the novel multivariate brain morphology patterns are biologically interpretable and may inform models of pathogenic mechanisms in severe mental illness.

Fundings

The study has received funding from the European Commission's Seventh Framework Programme (FP7/2007-2013, #602450, IMAGEMEND), Research Council of Norway (#213837, #223273, #204966/F20), the South-Eastern Norway Regional Health Authority (#2013123, #2014097, #2016083) and Kristian Gerhard Jebsen Foundation.

Acknowledgements

The authors would like to thank the participants of the study for their contribution, and the clinicians who were involved in patient recruitment and clinical assessments.

Footnotes

Appendix A

Supplementary data to this article can be found online at http://dx.doi.org/10.1016/j.nicl.2017.06.014.

Appendix A. Supplementary data

Supplementary data

mmc1.docx (7MB, docx)

References

  1. Andreasen N.C., Pierson R. The role of the cerebellum in schizophrenia. Biol. Psychiatry. 2008;64:81–88. doi: 10.1016/j.biopsych.2008.01.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Antonova E., Kumari V., Morris R., Halari R., Anilkumar A., Mehrotra R., Sharma T. The relationship of structural alterations to cognitive deficits in schizophrenia: a voxel-based morphometry study. Biol. Psychiatry. 2005;58:457–467. doi: 10.1016/j.biopsych.2005.04.036. [DOI] [PubMed] [Google Scholar]
  3. Bansal R., Staib L.H., Laine A.F., Hao X., Xu D., Liu J., Weissman M., Peterson B.S. Anatomical brain images alone can accurately diagnose chronic neuropsychiatric illnesses. PLoS One. 2012;7 doi: 10.1371/journal.pone.0050698. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Barch D.M. Cerebellar-thalamic connectivity in schizophrenia. Schizophr. Bull. 2014;40:1200–1203. doi: 10.1093/schbul/sbu076. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Barton R.A., Venditti C. Human frontal lobes are not relatively large. Proc. Natl. Acad. Sci. U. S. A. 2013;110:9001–9006. doi: 10.1073/pnas.1215723110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Benjamini Y., Hochberg Y. Controlling the false discovery rate – a practical and powerful approach to multiple testing. J. Roy. Stat. Soc. B Met. 1995;57:289–300. [Google Scholar]
  7. Betjemann R.S., Johnson E.P., Barnard H., Boada R., Filley C.M., Filipek P.A., Willcutt E.G., DeFries J.C., Pennington B.F. Genetic covariation between brain volumes and IQ, reading performance, and processing speed. Behav. Genet. 2010;40:135–145. doi: 10.1007/s10519-009-9328-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Boekel W., Wagenmakers E.J., Belay L., Verhagen J., Brown S., Forstmann B.U. A purely confirmatory replication study of structural brain-behavior correlations. Cortex. 2015;66:115–133. doi: 10.1016/j.cortex.2014.11.019. [DOI] [PubMed] [Google Scholar]
  9. Bostan A.C., Dum R.P., Strick P.L. Cerebellar networks with the cerebral cortex and basal ganglia. Trends Cogn. Sci. 2013;17:241–254. doi: 10.1016/j.tics.2013.03.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Bowie C.R., Harvey P.D. Cognition in schizophrenia: impairments, determinants, and functional importance. Psychiatr. Clin. N. Am. 2005;28:613–633. doi: 10.1016/j.psc.2005.05.004. [DOI] [PubMed] [Google Scholar]
  11. Brandt C.L., Doan N.T., Tønnesen S., Agartz I., Hugdahl K., Melle I., Andreassen O.A., Westlye L.T. Assessing brain structural associations with working-memory related brain patterns in schizophrenia and healthy controls using linked independent component analysis. NeuroImage. 2015;9:253–263. doi: 10.1016/j.nicl.2015.08.010. (Clinical) [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Breiman L. Random forests. Mach. Learn. 2001;45:5–32. [Google Scholar]
  13. Buckner R.L., Head D., Parker J., Fotenos A.F., Marcus D., Morris J.C., Snyder A.Z. A unified approach for morphometric and functional data analysis in young, old, and demented adults using automated atlas-based head size normalization: reliability and validation against manual measurement of total intracranial volume. NeuroImage. 2004;23:724–738. doi: 10.1016/j.neuroimage.2004.06.018. [DOI] [PubMed] [Google Scholar]
  14. Buckner R.L., Krienen F.M., Castellanos A., Diaz J.C., Yeo B.T. The organization of the human cerebellum estimated by intrinsic functional connectivity. J. Neurophysiol. 2011;106:2322–2345. doi: 10.1152/jn.00339.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Calhoun V.D., Sui J. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging. 2016. Multimodal fusion of brain imaging data: A key to finding the missing link (s) in complex mental illness. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Chee M.W., Chen K.H., Zheng H., Chan K.P., Isaac V., Sim S.K., Chuah L.Y., Schuchinsky M., Fischl B., Ng T.P. Cognitive function and brain structure correlations in healthy elderly East Asians. NeuroImage. 2009;46:257–269. doi: 10.1016/j.neuroimage.2009.01.036. [DOI] [PubMed] [Google Scholar]
  17. Chen K., Reiman E.M., Huan Z., Caselli R.J., Bandy D., Ayutyanont N., Alexander G.E. Linking functional and structural brain images with multivariate network analyses: a novel application of the partial least square method. NeuroImage. 2009;47:602–610. doi: 10.1016/j.neuroimage.2009.04.053. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Chen C.H., Fiecas M., Gutierrez E.D., Panizzon M.S., Eyler L.T., Vuoksimaa E., Thompson W.K., Fennema-Notestine C., Hagler D.J., Jr., Jernigan T.L., Neale M.C., Franz C.E., Lyons M.J., Fischl B., Tsuang M.T., Dale A.M., Kremen W.S. Genetic topography of brain morphology. Proc. Natl. Acad. Sci. U. S. A. 2013;110:17089–17094. doi: 10.1073/pnas.1308091110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Cross-Disorder Group of the Psychiatric Genomics Consortium, Lee S.H., Ripke S., Neale B.M., Faraone S.V., Purcell S.M., Perlis R.H., Mowry B.J., Thapar A., Goddard M.E., Witte J.S., Absher D., Agartz I., Akil H., Amin F., Andreassen O.A., Anjorin A., Anney R., Anttila V., Arking D.E., Asherson P., Azevedo M.H., Backlund L., Badner J.A., Bailey A.J., Banaschewski T., Barchas J.D., Barnes M.R., Barrett T.B., Bass N., Battaglia A., Bauer M., Bayes M., Bellivier F., Bergen S.E., Berrettini W., Betancur C., Bettecken T., Biederman J., Binder E.B., Black D.W., Blackwood D.H., Bloss C.S., Boehnke M., Boomsma D.I., Breen G., Breuer R., Bruggeman R., Cormican P., Buccola N.G., Buitelaar J.K., Bunney W.E., Buxbaum J.D., Byerley W.F., Byrne E.M., Caesar S., Cahn W., Cantor R.M., Casas M., Chakravarti A., Chambert K., Choudhury K., Cichon S., Cloninger C.R., Collier D.A., Cook E.H., Coon H., Cormand B., Corvin A., Coryell W.H., Craig D.W., Craig I.W., Crosbie J., Cuccaro M.L., Curtis D., Czamara D., Datta S., Dawson G., Day R., De Geus E.J., Degenhardt F., Djurovic S., Donohoe G.J., Doyle A.E., Duan J., Dudbridge F., Duketis E., Ebstein R.P., Edenberg H.J., Elia J., Ennis S., Etain B., Fanous A., Farmer A.E., Ferrier I.N., Flickinger M., Fombonne E., Foroud T., Frank J., Franke B., Fraser C., Freedman R., Freimer N.B., Freitag C.M., Friedl M., Frisen L., Gallagher L., Gejman P.V., Georgieva L., Gershon E.S., Geschwind D.H., Giegling I., Gill M., Gordon S.D., Gordon-Smith K., Green E.K., Greenwood T.A., Grice D.E., Gross M., Grozeva D., Guan W., Gurling H., De Haan L., Haines J.L., Hakonarson H., Hallmayer J., Hamilton S.P., Hamshere M.L., Hansen T.F., Hartmann A.M., Hautzinger M., Heath A.C., Henders A.K., Herms S., Hickie I.B., Hipolito M., Hoefels S., Holmans P.A., Holsboer F., Hoogendijk W.J., Hottenga J.J., Hultman C.M., Hus V., Ingason A., Ising M., Jamain S., Jones E.G., Jones I., Jones L., Tzeng J.Y., Kahler A.K., Kahn R.S., Kandaswamy R., Keller M.C., Kennedy J.L., Kenny E., Kent L., Kim Y., Kirov G.K., Klauck S.M., Klei L., Knowles J.A., Kohli M.A., Koller D.L., Konte B., Korszun A., Krabbendam L., Krasucki R., Kuntsi J., Kwan P., Landen M., Langstrom N., Lathrop M., Lawrence J., Lawson W.B., Leboyer M., Ledbetter D.H., Lee P.H., Lencz T., Lesch K.P., Levinson D.F., Lewis C.M., Li J., Lichtenstein P., Lieberman J.A., Lin D.Y., Linszen D.H., Liu C., Lohoff F.W., Loo S.K., Lord C., Lowe J.K., Lucae S., MacIntyre D.J., Madden P.A., Maestrini E., Magnusson P.K., Mahon P.B., Maier W., Malhotra A.K., Mane S.M., Martin C.L., Martin N.G., Mattheisen M., Matthews K., Mattingsdal M., McCarroll S.A., McGhee K.A., McGough J.J., McGrath P.J., McGuffin P., McInnis M.G., McIntosh A., McKinney R., McLean A.W., McMahon F.J., McMahon W.M., McQuillin A., Medeiros H., Medland S.E., Meier S., Melle I., Meng F., Meyer J., Middeldorp C.M., Middleton L., Milanova V., Miranda A., Monaco A.P., Montgomery G.W., Moran J.L., Moreno-De-Luca D., Morken G., Morris D.W., Morrow E.M., Moskvina V., Muglia P., Muhleisen T.W., Muir W.J., Muller-Myhsok B., Murtha M., Myers R.M., Myin-Germeys I., Neale M.C., Nelson S.F., Nievergelt C.M., Nikolov I., Nimgaonkar V., Nolen W.A., Nothen M.M., Nurnberger J.I., Nwulia E.A., Nyholt D.R., O'Dushlaine C., Oades R.D., Olincy A., Oliveira G., Olsen L., Ophoff R.A., Osby U., Owen M.J., Palotie A., Parr J.R., Paterson A.D., Pato C.N., Pato M.T., Penninx B.W., Pergadia M.L., Pericak-Vance M.A., Pickard B.S., Pimm J., Piven J., Posthuma D., Potash J.B., Poustka F., Propping P., Puri V., Quested D.J., Quinn E.M., Ramos-Quiroga J.A., Rasmussen H.B., Raychaudhuri S., Rehnstrom K., Reif A., Ribases M., Rice J.P., Rietschel M., Roeder K., Roeyers H., Rossin L., Rothenberger A., Rouleau G., Ruderfer D., Rujescu D., Sanders A.R., Sanders S.J., Santangelo S.L., Sergeant J.A., Schachar R., Schalling M., Schatzberg A.F., Scheftner W.A., Schellenberg G.D., Scherer S.W., Schork N.J., Schulze T.G., Schumacher J., Schwarz M., Scolnick E., Scott L.J., Shi J., Shilling P.D., Shyn S.I., Silverman J.M., Slager S.L., Smalley S.L., Smit J.H., Smith E.N., Sonuga-Barke E.J., St Clair D., State M., Steffens M., Steinhausen H.C., Strauss J.S., Strohmaier J., Stroup T.S., Sutcliffe J.S., Szatmari P., Szelinger S., Thirumalai S., Thompson R.C., Todorov A.A., Tozzi F., Treutlein J., Uhr M., van den Oord E.J., Van Grootheest G., Van Os J., Vicente A.M., Vieland V.J., Vincent J.B., Visscher P.M., Walsh C.A., Wassink T.H., Watson S.J., Weissman M.M., Werge T., Wienker T.F., Wijsman E.M., Willemsen G., Williams N., Willsey A.J., Witt S.H., Xu W., Young A.H., Yu T.W., Zammit S., Zandi P.P., Zhang P., Zitman F.G., Zollner S., International Inflammatory Bowel Disease Genetics, Devlin C.B., Kelsoe J.R., Sklar P., Daly M.J., O'Donovan M.C., Craddock N., Sullivan P.F., Smoller J.W., Kendler K.S., Wray N.R. Genetic relationship between five psychiatric disorders estimated from genome-wide SNPs. Nat. Genet. 2013;45:984–994. doi: 10.1038/ng.2711. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Dale A.M., Fischl B., Sereno M.I. Cortical surface-based analysis. I. Segmentation and surface reconstruction. NeuroImage. 1999;9:179–194. doi: 10.1006/nimg.1998.0395. [DOI] [PubMed] [Google Scholar]
  21. Ding H., Qin W., Jiang T., Zhang Y., Yu C. Volumetric variation in subregions of the cerebellum correlates with working memory performance. Neurosci. Lett. 2012;508:47–51. doi: 10.1016/j.neulet.2011.12.016. [DOI] [PubMed] [Google Scholar]
  22. Doan N.T., Engvig A., Persson K., Alnaes D., Kaufmann T., Rokicki J., Cordova-Palomera A., Moberget T., Braekhus A., Barca M.L., Engedal K., Andreassen O.A., Selbaek G., Westlye L.T. Dissociable diffusion MRI patterns of white matter microstructure and connectivity in Alzheimer's disease spectrum. Sci Rep. 2017;7:45131. doi: 10.1038/srep45131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Douaud G., Smith S., Jenkinson M., Behrens T., Johansen-Berg H., Vickers J., James S., Voets N., Watkins K., Matthews P.M., James A. Anatomically related grey and white matter abnormalities in adolescent-onset schizophrenia. Brain. 2007;130:2375–2386. doi: 10.1093/brain/awm184. [DOI] [PubMed] [Google Scholar]
  24. Douaud G., Groves A.R., Tamnes C.K., Westlye L.T., Duff E.P., Engvig A., Walhovd K.B., James A., Gass A., Monsch A.U., Matthews P.M., Fjell A.M., Smith S.M., Johansen-Berg H. A common brain network links development, aging, and vulnerability to disease. Proc. Natl. Acad. Sci. U. S. A. 2014;111:17648–17653. doi: 10.1073/pnas.1410378111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Elvsåshagen T., Westlye L.T., Boen E., Hol P.K., Andreassen O.A., Boye B., Malt U.F. Bipolar II disorder is associated with thinning of prefrontal and temporal cortices involved in affect regulation. Bipolar Disord. 2013;15:855–864. doi: 10.1111/bdi.12117. [DOI] [PubMed] [Google Scholar]
  26. van Erp T.G., Hibar D.P., Rasmussen J.M., Glahn D.C., Pearlson G.D., Andreassen O.A., Agartz I., Westlye L.T., Haukvik U.K., Dale A.M., Melle I., Hartberg C.B., Gruber O., Kraemer B., Zilles D., Donohoe G., Kelly S., McDonald C., Morris D.W., Cannon D.M., Corvin A., Machielsen M.W., Koenders L., de Haan L., Veltman D.J., Satterthwaite T.D., Wolf D.H., Gur R.C., Gur R.E., Potkin S.G., Mathalon D.H., Mueller B.A., Preda A., Macciardi F., Ehrlich S., Walton E., Hass J., Calhoun V.D., Bockholt H.J., Sponheim S.R., Shoemaker J.M., van Haren N.E., Hulshoff Pol H.E., Ophoff R.A., Kahn R.S., Roiz-Santianez R., Crespo-Facorro B., Wang L., Alpert K.I., Jonsson E.G., Dimitrova R., Bois C., Whalley H.C., McIntosh A.M., Lawrie S.M., Hashimoto R., Thompson P.M., Turner J.A. Subcortical brain volume abnormalities in 2028 individuals with schizophrenia and 2540 healthy controls via the ENIGMA consortium. Mol. Psychiatry. 2016;21:547–553. doi: 10.1038/mp.2015.63. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. van Erp T.G.M., Hibar D.P., Walton E., Schmaal L., Jiang W., Agartz I., Alpert K.I., Andreassen O.A., Beard L. Organization of Human Brain Mapping; Geneva: 2016. An ENIGMA Schizophrenia Working Group Meta-Analysis of Cortical Thickness/Area in over 6000 Subjects. [Google Scholar]
  28. Erus G., Battapady H., Satterthwaite T.D., Hakonarson H., Gur R.E., Davatzikos C., Gur R.C. Imaging patterns of brain development and their relationship to cognition. Cereb. Cortex. 2015;25:1676–1684. doi: 10.1093/cercor/bht425. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. First M.B., Spitzer R.L., Gibbon M., Williams J. 1996. Structured Clinical Interview for DSM-IV Axis I Disorders–Patient Edition (SCID-I/P, Version 2.0) [Google Scholar]
  30. Fischl B., Dale A.M. Measuring the thickness of the human cerebral cortex from magnetic resonance images. Proc. Natl. Acad. Sci. U. S. A. 2000;97:11050–11055. doi: 10.1073/pnas.200033797. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Francx W., Llera A., Mennes M., Zwiers M.P., Faraone S.V., Oosterlaan J., Heslenfeld D., Hoekstra P.J., Hartman C.A., Franke B. Integrated analysis of gray and white matter alterations in attention-deficit/hyperactivity disorder. NeuroImage. 2016;11:357–367. doi: 10.1016/j.nicl.2016.03.005. (Clinical) [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Franke B., Stein J.L., Ripke S., Anttila V., Hibar D.P., van Hulzen K.J., Arias-Vasquez A., Smoller J.W., Nichols T.E., Neale M.C., McIntosh A.M., Lee P., McMahon F.J., Meyer-Lindenberg A., Mattheisen M., Andreassen O.A., Gruber O., Sachdev P.S., Roiz-Santianez R., Saykin A.J., Ehrlich S., Mather K.A., Turner J.A., Schwarz E., Thalamuthu A., Yao Y., Ho Y.Y., Martin N.G., Wright M.J., Schizophrenia Working Group of the Psychiatric Genomics, C, Psychosis Endophenotypes International, C, Wellcome Trust Case Control, C, Enigma C., O'Donovan M.C., Thompson P.M., Neale B.M., Medland S.E., Sullivan P.F. Genetic influences on schizophrenia and subcortical brain volumes: large-scale proof of concept. Nat. Neurosci. 2016;19:420–431. doi: 10.1038/nn.4228. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Glahn D.C., Laird A.R., Ellison-Wright I., Thelen S.M., Robinson J.L., Lancaster J.L., Bullmore E., Fox P.T. Meta-analysis of gray matter anomalies in schizophrenia: application of anatomic likelihood estimation and network analysis. Biol. Psychiatry. 2008;64:774–781. doi: 10.1016/j.biopsych.2008.03.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Goldman A.L., Pezawas L., Mattay V.S., Fischl B., Verchinski B.A., Chen Q., Weinberger D.R., Meyer-Lindenberg A. Widespread reductions of cortical thickness in schizophrenia and spectrum disorders and evidence of heritability. Arch. Gen. Psychiatry. 2009;66:467–477. doi: 10.1001/archgenpsychiatry.2009.24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Gottesman I.I., Gould T.D. The endophenotype concept in psychiatry: etymology and strategic intentions. Am. J. Psychiatr. 2003;160:636–645. doi: 10.1176/appi.ajp.160.4.636. [DOI] [PubMed] [Google Scholar]
  36. Greenstein D., Weisinger B., Malley J.D., Clasen L., Gogtay N. Using multivariate machine learning methods and structural MRI to classify childhood onset schizophrenia and healthy controls. Front. Psych. 2012;3:53. doi: 10.3389/fpsyt.2012.00053. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Groves A.R., Beckmann C.F., Smith S.M., Woolrich M.W. Linked independent component analysis for multimodal data fusion. NeuroImage. 2011;54:2198–2217. doi: 10.1016/j.neuroimage.2010.09.073. [DOI] [PubMed] [Google Scholar]
  38. Groves A.R., Smith S.M., Fjell A.M., Tamnes C.K., Walhovd K.B., Douaud G., Woolrich M.W., Westlye L.T. Benefits of multi-modal fusion analysis on a large-scale dataset: life-span patterns of inter-subject variability in cortical morphometry and white matter microstructure. NeuroImage. 2012;63:365–380. doi: 10.1016/j.neuroimage.2012.06.038. [DOI] [PubMed] [Google Scholar]
  39. Guo C.C., Tan R., Hodges J.R., Hu X., Sami S., Hornberger M. Network-selective vulnerability of the human cerebellum to Alzheimer's disease and frontotemporal dementia. Brain. 2016;139:1527–1538. doi: 10.1093/brain/aww003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Gupta C.N., Calhoun V.D., Rachakonda S., Chen J., Patel V., Liu J., Segall J., Franke B., Zwiers M.P., Arias-Vasquez A., Buitelaar J., Fisher S.E., Fernandez G., van Erp T.G.M., Potkin S., Ford J., Mathalon D., McEwen S., Lee H.J., Mueller B.A., Greve D.N., Andreassen O., Agartz I., Gollub R.L., Sponheim S.R., Ehrlich S., Wang L., Pearlson G., Glahn D.C., Sprooten E., Mayer A.R., Stephen J., Jung R.E., Canive J., Bustillo J., Turner J.A. Patterns of gray matter abnormalities in schizophrenia based on an international mega-analysis. Schizophr. Bull. 2015;41:1133–1142. doi: 10.1093/schbul/sbu177. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Harasty J., Seldon H.L., Chan P., Halliday G., Harding A. The left human speech-processing cortex is thinner but longer than the right. Laterality. 2003;8:247–260. doi: 10.1080/13576500244000175. [DOI] [PubMed] [Google Scholar]
  42. Hibar D.P., Westlye L.T., van Erp T.G., Rasmussen J., Leonardo C.D., Faskowitz J., Haukvik U.K., Hartberg C.B., Doan N.T., Agartz I., Dale A.M., Gruber O., Kramer B., Trost S., Liberg B., Abe C., Ekman C.J., Ingvar M., Landen M., Fears S.C., Freimer N.B., Bearden C.E., Costa Rica/Colombia Consortium for Genetic Investigation of Bipolar, E, Sprooten E., Glahn D.C., Pearlson G.D., Emsell L., Kenney J., Scanlon C., McDonald C., Cannon D.M., Almeida J., Versace A., Caseras X., Lawrence N.S., Phillips M.L., Dima D., Delvecchio G., Frangou S., Satterthwaite T.D., Wolf D., Houenou J., Henry C., Malt U.F., Boen E., Elvsashagen T., Young A.H., Lloyd A.J., Goodwin G.M., Mackay C.E., Bourne C., Bilderbeck A., Abramovic L., Boks M.P., van Haren N.E., Ophoff R.A., Kahn R.S., Bauer M., Pfennig A., Alda M., Hajek T., Mwangi B., Soares J.C., Nickson T., Dimitrova R., Sussmann J.E., Hagenaars S., Whalley H.C., McIntosh A.M., Thompson P.M., Andreassen O.A. Rasmussen. Subcortical volumetric abnormalities in bipolar disorder. Mol. Psychiatry. 2016;21:1710–1716. doi: 10.1038/mp.2015.227. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Hibar D.P., Westlye L.T., Doan N.T., Jahanshad N., Cheung J.W., Ching C.R.K., Versace A., Bilderbeck A.C., Uhlmann A., Mwangi B., Krämer B., Overs B., Hartberg C.B., Abé C., Dima D., Grotegerd D., Sprooten E., Bøen E., Jimenez E., Howells F.M., Delvecchio G., Temmingh H., Starke J., Almeida J.R.C., Goikolea J.M., Houenou J., Beard L., Rauer L., Abramovic L., Bonnin M., Ponteduro M.F., Keil M., Rive M.M., Yao N., Yalin N., Najt P., Rosa P.G., Redlich R., Trost S., Hagenaars S., Fears S.C., Alonso-Lana S., van Erp T., Nickson T., Chaim-Avancini T.M., Meier T.B., Elvsåshagen T., Haukvik U.K., Lee W.H., Schene A.H., Lloyd A.J., Young A.H., Nugent A., Dale A.M., Pfennig A., McIntosh A.M., Lafer B., Baune B.T., Ekman C.J., Zarate C.A., Jr., Bearden C.E., Henry C., Simhandl C., McDonald C., Bourne C., Stein D.J., Wolf D.H., Cannon D.M., Glahn D.C., Veltman D.J., Pomarol-Clotet E., Vieta E., Canales-Rodriguez E.J., Nery F.G., Duran F.L.S., Busatto G.F., Roberts G., Pearlson G.D., Goodwin G.M., Kugel H., Whalley H.C., Ruhe H.G., Soares J.C., Fullerton J.M., Rybakowski J.K., Savitz J., Chaim K.T., Fatjó-Vilas M., Soeiro-de-Souza M.G., Boks M.P., Zanetti M.V., Otaduy M.C.G., Schaufelberger M.S., Alda M., Ingvar M., Phillips M.L., Kempton M.J., Bauer M., Landén M., Lawrence N.S., van Haren N.E.M., Horn N.R., Freimer N.B., Gruber O., Schofield P.R., Mitchell P.B., Kahn R.S., Lenroot R., Machado-Vieira R., Ophoff R., Sarró S., Frangou S., Satterthwaite T.D., Hajek T., Dannlowski U., Malt U.F., Arolt V., Gattaz W.F., Drevets W.C., Caseras X., Agartz I., Thompson P.M., Andreassen O.A. Cortical abnormalities in bipolar disorder: an MRI analysis of 6,503 individuals from the ENIGMA-bipolar disorder working group. Mol. Psychiatry. 2017 doi: 10.1038/mp.2017.73. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Honea R., Crow T.J., Passingham D., Mackay C.E. Regional deficits in brain volume in schizophrenia: a meta-analysis of voxel-based morphometry studies. Am. J. Psychiatr. 2005;162:2233–2245. doi: 10.1176/appi.ajp.162.12.2233. [DOI] [PubMed] [Google Scholar]
  45. Hutton C., Draganski B., Ashburner J., Weiskopf N. A comparison between voxel-based cortical thickness and voxel-based morphometry in normal aging. NeuroImage. 2009;48:371–380. doi: 10.1016/j.neuroimage.2009.06.043. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Insel T.R., Cuthbert B.N. Medicine. Brain disorders? Precisely. Science. 2015;348:499–500. doi: 10.1126/science.aab2358. [DOI] [PubMed] [Google Scholar]
  47. Johnson C.P., Follmer R.L., Oguz I., Warren L.A., Christensen G.E., Fiedorowicz J.G., Magnotta V.A., Wemmie J.A. Brain abnormalities in bipolar disorder detected by quantitative T1rho mapping. Mol. Psychiatry. 2015;20:201–206. doi: 10.1038/mp.2014.157. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Kambeitz J., Kambeitz-Ilankovic L., Leucht S., Wood S., Davatzikos C., Malchow B., Falkai P., Koutsouleris N. Detecting neuroimaging biomarkers for schizophrenia: a meta-analysis of multivariate pattern recognition studies. Neuropsychopharmacology. 2015;40:1742–1751. doi: 10.1038/npp.2015.22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Kanai R., Rees G. The structural basis of inter-individual differences in human behaviour and cognition. Nat. Rev. Neurosci. 2011;12:231–242. doi: 10.1038/nrn3000. [DOI] [PubMed] [Google Scholar]
  50. Karbasforoushan H., Duffy B., Blackford J.U., Woodward N.D. Processing speed impairment in schizophrenia is mediated by white matter integrity. Psychol. Med. 2015;45:109–120. doi: 10.1017/S0033291714001111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Karege F., Méary A., Perroud N., Jamain S., Leboyer M., Ballmann E., Fernandez R., Malafosse A., Schürhoff F. Genetic overlap between schizophrenia and bipolar disorder: a study with AKT1 gene variants and clinical phenotypes. Schizophr. Res. 2012;135:8–14. doi: 10.1016/j.schres.2011.12.015. [DOI] [PubMed] [Google Scholar]
  52. Kauppi K., Westlye L.T., Tesli M., Bettella F., Brandt C.L., Mattingsdal M., Ueland T., Espeseth T., Agartz I., Melle I., Djurovic S., Andreassen O.A. Polygenic risk for schizophrenia associated with working memory-related prefrontal brain activation in patients with schizophrenia and healthy controls. Schizophr. Bull. 2015;41:736–743. doi: 10.1093/schbul/sbu152. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Keefe R.S., Harvey P.D. Cognitive impairment in schizophrenia. Handb. Exp. Pharmacol. 2012:11–37. doi: 10.1007/978-3-642-25758-2_2. [DOI] [PubMed] [Google Scholar]
  54. Killgore W.D., Rosso I.M., Gruber S.A., Yurgelun-Todd D.A. Amygdala volume and verbal memory performance in schizophrenia and bipolar disorder. Cogn. Behav. Neurol. 2009;22:28–37. doi: 10.1097/WNN.0b013e318192cc67. [DOI] [PubMed] [Google Scholar]
  55. Kudo L.C., Karsten S.L., Chen J., Levitt P., Geschwind D.H. Genetic analysis of anterior posterior expression gradients in the developing mammalian forebrain. Cereb. Cortex. 2007;17:2108–2122. doi: 10.1093/cercor/bhl118. [DOI] [PubMed] [Google Scholar]
  56. Kuperberg G.R., Broome M.R., McGuire P.K., David A.S., Eddy M., Ozawa F., Goff D., West W.C., Williams S.C., van der Kouwe A.J., Salat D.H., Dale A.M., Fischl B. Regionally localized thinning of the cerebral cortex in schizophrenia. Arch. Gen. Psychiatry. 2003;60:878–888. doi: 10.1001/archpsyc.60.9.878. [DOI] [PubMed] [Google Scholar]
  57. Laidi C., d'Albis M.A., Wessa M., Linke J., Phillips M.L., Delavest M., Bellivier F., Versace A., Almeida J., Sarrazin S., Poupon C., Le Dudal K., Daban C., Hamdani N., Leboyer M., Houenou J. Cerebellar volume in schizophrenia and bipolar I disorder with and without psychotic features. Acta Psychiatr. Scand. 2015;131:223–233. doi: 10.1111/acps.12363. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Lee P.H., Baker J.T., Holmes A.J., Jahanshad N., Ge T., Jung J.Y., Cruz Y., Manoach D.S., Hibar D.P., Faskowitz J., McMahon K.L., de Zubicaray G.I., Martin N.H., Wright M.J., Ongur D., Buckner R., Roffman J., Thompson P.M., Smoller J.W. Partitioning heritability analysis reveals a shared genetic basis of brain anatomy and schizophrenia. Mol. Psychiatry. 2016;21:1680–1689. doi: 10.1038/mp.2016.164. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Lenth R.V. Least-squares means: the R package lsmeans. J. Stat. Softw. 2016;69:1–33. [Google Scholar]
  60. Liaw A., Wiener M. Classification and regression by randomForest. R News. 2002;2:18–22. [Google Scholar]
  61. Linden D.E. The challenges and promise of neuroimaging in psychiatry. Neuron. 2012;73:8–22. doi: 10.1016/j.neuron.2011.12.014. [DOI] [PubMed] [Google Scholar]
  62. Lyoo I.K., Sung Y.H., Dager S.R., Friedman S.D., Lee J.Y., Kim S.J., Kim N., Dunner D.L., Renshaw P.F. Regional cerebral cortical thinning in bipolar disorder. Bipolar Disord. 2006;8:65–74. doi: 10.1111/j.1399-5618.2006.00284.x. [DOI] [PubMed] [Google Scholar]
  63. Martınez-Montes E., Valdés-Sosa P.A., Miwakeichi F., Goldman R.I., Cohen M.S. Concurrent EEG/fMRI analysis by multiway partial least squares. NeuroImage. 2004;22:1023–1034. doi: 10.1016/j.neuroimage.2004.03.038. [DOI] [PubMed] [Google Scholar]
  64. Moberget T., Doan N.T., Alnæs D., Kaufmann T., Córdova Palomera A., Lagerberg T.V., Diedrichsen J., Schwarz E., Zink M., Eisenacher S., Kirsch P., Jönsson E.G., Fatouros-Bergman H., Flyckt L., KaSP#, Pergola G., Quarto T., Bertolino A., Barch D., Meyer-Lindenberg A., Agartz I., Andreassen O.A., Westlye L.T. Cerebellar volume and cerebello-cerebral structural covariance in schizophrenia – a multi-site mega-analysis of 983 patients and 1349 healthy controls. Mol. Psychiatry. 2017 doi: 10.1038/mp.2017.106. [DOI] [PubMed] [Google Scholar]
  65. Nenadic I., Gaser C., Sauer H. Heterogeneity of brain structural variation and the structural imaging endophenotypes in schizophrenia. Neuropsychobiology. 2012;66:44–49. doi: 10.1159/000338547. [DOI] [PubMed] [Google Scholar]
  66. Nieuwenhuis M., van Haren N.E., Hulshoff Pol H.E., Cahn W., Kahn R.S., Schnack H.G. Classification of schizophrenia patients and healthy controls from structural MRI scans in two large independent samples. NeuroImage. 2012;61:606–612. doi: 10.1016/j.neuroimage.2012.03.079. [DOI] [PubMed] [Google Scholar]
  67. Okugawa G., Nobuhara K., Takase K., Kinoshita T. Cerebellar posterior superior vermis and cognitive cluster scores in drug-naive patients with first-episode schizophrenia. Neuropsychobiology. 2007;56:216–219. doi: 10.1159/000122268. [DOI] [PubMed] [Google Scholar]
  68. O'Leary D.D., Chou S.J., Sahara S. Area patterning of the mammalian cortex. Neuron. 2007;56:252–269. doi: 10.1016/j.neuron.2007.10.010. [DOI] [PubMed] [Google Scholar]
  69. Onitsuka T., Shenton M.E., Kasai K., Nestor P.G., Toner S.K., Kikinis R., Jolesz F.A., McCarley R.W. Fusiform gyrus volume reduction and facial recognition in chronic schizophrenia. Arch. Gen. Psychiatry. 2003;60:349–355. doi: 10.1001/archpsyc.60.4.349. [DOI] [PubMed] [Google Scholar]
  70. van Os J., Kapur S. Schizophrenia. Lancet. 2009;374:635–645. doi: 10.1016/S0140-6736(09)60995-8. [DOI] [PubMed] [Google Scholar]
  71. Palaniyappan L., Liddle P.F. Differential effects of surface area, gyrification and cortical thickness on voxel based morphometric deficits in schizophrenia. NeuroImage. 2012;60:693–699. doi: 10.1016/j.neuroimage.2011.12.058. [DOI] [PubMed] [Google Scholar]
  72. Palesi F., Tournier J.D., Calamante F., Muhlert N., Castellazzi G., Chard D., D'Angelo E., Wheeler-Kingshott C.A. Contralateral cerebello-thalamo-cortical pathways with prominent involvement of associative areas in humans in vivo. Brain Struct. Funct. 2015;220:3369–3384. doi: 10.1007/s00429-014-0861-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Preston G.A., Weinberger D.R. Intermediate phenotypes in schizophrenia: a selective review. Dialogues Clin. Neurosci. 2005;7:165–179. doi: 10.31887/DCNS.2005.7.2/gpreston. [DOI] [PMC free article] [PubMed] [Google Scholar]
  74. Psychiatric Genomics Consortium Biological insights from 108 schizophrenia-associated genetic loci. Nature. 2014;511:421–427. doi: 10.1038/nature13595. [DOI] [PMC free article] [PubMed] [Google Scholar]
  75. Psychiatric GWAS Consortium Bipolar Disorder Working Group Large-scale genome-wide association analysis of bipolar disorder identifies a new susceptibility locus near ODZ4. Nat. Genet. 2011;43:977–983. doi: 10.1038/ng.943. [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Purcell S.M., Wray N.R., Stone J.L., Visscher P.M., O'Donovan M.C., Sullivan P.F., Sklar P. Common polygenic variation contributes to risk of schizophrenia and bipolar disorder. Nature. 2009;460:748–752. doi: 10.1038/nature08185. [DOI] [PMC free article] [PubMed] [Google Scholar]
  77. Rakic P. Evolution of the neocortex: a perspective from developmental biology. Nat. Rev. Neurosci. 2009;10:724–735. doi: 10.1038/nrn2719. [DOI] [PMC free article] [PubMed] [Google Scholar]
  78. Ravizza S.M., McCormick C.A., Schlerf J.E., Justus T., Ivry R.B., Fiez J.A. Cerebellar damage produces selective deficits in verbal working memory. Brain. 2006;129:306–320. doi: 10.1093/brain/awh685. [DOI] [PubMed] [Google Scholar]
  79. Ray K.L., McKay D.R., Fox P.M., Riedel M.C., Uecker A.M., Beckmann C.F., Smith S.M., Fox P.T., Laird A.R. ICA model order selection of task co-activation networks. Front. Neurosci. 2013;7:237. doi: 10.3389/fnins.2013.00237. [DOI] [PMC free article] [PubMed] [Google Scholar]
  80. Rimol L.M., Panizzon M.S., Fennema-Notestine C., Eyler L.T., Fischl B., Franz C.E., Hagler D.J., Lyons M.J., Neale M.C., Pacheco J., Perry M.E., Schmitt J.E., Grant M.D., Seidman L.J., Thermenos H.W., Tsuang M.T., Eisen S.A., Kremen W.S., Dale A.M. Cortical thickness is influenced by regionally specific genetic factors. Biol. Psychiatry. 2010;67:493–499. doi: 10.1016/j.biopsych.2009.09.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
  81. Rimol L.M., Hartberg C.B., Nesvag R., Fennema-Notestine C., Hagler D.J., Jr., Pung C.J., Jennings R.G., Haukvik U.K., Lange E., Nakstad P.H., Melle I., Andreassen O.A., Dale A.M., Agartz I. Cortical thickness and subcortical volumes in schizophrenia and bipolar disorder. Biol. Psychiatry. 2010;68:41–50. doi: 10.1016/j.biopsych.2010.03.036. [DOI] [PubMed] [Google Scholar]
  82. Rimol L.M., Nesvag R., Hagler D.J., Jr., Bergmann O., Fennema-Notestine C., Hartberg C.B., Haukvik U.K., Lange E., Pung C.J., Server A., Melle I., Andreassen O.A., Agartz I., Dale A.M. Cortical volume, surface area, and thickness in schizophrenia and bipolar disorder. Biol. Psychiatry. 2012;71:552–560. doi: 10.1016/j.biopsych.2011.11.026. [DOI] [PubMed] [Google Scholar]
  83. Rocha-Rego V., Jogia J., Marquand A., Mourao-Miranda J., Simmons A., Frangou S. Examination of the predictive value of structural magnetic resonance scans in bipolar disorder: a pattern classification approach. Psychol. Med. 2014;44:519–532. doi: 10.1017/S0033291713001013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  84. Schizophrenia Psychiatric Genome-Wide Association Study Consortium Genome-wide association study identifies five new schizophrenia loci. Nat. Genet. 2011;43:969–976. doi: 10.1038/ng.940. [DOI] [PMC free article] [PubMed] [Google Scholar]
  85. Schnack H.G., Kahn R.S. Detecting neuroimaging biomarkers for psychiatric disorders: sample size matters. Front. Psychol. 2016;7 doi: 10.3389/fpsyt.2016.00050. [DOI] [PMC free article] [PubMed] [Google Scholar]
  86. Schnack H.G., Nieuwenhuis M., van Haren N.E., Abramovic L., Scheewe T.W., Brouwer R.M., Pol H.E.H., Kahn R.S. Can structural MRI aid in clinical classification? A machine learning study in two independent samples of patients with schizophrenia, bipolar disorder and healthy subjects. NeuroImage. 2014;84:299–306. doi: 10.1016/j.neuroimage.2013.08.053. [DOI] [PubMed] [Google Scholar]
  87. Seldon H.L. Does brain white matter growth expand the cortex like a balloon? Hypothesis and consequences. Laterality. 2005;10:81–95. doi: 10.1080/13576500342000310. [DOI] [PubMed] [Google Scholar]
  88. Serpa M.H., Ou Y., Schaufelberger M.S., Doshi J., Ferreira L.K., Machado-Vieira R., Menezes P.R., Scazufca M., Davatzikos C., Busatto G.F. Neuroanatomical classification in a population-based sample of psychotic major depression and bipolar I disorder with 1 year of diagnostic stability. Biomed. Res. Int. 2014:2014. doi: 10.1155/2014/706157. [DOI] [PMC free article] [PubMed] [Google Scholar]
  89. Shenton M.E., Dickey C.C., Frumin M., McCarley R.W. A review of MRI findings in schizophrenia. Schizophr. Res. 2001;49:1–52. doi: 10.1016/s0920-9964(01)00163-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  90. Simonsen C., Sundet K., Vaskinn A., Birkenaes A.B., Engh J.A., Faerden A., Jonsdottir H., Ringen P.A., Opjordsmoen S., Melle I., Friis S., Andreassen O.A. Neurocognitive dysfunction in bipolar and schizophrenia spectrum disorders depends on history of psychosis rather than diagnostic group. Schizophr. Bull. 2011;37:73–83. doi: 10.1093/schbul/sbp034. [DOI] [PMC free article] [PubMed] [Google Scholar]
  91. Sui J., Adali T., Yu Q., Chen J., Calhoun V.D. A review of multivariate methods for multimodal fusion of brain imaging data. J. Neurosci. Methods. 2012;204:68–81. doi: 10.1016/j.jneumeth.2011.10.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
  92. Tesli M., Espeseth T., Bettella F., Mattingsdal M., Aas M., Melle I., Djurovic S., Andreassen O.A. Polygenic risk score and the psychosis continuum model. Acta Psychiatr. Scand. 2014;130:311–317. doi: 10.1111/acps.12307. [DOI] [PubMed] [Google Scholar]
  93. Van Petten C. Relationship between hippocampal volume and memory ability in healthy individuals across the lifespan: review and meta-analysis. Neuropsychologia. 2004;42:1394–1413. doi: 10.1016/j.neuropsychologia.2004.04.006. [DOI] [PubMed] [Google Scholar]
  94. Vos T., Flaxman A.D., Naghavi M., Lozano R., Michaud C., Ezzati M., Shibuya K., Salomon J.A., Abdalla S., Aboyans V., Abraham J., Ackerman I., Aggarwal R., Ahn S.Y., Ali M.K., Alvarado M., Anderson H.R., Anderson L.M., Andrews K.G., Atkinson C., Baddour L.M., Bahalim A.N., Barker-Collo S., Barrero L.H., Bartels D.H., Basanez M.G., Baxter A., Bell M.L., Benjamin E.J., Bennett D., Bernabe E., Bhalla K., Bhandari B., Bikbov B., Bin Abdulhak A., Birbeck G., Black J.A., Blencowe H., Blore J.D., Blyth F., Bolliger I., Bonaventure A., Boufous S., Bourne R., Boussinesq M., Braithwaite T., Brayne C., Bridgett L., Brooker S., Brooks P., Brugha T.S., Bryan-Hancock C., Bucello C., Buchbinder R., Buckle G., Budke C.M., Burch M., Burney P., Burstein R., Calabria B., Campbell B., Canter C.E., Carabin H., Carapetis J., Carmona L., Cella C., Charlson F., Chen H., Cheng A.T., Chou D., Chugh S.S., Coffeng L.E., Colan S.D., Colquhoun S., Colson K.E., Condon J., Connor M.D., Cooper L.T., Corriere M., Cortinovis M., de Vaccaro K.C., Couser W., Cowie B.C., Criqui M.H., Cross M., Dabhadkar K.C., Dahiya M., Dahodwala N., Damsere-Derry J., Danaei G., Davis A., De Leo D., Degenhardt L., Dellavalle R., Delossantos A., Denenberg J., Derrett S., Des Jarlais D.C., Dharmaratne S.D., Dherani M., Diaz-Torne C., Dolk H., Dorsey E.R., Driscoll T., Duber H., Ebel B., Edmond K., Elbaz A., Ali S.E., Erskine H., Erwin P.J., Espindola P., Ewoigbokhan S.E., Farzadfar F., Feigin V., Felson D.T., Ferrari A., Ferri C.P., Fevre E.M., Finucane M.M., Flaxman S., Flood L., Foreman K., Forouzanfar M.H., Fowkes F.G., Franklin R., Fransen M., Freeman M.K., Gabbe B.J., Gabriel S.E., Gakidou E., Ganatra H.A., Garcia B., Gaspari F., Gillum R.F., Gmel G., Gosselin R., Grainger R., Groeger J., Guillemin F., Gunnell D., Gupta R., Haagsma J., Hagan H., Halasa Y.A., Hall W., Haring D., Haro J.M., Harrison J.E., Havmoeller R., Hay R.J., Higashi H., Hill C., Hoen B., Hoffman H., Hotez P.J., Hoy D., Huang J.J., Ibeanusi S.E., Jacobsen K.H., James S.L., Jarvis D., Jasrasaria R., Jayaraman S., Johns N., Jonas J.B., Karthikeyan G., Kassebaum N., Kawakami N., Keren A., Khoo J.P., King C.H., Knowlton L.M., Kobusingye O., Koranteng A., Krishnamurthi R., Lalloo R., Laslett L.L., Lathlean T., Leasher J.L., Lee Y.Y., Leigh J., Lim S.S., Limb E., Lin J.K., Lipnick M., Lipshultz S.E., Liu W., Loane M., Ohno S.L., Lyons R., Ma J., Mabweijano J., MacIntyre M.F., Malekzadeh R., Mallinger L., Manivannan S., Marcenes W., March L., Margolis D.J., Marks G.B., Marks R., Matsumori A., Matzopoulos R., Mayosi B.M., McAnulty J.H., McDermott M.M., McGill N., McGrath J., Medina-Mora M.E., Meltzer M., Mensah G.A., Merriman T.R., Meyer A.C., Miglioli V., Miller M., Miller T.R., Mitchell P.B., Mocumbi A.O., Moffitt T.E., Mokdad A.A., Monasta L., Montico M., Moradi-Lakeh M., Moran A., Morawska L., Mori R., Murdoch M.E., Mwaniki M.K., Naidoo K., Nair M.N., Naldi L., Narayan K.M., Nelson P.K., Nelson R.G., Nevitt M.C., Newton C.R., Nolte S., Norman P., Norman R., O'Donnell M., O'Hanlon S., Olives C., Omer S.B., Ortblad K., Osborne R., Ozgediz D., Page A., Pahari B., Pandian J.D., Rivero A.P., Patten S.B., Pearce N., Padilla R.P., Perez-Ruiz F., Perico N., Pesudovs K., Phillips D., Phillips M.R., Pierce K., Pion S., Polanczyk G.V., Polinder S., Pope C.A., 3rd, Popova S., Porrini E., Pourmalek F., Prince M., Pullan R.L., Ramaiah K.D., Ranganathan D., Razavi H., Regan M., Rehm J.T., Rein D.B., Remuzzi G., Richardson K., Rivara F.P., Roberts T., Robinson C., De Leon F.R., Ronfani L., Room R., Rosenfeld L.C., Rushton L., Sacco R.L., Saha S., Sampson U., Sanchez-Riera L., Sanman E., Schwebel D.C., Scott J.G., Segui-Gomez M., Shahraz S., Shepard D.S., Shin H., Shivakoti R., Singh D., Singh G.M., Singh J.A., Singleton J., Sleet D.A., Sliwa K., Smith E., Smith J.L., Stapelberg N.J., Steer A., Steiner T., Stolk W.A., Stovner L.J., Sudfeld C., Syed S., Tamburlini G., Tavakkoli M., Taylor H.R., Taylor J.A., Taylor W.J., Thomas B., Thomson W.M., Thurston G.D., Tleyjeh I.M., Tonelli M., Towbin J.A., Truelsen T., Tsilimbaris M.K., Ubeda C., Undurraga E.A., van der Werf M.J., van Os J., Vavilala M.S., Venketasubramanian N., Wang M., Wang W., Watt K., Weatherall D.J., Weinstock M.A., Weintraub R., Weisskopf M.G., Weissman M.M., White R.A., Whiteford H., Wiersma S.T., Wilkinson J.D., Williams H.C., Williams S.R., Witt E., Wolfe F., Woolf A.D., Wulf S., Yeh P.H., Zaidi A.K., Zheng Z.J., Zonies D., Lopez A.D., Murray C.J. Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2013;380:2163–2196. doi: 10.1016/S0140-6736(12)61729-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  95. Watson T.C., Becker N., Apps R., Jones M.W. Back to front: cerebellar connections and interactions with the prefrontal cortex. Front. Syst. Neurosci. 2014;8:4. doi: 10.3389/fnsys.2014.00004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  96. Winkler A.M., Ridgway G.R., Webster M.A., Smith S.M., Nichols T.E. Permutation inference for the general linear model. NeuroImage. 2014;92:381–397. doi: 10.1016/j.neuroimage.2014.01.060. [DOI] [PMC free article] [PubMed] [Google Scholar]
  97. Wolfers T., Buitelaar J.K., Beckmann C.F., Franke B., Marquand A.F. From estimating activation locality to predicting disorder: a review of pattern recognition for neuroimaging-based psychiatric diagnostics. Neurosci. Biobehav. Rev. 2015;57:328–349. doi: 10.1016/j.neubiorev.2015.08.001. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

mmc1.docx (7MB, docx)

Articles from NeuroImage : Clinical are provided here courtesy of Elsevier

RESOURCES