Abstract
Background
The neuroanatomical basis of autism spectrum disorder (ASD) has remained elusive, mostly owing to high biological and clinical heterogeneity among diagnosed individuals. Despite considerable effort toward understanding ASD using neuroimaging biomarkers, heterogeneity remains a barrier, partly because studies mostly employ case-control approaches, which assume that the clinical group is homogeneous.
Methods
Here, we used an innovative normative modeling approach to parse biological heterogeneity in ASD. We aimed to dissect the neuroanatomy of ASD by mapping the deviations from a typical pattern of neuroanatomical development at the level of the individual and to show the necessity to look beyond the case-control paradigm to understand the neurobiology of ASD. We first estimated a vertexwise normative model of cortical thickness development using Gaussian process regression, then mapped the deviation of each participant from the typical pattern. For this, we employed a heterogeneous cross-sectional sample of 206 typically developing individuals (127 males) and 321 individuals with ASD (232 males) (6–31 years of age).
Results
We found few case-control differences, but the ASD cohort showed highly individualized patterns of deviations in cortical thickness that were widespread across the brain. These deviations correlated with severity of repetitive behaviors and social communicative symptoms, although only repetitive behaviors survived corrections for multiple testing.
Conclusions
Our results 1) reinforce the notion that individuals with ASD show distinct, highly individualized trajectories of brain development and 2) show that by focusing on common effects (i.e., the “average ASD participant”), the case-control approach disguises considerable interindividual variation crucial for precision medicine.
Keywords: Autism, Cortical thickness, Gaussian process, Heterogeneity, Normative modeling, Outlier detection
Autism spectrum disorder (ASD) is a lifelong neurodevelopmental disorder diagnosed exclusively on the basis of symptomatology, period of onset, and impairment (i.e., impairments in social communication and interaction, alongside repetitive stereotyped behavior and sensory anomalies) (1). Autism is well recognized as being highly heterogeneous on multiple levels—for example, in terms of its clinical presentation and underlying neurobiology. Indeed, more than 100 genes (2) and many aspects of brain structure have been associated with ASD at the group level (3). Autism is also grounded in the process of brain maturation, and it is believed that alterations are evident throughout brain development 4, 5. In particular, differences in cortical thickness (CT) have been reported across different studies and ages (6), which—together with differences in surface area (SA) 6, 7, 8, 9, 10—underpin regional differences in brain volume in ASD 10, 11, 12, 13. However, the precise etiology of the disorder in terms of brain development and underlying mechanisms remain elusive.
The heterogeneity of ASD is a fundamental barrier to understanding the neurobiology of ASD and the development of interventions (14). Regional group-level differences have been reported across several neuroanatomical measures, including CT 8, 10, 15, 16, 17, 18, 19, 20, 21, 22. However these findings show generally poor replication across studies 3, 7, 19, 23, 24 and small effect sizes 8, 19. Heterogeneity is also evident in studies that have used classifiers to discriminate ASD participants from control subjects, which mostly show relatively low accuracy for predicting diagnosis, especially in large samples 19, 25, 26. An important reason for this is that most studies to date have employed a traditional case-control approach, which is based on the assumption that the clinical and control groups are homogeneous entities 7, 27. Thus, the case-control approach provides information about alterations at the group level or, in other words, in the “average ASD participant.” However, different participants may have different symptom profiles and different etiological pathways, and resulting neurobiological changes may converge on the same symptoms. Therefore, to understand the neurobiology of ASD, it is important to understand the range of associated neurobiological variation, which may subsequently inform intervention at the level of the individual in the spirit of “precision medicine” (28). A common approach to study the biological heterogeneity underlying ASD is to find subtypes using clustering algorithms, mostly on the basis of symptoms or behavioral characteristics 29, 30, 31, 32, 33, 34. This approach has been somewhat successful and is appropriate if the clinical cohort can be cleanly partitioned into a relatively small number of homogeneous subgroups on the basis of the chosen measures. However, it does not tackle heterogeneity within subgroups, and it may be the case that no clearly defined subgroups exist in the data. Moreover, subgroups derived from behavior or symptoms require extensive validation on external measures and still may not fully reflect the underlying biology 35, 36.
Here, we apply a complementary normative modeling approach 36, 37 to understand the biological heterogeneity of ASD. This shifts the focus away from group-level comparisons—which can detect consistent differences across groups of individuals (e.g., diagnoses or putative subtypes)—toward characterizing the degree of alteration in each individual, with reference to the typically developing (TD) brain. This allows us to detect and map neuroanatomical alterations at the level of the individual and has recently shown promise in understanding the biological variation of psychotic disorders (37). Normative modeling is analogous to the use of growth charts in pediatric medicine, which allow the development (e.g., in terms of height or weight) of each individual child to be measured against expected centiles of variation in the population. To achieve this, we first estimated a statistical model characterizing typical cortical development that accurately quantifies the variation within the population and across brain development. We then placed each individual ASD participant in relation to the typical distribution to identify alterations in individual cases with respect to the typical pattern of brain maturation. Our main goals were to 1) to map the neuroanatomical features by which each individual ASD participant differs from the expected TD pattern, across both different developmental stages and different levels of functioning, and thereby 2) demonstrate the value of normative modeling techniques for understanding the biological heterogeneity of ASD. For this, we employed data from a large international study (38) with harmonized data acquisition procedures and a design that naturally groups subjects according to different developmental stages. While normative modeling is suitable for many different aspects of brain structure or function, here we focused on CT, which is a sensitive and reliable measure of cortical morphology in ASD 6, 8, 39, although we also investigated SA. Ultimately, we hope this approach will yield a set of individualized neurobiological “fingerprints” facilitating a route toward precision medicine approaches in ASD (28).
Methods and Materials
Participants
Full details on study design and clinical characteristics have been described previously (38). Briefly, we included all participants from the Longitudinal European Autism Project (40) cohort with a structural magnetic resonance imaging scan surviving quality control and the necessary clinical and demographic data. We included 206 TD individuals 7 to 31 years of age (127 males) (Table 1; Supplemental Table S1 and Supplemental Figure S1) and 321 individuals 6 to 31 years of age with ASD (232 males). There were no significant differences between the TD and ASD cohorts in age, but the IQ of ASD participants was lower than TD participants. Under the study design, each cohort was split into four subgroups according to age and level of intellectual ability (Table 1): 1) adults with ASD without intellectual disability (ID) and TD control subjects 18 to 30 years of age (IQ ≥70); 2) adolescents with ASD without ID and TD control subjects 12 to 17 years of age; 3) children with ASD without ID or TD control subjects 6 to 11 years of age; and 4) adolescents and adults with ASD and ID [i.e., full-scale IQ between 50 and 70 (1)] 12 to 30 years of age. Note that only TD participants were included in the estimation of the normative model.
Table 1.
Variable | ASD Cohort, n = 321 (89 Female) | TD Cohort, n = 206 (79 Female) | p Value |
---|---|---|---|
Age, Years | 17.01 ± 5.79 | 17.14 ± 5.97 | .93a |
IQ | |||
Global IQ | 100.89 ± 18.53, n = 316 | 108.22 ± 14.24 | .00 |
Performance IQ | 101.65 ± 20.14, n = 316 | 108.26 ± 15.72 | .00 |
Verbal IQ | 99.64 ± 18.53, n = 313 | 107.32 ± 16.13 | .00 |
ADI-R | n = 308 | ||
Social | 16.20 ± 6.71 | ||
Communication | 13.11 ± 5.69 | ||
Repetitive behavior | 4.32 ± 2.69 | ||
ADOS-2 | n = 258 | ||
Total | 5.12 ± 2.77 | ||
Social | 5.78 ± 2.62 | ||
Repetitive behavior | 4.78 ± 2.76 | ||
Schedule, n | |||
A: Adults | 125 | 84 | |
B: Adolescents | 112 | 70 | |
C: Children | 64 | 52 | |
D: IQ <70 | 20 | — |
Values are mean ± SD, except where noted.
ADI-R, Autism Diagnostic Interview-Revised; ADOS-2, Autism Diagnostic Observation Schedule, Second Edition; ASD, autism spectrum disorder; TD, typically developing.
Not significant.
TD participants were recruited via advertisement. Individuals with an existing ASD and/or mild ID diagnosis (according to DSM-5/ICD-10 criteria) were recruited from existing databases and clinic contacts across one of seven study sites: the Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, United Kingdom; Autism Research Centre at the University of Cambridge, Cambridge, United Kingdom; Radboud University Nijmegen Medical Centre, Nijmegen, the Netherlands; University Medical Centre Utrecht, Utrecht, the Netherlands; Central Institute of Mental Health, Mannheim, Germany; and University Campus Bio-Medico, Rome, Italy. The combined information from the Autism Diagnostic Interview-Revised (ADI-R) (41) and Autism Diagnostic Observation Schedule, Second Edition (ADOS-2) (42) were used to measure symptom severity (33). However, individuals with a clinical ASD diagnosis who did not reach conventional cutoffs on these instruments were not excluded. The ADI-R is a parent-reported measure of lifetime or past developmental window symptom severity, whereas the ADOS-2 is an expert rating of current symptoms. A standard set of exclusion criteria were applied and are provided in the Supplement. All subjects were scanned with a T1-weighted imaging protocol, and FreeSurfer (version 5.3; https://surfer.nmr.mgh.harvard.edu/) was used to estimate measures of regional CT and SA. See the Supplemental Methods for details.
Constructing a Normative Model of CT
An overview of the normative modeling approach is shown in Figure 1 and has been described previously (36). Briefly, Gaussian process regression (43) was used to estimate separate normative models of CT and SA at each vertex on the cortical surface (see Supplemental Methods for details). This normative model can be used to predict both the expected CT and the associated predictive uncertainty for each individual participant. The contours of predictive uncertainty can then be used to model centiles of variation within the cohort. This allows us to place each individual participant within the normative distribution, thereby quantifying the vertexwise deviation of CT from the healthy range across the brain.
To achieve this, we generated a developmental model of typical brain development by training a Gaussian process regression model on the TD cohort (n = 206) using age and gender as covariates (i.e., independent variables) to predict CT (i.e., dependent variable). In pediatric medicine, growth charts are normally estimated on the basis of a large population cohort (i.e., potentially including patients with various disorders based on the population prevalence). In our sample, the prevalence of ASD is much higher than in the population, so for simplicity and to avoid the normative model’s being enriched for ASD, we estimated the normative model on the basis of the TD participants only. Moreover, while the amount of data we employ here is relatively small in comparison with population-based studies, our Bayesian statistical model provides a principled method to handle uncertainty and therefore automatically makes inferences more conservative as the number of data points decreases, although more data would allow more precise estimates. To assess generalization, we used 10-fold cross-validation before retraining the model using the whole dataset to make predictions on the ASD participants following standard practice in machine learning (Supplemental Methods). Importantly, all parameters were estimated using the training data using empirical Bayesian estimation (36), and the use of cross-validation ensures unbiased estimates for the TD cohort as well as for the ASD cohort. Therefore, deviations can be compared with one another.
Estimating Regional Deviations for Each Subject
To estimate a pattern of regional deviations from typical CT for each participant, we derived a normative probability map (NPM) that quantifies the deviation from the normative model for CT at each vertex. This was done by using the normative model to predict vertexwise estimates of CT for each individual participant, then estimating a subject-specific Z score (36) (Supplemental Methods). This provides a statistical estimate of how much each individual differs from the healthy pattern at each vertex. We thresholded the NPMs, correcting for multiple comparisons by controlling false discovery rate (FDR) at p < .05 within each participant, as in Marquand et al. (36).
To measure the spatial overlap of the individualized deviations across the cohort, we calculated an overlap map by counting the significant (FDR-corrected) vertices derived from the Z-score maps across all subject-level NPMs. The resulting summary maps indicate the spread of vertexwise deviations across the brain, separately for positive and negative deviations. This allowed us to identify a set of brain regions where participants had increased (positive deviation) or decreased (negative deviation) CT relative to the reference cohort.
To provide a simple comparison for these subject-level deviations, we also estimated a standard vertexwise general linear model to establish significant differences between groups including age as a covariate. We also investigated models including quadratic and cubic age terms (corrected using FDR at p < .05) and separate models for male and female subjects.
Constructing an Individual-Level Atypicality Score
A key benefit of normative modeling is a probabilistic interpretation of the deviations across all subjects. The NPMs therefore provide a multivariate measure of deviation from the normative range across all brain regions. This captures spatially distributed differences from the TD pattern. To better understand most important focal differences for each subject, we estimated a summary score for each participant capturing the individual’s largest deviation from the typical pattern (which is potentially the most clinically relevant). This can be modeled using extreme value statistics (44) and is based on the notion that the expected maximum of any random variable converges to an extreme value distribution. Therefore, we estimated a maximum deviation for each subject by taking a trimmed mean of 1% of the top absolute deviations for each subject across all vertices and fit an extreme value distribution to these deviations.
Mapping Behavioral Associations
Last, to assess the clinical relevance of these deviations, we computed Spearman correlation coefficients between global and regional extreme deviation from the normative model and ADOS-2/ADI-R symptom severity scores (p < .05, FDR). The global measure (described above) provides an overall summary of the deviation for each individual, while the regional assessment helps to determine the functional correspondence of the deviations across individuals on a region-by-region basis. The regional extreme deviation was computed as the trimmed mean of the 1% of top absolute deviations for each region after parcellating the cortex using the Desikan-Killiany atlas (45).
Checking for Potential Confounds
To investigate whether potential confounds could have influenced our findings, we estimated a separate normative model additionally including dummy regressors for IQ, site, and FreeSurfer Euler number (46). We also performed post hoc tests between the deviations from the normative model and potential confounding variables (IQ, comorbid symptoms, and surrogate measures of image quality) (see Supplemental Tables S2 and S3).
Results
A Normative Model Quantifying the Decline of CT With Age
Figure 2 shows the developmental normative model of CT derived from the TD male cohort, thresholded to show vertices where the correlation between true and predicted labels was higher than predicted by chance (p < .05, FDR corrected) (see Supplemental Figure S3 for female cohort). The unthresholded map showing the correlation between true and predicted CT values is shown in Supplemental Figure S2 along with the root mean square error of the normative model across different vertices. In most regions, CT decreases consistently and approximately linearly with age. However, in some regions, CT followed a nonlinear (i.e., inverted U-shaped) trajectory with an early rise followed by a decline, e.g., in the inferior temporal and posterior frontal regions. This corresponds well with the known developmental trajectory of CT 47, 48, 49, 50, 51. The normative model for SA showed a similar, relatively global pattern of decline as for CT (not shown).
Widespread Deviations From the Normative Pattern of CT Among the ASD Cohort
Figure 3 shows the classical mass-univariate group difference (i.e., case-control) map between ASD and TD cohorts. This shows few significant differences between groups; only two small regions of increased CT in the superior frontal and parietal cortices survived FDR correction. There were also few significant differences when additionally including quadratic and cubic age terms and no differences in the age-by-diagnosis interaction. The separate models for male and female subjects also did not show any significant differences after FDR correction.
Figures 4 and 5 show a summary of the NPMs for the ASD and TD cohorts. Specifically, these figures show the number of participants in each group that deviate negatively (Figure 4) or positively (Figure 5) from the normative model at each vertex after intraindividual FDR correction. Importantly, and contrast to the general linear model, these deviations need not overlap between subjects. As expected, the TD cohort shows few significant deviations, indicating that the normative model provides a good fit for this cohort. Crucially, this fit was achieved under cross-validation and is therefore unbiased. Therefore, under the null hypothesis that ASD participants follow a similar trajectory of brain development to TD participants, there is no prior reason to expect that the fit will be better in TD than in ASD participants. In contrast, the total number of deviating vertices was noticeably higher in the ASD cohort and was widespread across the brain, suggesting that there are widespread and individualized deviations from the normative model in certain subsets of participants. When considering each age group separately, negative deviations were most prominent in children, whereas positive deviations were most prominent in adolescents and adults. The results were very similar for the models including IQ, scanning site, and Euler number as covariates (Supplemental Figures S4 and S5), and a similar pattern of results was observed for SA, albeit with slight differences with respect to the pattern of deviations across brain regions (Supplemental Figures S6 and S7).
ASD Participants Deviate More Than TD Participants From the Normative Pattern of Development
Figure 6 shows the distribution of the most extreme deviations from the normative model across the brain. This shows that the maximum deviation across the brain is higher in the ASD cohort than the TD cohort and shows that the distribution of the ASD cohort is shifted toward the right, implying relatively more subjects with extreme deviations. Saliently, the top 15 deviating individuals belong to the ASD cohort, which is extremely unlikely to occur by chance (p < .0005, binomial test). The NPMs of these participants (Supplemental Figure S8) have highly individualized patterns of deviation not only with respect to brain regions, but also in sign, with some participants having positive deviations (i.e., greater CT) or negative deviations (reduced CT). These participants did not show a consistent pattern with respect to their symptom scores (Supplemental Table S5), which underscores the degree of clinical and neurobiological heterogeneity within the ASD cohort. However, with regard to their demographic profile, subjects with predominantly positive deviations were adolescents or adults, while most subjects with negative deviations were children.
Association With Symptoms
Global deviations from the normative model were negatively associated with ADOS-2 repetitive behaviors (ρ = −.21, p < .05), and regional deviations were associated with symptoms in several brain regions (Figures 7 and 8). Associations were found with symptom severity in the repetitive domain of the ADOS-2 or ADI-R in prefrontal regions in female subjects. In male subjects, a similar pattern was seen but did not survive multiple comparison correction, except for the superior frontal region in the ADI-R. Social interaction and communication scores also had nominally significant associations in female subjects, but these did not survive correction.
Discussion
In this study, we aimed to dissect the heterogeneous neurobiology of ASD by mapping the deviation of each individual participant from a normative model of CT development. In a large, heterogeneous cohort spanning a wide range of the ASD phenotype, we showed few significant group-level differences between ASD and TD cohorts in CT using a classical case-control analysis. In contrast, our normative modeling approach showed striking, widespread patterns of cortical atypicality at the level of individual ASD participant. These patterns were highly individualized across participants, distinct across different developmental stages, and associated with symptoms, especially repetitive behaviors. This supports the notion that a subset of ASD participants follow a different developmental trajectory than TD subjects, and that the trajectory each ASD participant follows is highly individualized. From a methodological standpoint, our study shows that 1) it is necessary to look beyond the case-control paradigm to understand the heterogeneous neuroanatomy of ASD, 2) normative modeling provides an alternative conceptual framework for understanding the heterogeneous neurobiology of ASD in terms of deviations from a typical pattern, and 3) focusing on an “average autistic individual” provides only a partial reflection of the nature of the condition. In other words, the case-control approach focuses on common effects rather than interindividual variation. Capturing and capitalizing on such variation at the individual level is at the heart of precision medicine.
The normative model describes the variation in typical brain development showed a largely monotonic—and in some areas nonlinear—decrease of CT throughout development, consistent with previous neuroimaging studies 47, 48, 49, 50, 51, 52, 53, 54, 55. The fact that we observed widespread interindividual differences between ASD participants in terms of their deviations from the normative model explains why our classical case-control analysis revealed few significant differences and why several large previous neuroimaging studies have also only detected relatively modest group level effects 8, 19. The heterogeneity underlying ASD is widely recognized 2, 56, 57, 58, 59, 60, 61, 62; some studies have reported reductions in CT in ASD (15), whereas some studies have reported increases 16, 63. Saliently, these inconsistencies remain evident even in large studies; for example, a large study derived from the ENIGMA (Enhancing Neuro Imaging Genetics Through Meta Analysis) consortium demonstrated both regional increases and decreases in ASD at the group level that were consistent across development (8). Other studies—many derived from the ABIDE (Autism Brain Imaging Data Exchange) dataset (64)—have shown widespread increases in CT early in development that are attenuated later in development 19, 20, 48. Our results complement these studies because of our focus on studying individual variation within the ASD cohort. We show that 1) a subset of participants show decreased CT and SA in childhood while 2) other patients show regional increases in childhood in different areas (e.g., pericalcarine cortex), and 3) some participants show increased CT and SA in adolescence or adulthood. Crucially, however, these effects show minimal overlap across brain regions in different individuals. This is in line with another recent study applying normative modeling to ASD, which found effects in a subset of participants that were different from the main group effects (65). Thus, we consider that group-level effects can be understood as the background on which individual variation is superimposed. The individualized deviations we report were mostly located in areas previously associated with ASD, such as the medial cortex including the cingulate and dorsomedial prefrontal regions, lateral prefrontal and parietal cortices, temporal cortices, and hippocampal formation 6, 7, 63, 66, 67. While some of these regions have been associated with social processing, the individual deviations in these regions were not associated with social interaction or communication symptoms at the group level. This could be for several reasons; for example, the anatomical patterns associated with these symptoms may be expressed in other measures of cortical anatomy [e.g., 68, 69] or in subcortical regions. Adults and adolescents had relatively fewer deviations, but these were positive (relatively increased CT and SA) and widespread across prefrontal and temporal cortices. Notably, we detected relatively few deviations in ASD with ID, which is important to exclude the possibility that these subjects were driving the effects described above. However, the ASD with ID group was relatively small (n = 20), so we do not draw strong conclusions about potential differences between ASD with and without ID.
The 15 subjects with the most atypical anatomy all had ASD, which is extremely unlikely to occur by chance. Moreover, these participants had individualized brain alterations and clinical characteristics. At the group level, the regional deviations we detected from the normative model were associated with the severity of lifetime and current autistic symptoms (ADI-R and ADOS-2, respectively), demonstrating that our model predictions may be clinically relevant. The deviation from the normative range was most informative about repetitive behavior symptom severity in that the strongest correlations were between CT in prefrontal regions with restricted repetitive behaviors, especially in female subjects and across both parental report via ADI-R and observer ratings of current symptoms via ADOS-2. These results broadly correspond with previous reports 6, 70, 71 and suggest that ASD may be more heterogeneous in male individuals, but we are cautious about this interpretation because we did not test it directly. Taken together, our results add weight to the importance of considering ASD in the context of a model of typical brain development and at the individual level 39, 63, 67.
Our findings should be considered in the light of several limitations. First, the trajectories of brain development were based on cross-sectional data and should be validated in a longitudinal cohort. Longitudinal follow-up data are currently being acquired and will be the subject of a future report. Moreover, while our sample size is similar to other neuroimaging studies of brain development [e.g., (72)], the model would yield more precise estimates with more data. Second, we registered all subjects to a standard adult template brain, as is standard in the field 10, 63, 67, 73, 74, 75, which could cause bias. However, there were few deviations in the TD cohort, which makes this possibility unlikely. Third, our data do not permit strong inferences about the degree to which confounding variables may have influenced our findings. We found moderate associations between deviations from the normative models and a surrogate metric of image quality, but these were also associated with childhood ASD symptoms, comorbid attention-deficit/hyperactivity disorder symptoms, and IQ. Moreover, our study design does not permit inferences about the direction of causality. For example, subjects with the most abnormal anatomy may also have the most impairment. Finally, we did not perform manual edits on the cortical surface reconstructions. While this eliminates one potential source of bias, the results need to be interpreted in the light of this, and it is possible that performing manual edits may improve the quality of the surface reconstructions in some cases.
In conclusion, we estimated a normative model of cortical development based on a large TD cohort and applied this model to a heterogeneous ASD cohort. Our results show that it is necessary to look beyond the case-control paradigm—which is limited to detecting group-level effects describing the “average ASD participant”—to understand the heterogeneous neurobiology of ASD. Normative modeling is well suited for this purpose, as it can chart the individualized deviation of each individual subject relative to the normative range, and hence provides an excellent tool for understanding the heterogeneity of psychiatric disorders.
Acknowledgments and Disclosures
The work is supported by the Netherlands Organization for Scientific Research VIDI Grant Nos. 016.156.415 (to AFM) and 864.12.003 (to CFB); European Union Seventh Framework Programme Grant Nos. 602805 (AGGRESSOTYPE) (to JKB), 603016 (MATRICS) (to JKB), and 278948 (TACTICS) (to JKB); European Community’s Horizon 2020 Programme (H2020/2014-2020) Grant Nos. 643051 (MiND) (to JKB) and 642996 (BRAINVIEW) (to JKB); Wellcome Trust UK Strategic Award Grant No. 098369/Z/12/Z (to CFB); and EU-AIMS (European Autism Interventions), which receives support from Innovative Medicines Initiative Joint Undertaking Grant No. 115300, the resources of which are composed of financial contributions from the European Union’s Seventh Framework Programme (Grant No. FP7/2007-2013), from the European Federation of Pharmaceutical Industries and Associations companies’ in-kind contributions.
We gratefully acknowledge the support of the EU-AIMS (European Autism Interventions) Longitudinal European Autism Project study team for data acquisition, quality control, and preprocessing.
JKB has been a consultant to, advisory board member of, and a speaker for Janssen Cilag BV, Eli Lilly, Shire, Lundbeck, Roche, and Servier. He is not an employee of any of these companies, and not a stock shareholder of any of these companies. He has no other financial or material support, including expert testimony, patents or royalties. CFB is director and shareholder in SBGNeuro Ltd. SB discloses that he has in the last 5 years acted as an author, consultant or lecturer for Shire, Medice, Roche, Eli Lilly, Prima Psychiatry, GLGroup, System Analytic, Ability Partner, Kompetento, Expo Medica, and Prophase. He receives royalties for text books and diagnostic tools from Huber/Hogrefe, Kohlhammer, and UTB. TB served in an advisory or consultancy role for Actelion, Hexal Pharma, Lilly, Lundbeck, Medice, Novartis, and Shire. He received conference support or speaker’s fee by Lilly, Medice, Novartis, and Shire. He has been involved in clinical trials conducted by Shire and Vifor Pharma. He received royalities from Hogrefe, Kohlhammer, CIP Medien, and Oxford University Press. The present work is unrelated to the above grants and relationships. The other authors report no biomedical financial interests or potential conflicts of interest.
Footnotes
Supplementary material cited in this article is available online at https://doi.org/10.1016/j.bpsc.2018.11.013.
Supplementary Material
References
- 1.American Psychiatric Association . 5th ed. American Psychiatric Press; Washington, DC: 2013. Diagnostic and Statistical Manual of Mental Disorders. [Google Scholar]
- 2.Betancur C. Etiological heterogeneity in autism spectrum disorders: More than 100 genetic and genomic disorders and still counting. Brain Res. 2011;1380:42–77. doi: 10.1016/j.brainres.2010.11.078. [DOI] [PubMed] [Google Scholar]
- 3.Ecker C. The neuroanatomy of autism spectrum disorder: An overview of structural neuroimaging findings and their translatability to the clinical setting. Autism. 2016;21:18–28. doi: 10.1177/1362361315627136. [DOI] [PubMed] [Google Scholar]
- 4.Walsh C.A., Morrow E.M., Rubenstein J.L.R. Autism and brain development. Cell. 2008;135:396–400. doi: 10.1016/j.cell.2008.10.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Schumann C.M., Bloss C.S., Barnes C.C., Wideman G.M., Carper R.A., Akshoomoff N. Longitudinal magnetic resonance imaging study of cortical development through early childhood in autism. J Neurosci. 2010;30:4419–4427. doi: 10.1523/JNEUROSCI.5714-09.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Ecker C., Ginestet C., Feng Y., Johnston P., Lombardo M.V., Lai M.-C. Brain surface anatomy in adults with autism: The relationship between surface area, cortical thickness, and autistic symptomsbrain surface anatomy in adults with autism. JAMA Psychiatry. 2013;70:59–70. doi: 10.1001/jamapsychiatry.2013.265. [DOI] [PubMed] [Google Scholar]
- 7.Hyde K.L., Samson F., Evans A.C., Mottron L. Neuroanatomical differences in brain areas implicated in perceptual and other core features of autism revealed by cortical thickness analysis and voxel-based morphometry. Hum Brain Mapp. 2010;31:556–566. doi: 10.1002/hbm.20887. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.van Rooij D., Anagnostou E., Arango C., Auzias G., Behrmann M., Busatto G.F. Cortical and subcortical brain morphometry differences between patients with autism spectrum disorder and healthy individuals across the lifespan: Results from the ENIGMA ASD Working Group. Am J Psychiatry. 2018;175:359–369. doi: 10.1176/appi.ajp.2017.17010100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Ecker C., Bookheimer S.Y., Murphy D.G.M. Neuroimaging in autism spectrum disorder: Brain structure and function across the lifespan. Lancet Neurol. 2015;14:1121–1134. doi: 10.1016/S1474-4422(15)00050-2. [DOI] [PubMed] [Google Scholar]
- 10.Hazlett H.C., Poe M., Gerig G., Styner M., Chappell C., Smith R.G. Early brain overgrowth in autism associated with an increase in cortical surface area before age 2 years. Arch Gen Psychiatry. 2011;68:467–476. doi: 10.1001/archgenpsychiatry.2011.39. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Piven J., Arndt S., Bailey J., Havercamp S., Andreasen N.C., Palmer P. An MRI study of brain size in autism. Am J Psychiatry. 1995;152:1145–1149. doi: 10.1176/ajp.152.8.1145. [DOI] [PubMed] [Google Scholar]
- 12.Piven J., Arndt S., Bailey J., Andreasen N. Regional brain enlargement in autism: A magnetic resonance imaging study. J Am Acad Child Adolesc Psychiatry. 1996;35:530–536. doi: 10.1097/00004583-199604000-00020. [DOI] [PubMed] [Google Scholar]
- 13.Hardan A.Y., Minshew N.J., Mallikarjuhn M., Keshavan M.S. Brain volume in autism. J Child Neurol. 2001;16:421–424. doi: 10.1177/088307380101600607. [DOI] [PubMed] [Google Scholar]
- 14.Lai M.C., Lombardo M.V., Chakrabarti B., Baron-Cohen S. Subgrouping the autism “spectrum”: Reflections on DSM-5. PLoS Biol. 2013;11:e1001544. doi: 10.1371/journal.pbio.1001544. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Hadjikhani N., Joseph R.M., Snyder J., Tager-Flusberg H. Anatomical differences in the mirror neuron system and social cognition network in autism. Cereb Cortex. 2006;16:1276–1282. doi: 10.1093/cercor/bhj069. [DOI] [PubMed] [Google Scholar]
- 16.Mak-Fan K.M., Taylor M.J., Roberts W., Lerch J.P. Measures of cortical grey matter structure and development in children with autism spectrum disorder. J Autism Dev Disord. 2012;42:419–427. doi: 10.1007/s10803-011-1261-6. [DOI] [PubMed] [Google Scholar]
- 17.Wallace G.L., Dankner N., Kenworthy L., Giedd J.N., Martin A. Age-related temporal and parietal cortical thinning in autism spectrum disorders. Brain. 2010;133:3745–3754. doi: 10.1093/brain/awq279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Scheel C., Rotarska-Jagiela A., Schilbach L., Lehnhardt F.G., Krug B., Vogeley K., Tepest R. Imaging derived cortical thickness reduction in high-functioning autism: Key regions and temporal slope. Neuroimage. 2011;58:391–400. doi: 10.1016/j.neuroimage.2011.06.040. [DOI] [PubMed] [Google Scholar]
- 19.Haar S., Berman S., Behrmann M., Dinstein I. Anatomical abnormalities in autism? Cereb Cortex. 2016;26:1440–1452. doi: 10.1093/cercor/bhu242. [DOI] [PubMed] [Google Scholar]
- 20.Khundrakpam B.S., Lewis J.D., Kostopoulos P., Carbonell F., Evans A.C. Cortical thickness abnormalities in autism spectrum disorders through late childhood, adolescence, and adulthood: A large-scale MRI study. Cereb Cortex. 2017;27:1721–1731. doi: 10.1093/cercor/bhx038. [DOI] [PubMed] [Google Scholar]
- 21.Courchesne E., Karns C.M., Davis H.R., Ziccardi R., Carper R.A., Tigue Z.D. Unusual brain growth patterns in early life in patients with autistic disorder: An MRI study. Neurology. 2011;57:245–254. doi: 10.1212/wnl.57.2.245. [DOI] [PubMed] [Google Scholar]
- 22.Ecker C., Shahidiani A., Feng Y., Daly E., Murphy C., D’Almeida V. The effect of age, diagnosis, and their interaction on vertex-based measures of cortical thickness and surface area in autism spectrum disorder. J Neural Transm. 2014;121:1157–1170. doi: 10.1007/s00702-014-1207-1. [DOI] [PubMed] [Google Scholar]
- 23.Ramaswami G., Geschwind D.H. Genetics of autism spectrum disorder. Handb Clin Neurol. 2018;147:321–329. doi: 10.1016/B978-0-444-63233-3.00021-X. [DOI] [PubMed] [Google Scholar]
- 24.Zhang W., Groen W., Mennes M., Greven C., Buitelaar J., Rommelse N. Revisiting subcortical brain volume correlates of autism in the ABIDE dataset: Effects of age and sex. Psychol Med. 2018;48:654–668. doi: 10.1017/S003329171700201X. [DOI] [PubMed] [Google Scholar]
- 25.Wolfers T., Buitelaar J.K., Beckmann C.F., Franke B., Marquand A.F. From estimating activation locality to predicting disorder: A review of pattern recognition for neuroimaging-based psychiatric diagnostics. Neurosci Biobehav Rev. 2015;57:328–349. doi: 10.1016/j.neubiorev.2015.08.001. [DOI] [PubMed] [Google Scholar]
- 26.Sabuncu M.R., Konukoglu E. Clinical prediction from structural brain MRI scans: A large-scale empirical study. Neuroinformatics. 2014;13:31–46. doi: 10.1007/s12021-014-9238-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Damiano C.R., Mazefsky C.A., White S.W., Dichter G.S. Future directions for research in autism spectrum disorders. J Clin Child Adolesc Psychol. 2014;43:828–843. doi: 10.1080/15374416.2014.945214. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Insel T.R., Cuthbert B.N. Brain disorders? Precisely. Science. 2015;348:499–500. doi: 10.1126/science.aab2358. [DOI] [PubMed] [Google Scholar]
- 29.Lombardo M.V., Pierce K., Eyler L.T., Carter Barnes C., Ahrens-Barbeau C., Solso S. Different functional neural substrates for good and poor language outcome in autism. Neuron. 2015;86:567–577. doi: 10.1016/j.neuron.2015.03.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Fountain C., Winter A.S., Bearman P.S. Six developmental trajectories characterize children with autism. Pediatrics. 2012;129:e1112–e1120. doi: 10.1542/peds.2011-1601. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Fair D.A., Bathula D., Nikolas M.A., Nigg J.T. Distinct neuropsychological subgroups in typically developing youth inform heterogeneity in children with ADHD. Proc Natl Acad Sci U S A. 2012;109:6769–6774. doi: 10.1073/pnas.1115365109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Costa Dias T.G., Iyer S.P., Carpenter S.D., Cary R.P., Wilson V.B., Mitchel S.H. Characterizing heterogeneity in children with and without ADHD based on reward system connectivity. Dev Cogn Neurosci. 2015;11:155–174. doi: 10.1016/j.dcn.2014.12.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.van Loo H.M., de Jonge P., Romeijn J.-W., Kessler R.C., Schoevers R.A. Data-driven subtypes of major depressive disorder: A systematic review. BMC Med. 2012;10:156. doi: 10.1186/1741-7015-10-156. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Bell M.D., Corbera S., Johannesen J.K., Fiszdon J.M., Wexler B.E. Social cognitive impairments and negative symptoms in schizophrenia: Are there subtypes with distinct functional correlates? Schizophr Bull. 2013;39:186–196. doi: 10.1093/schbul/sbr125. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Marquand A.F., Wolfers T., Mennes M., Buitelaar J., Beckmann C.F. Beyond lumping and splitting: A review of computational approaches for stratifying psychiatric disorders. Biol Psychiatry Cogn Neurosci Neuroimaging. 2016;1:433–447. doi: 10.1016/j.bpsc.2016.04.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Marquand A.F., Rezek I., Buitelaar J., Beckmann C.F. Understanding heterogeneity in clinical cohorts using normative models: Beyond case-control studies. Biol Psychiatry. 2016;80:552–561. doi: 10.1016/j.biopsych.2015.12.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Wolfers T., Doan N., Kaufmann T., Alnæs D., Moberget T., Buitelaar J.K. Mapping the heterogeneous phenotype of schizophrenia and bipolar disorder using normative models. JAMA Psychiatry. 2018;75:1146–1155. doi: 10.1001/jamapsychiatry.2018.2467. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Loth E., Charman T., Mason L., Tillmann J., Jones E.J.H., Wooldridge C. The EU-AIMS Longitudinal European Autism Project (LEAP): Design and methodologies to identify and validate stratification biomarkers for autism spectrum disorders. Mol Autism. 2017;8:24. doi: 10.1186/s13229-017-0146-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Anagnostou E., Taylor M.J. Review of neuroimaging in autism spectrum disorders: What have we learned and where we go from here. Mol Autism. 2011;2:4. doi: 10.1186/2040-2392-2-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Charman T., Loth E., Tillmann J., Crawley D., Wooldridge C., Goyard D. The EU-AIMS Longitudinal European Autism Project (LEAP): Clinical characterisation. Mol Autism. 2017;8:27. doi: 10.1186/s13229-017-0145-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Rutter M. WPS; Torrance, CA: 2003. Autism Diagnostic Interview, Revised. [Google Scholar]
- 42.Lord C., Risi S., Lambrecht L., Cook E.H., Leventhal B.L., Dilavore P.C. The Autism Diagnostic Observation Schedule-Generic: A standard measure of social and communication deficits associated with the spectrum of autism. J Autism Dev Disord. 2000;30:205–223. [PubMed] [Google Scholar]
- 43.Rasmussen C.E., Williams C.K.I. Gaussian Processes for Machine Learning. MIT Press; Cambridge, MA: 2006. Model selection and adaptation of hyperparameters; pp. 105–128. [Google Scholar]
- 44.Fisher R.A., Tippett L.H.C. Limiting forms of the frequency distribution of the largest or smallest member of a sample. Math Proc Cambridge Philos Soc. 1928;24:180–190. [Google Scholar]
- 45.Desikan R.S., Ségonne F., Fischl B., Quinn B.T., Dickerson B.C., Blacker D. An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage. 2006;31:968–980. doi: 10.1016/j.neuroimage.2006.01.021. [DOI] [PubMed] [Google Scholar]
- 46.Dale A.M., Fischl B., Sereno M.I. Cortical surface-based analysis: I. Segmentation and surface reconstruction. Neuroimage. 1999;9:179–184. doi: 10.1006/nimg.1998.0395. [DOI] [PubMed] [Google Scholar]
- 47.Walhovd K.B., Fjell A.M., Giedd J., Dale A.M., Brown T.T. Through thick and thin: A need to reconcile contradictory results on trajectories in human cortical development. Cereb Cortex. 2016;27:1472–1481. doi: 10.1093/cercor/bhv301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Zielinski B.A., Prigge M.B.D., Nielsen J.A., Froehlich A.L., Abildskov T.J., Anderson J.S. Longitudinal changes in cortical thickness in autism and typical development. Brain. 2014;137:1799–1812. doi: 10.1093/brain/awu083. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Ducharme S., Albaugh M.D., Nguyen T., Hudziak J.J., Mateos-Pérez J.M., Labbe A. NeuroImage Trajectories of cortical thickness maturation in normal brain development — The importance of quality control procedures. Neuroimage. 2016;125:267–279. doi: 10.1016/j.neuroimage.2015.10.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Tamnes C.K., Herting M.M., Goddings A.-L., Meuwese R., Blakemore S.-J., Dahl R.E. Development of the cerebral cortex across adolescence: A multisample study of inter-related longitudinal changes in cortical volume, surface area, and thickness. J Neurosci. 2017;37:3402–3412. doi: 10.1523/JNEUROSCI.3302-16.2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Shaw P., Kabani N.J., Lerch J.P., Eckstrand K., Lenroot R., Gogtay N. Neurodevelopmental trajectories of the human cerebral cortex. J Neurosci. 2008;28:3586–3594. doi: 10.1523/JNEUROSCI.5309-07.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Fjell A.M., Grydeland H., Krogsrud S.K., Amlien I., Rohani D.A., Ferschmann L. Development and aging of cortical thickness correspond to genetic organization patterns. Proc Natl Acad Sci U S A. 2015;112:15462–15467. doi: 10.1073/pnas.1508831112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Fjell A.M., Walhovd K.B. Structural brain changes in aging: Courses, causes and cognitive consequences. Rev Neurosci. 2010;21:187–221. doi: 10.1515/revneuro.2010.21.3.187. [DOI] [PubMed] [Google Scholar]
- 54.Mensen V.T., Wierenga L.M., van Dijk S., Rijks Y., Oranje B., Mandl R.C.W., Durston S. Development of cortical thickness and surface area in autism spectrum disorder. Neuroimage Clin. 2016;13:215–222. doi: 10.1016/j.nicl.2016.12.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Thambisetty M., Wan J., Carass A., An Y., Prince J.L., Resnick S.M. Longitudinal changes in cortical thickness associated with normal aging. Neuroimage. 2010;52:1215–1223. doi: 10.1016/j.neuroimage.2010.04.258. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Abrahams B.S., Geschwind D.H. Advances in autism genetics: On the threshold of a new neurobiology. Nat Rev Genet. 2008;9:341–355. doi: 10.1038/nrg2346. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Ecker C., Murphy D. Neuroimaging in autism—from basic science to translational research. Nat Rev Neurol. 2014;10:82–91. doi: 10.1038/nrneurol.2013.276. [DOI] [PubMed] [Google Scholar]
- 58.Geschwind D.H., Levitt P. Autism spectrum disorders: Developmental disconnection syndromes. Curr Opin Neurobiol. 2007;17:103–111. doi: 10.1016/j.conb.2007.01.009. [DOI] [PubMed] [Google Scholar]
- 59.Marshall C.R., Noor A., Vincent J.B., Lionel A.C., Feuk L., Skaug J. Structural variation of chromosomes in autism spectrum disorder. Am J Hum Genet. 2008;82:477–488. doi: 10.1016/j.ajhg.2007.12.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Croen L.A., Grether J.K., Selvin S. Descriptive epidemiology of autism in a California population: Who is at risk? J Autism Dev Disord. 2002;32:217–224. doi: 10.1023/a:1015405914950. [DOI] [PubMed] [Google Scholar]
- 61.Seltzer M.M., Shattuck P., Abbeduto L., Greenberg J.S. Trajectory of development in adolescents and adults with autism. Ment Retard Dev Disabil Res Rev. 2004;10:234–247. doi: 10.1002/mrdd.20038. [DOI] [PubMed] [Google Scholar]
- 62.Ronald A., Happé F., Bolton P., Butcher L.M., Price T.S., Wheelwright S. Genetic heterogeneity between the three components of the autism spectrum: A twin study. J Am Acad Child Adolesc Psychiatry. 2006;45:691–699. doi: 10.1097/01.chi.0000215325.13058.9d. [DOI] [PubMed] [Google Scholar]
- 63.Hardan A.Y., Muddasani S., Vemulapalli M., Keshavan M.S., Minshew N.J. An MRI study of increased cortical thickness in autism. Am J Psychiatry. 2006;163:1290–1292. doi: 10.1176/appi.ajp.163.7.1290. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Di Martino A., Yan C.G., Li Q., Denio E., Castellanos F.X., Alaerts K. The autism brain imaging data exchange: Towards a large-scale evaluation of the intrinsic brain architecture in autism. Mol Psychiatry. 2014;19:659–667. doi: 10.1038/mp.2013.78. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Bethlehem R.A.I., Seidlitz J., Romero-Garcia R., Lombardo M.V. Using normative age modelling to isolate subsets of individuals with autism expressing highly age-atypical cortical thickness features. bioRxiv. 2018 [published online ahead of print Jan 23] [Google Scholar]
- 66.Amaral D.G., Schumann C.M., Nordahl C.W. Neuroanatomy of autism. Trends Neurosci. 2008;31:137–145. doi: 10.1016/j.tins.2007.12.005. [DOI] [PubMed] [Google Scholar]
- 67.Jiao Y., Chen R., Ke X., Chu K., Lu Z., Herskovits E. Predictive models of autism spectrum disorder based on brain regional cortical thickness. Neuroimage. 2011;50:589–599. doi: 10.1016/j.neuroimage.2009.12.047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Ecker C., Andrews D., Dell’Acqua F., Daly E., Murphy C., Catani M. Relationship between cortical gyrification, white matter connectivity, and autism spectrum disorder. Cereb Cortex. 2016;26:3297–3309. doi: 10.1093/cercor/bhw098. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Ecker C., Ronan L., Feng Y., Daly E., Murphy C., Ginestet C.E. Intrinsic gray-matter connectivity of the brain in adults with autism spectrum disorder. Proc Natl Acad Sci U S A. 2013;110:13222–13227. doi: 10.1073/pnas.1221880110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Moradi E., Khundrakpam B., Lewis J.D., Evans A.C., Tohka J. Predicting symptom severity in autism spectrum disorder based on cortical thickness measures in agglomerative data. Neuroimage. 2017;144:128–141. doi: 10.1016/j.neuroimage.2016.09.049. [DOI] [PubMed] [Google Scholar]
- 71.Doyle-Thomas K.A.R., Duerden E.G., Taylor M.J., Lerch J.P., Soorya L.V., Wang A.T. Effects of age and symptomatology on cortical thickness in autism spectrum disorders. Res Autism Spectr Disord. 2013;7:141–150. doi: 10.1016/j.rasd.2012.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Giedd J.N., Blumenthal J., Jeffries N.O., Castellanos F.X., Liu H., Zijdenbos A. Brain development during childhood and adolescence: A longitudinal MRI study. Nat Neurosci. 1999;2:861–863. doi: 10.1038/13158. [DOI] [PubMed] [Google Scholar]
- 73.Hardan A.Y., Libove R.A., Keshavan M.S., Melhem N.M., Minshew N.J. A preliminary longitudinal magnetic resonance imaging study of brain volume and cortical thickness in autism. Biol Psychiatry. 2009;66:320–326. doi: 10.1016/j.biopsych.2009.04.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.McAlonan G.M., Cheung V., Cheung C., Suckling J., Lam G.Y., Tai K.S. Mapping the brain in autism. A voxel-based MRI study of volumetric differences and intercorrelations in autism. Brain. 2005;128:268–276. doi: 10.1093/brain/awh332. [DOI] [PubMed] [Google Scholar]
- 75.McAlonan G.M., Suckling J., Wong N., Cheung V., Lienenkaemper N., Cheung C., Chua S.E. Distinct patterns of grey matter abnormality in high-functioning autism and Asperger’s syndrome. J Child Psychol Psychiatry. 2008;49:1287–1295. doi: 10.1111/j.1469-7610.2008.01933.x. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.