Abstract
Background
Adolescence hosts a sharp increase in the incidence of mental disorders. The prodromal phases are often characterized by cognitive deficits that predate disease onset by several years. Characterization of cognitive performance in relation to normative trajectories may have value for early risk assessment and monitoring.
Methods
Youth aged 8 to 21 years (N = 6481) from the Philadelphia Neurodevelopmental Cohort were included. Performance scores from a computerized neurocognitive battery were decomposed using principal component analysis, yielding a general cognitive score. Items reflecting various aspects of psychopathology from self-report questionnaires and collateral caregiver information were decomposed using independent component analysis, providing individual domain scores. Using normative modeling and Bayesian statistics, we estimated normative trajectories of cognitive function and tested for associations between cognitive deviance and psychopathological domain scores. In addition, we tested for associations with polygenic scores for mental and behavioral disorders often involving cognition, including schizophrenia, bipolar disorder, attention-deficit/hyperactivity disorder, and Alzheimer’s disease.
Results
More negative normative cognitive deviations were associated with higher general psychopathology burden and domains reflecting positive and prodromal psychosis, attention problems, norm-violating behavior, and anxiety. In addition, better performance was associated with higher joint burden of depression, suicidal ideation, and negative psychosis symptoms. The analyses revealed no evidence for associations with polygenic scores.
Conclusions
Our results show that cognitive performance is associated with general and specific domains of psychopathology in youth. These findings support the close links between cognition and psychopathology in youth and highlight the potential of normative modeling for early risk assessment.
Keywords: Cognition, Development, Genetic risk, Normative modeling, PNC, Psychopathology
Adolescence is a period characterized by substantial biological, cognitive, and psychological development. Supporting increasing demands from the social environment toward independence, the period from early childhood to young adulthood hosts a strong refinement of basic cognitive functions such as sensorimotor processes and complex functions such as cognitive control and emotion regulation (1,2). Accompanying and supporting this gradual improvement of cognitive functions, substantial maturational reorganization across brain tissue types and regions has been reported (3,4). Likely partly explained by a combination of concurrent biological changes and increasing environmental and social demands, adolescence and early adulthood are also accompanied by a sharp increase in the incidence rates of many mental disorders (5,6).
Converging behavioral, neural, and genetic evidence supports a neurodevelopmental component in the etiology of several mental disorders (7, 8, 9). Cognitive deficits are abundant in most mental disorders; however, substantial heterogeneity in cognitive performance has been reported among patients with disorders such as schizophrenia, bipolar disorder, and attention-deficit/hyperactivity disorder (ADHD) (10, 11, 12, 13). Subtle cognitive impairments are often present already in the prodromal phase of mental disorders and are likely to predate the onset of clinical symptoms for months and even years (14). While Alzheimer’s disease (AD) is associated with later life stages, studies have found that disease processes and subtle cognitive dysfunctions may emerge several years and even decades before clinical onset (15), which may point to a neurodevelopmental origin even in late-life cognitive disorders. Previous studies on youths with high polygenic risk for AD have revealed mixed findings, some indicating possible early cognitive alterations (16) and others suggesting no associations between polygenic scores and cognitive performance during childhood and adolescence (17).
ADHD, schizophrenia, bipolar disorder, and AD are all highly heritable disorders (13,18, 19, 20). While parts of the heritability are likely attributed to rare sequence variants with large effects, well-powered genome-wide association studies from the last decade indicate that a large fraction of the heritability of most mental disorders is accounted for by the joint effects of numerous common genetic variants, each with low penetrance (21, 22, 23). Based on this concept of distributed genetic associations, polygenic scores aggregate the genetic load across the genome based on individual-level genotype information (24). This method can afford accurate descriptions of polygenic risk, which, along with charting of individual variation in cognitive development and performance preceding the clinical phase, can be vital for detection of deviations related to risk of psychopathology (25). By mapping individual differences, normative modeling offers a conceptual and statistical framework for quantifying the normative range and individual deviations in the trajectories of biological and other relevant clinical features (26).
To examine patterns and variation of general cognitive functioning across age as an early indicator of mental disorder risk, we applied normative modeling on cognitive test data obtained from 6481 children and adolescents aged 8 to 22 years. Principal component analysis (PCA) was performed on the cognitive test data, and the first principal component was used as a generalized measure of cognition. We used normative modeling to probe each individual’s performance in relation to the estimated trajectories, resulting in an individual overall cognitive performance deviance score. In line with the aims of the National Institute of Mental Health Research Domain Criteria project of mental disorders (27), we decomposed self-reported questionnaire items and collateral information reflecting measures of psychopathology using independent component analysis (ICA) into data-driven and independent patterns of clinical symptom features (28). For the subset of participants with European ancestry and available cognitive, clinical, and genetic data (n = 3175), we tested for associations between individual deviance scores and polygenic scores for various mental and cognitive disorders, including schizophrenia, bipolar disorder, ADHD, and AD. Adopting a Bayesian regression framework, we hypothesized that deviating more negatively from the norm on cognition would be associated with higher scores in the selected clinical domains and greater polygenic scores for schizophrenia, bipolar disorder, ADHD, and AD.
Methods and Materials
Sample Description
We included data from the Philadelphia Neurodevelopmental Cohort, comprising >9000 participants aged 8 to 21 years (mean = 13.6, SD = 3.6) (29,30). Available information includes medical history; genetic, clinical, and cognitive data; and for a subset, neuroimaging. Details about recruitment procedures, sample characteristics, and clinical, cognitive, and imaging procedures have previously been described (30). Complete cognitive data were available from 6481 participants (3377 females); participants with severe medical conditions (n = 44) or missing clinical data (n = 4) were excluded. Genetic data were available from 4450 White Europeans; from these, 3175 (n = 1581 females, age = 8−21 years) participants also had cognitive and clinical data available (see Table S1 for further descriptions of the two samples).
Neurocognitive Test Battery
Participants completed a computerized test battery comprising 14 tests assessing executive functions, episodic memory, complex cognition, social cognition, and sensorimotor speed (31). Accuracy and response times were available for all tests. In total, we included 16 performance scores from 14 tests (see Figure S1 for more details). In addition, the Wide Range Achievement Test was administered to provide an estimate of general intellectual abilities. The percentage of missing values for the cognitive items ranged from 0.01% to 2.5%. For participants missing 1 to 5 test scores (n = 164), mean imputation was used. Participants missing >5 values were excluded (n = 4).
To obtain a data-driven measure of general cognitive function, we performed PCA and extracted the first component as a measure of general cognitive function (Figure 1). This component explained 35% of the variance, with the highest contributions from the Wide Range Achievement Test (10.9%) and the Penn Verbal Reasoning Test (10.4%). The contributions to the other components can be seen in Table S2.
Normative Modeling
Figure 2 summarizes the analysis workflow. We used the normative modeling framework to predict the first cognition-based principal component from the covariates sex and age under 10-fold cross-validation with the goal to detect individual-level deviations from the estimated norm. The Gaussian process regression predicted 45.6% of the variance of the observed cognitive performance out of sample. This shows that the PCA component was suited for growth charting because it was sufficiently linked to sex and age (mean standardized log loss = −0.304, root mean squared error between true/predicted responses = 1.803, standardized mean squared error = 0.544).
Thus, our results show an improvement in cognitive performance with increasing age for both males and females. While an association with age is essential for growth charting, the Gaussian process regression provides a consistent measure of predictive confidence in addition to point estimates (32). Using this estimate, we could quantify the deviation of each participant from the predicted mean in terms of an individual z score. This measure reflects the difference between the predicted cognitive test score and the observed cognitive score normalized by the estimated uncertainty of the prediction (33). Thus, using the normative modeling framework, we were able to estimate a score that reflected the deviation of a participant at the level of the individual.
Psychopathology Domains
All participants completed a computerized, structured interview (GOASSESSS) to assess major domains of psychopathology. This included measures of anxiety, mood, behavioral, eating, and psychosis spectrum disorders. In addition, collateral informants were used for participants aged 18 or younger (34). Based on previous work (28), we included 129 items (Table S3) capturing various psychopathological domains from all participants (N = 6481). Follow-up and conditional items were not included. The percentage of missing values for the chosen items were between 0% and 7%. For the participants with one or more missing items (n = 1627), except for 2 participants who had no clinical data available, missing values were replaced by the nearest neighbor value based on Euclidean distance (28). Based on previous work (28), all available clinical item scores were submitted to ICA using Icasso (MATLAB, version 1.21; The MathWorks, Inc.) (35) to capture latent overlapping categories underlying the psychopathological measures. The items were then decomposed into seven ICs. The resulting ICs represented attention problems (IC1); anxiety (IC2); norm-violating behavior (IC3); positive and prodromal psychosis symptoms (IC4); depression, suicide, and psychosis negative symptoms (IC5); mania (IC6); and obsessive-compulsive symptoms (IC7) (28). In addition, the mean weights across these components were used as a proxy for general psychopathology. Distributions for the included psychopathology domains can be seen in Figure S4.
Genetic Data
Genotyping was performed by the Center for Applied Genomics at the Children’s Hospital of Philadelphia. The DNA samples from the Philadelphia Neurodevelopmental Cohort were genotyped in different batches using Illumina OmniExpress (n = 1657), Illumina Human-610 Quad (n = 3807), Illumina HumanHap-550-v1 (n = 556), Illumina HumanHap-550-v3 (n = 1914), Affymetrix Genome-Wide Human SNP Array 6.0 (n = 66), or Affymetrix Axiom (n = 722) (hereafter, Omni, Quad, 550-v1, 550-v3, Affy60, and Axiom, respectively). From those datasets, only participants of European ancestry were included in these analyses. Multidimensional scaling and genotype imputation were performed using previously described procedures (36).
Using PRSice version 2 (37) and summary statistics obtained from earlier genome-wide association studies, we computed polygenic scores for schizophrenia (21), bipolar disorder (38), AD (39), and ADHD (22). Polygenic scores were calculated for participants with White European descent (n = 4450) for 6002 initial p-value thresholds, ranging from 5 × 10−8 to 0.5. To avoid setting a random threshold, for each phenotype, we decomposed the full set of polygenic scores into a reduced set of orthogonal components using PCA (40). For all phenotypes, the first components explained between 80% and 85% of the variance and were used in further analyses.
Statistical Analysis
All statistical analyses were carried out using R, version 3.6.0 (http://www.r-project.org/) (R Core Team, 2012) and python version 3.0 (https://www.python.org/). We used a Bayesian regression approach using the brms (41,42) package in R (R Core Team, 2012) to examine linear associations between deviations from the normative trajectory and either clinical scores or polygenic scores. The deviance scores from the normative cognitive trajectory (i.e., subject-level z-statistics) were included as the dependent variable, and age, sex, and either clinical scores or polygenic scores were entered as independent variables. To prevent false positives and to regularize the estimated associations, we used a prior strongly centered around zero (mean = 0, SD = 0.5) for all coefficients. All variables were standardized prior to analysis. We calculated Bayes factors (BFs) using the Savage-Dickey density ratio method (43). BF reflects the strength of evidence in favor of the null hypothesis or the alternative hypothesis. BF = 1 can be interpreted as evidence pulling in either direction. The following values can be interpreted as weight toward the alternative hypothesis with the following strengths: 0.3 to 1 (anecdotal), 0.1 to 0.3 (moderate), 0.03 to 0.1 (strong), 0.01 to 0.03 (very strong), and <0.01 (extreme). BF > 1 provides evidence toward the null hypothesis: 1 to 3 (anecdotal), 3 to 10 (moderate), 10 to 30 (strong), 30 to 100 (very strong), and >100 (extreme).
To further describe and visualize the relationship between cognitive performance and psychopathology, all participants were divided into deciles (n = 648 in each bin) based on their z score from the cognitive normative model, with low bins indicating good cognitive performance. Next, within each bin, we computed the number and proportion of clinical risk group participants as well as the corresponding odds ratio (OR), based on varying clinical thresholds of 1, 1.5, 2, and 3 SD above the mean for the clinical ICs. OR was calculated as
where exposed are participants with a psychopathological symptom score higher than 2 SD from the mean, cases are the participants placed in the lowest bins (i.e., poorest performance), and noncases have the best cognitive performance.
Results
Association Between Normative Model of Cognition and Psychopathology Scores
Figure 3 shows the posterior distributions for the association between the different psychopathological domain scores and the cognitive deviation score. The tests confirmed extreme evidence in favor of an association between cognitive deviation score and the general psychopathology factor (BF ≤ 0.001, β = 0.182), and the clinical factors reflecting positive and prodromal psychosis symptoms (BF ≤ 0.001, β = 0.171), attention problems (BF ≤ 0.001, β = 0.167), norm-violating behavior (BF ≤ 0.001, β = 0.133), and anxiety (BF ≤ 0.001, β = 0.117), indicating more negative deviations from the cognitive norm (i.e., poorer performance) with more severe psychopathological symptoms (see Table S4 for summary statistics). The tests also revealed extreme evidence in favor of a negative association between cognitive deviation scores and the component reflecting depression, suicide, and negative symptoms (BF = 0.002, β = −0.055), indicating better cognitive performance with higher burden. For the remaining psychopathological domain components, the models revealed strong and anecdotal evidence in favor of no associations for symptoms of mania (BF = 19.37, β = −0.015) and obsessive-compulsive disorder (BF = 2.654, β = −0.030), respectively.
Figure 4 shows the proportion of individuals with a psychopathological domain score >2 SD above the mean within each bin based on the cognitive performance score. Strikingly, for all psychopathological domains except depression, suicide, and negative symptoms (IC5, OR = 0.87); mania (IC6, OR = 1.36); and obsessive-compulsive symptoms (IC7, OR = 1.63), the odds of individuals being in the psychopathology risk group were 2.5 (IC1), 3.81 (IC2), 8.95 (IC3), 4.97 (IC4), and 4.1 (meanClinICA) times higher among the participants in the poorest performance bin than the participants placed in the best performance bin. This indicates that among the participants with poorer cognition, there is a substantially higher number of people who have high scores on general and/or domain-specific psychopathology.
Associations Between Cognitive Deviance Scores and Polygenic Risk Scores
Figure 5 shows the posterior distributions for the association between polygenic risk scores and the cognitive deviation score (see Table S4 for summary statistics). The model revealed strong evidence for no (null) association between cognitive deviance and polygenic scores for schizophrenia (BF = 18.42, β = −0.016), bipolar disorder (BF = 25.90, β = 0.002), AD (BF = 13.10, β = 0.022), and ADHD (BF = 25.03, β = −0.008).
Discussion
Subtle cognitive deficits are assumed to accompany or even precede the emergence of clinical symptoms in early phases of many mental disorders. The overall aim of this study was to examine if deviations in cognitive performance during childhood and adolescence could serve as an early indicator of mental disorder. To this end, we tested for associations between deviations from a normative trajectory of general cognitive function and both psychopathology domains and polygenic scores reflecting the cumulative genetic load associated with major early- and late-life mental and cognitive disorders. Using normative modeling built on cognitive test performance, we estimated normative cognitive trajectories and tested for associations between individual deviance scores and psychopathology and polygenic scores for schizophrenia, bipolar disorder, ADHD, and AD. While a previous study reported an exclusive association between cognition and psychotic symptoms in the Philadelphia Neurodevelopmental Cohort (44), our analysis also revealed associations with other dimensions of psychopathology. Bayesian statistics revealed strong evidence for associations between cognitive deviation and several domains of psychopathology, including a general psychopathology factor and symptom domains reflecting anxiety, positive psychotic and prodromal symptoms, norm-violating behavior, and attention problems. Here, higher symptom load was associated with more negatively deviating cognitive performance, and OR was an order of magnitude higher among the lowest-performing compared with the highest-performing participants. The four implicated symptom categories have previously been classified as belonging to separate empirical symptom factors often termed internalizing, externalizing, and thought disorder symptoms (45). Thus, our results indicate a generalized association between cognition and psychopathology. In contrast, the mania and obsessive-compulsive disorder symptom domains showed strong and anecdotal evidence for null associations between cognitive performance.
The association between cognitive performance and general psychopathology was expected based on previous research in children and adolescents (28,44,46,47), and similar broad psychopathological patterns have also been found when investigating the association between brain white matter characteristics and psychopathology (28). Beyond the general psychopathology factor, the psychosis positive and prodromal symptoms factor showed the strongest association with cognitive deviation. A possible explanation for psychosis positive and prodromal symptoms having the strongest association is that psychosis symptoms may be considered among the more extreme part of the psychopathology severity spectrum and may thus indicate stronger clinical risk and a more severe outcome. Thus, participants with high scores on the psychosis component would also be expected to show more negative deviations from the norm on cognitive performance. Supporting these findings, a previous neuroimaging study in a partly overlapping sample reported that the psychosis domain converged on regions of the cerebellum that have shown functional connectivity with the parietal cerebral network, which is associated with cognitive control processes (48).
While the majority of the associations reflected lower cognitive performance with higher levels of psychological symptoms, stronger symptoms of depression, suicidal ideation, and negative psychosis symptoms were associated with higher cognitive performance. The questionnaire items loading most heavily on this dimensional factor were “having an altered perception of yourself and/or the world,” “feeling disconnected from yourself or your life,” and “feeling sad or depressed most of the time.” These findings were unexpected given that cognitive dysfunction is considered a pathological feature of major depressive disorder (49). A possible explanation is that this dimensional component did not pick up core depression symptoms but rather captures, for instance, personality traits.
In line with the linear associations, the proportion of participants with extreme symptom scores (>2 SD above the mean) was substantially higher among the lowest cognitively performing participants compared with the highest-performing participants for most measures of psychopathology, with ORs suggesting almost five times higher probability of belonging to the clinical risk group among the lowest-performing decile compared with the highest-performing decile. While follow-up studies are required to assess the predictive value of the cognitive deviation score for future transition to a psychotic state or even a diagnosis of schizophrenia or other psychotic disorders, these results support the intuitive link between cognitive function and clinical signs of incipient or emerging psychopathology in children and adolescents. However, participants with extreme symptom loads were represented across all performance bins, possibly indicating subgroups of high-performing individuals with high clinical risk or psychological distress. Previous normative modeling studies on brain magnetic resonance imaging features have found substantial interindividual heterogeneity in various brain structures among patients with schizophrenia, bipolar disorder, autism spectrum disorder, and ADHD (26,50, 51, 52, 53, 54). While we did not pursue a classical case-control design in this work, our findings indicate that this interindividual heterogeneity also is present in terms of cognitive performance. Beyond the general patterns revealed by the linear models, these individual differences may be highly relevant for clinical decision making.
In general, idiosyncratic patterns of deviations revealed using normative modeling support the intuitive notion that group mean differences often represent inaccurate reflections of the deviations seen at an individual level. Because cognitive deviations in the prodromal phase have been found to be associated with more severe clinical phenotypes later in life (55), accurate modeling of cognitive maturity and deviation using normative modeling has the potential to provide valuable information for early detection of at-risk youth. This work provides a step toward the aim of adapting the flexible framework of normative modeling to map the individualistic patterns of cognition and their relationship to clinical risk. In general, the model apparently adequately detected individuals with a lower performance than expected based on the estimated trajectory. Owing to ceiling effects in the cognitive performance data, the model was likely less accurate in parsing the higher end of the function spectrum. Our normative model showed that the Gaussian process regression performed well out of sample. However, future work might consider alternative algorithms such as Bayesian linear regression with warping (56), which may improve the estimation of the mean and variance further.
Bayesian regression analysis revealed strong evidence for no associations between cognitive deviation and polygenic scores for schizophrenia, bipolar disorder, ADHD, and AD. Previous studies have provided mixed findings. In healthy adults, no significant associations were reported between general cognitive function and polygenic scores for ADHD, bipolar disorder, and AD (57,58). Others have reported associations between polygenic risk score for ADHD and more specific cognitive functions, such as working memory (59). Children, adolescents, and young adults carrying risk alleles for AD have also been shown to exhibit abnormal patterns of brain connectivity including brain regions involved in memory performance and inhibitory control (60,61). Furthermore, studies in healthy adults have reported negative associations between polygenic scores for schizophrenia and IQ (58,62), but others have found no associations (63,64). Studies in children and adolescents have also revealed mixed results, with some reporting positive (36), others negative (65), and some reporting no associations (62) between polygenic scores for schizophrenia and cognitive performance. A possible explanation for the lack of association with polygenic scores can be that the environment plays a vital role in this life period and that the genetic effects accumulate more over the life span.
The results of this study should be interpreted while considering its limitations. Most importantly, the cross-sectional nature of the investigations does not allow us to assess the predictive value of the cognitive deviation scores for future mental disorders. Similarly, both the performance scores and the symptom load reflect a snapshot of the current state of the individual. Future follow-up studies may be able to assess the predictive value for long-term mental health and outcome and assess important aspects of the temporal dynamics of the measured psychological factors. For example, symptom scores may show substantial day-to-day variability (66), and delineating state-like from trait-like characteristics of mental health is highly relevant in a clinical setting. A limitation in the genetic analysis is that we only included a subsample with European ancestry, limiting the generalizability to youth with other ancestries.
In conclusion, individual deviance in cognitive performance is related to general and specific domains of psychopathology in youth, with a substantially higher proportion of individuals with extreme symptom load among the lowest-performing participants compared with the highest-performing participants. While follow-up studies are needed to assess the predictive value for future development of mental illness, these results support the close links between emerging psychopathology and cognitive function in youth.
Acknowledgments and Disclosures
The study is supported by the Research Council of Norway (Grant Nos. 249795, 248238, 276082, 286838, and 288083 [to LTW] and Grant No. 323951 [to CKT]), the South-Eastern Norway Regional Health Authority (Grant Nos. 2014097, 2015044, 2015073, 2016083, 2018037, 2018076, and 2019101 [to LTW], Grant Nos. 2019069 and 2021070 [to CKT], and Grant Nos. 2019107 and 2020086 [to DA]), the Norwegian ExtraFoundation for Health and Rehabilitation (Grant No. 2015/FO5146 [to LTW]), KG Jebsen Stiftelsen, ERA-Net Cofund through the ERA PerMed project IMPLEMENT, the European Research Council under the European Union’s Horizon 2020 research and Innovation program (ERC StG Grant No. 802998 [to LTW] and ERC CoG Grant No. 10100118 [to OAA]), and the Marie Sklodowska-Curie grant (Grant No. 895011 [to TW]).
A previous version of this article was published as a preprint on PsyArXiv: https://psyarxiv.com/yz8q6/. An abstract version has also been submitted to the Society of Biological Psychiatry Conference 2022.
OAA is a consultant to HealthLytix and received speaker’s honoraria from Lundbeck. All other authors report no biomedical financial interests or potential conflicts of interest.
Footnotes
Supplementary material cited in this article is available online at https://doi.org/10.1016/j.bpsgos.2022.01.007.
Supplementary Material
References
- 1.Hofmann W., Schmeichel B.J., Baddeley A.D. Executive functions and self-regulation. Trends Cogn Sci. 2012;16:174–180. doi: 10.1016/j.tics.2012.01.006. [DOI] [PubMed] [Google Scholar]
- 2.Larsen B., Luna B. Adolescence as a neurobiological critical period for the development of higher-order cognition. Neurosci Biobehav Rev. 2018;94:179–195. doi: 10.1016/j.neubiorev.2018.09.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Sydnor V.J., Larsen B., Bassett D.S., Alexander-Bloch A., Fair D.A., Liston C., et al. Neurodevelopment of the association cortices: Patterns, mechanisms, and implications for psychopathology. Neuron. 2021;109:2820–2846. doi: 10.1016/j.neuron.2021.06.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Norbom L.B., Ferschmann L., Parker N., Agartz I., Andreassen O.A., Paus T., et al. New insights into the dynamic development of the cerebral cortex in childhood and adolescence: Integrating macro- and microstructural MRI findings. Prog Neurobiol. 2021;204:102109. doi: 10.1016/j.pneurobio.2021.102109. [DOI] [PubMed] [Google Scholar]
- 5.Kessler R.C., Berglund P., Demler O., Jin R., Merikangas K.R., Walters E.E. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication [published correction appears in Arch Gen Psychiatry 2005; 62:768] Arch Gen Psychiatry. 2005;62:593–602. doi: 10.1001/archpsyc.62.6.593. [DOI] [PubMed] [Google Scholar]
- 6.Paus T., Keshavan M., Giedd J.N. Why do many psychiatric disorders emerge during adolescence? Nat Rev Neurosci. 2008;9:947–957. doi: 10.1038/nrn2513. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Birnbaum R., Weinberger D.R. Genetic insights into the neurodevelopmental origins of schizophrenia. Nat Rev Neurosci. 2017;18:727–740. doi: 10.1038/nrn.2017.125. [DOI] [PubMed] [Google Scholar]
- 8.Insel T.R. Rethinking schizophrenia. Nature. 2010;468:187–193. doi: 10.1038/nature09552. [DOI] [PubMed] [Google Scholar]
- 9.Kessler R.C., Angermeyer M., Anthony J.C., de Graaf R., Demyttenaere K., Gasquet I., et al. Lifetime prevalence and age-of-onset distributions of mental disorders in the World Health Organization’s World Mental Health Survey Initiative. World Psychiatry. 2007;6:168–176. [PMC free article] [PubMed] [Google Scholar]
- 10.Carruthers S.P., Van Rheenen T.E., Gurvich C., Sumner P.J., Rossell S.L. Characterising the structure of cognitive heterogeneity in schizophrenia spectrum disorders. A systematic review and narrative synthesis. Neurosci Biobehav Rev. 2019;107:252–278. doi: 10.1016/j.neubiorev.2019.09.006. [DOI] [PubMed] [Google Scholar]
- 11.Joyce E.M., Roiser J.P. Cognitive heterogeneity in schizophrenia. Curr Opin Psychiatry. 2007;20:268–272. doi: 10.1097/YCO.0b013e3280ba4975. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Vaskinn A., Haatveit B., Melle I., Andreassen O.A., Ueland T., Sundet K. Cognitive heterogeneity across schizophrenia and bipolar disorder: A cluster analysis of intellectual trajectories. J Int Neuropsychol Soc. 2020;26:860–872. doi: 10.1017/S1355617720000442. [DOI] [PubMed] [Google Scholar]
- 13.Faraone S.V., Asherson P., Banaschewski T., Biederman J., Buitelaar J.K., Ramos-Quiroga J.A., et al. Attention-deficit/hyperactivity disorder. Nat Rev Dis Primers. 2015;1:15020. doi: 10.1038/nrdp.2015.20. [DOI] [PubMed] [Google Scholar]
- 14.Fusar-Poli P., Deste G., Smieskova R., Barlati S., Yung A.R., Howes O., et al. Cognitive functioning in prodromal psychosis: A meta-analysis. Arch Gen Psychiatry. 2012;69:562–571. doi: 10.1001/archgenpsychiatry.2011.1592. [DOI] [PubMed] [Google Scholar]
- 15.Bateman R.J., Xiong C., Benzinger T.L.S., Fagan A.M., Goate A., Fox N.C., et al. Clinical and biomarker changes in dominantly inherited Alzheimer’s disease [published correction appears in N Engl J Med 2012; 367:780] N Engl J Med. 2012;367:795–804. doi: 10.1056/NEJMoa1202753. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Axelrud L.K., Santoro M.L., Pine D.S., Talarico F., Gadelha A., Manfro G.G., et al. Polygenic risk score for Alzheimer’s disease: Implications for memory performance and hippocampal volumes in early life. Am J Psychiatry. 2018;175:555–563. doi: 10.1176/appi.ajp.2017.17050529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Korologou-Linden R., Anderson E.L., Jones H.J., Davey Smith G., Howe L.D., Stergiakouli E. Polygenic risk scores for Alzheimer’s disease, and academic achievement, cognitive and behavioural measures in children from the general population. Int J Epidemiol. 2019;48:1972–1980. doi: 10.1093/ije/dyz080. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Hilker R., Helenius D., Fagerlund B., Skytthe A., Christensen K., Werge T.M., et al. Heritability of schizophrenia and schizophrenia spectrum based on the nationwide Danish Twin Register. Biol Psychiatry. 2018;83:492–498. doi: 10.1016/j.biopsych.2017.08.017. [DOI] [PubMed] [Google Scholar]
- 19.Johansson V., Kuja-Halkola R., Cannon T.D., Hultman C.M., Hedman A.M. A population-based heritability estimate of bipolar disorder - In a Swedish twin sample. Psychiatry Res. 2019;278:180–187. doi: 10.1016/j.psychres.2019.06.010. [DOI] [PubMed] [Google Scholar]
- 20.Sims R., Hill M., Williams J. The multiplex model of the genetics of Alzheimer’s disease. Nat Neurosci. 2020;23:311–322. doi: 10.1038/s41593-020-0599-5. [DOI] [PubMed] [Google Scholar]
- 21.Schizophrenia Working Group of the Psychiatric Genomics Consortium Biological insights from 108 schizophrenia-associated genetic loci. Nature. 2014;511:421–427. doi: 10.1038/nature13595. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Demontis D., Walters R.K., Martin J., Mattheisen M., Als T.D., Agerbo E., et al. Discovery of the first genome-wide significant risk loci for attention deficit/hyperactivity disorder. Nat Genet. 2019;51:63–75. doi: 10.1038/s41588-018-0269-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Mullins N., Forstner A.J., O’Connell K.S., Coombes B., Coleman J.R.I., Qiao Z., et al. Genome-wide association study of more than 40,000 bipolar disorder cases provides new insights into the underlying biology. Nat Genet. 2021;53:817–829. doi: 10.1038/s41588-021-00857-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Smeland O.B., Frei O., Dale A.M., Andreassen O.A. The polygenic architecture of schizophrenia—Rethinking pathogenesis and nosology. Nat Rev Neurol. 2020;16:366–379. doi: 10.1038/s41582-020-0364-0. [DOI] [PubMed] [Google Scholar]
- 25.Foulkes L., Blakemore S.J. Studying individual differences in human adolescent brain development. Nat Neurosci. 2018;21:315–323. doi: 10.1038/s41593-018-0078-4. [DOI] [PubMed] [Google Scholar]
- 26.Marquand A.F., Kia S.M., Zabihi M., Wolfers T., Buitelaar J.K., Beckmann C.F. Conceptualizing mental disorders as deviations from normative functioning [published correction appears in Mol Psychiatry 2019; 24:1565] Mol Psychiatry. 2019;24:1415–1424. doi: 10.1038/s41380-019-0441-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Cuthbert B.N., Insel T.R. Toward the future of psychiatric diagnosis: The seven pillars of RDoC. BMC Med. 2013;11:126. doi: 10.1186/1741-7015-11-126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Alnæs D., Kaufmann T., Doan N.T., Córdova-Palomera A., Wang Y., Bettella F., et al. Association of heritable cognitive ability and psychopathology with white matter properties in children and adolescents. JAMA Psychiatry. 2018;75:287–295. doi: 10.1001/jamapsychiatry.2017.4277. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Satterthwaite T.D., Connolly J.J., Ruparel K., Calkins M.E., Jackson C., Elliott M.A., et al. The Philadelphia Neurodevelopmental Cohort: A publicly available resource for the study of normal and abnormal brain development in youth. Neuroimage. 2016;124:1115–1119. doi: 10.1016/j.neuroimage.2015.03.056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Satterthwaite T.D., Elliott M.A., Ruparel K., Loughead J., Prabhakaran K., Calkins M.E., et al. Neuroimaging of the Philadelphia Neurodevelopmental Cohort. Neuroimage. 2014;86:544–553. doi: 10.1016/j.neuroimage.2013.07.064. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Moore T.M., Reise S.P., Gur R.E., Hakonarson H., Gur R.C. Psychometric properties of the Penn Computerized Neurocognitive Battery. Neuropsychology. 2015;29:235–246. doi: 10.1037/neu0000093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Rasmussen C.E., Williams C.K.I. the MIT Press; Cambridge, MA: 2006. Gaussian Processes for Machine Learning. [Google Scholar]
- 33.Marquand A.F., Rezek I., Buitelaar J., Beckmann C.F. Understanding heterogeneity in clinical cohorts using normative models: Beyond case-control studies. Biol Psychiatry. 2016;80:552–561. doi: 10.1016/j.biopsych.2015.12.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Calkins M.E., Merikangas K.R., Moore T.M., Burstein M., Behr M.A., Satterthwaite T.D., et al. The Philadelphia Neurodevelopmental Cohort: Constructing a deep phenotyping collaborative. J Child Psychol Psychiatry. 2015;56:1356–1369. doi: 10.1111/jcpp.12416. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Himberg J., Hyvärinen A., Esposito F. Validating the independent components of neuroimaging time series via clustering and visualization. Neuroimage. 2004;22:1214–1222. doi: 10.1016/j.neuroimage.2004.03.027. [DOI] [PubMed] [Google Scholar]
- 36.Córdova-Palomera A., Kaufmann T., Bettella F., Wang Y., Doan N.T., van der Meer D., et al. Effects of autozygosity and schizophrenia polygenic risk on cognitive and brain developmental trajectories. Eur J Hum Genet. 2018;26:1049–1059. doi: 10.1038/s41431-018-0134-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Choi S.W., O’Reilly P.F. PRSice-2: Polygenic risk score software for biobank-scale data. Gigascience. 2019;8:giz082. doi: 10.1093/gigascience/giz082. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Stahl E.A., Breen G., Forstner A.J., McQuillin A., Ripke S., Trubetskoy V., et al. Genome-wide association study identifies 30 loci associated with bipolar disorder. Nat Genet. 2019;51:793–803. doi: 10.1038/s41588-019-0397-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Lambert J.C., Ibrahim-Verbaas C.A., Harold D., Naj A.C., Sims R., Bellenguez C., et al. Meta-analysis of 74,046 individuals identifies 11 new susceptibility loci for Alzheimer’s disease. Nat Genet. 2013;45:1452–1458. doi: 10.1038/ng.2802. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Alnæs D., Kaufmann T., van der Meer D., Córdova-Palomera A., Rokicki J., Moberget T., et al. Brain heterogeneity in schizophrenia and its association with polygenic risk [published correction appears in JAMA Psychiatry 2019; 76:986] JAMA Psychiatry. 2019;76:739–748. doi: 10.1001/jamapsychiatry.2019.0257. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Bürkner P.C. Advanced Bayesian multilevel modeling with the R package brms. The R Journal. 2018;10:395–411. [Google Scholar]
- 42.Bürkner P.C. brms: An R package for Bayesian multilevel models using Stan. J Stat Soft. 2017;80:1–28. [Google Scholar]
- 43.Wagenmakers E.J., Lodewyckx T., Kuriyal H., Grasman R. Bayesian hypothesis testing for psychologists: A tutorial on the Savage-Dickey method. Cogn Psychol. 2010;60:158–189. doi: 10.1016/j.cogpsych.2009.12.001. [DOI] [PubMed] [Google Scholar]
- 44.Gur R.C., Calkins M.E., Satterthwaite T.D., Ruparel K., Bilker W.B., Moore T.M., et al. Neurocognitive growth charting in psychosis spectrum youths. JAMA Psychiatry. 2014;71:366–374. doi: 10.1001/jamapsychiatry.2013.4190. [DOI] [PubMed] [Google Scholar]
- 45.Kotov R., Chang S.W., Fochtmann L.J., Mojtabai R., Carlson G.A., Sedler M.J., Bromet E.J. Schizophrenia in the internalizing-externalizing framework: A third dimension? Schizophr Bull. 2011;37:1168–1178. doi: 10.1093/schbul/sbq024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Romer A.L., Pizzagalli D.A. Is executive dysfunction a risk marker or consequence of psychopathology? A test of executive function as a prospective predictor and outcome of general psychopathology in the adolescent brain cognitive development study®. Dev Cogn Neurosci. 2021;51:100994. doi: 10.1016/j.dcn.2021.100994. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Castellanos-Ryan N., Brière F.N., O’Leary-Barrett M., Banaschewski T., Bokde A., Bromberg U., et al. The structure of psychopathology in adolescence and its common personality and cognitive correlates. J Abnorm Psychol. 2016;125:1039–1052. doi: 10.1037/abn0000193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Moberget T., Alnæs D., Kaufmann T., Doan N.T., Córdova-Palomera A., Norbom L.B., et al. Cerebellar gray matter volume is associated with cognitive function and psychopathology in adolescence. Biol Psychiatry. 2019;86:65–75. doi: 10.1016/j.biopsych.2019.01.019. [DOI] [PubMed] [Google Scholar]
- 49.Zuckerman H., Pan Z., Park C., Brietzke E., Musial N., Shariq A.S., et al. Recognition and treatment of cognitive dysfunction in major depressive disorder. Front Psychiatry. 2018;9:655. doi: 10.3389/fpsyt.2018.00655. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Bethlehem R.A.I., Seidlitz J., Romero-Garcia R., Trakoshis S., Dumas G., Lombardo M.V. A normative modelling approach reveals age-atypical cortical thickness in a subgroup of males with autism spectrum disorder. Commun Biol. 2020;3:486. doi: 10.1038/s42003-020-01212-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Tunç B., Yankowitz L.D., Parker D., Alappatt J.A., Pandey J., Schultz R.T., Verma R. Deviation from normative brain development is associated with symptom severity in autism spectrum disorder. Mol Autism. 2019;10:46. doi: 10.1186/s13229-019-0301-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Wolfers T., Beckmann C.F., Hoogman M., Buitelaar J.K., Franke B., Marquand A.F. Individual differences v. the average patient: Mapping the heterogeneity in ADHD using normative models. Psychol Med. 2020;50:314–323. doi: 10.1017/S0033291719000084. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Wolfers T., Doan N.T., Kaufmann T., Alnæs D., Moberget T., Agartz I., et al. Mapping the heterogeneous phenotype of schizophrenia and bipolar disorder using normative models. JAMA Psychiatry. 2018;75:1146–1155. doi: 10.1001/jamapsychiatry.2018.2467. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Zabihi M., Oldehinkel M., Wolfers T., Frouin V., Goyard D., Loth E., et al. Dissecting the heterogeneous cortical anatomy of autism spectrum disorder using normative models. Biol Psychiatry Cogn Neurosci Neuroimaging. 2019;4:567–578. doi: 10.1016/j.bpsc.2018.11.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Khandaker G.M., Barnett J.H., White I.R., Jones P.B. A quantitative meta-analysis of population-based studies of premorbid intelligence and schizophrenia. Schizophr Res. 2011;132:220–227. doi: 10.1016/j.schres.2011.06.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Fraza C.J., Dinga R., Beckmann C.F., Marquand A.F. Warped Bayesian linear regression for normative modelling of big data. Neuroimage. 2021;245:118715. doi: 10.1101/2021.04.05.438429. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Clarke T.K., Lupton M.K., Fernandez-Pujals A.M., Starr J., Davies G., Cox S., et al. Common polygenic risk for autism spectrum disorder (ASD) is associated with cognitive ability in the general population. Mol Psychiatry. 2016;21:419–425. doi: 10.1038/mp.2015.12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Liebers D.T., Pirooznia M., Seiffudin F., Musliner K.L., Zandi P.P., Goes F.S. Polygenic risk of schizophrenia and cognition in a population-based survey of older adults. Schizophr Bull. 2016;42:984–991. doi: 10.1093/schbul/sbw001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Ronald A., de Bode N., Polderman T.J.C. Systematic review: How the attention-deficit/hyperactivity disorder polygenic risk score adds to our understanding of ADHD and associated traits. J Am Acad Child Adolesc Psychiatry. 2021;60:1234–1277. doi: 10.1016/j.jaac.2021.01.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Axelrud L.K., Sato J.R., Santoro M.L., Talarico F., Pine D.S., Rohde L.A., et al. Genetic risk for Alzheimer’s disease and functional brain connectivity in children and adolescents. Neurobiol Aging. 2019;82:10–17. doi: 10.1016/j.neurobiolaging.2019.06.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Su Y.Y., Zhang X.D., Schoepf U.J., Varga-Szemes A., Stubenrauch A., Liang X., et al. Lower functional connectivity of default mode network in cognitively normal young adults with mutation of APP, presenilins and APOE ε4. Brain Imaging Behav. 2017;11:818–828. doi: 10.1007/s11682-016-9556-z. [DOI] [PubMed] [Google Scholar]
- 62.McIntosh A.M., Gow A., Luciano M., Davies G., Liewald D.C., Harris S.E., et al. Polygenic risk for schizophrenia is associated with cognitive change between childhood and old age. Biol Psychiatry. 2013;73:938–943. doi: 10.1016/j.biopsych.2013.01.011. [DOI] [PubMed] [Google Scholar]
- 63.Engen M.J., Lyngstad S.H., Ueland T., Simonsen C.E., Vaskinn A., Smeland O., et al. Polygenic scores for schizophrenia and general cognitive ability: Associations with six cognitive domains, premorbid intelligence, and cognitive composite score in individuals with a psychotic disorder and in healthy controls. Transl Psychiatry. 2020;10:416. doi: 10.1038/s41398-020-01094-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Shafee R., Nanda P., Padmanabhan J.L., Tandon N., Alliey-Rodriguez N., Kalapurakkel S., et al. Polygenic risk for schizophrenia and measured domains of cognition in individuals with psychosis and controls. Transl Psychiatry. 2018;8:78. doi: 10.1038/s41398-018-0124-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Hubbard L., Tansey K.E., Rai D., Jones P., Ripke S., Chambert K.D., et al. Evidence of common genetic overlap between schizophrenia and cognition. Schizophr Bull. 2016;42:832–842. doi: 10.1093/schbul/sbv168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Nelson B., McGorry P.D., Wichers M., Wigman J.T.W., Hartmann J.A. Moving from static to dynamic models of the onset of mental disorder: A review. JAMA Psychiatry. 2017;74:528–534. doi: 10.1001/jamapsychiatry.2017.0001. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.