Abstract
Contemporary theories propose that dysregulation of emotional perception is involved in the aetiology of psychosis. 298 healthy adolescents were assessed at age 14- and 19-years using fMRI while performing a facial emotion task. Psychotic-like experiences (PLEs) were assessed with the CAPE-42 questionnaire at age 19. The high PLEs group at age 19 years exhibited an enhanced response in right insular cortex and decreased response in right prefrontal, right parahippocampal and left striatal regions; also, a gradient of decreasing response to emotional faces with age, from 14 to 19 years, in the right parahippocampal region and left insular cortical area. The right insula demonstrated an increasing response to emotional faces with increasing age in the low PLEs group, and a decreasing response over time in the high PLEs group. The change in parahippocampal/amygdala and insula responses during the perception of emotional faces in adolescents with high PLEs between the ages of 14 and 19 suggests a potential ‘aberrant’ neurodevelopmental trajectory for critical limbic areas. Our findings emphasize the role of the frontal and limbic areas in the aetiology of psychotic symptoms, in subjects without the illness phenotype and the confounds introduced by antipsychotic medication.
Subject terms: Cognitive neuroscience, Human behaviour, Diagnostic markers
Introduction
Psychotic-like experiences (PLEs) describe transitory phenomena that, if they persist, can lead to clinically relevant symptoms with functional impairment1. A developmental model of psychosis describes transitory symptoms, such as PLEs and attenuated psychotic symptoms (psychosis proneness) becoming abnormally resilient (persistence) and subsequently clinically relevant (symptoms of clinical psychosis and impairment). This model is in line with the contemporary view that psychotic symptoms are not “all-or-nothing” pathological phenomena but rather fall within a spectrum ranging from normal, transient PLEs to pervasive psychotic symptoms, conceptualised as the continuum model of psychosis2. This view is supported by the high prevalence rates of sub-clinical delusional or hallucinatory experiences in the general population (10% and 30%), which is substantially higher than the prevalence rate of psychotic disorders3. In support of this model, structural brain abnormalities evident in adults with psychosis are also observed in adolescents with psychotic symptoms and free from the confound of medication effects4.
Late adolescence is a critical neurodevelopmental period, flagged by ongoing changes in brain structure and neural circuitry. These changes can be principal for the development of psychosis, as supported by the observation that the typical age of its onset occurs between late adolescence and early adulthood. The development of clinical psychosis can be a lengthy process, and individuals at increased risk, often referred to as the At-Risk-Mental-State (ARMS), can be characterised by using appropriate tools (i.e. the Comprehensive Assessment of the At-Risk Mental State, CAARMS, a structured questionnaire administered by clinicians, aiming to detect a variety of attenuated psychotic symptoms). Though conversion rates widely vary, approximately 20–35% of individuals aged 12–35 years who meet clinical criteria for a psychosis risk syndrome convert to clinical psychosis within two years5. During adolescence, particular epidemiological factors confer an increased risk for the future development of clinical psychosis; as shown by a single and non-replicated longitudinal study, the presence of various degrees of psychotic symptoms at age 11 years and cannabis use by the age of 15 years increases the likelihood of experiencing symptoms of schizophrenia in adulthood6.
PLEs offer a useful, non-clinical phenotype to study the spectrum of psychotic presentations7 with the advantages of a lack of exposure to the effects of both the illness and antipsychotic medication, and the possibility to study larger, non-clinical populations. Consequently, there is scope for the early detection and characterisation of PLEs in adolescence; the Community Assessment of Psychic Experiences Questionnaire (CAPE) can be the tool of choice, as the most widely used community assessment of PLEs8.
Patients with schizophrenia have long been recognised as having deficits in emotional processing, manifested as dysfunction in the domains of emotional expression, emotional experience (including hedonic responses) and emotional recognition (the ability to accurately identify and interpret emotions from other sources, including facial expressions)9; this has been attributed to aberrant information processing within a broader neural circuit, including the prefrontal cortices and the amygdala. A meta-analysis of neuroimaging studies of face processing comparing schizophrenia patients with healthy controls, showed patients demonstrating statistically significant under-recruitment of amygdalae and related regions including the parahippocampal cortex in response to aversive emotional material10; reduced activation was also evident in the right ventrolateral prefrontal cortex (VLPFC) and the right fusiform face area (FFA)11. Aberrant activation of the amygdalae and related regions including the parahippocampal cortex during processing of emotional stimuli was reflected in an inability to appropriately utilise and contextualise social cues. This deficit would naturally lead to the development of inappropriate suspicion, persecutory beliefs, with further impairment of interpersonal functioning12. Indeed, the insular cortices, caudate13 and the right parahippocampal gyrus14 demonstrate attenuated activation during facial emotion processing in patients with schizophrenia.
As PLEs offer a unique opportunity to study of psychosis unobstructed by the confounders of antipsychotic medication, and there is an observed association between schizophrenia and emotion processing, a reasonable step to take is to investigate a similar link between PLEs and emotion processing, employing a relevant neuroimaging task. There are only a few studies using neuroimaging during emotion processing tasks to investigate the neural basis of PLEs. A study of undergraduate students showed high CAPE scorers manifested greater activation in a number of prefrontal regions during reappraisal (reinterpretation of negative pictures); while the amygdala response to negative stimuli was decreased through reappraisal in the low scorers; functional connectivity analysis revealed lower prefrontal-amygdala coupling in high PLEs subjects15. Most recently, a functional Magnetic Resonance Imaging (fMRI) study employing an adolescent sample of subjects with PLEs (n = 27) at age 14 demonstrated increased hippocampus/amygdala/middle temporal gyrus and cerebellar activation during processing of neutral faces relative to subjects with low degree or absence of PLEs16.
The aim of the study was to examine whether PLEs in adolescence are associated with altered activation of frontal and limbic areas of a brain network, which have shown perturbed activation during facial emotion processing in subjects with psychosis. Three hypotheses were evaluated: the presence of elevated PLEs in late adolescence (age 19) will be associated with decreased activation of the amygdala/parahippocampal cortex, and associated network including prefrontal, insular and caudate regions during a facial emotion task15,16; the activation within these areas will differentially vary between high and low PLEs groups over the time between early (age 14) and late (age 19) adolescence; and the presence of increased PLEs in late adolescence will be associated with deficits in behavioural performance during risky and affective decision-making tasks17.
Methods
Participants and settings
As discussed previously (see acknowledgments), neuroimaging and clinical data of healthy adolescents were obtained from the IMAGEN database, https://imagen-europe.com/ accessed in August 2018. The IMAGEN study received ethical approval by the ethics research committees of the academic centres at which the study was conducted (London, Nottingham, United Kingdom and Dublin, Ireland; Paris, France and Berlin, Hamburg, Mannheim and Dresden, Germany). Ethical approval was obtained from the local ethics committee at each study site (London: Institute of Psychiatry; Nottingham: University of Nottingham; Dublin: Trinity College Dublin; Paris: National Institute of Health and medical Research (INSERM); Berlin: Charité University Berlin; Hamburg: University Medical Center Hamburg-Eppendorf; Mannheim: Central Institute of Mental Health Mannheim; Dresden: Technical University Dresden (TUD)).
All research methods were carried out in accordance with local guidelines and regulations. All adult participants provided written informed consent; minors provided oral informed consent and written informed consent was obtained by their parents or legal guardians. For further information please see our guidelines using the following link: www.nature.com/srep/policies/index.html#experimental-subjects.
The present study was conducted from January 1, 2016 to January 1, 2017, from anonymised data. Our study involved no information, either data or images, that could lead to the identification of participants. No such information is presented in the present publication. Access to IMAGEN database for the conduction of the present study did not require a separate informed consent; a waiver was applied owing to fully anonymised data. We used data collected at age 14 and 19. A total of 1,434 adolescents were initially selected based on quality controls and completeness of their behavioural and neuroimaging datasets. Two subgroups were assessed at ages 14 and 19 years. Those who scored at either high or low PLEs (based on the upper and lower deciles) on the CAPE-42 items instrument (see below) at age 19 were included in the analysis. The epidemiological features of our sample are described in Table 1, the exclusion criteria are listed in the supplement. Our sample included healthy individuals and the presence of major medical, neurological, developmental or psychiatric conditions, as well as pregnancy complications, was exclusionary; similarly, participants who developed a major psychiatric disorder during the study, were excluded from further follow-up.
Table 1.
CAPE TOTAL HIGH 10% (n = 149) | CAPE TOTAL LOW 10% (n = 149) | |||||
---|---|---|---|---|---|---|
Mean | SE | SD | Mean | SE | SD | |
Gender (Male %) | 33.60% | 56.40% | ||||
Handedness (R %) | 85.90% | 82.60% | ||||
Age BL (y) | 14.47 | 0.03 | 0.39 | 14.43 | 0.03 | 0.38 |
Age FU (y) | 19.02 | 0.06 | 0.76 | 18.98 | 0.06 | 0.74 |
Wisc Verbal Score (BL) | 111.15 | 1.32 | 15.66 | 106.72 | 1.27 | 15.24 |
Wisc Performance Score (BL) | 108.49 | 1.33 | 15.79 | 105.2 | 1.20 | 14.42 |
Adrs Total Score (FU) | 15.89 | 0.24 | 2.96 | 19.7 | 0.06 | 0.72 |
Audit Total Score (FU) | 7.5 | 0.44 | 5.34 | 5.26 | 0.32 | 3.87 |
Dast Cannabis Total Score (FU) | 1.59 | 0.21 | 2.52 | 0.54 | 0.08 | 1.02 |
Cape Total Score (FU) | 111.64 | 1.74 | 21.26 | 9.54 | 0.39 | 4.75 |
Cape Positive Symptoms Score (FU) | 33.09 | 1.27 | 15.48 | 3.23 | 0.24 | 2.98 |
Cape Bizarre Delusions Score (FU) | 13.17 | 0.97 | 11.82 | 0.37 | 0.09 | 1.09 |
Cape Social Delusions Score (FU) | 19.91 | 0.54 | 6.57 | 2.87 | 0.21 | 2.61 |
Cape Negative Symptoms Score (FU) | 46.37 | 0.93 | 11.37 | 2.22 | 0.21 | 2.61 |
Cape Depressive Symptoms Score (FU) | 32.18 | 0.61 | 7.49 | 4.09 | 0.21 | 2.54 |
WISC: Wechsler Intelligence Batter for Children38; the average score is 100; higher scores indicate higher than average intelligence and lower scores indicate lower than average intelligence.
ADRS: Adolescent Depression Rating Scale39; scores range from 0 to 60; higher scores indicate higher levels of adolescent depression.
AUDIT: Alcohol Use Disorders Identification Test40; scores range from 0 to 40; higher scores indicate greater levels of alcohol abuse.
DAST: Drug Abuse Screening Test41; scores range from 0 to 10; higher scores indicate greater levels of cannabis abuse.
CAPE: Community Assessment of Psychic Experiences Questionnaire7; scores range from 0 to 294; higher scores indicated elevated presence of attenuated psychotic symptoms.
SD: Standard Deviation; SE: Standard Error.
Measures
The CAPE-42 questionnaire7 was used as a measure of PLEs in our adolescent population at age 19 years. Based on the PDI-21(21-items Peters et al. Delusional Inventory)18 and PDI-40 (40-items Peters et al. Delusional Inventory)19, the CAPE-42 is a self-administered tool, including 42 items that are grouped in three dimensions: positive, negative, and depressive. Each item is scored for frequency and severity in a scale from 0 to 7; total scores range from 0 to 294. Higher scores indicate higher burden of symptoms found in the psychosis prodrome.
The Cambridge Neuropsychological Test Automated Battery (CANTAB) includes highly sensitive, precise and objective measures of cognitive function20. Our study focused on the Affective Go-NoGo Task (AGN), providing an assessment of the information processing biases for positive and negative stimuli; this task was chosen as a proxy for ‘hot’ cognition (cognitive functions mostly influenced by the individual’s emotional state), as related to the inhibitory/affective function of frontal and limbic areas of the brain. Participants completed the AGN at both age 14 and 19.
In the Face Task (FT) volunteers are asked to passively watch short black and white video clips presenting faces with neutral and angry expressions as well as control non-biological motion stimuli (concentric circles)21. In our study, we focused on the contrasts angry faces vs control stimuli, angry faces vs neutral faces and angry and neutral faces vs control stimuli, as previously described in the IMAGEN literature22,23. Additional literature identified common variance in response to ambiguous facial expression23. Participants completed the FT at both age 14 and 19.
Details of the CAPE-42, CANTAB AGN and FT are described in the supplement.
Stratification of the sample
We defined two subgroups with high or low PLEs, based on total CAPE-42 scores at age 19 years. Because the CAPE-42 total scores did not follow a normal distribution (eFig. 1), we selected participants with high and low scores using the upper and lower deciles. This distinction resulted in 149 adolescents in the high PLEs group and 149 in the low PLEs group. The high group CAPE-42 total score ranged from 91 to 182, corresponding to a standardised (per item) score range of 2·17 to 4·33. Cut-off levels in the region of 2.0 per CAPE-42 item (transposed to match our rating conventions) provide adequate positive predictive value for transition to psychosis24; based on our stratification, this level formed the lower bound of the high PLEs group. The two groups were equivalent for handedness, age and IQ.
fMRI acquisition and analysis
The standardised scanning parameters were selected to be compatible and implementable at all sites and scanners. A full description of the scanning protocols, cross-site standardization and quality checks, and pre-processing of resulting data are provided elsewhere25 and also listed in the supplement.
First-level analysis
Three within-subject contrasts reflecting core face emotional processing, was selected for investigation:
[Angry Faces] − [Control Stimuli];
[Angry Faces] − [Neutral Faces];
[Angry + Neutral Faces] − [Control Stimuli].
Control stimuli were non-facial motion stimuli. The contrasts were designed to separate emotional salient facial stimuli from neutral stimuli, and facial from non-facial stimuli, providing maximum differentiation, and were previously used in the IMAGEN population22. The fMRI scans were conducted at ages 14 and 19 years and were analysed using SPM12 (Statistical Parametric Mapping; http://www.fil.ion.ucl.ac.uk/spm Wellcome Trust Centre for Neuroimaging).
Second-level analysis
Preliminary whole-brain analysis revealed no statistically significant correlations between brain activation levels and CAPE-42 total scores in the overall sample of 1,434 adolescents; as a consequence, further analysis focused only on high and low CAPE-42 scorers and task-related regions of interests for the chosen contrast were collapsed across the high and low groups. This approach provided an unbiased estimate of the activation, as the group average positive/negative mask is orthogonal to high > low or low > high masks and is also supported by the literature on functional localizers26. As multiple ROIs resulted in this step, we performed a retrospective Bonferoni correction of the statistical significance threshold, at a contrast level.
We have extracted mean brain activation contrasts (parameter estimates) for all the identified ROIs, at the ages of 14 and 19. In a factorial analysis (Mixed Model 2-way ANOVA), the main effects of time, group and the interaction of time x group on brain activation levels were examined by employing a 2-way analysis of variance, with group as fixed and subject as random effects. Any main effects or interactions were further examined by post hoc paired and unpaired, 2-tailed t tests, with P < 0·05 as the statistically significant threshold. Additional exploratory analyses are also reported.
Results
Two groups of adolescents (high PLEs, n = 149, 50 [33·6%] male; low PLEs, n = 149, 84 [56·4%] male) were compared at ages 14 and 19 years. The two groups were equivalent for handedness, age and IQ.
Results of fMRI analysis
Five regions of interest (ROIs) based on previous studies of facial emotion processing in psychosis and UHR for psychosis15,16 were used; the prefrontal cortices, the temporal cortices, the limbic brain and the striatum were included for factorial analysis. The ROIs Montreal Neurological Institute (MNI) space coordinates were: left insular cortex (−36 11 −5), right insular cortex (42, 8, −14), left caudate body (−12, 5, 10), right superior frontal gyrus (6, 65, 31) and right parahippocampal gyrus/including the amygdala (33, −46, −5). One ROI (−36 11 −5) arose from the angry vs neutral faces contrast, while all remaining ROIs activated in the angry faces vs control stimuli contrast; no relevant activations were noted in the angry plus neutral faces vs control stimuli contrast. Only the right insular cortex ROI (42, 8, −14) did not survive a retrospective Bonferoni correction for multiple testing (p = 0.016 given a revised threshold at 0.01). Figure 1 provides a visual representation of the ROIs; eTable 1 in the Supplement reports the results of the functional ROI brain analysis.
Left insular cortex (−36 11 −5)
There was a significant main effect of group (F1,227 = 4·5, P = 0·03), which was driven by decreased activation in the high PLEs group compared to the low PLEs group at age 14 (t = −2·1, P = 0·04). There was also a significant main effect of time (F1,227 = 64·7, P < 0·0001) which was driven by a decrease in activation from age 14 to age 19 years, (high group t = 4·9 P < 0·0001; low group t = 6·4, P < 0·0001). Figure 2, Table 2, eTable 2, eTable 3.
Table 2.
Type III Sum of Squares | df | Mean Square | F | Sig. | r | |
---|---|---|---|---|---|---|
Right Insular ROI [42 8 −14] Brain Activation | ||||||
TIME | 0.002 | 1 | 0.002 | 0.002 | 0.97* | 0.003 |
GROUP | 3.92 | 1 | 3.92 | 19.52 | <0.0001 | 0.28 |
TIME * GROUP | 8.23 | 1 | 8.23 | 7.46 | 0.01 | 0.18 |
Error (TIME) | 253.77 | 230 | 1.10 | |||
Error (GROUP) | 46.2 | 230 | 0.20 | |||
Left Insular ROI [−36 11 −5] Brain Activation | ||||||
TIME | 13.99 | 1 | 13.99 | 64.75 | <0.0001 | 0.47 |
GROUP | 1.11 | 1 | 1.11 | 4.56 | 0.034 | 0.14 |
TIME * GROUP | 0.21 | 1 | 0.21 | 0.96 | 0.33* | 0.06 |
Error (TIME) | 49.05 | 227 | 0.22 | |||
Error (GROUP) | 55.46 | 227 | 0.24 | |||
Left Caudate ROI [−12 5 10] Brain Activation | ||||||
TIME | 0.39 | 1 | 0.33 | 1.71 | 0.19* | 0.09 |
GROUP | 0.18 | 1 | 0.18 | 3.04 | 0.08* | 0.14 |
TIME * GROUP | 0.73 | 1 | 0.73 | 3.20 | 0.07* | 0.12 |
Error (TIME) | 52.78 | 230 | 0.23 | |||
Error (GROUP) | 13.99 | 230 | 0.06 | |||
Right Prefrontal ROI [6 65 31] Brain Activation | ||||||
TIME | 4.83 | 1 | 4.83 | 6.98 | 0.01 | 0.17 |
GROUP | 1.15 | 1 | 1.15 | 4.21 | 0.04 | 0.13 |
TIME * GROUP | 2.19 | 1 | 2.15 | 3.17 | 0.08* | 0.12 |
Error (TIME) | 159.10 | 230 | 0.69 | |||
Error (GROUP) | 62.56 | 230 | 0.27 | |||
Right Parahippocampal ROI [33 −46 −5] Brain Activation | ||||||
TIME | 3.17 | 1 | 3.17 | 12.11 | 0.001 | 0.22 |
GROUP | 0.45 | 1 | 0.45 | 4.90 | 0.03 | 0.14 |
TIME * GROUP | 0.72 | 1 | 0.72 | 2.761 | 0.1* | 0.11 |
Error (TIME) | 60.25 | 230 | 0.26 | |||
Error (GROUP) | 21.36 | 230 | 0.09 |
Abbreviations df: degrees of Freedom; F: F-ratio; (*): not statistically significant at a p = 0.05 level; r: Pearson’s correlation coefficient.
Right insular cortex (42, 8, −14)
There was a significant interaction effect of group*time (F1, 230 = 7·4, P = 0·01) driven by a differential change in the groups’ brain activation from age 14 to age 19, showing a relative (non-significant) decrease in the high PLEs group, and an increase in the low PLEs group (t = −2·0, P = 0·04). Additional exploratory post hoc analysis exhibited increased activation of the high PLEs group compared to the low PLEs group at age 14 (t = 5·2, P < 0·0001). Figure 2, Table 2, eTable 2, eTable 3.
Left caudate body (−12, 5, 10)
There were no significant effects of group*time, nor any main effects of group or time. Additional exploratory analysis exhibited decreased activation in the high PLEs group compared to the low PLEs group at age 19 (t = −2·588, P = 0·01). Figure 2, Table 2, eTable 2, eTable 3.
Right superior frontal gyrus (6, 65, 31)
There was a main effect of group (F1, 230 = 4·2, P = 0·04), which was driven by decreased activation in the high PLEs group compared to the low PLEs group at age 19 (t = −2·3, P = 0·02). There was also a main effect of time (F1, 230 = 6·9, P = 0·01), which was driven by an increase in activation from age 14 to age 19 years, post hoc analyses showed this was significant only for the low PLEs group (t = −3·3, P = 0·001). Figure 2, Table 2, eTable 2, eTable 3.
Right Parahippocampal Gyrus/Amygdala (33, −46, −5)
There was a main effect of group (F1, 230 = 4·9, P = 0·03), which was driven by increased activation in the low PLEs group compared to the high PLEs group at age 19 (t = −2·8, p = 0·005). There was a main effect of time (F1, 230 = 12·1, P = 0·001), which was driven by a decrease in activation from age 14 to age 19 years, post hoc analyses showed this was significant only the high PLEs group (t = 4·3, P < 0·0001). Figure 2, Table 2, eTable 2, eTable 3.
Results CANTAB measures analysis
There was a main effect of time on AGN Total Omissions for both positive (F1, 159 = 58·8, P < 0·0001] and negative stimuli (F1, 159 = 50·2, P < 0·0001]; this was driven by a decrease, signifying improved performance, from age 14 to 19, across both the high and low PLE groups (high - AGN positive: t = 4·5, P < 0·0001; AGN negative: t = 3·7, P < 0·001 and low - AGN positive: t = 6·3, P < 0·0001; AGN negative: t = 6·4, P < 0·0001). Additional exploratory analysis revealed that the high PLEs group scored lower than the low PLEs group on AGN Total Omissions for both positive and negative stimuli at age 14 years, which indicates a better performance at inhibitory processing in the high versus the low PLEs group. Table 3, eTable 4, eTable 5.
Table 3.
Factorial Analysis, Mixed Model 2-way ANOVA | |||||||
---|---|---|---|---|---|---|---|
CANTAB Variable | Factors | Type III Sum of Squares | df, dfR | Mean Square | F value | P value | r value |
AGN Total Omissions Negative | GROUP | 73.82 | 1, 16 | 73.82 | 2.5 | 0.12* | 0.12 |
TIME | 3006.21 | 1, 16 | 3006.21 | 50.24 | <0.0001 | 0.49 | |
GROUP * TIME | 144.6 | 1, 16 | 144.6 | 2.42 | 0.12* | 0.12 | |
AGN Total Omissions Positive | GROUP | 77.1 | 1, 16 | 77.1 | 2.92 | 0.1* | 0.13 |
TIME | 3423.72 | 1, 16 | 3423.72 | 58.78 | <0.0001 | 0.52 | |
GROUP * TIME | 77.33 | 1, 16 | 77.33 | 1.33 | 0.25* | 0.09 |
Abbreviations,
AGN Total Omissions Negative/Positive: Affective Go-NoGo Task, total number of missed responses to targets in the blocks specified by the value of target type (negative, positive); CANTAB: Cambridge Neuropsychological Test Automated Battery;
df: degrees of Freedom; dfR: df(Error) F: F-ratio; r: Pearson’s correlation coefficient: (*): not statistically significant at a P = 0.05 level.
Correlations between CANTAB measures and brain activation levels
At age 14, brain activation levels at the right insular region (42, 8, −14) showed negative correlation with AGN Total Omissions for both positive and negative stimuli (AGN positive: r = −0·181, P = 0·01; AGN negative: r = −0·219, P = 0·002). At age 19, brain activation levels at the same region showed positive correlation with AGN Total Omissions for negative stimuli (r = 0·163, P = 0·03).
Discussion
The main findings of our analysis are summarised in Table 4. Overall, the group with lower CAPE scores showed increased activation, compared to the group with higher CAPE scores in the left insula (age 14), the left caudate, the right prefrontal and the right parahippocampal areas (age 19); the high CAPE score group exceeded the low CAPE score group in activation only in the right insula (age 14).
Table 4.
Brain ROI/CANTAB measure | Exploratory Analysis (significant effects) | Factorial Analysis | ||||
---|---|---|---|---|---|---|
Age 14 | Change between 14 and 19 | Age 19 | ||||
Brain ROIs | Left Insular Cortex [−36 11 −5] | Group, Time | L > H | H ↓ | L ↓ | |
Right Insular Cortex [42 8 −14] | Group, Group*Time | H > L | H ↓ NS | L ↑ | ||
Left Caudate Body [−12 5 10] | L > H | |||||
Right Superior Frontal Gyrus [6 65 31] | Group, Time | H ↑ NS | L ↑ | L > H | ||
Right Limbic Cortex [33 −46 −5] | Group, Time | H ↓ | L ↓ NS | L > H | ||
CANTAB measure | AGN Total Omissions, Positive Stimuli | Time | L > H | H ↓ | L ↓ | |
AGN Total Omissions, Negative Stimuli | Time | L > H | H ↓ | L ↓ |
H: High PLEs Group; L: Low PLEs Group;
↑: Increase in brain activation or CANTAB score (statistically significant);
↑ NS: Increase in brain activation or CANTAB score (statistically non-significant);
↓: Decrease in brain activation or CANTAB score (statistically significant);
↓ NS: Decrease in brain activation or CANTAB score (statistically non-significant).
19-year-old subjects with increased CAPE scores, indexing higher PLEs (measured only at age 19), demonstrated attenuated activation of the right superior frontal gyrus, the right parahippocampal gyrus/amygdala and the left caudate, compared to their peers with lower CAPE scores, indexing lower PLEs – when examined using fMRI during a facial emotion perception test. These regions form components of a broader neural circuit responsible for social cognition and behaviour, encompassing the amygdalae, the VMPFC, the cingulate cortex, somatosensory cortices, the fusiform gyrus and the superior temporal sulcus27. Misidentification of facial expressions represent a crucial deficit in this process, and as observed extensively in the schizophrenia literature, can give rise to impaired social interactions and the subsequent elaboration of paranoid and persecutory beliefs. The right parahippocampal gyrus, was also observed to show increased activation in controls, compared to schizophrenia patients, during the perception of fearful faces14. In our study, we noticed increased activation in the right parahippocampal gyrus including foci within the amygdala in the low PLEs group, at the age of 19, during perception of angry faces. These observations provide neuroimaging evidence supporting the extended psychosis phenotype encompassing preclinical and clinical presentations.
While the low PLEs group showed a regular trajectory of increasing activation over time in the right prefrontal and right insular cortices with brain maturation, the high PLEs group demonstrated decreased activation of the right parahippocampal/amygdala and left insular activation over the same time. This normal increase in frontal activation from age 14 to 19 years is thought to reflect a consequence of the increasing prefrontal cortical control evidenced by the routine improvement in behavioural impulsivity measures to affective stimuli assessed by the Affective Go-NoGo task. Besides, lack of change (or more precisely, a non-significant decrease) in the right insular activation for the high PLEs group between the ages of 14 and 19 results in a ‘normalisation’ of an overactivation at age 14, as the low PLEs group demonstrates a significant increase in right insular activation between the two timepoints. Our longitudinal analysis confirmed that in the high PLEs group, brain activation of a parahippocampal area including foci within the amygdala showed an attenuation between the ages of 14 and 19; the same area also demonstrated significantly decreased activation in the low PLEs group, at the age of 19. This variation could potentially underpin an ‘aberrant’ developmental process, leading to under-recruitment of critical limbic areas during perception of angry faces, introducing a risk for the future emergence of psychosis. Between the ages of 14 and 19, the high PLEs group compared to the low PLEs group showed no significant change in activation of the prefrontal cortex [6 65 31]; the same area remained under-active at the age of 19 in the high PLEs group, which could represent a residual deficit in frontal activation.
Hypoactivation in frontal areas might represent a trait (pattern of brain activation which persist along various timepoints) in the development of psychosis, as it appears in all phases of the continuum, from preclinical to schizophrenia. Frontal hypoactivation or ‘hypo-frontality’ has been extensively researched in schizophrenia, in relation to a variety of behaviours, including motivation, executive functions and psychotic symptomatology28. Another position is that during working memory tasks, patients with schizophrenia can either recruit more extended prefrontal resources, or fail to sustain recruitment of adequate prefrontal areas, compared to controls, which eventually results in poorer behavioural outcomes29. Functional dysconnectivity of fronto-striatal circuitry may represent a risk phenotype for psychosis. First-episode psychosis is associated with pronounced dysregulation of cortico-striatal systems, characterized most prominently by hypo-connectivity of dorsal and hyper-connectivity of ventral fronto-striatal circuits30. A meta-analysis of neurofunctional correlates of vulnerability to psychosis revealed hypoactivation of DLPFC and VLPFC as the most common finding in Ultra-High Risk (UHR) and First-Episode Psychosis (FEP) populations31. Our cross-sectional results indeed revealed hypoactivation of prefrontal [6 65 31] and striatal [−12 5 10] regions in the high PLEs group at age 19, a finding consistent with perturbed fronto-striatal connectivity.
Aberrant activation of the amygdala during a face recognition is probably one of neuroimaging hallmarks of psychosis. In our study, we identified a large cluster centred in the right parahippocampal gyrus, including the amygdalae, hippocampal, and parahippocampal areas, which demonstrated a peak activation at a right parahippocampal region, [33–46], which demonstrated significantly lower activation for the high PLEs group at the age of 19. A study employing a similar IMAGEN sample as ours revealed that subjects with PLEs demonstrated, among other findings, increased hippocampus/amygdala activation during processing of neutral faces, compared to controls16. It is of note however that the authors of this study employed a smaller sample (n = 27), assessed PLEs at age 14 only and used a less extended questionnaire focusing on perceptual abnormalities and delusional thoughts. It’s relevant that we are assessing a non-clinical group of subjects; thus, our findings are likely to correspond to preliminary brain alterations in a trajectory toward psychosis and predate changes that are later seen more consistently across the psychosis continuum.
Our finding of lower left caudate activation at age 19 in the high PLEs group, is of interest. A similar finding in this region has been reported by another study, showing that UHR individuals had decreased left caudate activation during processing of prosodic voice with negative emotional valence, compared to increases activation in controls32.
The neuropsychological assessment showed a decrease in AGN scores from age 14 to age 19 in both the high and low PLEs groups, which indicates an improvement in affective/inhibitory control. This change corresponds to findings of decreased limbic activation [33, −46, −5] from age 14 to age 19 in the high PLEs group, and increased frontal activation [6, 31, 65] from age 14 to age 19 in the low PLEs group. Knowing that processing of emotional material is largely mediated by limbic areas of the brain, while the frontal lobes can exert a top-down inhibitory control in subcortical areas, here we detect a dual pattern of achieving improved emotional processing, by either increasing ‘higher’ cortical control (high PLEs group) or decreasing ‘lower’ limbic activation (low PLEs group). Hyperactivation in the limbic system can account for an inability to regulate emotions, and as discussed earlier, emotion regulation difficulties can lie at the core of vulnerability to psychosis15.
Interestingly, the high PLEs group exhibited a lower rate of omissions in the AGN task, indexing increased affective/inhibitory control, compared to the low PLEs group at age 14. This observation cannot be accounted by the limited corresponding findings of increased right insular activation [42 8 −14] and decreased left insular activation [−36 11 −5] in the same group at the same age; neither can be interpreted within the boundaries of the continuum model of psychosis. However, similar inconsistencies between neuroimaging findings and cognitive-behavioural measures point towards the differences in sensitivity of the two approaches to detect an underlying brain process33.
Limitations
There is a number of limitations in our study. Firstly, we selected CAPE upper and lower deciles to stratify our sample, as these correspond to cut-off levels roughly equivalent to those associated with psychosis proneness in literature (detailed in the section describing the stratification of our sample). The decision to dichotomize our population was mainly driven by the need to identify the most/least prone to psychosis individuals in a naturalistic sample, given that CAPE-42 scores were still moderate in it. Despite the limitations introduced by the use of dichotomization, this was deemed as the most appropriate method to explore the extremes of the psychosis continuum in our naturalistic sample. Nevertheless, we eventually ended up with a high PLEs group having a still low average total score of 112, considering the full potential range of scoring (0–294). In addition, as we stratified our sample retrospectively, based on CAPE-42 scores at age 19 year, and in light of the absence of available scores at age 14 years or intermediate ages, it was impossible to observe the evolution of PLEs between the two timepoints. We have rather arbitrarily viewed the high-PLEs phenotype as a representative for the prodrome for psychosis; however, PLEs can have multiple clinical outcomes, thus leading to a variety of psychopathologies, other than florid psychosis or can also be associated with non-clinical phenotypes as manifested by a mean lifetime prevalence of>5% of psychotic experiences in the general population34. Obviously, the lack of transition to psychosis data restricts the use of our high PLEs group as a measure of the UHR population. There was a greater representation of males in our low vs high PLEs groups; despite male predominance being a common epidemiological finding in this clinical field35, this may impede the generalisability of our results. Moreover, we did not control for gray matter volumetric changes.
In our study we focused on contrasts involving angry faces aiming at emotional aspects of faces’ processing. It would be of interest for future studies to analyse contrasts allowing the detection differences in baseline activation (i.e. neutral faces vs control stimuli) which can be suggestive of an aberrant salience processing36.
Conclusions
In a previous study from the same IMAGEN sample, we provided evidence for a consistent increase in prefrontal activation during reward feedback, in the high PLEs group, between the ages of 14 and 19, which was attributed to a compensatory cognitive control mechanism37. The current study revealed functional alterations in parahippocampal/amygdala and insula responses during the perception of emotional faces in adolescents with high PLEs between the ages of 14 and 19 suggests a potential ‘aberrant’ neurodevelopmental trajectory for critical limbic areas. The two studies complement each other, while employing two different cognitive paradigms to examine the neural basis of PLEs in adolescence. Our findings emphasize the role of the frontal and limbic areas in the aetiology of psychotic symptoms in line with a continuum model, in a sample of subjects without the illness phenotype and the confounds introduced by antipsychotic medication.
Supplementary information
Acknowledgements
We would like to thank all members of the IMAGEN consortium for their contribution in the acquisition and analysis of all IMAGEN data. The present study employed the same sample and methodology presented in a recently published study of our team in JAMA Psychiatry37. Consequently, there is inevitable overlap between the JAMA article and various parts of this manuscript, especially in the methods’ and limitations’ sections. This work received support from the following sources: the European Union-funded FP6 Integrated Project IMAGEN (Reinforcement-related behaviour in normal brain function and psychopathology) (LSHM-CT- 2007-037286), the Horizon 2020 funded European Research Council Advanced Grant ‘STRATIFY’ (Brain network based stratification of reinforcement-related disorders) (695313), ERANID (Understanding the Interplay between Cultural, Biological and Subjective Factors in Drug Use Pathways) (PR-ST-0416-10004), BRIDGET (JPND: BRain Imaging, cognition Dementia, and next generation GEnomics) (MR/N027558/1), the FP7 projects IMAGEMEND(602450; IMAging GEnetics for MENtal Disorders), and MATRICS (603016), the Innovative Medicine Initiative Project EU-AIMS (115300-2), the Medical Research Council Grant ‘c-VEDA’ (Consortium on Vulnerability to Externalizing Disorders and Addictions) (MR/N000390/1), the Swedish Research Council FORMAS, the Medical Research Council, the National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley NHS Foundation Trust, and King’s College London, the Bundesministeriumfür Bildung und Forschung (BMBF grants 01GS08152; 01EV0711; eMED SysAlc01ZX1311A; Forschungsnetz AERIAL), the Deutsche Forschungsgemeinschaft (DFG grants SM 80/7-1, SM 80/7-2, SFB 940/1, NE 1383/14-1). Further support was provided by grants from: ANR (project AF12-NEUR0008-01 - WM2NA, and ANR-12-SAMA-0004), the Fondation de France, the Fondation pour la Recherche Médicale, the Mission Interministérielle de Lutte-contre-les-Drogues-et-les-Conduites-Addictives (MILDECA), the Fondation pour la Recherche Médicale (DPA20140629802), the Fondation de l’Avenir, Paris Sud University IDEX 2012; the National Institutes of Health, Science Foundation Ireland (16/ERCD/3797), U.S.A. (Axon, Testosterone and Mental Health during Adolescence; RO1 MH085772-01A1), and by NIH Consortium grant U54 EB020403, supported by a cross-NIH alliance that funds Big Data to Knowledge Centres of Excellence. This paper represents independent research part-funded by the National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care. All funders and sponsors had no role in the design and conduct of the study: collection, management analysis, and interpretation of the data; preparation review and approval of the manuscript; and decision to submit the manuscript for publication.
Author contributions
E.P. had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. E.P., E.M., D.W.J., P.M., C.B. and S.S. drafted the manuscript. T.B., A.L.W.B., C.B., E.B.Q., S.D., H.F., A.G., H.G., P.S., P.G., A.H., B.I., M.L.P.M., E.A., F.N., D.P.O., T.P., L.P., S.M., J.H.F., M.N.S., H.W., R.W., G.S. contributed to acquisition, analysis and interpretation of data and provided critical revision of the manuscript, for important intellectual content.
Competing interests
Dr. Evangelos Papanastasiou was supported by an NIHR BRC (National Institute for Health Research, Biomedical Research Council) Clinical Disorder Pilot Funding Award (2012–2013), and an NIHR CLAHRC (Collaboration for Leadership in Applied Health Research and Care) South London fee support award (2015–2016). He was an employee of Mundipharma Research and Lundbeck. Dr. Dan W. Joyce is supported by the NIHR Oxford Health Biomedical Research Centre (grant BRC-1215-20005). Prof. Tobias Banaschewski served in a paid advisory or consultancy role for Actelion, Hexal Pharma, Lilly, Lundbeck, Medice, Novartis, Shire. He received conference support or speaker’s fee by Lilly, Medice, Novartis, and Shire. He has been involved in clinical trials conducted by Shire & Viforpharma. He received royalties from Hogrefe, Kohlhammer, CIP Medien, Oxford University Press. The present work is unrelated to the above grants and relationships. Dr. Henrik Walter received a speaker honorarium from Servier (2014). Prof. Sukhwinder S. Shergill is supported by a European Research Council (ERC) Consolidator Award and by the NIHR South London and Maudsley Biomedical Research Centre (BRC). The other authors report no biomedical financial interests or potential conflicts of interest.
Footnotes
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
is available for this paper at 10.1038/s41598-020-62026-7.
References
- 1.Van OJ, Linscott R, Myin-Germeys I, Delespaul P, Krabbendam L. A systematic review and meta-analysis of the psychosis continuum: evidence for a psychosis proneness-persistence-impairment model of psychotic disorder. Psychol. Med. 2010;39:179–195. doi: 10.1017/S0033291708003814. [DOI] [PubMed] [Google Scholar]
- 2.Nelson B, Fusar-Poli P, Yung AR. Can we detect psychotic-like experiences in the general population? Curr. Pharm. Des. 2012;18:376–385. doi: 10.2174/138161212799316136. [DOI] [PubMed] [Google Scholar]
- 3.Verdoux H, van Os J. Psychotic symptoms in non-clinical populations and the continuum of psychosis. Schizophr. Res. 2002;54:59–65. doi: 10.1016/S0920-9964(01)00352-8. [DOI] [PubMed] [Google Scholar]
- 4.Satterthwaite TD, et al. Structural Brain Abnormalities in Youth with Psychosis Spectrum Symptoms. JAMA Psychiatry. 2016;73:515–524. doi: 10.1001/jamapsychiatry.2015.3463. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Fusar-Poli P, et al. The psychosis high-risk state: a comprehensive state-of-the-art review. JAMA Psychiatry. 2013;70:107–120. doi: 10.1001/jamapsychiatry.2013.269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Arseneault L, et al. Cannabis use in adolescence and risk for adult psychosis: longitudinal prospective study. Brit Med. J. 2002;325:1212–1213. doi: 10.1136/bmj.325.7374.1212. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Kelleher I, Cannon M. Psychotic-like experiences in the general population: characterizing a high-risk group for psychosis. Psychol. Med. 2011;41:1–6. doi: 10.1017/S0033291710001005. [DOI] [PubMed] [Google Scholar]
- 8.Van O, J., Verdoux, H. & Hanssen, M. CAPE42, http://cape42.homestead.com/ (2019)
- 9.Tremeau F. A review of emotion deficits in schizophrenia. Dialogues Clin. Neurosci. 2006;8:59–70. doi: 10.31887/DCNS.2006.8.1/ftremeau. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Anticevic A, et al. Amygdala recruitment in schizophrenia in response to aversive emotional material: a meta-analysis of neuroimaging studies. Schizophr. Bull. 2012;38:608–621. doi: 10.1093/schbul/sbq131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Pinkham AE, Hopfinger JB, Pelphrey KA, Piven J, Penn DL. Neural bases for impaired social cognition in schizophrenia and autism spectrum disorders. Schizophr. Res. 2008;99:164–175. doi: 10.1016/j.schres.2007.10.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Stahl, S. M. Psychosis and Schizophrenia. Stahl’s Essential Psychopharmacology, Neuroscientific Basis and Practical Applications 79–128 (Cambridge University Press, 2013).
- 13.Silverstein SM, et al. Increased fusiform area activation in schizophrenia during processing of spatial frequency-degraded faces, as revealed by fMRI. Psychol. Med. 2012;40:1159–1169. doi: 10.1017/S0033291709991735. [DOI] [PubMed] [Google Scholar]
- 14.Hall J, et al. Overactivation of fear systems to neutral faces in schizophrenia. Biol. Psychiatry. 2008;64:70–73. doi: 10.1016/j.biopsych.2007.12.014. [DOI] [PubMed] [Google Scholar]
- 15.Modinos G, Ormel J, Aleman A. Altered activation and functional connectivity of neural systems supporting cognitive control of emotion in psychosis proneness. Schizophr. Res. 2010;118:88–97. doi: 10.1016/j.schres.2010.01.030. [DOI] [PubMed] [Google Scholar]
- 16.Bourque J, et al. Functional Neuroimaging Predictors of Self-Reported Psychotic Symptoms in Adolescents. Am. J. psychiatry. 2017;174:566–575. doi: 10.1176/appi.ajp.2017.16080897. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Roiser JP, Howes OD, Chaddock CA, Joyce EM, McGuire P. Neural and behavioral correlates of aberrant salience in individuals at risk for psychosis. Schizophr. Bull. 2012;39:1328–1336. doi: 10.1093/schbul/sbs147. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Peters E, Joseph S, Day S, Garety P. Measuring delusional ideation: the 21-item Peters et al. Delusions Inventory (PDI) Schizophr. Bull. 2004;30:1005–1022. doi: 10.1093/oxfordjournals.schbul.a007116. [DOI] [PubMed] [Google Scholar]
- 19.Peters ER, Joseph SA, Garety PA. Measurement of delusional ideation in the normal population: introducing the PDI (Peters et al. Delusions Inventory) Schizophr. Bull. 1999;25:553–576. doi: 10.1093/oxfordjournals.schbul.a033401. [DOI] [PubMed] [Google Scholar]
- 20.Sahakian B, Owen A. Computerized assessment in neuropsychiatry using CANTAB: discussion paper. J. R. Soc. Medicine. 1992;85:399–402. [PMC free article] [PubMed] [Google Scholar]
- 21.Grosbras MH, Paus T. Brain networks involved in viewing angry hands or faces. Cereb. Cortex. 2006;16:1087–1096. doi: 10.1093/cercor/bhj050. [DOI] [PubMed] [Google Scholar]
- 22.Schneider S, et al. Boys do it the right way: Sex-dependent amygdala lateralization during face processing in adolescents. NeuroImage. 2011;56:1847–1853. doi: 10.1016/j.neuroimage.2011.02.019. [DOI] [PubMed] [Google Scholar]
- 23.Wang X, et al. The Hierarchical Structure of the Face Network Revealed by Its Functional Connectivity Pattern. J. Neurosci. 2016;36:890–900. doi: 10.1523/JNEUROSCI.2789-15.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Mossaheb N, et al. The Community Assessment of Psychic Experience (CAPE) questionnaire as a screening-instrument in the detection of individuals at ultra-high risk for psychosis. Schizophr. Res. 2012;141:210–214. doi: 10.1016/j.schres.2012.08.008. [DOI] [PubMed] [Google Scholar]
- 25.Schumann G, et al. The IMAGEN study: reinforcement-related behaviour in normal brain function and psychopathology. Mol. Psychiatry. 2010;15:1128–1139. doi: 10.1038/mp.2010.4. [DOI] [PubMed] [Google Scholar]
- 26.Friston KJ, Rotshtein P, Geng JJ, Sterzer P, Henson RN. A critique of functional localisers. NeuroImage. 2006;30:1077–1087. doi: 10.1016/j.neuroimage.2005.08.012. [DOI] [PubMed] [Google Scholar]
- 27.Adolphs R. The neurobiology of social cognition. Curr. Opin. Neurobiol. 2001;11:231–239. doi: 10.1016/S0959-4388(00)00202-6. [DOI] [PubMed] [Google Scholar]
- 28.Hill K, et al. Hypofrontality in schizophrenia: a meta-analysis of functional imaging studies. Acta Psychiatr. Scand. 2004;110:243–256. doi: 10.1111/j.1600-0447.2004.00376.x. [DOI] [PubMed] [Google Scholar]
- 29.Callicott JH, et al. Complexity of prefrontal cortical dysfunction in schizophrenia: more than up or down. Am. J. Psychiatry. 2003;160:2209–2215. doi: 10.1176/appi.ajp.160.12.2209. [DOI] [PubMed] [Google Scholar]
- 30.Fornito A, et al. Functional dysconnectivity of corticostriatal circuitry as a risk phenotype for psychosis. JAMA Psychiatry. 2013;70:1143–1151. doi: 10.1001/jamapsychiatry.2013.1976. [DOI] [PubMed] [Google Scholar]
- 31.Fusar-Poli P, et al. Neurofunctional correlates of vulnerability to psychosis: a systematic review and meta-analysis. Neurosci. Biobehav. Rev. 2007;31:465–484. doi: 10.1016/j.neubiorev.2006.11.006. [DOI] [PubMed] [Google Scholar]
- 32.Tseng H-H, et al. Corticolimbic dysfunction during facial and prosodic emotional recognition in first-episode psychosis patients and individuals at ultra-high risk. NeuroImage: Clinical. 2016;12:645–654. doi: 10.1016/j.nicl.2016.09.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Wilkinson D, Halligan P. The relevance of behavioural measures for functional-imaging studies of cognition. Nat. Rev. Neurosci. 2004;5(1):67–73. doi: 10.1038/nrn1302. [DOI] [PubMed] [Google Scholar]
- 34.McGrath JJ, et al. Psychotic Experiences in the General Population: A Cross-National Analysis Based on 31,261 Respondents From 18 Countries. JAMA Psychiatry. 2015;72:697–705. doi: 10.1001/jamapsychiatry.2015.0575. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Aleman A, Kahn RS, Selten JP. Sex differences in the risk of schizophrenia: evidence from meta-analysis. Arch. Gen. Psychiat. 2003;60:565–571. doi: 10.1001/archpsyc.60.6.565. [DOI] [PubMed] [Google Scholar]
- 36.Modinos G, et al. Neural correlates of aberrant emotional salience predict psychotic symptoms and global functioning in high-risk and first-episode psychosis. Soc. Cogn. Affect. Neurosci. 2015;10:1429–1436. doi: 10.1093/scan/nsv035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Papanastasiou E, et al. Examination of the Neural Basis of Psychoticlike Experiences in Adolescence During Reward Processing. JAMA. Psychiatry. 2018;75:1043–1051. doi: 10.1001/jamapsychiatry.2018.1973. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Wechsler, D. Wechsler Intelligence Scale for Children, Fifth Edition, https://www.pearsonassessments.com/store/usassessments/en/Store/Professional-Assessments/Cognition-%26-Neuro/Gifted-%26-Talented/Wechsler-Intelligence-Scale-for-Children-%7C-Fifth-Edition-/p/100000771.html?tab=product-details# (2014)
- 39.Revah-Levy A, Birmaher B, Gasquet I, Falissard B. The Adolescent Depression Rating Scale (ADRS): a validation study. BMC Psychiatry. 2007;7:1–10. doi: 10.1186/1471-244X-7-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Bohn MJ, Babor TF, Kranzler HR. The Alcohol Use Disorders Identification Test (AUDIT): validation of a screening instrument for use in medical settings. J. Stud. alcohol. 1995;56:423–432. doi: 10.15288/jsa.1995.56.423. [DOI] [PubMed] [Google Scholar]
- 41.Skinner HA. The drug abuse screening test. Addictive behaviors. 1982;7:363–371. doi: 10.1016/0306-4603(82)90005-3. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.