Skip to main content
Developmental Cognitive Neuroscience logoLink to Developmental Cognitive Neuroscience
. 2013 Dec 18;8:18–27. doi: 10.1016/j.dcn.2013.12.003

Girls’ challenging social experiences in early adolescence predict neural response to rewards and depressive symptoms

Melynda D Casement a, Amanda E Guyer b, Alison E Hipwell a, Rose L McAloon a, Amy M Hoffmann a, Kathryn E Keenan c, Erika E Forbes a,d,e,*
PMCID: PMC3960334  NIHMSID: NIHMS551158  PMID: 24397999

Highlights

  • Adolescent psychosocial stress prospectively predicted neural response to potential rewards.

  • Low parental warmth predicted increased reward response in the mPFC, striatum, and amygdala.

  • Peer victimization predicted decreased reward response in the mPFC.

  • Stress-related neural response to potential rewards was correlated with depressive symptoms.

  • Results support reward-focused neurodevelopmental models of depression in girls.

Abbreviations: BA, Brodmann Area; BOLD, blood-oxygen-level-dependent; EPI, echo planar imaging; fMRI, functional magnetic resonance imaging; LN, natural log transformation; mPFC, medial prefrontal cortex; MNI, Montreal Neurological Institute; OFC, orbitofrontal cortex; PGS, Pittsburgh Girls Study; PGS-E, Pittsburgh Girls Study-Emotions Substudy; ROI, region of interest; TE, echo time; TR, repetition time

Keywords: Parental warmth, Peer victimization, Reward, fMRI, Adolescence, Depression

Abstract

Developmental models of psychopathology posit that exposure to social stressors may confer risk for depression in adolescent girls by disrupting neural reward circuitry. The current study tested this hypothesis by examining the relationship between early adolescent social stressors and later neural reward processing and depressive symptoms. Participants were 120 girls from an ongoing longitudinal study of precursors to depression across adolescent development. Low parental warmth, peer victimization, and depressive symptoms were assessed when the girls were 11 and 12 years old, and participants completed a monetary reward guessing fMRI task and assessment of depressive symptoms at age 16. Results indicate that low parental warmth was associated with increased response to potential rewards in the medial prefrontal cortex (mPFC), striatum, and amygdala, whereas peer victimization was associated with decreased response to potential rewards in the mPFC. Furthermore, concurrent depressive symptoms were associated with increased reward anticipation response in mPFC and striatal regions that were also associated with early adolescent psychosocial stressors, with mPFC and striatal response mediating the association between social stressors and depressive symptoms. These findings are consistent with developmental models that emphasize the adverse impact of early psychosocial stressors on neural reward processing and risk for depression in adolescence.

1. Introduction

Depression is a leading cause of global disease burden with a 16.6% lifetime prevalence (Kessler et al., 2005, World Health Organization, 2008). Although the prevalence of depression during childhood is less than 3% (Fleming and Offord, 1990), rates of depression increase sharply during adolescence with the first onset occurring between the ages of 12 and 19 years in 20% of individuals who experience depression during their lifetimes (Kessler et al., 2005). Rates of depression are particularly high in adolescent girls (cumulative prevalence of 20.8%), who are twice as likely to become depressed compared to adolescent boys (Kessler, 1993). Because depression is a recurrent disorder, experiencing depression for the first time in childhood or adolescence, compared with onset later in life, results in greater lifetime depression-related disability (Kovacs, 1997). Thus, studies that examine risk factors for the development of depression in adolescent girls are particularly relevant for prevention and intervention efforts.

Parent and peer relationships are both important to adolescent development, and stressors in either social domain can increase risk for psychopathology. There is a large body of research documenting the impact that parenting behaviors, such as emotional responsiveness and warmth, have on children's emotional development broadly (Eisenberg et al., 1998, Morris et al., 2007), and on depressive symptoms specifically (McLeod et al., 2007). Additional data from longitudinal studies indicate that low parental warmth increases risk for depression in children and adolescents (Ge et al., 1994, Ge et al., 1996, Hipwell et al., 2008) and decreases resilience in adolescents with a high genetic and socioeconomic risk for the disorder (Brennan et al., 2003, Masten et al., 1999). Early adolescence in particular is characterized by decreases in parent–child relationship quality (Loeber et al., 2000, McGue et al., 2005), which could contribute to the higher risk for psychopathology during this developmental period relative to childhood.

Although parents continue to be important sources of social support and play a role in adolescents’ mental health, peer relationships become increasingly important as adolescents individuate from parents and form social hierarchies with peers. Stressful interactions with peers, including emotional exclusion and aggression, are particularly difficult experiences for adolescents (Nelson et al., 2005, O’Brien and Bierman, 1988), and approximately 50% of sixth and seventh graders experience these forms of peer victimization (Wang et al., 2009). Peer victimization is also associated with increased risk for depression. A meta-analysis of cross-sectional studies indicated that peer victimization during childhood or adolescence was moderately associated with depression, and had a stronger relationship with depression than other negative psychosocial outcomes such as anxiety (Hawker and Boulton, 2000). Peer victimization also predicted later depressive symptoms in several longitudinal studies of children and adolescents (Keenan et al., 2010b, Sweeting et al., 2006, Vuijk et al., 2007).

Although there is substantial evidence that low parental warmth and peer victimization are both associated with risk for depression, few studies have examined the potential neural mechanisms of these effects. Several developmental models of depression have focused on the interface between adolescent social development and brain development in conceptualizing vulnerability to depression (Davey et al., 2008, Forbes and Dahl, 2005, Nelson et al., 2005). In this view, adolescent development of neural reward circuitry is a key process in the etiology of depression and depressive anhedonia. Furthermore, stressors that occur during adolescence may disrupt the development of reward-related circuitry, such as the medial prefrontal cortex (mPFC) – a region implicated in self-relevant and social processing as well as reward function (Amodio and Frith, 2006, Northoff and Hayes, 2011) – and the ventral striatum – a region implicated in motivation to obtain rewards (Berridge and Robinson, 1998). Consistent with these neurodevelopmental models of depression, neural response during reward anticipation and following rewarding outcomes is disrupted in adolescents and adults with depression (Forbes et al., 2009, Knutson et al., 2008, Pizzagalli et al., 2009, Steele et al., 2007). There is also evidence that exposure to early life stress, such as childhood maltreatment, is associated with reductions in reward-directed behavior (Guyer et al., 2006), and maternal deprivation produces anhedonic behaviors (e.g., decreased sucrose preference) in rodents and non-human primates (Pryce et al., 2005), behaviors that are supported by neural reward circuitry (Berridge and Robinson, 1998).

The aim of the present paper was to examine the relationship between social stressors experienced in early adolescence and neural response to rewards and depressive symptoms in later adolescence. Low parental warmth, peer victimization, and depressive symptoms were assessed at ages 11 and 12 and used to predict neural response during reward anticipation at age 16 in a large sub-sample of adolescent girls from the ongoing Pittsburgh Girls Study (PGS). Depressive symptoms were also assessed at age 16 and used to test associations with neural response to potential rewards in areas that were also associated with early adolescent social stressors. Based on previous studies showing increased mPFC response during reward anticipation in depressed adolescents (Forbes et al., 2009) and adults (Knutson et al., 2001), we expected that low parental warmth, peer victimization, and depressive symptoms would be associated with increased mPFC response during reward anticipation. We also expected that low parental warmth, peer victimization, and depressive symptoms would be associated with decreased ventral striatum response to potential rewards, consistent with other studies that found decreased striatal response to rewards in clinically depressed samples (Forbes et al., 2009, Pizzagalli et al., 2009, Steele et al., 2007). Finally, we hypothesized that neural response to potential rewards in the mPFC and ventral striatum would mediate the association between early adolescent social stress and depressive symptoms at age 16, even after controlling for early adolescent depressive symptoms.

2. Materials and methods

2.1. Participants

Participants were girls and their birth mothers recruited from the longitudinal Pittsburgh Girls Study (Keenan et al., 2010a). The PGS sample was formed following an enumeration of households with girls between the ages of 5 and 8 in the city of Pittsburgh. Of the 2992 eligible families, 2451 (85%) were successfully re-contacted and agreed to participate in a prospective study. Girls in the current fMRI study were participants in the ongoing longitudinal PGS Emotions sub-study (PGS-E), a study of precursors to depression beginning with laboratory assessments of girls and their mothers at age 9 years. PGS-E participants were drawn from the youngest participants in the PGS who either screened high on measures of depressive symptoms at age 8, or who were included in a random selection from the remaining 8-year old PGS girls. Girls whose scores fell at or above the 75th percentile by their own report on the Short Moods and Feelings Questionnaire (Angold et al., 1995) and/or by their mother's report on the Child Symptom Inventory (Gadow and Sprafkin, 1997) comprised the screen-high group (N = 135). There were significantly more African American than European American girls in the screen-high group. Thus, the girls selected from the remainder were matched to the screen-high group on race. Of the 263 families eligible to participate in the PGS-E, 232 (88.2%) agreed to participate and completed the first laboratory assessment when the girls were nine years of age. Retention in each year was above 95%.

At age 16, 194 participants completed the annual PGS-E assessment and 147 completed the reward task and fMRI scan (22 refused to be scanned or could not be scheduled, 25 were ineligible for scanning at the time of the study due to pregnancy, braces, or other scanning exclusions). An additional 27 participants who completed the scan were excluded from analyses. Reasons for exclusion included <80% striatum coverage (n = 12), >2 mm or 2° average movement in any direction during the scan (n = 6), poor quality scan (n = 2), incidental findings (n = 1), <80% response rate on the reward task (n = 2), and not understanding the reward task (n = 4). Subsequently, data from 120 participants were available for analyses. Of this sample, 65% were Black, 27% were White, and 8% were multi-racial. Sixty percent of the study families received some form of public assistance when the girls were between the ages of 9 and 12, with 26% of the families receiving public assistance continuously during that period. The mean number of years that participants’ families received public assistance was 0.43 (SD = 0.42), indicating that participants’ families received public assistance slightly less than 2 out of 4 years (ages 9–12) on average. The study distribution for race and public assistance was representative of the full PGS-E sample.

2.2. Questionnaires and interviews

Low parental warmth was assessed by parent report using six items from the Parent–Child Rating Scale (Loeber et al., 1998). Items (e.g., “How often have you wished [your daughter] would just leave you alone”) were scored on a three-point scale (1 = ‘almost never’ to 3 = ‘often’). Higher scores were indicative of lower parental warmth. Cronbach's α for low parental warmth items ranged from 0.75 (age 11) to 0.76 (age 12). Scores at ages 11 and 12 were correlated with one another (Pearson's r = 0.59, p < 0.001) and were averaged for analysis (M = 8.71, SD = 2.09).

Peer victimization was assessed using nine items from the Peer Experiences Scale (Vernberg et al., 1999). Items assessed victimization by physical aggression and social exclusion on a five-point scale (0 = ‘never’ to 4 = ‘a few times per week’). Cronbach's α for the nine victimization items ranged from 0.85 (age 11) to 0.83 (age 12). Scores at ages 11 and 12 were correlated with one another (Pearson's r = 0.63, p < 0.001) and were averaged for analysis (M = 3.33, SD = 4.30).

Current symptoms of depression (i.e., past month) were measured in each year using the Schedule for Affective Disorders and Schizophrenia for School-Age Children–Present and Lifetime Version (Kaufman et al., 1997), a semi-structured psychiatric diagnostic interview, which was administered separately to the mother and the girl by research assistants who were trained and monitored by a licensed clinical psychologist (KK). Each of the nine symptoms of depression was assessed on a three-point scale (1 = ‘not present’, 2 = ‘subthreshold’, 3 = ‘threshold’) regardless of whether disturbance in mood or anhedonia were endorsed, thereby providing a continuous measure of depression symptom counts. Thirteen percent of the girls’ interviews were randomly selected and coded for assessing interrater reliability. For youth-report data, the average intraclass correlation coefficient for total number of symptoms was 0.92. For caregiver report, the intraclass correlation coefficient for total number of symptoms was 0.58. A symptom was considered present if it was endorsed by either informant. At each wave of data collection the alpha coefficient for the nine depression symptoms based on the combined informants was above 0.55.

2.3. Reward task

Participants performed a reward-guessing task with a slow event-related design during fMRI acquisition. This task was designed to index brain activation during anticipation of monetary incentives. Previous studies show that this task reliably elicits activation in neural reward circuitry (Forbes et al., 2009, Forbes et al., 2010).

Participants were instructed to guess whether the value of a visually presented card, with possible value from 1 to 9, would be greater than or less than five. Each trial began with the presentation of a blank card. Participants had 4 s to guess the value of the card via button press. The type of trial was then displayed for 6 s using an image with hands shuffling cards overlaid on an upward facing yellow arrow to indicate potential reward trials or a downward facing yellow arrow to indicate potential loss trials. This was followed by presentation of the “actual” value of the card for 500 ms, feedback on the trial outcome for 500 ms (a green upward-facing arrow for win, a red downward-facing arrow for loss, or a yellow circle for a no-change outcome), and a crosshair was displayed for 9 s. There were 24 trials, 20 s each, administered over a single 8 min run. Trials were presented in pseudorandom order and outcomes were predetermined with a balanced number of trial types (12 possible-win, 12 possible-loss; 6 win, 6 loss, and 12 neutral outcomes). This number of trials was previously shown to be adequate to elicit a robust BOLD response in our regions of interest (Forbes et al., 2009). Participants were told that they would receive their winnings after the scan; in fact, all participants received $10.

2.4. MRI acquisition, processing, and analysis

Neuroimaging was conducted on a Siemens 3.0 T Tim Trio scanner. BOLD functional images were acquired using a gradient echo planar imaging (EPI) sequence that included 39 axial slices (3.1 mm wide) beginning at the cerebral vertex and extending across the entire cerebrum and most of the cerebellum (TR/TE = 2000/28 ms, field of view = 20 cm, matrix = 64 × 64). Scanning parameters were selected to optimize BOLD signal quality while maximizing whole brain coverage. A reference EPI scan was acquired before fMRI data collection to visually inspect for artifacts (e.g., ghosting) and ensure adequate signal across the entire volume. In addition, a 160-slice high-resolution sagittally acquired T1-weighted anatomical image was collected for co-registration and normalization of functional images (TR/TE = 2300/2.98 ms, field of view = 20 cm, matrix = 256 × 240).

Preprocessing and analysis of imaging data were conducted using Statistical Parametric Mapping software (SPM8; http://www.fil.ion.ucl.ac.uk/spm). Anatomical images were auto-segmented in SPM8 prior to analysis. Functional image preprocessing included spatial realignment to the first volume in the time series to correct for head motion, spatial normalization to Montreal Neurological Institute (MNI) stereotaxic space using a 12-parameter affine model, and image smoothing using a Gaussian filter set at 6 mm full-width half-maximum to minimize noise and individual differences in gyral anatomy. Voxel-wise signal was ratio-normalized to the whole-brain global mean. Preprocessed data were inspected prior to second-level analysis to ensure that all participants had good whole brain coverage, ventral striatum coverage of at least 80%, and less than 2 mm or 2° average movement in any direction during the scan.

Second-level random effects models were used to estimate neural response to rewards while accounting for scan-to-scan and between-participant variability. For each participant, condition effects were calculated at each voxel using paired t-tests for reward anticipation > baseline. Reward anticipation was defined as the 12 potential-win intervals that included the 6 s potential-win arrow, 500 ms number presentation, 500 ms arrow feedback and the first second of fixation (8 s total). The reward anticipation period extended 2 s beyond the potential-win arrow to account for the delay in hemodynamic response relative to neural activity and capture as much of the reward anticipation response as possible while avoiding substantial overlap with BOLD response to reward outcome events. The last 3 s of fixation for all 24 trials served as the baseline condition. By averaging the last 3 s of fixation across all trial outcomes (6 reward, 6 loss, 12 neutral), the baseline condition served as a relatively neutral comparison for contrasts with reward anticipation (Forbes et al., 2009, Forbes et al., 2010).

Analysis of imaging data focused on four regions of interest (ROIs): striatum, mPFC, orbitofrontal cortex (OFC), and amygdala. ROIs were defined using PickAtlas 3.0.3 (http://fmri.wfubmc.edu/software/PickAtlas). The striatal ROI was defined as a sphere with a 20 mm radius, centered on the Talairach coordinates of x = 0, y = 10 and z = −10, and encompassing the ventral striatum (including nucleus accumbens) and dorsal striatum bilaterally. The mPFC ROI was defined as a sphere with a 25 mm radius, centered on Talairach coordinates x = 0, y = 42, z = 18, and encompassing BA32 and medial regions of BA9 and BA10. Spheres were used for the striatal and mPFC ROIs because this approach focuses analyses on the striatum and medial regions of BAs 9 and 10 more precisely than atlas-based anatomical masks of those regions (especially for mPFC, which includes medial sections of large prefrontal regions such as BA10). The OFC was defined as BA11 and BA47, and the amygdala was defined using the human PickAtlas label. AlphaSim (http://afni.nimh.nih.gov/afni/) cluster extent thresholds were calculated a priori to determine the minimum cluster size necessary to maintain a corrected p < 0.05 for each ROI (cluster extent thresholds: striatum = 189 voxels, mPFC = 178 voxels, OFC = 62 voxels, amygdala = 62 voxels).

Regression analyses were performed in SPM8 to determine whether low parental warmth and peer victimization were associated with reward anticipation across participants. Using results of these analyses, a second set of regression analyses were conducted to determine whether current depressive symptoms were associated with neural response during reward anticipation in regions that were also associated with low parental warmth or peer victimization. To accomplish this, functional masks were created based on significant clusters yielded by regressions of BOLD response on early adolescent social stressors for each of the four anatomical ROIs. These functional masks were saved and used as functional ROIs for regressions of depressive symptoms on BOLD response. Because scores for low parental warmth, peer victimization, and depressive symptoms were positively skewed, these scores were log-transformed prior to analysis to better approximate a normal distribution. A constant was added to the peer victimization and depression scores prior to log-transformation because raw scores included values of zero. To account for the potential relationship between early depressive symptoms and neural response to rewards at age 16, all regression analyses included depressive symptom count averaged across ages 9–12 as a covariate. To address potential contributions of SES to development of reward circuitry, regression analyses also included, as a covariate, the average number of years that participants’ families received public assistance across ages 9–12. Regression weights and confidence intervals for significant clusters of activation were computed in SPSS using extracted SPM beta values for the average BOLD response across each significant cluster.

Finally, for each region that was significantly associated both with early adolescent social stressors and current depressive symptoms, mediation analyses were used to examine whether neural response during reward anticipation accounted for a significant portion of the association between early adolescent social stress and later depressive symptoms. To accomplish this, a second set of functional masks was created based on significant clusters yielded by regressions of BOLD response on current depressive symptoms for each functional ROI described above. These functional masks were saved and used as functional ROIs for regressions of low maternal warmth on BOLD response and peer victimization on BOLD response. Average BOLD response beta values across each significant cluster were extracted from these regressions, and tested as a mediator of the relationships between low maternal warmth and depressive symptoms, and peer victimization and depressive symptoms. Mediation analyses were implemented using the bootstrap method with the SPSS PROCESS macro (Hayes, 2013). Average depressive symptom count from ages 9 to 12 and average years of family public assistance from ages 9 to 12 were included as covariates in mediation analyses.

3. Results

3.1. Participant characteristics and clinical outcomes

Of the 120 girls with analyzable fMRI data, 3 met criteria for current major depressive disorder and an additional 7 met criteria for minor depressive disorder at age 16. The point prevalence of major depression in the sample (2.5%) is consistent with the point prevalence of depression in epidemiologic studies of adolescents (3.37 [95% CI: 1.35, 5.39]; Lewinsohn et al., 1993). The mean number of depressive symptoms at age 16 was 1.18 (SD = 1.35). The mean number of depressive symptoms across ages 9–12 was 2.06 (SD = 1.57). One-tailed Pearson's correlations indicated that depressive symptoms at age 16 were positively associated with low parental warmth (r = 0.42, p < 0.001) and peer victimization (r = 0.37, p < 0.001) in early adolescence. Low parental warmth and peer victimization were modestly associated with each other (r = 0.17, p = 0.03).

3.2. Association between early adolescent social stressors and reward-related BOLD response

Lower levels of parental warmth were associated with increased response in the dorsal and rostral mPFC (R2 = 0.10, beta = 0.26, 95% CI: 0.14, 1.02, p = 0.01), ventral striatum (R2 = 0.11, beta = 0.28, 95% CI: 0.21, 1.11, p = 0.004), and amygdala (R2 = 0.11, beta = 0.25, 95% CI: 0.10, 0.76, p = 0.012) during reward anticipation. Higher levels of peer victimization were associated with decreased response in the dorsal and rostral mPFC during reward anticipation (R2 = 0.10, beta = −0.26, 95% CI: −0.27, −0.04, p = 0.007). OFC response during reward anticipation was not associated with either low parental warmth or peer victimization. Detailed SPM8 regression results are presented in Table 1 and Fig. 1.

Table 1.

Low parental warmth and peer victimization as predictors of BOLD response during reward anticipation.

Region MNI coordinates
Cluster size t (df = 115)
x y z
Low parental warmth associated with increased reward response
 mPFC (BA 9, 10, 32) −18 56 30 2278 3.74**
 Caudate head, caudate body, nucleus accumbens 10 6 16 1389 3.20*
 Right amygdala 32 −2 −22 117 2.97
Peer victimization associated with decreased reward response
 mPFC (BA 10, 32) 0 50 10 372 3.19
 mPFC (BA 8, 9, 32) 4 26 40 253 2.56

Note: Alpha Sim corrected p < 0.05 for all contrasts. BA, Brodmann Area; BOLD, blood-oxygen-level-dependent.

*

p < 0.05 corrected for family-wise error at the cluster-level.

**

p < 0.01 corrected for family-wise error at the cluster-level.

Fig. 1.

Fig. 1

Association between social stressors and blood-oxygen-level-dependent (BOLD) response during reward anticipation. Low parental warmth was positively associated with BOLD response in the dorsal and rostral mPFC (A; R2 = 0.10), ventral striatum (B; R2 = 0.11), and amygdala (C; R2 = 0.11). LN = natural log transformation. Peer victimization was negatively associated with BOLD response in the rostral mPFC (D; R2 = 0.10).

3.3. Association between reward-related BOLD response and depressive symptoms

Higher levels of concurrent depressive symptoms were associated with increased response in regions of the rostral mPFC (R2 = 0.07, beta = 0.19, 95% CI: −0.01, 0.33, p = 0.06) and ventral striatum (R2 = 0.06, beta = 0.22, 95% CI: 0.01, 0.32, p = 0.04) that were also positively associated with low parental warmth. Detailed SPM8 regression results are presented in Table 2 and Fig. 2. In addition, bootstrap tests of mediation indicated that BOLD response in both the mPFC (ES = 0.15, 95% CI: 0.004, 0.40, p < 0.05) and ventral striatum (ES = 0.14, 95% CI: 0.001, 0.41, p < 0.05) significantly mediated the association between low parental warmth and depressive symptoms. Depressive symptoms were not significantly associated with neural response during reward anticipation in regions that were also associated with peer victimization.

Table 2.

Depressive symptoms predicting increased BOLD response during reward anticipation in regions that are also associated with low parental warmth.

Region MNI coordinates
Cluster size t (df = 116)
x y z
Caudate body, caudate head −10 2 12 469 3.32
mPFC (BA 9) 16 54 28 146 2.33

Note. Alpha Sim corrected p < 0.05 for all contrasts. BA, Brodmann Area, BOLD, blood-oxygen-level-dependent.

Fig. 2.

Fig. 2

Association between depressive symptoms and reward-related BOLD response in regions that were also associated with low parental warmth. Depressive symptoms were positively associated with BOLD response in the rostral mPFC (A; R2 = 0.07) and ventral striatum (B; R2 = 0.06) during reward anticipation. LN = natural log transformation.

4. Discussion

The results of the present study indicate that social stressors experienced by girls in early adolescence are associated with neural response to anticipated rewards at age 16. Low parental warmth at ages 11 and 12 had particularly robust associations with neural response to reward at age 16, with large clusters of increased activation in the mPFC and ventral striatum during reward anticipation. In contrast, the relationship between peer victimization at ages 11 and 12 and neural response to reward was more modest and in the opposite direction. Greater peer victimization was associated with decreased mPFC activation during reward anticipation, and it did not predict reward response in other reward-related ROIs. These results suggest that in early adolescence, low parental warmth may have a greater influence than peer victimization on later adolescent neural response to reward, and that different types of social stressors may influence reward circuitry in different ways. Of note, low parental warmth is likely to be more stable across child development than peer victimization (Loeber et al., 2000, Wang et al., 2009). Girls who experience low parental warmth at ages 11 and 12 may have experienced similar parenting behaviors at multiple time points in development, with cumulative influence on their brain development. Peer groups, in contrast, tend to shift frequently during adolescence (Hardy et al., 2002). Therefore, the experience of social exclusion or aggression may be more normative, inconsistent, and time-limited, with less robust influence than parental warmth on adolescent brain function.

We also found that regions of the mPFC and striatum that were correlated with early adolescent parental warmth were also positively related to depressive symptoms at age 16. In fact, neural response to potential rewards in the mPFC and striatum mediated the relationship between low parental warmth and depressive symptoms. The associations of early adolescent parental warmth and subsequent depressive symptoms with mPFC reward anticipation response were in the predicted direction: lower warmth predicted greater dorsal and rostral mPFC response, and higher depressive symptoms predicted greater rostral mPFC response. This is consistent with previous studies that found increased mPFC reward anticipation response in depressed participants (Forbes et al., 2009, Knutson et al., 2001). The mPFC is instrumental to evaluating the relative value of rewards and coordinating reward-related behavior (Rushworth and Behrens, 2008) as well as self-relevant and social processing (Amodio and Frith, 2006, Northoff and Hayes, 2011). Increased response in this region in individuals who have experienced low parental warmth or have higher depressive symptoms may reflect increased evaluation of personal performance on the task in light of previous experience or the imagined performance of others. Given that the rostral mPFC is also involved in self-related processing and internal monitoring (Amodio and Frith, 2006), increased response to reward in the mPFC could also reflect difficulty disengaging from this internal self-focus during the task.

In the present study, low parental warmth and higher levels of depressive symptoms were each independently associated with increased ventral striatal response during reward anticipation. This pattern was in the opposite direction to our prediction given the existing research in which decreased striatal response in depressed participants was observed relative to controls (Forbes et al., 2009, Pizzagalli et al., 2009, Steele et al., 2007). In those previous studies, however, participants were clinically depressed and samples were comprised of both males and females. The present study also measured reward anticipation response and depressive symptoms when the girls were 16, while other studies have assessed reward response in middle-aged adults (Pizzagalli et al., 2009, Steele et al., 2007) or across wider age ranges (8–17 in Forbes et al., 2009). Neurons in the mPFC and striatum undergo dramatic pruning and reorganization during adolescence (Andersen and Teicher, 2008, Davey et al., 2008, Spear, 2013). Therefore, sample differences could reflect the developmental phase of our fMRI and depressive symptom assessment.

Another possible explanation for this inconsistency with the extant literature is that different depression phenotypes will yield different neural signatures. The striatum is involved in coding the incentive salience, or motivational value, of rewards (Berridge and Robinson, 1998). Although we cannot tease apart depression sub-types in the current study, it may be that for depression characterized by anhedonia and low positive emotion one would expect blunted striatal activity in anticipation of reward. Depression characterized by dysphoria or irritability may be more reactive to reward opportunities. Similarly, predictable and consistent low parental warmth in the parent–child relationship may confer different risks for atypical neural processing of rewards than inconsistent or unpredictable parenting behavior. Differentiating patterns of brain activity among different depression phenotypes and risk contexts is a critical component to the development of brain-based algorithms for optimizing interventions. Our results suggest that there may be different patterns of neural activity within the broad domain of depression and contextual risks.

This is one of the first studies to use longitudinal data on early adolescent social stressors to predict brain reward processing and depressive symptoms later in adolescence, and it is the first study of social stress and reward processing in an all-female sample. Adverse parent and peer relationships may be especially influential for girls because girls are more likely than boys to value social cooperation, rely on social support to cope with stressors, attribute negative events to themselves, over-empathize with others, and suppress negative emotions to comply with the others’ expectations (Keenan and Hipwell, 2005). For example, girls who have parents who are cold or punishing may blame themselves for their parents’ behavior and go to great lengths to comply with their parents’ wishes at the expense of their own emotional expression and desire for social support. Furthermore, early-adolescent girls report greater declines in the quality of their relationships with their parents (McGue et al., 2005) and have higher rates of relational victimization (Wang et al., 2009) than boys. The high value that girls place on social cooperation and support, combined with the decrease in the quality of parent–child relationships and high rate of relational victimization during the transition from childhood to adolescence, may partially account for girls’ relatively greater risk for later depression. Other strengths of this study include the large sample size and the inclusion of participants who are at high risk for adverse psychosocial outcomes due to low socioeconomic status.

Conversely, because this study included an all-female sample, the relationship between low parental warmth, peer victimization, and neural reward processing in boys remains to be determined. Likewise, because many of the girls in the study were from low-income, urban neighborhoods, the results presented here may not generalize to girls from other socioeconomic backgrounds or environments. Although we included years of public assistance as a covariate in our analyses to control for the effect of poverty on reward response, we were not able to include a comprehensive indicator of socioeconomic status, such as income-to-needs, because complete income information was not provided by all participants. While possibly less fine-grained a measure of SES, public assistance represents an objective measure of family financial difficulty and indicates which of our generally low-SES participants were particularly burdened with poverty. Childhood SES has been reported to influence dorsal mPFC response to reward in adults (Gianaros et al., 2011) as well as emotional processing (Gianaros et al., 2008) and PFC function (Sheridan et al., 2012). Financial stress may also weaken parents’ caregiving resources and the ability of children to cope with psychosocial stressors such as low parental warmth and peer victimization (McLoyd, 1990). Additional research that examines the synergistic effects of socioeconomic status, parenting behavior, and peer stressors could delineate the neural mechanisms by which different stressors impact brain function during adolescence.

Additional study limitations include the cross-sectional fMRI assessment, the circumscribed assessment of psychosocial stress through two self-report measures, and the limited number of trials in the Reward Guessing Task. First, although our design is longitudinal and prospective, we did not assess brain functioning earlier in adolescence, and thus cannot infer that early adolescent social stressors caused disruptions in later neural response to reward. Causality has been established in animal studies, which show that early social stress produces anhedonic behavior in rodents and non-human primates (Pryce et al., 2005), and these behaviors depend on brain reward circuitry (Berridge and Robinson, 1998). However, a number of other factors could explain the association between early social stressors and brain reward response in the present study. In particular, girls’ depressive symptoms and/or altered reward responsiveness may influence parenting and peer relationships (e.g., Hipwell et al., 2008). Furthermore, while some parental psychopathology is likely reflected by our measure of low parental warmth, we did not include a separate index of parent/family psychopathology in our analyses, nor did we include other measures of parenting that could moderate the association between warmth and reward and warmth and depression symptoms. In addition, self-reported data have some limitations, and observational measures of adolescents’ relationships with their parents and peers may provide a clearer picture of the relationship between social stress and neural response to reward. Finally, the limited number of trials in the Reward Guessing Task (12 potential win) may have reduced the signal-to-noise ratio in analyses of reward anticipation response. Notably, including too many trials and thereby extending the duration of the task also has disadvantages due to risk of task habituation, fatigue, and movement. We limited the number of trials in the Reward Guessing Task to balance these risks and because we’ve previously found that 12 reward anticipation trials is an adequate number to elicit a robust BOLD response in our regions of interest (Forbes et al., 2009).

Despite these limitations, this study is consistent with the idea that early social stress affects the neurodevelopment of reward circuits and thereby increases risk for depressive symptoms. The results of this study, particularly the divergent directions of association between neural response to reward and the two types of psychosocial stressors studied here, indicate that the influence of specific psychosocial stressors may be differentially weighted in the brain. Future studies of psychosocial stress and reward processing during adolescence should carefully consider the relative impact of parent, peer, and other stressors and their developmental timing on systems involved in the pathophysiology of depression. Furthermore, there is some evidence that neural response to monetary and social rewards differs between females and males: monetary and social rewards elicit similar patterns of striatum response in females, while men are more responsive to monetary rewards and less responsive to social rewards than women (Guyer et al., 2009, Spreckelmeyer et al., 2009). Given the pronounced sex differences in the incidence of depression during adolescence and the influence of psychosocial stressors, it will be important for future studies to examine the influence of psychosocial stressors on reward processing in both sexes. Ultimately, these studies may lead to developmentally-appropriate and sex-specific interventions for reward-related brain function and other neural and behavioral precursors of depression in adolescence.

Conflicts of interest statement

There are no conflicts of interest to report in submission of this manuscript.

Acknowledgements

This research was supported in part by the National Institutes of Health [R01-MH093605, R01-MH66167, R01-MH56630, and R01-HD067185]. The study sponsor had no role in the design, analysis or interpretation of the study data, the writing of the report, or the decision to submit the manuscript for publication. The authors thank the families participating in the Learning About Girls’ Emotions Study.

Contributor Information

Melynda D. Casement, Email: casementmd@upmc.edu.

Amanda E. Guyer, Email: aeguyer@ucdavis.edu.

Alison E. Hipwell, Email: hipwellae@upmc.edu.

Rose L. McAloon, Email: mcaloonrl@upmc.edu.

Amy M. Hoffmann, Email: hoffmanna@upmc.edu.

Kathryn E. Keenan, Email: kkeenan@yoda.bsd.uchicago.edu.

Erika E. Forbes, Email: forbese@upmc.edu.

References

  1. Amodio D.M., Frith C.D. Meeting of minds: the medial frontal cortex and social cognition. Nat. Rev. Neurosci. 2006;7(4):268–277. doi: 10.1038/nrn1884. [DOI] [PubMed] [Google Scholar]
  2. Andersen S.L., Teicher M.H. Stress, sensitive periods and maturational events in adolescent depression. Trends Neurosci. 2008;31(4):183–191. doi: 10.1016/j.tins.2008.01.004. [DOI] [PubMed] [Google Scholar]
  3. Angold A., Costello E.J., Messer S.C., Pickles A., Winder F., Silver D. Development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. Int. J. Methods Psychiatr. Res. 1995;5:237–249. [Google Scholar]
  4. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Rev. 1998;28:309–369. doi: 10.1016/s0165-0173(98)00019-8. [DOI] [PubMed] [Google Scholar]
  5. Brennan P.A., Le Brocque R., Hammen C. Maternal depression, parent–child relationships, and resilient outcomes in adolescence. J. Am. Acad. Child Adolesc. Psychiatry. 2003;42(12):1469–1477. doi: 10.1097/00004583-200312000-00014. [DOI] [PubMed] [Google Scholar]
  6. Davey C.G., Yücel M., Allen N.B. The emergence of depression in adolescence: development of the prefrontal cortex and the representation of reward. Neurosci. Biobehav. Rev. 2008;32(1):1–19. doi: 10.1016/j.neubiorev.2007.04.016. [DOI] [PubMed] [Google Scholar]
  7. Eisenberg N., Cumberland A., Spinrad T.L. Parental socialization of emotion. Psychol. Inq. 1998;9(4):241–273. doi: 10.1207/s15327965pli0904_1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Fleming J.E., Offord D.R. Epidemiology of childhood depressive disorders: a critical review. J. Am. Acad. Child Adolesc. Psychiatry. 1990;29(4):571–580. doi: 10.1097/00004583-199007000-00010. [DOI] [PubMed] [Google Scholar]
  9. Forbes E.E., Dahl R.E. Neural systems of positive affect: relevance to understanding child and adolescent depression? Dev. Psychopathol. 2005;17(03):827–850. doi: 10.1017/S095457940505039X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Forbes E.E., Hariri A.R., Martin S.L., Silk J.S., Moyles D.L., Fisher P.M. Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder. Am. J. Psychiatry. 2009;166(1):64–73. doi: 10.1176/appi.ajp.2008.07081336. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Forbes E.E., Olino T.M., Ryan N.D., Birmaher B., Axelson D., Moyles D.L., Dahl R.E. Reward-related brain function as a predictor of treatment response in adolescents with major depressive disorder. Cogn. Affect. Behav. Neurosci. 2010;10(1):107–118. doi: 10.3758/CABN.10.1.107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Gadow K.D., Sprafkin J.N. Checkmate Plus; Stony Brook, NY: 1997. Adolescent Symptom Inventory-4 Screening Manual. [Google Scholar]
  13. Ge X., Best K.M., Conger R.D., Simons R.L. Parenting behaviors and the occurrence and co-occurrence of adolescent depressive symptoms and conduct problems. Dev. Psychol. 1996;32(4):717–731. [Google Scholar]
  14. Ge X., Lorenz F.O., Conger R.D., Elder G.H. Trajectories of stressful life events and depressive symptoms during adolescence. Dev. Psychol. 1994;30(4):467–483. [Google Scholar]
  15. Gianaros P.J., Horenstein J.A., Hariri A.R., Sheu L.K., Manuck S.B., Matthews K.A., Cohen S. Potential neural embedding of parental social standing. Soc. Cogn. Affect. Neurosci. 2008;3(2):91–96. doi: 10.1093/scan/nsn003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Gianaros P.J., Manuck S.B., Sheu L.K., Kuan D.C.H., Votruba-Drzal E., Craig A.E., Hariri A.R. Parental education predicts corticostriatal functionality in adulthood. Cereb. Cortex. 2011;21(4):896–910. doi: 10.1093/cercor/bhq160. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Guyer A.E., Kaufman J., Hodgdon H.B., Masten C.L., Jazbec S., Pine D.S., Ernst M. Behavioral alterations in reward system function. J. Am. Acad. Child Adolesc. Psychiatry. 2006;45(9):1059–1067. doi: 10.1097/01.chi.0000227882.50404.11. [DOI] [PubMed] [Google Scholar]
  18. Guyer A.E., McClure-Tone E.B., Shiffrin N.D. Probing the neural correlates of anticipated peer evaluation in adolescence. Child Dev. 2009;40:1000–1015. doi: 10.1111/j.1467-8624.2009.01313.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Hardy C.L., Bukowski W.M., Sippola L.K. Stability and change in peer relationships during the transition to middle-level school. J. Early Adolesc. 2002;22(2):117–142. [Google Scholar]
  20. Hawker D.S.J., Boulton M.J. Twenty years’ research on peer victimization and psychosocial maladjustment: a meta-analytic review of cross-sectional studies. J. Child Psychol. Psychiatry. 2000;41(4):441–455. [PubMed] [Google Scholar]
  21. Hayes A.F. NY: Guilford Press; New York: 2013. Introduction to mediation, moderation and conditional process analysis: A regression-based approach. [Google Scholar]
  22. Hipwell A., Keenan K., Kasza K., Loeber R., Stouthamer-Loeber M., Bean T. Reciprocal influences between girls’ conduct problems and depression, and parental punishment and warmth: a six year prospective analysis. J. Abnorm. Child Psychol. 2008;36(5):663–677. doi: 10.1007/s10802-007-9206-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Kaufman J., Birmaher B., Brent D., Rao U., Flynn C., Moreci P. Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data. J. Am. Acad. Child Psychiatry. 1997;36(7):980–988. doi: 10.1097/00004583-199707000-00021. [DOI] [PubMed] [Google Scholar]
  24. Keenan K., Hipwell A.E. Preadolescent clues to understanding depression in girls. Clin. Child Family Psychol. Rev. 2005;8(2):89–105. doi: 10.1007/s10567-005-4750-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Keenan K., Hipwell A., Chung T., Stepp S., Stouthamer-Loeber M., Loeber R., McTigue K. The Pittsburgh Girls Study: overview and initial findings. J. Clin. Child Adolesc. 2010;39(4):506–521. doi: 10.1080/15374416.2010.486320. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Keenan K., Hipwell A., Feng X., Rischall M., Henneberger A., Klosterman S. Lack of assertion, peer victimization, and risk for depression in girls: testing a diathesis-stress model. J. Adolesc. Health. 2010;47(5):526–528. doi: 10.1016/j.jadohealth.2010.03.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Kessler R. Sex and depression in the National Comorbidity Survey I: lifetime prevalence, chronicity and recurrence. J. Affect. Disorders. 1993;29(2–3):85–96. doi: 10.1016/0165-0327(93)90026-g. [DOI] [PubMed] [Google Scholar]
  28. Kessler R.C., Berglund P., Demler O., Jin R., Merikangas K.R., Walters E.E. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch. Gen. Psychiatry. 2005;62(6):593–602. doi: 10.1001/archpsyc.62.6.593. [DOI] [PubMed] [Google Scholar]
  29. Knutson B., Adams C.M., Fong G.W., Hommer D. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J. Neurosci. 2001;21(16):RC159. doi: 10.1523/JNEUROSCI.21-16-j0002.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Knutson B., Bhanji J.P., Cooney R.E., Atlas L.Y., Gotlib I.H. Neural responses to monetary incentives in major depression. Biol. Psychiatry. 2008;63(7):686–692. doi: 10.1016/j.biopsych.2007.07.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Kovacs M. Depressive disorders in childhood: an impressionistic landscape. J. Child Psychol. Psychiatry. 1997;38(3):287–298. doi: 10.1111/j.1469-7610.1997.tb01513.x. [DOI] [PubMed] [Google Scholar]
  32. Lewinsohn P.M., Hops H., Roberts R.E., Seeley J.R., Andrews J.A. Adolescent psychopathology: I. Prevalence and incidence of depression and other DSM-III-R disorders in high school students. J. Abnorm. Psychol. 1993;102(1):133–144. doi: 10.1037//0021-843x.102.1.133. [DOI] [PubMed] [Google Scholar]
  33. Loeber R., Drinkwater M., Yin Y., Anderson S.J., Schmidt L.C., Crawford A. Stability of family interaction from ages 6 to 18. J. Abnorm. Child Psychol. 2000;28(4):353–369. doi: 10.1023/a:1005169026208. [DOI] [PubMed] [Google Scholar]
  34. Loeber R., Farrington D.P., Stouthamer-Loeber M., Van Kammen W. Lawrence Erlbaum Associates; Mahwah, NJ: 1998. Antisocial Behavior and Mental Health Problems: Explanatory Factors in Childhood and Adolescence. [Google Scholar]
  35. Masten A.S., Hubbard J.J., Gest S.D., Tellegen A., Garmezy N., Ramirez M. Competence in the context of adversity: pathways to resilience and maladaptation from childhood to late adolescence. Dev. Psychopathol. 1999;11(1):143–169. doi: 10.1017/s0954579499001996. [DOI] [PubMed] [Google Scholar]
  36. McGue M., Elkins I., Walden B., Iacono W.G. Perceptions of the parent–adolescent relationship: a longitudinal investigation. Dev. Psychol. 2005;41(6):971–984. doi: 10.1037/0012-1649.41.6.971. [DOI] [PubMed] [Google Scholar]
  37. McLeod B.D., Weisz J.R., Wood J.J. Examining the association between parenting and childhood depression: a meta-analysis. Clin. Psychol. Rev. 2007;27(8):986–1003. doi: 10.1016/j.cpr.2007.03.001. [DOI] [PubMed] [Google Scholar]
  38. McLoyd V.C. The impact of economic hardship on black families and children: psychological distress, parenting, and socioemotional development. Child Dev. 1990;61(2):311–346. doi: 10.1111/j.1467-8624.1990.tb02781.x. [DOI] [PubMed] [Google Scholar]
  39. Morris A.S., Silk J.S., Steinberg L., Myers S.S., Robinson L.R. The role of the family context in the development of emotion regulation. Soc. Dev. 2007;16(2):361–388. doi: 10.1111/j.1467-9507.2007.00389.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Nelson E.E., Leibenluft E., McClure E.B., Pine D.S. The social re-orientation of adolescence: a neuroscience perspective on the process and its relation to psychopathology. Psychol. Med. 2005;35(2):163–174. doi: 10.1017/s0033291704003915. [DOI] [PubMed] [Google Scholar]
  41. Northoff G., Hayes D.J. Is our self nothing but reward? Biol. Psychiatry. 2011;69(11):1019–1025. doi: 10.1016/j.biopsych.2010.12.014. [DOI] [PubMed] [Google Scholar]
  42. O’Brien S.F., Bierman K.L. Conceptions and perceived influence of peer groups: interviews with preadolescents and adolescents. Child Dev. 1988;59(5):1360–1365. doi: 10.1111/j.1467-8624.1988.tb01504.x. [DOI] [PubMed] [Google Scholar]
  43. Pizzagalli D.A., Holmes A.J., Dillon D.G., Goetz E.L., Birk J.L., Bogdan R. Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder. Am. J. Psychiatry. 2009;166(6):702–710. doi: 10.1176/appi.ajp.2008.08081201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Pryce C.R., Rüedi-Bettschen D., Dettling A.C., Weston A., Russig H., Ferger B., Feldon J. Long-term effects of early-life environmental manipulations in rodents and primates: potential animal models in depression research. Neurosci. Biobehav. Rev. 2005;29(4-5):649–674. doi: 10.1016/j.neubiorev.2005.03.011. [DOI] [PubMed] [Google Scholar]
  45. Rushworth M.F.S., Behrens T.E.J. Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 2008;11(4):389–397. doi: 10.1038/nn2066. [DOI] [PubMed] [Google Scholar]
  46. Sheridan M.A., Sarsour K., Jutte D., D’Esposito M., Boyce W.T. The impact of social disparity on prefrontal function in childhood. PLoS ONE. 2012;7(4):e35744. doi: 10.1371/journal.pone.0035744. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Spear L.P. Adolescent neurodevelopment. J. Adolesc. Health. 2013;52(S2):S7–S13. doi: 10.1016/j.jadohealth.2012.05.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Spreckelmeyer K.N., Krach S., Kohls G., Rademacher L., Irmak A., Konrad K., Kircher T., Gründer G. Anticipation of monetary and social reward differently activates mesolimbic brain structures in men and women. Soc. Cogn. Affect. Neurosci. 2009;4(2):158–165. doi: 10.1093/scan/nsn051. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Steele J.D., Kumar P., Ebmeier K.P. Blunted response to feedback information in depressive illness. Brain. 2007;130(9):2367–2374. doi: 10.1093/brain/awm150. [DOI] [PubMed] [Google Scholar]
  50. Sweeting H., Young R., West P., Der G. Peer victimization and depression in early-mid adolescence: a longitudinal study. Brit. J. Educ. Psychol. 2006;76(Pt 3):577–594. doi: 10.1348/000709905X49890. [DOI] [PubMed] [Google Scholar]
  51. Vernberg E.M., Jacobs A.K., Hershberger S.L. Peer victimization and attitudes about violence during early adolescence. J. Clin. Child Psychol. 1999;28(3):386–395. doi: 10.1207/S15374424jccp280311. [DOI] [PubMed] [Google Scholar]
  52. Vuijk P., van Lier P.A.C., Crijnen A.A.M., Huizink A.C. Testing sex-specific pathways from peer victimization to anxiety and depression in early adolescents through a randomized intervention trial. J. Affect. Disorders. 2007;100(1–3):221–226. doi: 10.1016/j.jad.2006.11.003. [DOI] [PubMed] [Google Scholar]
  53. Wang J., Iannotti R.J., Nansel T.R. School bullying among adolescents in the United States: physical, verbal, relational, and cyber. J. Adolesc. Health. 2009;45:368–375. doi: 10.1016/j.jadohealth.2009.03.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. World Health Organization . World Health Organization; Geneva, Switzerland: 2008. The Global Burden of Disease; pp. 1–160. [Google Scholar]

Articles from Developmental Cognitive Neuroscience are provided here courtesy of Elsevier

RESOURCES