Abstract
Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents.
Keywords: Adolescent, reward, electrophysiology, striatum, dopamine, rat
1. Introduction
Current research on psychiatric disorders has placed a strong emphasis on early detection and treatment. Many symptoms of schizophrenia, mood disorders and addiction first manifest during the adolescent period (Adriani and Laviola, 2004; Casey et al., 2008; Schramm-Sapyta et al., 2009; Mitchell and Potenza, 2014). Accordingly, it is critical to elucidate the biological and environmental risk factors that render adolescents highly vulnerable to these disorders. Such mechanistic knowledge is necessary for the development of interventions to prevent or attenuate the emergence of disease.
Previous preclinical research on brain development and disease has primarily assessed morphological changes or alterations at the receptor level. These studies have yielded critical information about adolescent biology and behavior. There is little known, however, about real-time dynamics of neuronal activity during behavior. This information is particularly relevant in light of recent theories positing that dysfunctional neuronal network activity is a critical contributor to the etiology of disease (Uhlhaas and Singer, 2012; Moghaddam and Wood, 2014). To fully understand how behaviorally relevant neuronal network activity is altered in vulnerable individuals, we must first understand how individual neurons and neural ensembles encode salient events in healthy adolescents and adults.
Changes in affect, motivation, and motivational processing during adolescence are among the first observed behaviors predictive of schizophrenia and other psychiatric illnesses in high risk individuals (Ernst et al., 2006; Gladwin et al., 2011; Juckel et al., 2012). To understand the development of symptoms during this vulnerable developmental period, it is essential to quantify the basic neural mechanisms underlying adolescent reward processing. Recent data accumulated in our lab using adolescence rats suggest substantial age-related differences in reward-induced neuronal activity. These differences are manifested even when 1) measurable behavior is equivalent between adolescent and adult subjects, and 2) baseline levels of neuronal activity are equivalent between age groups. Thus, reward-evoked neuronal activity may, in some instances, be more effective than behavioral measures of motivation or baseline activity as a marker of early vulnerability to disease. In this review, we summarize adolescent reward-processing data acquired from a rat model across multiple brain regions, and discuss the implications of these differences for adolescent behavior and disease vulnerability.
2. Adolescent reward processing differs from adults across multiple regions
The technique focused in this review is single-unit extracellular recording where neuronal activity of multiple neurons can be measured in real-time in behaving animals (Sturman and Moghaddam, 2011b). For this method, multiwire electrode arrays are implanted in specific brain regions and electrical signals are amplified and high pass filtered to isolate high frequency neuronal activity, such as action potentials or local field potential oscillations (Buzsaki, 2004; Sturman and Moghaddam, 2011b; Wood et al., 2012). Measuring neural activity in awake-behaving adolescent rats is a challenging endeavor, as the adolescent window only spans approximately between postnatal days 28 – 55 (Spear, 2000). After accounting for the required time for electrode implantation surgery, recovery and habituation, the brief remaining time window precludes the use of complex behavioral paradigms with electrophysiology. Therefore, behavioral tasks that do not require long training times must be used to measure reward processing in adolescent rats. Our lab utilizes a rewarded instrumental task in which rats learn to nose poke into a lit port to receive a single sugar pellet, while neural activity is recorded from electrode arrays implanted into specific brain regions (Figure 1). Importantly, the task is simple enough that learning and performance of the primary components of the task are comparable between adults and adolescents (Sturman et al., 2010), thus any differences in neuronal activity are indicative of reward processing differences, rather than a product of behavioral asymmetry between groups. Each of these behavioral events can be synchronized with measures of neural activity with sub-second long temporal resolution, allowing assessment of neural activity associated with reward-related cues, goal-directed actions, and reward anticipation and delivery. Using variants of this task, we recorded from orbitofrontal cortex, dorsal and ventral striatum, and ventral tegmental area in adult and adolescent rats. We then discuss how these differences in reward-processing may be related to reward-related cognitive traits observed during adolescence, including impulsivity, risk taking and behavioral flexibility.
2.1. Prefrontal cortex
Prefrontal cortex (PFC) undergoes substantial development throughout adolescence, and this development has been implicated in adolescent behavioral tendencies, particularly the ability to regulate and inhibit motivated behaviors (Brenhouse et al., 2010; Geier et al., 2010; Sturman and Moghaddam, 2011a; Ernst, 2014). PFC is divided into multiple functionally distinct subregions with different implications for adolescent behavior and disease vulnerability. Orbitofrontal cortex (OFC) is a lateral prefrontal-cortical region that receives input from sensory regions and is extensively connected with limbic areas (Price, 2007; Rolls and Grabenhorst, 2008). Accordingly, OFC is ideally suited to integrate physical aspects of rewarding and aversive outcomes with emotional information, and then utilize this affective information to guide behavior. Neuronal activity in OFC has been associated with the representation of rewarding outcomes (van Duuren et al., 2007; Balleine et al., 2011; Schoenbaum et al., 2011), and has been implicated in multiple facets of impulsive behavior (Berlin et al., 2004; Winstanley et al., 2010; Zeeb et al., 2010), which is elevated in humans and rats during adolescence (Green et al., 1994; Adriani and Laviola, 2003; Burton and Fletcher, 2012; Doremus-Fitzwater et al., 2012; Mitchell and Potenza, 2014). Because OFC (along with other prefrontal regions) has been shown to be underdeveloped in human adolescents (Sowell et al., 1999; Galvan et al., 2006), OFC is a logical target for probing for age-related differences in reward processing.
Single unit extracellular recording was used to measure task-evoked activity in individual neurons. In adults, OFC population neuronal activity decreased during reward retrieval (Figure 1B). In contrast, the adolescent OFC population activity was increased during retrieval (Sturman and Moghaddam, 2011b). This profound difference in activity occurred despite similar baseline firing rate between groups, and comparable neuronal inhibition during the performance phase of the instrumental action that lead to reward delivery. These data suggest that reward processing in OFC can be an effective biomarker of age-related differences, even when baseline neuronal activity and behavior are equivalent between groups.
Although baseline firing rate was similar between age groups, an alternate analysis of firing patterns revealed further distinctions. Adolescent OFC showed increased variability compared to adults in firing rate across multiple trials, as assessed by fano factor (Churchland et al., 2010). This variability may be indicative of inefficient neural coding of reward-related events, as spike variability undermines effective inter-regional communication through spike-field coherence (Fries, 2005; Churchland et al., 2010). Importantly, this finding suggests that measures beyond simple firing rate may be necessary to detect functional differences in neural processing between age groups, and possibly between healthy controls and diseased or at-risk patients.
OFC plays a modulatory role in impulsive choice, defined as a preference for immediate rewards/gratification (Winstanley, 2007). Adolescent humans and rats have increased preference for immediate gratification compared to adult humans and rats, and this has been implicated in adolescent drug abuse and maladaptive behavior (Adriani and Laviola, 2003; Doremus-Fitzwater et al., 2012; Mitchell and Potenza, 2014; Stanis and Andersen, 2014). Impulsive decision-making is associated with several psychiatric disorders (Bechara et al., 2001; Ahn et al., 2011; Nolan et al., 2011), and is both a predictor of drug abuse and a consequence of long-term exposure to drugs of abuse (Simon et al., 2007; Perry et al., 2008; Anker et al., 2009; de Wit, 2009; Mendez et al., 2010). Thus, a feed forward condition may develop in which individuals with psychiatric vulnerabilities involving aberrant impulsive regulation are highly likely to abuse drugs, which then exacerbates trait impulsivity (Garavan and Stout, 2005; Setlow et al., 2009). Our data suggest that age differences in impulsivity may be, in part, due to neuronal processing differences in the OFC, as OFC encodes information about reward-associated delays (Roesch and Olson, 2005; Roesch et al., 2006). The highly variable neural processing throughout task performance (as assessed by fano factor) and hyperactive reward-evoked response observed in adolescent OFC may, therefore, be related to unstable representations of reward-related events. Our observation may also be related to a suboptimal ability to bridge long delays between actions and outcomes, a function associated with OFC neurons (Roesch et al., 2006). This in turn would facilitate persistent choice of immediate over delayed gratification.
Age-related differences also are observed in infralimbic and prelimbic regions of the medial PFC , which are implicated in behavioral planning and feedback, attention, and response inhibition (Goldman-Rakic, 1995; Fuster, 2001; Killcross and Coutureau, 2003; Magno et al., 2006; Peters et al., 2008; Burgos-Robles et al., 2013; Pezze et al., 2014). While neuronal activity has not yet been recorded in these regions in behaving adolescent animals, developmental correlates of reward processing have been revealed by quantifying immediate early genes. After heroin self-administration, adolescents showed an attenuated increase in Fos positive neurons in prelimbic and infralimbic cortices compared to adults, indicative of reduced activation of adolescent medial PFC by drug reward seeking (Doherty et al., 2013). Reports of nicotine-evoked activity are conflicting, demonstrating either enhanced increase in Arc or similar changes in cfos in adolescent compared to adult medial PFC (Leslie et al., 2004; Schochet et al., 2005). Finally, cocaine exposure caused increase c-fos expression in adolescent PFC (Cao et al., 2007). While these studies provide useful data, direct measurements of neural processing of both drug and natural rewards in adolescent medial PFC will yield temporally specific information about adolescent medial PFC function.
Dopamine receptor expression in prelimbic cortex peaks during adolescence (Andersen et al., 2000). D1 dopamine receptors, in particular, have been linked to adolescent motivated behavior. Adolescent rats demonstrate increased vulnerability to drug-associated cues compared to adult rats (Leslie et al., 2004; Brenhouse and Andersen, 2008; Brenhouse et al., 2008; Kota et al., 2011); blocking D1 receptors in adolescent prelimbic cortex decreases sensitivity to these cues (Brenhouse et al., 2008). In addition, overexpressing D1 receptors in adult prelimbic cortex recapitulated adolescent behavioral tendencies, including impulsivity and increased sensitivity to drug-associated cues (Sonntag et al., 2014). D1 receptor manipulation also modulates behavioral sensitivity to amphetamine to a greater degree in adolescents than adults (Mathews and McCormick, 2012).
2.2. Striatum
Neural development during adolescence is ongoing in the striatum (Sowell et al., 1999; Ernst et al., 2006; Casey et al., 2008; Geier et al., 2010; Somerville et al., 2011). Striatum is involved with learning, reward processing and movement, and has been strongly implicated in psychiatric disorders including schizophrenia and addiction (Kalivas and Volkow, 2005; Everitt et al., 2008; Horga and Abi-Dargham, 2014). Both ventral and dorsal striatum receive dense dopaminergic projections from the midbrain, and dopamine transmission has repeatedly been shown to differ between adulthood and adolescence (Adriani and Laviola, 2004; Volz et al., 2009; McCutcheon et al., 2012). While there is a wealth of data from animal models describing neuroanatomical and pharmacological differences in striatum between adolescent and adult rodents (Andersen et al., 1997; Bolanos et al., 1998; Tarazi et al., 1998), there are considerably less data describing age-related differences in neural activity. The majority of the neural imaging studies performed in human adolescent subjects have focused on ventral striatum (VS) in particular the nucleus accumbens (NAc), which is implicated in motivation, learning and cue processing (Robbins and Everitt, 1996; Kelley, 2004; Ernst et al., 2006; Galvan et al., 2006; Geier et al., 2010; Hart et al., 2014). However, dorsal striatum (DS), which is implicated in learning, action-selection and habit formation (Packard and White, 1990; Balleine et al., 2007; Kimchi et al., 2009), has been largely overlooked as a locus of developmental differences. To quantify and compare neural correlates of reward processing in both striatal regions, our lab recorded single-unit extracellular activity in both DS and NAc of adult and adolescent rats during goal-directed behavior.
Somewhat surprisingly, task-evoked activity in NAc did not differ substantially between adult and adolescent rats (Sturman and Moghaddam, 2012). Robust age-related differences, however, were observed in DS. Adolescent neurons were activated just prior to a reward-seeking action, whereas adult neurons did not respond until after action completion (Figure 1B). Adolescent neurons in DS also were activated prior to reward retrieval, while adult neurons were inhibited by reward (Figure 1B). This demonstrated that the adolescent brain recruits DS circuitry both earlier and to a greater degree than adults during reward-retrieval.
While adolescent DS neurons are hyper-responsive to rewards, amphetamine-evoked dopamine release is attenuated compared to adults in this region. Lower levels of amphetamine-evoked dopamine efflux in the DS, but, again, not the NAc of adolescent rats compared to adults (Matthews et al., 2013). Interestingly, the opposite effect has been observed with dopaminergic drugs that act as uptake inhibitors, such as cocaine and methylphenidate, which cause enhanced dopamine efflux in adolescent compared to adult DS (Walker and Kuhn, 2008; Walker et al., 2010). As with amphetamine, this age-related cocaine effect was more pronounced in DS than NAc (Frantz et al., 2007; Walker and Kuhn, 2008). This difference between DS dopamine release may be a function of baseline dopamine availability, as reduced dopamine availability in projection dopamine neurons would likely affect drugs that facilitate dopamine release (such as amphetamine) to a greater degree than drugs that maintain dopamine in the synapse (such as cocaine). Accordingly, tyrosine hydroxylase, an enzyme involved with the synthesis of dopamine, was reduced in adolescent DS but not NAc (Matthews et al., 2013). This reduction in evoked-dopamine neurotransmission suggests that dopamine projections to DS, which arise from substantia nigra pars compacta (Ungerstedt, 1971; Lynd-Balta and Haber, 1994), may be hypoactive during adolescence. Dopamine has an inhibitory influence on medium spiny neurons in the striatum (Kreitzer and Malenka, 2008). A hypoactive dopamine neurotransmission in adolescence DS may, therefore, contribute to our observed enhanced reward-evoked activity in DS neurons. Future studies recording from dopamine projections to the adolescent DS will directly address this mechanism.
The area of striatum traditionally associated with attributing value and motivation to cues and rewards is VS (Robbins and Everitt, 1996; Kelley, 2004; Cooper and Knutson, 2008; Flagel et al., 2011). Accordingly, many theories of adolescent illness and behavioral vulnerability hinge on aberrant reward-related motivated behavior and responsivity of reward-related brain circuitry (Bjork et al., 2004; Galvan et al., 2006; Geier et al., 2010; Van Leijenhorst et al., 2010). The previous data, on the other hand, suggest that age-related differences to rewards may be even greater in DS (Sturman and Moghaddam, 2012; Matthews et al., 2013). While these do not preclude the role of the developing VS in adolescent behavioral and disease vulnerability, they suggest that DS may also play a substantial role in adolescent behavioral tendencies.
The DS is strongly associated with learning and the physical manifestation of locomotive behavior (Robbins and Everitt, 1992; Packard and Knowlton, 2002; Gittis and Kreitzer, 2012). In particular the dorsomedial striatum (DMS), or associative striatum region of the DS is implicated in linking actions to rewarding outcomes, as lesions of DMS abolish the learning and expression of goal-directed behavior (Yin and Knowlton, 2004; Ragozzino, 2007), and DMS activity also has been implicated in the encoding of flexible response patterns (Kimchi and Laubach, 2009). Conversely, dorsolateral striatum (DLS) is involved with the consolidation and expression of habitual behavior, during which actions are no longer dependent on outcome representation (Yin et al., 2004; Yin et al., 2009). The studies of adolescent neuronal activity and dopamine release detailed in this review (Sturman and Moghaddam, 2012; Matthews et al., 2013) were both localized to DMS, underscoring the importance of this region in development toward the adolescent behavioral phenotype and illness vulnerability. In line with this idea, several differences have been observed in instrumental behavior between adult and adolescent rats, with adolescents demonstrating differences in instrumental behavior, including differences in appetitive motivation, reduced extinction, attenuated response inhibition and impaired ability to adjust to changes in action-outcome contingencies (Friemel et al., 2010; Sturman et al., 2010; Andrzejewski et al., 2011; Spear, 2011; Burton and Fletcher, 2012; Naneix et al., 2012). In addition, adolescents exhibit reduced ability to quickly initiate an appropriate response after a stop signal (Simon et al., 2013), similar to the effect observed after lesions of DMS (Eagle and Robbins, 2003).
In contrast to adolescent DMS, the presence of developmental differences in DLS is less clear. During the expression of goal-directed behavior, actions are initially tightly linked to outcome representation. After overtraining, however, actions become less influenced by outcome representation, and more automated (“habitual”) (Dickinson, 1985). Plasticity related to this habit learning occurs in DLS (Yin et al., 2009; Balleine and O'Doherty, 2010; Thorn et al., 2010), and the shift from goal-directed to habitual behavior is mediated in part by dopamine transmission in DS (Packard and White, 1991; Belin and Everitt, 2008). There are conflicting data on the development of habit formation in adolescent vs. adult rats. Adolescent rats demonstrate an inability to adjust responding to changes in contingency, as well as increased habitual behavior in a reinforcer devaluation task (Naneix et al., 2012; Hammerslag and Gulley, 2014). There is evidence for either behavioral rigidity or flexibility in adolescent rats on a set shifting task compared to adults, based on task design and parameters (Leslie et al., 2004; Newman and McGaughy, 2011; Snyder et al., 2014). More complex tasks appear to consistently yield greater levels of flexibility in adolescents. A four-choice reversal task, which requires a greater cognitive load than the standard two-choice set shifting design, revealed greater flexibility in adolescent compared to adult mice (Johnson and Wilbrecht, 2011). In addition, recent data demonstrate that, after learning to withhold an action in the presence of a cue, adolescent rats acquire that cue more quickly as a Pavlovian-conditioned stimulus predictive of reward, as assessed by an increase in reward approach behavior. This suggested that adolescents are able to rapidly adjust the value of a cue that was previous salient (which differs from reversal tasks, which typically involve attributing value to a previously unrewarded cue). A recent experiment in our lab tested this ability to adjust to changes in cue identity further by training rats in a cued instrumental paradigm, during which a 10 second cue (light or tone) was presented, and a nose poke into a lit port resulted in food pellet delivery. No difference in correct responses between adults and adolescents was observed in this task (F(1,12)=.23, p = .64; n=7/age group; Figure 2). In the second phase of this experiment, the instrumental cue was shifted in modality to a 10 second Pavlovian cue. After the shift in cue-outcome relationship, adolescents showed a higher percentage of Pavlovian approach during this cue than adults, as assessed by time spent in the food trough during the cue (F(1,12) = 6.96, p = .023; Figure 2). In a control experiment, adolescent and adult rats acquired Pavlovian approach to a novel cue at an equal rate, indicating that this effect was not related to an age related difference in the general ability to learn or perform Pavlovian conditioning (F(1,12)= .26, p = .62). These data, therefore, indicate that, when a cue acts as either a stop or go signal within an instrumental context, changes in cue-outcome relationships can be flexibly acquired by adolescent rats more quickly than adults. This characteristic of the adolescent brain would allow it to adjust to changes in value of previously salient cues or environments more efficiently than an adult brain. This is an interesting finding because much of the research on adolescents focuses on maladaptive behaviors, whereas behavioral flexibility is generally suggested to be an advantageous characteristic.
The summarized data suggest that adolescent rats may encode relationships between cues and outcomes in which cues were previously meaningful more flexibly than adults (Simon et al., 2013; Figure 2), or in situations with a higher cognitive load (Johnson and Wilbrecht, 2011). The hyper-responsivity observed in adolescent DMS during reward-related events (Sturman and Moghaddam, 2012) may promote increased ability to alter behavioral strategies (Kimchi and Laubach, 2009). It would be of interest to record from adolescent DLS, which is involved with the learning and expression of habitual behavior, to observe if this region is hypoactive compared to adults. Accelerated habit formation is proposed to promote addiction, as habitual drug seeking behavior is less sensitive to the negative consequences of drug abuse and addiction (Everitt et al., 2008; Hogarth et al., 2013). Thus, ongoing study of the role of the developing DS in habit formation is highly relevant toward the preponderance of adolescent drug addiction.
Both DS and VS are involved with risky decision-making (Cardinal, 2006; Simon et al., 2011; Kohno et al., 2013; Mitchell et al., 2014), defined as a preference for risky over safe rewards. Risky behavior is a hallmark of adolescence, and is linked to drug abuse (Bornovalova et al., 2005; Balogh et al., 2013). Moreover, recent evidence from a rat model of risky decision-making demonstrates that risky behavior in adolescents predicts cocaine self-administration (Mitchell et al., 2014), which may facilitate the drug abuse and addiction vulnerability during adolescence (Adriani and Laviola, 2004; Merline et al., 2004; Doremus-Fitzwater et al., 2010). Reduced dopamine receptor availability in both striatal regions is predictive of higher levels of risky decision-making in rats, and local infusion of selective dopamine agonists either systemically or into adolescent striatum reduces risky behavior (Simon et al., 2011; Mitchell et al., 2014). Accordingly, adolescent rats demonstrate reduced dopamine responsivity and TH expression in DS (Matthews et al., 2013), which may provide a partial mechanism for adolescent risky behavior. Risky decision-making also is associated with neuronal activity and dopamine receptor expression in OFC (Eshel et al., 2007; Van Leijenhorst et al., 2010; Simon et al., 2011; O'Neill and Schultz, 2013). It is possible that the hyperactive reward responses in both OFC and DS (Sturman and Moghaddam, 2011b, 2012) are related to the excessive and occasionally maladaptive risky decision-making during adolescence. Further study of this circuitry could yield interesting data and therapeutic options for the early stages of diseases characterized by risky behavior that manifest during adolescence, including addiction, schizophrenia and depression (Ludewig et al., 2003; Bornovalova et al., 2005; Taylor Tavares et al., 2007).
2.3. Ventral tegmental area
Dopamine neurons, especially those localized in ventral tegmental area (VTA), are involved with reward processing, associative learning, and the pathophysiology of addiction, mood disorders, and schizophrenia (Wise and Bozarth, 1985; Schultz, 1998; Wise, 2004; Sesack and Grace, 2010; Howes et al., 2012). The dopamine system has been implicated in adolescent behavioral and illness vulnerabilities (Luciana et al., 2012; Matthews et al., 2013; Niwa et al., 2013), and aspects of dopamine transmission and VTA activity are different in adults and adolescents (Robinson et al., 2011; McCutcheon et al., 2012; Matthews et al., 2013). In addition, dopamine neurons in VTA project to prefrontal cortex and ventral striatum, regions undergoing development during adolescence. Little is known, however, about how adolescent VTA neurons process reward related events compared to adults. Recent preliminary recording of extracellular activity from VTA neurons in adult and adolescent rats indicates that these neurons have similar basal firing rate and responding to reward related cues (Kim and Moghaddam, 2012), and work is ongoing that will assess adolescent reward processing in this, and other, dopaminergic regions.
2.4. Reward processing circuitry summary
Adolescents demonstrate enhanced impulsive behavior, risk taking, cue salience, drug and reward seeking, and behavioral flexibility compared to adults. As detailed above, single unit electrophysiology revealed age-related differences in reward processing that are likely involved with these behavioral tendencies. Adolescents demonstrate hyper-activation to reward relative to adults in both OFC and DS (Figure 3). The OFC directly projects to the DS, at least in adult rodents, suggesting that immature OFC-DS connectivity also may contribute to these observed effects (Berendse et al., 1992; Reep et al., 2003). Dopaminergic neurons projecting from the substantia nigra also project to DS (Voorn et al., 2004), and aberrant reward-evoked activity in these neurons may contribute to hyperactive DS reward processing in adolescence. The reduced dopamine efflux observed in DS following amphetamine exposure suggests that these neurons may indeed be hyperactive compared to adults, although further experiments are necessary to confirm this functional difference. Reward-evoked activity in DLS, which receives the strongest dopaminergic input from substantia nigra (Groenewegen, 2003; Voorn et al., 2004), also is likely to differ between adults and adolescents, as the development of behavioral habits varies across the lifespan (Johnson and Wilbrecht, 2011; Newman and McGaughy, 2011; Simon et al., 2013; Snyder et al., 2014).
Interestingly, no substantial age-related differences were observed in NAc reward processing, despite VS being a prominent factor in models of adolescent behavioral vulnerability (Ernst et al., 2009; Geier et al., 2010). This similar neural activity between age groups is consistent with reports of no age related differences in drug-evoked dopamine efflux in NAc (Frantz et al., 2007; Matthews et al., 2013), although studies about dopamine receptor expression in NAc are conflicting (Teicher et al., 1995; Tarazi and Baldessarini, 2000). The lack of differences in NAc reward-processing does not preclude the influence of the developing adolescent NAc on behavioral and psychopathology vulnerabilities; however, the observed differences in motivational processes during adolescence (Spear, 2011) may arise from functional neural activity in DS and PFC regions to a greater extent than NAc. Collectively, these finding suggest that the traditional brain reward circuitry should be modified for adolescents (Figure 3).
3. Conclusion
The findings reviewed here inform future adolescent research in two ways: (1) Baseline activity or response to sensory stimuli such as reward predicting cues are unaffected, or less affected, than neuronal processing around the time of reward. Thus, a focus on reward response may provide the ideal biomarker for early vulnerability to disorders of motivation and affect. (2) Robust neuronal responses were observed in regions that are not typically associated with reward processing in adults. Thus, the dynamic circuitry of motivated behavior may be different than our adult models and involve cortical and basal ganglia regions that are not classically associated with reward processing. Future emphasis on regions such as the DS may greatly enhance our knowledge of this dynamic circuitry and its contribution to disease vulnerability in at-risk individuals.
Highlights.
The adolescent brain processes rewards differently than in adults
These differences occur even when behavior is similar between age groups
DS was the locus of substantial developmental differences in reward activity
Surprisingly, differences were not as pronounced in VS
These differences may have implications for adolescent psychiatric vulnerability
Acknowledgements
This work was supported by DA 035050 (NWS) and MH048404-23 (BM).
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
4. Conflicts of Interest
The authors declare that there are no conflicts of interest.
References
- Adriani W, Laviola G. Elevated levels of impulsivity and reduced place conditioning with d-amphetamine: two behavioral features of adolescence in mice. Behav Neurosci. 2003;117:695–703. doi: 10.1037/0735-7044.117.4.695. [DOI] [PubMed] [Google Scholar]
- Adriani W, Laviola G. Windows of vulnerability to psychopathology and therapeutic strategy in the adolescent rodent model. Behav Pharmacol. 2004;15:341–352. doi: 10.1097/00008877-200409000-00005. [DOI] [PubMed] [Google Scholar]
- Ahn W-Y, Rass O, Fridberg DJ, Bishara AJ, Forsyth JK, Breier A, Busemeyer JR, Hetrick WP, Bolbecker AR, O'Donnell BF. Temporal discounting of rewards in patients with bipolar disorder and schizophrenia. Journal of Abnormal Psychology. 2011;120:911–921. doi: 10.1037/a0023333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Andersen SL, Dumont NL, Teicher MH. Developmental differences in dopamine synthesis inhibition by (+/−)-7-OH-DPAT. Naunyn-Schmiedeberg's archives of pharmacology. 1997;356:173–181. doi: 10.1007/pl00005038. [DOI] [PubMed] [Google Scholar]
- Andersen SL, Thompson AT, Rutstein M, Hostetter JC, Teicher MH. Dopamine receptor pruning in prefrontal cortex during the periadolescent period in rats. Synapse. 2000;37:167–169. doi: 10.1002/1098-2396(200008)37:2<167::AID-SYN11>3.0.CO;2-B. [DOI] [PubMed] [Google Scholar]
- Andrzejewski ME, Schochet TL, Feit EC, Harris R, Mc Kee BL, Kelley AE. A comparison of adult and adolescent rat behavior in operant learning, extinction, and behavioral inhibition paradigms. Behav Neurosci. 2011;125:93–105. doi: 10.1037/a0022038. [DOI] [PubMed] [Google Scholar]
- Anker JJ, Perry JL, Gliddon LA, Carroll ME. Impulsivity predicts the escalation of cocaine self-administration in rats. Pharmacol Biochem Behav. 2009;93:343–348. doi: 10.1016/j.pbb.2009.05.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balleine BW, O'Doherty JP. Human and rodent homologies in action control: Corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 2010;35:48–69. doi: 10.1038/npp.2009.131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balleine BW, Delgado MR, Hikosaka O. The Role of the Dorsal Striatum in Reward and Decision-Making. J Neurosci. 2007;27:8161–8165. doi: 10.1523/JNEUROSCI.1554-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balleine BW, Leung BK, Ostlund SB. The orbitofrontal cortex, predicted value, and choice. Ann N Y Acad Sci. 2011;1239:43–50. doi: 10.1111/j.1749-6632.2011.06270.x. [DOI] [PubMed] [Google Scholar]
- Balogh KN, Mayes LC, Potenza MN. Risk-taking and decision-making in youth: relationships to addiction vulnerability. Journal of behavioral addictions. 2013;2 doi: 10.1556/JBA.2.2013.1.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bechara A, Dolan S, Denburg N, Hindes A, Anderson SW, Nathan PE. Decision-making deficits, linked to dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia. 2001;39:376–389. doi: 10.1016/s0028-3932(00)00136-6. [DOI] [PubMed] [Google Scholar]
- Belin D, Everitt BJ. Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron. 2008;57:432–441. doi: 10.1016/j.neuron.2007.12.019. [DOI] [PubMed] [Google Scholar]
- Berendse HW, Galis-de Graaf Y, Groenewegen HJ. Topographical organization and relationship with ventral striatal compartments of prefrontal corticostriatal projections in the rat. The Journal of comparative neurology. 1992;316:314–347. doi: 10.1002/cne.903160305. [DOI] [PubMed] [Google Scholar]
- Berlin HA, Rolls ET, Kischka U. Impulsivity, time perception, emotion and reinforcement sensitivity in patients with orbitofrontal cortex lesions. Brain. 2004;127:1108–1126. doi: 10.1093/brain/awh135. [DOI] [PubMed] [Google Scholar]
- Bjork JM, Knutson B, Fong GW, Caggiano DM, Bennett SM, Hommer DW. Incentive-elicited brain activation in adolescents: similarities and differences from young adults. J Neurosci. 2004;24:1793–1802. doi: 10.1523/JNEUROSCI.4862-03.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bolanos CA, Glatt SJ, Jackson D. Subsensitivity to dopaminergic drugs in periadolescent rats: a behavioral and neurochemical analysis. Brain research Developmental brain research. 1998;111:25–33. doi: 10.1016/s0165-3806(98)00116-3. [DOI] [PubMed] [Google Scholar]
- Bornovalova MA, Daughters SB, Hernandez GD, Richards JB, Lejuez CW. Differences in impulsivity and risk-taking propensity between primary users of crack cocaine and primary users of heroin in a residential substance-use program. Experimental and Clinical Psychopharmacology. 2005;13:311–318. doi: 10.1037/1064-1297.13.4.311. [DOI] [PubMed] [Google Scholar]
- Brenhouse HC, Andersen SL. Delayed extinction and stronger reinstatement of cocaine conditioned place preference in adoelscent rats, compared to adults. Behav Neurosci. 2008;122:460–465. doi: 10.1037/0735-7044.122.2.460. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brenhouse HC, Sonntag KC, Andersen SL. Transient d1 dopamine receptor expression on prefrontal cortex projection neurons: relationship to enhanced motivational salience of drug cues in adolescence. J Neurosci. 2008;28:2375–2382. doi: 10.1523/JNEUROSCI.5064-07.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brenhouse HC, Dumais K, Andersen SL. Enhancing the salience of dullness: behavioral and pharmacological strategies to facilitate extinction of drug-cue associations in adolescent rats. Neuroscience. 2010;169:628–636. doi: 10.1016/j.neuroscience.2010.05.063. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burgos-Robles A, Bravo-Rivera H, Quirk GJ. Prelimbic and infralimbic neurons signal distinct aspects of appetitive instrumental behavior. PloS one. 2013;8:e57575. doi: 10.1371/journal.pone.0057575. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burton CL, Fletcher PJ. Age and sex differences in impulsive action in rats: The role of dopamine and glutamate. Behav Brain Res. 2012;230:21–33. doi: 10.1016/j.bbr.2012.01.046. [DOI] [PubMed] [Google Scholar]
- Buzsaki G. Large-scale recording of neuronal ensembles. Nat Neurosci. 2004;7:446–451. doi: 10.1038/nn1233. [DOI] [PubMed] [Google Scholar]
- Cao J, Lotfipour S, Loughlin SE, Leslie FM. Adolescent maturation of cocaine-sensitive neural mechanisms. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 2007;32:2279–2289. doi: 10.1038/sj.npp.1301349. [DOI] [PubMed] [Google Scholar]
- Cardinal RN. Neural systems implicated in delayed and probabilistic reinforcement. Neural Networks. 2006;19:1277–1301. doi: 10.1016/j.neunet.2006.03.004. [DOI] [PubMed] [Google Scholar]
- Casey BJ, Jones RM, Hare TA. The Adolescent Brain. Ann N Y Acad Sci. 2008;1124:111–126. doi: 10.1196/annals.1440.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Churchland MM, et al. Stimulus onset quenches neural variability: a widespread cortical phenomenon. Nat Neurosci. 2010;13:369–378. doi: 10.1038/nn.2501. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cooper JC, Knutson B. Valence and salience contribute to nucleus accumbens activation. NeuroImage. 2008;39:538–547. doi: 10.1016/j.neuroimage.2007.08.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- de Wit H. Impulsivity as a determinant and consequence of drug use: a review of underlying processes. Addict Biol. 2009;14:22–31. doi: 10.1111/j.1369-1600.2008.00129.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dickinson A. Actions and habits: the development of behavioral autonomy. Philosophical transactions of the Royal Society of London Series B, Biological sciences. 1985;308:67–78. [Google Scholar]
- Doherty JM, Cooke BM, Frantz KJ. A role for the prefrontal cortex in heroin-seeking after forced abstinence by adult male rats but not adolescents. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 2013;38:446–454. doi: 10.1038/npp.2012.200. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Doremus-Fitzwater TL, Varlinskaya EI, Spear LP. Motivational systems in adolescence: Possible implications for age differences in substance abuse and other risk-taking behaviors. Brain and cognition. 2010;72:114–123. doi: 10.1016/j.bandc.2009.08.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Doremus-Fitzwater TL, Barretto M, Spear LP. Age-related differences in impulsivity among adolescent and adult Sprague-Dawley rats. Behav Neurosci. 2012;126:735–741. doi: 10.1037/a0029697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eagle DM, Robbins TW. Inhibitory control in rats performing a stop-signal reaction-time task: effects of lesions of the medial striatum and d-amphetamine. Behav Neurosci. 2003;117:1302–1317. doi: 10.1037/0735-7044.117.6.1302. [DOI] [PubMed] [Google Scholar]
- Ernst M. The triadic model perspective for the study of adolescent motivated behavior. Brain and cognition. 2014;89:104–111. doi: 10.1016/j.bandc.2014.01.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ernst M, Pine DS, Hardin M. Triadic model of the neurobiology of motivated behavior in adolescence. Psychol Med. 2006;36:299–312. doi: 10.1017/S0033291705005891. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ernst M, Romeo RD, Andersen SL. Neurobiology of the development of motivated behaviors in adolescence: A window into a neural systems model. Pharmacol Biochem Behav. 2009;93:199–211. doi: 10.1016/j.pbb.2008.12.013. [DOI] [PubMed] [Google Scholar]
- Eshel N, Nelson EE, Blair J, Pine DS, Ernst M. Neural substrates of choice selection in adults and adolescents: development of the ventrolateral prefrontal and anterior cingulate cortices. Neuropsychologia. 2007;45:1270–1279. doi: 10.1016/j.neuropsychologia.2006.10.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Everitt BJ, Belin D, Economidou D, Pelloux Y, Dalley JW, Robbins TW. Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction. Philosophical Transactions of the Royal Society B: Biological Sciences. 2008;363:3125–3135. doi: 10.1098/rstb.2008.0089. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Flagel SB, Clark JJ, Robinson TE, Mayo L, Czuj A, Willuhn I, Akers CA, Clinton SM, Phillips PEM, Akil H. A selective role for dopamine in stimulus-reward learning. Nature. 2011;469:53–57. doi: 10.1038/nature09588. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Frantz KJ, O'Dell LE, Parsons LH. Behavioral and neurochemical responses to cocaine in periadolescent and adult rats. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 2007;32:625–637. doi: 10.1038/sj.npp.1301130. [DOI] [PubMed] [Google Scholar]
- Friemel CM, Spanagel R, Schneider M. Reward sensitivity for a palatable food reward peaks during pubertal developmental in rats. Frontiers in Behavioral Neuroscience. 2010;4 doi: 10.3389/fnbeh.2010.00039. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fries P. A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn Sci. 2005;9:474–480. doi: 10.1016/j.tics.2005.08.011. [DOI] [PubMed] [Google Scholar]
- Fuster JM. The prefrontal cortex--an update: time is of the essence. Neuron. 2001;30:319–333. doi: 10.1016/s0896-6273(01)00285-9. [DOI] [PubMed] [Google Scholar]
- Galvan A, Hare TA, Parra CE, Penn J, Voss H, Glover G, Casey BJ. Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents. J Neurosci. 2006;26:6885–6892. doi: 10.1523/JNEUROSCI.1062-06.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Garavan H, Stout JC. Neurocognitive insights into substance abuse. Trends in cognitive sciences. 2005;9:195–201. doi: 10.1016/j.tics.2005.02.008. [DOI] [PubMed] [Google Scholar]
- Geier CF, Terwilliger R, Teslovich T, Velanova K, Luna B. Immaturities in reward processing and its influence on inhibitory control in adolescence. Cereb Cortex. 2010;20:1613–1629. doi: 10.1093/cercor/bhp225. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gittis AH, Kreitzer AC. Striatal microcircuitry and movement disorders. Trends Neurosci. 2012;35:557–564. doi: 10.1016/j.tins.2012.06.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gladwin TE, Figner B, Crone EA, Wiers RW. Addiction, adolescence, and the integration of control and motivation. Developmental cognitive neuroscience. 2011;1:364–376. doi: 10.1016/j.dcn.2011.06.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goldman-Rakic PS. Cellular basis of working memory. Neuron. 1995;14:477–485. doi: 10.1016/0896-6273(95)90304-6. [DOI] [PubMed] [Google Scholar]
- Green L, Fry AF, Myerson J. Discounting of delayed rewards: a life-span comparison. Psychol Sci. 1994;5:33–36. [Google Scholar]
- Groenewegen HJ. The basal ganglia and motor control. Neural plasticity. 2003;10:107–120. doi: 10.1155/NP.2003.107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hammerslag LR, Gulley JM. Age and sex differences in reward behavior in adolescent and adult rats. Dev Psychobiol. 2014;56:611–621. doi: 10.1002/dev.21127. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hart G, Leung BK, Balleine BW. Dorsal and ventral streams: the distinct role of striatal subregions in the acquisition and performance of goal-directed actions. Neurobiol Learn Mem. 2014;108:104–118. doi: 10.1016/j.nlm.2013.11.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hogarth L, Balleine BW, Corbit LH, Killcross S. Associative learning mechanisms underpinning the transition from recreational drug use to addiction. Ann N Y Acad Sci. 2013;1282:12–24. doi: 10.1111/j.1749-6632.2012.06768.x. [DOI] [PubMed] [Google Scholar]
- Horga G, Abi-Dargham A. The striatum and dopamine: a crossroad of risk for schizophrenia. JAMA psychiatry. 2014;71:489–491. doi: 10.1001/jamapsychiatry.2014.191. [DOI] [PubMed] [Google Scholar]
- Howes OD, Kambeitz J, Kim E, Stahl D, Slifstein M, Abi-Dargham A, Kapur S. The nature of dopamine dysfunction in schizophrenia and what this means for treatment: Meta-analysis of imaging studies. Arch Gen Psychiatry. 2012;69:776–786. doi: 10.1001/archgenpsychiatry.2012.169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johnson C, Wilbrecht L. Juvenile mice show greater flexibility in multiple choice reversal learning than adults. Developmental cognitive neuroscience. 2011;1:540–551. doi: 10.1016/j.dcn.2011.05.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Juckel G, Friedel E, Koslowski M, Witthaus H, Ozgurdal S, Gudlowski Y, Knutson B, Wrase J, Brune M, Heinz A, Schlagenhauf F. Ventral striatal activation during reward processing in subjects with ultra-high risk for schizophrenia. Neuropsychobiology. 2012;66:50–56. doi: 10.1159/000337130. [DOI] [PubMed] [Google Scholar]
- Kalivas PW, Volkow ND. The neural basis of addiction: a pathology of motivation and choice. Am J Psychiatry. 2005;162:1403–1413. doi: 10.1176/appi.ajp.162.8.1403. [DOI] [PubMed] [Google Scholar]
- Kelley AE. Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning. Neuroscience and biobehavioral reviews. 2004;27:765–776. doi: 10.1016/j.neubiorev.2003.11.015. [DOI] [PubMed] [Google Scholar]
- Killcross S, Coutureau E. Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb Cortex. 2003;13:400–408. doi: 10.1093/cercor/13.4.400. [DOI] [PubMed] [Google Scholar]
- Kim Y, Moghaddam B. VTA neural responses are different between adolescent and adult rats during appetitive instrumental learning and extinction. Society for Neuroscience Abstracts. 2012 704.11/DDD73. [Google Scholar]
- Kimchi EY, Laubach M. Dynamic encoding of action selection by the medial striatum. J Neurosci. 2009;29:3148–3159. doi: 10.1523/JNEUROSCI.5206-08.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kimchi EY, Torregrossa MM, Taylor JR, Laubach M. Neuronal correlates of instrumental learning in the dorsal striatum. J Neurophysiol. 2009;102:475–489. doi: 10.1152/jn.00262.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kohno M, Ghahremani DG, Morales AM, Robertson CL, Ishibashi K, Morgan AT, Mandelkern MA, London ED. Risk-Taking Behavior: Dopamine D2/D3 Receptors, Feedback, and Frontolimbic Activity. Cereb Cortex. 2013 doi: 10.1093/cercor/bht218. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kota D, Sanjakdar S, Marks MJ, Khabour O, Alzoubi K, Damaj MI. Exploring behavioral and molecular mechanisms of nicotine reward in adolescent mice. Biochem Pharmacol. 2011;82:1008–1014. doi: 10.1016/j.bcp.2011.06.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kreitzer AC, Malenka RC. Striatal plasticity and basal ganglia circuit function. Neuron. 2008;60:543–554. doi: 10.1016/j.neuron.2008.11.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Leslie FM, Loughlin SE, Wang R, Perez L, Lotfipour S, Belluzzia JD. Adolescent development of forebrain stimulant responsiveness: insights from animal studies. Ann N Y Acad Sci. 2004;1021:148–159. doi: 10.1196/annals.1308.018. [DOI] [PubMed] [Google Scholar]
- Luciana M, Wahlstrom D, Porter JN, Collins PF. Dopaminergic modulation of incentive motivation in adolescence: age-related changes in signaling, individual differences, and implications for the devlopment of self-regulation. Dev Psychol. 2012;48:844–861. doi: 10.1037/a0027432. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ludewig K, Paulus MP, Vollenweider FX. Behavioural dysregulation of decision-making in deficit but not nondeficit schizophrenia patients. Psychiatry Res. 2003;119:293–306. doi: 10.1016/s0165-1781(03)00103-3. [DOI] [PubMed] [Google Scholar]
- Lynd-Balta E, Haber SN. The organization of midbrain projections to the striatum in the primate: sensorimotor-related striatum versus ventral striatum. Neuroscience. 1994;59:625–640. doi: 10.1016/0306-4522(94)90182-1. [DOI] [PubMed] [Google Scholar]
- Magno E, Foxe JJ, Molholm S, Robertson IH, Garavan H. The anterior cingulate and error avoidance. J Neurosci. 2006;26:4769–4773. doi: 10.1523/JNEUROSCI.0369-06.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mathews IZ, McCormick CM. Role of medial prefrontal cortex dopamine in age differences in response to amphetamine in rats: locomotor activity after intra-mPFC injections of dopaminergic ligands. Developmental neurobiology. 2012;72:1415–1421. doi: 10.1002/dneu.22000. [DOI] [PubMed] [Google Scholar]
- Matthews M, Bondi C, Torres GE, Moghaddam B. Reduced presynaptic dopamine activity in adolescent dorsal striatum. Neuropsychopharmacol. 2013;38:1344–1351. doi: 10.1038/npp.2013.32. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McCutcheon JE, Conrad KL, Carr SB, Ford KA, McGehee DS, Marinelli M. Dopamine neurons in the ventral tegmental area fire faster in adolescent rats than in adults. J Neurophysiol. 2012;108:1620–1630. doi: 10.1152/jn.00077.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mendez IA, Simon NW, Hart N, Mitchell MR, Nation JR, Wellman PJ, Setlow B. Self-administered cocaine causes lasting increases in impulsive choice in a delay discounting task. Behav Neurosci. 2010;124:470–477. doi: 10.1037/a0020458. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merline AC, O'Malley PM, Schulenberg JE, Bachman JG, Johnston LD. Substance use among adults 35 years of age: Prevalence, adulthood predictors, and impact of adolescent substance use. Am J Public Health. 2004;94:96–102. doi: 10.2105/ajph.94.1.96. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mitchell MR, Potenza MN. Addictions and personality traits: Impulsivity and related constructs. Current behavioral neuroscience reports. 2014;1:1–12. doi: 10.1007/s40473-013-0001-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mitchell MR, Weiss VG, Beas BS, Morgan D, Bizon JL, Setlow B. Adolescent risk taking, cocaine self-administration, and striatal dopamine signaling. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 2014;39:955–962. doi: 10.1038/npp.2013.295. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moghaddam B, Wood J. Teamwork matters: coordinated neuronal activity in brain systems relevant to psychiatric disorders. JAMA psychiatry. 2014;71:197–199. doi: 10.1001/jamapsychiatry.2013.2080. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Naneix F, Marchand AR, Di Scala G, Pape J-R, Coutureau E. Parallel maturation of goal-directed behavior and dopaminergic systems during adolescence. J Neurosci. 2012;32:16223–16232. doi: 10.1523/JNEUROSCI.3080-12.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Newman LA, McGaughy J. Adolescent rats show cognitive rigidity in a test of attentional set shifting. Dev Psychobiol. 2011;53:391–401. doi: 10.1002/dev.20537. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Niwa M, Jaaro-Peled H, Tankou S, Seshadri S, Hikida T, Matsumoto Y, Cascella NG, Kano S-i, Ozaki N, Nabeshima T, Sawa A. Adolescent stress–induced epigenetic control of dopaminergic neurons via glucocorticoids. Science. 2013;339:335–339. doi: 10.1126/science.1226931. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nolan KA, D'Angelo D, Hoptman MJ. Self-report and laboratory measures of impulsivity in patients with schizophrenia or schizoaffective disorder and healthy controls. Psychiatry Research. 2011;187:301–303. doi: 10.1016/j.psychres.2010.10.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- O'Neill M, Schultz W. Risk prediction error coding in orbitofrontal neurons. J Neurosci. 2013;33:15810–15814. doi: 10.1523/JNEUROSCI.4236-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Packard MG, White NM. Lesions of the caudate nucleus selectively impair “reference memory” acquisition in the radial maze. 1990;53:39–50. doi: 10.1016/0163-1047(90)90780-a. [DOI] [PubMed] [Google Scholar]
- Packard MG, White NM. Dissociation of hippocampus and caudate nucleus memory systems by posttraining intracerebral injection of dopamine agonists. Behav Neurosci. 1991;105:295–306. doi: 10.1037//0735-7044.105.2.295. [DOI] [PubMed] [Google Scholar]
- Packard MG, Knowlton BJ. Learning and memory functions of the basal ganglia. Annu Rev Neurosci. 2002;25:563–593. doi: 10.1146/annurev.neuro.25.112701.142937. [DOI] [PubMed] [Google Scholar]
- Perry JL, Nelson SE, Carroll ME. Impulsive choice as a predictor of acquisition of IV cocaine self-administration and reinstatement of cocaine-seeking behavior in male and female rats. Experimental and Clinical Psychopharmacology. 2008;16:165–177. doi: 10.1037/1064-1297.16.2.165. [DOI] [PubMed] [Google Scholar]
- Peters J, LaLumiere RT, Kalivas PW. Infralimbic prefrontal cortex is responsible for inhibiting cocaine seeking in extinguished rats. J Neurosci. 2008;28:6046–6053. doi: 10.1523/JNEUROSCI.1045-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pezze M, McGarrity S, Mason R, Fone KC, Bast T. Too little and too much: hypoactivation and disinhibition of medial prefrontal cortex cause attentional deficits. J Neurosci. 2014;34:7931–7946. doi: 10.1523/JNEUROSCI.3450-13.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Price JL. Definition of the orbital cortex in relation to specific connections with limbic and visceral structures and other cortical regions. Ann N Y Acad Sci. 2007;1121:54–71. doi: 10.1196/annals.1401.008. [DOI] [PubMed] [Google Scholar]
- Ragozzino ME. The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility. Ann N Y Acad Sci. 2007;1121:355–375. doi: 10.1196/annals.1401.013. [DOI] [PubMed] [Google Scholar]
- Reep RL, Cheatwood JL, Corwin JV. The associative striatum: organization of cortical projections to the dorsocentral striatum in rats. The Journal of comparative neurology. 2003;467:271–292. doi: 10.1002/cne.10868. [DOI] [PubMed] [Google Scholar]
- Robbins TW, Everitt BJ. Functions of dopamine in the dorsal and ventral striatum. 1992;4:119–127. [Google Scholar]
- Robbins TW, Everitt BJ. Neurobehavioural mechanisms of reward and motivation. Curr Opin Neurobiol. 1996;6:228–236. doi: 10.1016/s0959-4388(96)80077-8. [DOI] [PubMed] [Google Scholar]
- Robinson DL, Zitzman DL, Smith KJ, Spear LP. Fast dopamine release events in the nucleus accumbens of early adolescent rats. Neuroscience. 2011;176:296–307. doi: 10.1016/j.neuroscience.2010.12.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roesch MR, Olson CR. Neuronal activity in primate orbitofrontal cortex reflects the value of time. J Neurophysiol. 2005;94:2457–2471. doi: 10.1152/jn.00373.2005. [DOI] [PubMed] [Google Scholar]
- Roesch MR, Taylor AR, Schoenbaum G. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron. 2006;51:509–520. doi: 10.1016/j.neuron.2006.06.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rolls ET, Grabenhorst F. The orbitofrontal cortex and beyond: From affect to decision-making. Prog Neurobiol. 2008;86:216–244. doi: 10.1016/j.pneurobio.2008.09.001. [DOI] [PubMed] [Google Scholar]
- Schochet TL, Kelley AE, Landry CF. Differential expression of arc mRNA and other plasticity-related genes induced by nicotine in adolescent rat forebrain. Neuroscience. 2005;135:285–297. doi: 10.1016/j.neuroscience.2005.05.057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schoenbaum G, Takahashi Y, Liu T-L, McDannald MA. Does the orbitofrontal cortex signal value? Ann N Y Acad Sci. 2011;1239:87–99. doi: 10.1111/j.1749-6632.2011.06210.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schramm-Sapyta NL, Walker QD, Caster JM, Levin ED, Kuhn CM. Are adolescents more vulnerable to drug addiction than adults? Evidence from animal models. Psychopharmacology (Berl) 2009;206:1–21. doi: 10.1007/s00213-009-1585-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol. 1998;80:1–27. doi: 10.1152/jn.1998.80.1.1. [DOI] [PubMed] [Google Scholar]
- Sesack SR, Grace AA. Cortico-Basal Ganglia reward network: microcircuitry. Neuropsychopharmacol. 2010;35:27–47. doi: 10.1038/npp.2009.93. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Setlow B, Mendez IA, Mitchell MR, Simon NW. Effects of chronic administration of drugs of abuse on impulsive choice (delay discounting) in animal models. Behav Pharm. 2009;20:380–389. doi: 10.1097/FBP.0b013e3283305eb4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Simon NW, Mendez IA, Setlow B. Cocaine exposure causes long term increases in impulsive choice. Behav Neurosci. 2007;121:543–549. doi: 10.1037/0735-7044.121.3.543. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Simon NW, Gregory TA, Wood J, Moghaddam B. Differences in response inhibition and behavioral flexibility between adolescent and adult rats. Behav Neurosci. 2013;127:23–32. doi: 10.1037/a0031328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Simon NW, Montgomery KS, Beas BS, Mitchell MR, LaSarge CL, Mendez IA, Banuelos C, Vokes CM, Taylor AB, Haberman RP, Bizon JL, Setlow B. Dopaminergic modulation of risky decision-making. J Neurosci. 2011;31:17460–17470. doi: 10.1523/JNEUROSCI.3772-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Snyder KP, Barry M, Valentino RJ. Cognitive impact of social stress and coping strategy throughout development. Psychopharmacology (Berl) 2014 doi: 10.1007/s00213-014-3654-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Somerville LH, Hare T, Casey BJ. Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents. J Cognit Neurosci. 2011;23:2123–2134. doi: 10.1162/jocn.2010.21572. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sonntag KC, Brenhouse HC, Freund N, Thompson BS, Puhl M, Andersen SL. Viral over-expression of D1 dopamine receptors in the prefrontal cortex increase high-risk behaviors in adults: comparison with adolescents. Psychopharmacology (Berl) 2014;231:1615–1626. doi: 10.1007/s00213-013-3399-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sowell ER, Thompson PM, Holmes CJ, Jernigan TL, Toga AW. In vivo evidence for post-adolescent brain maturation in frontal and striatal regions. Nat Neurosci. 1999;2:859–861. doi: 10.1038/13154. [DOI] [PubMed] [Google Scholar]
- Spear LP. The adolescent brain and age-related behavioral manifestations. Neurosci Biobehav Rev. 2000;24:417–463. doi: 10.1016/s0149-7634(00)00014-2. [DOI] [PubMed] [Google Scholar]
- Spear LP. Rewards, aversions and affect in adolescence: Emerging convergences across laboratory animal and human data. Developmental cognitive neuroscience. 2011;1:390–403. doi: 10.1016/j.dcn.2011.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stanis J, Andersen S. Reducing substance use during adolescence: a translational framework for prevention. Psychopharmacology. 2014;231:1437–1453. doi: 10.1007/s00213-013-3393-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sturman DA, Moghaddam B. The neurobiology of adolescence: Changes in brain architecture, functional dynamics, and behavioral tendencies. Neurosci Biobehav Rev. 2011a;35:1704–1712. doi: 10.1016/j.neubiorev.2011.04.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sturman DA, Moghaddam B. Reduced Neuronal Inhibition and Coordination of Adolescent Prefrontal Cortex during Motivated Behavior. J Neurosci. 2011b;31:1471–1478. doi: 10.1523/JNEUROSCI.4210-10.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sturman DA, Moghaddam B. Striatum processes reward differently in adolescents versus adults. Proc Natl Acad Sci. 2012;109:1719–1724. doi: 10.1073/pnas.1114137109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sturman DA, Mandell DR, Moghaddam B. Adolescents exhibit behavioral differences from adults during instrumental learning and extinction. Behav Neurosci. 2010;124:16–25. doi: 10.1037/a0018463. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tarazi FI, Baldessarini RJ. Comparative postnatal development of dopamine D1, D2 and D4 receptors in rat forebrain. Int J Dev Neurosci. 2000;18:29–37. doi: 10.1016/s0736-5748(99)00108-2. [DOI] [PubMed] [Google Scholar]
- Tarazi FI, Tomasini EC, Baldessarini RJ. Postnatal development of dopamine and serotonin transporters in rat caudate-putamen and nucleus accumbens septi. Neurosci Lett. 1998;254:21–24. doi: 10.1016/s0304-3940(98)00644-2. [DOI] [PubMed] [Google Scholar]
- Taylor Tavares JV, Clark L, Cannon DM, Erickson K, Drevets WC, Sahakian BJ. Distinct profiles of neurocognitive function in unmedicated unipolar depression and bipolar II depression. Biological Psychiatry. 2007;62:917–924. doi: 10.1016/j.biopsych.2007.05.034. [DOI] [PubMed] [Google Scholar]
- Teicher MH, Andersen SL, Hostetter JC., Jr Evidence for dopamine receptor pruning between adolescence and adulthood in striatum but not nucleus accumbens. Dev Brain Res. 1995;89:167–172. doi: 10.1016/0165-3806(95)00109-q. [DOI] [PubMed] [Google Scholar]
- Thorn CA, Atallah H, Howe M, Graybiel AM. Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron. 2010;66:781–795. doi: 10.1016/j.neuron.2010.04.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Uhlhaas PJ, Singer W. Neuronal dynamics and neuropsychiatric disorders: toward a translational paradigm for dysfunctional large-scale networks. Neuron. 2012;75:963–980. doi: 10.1016/j.neuron.2012.09.004. [DOI] [PubMed] [Google Scholar]
- Ungerstedt U. Stereotaxic mapping of the monoamine pathways in the rat brain. Acta physiologica Scandinavica Supplementum. 1971;367:1–48. doi: 10.1111/j.1365-201x.1971.tb10998.x. [DOI] [PubMed] [Google Scholar]
- van Duuren E, Escamez FAN, Joosten RNJMA, Visser R, Mulder AB, Pennartz CMA. Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task. Learn Memory. 2007;14:446–456. doi: 10.1101/lm.546207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Leijenhorst L, Gunther Moor B, Op de Macks ZA, Rombouts SA, Westenberg PM, Crone EA. Adolescent risky decision-making: neurocognitive development of reward and control regions. NeuroImage. 2010;51:345–355. doi: 10.1016/j.neuroimage.2010.02.038. [DOI] [PubMed] [Google Scholar]
- Volz TJ, Farnsworth SJ, Rowley SD, Hanson GR, Fleckenstein AE. Age-dependent differences in dopamine transporter and vesicular monoamine transporter-2 function and their implications for methamphetamine neurotoxicity. Synapse. 2009;63:147–151. doi: 10.1002/syn.20580. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Voorn P, Vanderschuren LJ, Groenewegen HJ, Robbins TW, Pennartz CM. Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci. 2004;27:468–474. doi: 10.1016/j.tins.2004.06.006. [DOI] [PubMed] [Google Scholar]
- Walker QD, Kuhn CM. Cocaine increases stimulated dopamine release more in periadolescent than adult rats. Neurotoxicol Teratol. 2008;30:412–418. doi: 10.1016/j.ntt.2008.04.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Walker QD, Morris SE, Arrant AE, Nagel JM, Parylak S, Zhou G, Caster JM, Kuhn CM. Dopamine uptake inhibitors but not dopamine releasers induce greater increases in motor behavior and extracellular dopamine in adolescent rats than in adult male rats. J Pharmacol Exp Ther. 2010;335:124–132. doi: 10.1124/jpet.110.167320. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Winstanley CA. The orbitofrontal cortex, impulsivity, and addiction: Probing orbitofrontal dysfunction at the neural, neurochemical, and molecular level. Ann NY Acad Sci. 2007;1121:639–655. doi: 10.1196/annals.1401.024. [DOI] [PubMed] [Google Scholar]
- Winstanley CA, Zeeb FD, Bedard A, Fu K, Lai B, Steele C, Wong AC. Dopaminergic modulation of the orbitofrontal cortex affects attention, motivation and impulsive responding in rats performing the five-choice serial reaction time task. Behav Brain Res. 2010;210:263–272. doi: 10.1016/j.bbr.2010.02.044. [DOI] [PubMed] [Google Scholar]
- Wise RA. Dopamine, learning and motivation. Nat Rev Neurosci. 2004;5:483–494. doi: 10.1038/nrn1406. [DOI] [PubMed] [Google Scholar]
- Wise RA, Bozarth MA. Brain mechanisms of drug reward and euphoria. Psychiatric medicine. 1985;3:445–460. [PubMed] [Google Scholar]
- Wood J, Kim Y, Moghaddam B. Disruption of prefrontal cortex large scale neuronal activity by different classes of psychotomimetic drugs. J Neurosci. 2012;32:3022–3031. doi: 10.1523/JNEUROSCI.6377-11.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yin HH, Knowlton BJ. Contributions of striatal subregions to place and response learning. Learn Mem. 2004;11:459–463. doi: 10.1101/lm.81004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yin HH, Knowlton BJ, Balleine BW. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci. 2004;19:181–189. doi: 10.1111/j.1460-9568.2004.03095.x. [DOI] [PubMed] [Google Scholar]
- Yin HH, Mulcare SP, Hilario MR, Clouse E, Holloway T, Davis MI, Hansson AC, Lovinger DM, Costa RM. Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat Neurosci. 2009;12:333–341. doi: 10.1038/nn.2261. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zeeb F, Floresco S, Winstanley C. Contributions of the orbitofrontal cortex to impulsive choice: interactions with basal levels of impulsivity, dopamine signalling, and reward-related cues. Psychopharmacology. 2010;211:87–98. doi: 10.1007/s00213-010-1871-2. [DOI] [PubMed] [Google Scholar]