SUMMARY
The nucleus accumbens (NAc) and the dynorphinergic system are widely implicated in motivated behaviors. Prior studies have shown that activation of the dynorphin-kappa opioid receptor (KOR) system leads to aversive, dysphoria-like behavior. However, the endogenous sources of dynorphin in these circuits remain unknown. We investigated whether dynorphinergic neuronal firing in the NAc is sufficient to induce aversive behaviors. We found that photostimulation of dynorphinergic cells in the ventral NAc shell elicits robust conditioned and real-time aversive behavior via KOR activation, and in contrast, photostimulation of dorsal NAc shell dynorphin cells induced a KOR-mediated place preference and were positively reinforcing. These results show previously unknown discrete subregions of dynorphin-containing cells in the NAc shell that selectively drive opposing behaviors. Understanding the discrete regional specificity by which NAc dynorphinerigic cells regulate preference and aversion provides insight into motivated behaviors that are dysregulated in stress, reward, and psychiatric disease.
INTRODUCTION
It is now widely thought that many mood disorders are associated with major disruption of the brain's reward circuitry. The nucleus accumbens (NAc) is a key region in this circuit with major projections from the ventral tegmental area (VTA), medial prefrontal cortex (mPFC), basolateral amygdala (BLA), and hippocampus (Britt et al., 2012; Russo and Nestler, 2013). Recent studies have identified the striatum as crucial for integrating behavioral responses to both positive and negative reinforcement (Castro and Berridge, 2014; Everitt and Robbins, 2005; Kravitz et al., 2012). For example, NAc neuronal activity is consistently reduced in major depression in humans (Drevets et al., 1992; Mayberg et al., 2000) and is thought to reflect a loss of reward function that drives common symptoms such as anhedonia (Russo and Nestler, 2013). In order to better understand these processes, it is important to dissect how neuromodulator systems within specific brain subnuclei function to influence negative emotional states, represented by changes in motivated behavior.
The kappa opioid receptor (KOR) system has been identified as one such prominent neuromodulator system in the regulation of motivated behavior and is highly implicated in stress-induced dysphoria and vulnerability to drug abuse. KORs are endogenously activated by the peptide dynorphin (dyn), which is cleaved from the precursor prodynorphin (Chavkin et al., 1982). Dyn is widely known to mediate negative emotional states; for example, KOR agonists induce place aversions, depression-like behavior, and dysphoria in both human and animal models (Mucha et al., 1985; Pfeiffer et al., 1986; Shippenberg et al., 2007). Notably, direct infusion of KOR agonists into the NAc mediates conditioned place aversion (Bals-Kubik et al., 1989), and local antagonism of KOR in this region prevents depression-like behavioral responses (Land et al., 2009; Shirayama et al., 2004). Furthermore, dyn-containing axon terminals and cell bodies are located in the NAc (Van Bockstaele et al., 1995), and a number of studies have shown recruitment of the dyn/KOR system within the NAc following compulsive drug taking (Daunais et al., 1993; Fagergren et al., 2003; Hurd et al., 1992; Lindholm et al., 2000; Schlussman et al., 2005; Solecki et al., 2009). It is thought that monoamine output within the NAc is tightly regulated via presynaptic KORs on serotonergic and dopaminergic cells in the region, ultimately acting to suppress release of dopamine and serotonin. However, the mechanisms and role of endogenous dyn in the regulation of KOR-mediated negative affective behaviors remain unresolved (Bruchas et al., 2010, 2011).
Here we directly ascertained the sufficiency of the photostimulation of dyn-expressing cells within the NAc shell (NAcSh) to drive motivated behaviors. We hypothesized that photostimulation of dyn-expressing cells the NAcSh will drive an aversion behavior in a real-time place-testing paradigm (RTPT) using a combination of bidirectional wireless μ-ILED optogenetic technology, a conditioned place-testing paradigm and operant self-stimulation. Here we report a distinct subpopulation of ventral NAc dyn-expressing cells that when photostimulated produce robust aversive behavioral responses, whereas photostimulation of dyn-expressing cells in a nearby dorsal NAc site engages positively reinforced motivated behaviors, both of which of require KOR activation.
RESULTS
Dyn-tdTomato-Reporter Mouse Allows Visualization of Dynorphin-Containing Cells
To determine key sites of dyn influence throughout the brain, we generated a dyn-tdTomato-reporter mouse by crossing preprodynorphin-IRES-cre (dyn-IRES-cre) mice (Krashes et al., 2014) to the Allen Institute for Brain Science tdTomato flox-stop reporter line (Ai9) (Madisen et al., 2010) (Figures 1A and S1). This new mouse line (dyn-cretdTomato) is useful for cre-dependent expression/excision in selected dyn-circuits and provides a representative map of dyn-expressing cells, dyn axon projections, and terminal fields. We first characterized dyn expression across the full brain of these mice, comparing our dyn-cretdTomato expression with in situ hybridization data (Figures 1B and 1C) to confirm soma-specific labeling in well-known dyn-enriched regions. Using dyn-cretdTomato mice, we visualized an abundance of dyn-containing cells within the NAc, in line with current literature (Figures 1B and 1C). In addition, we found robust dyn-induced tdTomato expression in the hippocampus, bed nucleus of the stria terminalis, BLA, central nucleus of the amygdala, throughout the cortex, caudate putamen, globus pallidus, VTA and the substania nigra, dorsal raphe, and locus coeruleus (Figures S1A–S1E).
Figure 1. Dyn-tdTomato-Reporter Mouse Allows Visualization of Dynorphin-Containing Cells.
(A) Diagram showing the generation of the dyn-CretdTomato mouse line from the cross between the dyn-IRES-cre × Ai9-tdTomato.
(B) Dyn labeling in dyn-IRES-cre × Ai9-tdTomato compared to in situ images from the Allen Institute for Brain Science in a sagittal section highlighting presence of dyn in the striatum, the hippocampus, BNST, amygdala, hippocampus, and substantia nigra. All images show tdTomato (red) and Nissl (blue) staining.
(C) Coronal section highlighting dynorphinergic cell labeling in the NAc as compared to the Allen Institute for Brain Science.
(D) Images of nissl (blue), tdtomato (red), and dyn (green) and a merge of all three in the NAcSh (63× magnification) (AP+1.3, ML ±0.5, DV–4.5). All scale bars are 100 μm.
(E) Cells labeled with anti-dyn antisera also all express tdtomato represented as co-expression (%). This is significant when compared to dyn/nissl co-localization (data represented as mean ± SEM, n = 3 slices per animal from three animals per group: one way ANOVA, Bonferroni post hoc, dyn/nissl versus dyn/tdtomato, dyn/nissl versus no1°/Nissl, tdTomato/Nissl td/Tomato/dyn, and tdTomato/Dyn versus no1°/tdTomato, ****p < 0.0001).
To further validate our reporter mouse, we first examined whether both dyn- and tdTomato-labeled cells are expressed in the same number of nissl-labeled cells within the NAcSh. In these experiments, we found that 100% of cells labeled with the anti-dyn antisera also express tdTomato (Figures 1D, 1E, and S1F). This was statistically significant and highly conserved, as not all dyn-labeled cells overlaid with all the nissl-labeled cells. We also ran a negative control in which the primary antibody was absent, further confirming the integrity of the anti-dyn antisera (Figures 1E and S1F). These findings support the conclusion that the dyn-cretdTomato mouse line reliably labels dyn-containing cells in the NAc.
Photostimulation of Dyn-Containing Cells Elicits Action Potential Firing and Release of Dynorphin
Due to the relative novelty of this dyn-cre mouse line, we first determined whether photostimulation of dyn-containing cells could elicit robust action potentials at multiple frequencies in slice. We injected AAV5-DIO-ChR2-eYFP into the NAc of dyn-cre mice (Figure 2A) and performed whole-cell electrophysiology. We found intact spike fidelity at frequencies of 5 Hz, 10 Hz, and 20 Hz (1 ms, 5 ms, and 10 ms pulse width), which was not stably maintained at 40 Hz (Figures 2B–2F, S2A, and S2B). Importantly, we also demonstrate that when we pulse blue light on cells that express ChR2, we see reliable spiking in current clamp; however, when we pulse blue light on cells that do not express ChR2 in close proximity, we see no effects in current clamp, supporting the notion that interactions between dyn-positive cells and neighboring medium spiny neurons (MSNs) or cholinergic neurons are not observed under these photostimulation conditions. We then performed several experiments in voltage clamp in non-ChR2-expressing neurons and found evidence for local GABA release onto these non-ChR2 neurons, consistent with models that suggest different populations of MSNs can inhibit each other (Figure S2C).
Figure 2. Photostimulation of Dyn-Containing Cells Elicits Action Potential Firing and Release of Dynorphin.
(A) Cartoon of virus and fiber optic placement.
(B–E) Whole-cell slice recording showing light-evoked action potentials in dyn-cre ChR2+ and ChR2− cells in the vNAcSh using a 10-ms pulse width at 5, 10, 20, and 40 Hz.
(F) Summary graph showing loss of spike fidelity at 40 Hz and no apparent change in spike fidelity at 1, 5, or 10 ms pulse width.
(G) Timeline used to collect samples and measure dyn release using an ELISA protocol.
(H) Photostimulation of dyn-expressing ChR2+ cells in the NAcSh increases the concentration of dyn when compared to non-ChR2-expressing cells in dyn-cre− animals (data represented as mean ± SEM, n = 2/group with eight replicates in each group: Student's t test ****p < 0.0001).
To ascertain whether photostimulation of these cells could lead to dyn release at a frequency of 10 Hz (10 ms pulse width), we established an optogenetically induced neuropeptide release ELISA in tissue slice. Here we show that photostimulation of ChR2-expressing neurons in the NAcSh of dyn-cre mice significantly increases the release of dyn compared to non-ChR2-expressing neurons in controls (dyn-cre− mice) (Figures 2G, 2H, and S2D). Taken together, these data support the conclusion that we can reliably drive dynorphinergic tone in dyn-expressing cells in the NAc.
Activation of Dynorphinergic Cells in the NAcSh Drives Both Aversion and Reward
Prior reports have suggested that the dyn/KOR system mediates negative emotional states associated with depression and drug dependence through increased dyn expression and release in the NAc, contributing to the dysphoria. However, the endogenous source of dyn in these responses has not been shown (Britton et al., 1982; Bruchas et al., 2010; Knoll et al., 2011; Lindholm et al., 2000; Mucha et al., 1985; Pfeiffer et al., 1986; Rylkova et al., 2009; Schlosburg et al., 2013; Shippenberg et al., 2007). Given the location of dyn-expressing cells in the NAc, we first hypothesized that photostimulation of NAc-dyn neurons would produce aversive behaviors. To test this hypothesis, we injected AAV5-DIO-ChR2-eYFP, chronically implanted a fiber optic into the NAcSh of dyn-cre+ and dyn-cre− mice (controls), and used an RTPT (Figure 3A). During this 20-min behavioral test, photostimulation occurs in real-time only upon entry into the counterbalanced designated chamber (Carter et al., 2010; Siuda et al., 2015a; Stamatakis and Stuber, 2012; Tan et al., 2012). Behavioral data were then calculated as time spent in the photostimulation-paired chamber, expressed as a percentage of total time. In this experiment we also assessed the efficacy of photostimulated cell firing in vivo in producing real-time behavioral responses, as compared to the in vitro whole-cell recordings. In accordance with our hypothesis, we found that photostimulation of dyn-expressing cells in the NAcSh over the same range of frequencies (5 Hz, 10 Hz and 20 Hz with an 10 ms pulse width) produced a significant real-time aversion behavior, which plateaued at 40 Hz, correlating with the in vitro whole-cell recordings (Figure 3B). Interestingly we also observed a subgroup of mice that showed a robust preference behavior when compared to controls. To further validate this apparent divergence in behavior, we performed a D'agostino and Pearson Omnibus normality test, which established that these data are not normally distributed (p < 0.001) and are bimodal. This allowed us to further classify the data into two separable groups. To investigate what may drive these opposing behavioral states, we carefully examined the anatomical distribution of viral expression within the NAcSh of each individual mouse and group. Interestingly, we identified that mice exhibiting a preference behavior showed isolated dorsal viral expression in the NAcSh, whereas mice exhibiting an aversion behavior showed a more ventral pattern of viral expression (Figures 3C and S3A). Using a Spearman rank correlation test, we show that the level of preference/aversion (expressed as percent time in stimulation side) in each individual mouse is positively correlated (r = 0.8895) with the location of both viral expression and fiber optic placement along the dorsal-ventral axis (Figures 3D and S3B). Here we report that photostimulation of dyn-expressing cells at −4.60 mm to −5.00 mm from bregma drives an aversion behavior whereas photostimulation of dyn-expressing cells at −4.00 mm to −4.30 mm drives a preference behavior. We therefore classified these two groups as “averters” or “preferers.”
Figure 3. Activation of Dynorphinergic Cells in the NAcSh Drives Both Aversion and Reward.
(A) Calendar outlining experimental procedure of the RTPT.
(B) Frequency response curve (10, 20, and 40 Hz stimulation; 10 ms pulse width) showing two distinctly responding groups. One group spent significantly more time in the photostimulation side (preference), and the other spent more time in the non-stimulated side aversion (data represented as mean ± SEM, n = 7–10).
(C) Scatter plot of individual mice that exhibit a preference behavior, show dorsal ChR2 expression, or an aversion behavior, show more ventral ChR2 expression, following 10 Hz, 10 ms pulse width photostimulation (n = 7–10). Nissl (blue) and ChR2 (green).
(D) Scatter plot showing the level of preference in each individual mouse is positively correlated with fiber tip placement (data represented as mean ± SEM, n = 7–10: Spearman positive correlation, r = 0.8895).
(E) At 10 Hz preferers and averters show a significant preference or aversion compared to each another and controls (data represented as mean ± SEM, n = 5–11: one-way ANOVA, Bonferroni post hoc, control versus preferers ****p < 0.0001, control versus averters ****p < 0.01, preferers versus averters ****p < 0.0001).
(F) At 20 Hz preferers and averters show a significant preference or aversion compared to one another and controls (data represented as mean ± SEM, n = 6: one-way ANOVA, Bonferroni post hoc, control versus preferers ****p < 0.0001, control versus averters **p < 0.001, preferers versus averters ****p < 0.0001).
Following the identification of two distinct and opposing groups, we analyzed the efficacy of photostimulation frequency to drive these behaviors. We found that both 10 Hz and 20 Hz stimulation produced a real-time place preference in mice with more dorsal viral expression and fiber optic placement, and in contrast, this stimulation pattern elicited an aversion in mice with ventral viral expression and fiber optic placement. These were significantly different from one another and both were significantly different when compared to dyn-cre− controls injected with AAV5-DIO-ChR2-eYFP (Figures 3E and 3F). These results suggest that photostimulation of dyn-expressing cells in discrete subregions within the NAcSh can drive opposing behaviors with distinct positive (dorsal) or negative (ventral) valence as measured by a real-time place preference or real-time place aversion, respectively.
Spatially Discrete Targeting of NAc Dyn-Containing Cells Can Engage Either Preference or Aversion in the Same Animal
To further investigate the subregional distinction in behavior within the NAcSh and to enable precise, discrete spatial targeting, we used a new modified form of our recently developed wireless μ-ILED devices (Jeong et al., 2015; Kim et al., 2013; McCall et al., 2013). We reconfigured the original wireless μ-ILED devices to produce a device that allows isolated and directionally controlled light to specific NAc subregions. In this case, we positioned one μ-ILED to target the dorsal NAcSh (dNAcSh) and the other the ventral NAcSh (vNAcSh), separated by a distance of 1 mm (Figures 4A, 4B, S4A, and S4B). These devices are wirelessly controlled using a radio frequency (RF) power source, which can either activate each μ-ILED independently or both simultaneously (Figures 4B and S4B). These devices provide discrete spatial targeting and importantly allow for selective regional photostimulation within the same individual mouse. Following injection of AAV5-DIO-ChR2-eYFP into the NAcSh of dyn-cre+ and dyn-cre− mice, with expression spanning both dorsal and ventral coordinates, devices were implanted into mice and used in the real-time place preference paradigm (Figure 4C). Here we show that within the same mouse we can selectively photostimulate the ventral NAc, to produce a real time aversion; photostimulate the dNAcSh, to drive a real time preference; or both regions together, which does not elicit either behavior (Figures 4D–4F). In addition, photostimulation of dyn-expressing cells in either the dorsal or the vNAcSh does not induce any significant changes in locomotor activity compared to controls (Figure S4E). In addition, we investigated whether targeting these distinct regions in the NAc induced anxiety behavior, as recent reports have implicated the KOR/dyn system in anxiety-like behavioral responses (Bruchas et al., 2009; Knoll et al., 2011). Consistent with prior reports that identified the BLA and the central nucleus of the amygdala as key KOR-expressing regions involved in anxiety-like behaviors, we found that stimulating dyn-containing cells in either dorsal or ventral NAcSh did not induce anxiety-like behavior in an open field anxiety-like behavioral paradigm (Figures S4F–S4I).
Figure 4. Discrete Spatial Targeting Drives Preference and Aversion in the Same Animal.
(A) Directionally controlled light spread of μ-ILED devices compared to fiber optics for isolating subregions of NAc as demonstrated in the fluorescein.
(B) Images of an ultrathin (~10–50 μm), flexible integrated system. Light can be isolated to either dorsal or ventral NAcSh
(C) Behavioral calendar of the experimental procedure.
(D) Examples of real-time mouse behavioral traces following no stimulation, ventral or dorsal wireless photostimulation, and ventral and dorsal photostimulation together.
(E) Aversion and preference real-time behavior following stimulation of the ventral and dNAcSh within each individual mouse (data represented as mean ± SEM, n = 11: Student's t test, ***p < 0.001).
(F) Stimulation with dorsal μ-ILED drives a real-time place preference, but stimulation with ventral μ-ILED drives an aversion, measured as a significant increase or decrease in time spent in the stimulation side (%), respectively. Stimulating both ventral and dorsal μ-ILEDs has no significant effect on behavior. (Data represented as mean ± SEM, n = 11: one sampled Student's t test; ****p < 0.0001 dorsal and ***p < 0.001 ventral.)
Together, these data support the hypothesis that activation of dyn-expressing cells in the vNAcSh drives an aversion behavior and cells in the dNAcSh drives a preference. Bidirectional μ-ILED control adds confidence to the current findings and suggests that stimulation of the subsets of neurons within the NAc dynorphinergic system is capable of dynamic engagement of either positive or negative valence in the same mouse. Furthermore, because these devices are ultrathin, minimally invasive (Jeong et al., 2015; Kim et al., 2013; McCall et al., 2013), and target both dorsal and ventral NAcSh, there is limited likelihood that dorsal lesions from our earlier fiber optic implantation influence the observed behavioral responses.
Dynorphin mRNA-Positive Neurons Colocalize with Drd1-Positive Neurons, but Not with Drd2-Positive Neurons in Both the dNAcSh and vNAcSh
To understand how different populations of dyn-expressing cells with the dorsal or vNAcSh are able to drive opposing behaviors, we explored the colocalization of dyn with known dopaminergic receptors using mRNA in situ hybridization. It is widely known that dyn is locally expressed in MSNs within the NAc that coexpress dopamine D1 receptors (Ghazarossian et al., 1980; Raynor et al., 1994), but the discrete regions within the NAcSh identified here have not been extensively examined in this respect. We hypothesized that dopamine D1/Dyn co-expression may differ between the dorsal and ventral sites, which may explain the opposing preference and aversion behaviors. However, we found that there was no significant difference in the number of dyn mRNA-expressing neurons between the dNAcSh and vNAcSh (Figure 5A– 5C, S5A, and S5B). This agreed with our anti-dyn staining where there was also no significant difference in dyn-labeled cells in the dorsal and ventral shell (Figure 5D). Both dorsal and ventral dyn mRNA+ neurons in the NAcSh also show increased colocalization (92%) with Drd1-containing neurons compared to Drd2-containing neurons (7%) (Figures 5A, 5B, 5D, S5A, and S5B). These data support the conclusion that colocalization of dyn with D1 receptors is not differentially segregated within these regions of the NAcSh and is therefore unlikely to be responsible for the opposing behaviors we observed.
Figure 5. Dyn mRNA+ Neurons Colocalize with Drd1+ Neurons, but Not with Drd2+ Neurons in Both the Dorsal and vNAcSh.
(A) Cartoon depicting the anatomical location of the dorsal (blue) subregion of the NAcSh corresponding to images as well as quantification. Representative 40× images of pDyn (green), Drd1 (red), and Drd2 (purple) mRNA expression in the dorsal shell.
(B) Cartoon depicting the anatomical location of the ventral (red) subregions of the NAcSh corresponding to microscope images as well as quantification. Representative 40× images of pDyn (green), Drd1 (red), and Drd2 (purple) mRNA expression in the ventral shell.
(C) No significant difference in dyn mRNA-expressing neurons between the dNAcSh and vNAcSh.
(D) No significant difference in anti-dyn antisera-positive cells in the dNAcSh or vNAcSh (data represented as mean ± SEM, n = 3).
(E) Dorsal and ventral NAcSh dyn mRNA+ neurons show increased colocalization with Drd1-containing neurons compared to Drd2-containing neurons. (Data represented as mean ± SEM, n = 5, ****p < .0001, one-way ANOVA, Bonferroni post hoc.)
Aversion and Preference Following Photostimulation of dyn-Expressing Neurons in the NAcSh Requires KOR Activity
Current research indicates a role for NAc KORs in aversive negative affective behaviors involved in stress, dysphoria, and drug abuse (Bals-Kubik et al., 1989; Land et al., 2009; Mucha et al., 1985; Shippenberg et al., 2007; Solecki et al., 2009). Therefore, we hypothesized that activation of KORs following the photostimulated release of dyn in the ventral NAc is one of the key underlying mechanisms for the observed aversion behavior.
From this point onward we modified our viral injection volume and coordinates to specifically target either the dorsal or vNAcSh. We also injected AAV5-DIO-ChR2-eYFP into dyn-cre− control mice in either the dorsal and ventral NAc and saw no effect of photostimulation in either group. Based on the results from our whole-cell slice recordings and in vivo frequency response data, we photostimulated at 10 Hz with a 10-ms pulse width to elicit action potential firing, remain physiologically relevant, and maintain reliable spike fidelity. We first assessed how photostimulation of dyn-expressing cells in the vNAcSh drives an aversion in a conditioned place-testing paradigm. This Pavlovian conditioning behavioral model is used to measure the motivational or aversive effects of an associated experience. The key component of this model is the learning aspect, which was absent in our RTPT paradigm (Figure 6A). We found that in a real-time Y-maze conditioning paradigm (Figure 6A) we are able to condition mice to the photostimulation of dyn-expressing cells in the vNAcSh to drive a learned aversion behavior, which is consistent with our earlier findings. In addition, conditioned photostimulation of dNAcSh was able to drive a significant preference behavior when compared to either controls or one another (Figures 6B and 6C).
Figure 6. Preference and Aversion Following Photostimulation of Dyn-Containing Neurons in the Dorsal and vNAcSh Requires KOR Activity.
(A) Calendar outlining the Y-maze paradigm.
(B) Representative activity heat maps from all groups during post-test.
(C) Change from baseline in dorsal, ventral, and control mice measured across all 5 days of the Y-maze paradigm (data represented as mean ± SEM, n = 8–13, two-way ANOVA, interaction effect between groups and days, p < 0.0001).
(D) Change from baseline in NorBNI+dorsal, NorBNI+ventral, and NorBNI alone mice measured across all 5 days of the Y-maze paradigm (data represented as mean ± SEM, n = 8–13).
(E) Change in percent time spent in conditioned arm of the Y-maze in all groups (data represented as mean ± SEM, n = 8–13; one-way ANOVA, Bonferroni post hoc, control versus dorsal **p < 0.01, Control versus ventral *p < 0.05, dorsal versus ventral ****p < 0.0001, control versus NorBNI alone ns, dorsal versus NorBNI ***p < 0.001, dorsal versus dorsal+NorBNI ##p < 0.01, ventral versus ventral NorBNI #p < 0.05).
To test the hypothesis that the aversion behavior is mediated by the release of dyn from cells within the vNAcSh acting on local KORs, we locally infused the long-acting KOR antagonist NorBNI (2.5 μg/1 μl) (Bruchas et al., 2007; Al-Hasani et al., 2013a; Melief et al., 2010) into the vNAcSh 14 days after site-specific AAV5-DIO-ChR2-eYFP injection in to the vNAcSh (Figure 6A). Importantly, injection of NorBNI into the vNAcSh was able to significantly block the aversion following photostimulation of dyn-expressing cells (Figures 6B, 6D, and 6E) with no observed change in locomotor activity (Figure S6C). A group of dyn-cre− mice was injected with NorBNI as a control to ensure that NorBNI has no baseline effect on learning. These mice were statistically identical to the controls (Figures 6B, 6D, and 6E). These findings suggest that the aversion behavior mediated following photostimulation of dyn-expressing cells in the vNAcSh is in fact KOR mediated, acting locally within the NAc itself, consistent with prior studies using exogenous agonist and antagonist infusions within this region (Castro and Berridge, 2014; Land et al., 2009; Shippenberg et al., 2007). Interestingly, and somewhat unexpectedly, we also observed that NorBNI was able to block the preference behavior observed following photostimulation of dyn-expressing in the dNAcSh (Figures 6B, 6D, and 6E). This finding, while surprising, is supported by the recent findings of Castro and Berridge (2014), who show that agonist activation of KOR in discrete regions of the NAc can drive preference/appetitive behaviors.
Distinct NAc Dyn Populations in Operant Stimulation Produce Positive and Negative Responses
The operant self-stimulation paradigm uniquely demonstrates the ability of a mouse to establish response habits similar to those exhibited to natural reward. Here we assessed the contribution of dNAcSh and vNAcSh dyn-expressing neurons in self-stimulation (Figure 7A). Importantly, all groups of mice were able to learn to nose poke at the same rate for a food reward (Figure 7B). Following food training, the food pellet was replaced with a 2-s (10 Hz, 10 ms pulse width) photostimulation, which was delivered following a nose poke. The dorsally injected mice continued to show positive reinforcement behavior, but the number of nose pokes increased 5-fold following photostimulation, emphasizing the highly rewarding nature of self-stimulation of this NAcSh subregion (Figures 7C, 7E, S7B, and S7E; Movie S1). However, both the controls and the ventrally injected mice decreased their number of nose pokes following photostimulation, which was significantly different compared to the dorsally injected mice (Figures 7C and 7E). The aversive nature of the photostimulation in the vNAcSh suggests that it is strong enough to mute the characteristic extinction burst seen during the first day of photostimulation and accelerate extinction following food training. Whereas the dorsally injected mice maintain an increased number of nose pokes due to the reinforcing nature of the photostimulation (Figures 7C, 7E, S7B, and S7E). Furthermore, NorBNI locally infused into these subregions blocked both the positive and negative behaviors displayed in this self-stimulation operant model (Figures 7D, 7E, S7C, and S7G–S7I). In addition, treatment of NorBNI alone was not significantly different from controls, suggesting that NorBNI infusion by itself within this structure does interfere with learning processes, consistent with prior reports (Land et al., 2008) (Figures 7D, 7E, S7C, and S7G). These operant self-stimulation data further suggest that there is a dynamic relationship between the positively reinforcing and aversive nature of stimulating distinct subpopulations of NAcSh Dyn-containing cells, both of which appear to be mediated by local KORs.
Figure 7. Distinct NAc Dyn Populations in Operant Stimulation Produce Positive and Negative Responses.
(A) Calendar outlining the operant self-stimulation paradigm.
(B) No significant difference in active nose pokes for food reward between all groups (data represented as mean ± SEM, n = 6 to 7).
(C) Data showing number of nose pokes across 5 day of operant self-stimulation. Dorsally injected mice show significantly increased active nose pokes, compared to controls and ventrally injected mice, which show a significant reduction in nose pokes following photostimulation (data represented as mean ± SEM, n = 6 to 7: two way repeated-measures ANOVA, Bonferroni post hoc; dorsal versus controls on day 1 ***p < 0.001, dorsal versus controls on day 2 **p < 0.001, dorsal versus ventral on day 1 and 2 ****p < 0.0001.)
(D) Data showing number of nose pokes across 5 days of operant self-stimulation with no significant differences between ventral+NorBNI, dorsal+NorBNI, and NorBNI alone (data represented as mean ± SEM, n = 6 to 7).
(E) Significant differences in total nose pokes on day 1 and day 2 following photostimulation (data represented as mean ± SEM, n = 6 to 7: one-way ANOVA, Bonferroni post hoc; control versus dorsal ***p < 0.0001, dorsal versus ventral ***p < 0.0001, ventral versus ventral+NorBNI *p < 0.01, dorsal versus dorsal+NorBNI, dorsal versus NorBNI alone ***p < 0.001, control versus NorBNI alone ns).
Representative 60-min trials for each group.
DISCUSSION
In the present study, we identify that photostimulation of dyn-expressing cells in discrete subregions within the NAcSh drive opposing motivational behavioral states. We show that photostimulation of dyn-expressing cells in the vNAcSh drives aversion behavior whereas photostimulation in the dNAcSh drives a preference/reward behavior. Here we demonstrate this functional anatomical segregation using three different behavioral paradigms; real-time place testing using bidirectional wireless μ-ILED technology, conditioned place testing, and operant self-stimulation.
Previous studies reported that the dyn/KOR system mediates negative emotional states likely through increased dyn release in the NAc, contributing to the dysphoria associated with depression, drug dependence, and withdrawal, but the mechanisms for engagement of dyn circuitry were unknown (Britton et al., 1982; Bruchas et al., 2009; Knoll et al., 2011; Lindholm et al., 2000; Mucha et al., 1985; Pfeiffer et al., 1986; Rylkova et al., 2009; Schlosburg et al., 2013; Shippenberg et al., 2007). In this study, we demonstrate that discrete activation of dyn-expressing cells within the vNAcSh drives an aversion behavior. It was shown that the rostrodorsal quadrant of the medial NAcSh in rats contains a specialized opioid hedonic hotspot, which traditionally mediates an increase in “liking” following mu opioid receptor (MOR) activation; however, a role has also been identified for both delta opioid receptors (DOR) and KOR (Castro and Berridge, 2014). Within this recent body of work, a separate suppressive cold spot in the caudal half of the shell was identified in which each opioid stimulation oppositely reduced sucrose positive “liking” reactions (Castro and Berridge, 2014). In addition to these findings, this group identified several anatomical differences between NAc opioid control of “liking” verses “wanting” of feeding (Castro and Berridge, 2014). These results not only highlight the anatomical heterogeneity of the NAc but also show that this is localized to opioid reward-related functions in the medial shell, which includes a role for the KOR system. While using a different species and behavioral model and focusing on the dorsal/ventral axis rather than the rostral/caudal axis, we report consistent endogenous dynorphinergic heterogeneity within the NAcSh. Here, selective photostimulation of the endogenous dyn-expressing cells in the dNAcSh drives a preference/reward behavior, but photostimulation of dyn-expressing neurons in the vNAcSh drives aversion behavior. Furthermore, a recent study has found that prodynorphin content specifically in the vNAcSh is dramatically increased following 12-hr-long access heroin self-administration, and that escalation of this drug-seeking behavior was suppressed following treatment with the long-acting KOR antagonist NorBNI (Schlosburg et al., 2013). These findings further support our data and suggest that dyn tone in distinct subregions within the NAcSh can drive opposing motivated behavioral states. We show the specific location of the virus and more importantly the fiber optic tip through all three coronal, sagittal, and horizontal planes to help identify the two distinct dorsal and ventral shell regions that drive these opposing behaviors (Figure 8).
Figure 8. Characterization of Viral Expression and Fiber Placement throughout the NAc.
(A and B) Coronal, sagittal, and horizontal views documenting NAc dyn-dependent viral expression in dorsally injected mice (A) that demonstrated reward-like behaviors and ventrally injected mice (B) that demonstrated aversion behaviors. Top panels use stereotaxic coordinates and atlas images to orient the location of bottom panels of representative confocal micrographs. Scale bars,100 μm. * indicates tissue damage from fiber placements.
To discretely isolate these small subregions of the NAc within a single animal, we modified our wireless, spatially targeted μ-ILED devices (Jeong et al., 2015; Kim et al., 2013; McCall et al., 2013) to enable independent illumination of either the ventral or dorsal region of the NAc within the same mouse. We generated this modified version to directly test the question of spatial segregation of reward and aversion within the NAcSh and were able to induce a real-time aversion and reward behavior within the same mouse to show that engaging dyn neurons in these discrete regions mediates opposing behaviors. Importantly, we also found that stimulating these distinct regions does not mediate an anxiety-like behavior, consistent with previous reports that identify the amygdala as the KOR site involved in anxiety-like behaviors (Bruchas et al., 2009; Knoll et al., 2011).
Looking closely at the neurobiological sources of dyn and KOR in the NAc, it is widely known that dyn is predominantly expressed in MSNs within the NAc that coexpress dopamine D1 receptors. However, there are also input projections from other structures that could release dyn, such as the ventral pallidum and the lateral hypothalamus (Baldo et al., 2003; Groenewegen et al., 1999; Haber et al., 1985; Peyron et al., 1998). KORs have been shown to have a somewhat heterogeneous cellular distribution within the NAcSh, in line with their role in the direct and indirect modulation of excitatory transmission (Svingos et al., 1999). It is reported that postsynaptic KORs in the NAc are on dendrites of most MSNs but reside predominantly on the dopamine-D2-expressing MSNs (Svingos et al., 1999). KORs are also widely known to be expressed on presynaptic terminals of glutamate, serotonin, and dopamine projections into the NAc (Bruchas et al., 2011; Hjelmstad and Fields, 2001; Land et al., 2009; Schindler et al., 2012; Svingos et al., 1999). In light of this, we hypothesized that the dyn-mediated aversion in the vNAcSh is driven by activation of KOR locally in the NAc. In both a conditioned place preference and an operant self-stimulation paradigm, we show that NorBNI is able to block the aversion behavior following photostimulation of dyn neurons in the vNAcSh, thereby identifying that aversion behavior in the vNAcSh is mediated by a local KOR-dependent mechanism.
Photostimulation of dyn-expressing cells in the dNAcSh also drives a preference/reward behavior in all three paradigms. This finding is intriguing in light of the widely accepted role of the dyn/KOR system in aversive/dysphoric behaviors. In addition to localizing in NAc GABAergic MSNs, dyn-expressing cells also express substance P (Lee et al., 1997; Napier et al., 1995) and synapse onto cholinergic neurons that express NK1 receptors (Martone et al., 1992; Pickel et al., 1976). The subsequent activation of these receptors is thought to be involved in cue signaling reward and learning (Elliott et al., 1986; Graybiel et al., 1994). Based on these findings, we thought perhaps the stimulation of dyn-expressing cells modulates substance P/cholinergic signaling to drive the observed preference behavior. However, subsequent experiments show that the positive rewarding effects appear to be mediated by KOR activation, as NorBNI is able to block these rewarding effects. Interestingly, the Berridge group is the first to report rewarding effects for kappa activation, but this was restricted to the rostrodorsal shell hotspot, as all other areas produced negative effects (Castro and Berridge, 2014). They suggest that the anatomical specificity gates the valence of KOR effects in the NAc, which in turn seems to be the case with our current findings. How KOR is able to mediate these opposing behaviors in two distinct regions of the NAcSh is unknown, but it is likely modulated by functionally distinct neuronal populations projecting to either the dorsal or ventral shell. This concept was well demonstrated in a recent study identifying distinct neuronal population projections from the BLA to the NAc code for positive valence, but projections to the central nucleus of the amygdala code for negative valence (Namburi et al., 2015). In addition, novel signaling within mesoaccumbens fibers in which both glutamate and dopamine can both be released from the same axons has recently been identified (Zhang et al., 2015). Furthermore, there is new evidence showing that projections from the NAc to the ventral pallidum do not conform to the traditionally accepted model of D1-direct and D2-indirect neuronal communication (Kupchik et al., 2015). Complex neuronal characteristics such as these in conjunction with the analysis of discrete projections may help us to dissect how the KOR in the NAcSh can mediate both a preference and aversion behavior via separable populations. Furthermore, the current findings we report here corroborate the elegant work of Thompson and Swanson (2010), which identified network nodes within the NAc that are localized and restricted to specific subdivisions within a region (Thompson and Swanson, 2010). Mapping the distinct projections to and from discrete regions in future studies with the dyn-reporter mouse (dyn-CretdTomato) and viral tracing approaches will help us to understand what is driving the unique behavioral outputs in this present study and how these populations are engaged, altered, and recruited in stress- and reward-related behaviors.
Here we have identified two distinct subregions within the NAcSh that drive opposing behaviors through activation of the KOR/dyn system. Photostimulation of dyn-expressing neurons in the vNAcSh causes a KOR-dependent aversive behavior, whereas photostimulation of dyn-expressing neurons in the dNAcSh causes preference. Understanding the circuitry that mediates motivated behaviors is critical in furthering our understanding of positive and negative affective states that contribute to mood disorders, addiction, and depression.
EXPERIMENTAL PROCEDURES
Additional detailed methods provided in the Supplemental Experimental Procedures.
Experimental Subjects and Stereotaxic Surgery
Adult (25–35 g) male preprodynorphin-IRES-cre (dyn-Cre) mice were group-housed, given access to food pellets and water ad libitum, and maintained on a 12 hr:12 hr light:dark cycle (lights on at 7:00 AM). All animals were kept in a sound-attenuated, isolated holding facility in the lab 1 week prior to surgery, post-surgery, and throughout the duration of the behavioral assays to minimize stress. All procedures were approved by the Animal Care and Use Committee of Washington University and conformed to US National Institutes of Health guidelines. For surgery, mice were anesthetized in an induction chamber (4% Isoflurane) and placed into a stereotaxic frame (Kopf Instruments, Model 1900) where they were maintained at 1%–2% isoflurane. We performed a craniotomy and unilaterally injected, using a blunt needle (86200, Hamilton Company), 300 nl of AAV5-DIO-ChR2-eYFP or AAV5-DIO-eYFP (Hope Center Viral Vector Core, viral titer 2 × 1013 vg/ml) into either the dNAcSh (stereotaxic coordinates from bregma: +1.30 anterior-posterior [AP], ±0.5 medial-lateral [ML], −4.25 mm dorsal-ventral [DV]) or vNAcSh (stereotaxic coordinates from bregma: +1.30 [AP], ±0.5 [ML], −4.75 mm [DV]), followed by fiber optic implantation (Sparta et al., 2012). We secured the implants using two bone screws and a dental dental cement headcap (Lang Dental). Mice were allowed to recover for 3 weeks prior to behavioral testing, permitting optimal expression of ChR2 in the Dyn-Cre cell bodies. For NorBNI local Infusion, mice were locally injected with NorBNI in the vNAcSh (2.5 μg/1 μl) and implanted with a fiber optic 2 weeks prior to behavior. These mice were allowed at least 1 week to recover post-surgery before beginning experimentation, well within the limits of norBNI antagonism.
Generation and Breeding of Pdyn-IRES-cre Mice and Ai9-x Pdyn-IRES-cre
Pdyn-IRES-cre mice were kindly provided by Bradford Lowell's lab (Krashes et al., 2014). The mice were bred at Washington University in Saint Louis by crossing the pdyn-IRES-cre mice with C57BL/6 wild-type mice and backcrossed for seven generations. These mice were then crossed to Ai9-tdTomato mice on C57BL/6 background, bred, and backcrossed for seven generations.
Immunohistochemistry and Quantification
Immunohistochemistry and quantification was performed as previously described (Al-Hasani et al., 2013b; Kim et al., 2013; McCall et al., 2015). To ensure no bleed through from the bright tdTomato signaling, a very conservative bandwidth was used to collect the Alexa 488 signal (498–520 nm), and a red shifted bandwidth was used for the tdTomato signal (600–700 nm). These were also compared to a negative control (no 1° Ab).
Slice Electrophysiology
We performed whole-cell electrophysiology experiments similar to those published (Sparrow et al., 2012). Briefly, mice were rapidly decapitated under isoflurane anesthesia, and 300 μM coronal slices containing the NAc were prepared on a vibratome (Leica VT1200). The brains were removed and placed in ice-cold modified high sucrose artificial cerebrospinal fluid (aCSF). Slices were then transferred to normal aCSF maintained at ~30° (Warner Instruments). Slices were placed in a holding chamber (Warner Instruments) and were allowed to rest for 1 hr. Slices were continuously bubbled with a 95% O2/5% CO2 mixture throughout slicing and experiments. Patch pipettes (3–6 MΩ) were pulled from thin-walled borosilicate glass on a Flaming-Brown Micropipette Puller (Sutter Instruments). Following rupture of the cell membrane, cells were allowed to rest and equilibrate to the intracellular recording solutions. Input resistance was monitored continuously throughout the experiment, and when input resistance deviated by more than 20%, the experiment was discarded. Light-evoked action potentials in the NAc were recorded using a potassium-gluconate-based internal. Action potentials were light-evoked at frequencies from 5 to 40 Hz to determine spike fidelity. Light-evoked IPSC recordings exclusively from non-dynorphin neurons in the vNAcSh were conducted in voltage clamp using a cesium-methansulfonate-based internal solution so that we could detect EPSCs (−55 mV) and IPSCs (+10 mV) in the same neuron. After confirming the absence of a light-evoked EPSC signal, we measured light-evoked IPSCs during a single 10-ms light pulse of 470 nm. In a subset of these experiments, SR95531 (GABAzine, 10 μM) was bath applied for 10 min to block IPSCs. All solutions can be found in the Supplemental Experimental Procedures.
Peptide Enzyme Immunoassay to Measure Photostimulated Release of dyn
3 weeks post-viral injection, mice were intracardially perfused with aCSF, and 150 μm sections were taken using a vibrotome (Leica). Slices containing the NAc were allowed to acclimate at 30°C in aerated NMDG aCSF for 10 min before being transferred to recovery aCSF at room temperature for 20 to 40 min. Slices from each animal were collected in a glass vial containing 500 μl of recovery aCSF. A 473-nm laser (10 Hz, 10 ms pulse width) was directed to the bottom of the glass vial containing the slices for 15 min. Following photostimulation, 8 × 50 μl of the recovery aCSF from within the vial was pipetted into a 96-well plate as per Peninsula Protocol II (Peninsula Labs). Absorbance was measured at 650 nm using a SynergyMx microplate reader (BioTek). Dyn release was quantified in ng/ml and compared to dyn-cre− controls.
Behavior
All behaviors were performed within a sound-attenuated room maintained at 23°C at least 1 week after habituation to the holding room and the final surgery. Lighting was stabilized at ~1,500 lux for aversion behaviors, ~250 lux for anxiety-like behaviors. Movements were video recorded and analyzed using Ethovision XT 8.5 (Noldus Information Technologies). At the end of each study, animals were perfused with 4% paraformaldehyde followed by anatomical analysis to confirm injection sites and cell-type-specific expression.
Real-Time Place Testing
Mice were placed in a custom-made unbiased, balanced two-compartment conditioning apparatus (52.5 × 25.5 × 25.5 cm) as described previously (McCall et al., 2015; Siuda et al., 2015b). During a 20-min trial, entry into one compartment triggered photostimulation of various frequencies (5, 10, 20, 40 Hz, etc.) while the animal remained in the light-paired chamber and entry into the other chamber ended photostimulation.
Y-Maze Conditioned Place Testing
Mice were placed in a three-chambered environment compatible with fiber optics coupled to 473-nm laser as previously described (Kim et al., 2013). On day 1 (pre-test), the mice have free access to all chambers without stimulation to show no bias between the two larger, cue-distinct environments. This is followed by three conditioning days where upon entry into one chamber photostimulation (10 Hz, 10 ms pulse width) occurs in real-time, and when the animal leaves this compartment photostimulation ends. On day 5 (post-test), mice have free access to all chambers without stimulation to assess whether a preference or aversion association has been made with the paired context. Data were calculated as time spent in each chamber and entries into the photostimulation-paired chamber.
Operant Self-Stimulation
Mice are initially food deprived to 90% of their body weight and trained to nose poke for food pellets for 4 days in a modular test chamber for mice (17.8 cm × 15.2 cm × 18.4 cm) (Med Associates Inc.). This was used in conjunction with either Ethovision XT (Noldus) or MED-PC (Med Associates Inc.). This was followed by operant self-stimulation where upon an active nose poke the mice receive a 2-s photostimulation (10 Hz, 10 ms pulse width stimulation) on a fixed ratio-1 schedule for a 1 hr session. For operant self-stimulation, the mice are connected to a laser via a tether that runs through the top of the chamber. An Arduino (http://www.arduino.cc/) is programed and connected to the laser and chamber so upon nose poking the 2 s, 10 Hz, 10-ms pulse width photostimulation is administered paired with a cue light and a tone. An inactive nose poke resulted in no stimulation, cue light, or tone. The data were calculated as total number of nose pokes at the active and inactive for each day over the course of 5 days.
Wireless Powering and RF Powering Scavenger
Wireless powering of the μ-ILED devices was adapted as previously described (Kim et al., 2013; McCall et al., 2013). The RF scavenger consists of antennas, impedance matching circuits, and Cockcroft-Walton voltage multiplier. The wireless power transmitter includes an RF signal generator (Agilent N5181A), a power supply (Agilent U8031A), a RF power amplifier (Empower RF Systems 1119-BBM3K5KHM), an RF signal splitter (RF Lambda RFLT2W0727GN), and two panel antennas (ARC Wireless ARC-PA2419B01). The RF signal generator is internally modulated to deliver sufficient power to light the μ-ILEDs at the given stimulation protocol (10 Hz, 50 ms pulse widths). The modulated RF signal is amplified and transmitted from the panel antenna to the headstage power harvesters. The RF signal generator has a power output from −10 to 0 dBm at 1.5 GHz and 2.4 GHz for each LEDs, optimized daily to ensure equivalent light power in the assay. Mice with chronically implanted μ-ILED devices were acutely connected to the headstage power harvesters immediately prior to any wireless photostimulation.
RNAscope Fluorescent In Situ Hybridization (FISH)
Following rapid decapitation of C57/BL6 mice, brains were rapidly frozen in 100 ml −50°C isopentane and stored at −80°C. Coronal sections containing the NAc, corresponding to the injection plane used in the behavioral experiments, were cut at 20 μM at −20°C and thaw-mounted onto Super Frost Plus slides (Fisher). Slides were stored at −80°C until further processing. FISH was performed according to the RNAScope 2.0 Fluorescent Multiple Kit User Manual for Fresh Frozen Tissue (Advanced Cell Diagnostics, Inc.) as described by Wang et al. (2012). Briefly, sections were fixed in 4% PFA, dehydrated, and treated with pretreatment 4 protease solution. Sections were then incubated for target probes for mouse prodynorphin (pDyn-C1, accession number NM_018863.3, probe region 33–700) dopamine receptor 1 (Drd1-C2, accession number NM_010076.3, probe region 463–1,336), and dopamine receptor 2 (Drd2-C3, accession number NM_010077.2, 85–1,153). All target probes consisted of 20 ZZ oligonucleotides and were obtained from Advanced Cell Diagnostics. Following probe hybridization, sections underwent a series of probe signal amplification steps followed by incubation of fluorescently labeled probes designed to target the specified channel associated with pDyn (C1 – Alexa 488), Drd1 (C2 – Atto 550), and Drd2 (C3 – Atto 647). Slides were counterstained with DAPI, and coverslips were mounted with Vectashield Hard Set mounting medium (Vector Laboratories). Images were obtained on a Leica TCS SPE confocal microscope and analyzed with Application Suite Advanced Fluorescence (Leica).
Statistics
All data are expressed as mean ± SEM. Statistical significance was taken as *p < 0.05, **p < 0.01, ***p < 0.001, and ****p < 0.0001, as determined by a one-way ANOVA or a two-way repeated-measures ANOVA followed by a Bonferroni post hoc tests as appropriate. Statistical analyses were performed in GraphPad Prism 5.0.
Supplementary Material
Highlights.
Optogenetic excitation of nucleus accumbens dynorphin cells elicits dynorphin release
Discrete accumbens shell dynorphinergic populations drive either aversion or reward
These two nucleus accumbens subregions can be bidirectionally controlled
Both aversive and rewarding behaviors require kappa opioid receptors
ACKNOWLEDGMENTS
We thank all of the Bruchas Laboratory for their helpful insight and discussion throughout the preparation of the manuscript. In particular, Edward Siuda for his advice with ELISA analysis. William Planer, Audra Foshage, and Lamley Lawson for their technical support. We thank Bryan Copits in Professor Gereau's laboratory for his technical assistance and advice in the collection of the peptide release data. We also thank the HOPE Center viral vector core (NINDS, P30NS057105) and Alafi Neuroimaging Lab (NIH, S10RR027552). This work is supported by NIDA R01 DA033396 (M.R.B.), R01DA037152 (M.R.B.), NIDA K99/R00 Pathway to Independence Award DA038725 (R.A.-H.), NIMH F31 MH101956 (J.G.M.), TR01NS081707 (M.R.B. and J.A.R.) and R01DK075632 (B.B.L.), R37DK053477 (B.B.L.), R01DK089044 (B.B.L.), R01DK071051 (B.B.L.), R01DK096010 (B.B.L.), and P30DK046200 (B.B.L.).
Footnotes
AUTHOR CONTRIBUTIONS
Conceptualization, R.A.-H., J.G.M., and M.R.B.; Methodology, R.A.-H., J.G.M., A.M.G., G.S., C.-O.P., S.I.P., C.M.M., N.A.C., T.L.K., J.A.R., and M.R.B.; Investigation, R.A.-H., J.G.M., A.M.G, G.S., J.M.B., G.S., C.-O.P., S.I.P, C.M.M., and N.A.C.; Resources, M.J.K. and B.B.L.; Writing – Original Draft, Review & Editing, R.A.-H., J.G.M., and M.R.B.; Funding acquisition, M.R.B., R.A.-H.; Supervision, T.L.K., J.A.R.; Project administration, M.R.B.
SUPPLEMENTAL INFORMATION
Supplemental Information includes seven figures and Supplemental Experimental Procedures and can be found with this article online at http://dx.doi.org/10.1016/j.neuron.2015.08.019.
REFERENCES
- Al-Hasani R, McCall JG, Foshage AM, Bruchas MR. Locus coeruleus kappa opioid receptors modulate reinstatement of cocaine place preference through a noradrenergic mechanism. Neuropsychopharmacology. 2013a;38:2484–2497. doi: 10.1038/npp.2013.151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Al-Hasani R, McCall JG, Foshage AM, Bruchas MR. Locus coeruleus kappa-opioid receptors modulate reinstatement of cocaine place preference through a noradrenergic mechanism. Neuropsychopharmacology. 2013b;38:2484–2497. doi: 10.1038/npp.2013.151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baldo BA, Daniel RA, Berridge CW, Kelley AE. Overlapping distributions of orexin/hypocretin- and dopamine-beta-hydroxylase immuno-reactive fibers in rat brain regions mediating arousal, motivation, and stress. J. Comp. Neurol. 2003;464:220–237. doi: 10.1002/cne.10783. [DOI] [PubMed] [Google Scholar]
- Bals-Kubik R, Herz A, Shippenberg TS. Evidence that the aversive effects of opioid antagonists and kappa-agonists are centrally mediated. Psychopharmacology (Berl.) 1989;98:203–206. doi: 10.1007/BF00444692. [DOI] [PubMed] [Google Scholar]
- Britt JP, Benaliouad F, McDevitt RA, Stuber GD, Wise RA, Bonci A. Synaptic and behavioral profile of multiple glutamatergic inputs to the nucleus accumbens. Neuron. 2012;76:790–803. doi: 10.1016/j.neuron.2012.09.040. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Britton DR, Koob GF, Rivier J, Vale W. Intraventricular corticotropin-releasing factor enhances behavioral effects of novelty. Life Sci. 1982;31:363–367. doi: 10.1016/0024-3205(82)90416-7. [DOI] [PubMed] [Google Scholar]
- Bruchas MR, Land BB, Aita M, Xu M, Barot SK, Li S, Chavkin C. Stress-induced p38 mitogen-activated protein kinase activation mediates kappa-opioid-dependent dysphoria. J. Neurosci. 2007;27:11614–11623. doi: 10.1523/JNEUROSCI.3769-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bruchas MR, Land BB, Lemos JC, Chavkin C. CRF1-R activation of the dynorphin/kappa opioid system in the mouse basolateral amygdala mediates anxiety-like behavior. PLoS ONE. 2009;4:e8528. doi: 10.1371/journal.pone.0008528. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bruchas MR, Land BB, Chavkin C. The dynorphin/kappa opioid system as a modulator of stress-induced and pro-addictive behaviors. Brain Res. 2010;1314:44–55. doi: 10.1016/j.brainres.2009.08.062. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bruchas MR, Schindler AG, Shankar H, Messinger DI, Miyatake M, Land BB, Lemos JC, Hagan CE, Neumaier JF, Quintana A, et al. Selective p38a MAPK deletion in serotonergic neurons produces stress resilience in models of depression and addiction. Neuron. 2011;71:498–511. doi: 10.1016/j.neuron.2011.06.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carter ME, Yizhar O, Chikahisa S, Nguyen H, Adamantidis A, Nishino S, Deisseroth K, de Lecea L. Tuning arousal with optogenetic modulation of locus coeruleus neurons. Nat. Neurosci. 2010;13:1526–1533. doi: 10.1038/nn.2682. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Castro DC, Berridge KC. Opioid hedonic hotspot in nucleus accumbens shell: mu, delta, and kappa maps for enhancement of sweetness “liking” and “wanting”. J. Neurosci. 2014;34:4239–4250. doi: 10.1523/JNEUROSCI.4458-13.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chavkin C, James IF, Goldstein A. Dynorphin is a specific endogenous ligand of the kappa opioid receptor. Science. 1982;215:413–415. doi: 10.1126/science.6120570. [DOI] [PubMed] [Google Scholar]
- Daunais JB, Roberts DC, McGinty JF. Cocaine self-administration increases preprodynorphin, but not c-fos, mRNA in rat striatum. Neuroreport. 1993;4:543–546. doi: 10.1097/00001756-199305000-00020. [DOI] [PubMed] [Google Scholar]
- Drevets WC, Videen TO, Price JL, Preskorn SH, Carmichael ST, Raichle ME. A functional anatomical study of unipolar depression. J. Neurosci. 1992;12:3628–3641. doi: 10.1523/JNEUROSCI.12-09-03628.1992. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Elliott PJ, Nemeroff CB, Kilts CD. Evidence for a tonic facilita-tory influence of substance P on dopamine release in the nucleus accumbens. Brain Res. 1986;385:379–382. doi: 10.1016/0006-8993(86)91087-5. [DOI] [PubMed] [Google Scholar]
- Everitt BJ, Robbins TW. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 2005;8:1481–1489. doi: 10.1038/nn1579. [DOI] [PubMed] [Google Scholar]
- Fagergren P, Smith HR, Daunais JB, Nader MA, Porrino LJ, Hurd YL. Temporal upregulation of prodynorphin mRNA in the primate striatum after cocaine self-administration. Eur. J. Neurosci. 2003;17:2212–2218. doi: 10.1046/j.1460-9568.2003.02636.x. [DOI] [PubMed] [Google Scholar]
- Ghazarossian VE, Chavkin C, Goldstein A. A specific radioimmunoassay for the novel opioid peptide dynorphin. Life Sci. 1980;27:75–86. doi: 10.1016/0024-3205(80)90021-1. [DOI] [PubMed] [Google Scholar]
- Graybiel AM, Aosaki T, Flaherty AW, Kimura M. The basal ganglia and adaptive motor control. Science. 1994;265:1826–1831. doi: 10.1126/science.8091209. [DOI] [PubMed] [Google Scholar]
- Groenewegen HJ, Wright CI, Beijer AV, Voorn P. Convergence and segregation of ventral striatal inputs and outputs. Ann. N Y Acad. Sci. 1999;877:49–63. doi: 10.1111/j.1749-6632.1999.tb09260.x. [DOI] [PubMed] [Google Scholar]
- Haber SN, Groenewegen HJ, Grove EA, Nauta WJ. Efferent connections of the ventral pallidum: evidence of a dual striato pallidofugal pathway. J. Comp. Neurol. 1985;235:322–335. doi: 10.1002/cne.902350304. [DOI] [PubMed] [Google Scholar]
- Hjelmstad GO, Fields HL. Kappa opioid receptor inhibition of glutamatergic transmission in the nucleus accumbens shell. J. Neurophysiol. 2001;85:1153–1158. doi: 10.1152/jn.2001.85.3.1153. [DOI] [PubMed] [Google Scholar]
- Hurd YL, Brown EE, Finlay JM, Fibiger HC, Gerfen CR. Cocaine self-administration differentially alters mRNA expression of striatal peptides. Brain Res. Mol. Brain Res. 1992;13:165–170. doi: 10.1016/0169-328x(92)90058-j. [DOI] [PubMed] [Google Scholar]
- Jeong J-W, McCall JG, Shin G, Zhang Y, Al-Hasani R, Kim M, Li S, Sim JY, Jang K-I, Shi Y, et al. Wireless Optofluidic Systems for Programmable In Vivo Pharmacology and Optogenetics. Cell. 2015;162:662–674. doi: 10.1016/j.cell.2015.06.058. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kim TI, McCall JG, Jung YH, Huang X, Siuda ER, Li Y, Song J, Song YM, Pao HA, Kim R-H, et al. Injectable, cellular-scale opto-electronics with applications for wireless optogenetics. Science. 2013;340:211–216. doi: 10.1126/science.1232437. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knoll AT, Muschamp JW, Sillivan SE, Ferguson D, Dietz DM, Meloni EG, Carroll FI, Nestler EJ, Konradi C, Carlezon WA., Jr. Kappa opioid receptor signaling in the basolateral amygdala regulates conditioned fear and anxiety in rats. Biol. Psychiatry. 2011;70:425–433. doi: 10.1016/j.biopsych.2011.03.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krashes MJ, Shah BP, Madara JC, Olson DP, Strochlic DE, Garfield AS, Vong L, Pei H, Watabe-Uchida M, Uchida N, et al. An excitatory paraventricular nucleus to AgRP neuron circuit that drives hunger. Nature. 2014;507:238–242. doi: 10.1038/nature12956. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kravitz AV, Tye LD, Kreitzer AC. Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nat. Neurosci. 2012;15:816–818. doi: 10.1038/nn.3100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kupchik YM, Brown RM, Heinsbroek JA, Lobo MK, Schwartz DJ, Kalivas PW. Coding the direct/indirect pathways by D1 and D2 receptors is not valid for accumbens projections. Nat. Neurosci. 2015 doi: 10.1038/nn.4068. Published online July 27, 2015. http://dx.doi.org/10.1038/nn.4068. [DOI] [PMC free article] [PubMed]
- Land BB, Bruchas MR, Lemos JC, Xu M, Melief EJ, Chavkin C. The dysphoric component of stress is encoded by activation of the dynorphin kappa-opioid system. J. Neurosci. 2008;28:407–414. doi: 10.1523/JNEUROSCI.4458-07.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Land BB, Bruchas MR, Schattauer S, Giardino WJ, Aita M, Messinger D, Hnasko TS, Palmiter RD, Chavkin C. Activation of the kappa opioid receptor in the dorsal raphe nucleus mediates the aversive effects of stress and reinstates drug seeking. Proc. Natl. Acad. Sci. USA. 2009;106:19168–19173. doi: 10.1073/pnas.0910705106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee T, Kaneko T, Shigemoto R, Nomura S, Mizuno N. Collateral projections from striatonigral neurons to substance P receptor-expressing intrinsic neurons in the striatum of the rat. J. Comp. Neurol. 1997;388:250–264. doi: 10.1002/(sici)1096-9861(19971117)388:2<250::aid-cne5>3.0.co;2-0. [DOI] [PubMed] [Google Scholar]
- Lindholm S, Ploj K, Franck J, Nylander I. Repeated ethanol administration induces short- and long-term changes in enkephalin and dynorphin tissue concentrations in rat brain. Alcohol. 2000;22:165–171. doi: 10.1016/s0741-8329(00)00118-x. [DOI] [PubMed] [Google Scholar]
- Madisen L, Zwingman TA, Sunkin SM, Oh SW, Zariwala HA, Gu H, Ng LL, Palmiter RD, Hawrylycz MJ, Jones AR, et al. A robust and high-throughput Cre reporting and characterization system for the whole mouse brain. Nat. Neurosci. 2010;13:133–140. doi: 10.1038/nn.2467. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Martone ME, Armstrong DM, Young SJ, Groves PM. Ultrastructural examination of enkephalin and substance P input to cholinergic neurons within the rat neostriatum. Brain Res. 1992;594:253–262. doi: 10.1016/0006-8993(92)91132-x. [DOI] [PubMed] [Google Scholar]
- Mayberg HS, Brannan SK, Tekell JL, Silva JA, Mahurin RK, McGinnis S, Jerabek PA. Regional metabolic effects of fluoxetine in major depression: serial changes and relationship to clinical response. Biol. Psychiatry. 2000;48:830–843. doi: 10.1016/s0006-3223(00)01036-2. [DOI] [PubMed] [Google Scholar]
- McCall JG, Kim TI, Shin G, Huang X, Jung YH, Al-Hasani R, Omenetto FG, Bruchas MR, Rogers JA. Fabrication and application of flexible, multimodal light-emitting devices for wireless optogenetics. Nat. Protoc. 2013;8:2413–2428. doi: 10.1038/nprot.2013.158. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McCall JG, Al-Hasani R, Siuda ER, Hong DY, Norris AJ, Ford CP, Bruchas MR. CRH Engagement of the Locus Coeruleus Noradrenergic System Mediates Stress-Induced Anxiety. Neuron. 2015;87:605–620. doi: 10.1016/j.neuron.2015.07.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Melief EJ, Miyatake M, Bruchas MR, Chavkin C. Ligand-directed c-Jun N-terminal kinase activation disrupts opioid receptor signaling. Proc. Natl. Acad. Sci. USA. 2010;107:11608–11613. doi: 10.1073/pnas.1000751107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mucha RF, Millan MJ, Herz A. Aversive properties of naloxone in non-dependent (naive) rats may involve blockade of central beta-endorphin. Psychopharmacology (Berl.) 1985;86:281–285. doi: 10.1007/BF00432214. [DOI] [PubMed] [Google Scholar]
- Namburi P, Beyeler A, Yorozu S, Calhoon GG, Halbert SA, Wichmann R, Holden SS, Mertens KL, Anahtar M, Felix-Ortiz AC, et al. A circuit mechanism for differentiating positive and negative associations. Nature. 2015;520:675–678. doi: 10.1038/nature14366. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Napier TC, Mitrovic I, Churchill L, Klitenick MA, Lu XY, Kalivas PW. Substance P in the ventral pallidum: projection from the ventral striatum, and electrophysiological and behavioral consequences of pallidal substance P. Neuroscience. 1995;69:59–70. doi: 10.1016/0306-4522(95)00218-8. [DOI] [PubMed] [Google Scholar]
- Peyron C, Tighe DK, van den Pol AN, de Lecea L, Heller HC, Sutcliffe JG, Kilduff TS. Neurons containing hypocretin (orexin) project to multiple neuronal systems. J. Neurosci. 1998;18:9996–10015. doi: 10.1523/JNEUROSCI.18-23-09996.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pfeiffer A, Brantl V, Herz A, Emrich HM. Psychotomimesis mediated by kappa opiate receptors. Science. 1986;233:774–776. doi: 10.1126/science.3016896. [DOI] [PubMed] [Google Scholar]
- Pickel VM, Joh TH, Reis DJ. Monoamine-synthesizing enzymes in central dopaminergic, noradrenergic and serotonergic neurons. Immunocytochemical localization by light and electron microscopy. J. Histochem. Cytochem. 1976;24:792–306. doi: 10.1177/24.7.8567. [DOI] [PubMed] [Google Scholar]
- Raynor K, Kong H, Chen Y, Yasuda K, Yu L, Bell GI, Reisine T. Pharmacological characterization of the cloned kappa-, delta-, and mu-opioid receptors. Mol. Pharmacol. 1994;45:330–334. [PubMed] [Google Scholar]
- Russo SJ, Nestler EJ. The brain reward circuitry in mood disorders. Nat. Rev. Neurosci. 2013;14:609–625. doi: 10.1038/nrn3381. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rylkova D, Shah HP, Small E, Bruijnzeel AW. Deficit in brain reward function and acute and protracted anxiety-like behavior after discontinuation of a chronic alcohol liquid diet in rats. Psychopharmacology (Berl.) 2009;203:629–640. doi: 10.1007/s00213-008-1409-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schindler AG, Messinger DI, Smith JS, Shankar H, Gustin RM, Schattauer SS, Lemos JC, Chavkin NW, Hagan CE, Neumaier JF, Chavkin C. Stress produces aversion and potentiates cocaine reward by releasing endogenous dynorphins in the ventral striatum to locally stimulate serotonin reuptake. J. Neurosci. 2012;32:17582–17596. doi: 10.1523/JNEUROSCI.3220-12.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schlosburg JE, Whitfield TW, Jr., Park PE, Crawford EF, George O, Vendruscolo LF, Koob GF. Long-term antagonism of k opioid receptors prevents escalation of and increased motivation for heroin intake. J. Neurosci. 2013;33:19384–19392. doi: 10.1523/JNEUROSCI.1979-13.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schlussman SD, Zhou Y, Bailey A, Ho A, Kreek MJ. Steady-dose and escalating-dose “binge” administration of cocaine alter expression of behavioral stereotypy and striatal preprodynorphin mRNA levels in rats. Brain Res. Bull. 2005;67:169–175. doi: 10.1016/j.brainresbull.2005.04.018. [DOI] [PubMed] [Google Scholar]
- Shippenberg TS, Zapata A, Chefer VI. Dynorphin and the pathophysiology of drug addiction. Pharmacol. Ther. 2007;116:306–321. doi: 10.1016/j.pharmthera.2007.06.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shirayama Y, Ishida H, Iwata M, Hazama G-I, Kawahara R, Duman RS. Stress increases dynorphin immunoreactivity in limbic brain regions and dynorphin antagonism produces antidepressant-like effects. J. Neurochem. 2004;90:1258–1268. doi: 10.1111/j.1471-4159.2004.02589.x. [DOI] [PubMed] [Google Scholar]
- Siuda ER, Copits BA, Schmidt MJ, Baird MA, Al-Hasani R, Planer WJ, Funderburk SC, McCall JG, Gereau RW, 4th, Bruchas MR. Spatiotemporal control of opioid signaling and behavior. Neuron. 2015a;86:923–935. doi: 10.1016/j.neuron.2015.03.066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Siuda ER, Copits BA, Schmidt MJ, Baird MA, Al-Hasani R, Planer WJ, Funderburk SC, McCall JG, Gereau RW, 4th, Bruchas MR. Spatiotemporal control of opioid signaling and behavior. Neuron. 2015b;86:923–935. doi: 10.1016/j.neuron.2015.03.066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Solecki W, Turek A, Kubik J, Przewlocki R. Motivational effects of opiates in conditioned place preference and aversion paradigm–a study in three inbred strains of mice. Psychopharmacology (Berl.) 2009;207:245–255. doi: 10.1007/s00213-009-1672-7. [DOI] [PubMed] [Google Scholar]
- Sparrow AM, Lowery-Gionta EG, Pleil KE, Li C, Sprow GM, Cox BR, Rinker JA, Jijon AM, Peňa J, Navarro M, et al. Central neuropep-tide Y modulates binge-like ethanol drinking in C57BL/6J mice via Y1 and Y2 receptors. Neuropsychopharmacology. 2012;37:1409–1421. doi: 10.1038/npp.2011.327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sparta DR, Stamatakis AM, Phillips JL, Hovelsø N, van Zessen R, Stuber GD. Construction of implantable optical fibers for long-term optogenetic manipulation of neural circuits. Nat. Protoc. 2012;7:12–23. doi: 10.1038/nprot.2011.413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stamatakis AM, Stuber GD. Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance. Nat. Neurosci. 2012;15:1105–1107. doi: 10.1038/nn.3145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Svingos AL, Colago EE, Pickel VM. Cellular sites for dynorphin activation of kappa-opioid receptors in the rat nucleus accumbens shell. J. Neurosci. 1999;19:1804–1813. doi: 10.1523/JNEUROSCI.19-05-01804.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tan KR, Yvon C, Turiault M, Mirzabekov JJ, Doehner J, Labouèbe G, Deisseroth K, Tye KM, Lüscher C. GABA neurons of the VTA drive conditioned place aversion. Neuron. 2012;73:1173–1183. doi: 10.1016/j.neuron.2012.02.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thompson RH, Swanson LW. Hypothesis-driven structural connectivity analysis supports network over hierarchical model of brain architecture. Proc. Natl. Acad. Sci. USA. 2010;107:15235–15239. doi: 10.1073/pnas.1009112107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Bockstaele EJ, Gracy KN, Pickel VM. Dynorphinimmunoreactive neurons in the rat nucleus accumbens: ultrastructure and synaptic input from terminals containing substance P and/or dynorphin. J. Comp. Neurol. 1995;351:117–133. doi: 10.1002/cne.903510111. [DOI] [PubMed] [Google Scholar]
- Wang F, Flanagan J, Su N, Wang L-C, Bui S, Nielson A, Wu X, Vo H-T, Ma X-J, Luo Y. RNAscope: a novel in situ RNA analysis platform for formalin-fixed, paraffin-embedded tissues. J. Mol. Diagn. 2012;14:22–29. doi: 10.1016/j.jmoldx.2011.08.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang S, Qi J, Li X, Wang H-L, Britt JP, Hoffman AF, Bonci A, Lupica CR, Morales M. Dopaminergic and glutamatergic micro-domains in a subset of rodent mesoaccumbens axons. Nat. Neurosci. 2015;18:386–392. doi: 10.1038/nn.3945. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.