Summary
The nucleus accumbens (NAc) plays a key role in drug-related behavior and natural reward learning. Synaptic plasticity in dopamine D1 and D2 receptor medium spiny neurons (MSNs) of the NAc and the endogenous cannabinoid (eCB) system have been implicated in reward seeking. However, the precise molecular and physiological basis of reward-seeking behavior remains unknown. We found that the specific deletion of metabotropic glutamate receptor 5 (mGluR5) in D1-expressing MSNs (D1miRmGluR5 mice) abolishes eCB-mediated long-term depression (LTD) and prevents the expression of drug (cocaine and ethanol), natural reward (saccharin), and brain-stimulation-seeking behavior. In vivo enhancement of 2-arachidonoylglycerol (2-AG) eCB signaling within the NAc core restores both eCB-LTD and reward-seeking behavior in D1miRmGluR5 mice. The data suggest a model where the eCB and glutamatergic systems of the NAc act in concert to mediate reward-seeking responses.
Subject Areas: Neuroscience, Behavioral Neuroscience, Molecular Neuroscience
Graphical Abstract
Highlights
-
•
mGluR5-D1-CB1-induced eCB-LTD mediates drugs of abuse and natural reward seeking
-
•
eCB-LTD in D2-MSNs plays no important role in processing of reward-seeking responses
-
•
Loss of eCB-LTD is a consequence of higher MAGL activity and lower CB1R expression
-
•
Acute drug administration stops craving for alternative rewards on following days
Neuroscience; Behavioral Neuroscience; Molecular Neuroscience
Introduction
The brain reward system mediates motivational responses to natural rewards such as drinking, eating, and reproduction. Reinforcement learning for natural rewards depends on the formation of long-lasting conditioned associations that result in reward-seeking responses. This form of learning involves synaptic plasticity within the reward system, notably in medium spiny neurons (MSNs) of the nucleus accumbens (NAc) (Russo et al., 2010, Lüscher and Malenka, 2011). Drugs of abuse also act through the reward system, but the extent to which drug rewards and natural rewards share common neurobiological mechanisms within the reward system is barely studied.
One mechanism by which drugs of abuse alter synaptic plasticity in the reward system involves endocannabinoids (eCB). Stimulation of prelimbic cortex afferents at naturally occurring frequencies can cause long-term depression (LTD) of NAc glutamatergic synapses—an effect mediated by eCB release and presynaptic cannabinoid type 1receptor (CB1R) (Robbe et al., 2002, Zlebnik and Cheer, 2016, Araque et al., 2017). This form of eCB-mediated synaptic plasticity in the NAc depends on postsynaptic metabotropic glutamate receptor 5 (mGluR5) and is eliminated following exposure to drugs of abuse (Mato et al., 2004, Fourgeaud et al., 2004, Zlebnik and Cheer, 2016).
Although a direct involvement of this particular form of plasticity in reinforcement learning has so far not been demonstrated, there is increasing evidence that both mGluR5 and CB1R are critical for the expression of eCB-induced LTD and are involved in reward-seeking responses. Thus systemic pharmacological blockade of mGluR5 (Bäckström et al., 2004, Olive, 2009, Wang et al., 2013, Mihov and Hasler, 2016) or CB1R (De Vries et al., 2001, Cippitelli et al., 2005) reduces cue-induced reinstatement of drug-seeking responses. mGluR5 blockade also increases intracranial self-stimulation (ICSS) thresholds, suggesting a deficit in brain reward function (Cleva et al., 2012). The anatomical loci and neuronal mechanisms underlying these effects of CB1R and mGluR5 antagonists are still not well defined, but a specific role of CB1R in the NAc has been demonstrated for cocaine-, heroin-, and nicotine-seeking behavior in rodents (Xi et al., 2006, Kodas et al., 2007, Alvarez-Jaimes et al., 2008). Likewise mGluR5 in the NAc is also critically involved in drug-seeking behavior. Thus genetic deletion of mGluR5 in the NAc (Novak et al., 2010), intra-NAc administration of a selective mGluR5 antagonist (Knackstedt et al., 2014), and pharmacological inhibition of mGluR5 signaling via Homer proteins reduce cue-induced cocaine-seeking (Wang et al., 2013). Furthermore, combining sub-threshold doses of mGlu5R and CB1R antagonists also prevents alcohol-seeking behavior (Adams et al., 2010), suggesting an interaction between these two systems in mediating drug-seeking behavior. mGluR5 and CB1R blockade may also reduce seeking for food and other natural rewards. However, these findings are less consistent compared with those using drug rewards (Fattore et al., 2007, Sanchis-Segura et al., 2004, Olive, 2009, Sinclair et al., 2012, Watterson et al., 2013, Schmidt et al., 2015, Mihov and Hasler, 2016).
Two fundamental but unresolved issues are whether eCB-mediated synaptic plasticity that depends on presynaptic CB1R and postsynaptic mGluR5 in the NAc is causally involved in drug-seeking responses and whether the extent to which these synaptic changes also mediate natural reward-seeking responses; i.e., is there a common or distinct synaptic mechanism involved in drug and natural reward-seeking behavior. Here we mainly focused on e-CB-mediated synaptic plasticity in dopamine D1-receptor-containing MSNs, as several studies (Calipari et al., 2016, Hikida et al., 2010, Lobo and Nestler, 2011, Ma et al., 2018, Soares-Cunha et al., 2016) suggest that this neuronal population seems to be more likely involved in the formation of drug/natural reward-seeking behavior than D2-containing MSNs.
Results
mGluR5 in D1-Containing Neurons Mediate Drug- and Natural Reward-Seeking Behavior
Using a conditional mouse model with a knockdown of mGluR5 in dopamine D1-receptor-containing neurons (D1miRmGluR5 mice), we recently demonstrated that mGluR5 in this specific neuronal population mediates cue-induced reinstatement of cocaine-seeking behavior (Novak et al., 2010). Using this mouse model, we further asked if reward-seeking responses toward other drugs of abuse and natural rewards are also affected by this selective deletion of mGluR5 in D1-containing neurons. We first assessed ethanol-seeking responses in the reinstatement paradigm. D1miRmGluR5 mutants and wild-type littermates were trained under operant conditions. According to our standard protocol (Eisenhardt et al., 2015) mice were then trained for 15 days in 30-min sessions to lever press for ethanol with the presentation of contextual cues (S+/CS+) predictive of ethanol availability. All mice acquired stable lever pressing for ethanol (Figure S1A, two-way ANOVA, genotype effect: F(1,22) = 0.3, p = 0.6; genotype × time interaction: F(14,308) = 1.2, p = 0.3). Likewise, no genotype difference was observed during a 15-day extinction phase (Figure S1B, two-way ANOVA, genotype effect: F(1,22) = 0.2, p = 0.7; session effect: F(14,308) = 9.3, p < 0.0001). One day after the last extinction session, mice were tested for cue-induced reinstatement of ethanol seeking. The presentation of S+/CS+ significantly reinstated ethanol-seeking behavior in wild-type mice—an effect that was absent in mutant mice (Figure 1A left, two-way ANOVA, genotype: F(1,22) = 6.1, p < 0.05, cue F(2,44) = 41.6, p < 0.0001, and a cue × genotype interaction effect: F(2,44) = 5.5, p < 0.01). These findings extend our previous observation of a similar phenotype with cocaine-associated cues (Novak et al., 2010) and demonstrate that mGluR5 in D1 neurons is a mediator of drug/cue memories and drug-seeking responses.
We next examined whether mGluR5 in D1 neurons is involved in the general processing of conditioned reward-seeking responses. For this purpose, a second group of mice was tested for its seeking behavior toward saccharin, a natural reward. During acquisition and extinction phases, again no genotype differences were observed for saccharin responding (Figure S1B and S1C two-way ANOVA, genotype effect: F(1,27) = 0.8, p = 0.8 for acquisition and genotype effect: F(1,27) = 2.2, p = 0.1 for extinction). Presentation of the S+/CS+ stimuli triggered reinstatement of saccharin-seeking behavior in wild-type mice but not in D1miRmGluR5 mice (Figure 1B left, two-way ANOVA, genotype: F(1,27) = 10.7, p < 0.005, cue F(2,54) = 40.6, p < 0.0001, and a cue × genotype interaction effect: F(2,54) = 7.5, p < 0.005) demonstrating that mGluR5 in D1 neurons is also critical for natural reward-seeking responses.
Systemic administration of mGluR5 antagonists also reduces drug-seeking responses as well as saccharin-seeking responses (Bäckström et al., 2004, Olive, 2009, Watterson et al., 2013, Mihov and Hasler, 2016). If mGluR5 in D1-containing neurons would solely contribute to this systemic drug effect, reward-seeking responses in D1miRmGluR5 mice should not further be affected by mGluR5 antagonist. Therefore, we studied the effects of 2-methyl-6-(phenylethynyl)pyridine (MTEP 20 mg/kg) on cue-induced reinstatement of ethanol and saccharin seeking in our mutant mice. As expected, in comparison to vehicle, MTEP reduced the reinstatement response for ethanol-seeking behavior and saccharin-seeking behavior in wild-type mice. However, MTEP had no further effect in D1miRmGluR5 mice on the already reduced reinstatement (Figure 1A right, two-way ANOVA, treatment effect F(1,10) = 6.7; p < 0.05 and Figure 1B right, treatment effect F(1,27) = 48.6; p < 0.0001).
We further tested a third group of mutant mice for brain stimulation reward using the ICSS paradigm (Bilbao et al., 2015). Following ICSS training animals underwent the testing phase of 15 descending frequencies and all mice showed the expected frequency-dependent decrease in the number of stimulations per trial, which became significant from the sixth frequency on (Figure 1C, left, frequency effect F(14,406) = 119.2; p < 0.0001). Because lower frequencies are less rewarding, and after having observed that from the sixth frequency on the performance of the mice started to decline, we defined the first five frequencies as the “seeking” component of the test and the remaining 10 as the “extinction” component. During the “seeking” component the performance of the D1miRmGluR5 mice was significantly lower than the response rate of the wild-type mice (genotype × frequency interaction effect F(14,406) = 2.5; p < 0.01), whereas the “extinction” component was similar in all mice, performing 40% (similar to the extinction in operant conditions) of the baseline (Figure 1C, middle). Furthermore, compared with wild-type, D1miRmGluR5 mice also showed a significantly lower reinforcement rate (Figure 1C, right, t (25) = 2.1; p < 0.05).
Finally, given the well-known crosstalk between mGluR5 in the MSN and presynaptic CB1R, we also studied the effects of the CB1R antagonist AM251 on cue-induced reinstatement of saccharin-seeking behavior in both wild-type and mutant mice. Similar to MTEP, systemic administration of AM251 reduced the reinstatement in wild-type mice, but not in D1miRmGluR5 mice (Figure S2, treatment effect F(1,27) = 15.3; p < 0.001 and treatment × genotype interaction effect F(1,27) = 27.6; p < 0.0001). In order to show that CB1R within the NAc is responsible for the observed effect in wild-type mice, a separate group of wild-type mice received an intra-accumbal administration of AM251. Again this brain-site-specific blockade of CB1R also reduced cue-induced reinstatement of saccharin seeking behavior (Figure S3, t(8) = 3.7, p < 0.01).
In summary, mGluR5 in D1-containing neurons mediate in interaction with presynaptic CB1R cocaine- (Novak et al., 2010), ethanol-, saccharin-, and brain-stimulation-seeking responses. However, motor, emotional, and cognitive components can potentially affect reward-seeking responses (Sanchis-Segura and Spanagel, 2006). Therefore, in a series of control experiments, mice were tested for spontaneous locomotor activity, habituation to novelty, anxiety, short-term memory, and other D1-dependent responses. With the exception of a faster habituation to a novel environment (Figure S4B), all tested motor, emotional, or cognitive behaviors were normal in D1miRmGluR5 mice (Figure S4). Next we asked the question which synaptic mechanism could underlie the general lack of reward-seeking responses in D1miRmGluR5 mice.
mGluR5 in D1 Neurons Mediates eCB-LTD
We and others have shown that eCB-LTD requires the postsynaptic activation of mGluR5 to initiate retrograde eCB signaling (Robbe et al., 2002, Katona and Freund, 2012, Zlebnik and Cheer, 2016, Araque et al., 2017). Therefore, we examined basal synaptic transmission and eCB-mediated LTD in D1miRmGluR5 mice in NAc slices. Stimulation mimicking naturally occurring frequencies in NAc MSNs reliably induced a robust eCB-LTD in wild-type but not in D1miRmGluR5 mice (Figure 2A). Given that the deletion of mGluR5 is specific to D1-containing neurons (Novak et al., 2010), we suggest that the lack of eCB-LTD in D1miRmGluR5 mice contributes to the lack of reward seeking in these mice.
Previous reports showed also a prominent eCB-LTD in D2-MSNs in NAc (e.g. Shen et al., 2008, Kreitzer and Malenka, 2007, Grueter et al., 2010, Nazzaro et al., 2012), and this neuronal population may also contribute to reward-seeking responses (Soares-Cunha et al., 2016). We addressed this issue by specific labeling of MSNs that belong to either the indirect or direct dopamine pathways by using retrobeads. We patched retrogradely labeled direct (thereafter named D1-MSN) and indirect pathway (thereafter named D2-MSN) in wild-type mice and compared the capability of LTD induction in D1-or D2-MSNs in both wild-type and D1miRmGluR5 mice. In line with what has been previously shown eCB-LTD was expressed in direct and indirect pathway MSNs in wild-type animals (Figure 2B). Furthermore, in D1miRmGluR5 mice eCB-LTD was only present in D2-MSNs but not in D1-MSNs (Figure 2C). Taken together, these results suggest that eCB-LTD can be observed in both D1- and D2-MSNs and that we observe a selective lack of eCB-LTD in D1miRmGluR5 mice. If eCB-LTD in D2-MSNs would contribute to a decrease in reward-seeking responses, systemic or accumbal mGluR5 and presynaptic CB1R blockade should have led to an additional decline of responding in D1miRmGluR5 mice. This, however, was not the case (Figures 1, S2, and S3), which led us to the conclusion that eCB-LTD in D2-MSNs play no or an insignificant role in processing of reward-seeking responses, which is also in line with previous studies (Calipari et al., 2016, Hikida et al., 2010, Lobo and Nestler, 2011, Ma et al., 2018, Soares-Cunha et al., 2016).
We have previously shown that both CB1R and mGluR2/3 receptors share the same presynaptic machinery to induce LTD (Mato et al., 2005). To test if mGluR2/3-induced LTD is altered in D1miRmGluR5 mice we examined excitatory postsynaptic currents (EPSCs) in NAc MSNs following bath application of the mGluR2/3 agonist LY379268 and did not observe any genotype difference in LTD induction (Figure 2D), showing that the presynaptic LTD machinery is normal in D1miRmGluR5 mice.
Covariance of presynaptic CB1R functionality and eCB-LTD has been previously reported (Mato et al., 2004, Lafourcade et al., 2011). Thus, we thought to evaluate presynaptic CB1R efficiency in D1miRmGluR5 mice. The dose-response curve for the inhibition of evoked synaptic transmission in response to bath perfusion of the CB1R agonist CP55,940 was shifted to the right in NAc synapses of D1miRmGluR5 mice compared with wild-types (Figure 3J; CP55, 940 0.1 μM; p < 0.05) but the maximal inhibition was not significantly reduced (CP55, 940 10 μM; p = 0.54). Basal synaptic transmission was also not altered, as administration of a CB1R antagonist did not affect the basal synaptic transmission of both genotypes (Figure S5). These results suggest reduced CB1R expression in D1miRmGluR5 mice. We thus set out to study possible alteration in the eCB machinery on the ultrastructural level in our genetic mouse model.
Deletion of eCB-LTD in the NAc Is a Consequence of Augmented MAGL Activity and Reduced CB1R Expression
CB1R and other components of the eCB system, such as the key enzymes monoacylglycerol lipase (MAGL) (Pan et al., 2011) and diacylglycerol lipase-α (DAGL-α) (Gao et al., 2010), as well as 2-arachidonylglycerol (2-AG) and other eCBs may have been influenced by the constitutive deletion of eCB-LTD in our genetic model. Here we used electron microscopy to analyze the distribution of CB1R, DAGL-α, and MAGL and mass spectrometry to quantify eCBs levels in the NAc of both wild-type and mutant mice.
As described previously (Puente et al., 2011), CB1R labeling was localized at presynaptic terminals making asymmetric synapses with dendritic spines and small dendrites (Figures 3A and 3D). A significant reduction of CB1R immunoparticles in D1miRmGluR5 mice compared with wild-type mice was found on the ultrastructural level within the NAc (Figure 3A, 3D, and 3G, t(13) = 5.2, p <0.0005). Hence, reduced presynaptic expression of CB1R correlates with the reduced inhibition of CB1R-dependent excitatory transmission observed in the mutants (Figure 3J). The distribution of DAGL-α and presynaptic MAGL was in agreement with the subcellular pattern in other brain structures (Puente et al., 2011): DAGL-α immunolabeling was mostly distributed in spine head membranes postsynaptic to asymmetric synapses (Figures 3B and 3E), and MAGL immunoparticles were in membranes of excitatory synaptic terminals (Figures 3C and 3F). The proportion of immunoparticles for DAGL-α and presynaptic MAGL did not differ between genotypes (Figure 3G). MAGL was also found at dendritic spines, where it was significantly higher expressed in the mutants (Figure 3G, t(14) = 2.5, p < 0.05). The significance of a differential distribution of this enzyme (pre- and postsynaptically) and the apparent paradox of increased postsynaptic expression with no changes in DAGL-α is not clear and might indicate non-overlapping functions of this enzyme, which could enable the establishment of two different pools of 2-AG, pre-stored and released, as it has been already suggested (Alger and Kim, 2011). Nevertheless, any possible functional relevance of increased postsynaptic MAGL activity in D1miRmGluR5 to eCB- mediated LTD is unlikely, as the hydrolysis by means of presynaptic MAGL has been proposed as a primary mechanism for 2-AG inactivation (Dinh et al., 2002).
The basal un-stimulated endogenous concentrations of 2-AG and anandamide (AEA) were normal in D1miRmGluR5 mice (Figures 3H and 3I: 2-AG: t(18) = -0.3, p = 0.7; AEA: t(18) = -0.2, p = 0.8). Neither 2-AG and AEA nor the metabolites 1-arachidonoyl glycerol (1-AG), arachidonic acid (AA), and other eCB congener concentrations, including oleoylethanolamide (OEA) and palmitoylethanolamide (PEA), (Figure S6) were affected. This finding is in line with the overall normal expression levels of the key enzymes in the mutant mice and supports the assertion that 2-AG levels are solely determined by the balance between production (DAGL- α) and presynaptic degradation by MAGL (Ohno-Shosaku et al., 2012). In summary, these ultrastructural data show that an augmented postsynaptic MAGL activity, combined with reduced CB1R and a lack of mGluR5, is the molecular alterations that result in a lack of eCB-LTD. One possibility to counteract these molecular alterations and to restore eCB-LTD is by increasing 2-AG levels (Bosch-Bouju et al., 2016).
Enhancement of eCB Signaling Restores eCB-LTD and Reward-Seeking Responses in D1miRmGluR5
The MAGL inhibitor JZL184 produces a selective blockade of 2-AG hydrolysis and thereby leads to an increase in 2-AG levels (Long et al., 2009, Bosch-Bouju et al., 2016). JZL184 (1 mM) restored eCB-LTD in the NAc in D1miRmGluR5 (Figure 4A). Likewise, systemic application of JZL184 prior to the reinstatement led to a saccharin-seeking response in D1miRmGluR5 mice (Figure 4B, t (2.8) = −2.8, p < 0.05), which was comparable to the one observed in wild-type mice. In wild-type mice the reinstatement response was attenuated by JZL184 (Figure S7, t (13) = 9.2, p < 0.0001), possibly due to the functional desensitization of CB1R in response to elevated 2-AG levels (Long et al., 2009) or due to the rewarding properties of enhanced endogenous 2-AG levels (Justinova et al., 2005), and subsequent CB1R stimulation. As a proof of concept experiments, we sought to demonstrate a direct role of the NAc by infusing JZL184 into this brain site. JZL184 dose-dependently restored the reinstatement response (Figure 4C, t (7) = 3.4, p < 0.05 and t (7) = 4.4, p < 0.01 for 1.6 and 3μg/0.5μL, respectively). Taken together, these data show that increasing 2-AG levels and thereby CB1R signaling in the NAc restores e-CB-LTD in D1miRmGluR5 mice and subsequently reward-seeking responses.
If eCB-LTD in D1-containing neurons is the physiological substrate of reward-seeking behavior, one should be able to manipulate reward-seeking by prior drug administration. Thus, it has been shown that already a single in vivo exposure to cocaine (Fourgeaud et al., 2004) or Δ9-THC (Mato et al., 2004) abolishes eCB-LTD in the NAc. Therefore, acute drug treatment that ablates eCB-LTD should impede reward seeking in wild-type mice. Indeed, a single cocaine or CP55,940 injection 24 h before reinstatement testing—a protocol that abolishes eCB-LTD—selectively inhibited cue-induced saccharin-seeking responses (Figure 4D, ANOVA, for cocaine: reinstatement effect: F(2,22) = 11.9, p < 0.001; reinstatement × treatment interaction effect: F(4,34) = 4.5, p < 0.01; Figure 4E, for CP55,940: reinstatement effect: F(2,26) = 16.9, p < 0.0001; reinstatement × treatment interaction effect: F(2,26) = 7.7, p < 0.005) but not self-administration (Figure 4F, self-administration effect: F(1,11) = 3.7, p = 0.08; treatment effect: F(1,11) = 0.3, p = 0.6) in wild-type mice. This is a finding with clinical implications, as it would suggest that acute forced drug administration abolishes craving for an alternative reinforcer on subsequent days. This observation deserves closer investigations, especially in relevance for human drug-taking behavior.
Discussion
Here we propose a model (Figure 4G) in which the presentation of drug-conditioned cues activate excitatory afferents to the NAc and facilitate drug and natural reward-seeking responses by encoding reward-associated cues (Britt et al., 2012). This excitation leads to an increase of accumbal glutamate transmission (Kalivas, 2009) and activation of postsynaptic mGluR5 on D1-MSNs. Subsequent mGluR5-mediated eCB-LTD within the NAc leads then to an inhibition of cue-induced glutamate release and finally to a state of seeking for the reward-associated cue. The selective inhibition of glutamate transmission might not take place when key players such as CB1R and mGluR5 are pharmacologically blocked or genetically manipulated as in our D1miRmGluR5 mutants. Hence in D1miRmGluR5 mice, presentation of a reward-associated cue does not activate the mGluR5-dependent perisynaptic signaling machinery; i.e., the synthesis and release of 2-AG through the diacylglycerol pathway (Hashimotodani et al., 2007). A downregulation of CB1R from glutamatergic terminals ultimately results in an impairment of long-term control of glutamate release by a lack of D1-MSN mediated LTD induction. Without this LTD, seeking behavior in these mutant mice is not triggered.
Our data are compatible with the idea that both D1- and D2 (as well as D1/D2)-expressing neurons produce 2-AG in the NAc. We propose that in wild-type mice, D1 and D1/D2 MSNs are a principal source of the 2-AG that mediates eCB-LTD and reward-seeking responses. In our D1miRmGluR5 mutants, the production of 2-AG is insufficient to reach the threshold of LTD induction. In the presence of JZL184, 2-AG is augmented and sufficient to trigger LTD. This idea in line with a recent study shows that mGluR5 antagonism inhibits cocaine reinforcement and relapse by elevation of extracellular glutamate in the NAc via a CB1 receptor mechanism (Li et al., 2018).
The possibility that D2-MSN in the NAc core could have also contributed to the alterations in reward-seeking responses in mutant mice is unlikely because a previous study by Anderson et al. (2006) showed that cooperative activation of D1-like and D2-like dopamine receptors is required for the reinstatement of a drug-seeking behavior in the NAc shell, but not core. Furthermore, neither systemic nor accumbal mGluR5 or presynaptic CB1R blockade led to a further decrease in D1miRmGluR5 mutants (Figure 1, S2, and S3). This suggests that eCB-LTD in D2-MSNs plays no or only a minor role in the processing of reward-seeking responses, which is also in line with previous studies (Calipari et al., 2016, Hikida et al., 2010, Lobo and Nestler, 2011, Ma et al., 2018, Soares-Cunha et al., 2016).
In conclusion, we show that mGluR5 interacts with the eCB system to induce synaptic changes in D1 neurons in the NAc and that the resulting eCB-LTD mediates cue-induced reward-seeking responses. We propose that such molecular and synaptic events contribute to the common neural circuit adaptations that underlie the persistence of natural and drug reward memories. Cues paired with drugs of abuse can drive behavioral and physiological responses responsible for craving and relapse even after long periods of abstinence (Shaham et al., 2003, Sanchis-Segura and Spanagel, 2006), and similarly, cues conditioned to non-drug rewards such as highly palatable liquids and food, sex, and money induce similar network activity and contribute to overeating, obesity, gambling, and other forms of addictive behavior (Noori et al., 2016). Proposing that natural and drug rewards share the same molecular and physiological correlate for cue-induced reward-seeking responses, medications targeting mGluR5-dependent eCB-LTD, such as compounds that modulate endogenous 2-AG levels, may be useful in treating a variety of addictive behaviors.
Limitations of the Study
The present study has two limitations. First, with our mouse model we could not well distinguish about the contribution of D1- and D2-MSNs in the processing of reward-seeking responses. Although our data strongly support the conclusion that eCB-LTD in D2-MSNs plays no important role in processing of reward-seeking responses, the use of D2miRmGluR5 mutants would have provided full evidence for this conclusion. Clearly, the generation of such a selective transgenic mouse model and its full behavioral, molecular, neuroanatomical, and physiological characterization as presented here for D1miRmGluR5 mutants would have been a major contribution on its own. Secondly, we did not perform slice experiments to test if saccharin exposure can abolish eCB-LTD. This research question was indeed of interest in regard to our previous publications where we showed that eCB-mediated synaptic plasticity in the NAc is eliminated following exposure to drugs of abuse (Mato et al., 2004, Fourgeaud et al., 2004, Zlebnik and Cheer, 2016). However, in the context of this study, this additional information would not have impact on our conclusions: the present work tested the hypothesis that eCB-LTD in D1 MSN mediates reward-seeking behavior and not that natural rewards would abolish this form of plasticity.
Methods
All methods can be found in the accompanying Transparent Methods supplemental file.
Acknowledgments
We would like to thank Rick Bernardi for editing this manuscript and Anne Rohrbacher for tissue preparation. This work was supported by the BundesministeriumfürBildung und Forschung (e:Med program; FKZ: 01ZX1311A and 01ZX1909, Spanagel et al., 2013) and the Deutsche Forschungsgemeinschaft (DFG, Germany) TRR265/A05 and SFB1158/B04. Work in O.J.M. laboratory is supported by INSERM. C.S. and R.L were supported by the DFG Research Unit FOR926 (central project CP1) and by the BMBF Consortium LOGIN. Funding for P.G.’s laboratory was provided by Red de TrastornosAdictivos, ISCIII (“RD16/0017/0012” to PG), co-funded by ERDF/ESF, “Investing in your future”; The Basque Government (IT1230-19) and MINECO/FEDER, UE (SAF2015-65034-R).
Author Contributions
A.B., M.E., S.P.W., S.L., and R.S. performed and analyzed the behavioral experiments. A.T., D.N., O.L., M.S and O.M performed and analyzed the electrophysiology experiments. A.T. prepared the original electrophysiology figures, drafted an early version of the manuscript and participated to the manuscript's correction. A.R.V., N.P., and P.G. performed and analyzed the immunohistochemistry for electron microscopy experiment. R.L. and B.L. performed and analyzed the measurement of eCB levels. A.B., O.M., and R.S. are accountable for the integrity of the data reported in the paper, carried out the analysis, and wrote the manuscript; all of the authors participated in the design and analysis of experiments and in editing of the paper.
Declaration of Interests
The authors declare no competing interests.
Published: March 27, 2020
Footnotes
Supplemental Information can be found online at https://doi.org/10.1016/j.isci.2020.100951.
Contributor Information
Ainhoa Bilbao, Email: ainhoa.bilbao@zi-mannheim.de.
Olivier J. Manzoni, Email: olivier.manzoni@inserm.fr.
Rainer Spanagel, Email: rainer.spanagel@zi-mannheim.de.
Supplemental Information
References
- Adams C.L., Short J.L., Lawrence A.J. Cue-conditioned alcohol seeking in rats following abstinence: involvement of metabotropic glutamate 5 receptors. Br. J. Pharmacol. 2010;159:534–542. doi: 10.1111/j.1476-5381.2009.00562.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Alger B.E., Kim J. Supply and demand for endocannabinoids. Trends Neurosci. 2011;34:304–315. doi: 10.1016/j.tins.2011.03.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Alvarez-Jaimes L., Polis I., Parsons L.H. Attenuation of cue-induced heroin-seeking behavior by cannabinoid CB1 antagonist infusions into the nucleus accumbens core and prefrontal cortex, but not basolateral amygdala. Neuropsychopharmacology. 2008;10:2483–2489. doi: 10.1038/sj.npp.1301630. [DOI] [PubMed] [Google Scholar]
- Anderson S.M., Schmidt H.D., Pierce R.C. Administration of the D2 dopamine receptor antagonist sulpiride into the shell, but not the core, of the nucleus accumbens attenuates cocaine priming-induced reinstatement of drug seeking. Neuropsychopharmacology. 2006;31:1452–1461. doi: 10.1038/sj.npp.1300922. [DOI] [PubMed] [Google Scholar]
- Araque A., Castillo P.E., Manzoni O.J., Tonini R. Synaptic functions of endocannabinoid signaling in health and disease. Neuropharmacology. 2017;124:13–24. doi: 10.1016/j.neuropharm.2017.06.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bäckström P., Bachteler D., Koch S., Hyytiä P., Spanagel R. mGluR5 antagonist MPEP reduces ethanol-seeking and relapse behavior. Neuropsychopharmacology. 2004;29:921–928. doi: 10.1038/sj.npp.1300381. [DOI] [PubMed] [Google Scholar]
- Bilbao A., Robinson J.E., Heilig M., Malanga C.J., Spanagel R., Sommer W.H., Thorsell A. A pharmacogenetic determinant of mu-opioid receptor antagonist effects on alcohol reward and consumption: evidence from humanized mice. Biol. Psychiatry. 2015;77:850–858. doi: 10.1016/j.biopsych.2014.08.021. [DOI] [PubMed] [Google Scholar]
- Bosch-Bouju C., Larrieu T., Linders L., Manzoni O.J., Layé S. Endocannabinoid-mediated plasticity in nucleus accumbenscontrols vulnerability to anxiety after social defeat stress. Cell Rep. 2016;16:1237–1242. doi: 10.1016/j.celrep.2016.06.082. [DOI] [PubMed] [Google Scholar]
- Britt J.P., Benaliouad F., McDevitt R.A., Stuber G.D., Wise R.A., Bonci A. Synaptic and behavioral profile of multiple glutamatergic inputs to the nucleus accumbens. Neuron. 2012;76:790–803. doi: 10.1016/j.neuron.2012.09.040. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Calipari E.S., Bagot R.C., Purushothaman I., Davidson T.J., Yorgason J.T., Peña C.J., Walker D.M., Pirpinias S.T., Guise K.G., Ramakrishnan C. In vivo imaging identifies temporal signature of D1 and D2 medium spiny neurons in cocaine reward. Proc. Natl. Acad. Sci. U S A. 2016;113:2726–2731. doi: 10.1073/pnas.1521238113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cippitelli A., Bilbao A., Hansson A.C., del Arco I., Sommer W.H., Heilig M., Massi M., Bermúdez-Silva F.J., Navarro M., Ciccocioppo R. Cannabinoid CB1 receptor antagonism reduces conditioned reinstatement of ethanol-seeking behavior in rats. Eur. J. Neurosci. 2005;21:2243–2251. doi: 10.1111/j.1460-9568.2005.04056.x. [DOI] [PubMed] [Google Scholar]
- Cleva R.M., Watterson L.R., Johnson M.A., Olive M.F. Differential modulation of thresholds for intracranial self-stimulation by mGlu5 positive and negative allosteric modulators: implications for effects on drug self-administration. Front. Pharmacol. 2012;2:93. doi: 10.3389/fphar.2011.00093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dinh T.P., Freund T.F., Piomelli D. A role for monoglyceride lipase in 2-arachidonoylglycerol inactivation. Chem. Phys. Lipids. 2002;121:149–158. doi: 10.1016/s0009-3084(02)00150-0. [DOI] [PubMed] [Google Scholar]
- Eisenhardt M., Leixner S., Luján R., Spanagel R., Bilbao A. Glutamate receptors within the mesolimbic dopamine system mediate alcohol relapse behavior. J. Neurosci. 2015;35:15523–15538. doi: 10.1523/JNEUROSCI.2970-15.2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fattore L., Fadda P., Fratta W. Endocannabinoid regulation of relapse mechanisms. Pharmacol. Res. 2007;56:418–427. doi: 10.1016/j.phrs.2007.09.004. [DOI] [PubMed] [Google Scholar]
- Fourgeaud L., Mato S., Bouchet D., Hémar A., Worley P.F., Manzoni O.J. A single in vivo exposure to cocaine abolishes endocannabinoid-mediated long-term depression in the nucleus accumbens. J. Neurosci. 2004;24:6939–6945. doi: 10.1523/JNEUROSCI.0671-04.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gao Y., Vasilyev D.V., Goncalves M.B., Howell F.V., Hobbs C., Reisenberg M., Shen R., Zhang M.Y., Strassle B.W., Lu P. Loss of retrograde endocannabinoidsignaling and reduced adult neurogenesis in diacylglycerol lipase knock-out mice. J. Neurosci. 2010;30:2017–2024. doi: 10.1523/JNEUROSCI.5693-09.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grueter B.A., Brasnjo G., Malenka R.C. Postsynaptic TRPV1 triggers cell type-specific long-term depression in the nucleus accumbens. Nat. Neurosci. 2010;13:1519–1525. doi: 10.1038/nn.2685. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hashimotodani Y., Ohno-Shosaku T., Kano M. Ca2+-assisted receptor-driven endocannabinoid release: mechanisms that associate presynaptic and postsynaptic activities. Curr. Opin. Neurobiol. 2007;17:360–365. doi: 10.1016/j.conb.2007.03.012. [DOI] [PubMed] [Google Scholar]
- Hikida T., Kimura K., Wada N., Funabiki K., Nakanishi S. Distinct roles of synaptic transmission in direct and indirect striatal pathways to reward and aversive behavior. Neuron. 2010;66:896–907. doi: 10.1016/j.neuron.2010.05.011. [DOI] [PubMed] [Google Scholar]
- Justinova Z., Solinas M., Tanda G., Redhi G.H., Goldberg S.R. The endogenous cannabinoid anandamide and its synthetic analog R(+)-methanandamide are intravenously self-administered by squirrel monkeys. J. Neurosci. 2005;25:5645–5650. doi: 10.1523/JNEUROSCI.0951-05.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kalivas P.W. The glutamate homeostasis hypothesis of addiction. Nat. Rev. Neurosci. 2009;10:561–572. doi: 10.1038/nrn2515. [DOI] [PubMed] [Google Scholar]
- Katona I., Freund T.F. Multiple functions of endocannabinoid signaling in the brain. Annu. Rev. Neurosci. 2012;35:529–558. doi: 10.1146/annurev-neuro-062111-150420. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knackstedt L.A., Trantham-Davidson H.L., Schwendt M. The role of ventral and dorsal striatum mGluR5 in relapse to cocaine-seeking and extinction learning. Addict. Biol. 2014;19:87–101. doi: 10.1111/adb.12061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kodas E., Cohen C., Louis C., Griebel G. Cortico-limbic circuitry for conditioned nicotine-seeking behaviour in rats involves endocannabinoidsignalling. Psychopharmacology (Berl) 2007;194:161–171. doi: 10.1007/s00213-007-0813-0. [DOI] [PubMed] [Google Scholar]
- Kreitzer A.C., Malenka R.C. Endocannabinoid-mediated rescue of striatal LTD and motor deficits in Parkinson's disease models. Nature. 2007;445:643–647. doi: 10.1038/nature05506. [DOI] [PubMed] [Google Scholar]
- Lafourcade M., Larrieu T., Mato S., Duffaud A., Sepers M., Matias I., De Smedt-Peyrusse V., Labrousse V.F., Bretillon L., Matute C. Nutritional omega-3 deficiency abolishes endocannabinoid-mediated neuronal functions. Nat. Neurosci. 2011;14:345–350. doi: 10.1038/nn.2736. [DOI] [PubMed] [Google Scholar]
- Li X., Peng X.Q., Jordan C.J., Li J., Bi G.H., He Y., Yang H.J., Zhang H.Y., Gardner E.L., Xi Z.X. mGluR5 antagonism inhibits cocaine reinforcement and relapse by elevation of extracellular glutamate in the nucleus accumbens via a CB1 receptor mechanism. Sci. Rep. 2018;8:3686. doi: 10.1038/s41598-018-22087-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lobo M.K., Nestler E.J. The striatal balancing act in drug addiction: distinct roles of direct and indirect pathway medium spiny neurons. Front. Neuroanat. 2011;5:41. doi: 10.3389/fnana.2011.00041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Long J.Z., Li W., Booker L., Burston J.J., Kinsey S.G., Schlosburg J.E., Pavón F.J., Serrano A.M., Selley D.E., Parsons L.H. Selective blockade of 2-arachidonoylglycerol hydrolysis produces cannabinoid behavioral effects. Nat. Chem. Biol. 2009;5:37–44. doi: 10.1038/nchembio.129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lüscher C., Malenka R.C. Drug-evoked synaptic plasticity in addiction: from molecular changes to circuit remodelling. Neuron. 2011;69:650–663. doi: 10.1016/j.neuron.2011.01.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ma T., Cheng Y., Roltsch E., Wang X., Lu J., Gao X., Huang C.C.Y., Wei X.Y., Ji J.Y., Wang J. Bidirectional and long-lasting control of alcohol-seeking behavior by corticostriatal LTP and LTD. Nat.Neurosci. 2018;21:373–383. doi: 10.1038/s41593-018-0081-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mato S., Chevaleyre V., Robbe D., Pazos A., Castillo P.E., Manzoni O.J. A single in-vivo exposure to delta 9THC blocks endocannabinoid-mediated synaptic plasticity. Nat. Neurosci. 2004;6:585–586. doi: 10.1038/nn1251. [DOI] [PubMed] [Google Scholar]
- Mato S., Robbe D., Grandes P., Manzoni O.J. Presynaptic homeostatic plasticity rescues long-term depression after chronic Delta 9-tetrahydrocannabinol exposure. J. Neurosci. 2005;25:11619–11627. doi: 10.1523/JNEUROSCI.2294-05.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mihov Y., Hasler G. Negative allosteric modulators of metabotropic glutamate receptors subtype 5 in addiction: a therapeutic window. Int. J. Neuropsychopharmacol. 2016;19 doi: 10.1093/ijnp/pyw002. pii: pyw002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nazzaro C., Greco B., Cerovic M., Baxter P., Rubino T., Trusel M., Parolaro D., Tkatch T., Benfenati F., Pedarzani P. SK channel modulation rescues striatal plasticity and control over habit in cannabinoid tolerance. Nat. Neurosci. 2012;15:284–293. doi: 10.1038/nn.3022. [DOI] [PubMed] [Google Scholar]
- Noori H.R., CosaLinan A., Spanagel R. Largely overlapping neuronal substrates of reactivity to drug, gambling, food and sexual cues: a comprehensive meta-analysis. Eur. Neuropsychopharmacol. 2016;26:1419–1430. doi: 10.1016/j.euroneuro.2016.06.013. [DOI] [PubMed] [Google Scholar]
- Novak M., Halbout B., O'Connor E.C., Rodriguez Parkitna J., Su T., Chai M., Crombag H.S., Bilbao A., Spanagel R., Stephens D.N. Incentive learning underlying cocaine-seeking requires mGluR5 receptors located on dopamine D1 receptor-expressing neurons. J. Neurosci. 2010;30:11973–11982. doi: 10.1523/JNEUROSCI.2550-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ohno-Shosaku T., Tanimura A., Hashimotodani Y., Kano M. Endocannabinoids and retrograde modulation of synaptic transmission. Neuroscientist. 2012;18:119–132. doi: 10.1177/1073858410397377. [DOI] [PubMed] [Google Scholar]
- Olive M.F. Metabotropic glutamate receptor ligands as potential therapeutics for addiction. Curr. Drug Abuse Rev. 2009;2:83–98. doi: 10.2174/1874473710902010083. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pan B., Wang W., Zhong P., Blankman J.L., Cravatt B.F., Liu Q.S. Alterations of endocannabinoid signaling, synaptic plasticity, learning, and memory in monoacylglycerol lipase knock-out mice. J. Neurosci. 2011;31:13420–13430. doi: 10.1523/JNEUROSCI.2075-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Puente N., Cui Y., Lassalle O., Lafourcade M., Georges F., Venance L., Grandes P., Manzoni O.J. Polymodal activation of the endocannabinoid system in the extended amygdala. Nat. Neurosci. 2011;12:1542–1547. doi: 10.1038/nn.2974. [DOI] [PubMed] [Google Scholar]
- Robbe D., Kopf M., Remaury A., Bockaert J., Manzoni O.J. Endogenous cannabinoids mediate long-term synaptic depression in the nucleus accumbens. Proc. Natl. Acad. Sci. U S A. 2002;99:8384–8388. doi: 10.1073/pnas.122149199. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Russo S.J., Dietz D.M., Dumitriu D., Morrison J.H., Malenka R.C., Nestler E.J. The addicted synapse: mechanisms of synaptic and structural plasticity in nucleus accumbens. Trends Neurosci. 2010;33:267–276. doi: 10.1016/j.tins.2010.02.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sanchis-Segura C., Spanagel R. Behavioural assessment of drug reinforcement and addictive features in rodents: an overview. Addict. Biol. 2006;11:2–38. doi: 10.1111/j.1369-1600.2006.00012.x. [DOI] [PubMed] [Google Scholar]
- Sanchis-Segura C., Cline B.H., Marsicano G., Lutz B., Spanagel R. Reduced sensitivity to reward in CB1 knockout mice. Psychopharmacology (Berl) 2004;176:223–232. doi: 10.1007/s00213-004-1877-8. [DOI] [PubMed] [Google Scholar]
- Schmidt H.D., Kimmey B.A., Arreola A.C., Pierce R.C. Group I metabotropic glutamate receptor-mediated activation of PKC gamma in the nucleus accumbens core promotes the reinstatement of cocaine seeking. Addict. Biol. 2015;20:285–296. doi: 10.1111/adb.12122. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shaham Y., Shalev U., Lu L., De Wit H., Stewart J. The reinstatement model of drug relapse: history, methodology and major findings. Psychopharmacology (Berl) 2003;168:3–20. doi: 10.1007/s00213-002-1224-x. [DOI] [PubMed] [Google Scholar]
- Shen W., Flajolet M., Greengard P., Surmeier D.J. Dichotomous dopaminergic control of striatal synaptic plasticity. Science. 2008;321:848–851. doi: 10.1126/science.1160575. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sinclair C.M., Cleva R.M., Hood L.E., Olive M.F., Gass J.T. mGluR5 receptors in the basolateral amygdala and nucleus accumbens regulate cue-induced reinstatement of ethanol-seeking behavior. Pharmacol. Biochem. Behav. 2012;101:329–335. doi: 10.1016/j.pbb.2012.01.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Soares-Cunha C., Coimbra B., Sousa N., Rodrigues A.J. Reappraising striatal D1- and D2-neurons in reward and aversion. Neurosci. Biobehav. Rev. 2016;68:370–386. doi: 10.1016/j.neubiorev.2016.05.021. [DOI] [PubMed] [Google Scholar]
- Spanagel R., Durstewitz D., Hansson A., Heinz A., Kiefer F., Köhr G., Matthäus F., Nöthen M.M., Noori H.R., Obermayer K. A systems medicine research approach for studying alcohol addiction. Addict. Biol. 2013;18:883–896. doi: 10.1111/adb.12109. [DOI] [PubMed] [Google Scholar]
- De Vries T.J., Shaham Y., Homberg J.R., Crombag H., Schuurman K., Dieben J., Vanderschuren L.J., Schoffelmeer A.N. A cannabinoid mechanism in relapse to cocaine seeking. Nat. Med. 2001;7:1151–1154. doi: 10.1038/nm1001-1151. [DOI] [PubMed] [Google Scholar]
- Wang X., Moussawi K., Knackstedt L., Shen H., Kalivas P.W. Role of mGluR5 neurotransmission in reinstated cocaine-seeking. Addict. Biol. 2013;18:40–49. doi: 10.1111/j.1369-1600.2011.00432.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Watterson L.R., Kufahl P.R., Nemirovsky N.E., Sewalia K., Hood L.E., Olive M.F. Attenuation of reinstatement of methamphetamine-, sucrose-, and food-seeking behavior in rats by fenobam, a metabotropic glutamate receptor 5 negative allosteric modulator. Psychopharmacology. 2013;225:151–159. doi: 10.1007/s00213-012-2804-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xi Z.X., Gilbert J.G., Peng X.Q., Pak A.C., Li X., Gardner E.L. Cannabinoid CB1 receptor antagonist AM251 inhibits cocaine-primed relapse in rats: role of glutamate in the nucleus accumbens. J. Neurosci. 2006;26:8531–8536. doi: 10.1523/JNEUROSCI.0726-06.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zlebnik N.E., Cheer J.F. Drug-induced alterations of endocannabinoid-mediated plasticity in brain reward regions. J. Neurosci. 2016;36:10230–10238. doi: 10.1523/JNEUROSCI.1712-16.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.