Abstract
Background
Dopamine modulation of neuronal signaling in the frontal cortex, midbrain, and striatum is essential for processing and integrating diverse external sensory stimuli and attaching salience to environmental cues that signal causal relationships, thereby guiding goal-directed, adaptable behaviors. At the cellular level, dopamine signaling is mediated through D1-like or D2-like receptors. Although a role for D1-like receptors in a variety of goal-directed behaviors has been identified, an explicit involvement of D2 receptors has not been clearly established. To determine whether dopamine D2 receptor-mediated signaling contributes to associative and reversal learning, we compared C57Bl/6J mice that completely lack functional dopamine D2 receptors to wild-type mice with respect to their ability to attach appropriate salience to external stimuli (stimulus discrimination) and disengage from inappropriate behavioral strategies when reinforcement contingencies change (e.g. reversal learning).
Results
Mildly food-deprived female wild-type and dopamine D2 receptor deficient mice rapidly learned to retrieve and consume visible food reinforcers from a small plastic dish. Furthermore, both genotypes readily learned to dig through the same dish filled with sterile sand in order to locate a buried food pellet. However, the dopamine D2 receptor deficient mice required significantly more trials than wild-type mice to discriminate between two dishes, each filled with a different scented sand, and to associate one of the two odors with the presence of a reinforcer (food). In addition, the dopamine D2 receptor deficient mice repeatedly fail to alter their response patterns during reversal trials where the reinforcement rules were inverted.
Conclusions
Inbred C57Bl/6J mice that develop in the complete absence of functional dopamine D2 receptors are capable of olfaction but display an impaired ability to acquire odor-driven reinforcement contingencies. Furthermore, the ability of dopamine D2 receptor deficient mice to adjust their responding to a previously reinforced stimulus when unexpected outcomes are encountered is significantly impaired. These findings suggest that signaling mediated by the dopamine D2 receptor is important for regulating associative and reversal learning and may have implications for the treatment of human attention disorders.
Background
Reinforcement-mediated associative learning, or the ability to ascribe deterministic relationships between environmental stimuli that signal the probability of receiving a primary reinforcer (e.g. food), has been divided into 3 components or stages [1]. The first, unlearned stage is the organism's experience with a primary reinforcer that elicits some unlearned/innate physiological response (e.g. palatability of a food or satiety). The second phase involves the attachment of salience to external stimuli (discriminative stimuli) that signal whether the delivery of a primary reinforcer will or will not occur based on some emitted behavior (e.g. a rodent lever presses for food pellets only when a stimulus light is illuminated in an operant chamber). Finally, there is the maintenance of associative learning relationships over time (a stimulus light always signifies a food pellet is available subsequent to a lever press) [see refs. [1,2] for review]. Berridge and Robinson [1] have proposed that dopamine plays a pivotal role in the second phase of reinforcement-mediated associative learning by molding the "incentive salience" or learned motivational properties of conditioned stimuli. In support of this view are several studies demonstrating that the disruption of dopamine signaling via acute blockade of dopamine receptors with dopamine receptor antagonists [3-9] or 6-OHDA lesions [1,10,11] do not disrupt phase 1, the palatability or primary reinforcing characteristics of a natural reinforcer (e.g. palatability) but disrupt phase 2, the formation of incentive salience.
Dopamine signaling is mediated at the cellular level by two major subclasses of G-protein coupled receptors that are referred to as D-1 like (D1aR, D1b/5R) or D-2 like (D2R, D3R, D4R) [12,13]. Although individual genes code for each dopamine receptor subtype, there is considerable pharmacological overlap between D1-like and D2-like receptors. Several studies have used pharmacological manipulations to investigate the contribution of dopamine receptor subtypes in various stages of associative learning [1,2,14]. Currently it is held that excitatory dopamine D1Rs mediate the acquisition and expression of several conditioned behaviors involving food reinforcers [e.g. [6,7]] as well as responding for conditioned cues predictive of cocaine delivery [9] – consistent with the interpretation that D1R mediated signaling might modulate the maintenance of stimulus-response outcomes. Despite a growing literature demonstrating disrupted associative learning following acute manipulations of dopamine D1R signaling during acquisition of associative learning tasks with food [e.g. [6,7]], the actual contribution of D2R-mediated signaling on acquisition and maintenance of associative learning in rodents is unresolved.
While D2R antagonists have been used in the context of rodent associative learning paradigms, their lack of receptor subtype specificity [13] and motor-disrupting effects [6,8] have prevented a rigorous examination of the actual role this dopamine receptor subtype plays in associative and reversal learning in the context of an operant behavior. Past experiments seeking to explore the possible involvement of dopamine D2Rs in associative learning have utilized low to moderate doses of drugs [2,5,6] and site-specific administration [7,9] in order to avoid the confounding effect that locomotor disruption associated with acute D2R blockade can have on learning performance in rodents. Besides their lack of receptor subtype specificity, an acute exposure to commercially available D2 receptor antagonists fails to completely block signaling mediated solely by D2Rs. Moreover, acute dosing does not recapitulate the marked learning deficits produced in rodents [15,16] by chronic exposure to dopamine D2R antagonists [6,7].
The influence of dopamine D2R-mediated signaling on reversal learning is also poorly understood. Reversal learning can be conceptualized as the ability to recognize an unexpected consequence to a previously established associative learning rule and then alter response strategies accordingly [17,18]. Reversal learning in rodents can serve as an index of learning adaptability and alertness that correlates with human attentional-shift paradigms [17,18]. Additionally, a previous report demonstrated that excitotoxic lesions of terminal field targets of mesocortical dopamine have been shown to disrupt reversal learning [19]. Administration of the D2R/D3R antagonist, sulpiride, impairs spatial reversal leaning in mice [20] and has also been shown to impair attention and the cognitive performances of healthy human volunteers [21]. Moreover an inverse relationship between lower dopamine D2R levels and compulsive behavior in human subjects has been reported [22]. Taken together these findings suggest that D2R-mediated signaling could play a critical role in reversal learning but are insufficient to prove it.
In an effort to establish the contribution of dopamine D2 receptor-mediated signaling to associative and non-spatial reversal learning in adult mice, we compared mice [23] that had developed in the complete absence of all functional dopamine D2 receptors (D2R-/-) to wild-type littermates (D2R+/+) in a go/no-go operant learning procedure that measures primary reinforcement, sensory processing, and reversal learning [17-19]. Here we report that dopamine D2R-mediated signaling must be intact if a mouse is to efficiently learn to associate a food reinforcer with a specific odor and then adaptively disengage inappropriate behavioral strategies following the reversal of reinforcement contingencies.
Results
Both wild-type and D2R deficient mice learn operant behaviors equally well
Mildly food-deprived D2R+/+ and D2R-/- mice readily learned to locate and consume food pellets during both training sessions. Figure 1 depicts the latency for both genotypes to ambulate to a dish to retrieve an unhidden food pellet. There were no differences between genotypes to retrieve the reinforcers (F1,59 = 0.2, p > 0.65), and both groups significantly decreased the amount of time necessary to perform this task along successive trials (F4,59 = 5.74, p < 0.001). Figure 2 depicts the latency to dig for the food pellet buried in a single dish filled with unscented sand. No genotype differences were found in the ability to dig through unscented sand for a hidden food pellet (F1,128 = 1.26, p > 0.27).
Wild-type mice outperform D2R-/- mice in an odor-driven, stimulus-discrimination, operant task
To master the odor-driven stimulus discrimination task, D2R-/- mice required significantly more trials (Fig. 3A: t(14) = 2.20; p < 0.05) and committed more errors (Fig. 3B: t(14) = 2.92; p < 0.05) than D2R+/+ mice to learn to associate a specific odor with the presence or absence of the food reinforcer. However, both genotypes did learn the task and eventually maintained accurate discrimination for a minimum of 8 correct responses out of 10 trials.
Mice lacking dopamine D2 receptors engage in unreinforced behavior in a perseverative manner following reversal of reinforcement contingencies
D2R-/- mice repeatedly failed to inhibit previously established learning contingencies during reversal trials (Fig. 4A: t(14) = 3.54; p < 0.01) and committed significantly more reversal errors than D2R+/+ mice (Fig. 4B: t(14)= 3.18; p < 0.01). Categorical division of reversal errors (Ferry et al., 2000) – digging in the dish that did not contain the food pellet (S-) (error of commission; Fig. 5A) versus failing to respond within 3-min of presentation (error of omission; Fig. 5B) revealed that both genotypes chiefly committed errors of commission versus errors of omission (D2R-/- mice, U = 0.00; p < 0.01; D2R+/+ mice U = 9.00, p < 0.05), D2R-/- mice committed more commission errors than D2R+/+ mice (U = 5.00, p < 0.05), and there were no differences between D2R-/- and D2R+/+ mice in omission errors (U = 27.5, p = 0.65). Moreover, the number of commission errors committed during the first reversal session (an index of stimulus bound perseveration, where all animals are responding to the reversed contingencies for the first time; Fig. 6) indicated a deficit in the D2R-/- mice compared to the D2R+/+ mice (U = 8.5, p < 0.01). Finally, in an attempt to assess whether perseveration occurred across multiple reversal sessions (Fig. 7), we analyzed the number of commission errors emitted before relearning the reinforcement contingencies during the reversal sessions. The data depicted were collected from subjects that had not achieved the 80% performance criterion. Therefore, the number of D2R+/+ mice represented in session #1 is 8, in session #2 n = 8, session #3 n = 6 (2 mice met our criterion), in session # 4 n = 5 (three met the criterion). Following session 5, the remaining 5 D2R+/+ mice had met criteria. For the D2R-/- mice, each point on the graph represents 8 subjects. None of the D2R-/- mice achieved the criterion of 80% accuracy by session 5. For the overall 2-way ANOVA, there was a significant difference between genotypes for the number of perseverative errors (F1,51 = 16.61, p < 0.001).
Discussion
In this study, we sought to determine the contribution of dopamine D2 receptor-mediated signaling to the various stages of associative and reversal learning. D2R-/- mice demonstrated that they were capable of learning to locate and consume food pellets, indicating that their locomotor behavior was not detectably disrupted and their primary motivation to obtain a natural reinforcer (food pellet) was undisturbed. Rather, the impaired ability of D2R-/- mice to assign appropriate discriminative stimulus relationships in an operant discrimination task argues that D2R-mediated signaling contributes to the neuronal processes involved in attaching salience to environmental stimuli. The deficient capacity of D2R-/- mice to disengage inappropriate decision strategies strongly argues that mesolimbic dopamine signaling, mediated by dopamine D2Rs is essential for efficient reversal learning to occur.
Mice with or without intact dopamine D2R-mediated signaling displayed similar decreases in latencies to retrieve unhidden food pellets (Fig. 1) and learned to dig for food buried in unscented sand (Fig. 2). These findings are in complete agreement with earlier studies that utilized rats and fairly selective D2R antagonists [3-8], as well as even very extensive 6-OHDA lesions [1,10,11] in associative and operant learning paradigms. Our results add to a growing literature demonstrating a negligible role of dopamine, and now, specifically, D2Rs in the unconditioned or hedonic value of natural (food) reinforcers [1,2].
The comparatively poor skill of D2R-/- mice during discrimination trials suggests a role for D2Rs in acquisition of appropriate S+/S- relationships in operant associative learning. Several studies have demonstrated that both the acquisition [6,7] and expression [9] of associative learning are mediated by dopamine D1Rs. Most literature reviews identify dopamine D1Rs with dopamine-mediated learning and D2Rs with motor related behaviors [e.g. [24]]. Moreover, it has been reported that acute administration of the dopamine D2/3 antagonist, raclopride, actually improves acquisition of food-motivated associative learning [6]. However, only acute administrations of antagonists were given, and learning was not measured during complete D1R or D2R blockade [6]. Significantly, the reports cited above failed to address the technical limitations of the approach: i.e. that the antagonists used lack adequate subtype specificity and only partially blocked D2R-mediated signaling thus making it impossible to rigorously assess the role of D2R-mediated signaling in associative and reversal learning. Additionally, none of these studies addressed the observation that the effects of D2R antagonists on locomotion and learning depend on whether exposure is chronic or acute [e.g. [15,16]].
That D2R-mediated signaling orchestrates just motor components of learning is a conclusion that is potentially biased due to the practice of avoiding doses of drugs that induce catalepsy (and therefore measuring only partial blockade of dopamine D2Rs) and single administrations [e.g. [3]]. Quite possibly, the functional role of D2Rs in associative learning might be masked because of this concern about locomotor disruption [2,6,8]. Doses of raclopride as low as 0.5 mg/kg significantly disrupt motor behavior [25], although this peripheral dose is consistently used in learning paradigms [e.g. [6]]. One might then ask: "How then could the role of D2Rs in associative learning be dissociated from motor behavior?" Seminal experiments [26-28] have clearly demonstrated that repeated administration of catalepsy-inducing doses of D2R antagonists in rodents actually leads to a striking behavioral tolerance to catalepsy. These doses have been shown to occupy well over 80% of available D2Rs [29]. Future experiments measuring acquisition of associative learning in rodents that received chronic administration of D2R antagonists and demonstrated behavioral tolerance to their motor disrupting effects would be a logical test of this hypothesis. However, the realization that multiple dopamine receptor subtypes would be concurrently targeted with the presently commercially available antagonists, such as D2Rs, D3Rs, and D4Rs would have to be rectified. We would argue that the most parsimonious approach at this time is to utilize mice that have been genetically altered such that they are lacking one or both functional alleles of the specific receptor of interest. While they do have their limitations (e.g. developmental compensation and strain effects in mouse lines not backcrossed adequately to a parental strain for a minimum of 10 generations), use of our inbred (N20 generation) animals in the present study (where no differences in locomotor behavior were detected between D2R-/- and D2R+/+ mice; Figs. 1 &2) revealed a previously unappreciated role of D2R-mediated signaling in associative learning and attention that could not be measured with the currently available, acutely administered D2R antagonists.
A cursory analysis of our data might suggest to some that the genetic manipulation of the drd2 locus conferred a gross olfactory impairment to the D2R-/- mice. Rather, we argue that this is not likely because the D2R-/- mice did learn to retrieve the food pellets from the dishes and eventually learned to accurately discriminate odors. Recent electrophysiological data demonstrate that dopamine D2R's are located on glutamatergic terminal axons of olfactory nerves and depress excitatory input of the olfactory nerve to the mitral cells of the olfactory bulb [30,31]. Consequently, our data, and data from other studies, suggest that the complete lack of D2Rs in the olfactory bulb does not prevent transduction of olfactory stimuli; rather it affects the ability to habituate, or tune, olfactory nerve activity associated with repeatedly encountered concentrations of chemical stimuli [32].
The performance of D2R-/- mice during reversal learning is deficient revealing a role for dopamine D2R-mediated signaling in tasks requiring behavioral flexibility
Perseverative behavioral patterns characterized the D2R-/- mice relative to D2R+/+ mice during reversal learning sessions (Figure 4), manifested during early reversal trials (Figure 6) and persisted across several sessions (Figure 7). These findings are significant because D2R-/- mice respond to food reinforcers and ultimately form and maintain odor-driven S+/S- relationships (a putative D1R-mediated behavior [6]) just as D2R+/+ mice (both groups achieved ≥ 80% discrimination accuracy, the dopamine D1Rs in our mice were not targeted). A future extension of this study would be to test performance over a fixed number of trials and determine patterns of error rates during acquisition of the discrimination and reversal learning tasks. This manipulation would control the number of errors based on trials performed to determine if the apparent difference in absolute number of errors demonstrated by the mutant mice (the putative performance deficit) is simply a reflection of extra trials. Nonetheless, the inability of D2R-/- mice to disengage from previously established S+/S- contingencies (responding to a discriminative stimulus; Fig. 4) strongly argues that mesolimbic dopamine, and in particular dopamine D2R-mediated signaling, modulates the process of alerting the subject that familiar contingencies are now associated unexpected consequences.
Schultz and colleagues have demonstrated that dopamine cells display consistent tonic firing patterns during maintenance of associative learning tasks [33]. However, phasic burst activity of dopaminergic cells occurs when discrepancies between predicted and actual reinforcement contingencies transpire [14]. This robust increase of dopaminergic cell activation in response to unpredicted outcomes has been referred to as an "error" signal [14]. To date, the molecular basis of this error signal has not been identified. The inability of the D2R-/- mice to desist responding to a previously reinforced stimulus suggests that the dopamine D2R might in fact be the focal point of this error-signaling cascade.
Electrophysiological data further support the hypothesis that signaling mediated by dopamine D2Rs tunes D1R-mediated mesocorticolimbic output. Calabresi et al. [34] demonstrated that tetanic stimulation of dorsal striatum slices prepared from D2R-/- mice is associated with enhanced EPSP and as a result increased striatal synaptic efficacy. In contrast, stimulation of dorsal striatum slices from wild-type mice resulted in IPSP activity, long-term depression, and decreased neuronal activity of striatal efferents [34]. Carlsson and colleagues [35] have speculated that dopamine D2R stimulation in the striatum serves to "brake" or diminish excitatory corticostriatal signaling and plasticity. Indeed, perseverative behavior is associated with over activity of the dorsal striatum in rodents [36] and over activity of the caudate in patients with ADHD [37] and a strong inverse correlation of D2R binding with compulsive behavior has been reported [22]. Importantly, our data indicate that the poor performances displayed by the D2R-/- mice are manifestations of reversal learning deficits and not gross motivational or sensory impairments. We therefore argue that D2Rs participate in signaling or alerting the organism of learning contingency changes during reversal learning and sculpt ongoing goal-directed behavior.
Conclusions
This study demonstrates that signaling by dopamine D2Rs does not mediate the hedonic value of reinforcers, supporting and refining earlier findings [1,2]. However, mice completely deficient in D2Rs demonstrated disrupted acquisition of discriminative stimulus relationships and an impaired ability to recognize changes in behavioral determinants. Therefore, we suggest that during associative learning or when unexpected reinforcement outcomes are modified (reversal learning) dopamine-driven reinforcement impulses involve signaling mediated by dopamine D2Rs. In the course of associative learning, striatal synapses [38] receive experience-driven gain [7], thus permitting newly established reinforcement-mediated signals to traverse ascending efferents en route to the frontal cortex, completing a functional limbic/motor circuit [39-41]. Possibly, the lack of dopamine D2R-mediated signaling prevents refinement of the corticostriatal reinforcement circuits in the brains of the D2R-/- mice, thus impairing their ability to form S+/S- contingencies and disengage inappropriate dopamine D1R-mediated associative responding when unexpected consequences to goal-directed behaviors happened. Consequently, we are compelled to conclude that the perseverative performance deficits demonstrated by the D2R-/- mice in the tasks used in the present study reveal a previously unreported role for D2Rs in associative and reversal learning.
Methods
Subjects
The sixteen, 8–10 week old, 25–30 g mice (8 per genotype) used in this study were the congenic offspring of breeders that were descendants of the original F2 hybrid (129/Sv × C57BL/6J; Kelly et al., 1997) that was backcrossed to inbred C57Bl/6J stock (Jackson Laboratories, ME). This breeding strategy was repeated for 20 successive generations with the gender of the donor/mutant alternating with each generation. All experimental subjects were genotyped by PCR as previously described [23]. All testing occured randomly across estrous cycles. The Department of Comparative Medicine at Oregon Health and Science University approved all protocols, and all animals were maintained in accordance to National Institutes of Health's Guide for the Care and Use of Laboratory Animals.
Experimental procedures
Odor discrimination training and testing
A 2-odor discrimination paradigm was chosen because it permits a measure of attentional focus in goal-directed behavior. Odor discrimination was chosen as the particular task because it is a highly robust behavior in rodents [18]. To minimize experimental error, the experimenter was blind to genotype during testing. Mice were mildly food deprived to approximately 85% ad libitum weight. Dopamine D2R-/- and D2R+/+ mice (n = 8 per group) were initially trained to ambulate the length of a polyvinyl mouse cage (30-cm) to retrieve ~30-mg of Pico® fat supplemented rodent food located in a small plastic cup (3-cm) attached to the floor of the testing apparatus with Velcro. Each subject received five trials, and the latency to locate and start to consume the food pellet was recorded manually with a standard hand-held stopwatch. Twenty-four hours later subjects were trained to ambulate towards and dig through the same 3-cm dish filled with sterile sand to locate a food pellet buried underneath the sand. Subjects received 10 trials. If a mouse failed to locate a food pellet within 10-min of the first trial, an additional food pellet was dropped on top of the dish. This manipulation usually ensured that a subject would dig through the sand to locate the original pellet and learn this task.
The next day, mice were presented to the testing apparatus that now contained 2 dishes, each filled with different scented sand. One odor signaled that a food reinforcer was buried in that particular dish (S+) while the other odor signaled that no reinforcer was contained within that particular dish (S-). The sand was scented by adding 0.80 grams of either cinnamon or dill weed to 98.8 grams of autoclaved playground sand purchased from a local farm and garden store. Finally, 0.40 grams of finely ground food was mixed with the scented sand in order to mask any odor emitted by the food reinforcer in the S+ dish. This final mixture did not appear to be palatable to the subjects. A trial terminated when the mouse: dug in the correct dish and consumed the hidden pellet, or began to dig in the incorrect dish. Digging was considered the actual physical displacement of sand with the forepaws and/or snout. Placing forelimbs on either of the dishes and sniffing was not considered digging and was not penalized or scored. Each completed trial was separated by a 20-sec inter-trial-interval (ITI). Preliminary experiments demonstrated that an extended time-out period following an incorrect response was not required to ensure goal-directed behavior in the wild-type or mutant mice for this particular task (data not shown). Therefore, the 20-sec ITI was used to separate all trials (successful and unsuccessful). The S+ and S- scents were counterbalanced across subjects in order to control for potential scent bias (pilot data suggest there are no biases, data not shown). Following accurate discrimination, defined as 8 correct retrievals across 10 consecutive trials, reversal trials began.
Reversal learning measurement
We next investigated the contribution of dopamine D2Rs to reversal learning behavior by inverting the reinforcement contingencies – now the former S+ signaled no reinforcer and the previous S- now indicated reinforcement availability. This manipulation permits an evaluation of the ability to inhibit responses to previously reinforced discriminative stimuli [18]. The number of trials necessary to establish 8 out of 10 accurate responses was our definition of successful reversal learning.
Data analysis
The latency to retrieve a pellet from an empty dish, the latency to dig through a dish filled with unscented sand, and the number of errors of commission committed across the reversal sessions were analyzed with 2-way analyses of variance (genotype × trials). The number of trials necessary to attain criterion performance in odor discrimination (8 correct responses across 10 consecutive trials) and errors committed while learning the discrimination tasks were separated as individual testing phases (e.g. odor discrimination and reversal learning) and analyzed separately with unpaired 2-tailed t-tests. Significance was established at p < 0.05. Errors committed during reversal trials were further categorically separated as errors of commission (failing to withhold responding to S-) and errors of omission (failing to dig in either dish after 3-min had expired). Categorical errors and number of commission errors committed during the first reversal learning session were analyzed between groups with nonparametric Mann-Whitney U tests.
Authors' contributions
PJK designed and ran all of the experiments, analyzed the data, and co-wrote the manuscript. DKG oversaw and facilitated the experiments and co-wrote the manuscript.
Acknowledgments
Acknowledgements
This study was supported by grants DA07262 (PJK), DA12062 (DKG), and MH067497 (DKG). We thank Katherine M. Suchland for her excellent technical assistance.
Contributor Information
Paul J Kruzich, Email: kruzichp@ohsu.edu.
David K Grandy, Email: grandyd@ohsu.edu.
References
- Berridge KC, Robinson TE. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev. 1998;28:309–369. doi: 10.1016/S0165-0173(98)00019-8. [DOI] [PubMed] [Google Scholar]
- Salamone JD, Correa M. Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav Brain Res. 2002;137:3–25. doi: 10.1016/S0166-4328(02)00282-6. [DOI] [PubMed] [Google Scholar]
- Pecina S, Berridge KC, Parker LA. Pimozide does not shift palatability: separation of anhedonia from sensorimotor suppression by taste reactivity. Pharmacol Biochem Behav. 1997;58:801–811. doi: 10.1016/S0091-3057(97)00044-0. [DOI] [PubMed] [Google Scholar]
- Nowend KL, Arizzi M, Carlson BB, Salamone JD. D1 or D2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption. Pharmacol Biochem Behav. 2001;69:373–382. doi: 10.1016/S0091-3057(01)00524-X. [DOI] [PubMed] [Google Scholar]
- Salamone JD, Arizzi MN, Sandoval MD, Cervone KM, Aberman JE. Dopamine antagonists alter response allocation but do not suppress appetite for food in rats: contrast between the effects of SKF 8 raclopride, and fenfluramine on a concurrent choice task. Psychopharmacology (Berl) 2002;160:371–380. doi: 10.1007/s00213-001-0994-x. [DOI] [PubMed] [Google Scholar]
- Eyny YS, Horvitz JC. Opposing roles of D1 and D2 receptors in appetitive conditioning. J Neurosci. 2003;23:1584–1587. doi: 10.1523/JNEUROSCI.23-05-01584.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith-Roe SL, Kelley AE. Coincident activation of NMDA and dopamine D1 receptors within the nucleus accumbens core is required for appetitive instrumental learning. J Neurosci. 2000;20:7737–7742. doi: 10.1523/JNEUROSCI.20-20-07737.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baldo BA, Sadeghian K, Basso AM, Kelley AE. Effects of selective dopamine D1 or D2 receptor blockade within nucleus accumbens subregions on ingestive behavior and associated motor activity. Behav Brain Res. 2002;137:165–177. doi: 10.1016/S0166-4328(02)00293-0. [DOI] [PubMed] [Google Scholar]
- See RE, Kruzich PJ, Grimm JW. Dopamine, but not glutamate, receptor blockade in the basolateral amygdala attenuates conditioned reward in a rat model of relapse to cocaine-seeking behavior. Psychopharmacology (Berl) 2001;154:301–310. doi: 10.1007/s002130000636. [DOI] [PubMed] [Google Scholar]
- Dalley JW, Chudasama Y, Theobald DE, Pettifer CL, Fletcher CM, Robbins TW. Nucleus accumbens dopamine and discriminated approach learning: interactive effects of 6-hydroxydopamine lesions and systemic apomorphine administration. Psychopharmacology (Berl) 2002;161:425–433. doi: 10.1007/s00213-002-1078-2. [DOI] [PubMed] [Google Scholar]
- Salamone JD, Wisniecki A, Carlson BB, Correa M. Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience. 2001;105:863–870. doi: 10.1016/S0306-4522(01)00249-4. [DOI] [PubMed] [Google Scholar]
- Civelli O, Bunzow JR, Grandy DK. Molecular diversity of the dopamine receptors. Annu Rev Pharmacol Toxicol. 1993;33:281–307. doi: 10.1146/annurev.pa.33.040193.001433. [DOI] [PubMed] [Google Scholar]
- Neve KA, Neve RL. The Dopamine Receptors. Totowa, NJ: Humana Press; 1997. [Google Scholar]
- Schultz W. Multiple reward signals in the brain. Nat Rev Neurosci. 2000;1:199–207. doi: 10.1038/35044563. [DOI] [PubMed] [Google Scholar]
- Terry AV, Jr, Hill WD, Parikh V, Evans DR, Waller JL, Mahadik SP. Differential effects of chronic haloperidol and olanzapine exposure on brain cholinergic markers and spatial learning in rats. Psychopharmacology (Berl) 2002;164:360–368. doi: 10.1007/s00213-002-1230-z. [DOI] [PubMed] [Google Scholar]
- Terry AV, Jr, Hill WD, Parikh V, Waller JL, Evans DR, Mahadik SP. Differential effects of haloperidol, risperidone, and clozapine exposure on cholinergic markers and spatial learning performance in rats. Neuropsychopharmacology. 2003;28:300–309. doi: 10.1038/sj.npp.1300039. [DOI] [PubMed] [Google Scholar]
- Rondi-Reig L, Libbey M, Eichenbaum H, Tonegawa CA1-specific N-methyl-D-aspartate receptor knockout mice are deficient in solving a nonspatial transverse patterning task. Proc Natl Acad Si. 2001;98:3543–3548. doi: 10.1073/pnas.041620798. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Slotnick BM. Animal cognition and the rat olfactory system. Trends Cogn Sci. 2001;5:216–222. doi: 10.1016/S1364-6613(00)01625-9. [DOI] [PubMed] [Google Scholar]
- Ferry AT, Lu XC, Price JL. Effects of excitotoxic lesions in the ventral striatopallidal – thalamocortical pathway on odor reversal learning: inability to extinguish an incorrect response. Exp Brain Res. 2000;131:320–335. doi: 10.1007/s002219900240. [DOI] [PubMed] [Google Scholar]
- Gasbarri A, Sulli A, Pacitti C, Puglisi-Allegra S, Cabib S, Castellano C, Introini-Collison I, McGaugh JL. Strain-dependent effects of D2 dopaminergic and muscarinic-cholinergic agonists and antagonists on memory consolidation processes in mice. Behav Brain Res. 1997;86:97–104. doi: 10.1016/S0166-4328(96)02250-4. [DOI] [PubMed] [Google Scholar]
- Mehta MA, Sahakian BJ, McKenna PJ, Robbins TW. Systemic sulpiride in young adult volunteers simulates the profile of cognitive deficits in Parkinson's disease. Psychopharmacology (Berl) 1999;146:162–174. doi: 10.1007/s002130051102. [DOI] [PubMed] [Google Scholar]
- Volkow ND, Wang GJ, Fowler JS, Logan J, Gatley SJ, Gifford A, Hitzemann R, Ding YS, Pappas N. Prediction of reinforcing responses to psychostimulants in humans by brain dopamine D2 receptor levels. Am J Psychiatry. 1999;156:1440–1443. doi: 10.1176/ajp.156.9.1440. [DOI] [PubMed] [Google Scholar]
- Kelly MA, Rubinstein M, Asa SL, Zhang G, Saez C, Bunzow JR, Allen RG, Hnasko R, Ben-Jonathan N, Grandy DK, Low MJ. Pituitary lactotroph hyperplasia and chronic hyperprolactinemia in dopamine D2 receptor-deficient mice. Neuron. 1997;19:103–113. doi: 10.1016/S0896-6273(00)80351-7. [DOI] [PubMed] [Google Scholar]
- Beninger RJ, Miller R. Dopamine D1-like receptors and reward-related incentive learning. Neurosci Biobehav Rev. 1998;22:335–345. doi: 10.1016/S0149-7634(97)00019-5. [DOI] [PubMed] [Google Scholar]
- Hillegaart V, Ahlenius S. Effects of raclopride on exploratory locomotor activity, treadmill locomotion, conditioned avoidance behaviour and catalepsy in rats: behavioural profile comparisons between raclopride, haloperidol and preclamol. Pharmacol Toxicol. 1987;60:350–354. doi: 10.1111/j.1600-0773.1987.tb01525.x. [DOI] [PubMed] [Google Scholar]
- Campbell A, Baldessarini Tolerance to behavioral effects of haloperidol. Life Sci. 1981;29:1341–1346. doi: 10.1016/0024-3205(81)90677-9. [DOI] [PubMed] [Google Scholar]
- Ezrin-Waters C, Seeman P. Tolerance of haloperidol catalepsy. Eur J Pharmacol. 1977;41:321–327. doi: 10.1016/0014-2999(77)90325-9. [DOI] [PubMed] [Google Scholar]
- Puri SK, Lal H. Tolerance to the behavioral and neurochemical effects of haloperidol and morphine in rats chronically treated with morphine or haloperidol. Naunyn Schmiedebergs Arch Pharmacol. 1974;282:155–170. doi: 10.1007/BF00499030. [DOI] [PubMed] [Google Scholar]
- Kapur S, Seeman P. Does fast dissociation from the dopamine d(2) receptor explain the action of atypical antipsychotics?: A new hypothesis. Am J Psychiatry. 2001;158:360–369. doi: 10.1176/appi.ajp.158.3.360. [DOI] [PubMed] [Google Scholar]
- Ennis M, Zhou FM, Ciombor KJ, Aroniadou-Anderjaska V, Hayar A, Borrelli E, Zimmer LA, Margolis F, Shipley MT. Dopamine D2 receptor-mediated presynaptic inhibition of olfactory nerve terminals. J Neurophysiol. 2001;86:2986–2997. doi: 10.1152/jn.2001.86.6.2986. [DOI] [PubMed] [Google Scholar]
- Wilson DA, Wood JG. Functional consequences of unilateral olfactory deprivation: time-course and age sensitivity. Neuroscience. 1992;49:183–192. doi: 10.1016/0306-4522(92)90086-H. [DOI] [PubMed] [Google Scholar]
- Hsia AY, Vincent JD, Lledo PM. Dopamine depresses synaptic inputs into the olfactory bulb. J Neurophysiol. 1999;82:1082–1085. doi: 10.1152/jn.1999.82.2.1082. [DOI] [PubMed] [Google Scholar]
- Fiorillo CD, Tobler PN, Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science. 2003;299:1898–1902. doi: 10.1126/science.1077349. [DOI] [PubMed] [Google Scholar]
- Calabresi P, Saiardi A, Pisani A, Baik JH, Centonze D, Mercuri NB, Bernardi G, Borrelli EP. Abnormal synaptic plasticity in the striatum of mice lacking dopamine D2 receptors. J Neurosci. 1997;17:4536–4544. doi: 10.1523/JNEUROSCI.17-12-04536.1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carlsson A, Waters N, Holm-Waters S, Tedroff J, Nilsson M, Carlsson ML. Interactions between monoamines, glutamate, and GABA in schizophrenia: new evidence. Annu Rev Pharmacol Toxicol. 2001;41:237–260. doi: 10.1146/annurev.pharmtox.41.1.237. [DOI] [PubMed] [Google Scholar]
- Graybiel AM, Rauch SL. Toward a neurobiology of obsessive-compulsive disorder. Neuron. 2000;28:343–347. doi: 10.1016/S0896-6273(00)00113-6. [DOI] [PubMed] [Google Scholar]
- Teicher MH, Anderson CM, Polcari A, Glod CA, Maas LC, Renshaw PF. Functional deficits in basal ganglia of children with attention-deficit/hyperactivity disorder shown with functional magnetic resonance imaging relaxometry. Nat Med. 2000;6:470–473. doi: 10.1038/74737. [DOI] [PubMed] [Google Scholar]
- Wang H, Pickel VM. Dopamine D2 receptors are present in prefrontal cortical afferents and their targets in patches of the rat caudate-putamen nucleus. J Comp Neurol. 2002;442:392–404. doi: 10.1002/cne.10086. [DOI] [PubMed] [Google Scholar]
- Robbins TW. Chemical neuromodulation of frontal-executive functions in humans and other animals. Exp Brain Res. 2000;133:130–138. doi: 10.1007/s002210000407. [DOI] [PubMed] [Google Scholar]
- Mogenson GJ, Jones DL, Yim CY. From motivation to action: functional interface between the limbic system and the motor system. Prog Neurobi l. 1980;14:69–97. doi: 10.1016/0301-0082(80)90018-0. [DOI] [PubMed] [Google Scholar]
- Ongur D, Price JL. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb Cortex. 2000;10:206–219. doi: 10.1093/cercor/10.3.206. [DOI] [PubMed] [Google Scholar]