Skip to main content
The Journal of Neuroscience logoLink to The Journal of Neuroscience
. 2009 Sep 9;29(36):11215–11225. doi: 10.1523/JNEUROSCI.6096-08.2009

Orexin A/Hypocretin-1 Selectively Promotes Motivation for Positive Reinforcers

Stephanie L Borgland 1,5,, Shao-Ju Chang 1, M Scott Bowers 1, Jennifer L Thompson 5, Nicole Vittoz 3, Stan B Floresco 4, Jonathan Chou 1, Billy T Chen 1, Antonello Bonci 1,2
PMCID: PMC2771749  NIHMSID: NIHMS148305  PMID: 19741128

Abstract

Orexin A/hypocretin-1 (oxA/hcrt-1) is known to be a modulator of dopamine-dependent neuronal activity and behaviors. However, the role of this system in driving motivated behaviors remains poorly understood. Here, we show that orexin/hypocretin receptor-1 (ox/hcrt-1R) signaling is important for motivation for highly salient, positive reinforcement. Blockade of ox/hcrt-1R selectively reduced work to self-administer cocaine or high fat food pellets. Moreover, oxA/hcrt-1 strengthened presynaptic glutamatergic inputs to the ventral tegmental area (VTA) only in cocaine or high fat self-administering rats. Finally, oxA/hcrt-1-mediated excitatory synaptic transmission onto VTA neurons was not potentiated following an arousing, aversive stimulus, suggesting that oxA/hcrt-1-mediated glutamatergic synaptic transmission was potentiated selectively with highly salient positive reinforcers. These experiments provide evidence for a selective role of oxA/hcrt-1 signaling in motivation for highly salient reinforcers and may represent a unique opportunity to design novel therapies that selectively reduce excessive drive to consume positive reinforcers of high salience.

Introduction

The ventral tegmental area (VTA) is an important brain structure for relaying salient information (Berridge, 2007), and neural plasticity of dopamine neurons in this region plays an important role in early behavioral responses following initial drug exposures (Ungless et al., 2001; Borgland et al., 2004). It has been hypothesized that strengthened excitatory synapses onto dopamine neurons leads to burst-like firing, and consequently, enhanced dopamine release in VTA target regions involved in the attachment of salience to events associated with exposure to commonly addictive drugs (Jones and Bonci, 2005).

The orexins, also known as hypocretins, are neuropeptides produced in the lateral hypothalamic area that contribute to homeostatic processes such as arousal and feeding (de Lecea et al., 1998; Sakurai et al., 1998). They are comprised of two distinct peptides; orexin A/hypocretin-1 (oxA/hcrt-1) and orexin B/hypocretin-2. Orexin/hypocretin neurons project locally within the hypothalamus and widely throughout the brain, including a substantial projection to catecholaminergic regions such as the VTA and locus ceruleus (Peyron et al., 1998). Although orexin/hypocretin neurons form only 5% of synapses in the VTA, the presence of intra-VTA orexin-containing dense core vesicles (Balcita-Pedicino and Sesack, 2007) indicates that these peptides are likely released extrasynaptically into the VTA to mediate its functional effects, including increasing firing rate (Korotkova et al., 2003; Muschamps et al., 2007), strengthening glutamatergic synapses (Borgland et al., 2006) and enhancing dopamine release in VTA target regions (Narita et al., 2006; Vittoz and Berridge, 2006; Vittoz et al., 2008).

Activation of orexin/hypocretin neurons contributes to homeostatic processes such as arousal and feeding (de Lecea et al., 1998; Sakurai et al., 1998). Selective activation of orexin/hypocretin neurons in mice using optogenetic technology promoted the transition from sleep to wakefulness (Adamantidis et al., 2007). Furthermore, orexin/hypocretin neuronal firing, identified by antidromic stimulation from the VTA, is linked to movement and EEG arousal during states that have strong emotional components, such as exploratory behavior and approaching food, suggesting a potential role for these neurons in arousal for goal-directed behaviors (Mileykovskiy et al., 2005). Accordingly, intracerebroventricular (i.c.v.) injections of oxA/hcrt-1 increases home cage food intake (Sakurai et al., 1998), and activation of orexin/hypocretin-1 receptors (ox/hcrt-1R) has been shown to play a role in palatable, high-fat food intake, as the ox/hcrt-1R antagonist, SB334867 reduced home cage feeding (Clegg et al., 2002; Zheng et al., 2007) and operant self-administration of high-fat-containing food (Nair et al., 2008).

Recent evidence links the orexin system with reward and reinforcement (Aston-Jones et al., 2009). For example, orexin/hypocretin neurons are activated when rats prefer contexts associated with addictive drugs or food (Harris et al., 2005). Further, reinstatement to cocaine (Harris et al., 2005; Boutrel et al., 2006; Smith et al., 2009) or ethanol (Lawrence et al., 2006), and the development of behavioral sensitization to cocaine (Borgland et al., 2006), is blocked by the ox/hcrt-1R antagonist, SB334867. We previously reported that oxA/hcrt-1 enhanced excitatory synaptic transmission in the VTA and also enabled plasticity associated with cocaine (Borgland et al., 2006), suggesting an underlying mechanism for the proposed reinforcing effects of oxA/hcrt-1. Because orexin/hypocretins are known to mediate both arousal and reward, we wanted to determine whether these peptides can drive motivated behavior. We hypothesized that by blocking ox/hcrt-1R signaling, we could reduce the effort rats are willing to exert for drug and palatable food reinforcers.

Materials and Methods

Individually housed male Sprague Dawley rats (350–400 g; Charles River Laboratories and the University of British Columbia) were used in all experiments. Animals were maintained on a 12 h light/dark cycle (lights on 7 A.M.–7 P.M.) with food and water available ad libitum unless stated below. Both behavioral experiments and decapitations for slice electrophysiology occurred at ZT = 8 ± 1 h (3 P.M.). All animal procedures were approved by the Institutional Animal Care and Use Committee of the Ernest Gallo Clinic and Research Center and the Animal Care Centre at the University of British Columbia.

Surgery.

Animals were implanted with a chronically indwelling intravenous catheter and trained to self-administer cocaine, as previously described (Carelli et al., 2000). The catheter was flushed daily with heparinized saline (0.4 ml of 10 IU) to maintain patency. Some food-restricted “sham” (FR) rats were fitted with intrajugular catheters. We found no difference in electrophysiological recordings of oxA/hcrt-1-induced potentiation of NMDA receptor (NMDAR) currents between rats that had surgery and rats that did not have surgery, therefore we included rats from both groups together.

Cocaine self-administration.

One week after surgery, animals were food-deprived for 24 h before 1 or 2 overnight shaping sessions. Rats were food restricted to 20 g of Purina rat chow per day delivered in the home cage for the duration of the experiment. Shaping for lever pressing occurred during overnight (15 h) and fixed ratio 1 (FR1) sessions in standard operant chambers with two retractable levers, each beneath a cue light and flanking a food hopper (Coulbourn Instruments). Animals were randomly assigned an active lever for the duration of experimentation. During shaping, each active lever press resulted in the delivery of a single 45 mg Noyes food pellet (Research Diets), in addition to a 4 s cue light illumination over the active lever. Each pellet delivery was followed by an 18 s timeout where additional lever presses were recorded, but did not result in food reinforcement or presentation of the cue light. The day following 1 or 2 15 h overnight sessions, animals were placed in a 2 h session where food was delivered on an FR1 schedule, and every eighth press resulted in a 0.50 mg/kg cocaine infusion over 2 s, which was paired with both 4 s cue light illumination and a tone. Each infusion was followed by an 18 s timeout. The animals were limited to earning 200 reinforcers during all sessions. The session with both food and cocaine as reinforcers facilitated the transition to cocaine-only self-administration. After this food-cocaine training session, animals received 14–17 additional days of training. Each day, animals were allowed to self-administer cocaine on an FR1, then FR3, and finally an FR5 schedule, with each infusion paired with a 4 s cue light and a tone followed by an 18 s timeout period. Once rats achieved adequate lever pressing on an FR5 schedule (rats received a minimum of 9 infusions on each FR5 training session), rats were tested daily under a progressive ratio (PR) schedule of reinforcement for 4 d. Under this schedule, the number of responses required to obtain each successive infusion of cocaine was determined by the equation (Richardson and Roberts, 1996): Response ratio = [5e(injection number × 0.2)] − 5, to produce the following sequence of required lever presses: 1, 2, 4, 6, 9, 12, 15, 25, 32, 40, 50, 62, etc. The daily PR sessions were terminated when 1 h elapsed without a drug infusion and, as a result, generally lasted 3 h or less. The maximal number of presses emitted to attain the final ratio was defined as the breakpoint (Richardson and Roberts, 1996). There was no effect of time on lever pressing, reinforcers received, or breakpoint over the 4 days of PR (supplemental Fig. 1, available at www.jneurosci.org as supplemental material). During all sessions, depression of the inactive lever generated no programmed consequence, but responses were recorded.

Regular food and high fat chocolate pellet self-administration.

The training protocol for food self-administration was similar to that described above for cocaine self-administration, with 2 overnight shaping sessions (15 h, FR1) where pressing on the active lever delivered one 45 mg pellet as well as cue light illumination and a tone. Each reinforcer was followed by an 18 s timeout. Animals were mildly food restricted, as above, for the entire set of operant sessions. Because rats appeared to respond more frequently for food, the PR schedule was calculated by the following equation (Richardson and Roberts, 1996): Response ratio = [5e(injection number × 0.24)] − 5, to produce the following sequence of required lever presses: 1, 3, 5, 8, 12, 16, 22, 29, 38, 50, 65, 84, etc. Separate groups of rats were trained to lever press for either standard food, or high fat chocolate pellets (45 mg pellet containing 35% fat and 37% carbohydrate with chocolate flavor and scent, Bioserv). These experiments were conducted in a manner similar to that described above.

On the second and third days of PR testing, rats that were trained to lever press for either cocaine, regular food (RF) pellets, or high fat chocolate (HF) pellets received vehicle injections (i.p) and on the subsequent day received an injection of the ox/hcrt-1R antagonist, SB334867 (10 or 20 mg/kg). In some experiments, cocaine (15 mg/kg), the dopamine uptake blocker GBR12909 (5 mg/kg), or saline was given on the second, third and fourth days of PR testing.

Effort-based task.

Rats were trained and tested in a 4-arm black acrylic cross-maze (dimensions: 60 cm long, 10 cm wide, 10 cm deep) with rectangular food wells (4 cm wide × 1 cm deep) placed 2 cm from the end wall of each arm. A removable piece of black acrylic blocked one of the arms of the maze to for a “T” configuration throughout the duration of the experiment, including training. Rats were released from the stem arm located in the same spatial location in the testing room. One or both choice arms of the maze could be blocked with barriers over which the animals had to climb to obtain rewards. These barriers were constructed in the shape of a wedge, using galvanized wire mesh with white plastic sides 30 cm in length. To obtain access to the food in one arm, rats had to scale up the vertical side and descend down a slope of varying incline depending on the size of the barrier. Habituation and training were identical to procedures described by Floresco and Ghods-Sharifi (2007) and outlined in the time line in Figure 4A. Briefly, in the first phase of discrimination training, 3 pellets of high fat chocolate food were put in the feeding well of the goal arm (the HF arm) and 3 regular food pellets were put in the other goal arm (the RF arm). For half of the rats, the HF arm was the left arm and for the others, it was the right. Each rat was placed in the stem arm and was allowed to sample from either the HF or RF arm. For the first 3 d, each rat could sample from both arms for 5 trials. On the next 3 d, rats were moved to the second phase of discrimination training in which access to one of the goal arms was prevented by blocking the arms with a plastic block at its entrance, forcing the rat to sample a particular arm on each trial. The order of these forced trials was determined pseudorandomly so that they never had more than two consecutive turns in either direction for a total of 10 trials per day. In the following discrimination training, rats had free choice to either the HF or the RF arm for 16 trials. Rats were removed from the maze after eating the food in the selected arm without being able to sample the other arm. On trials 6 and 12, the plastic block was placed in the arm chosen by the rat on the previous trial to prevent potential turn biases from interfering with discrimination training. For discrimination and subsequent barrier training, rats were trained to reach a criterion performance of eating from the HF arm on ≥75% of trials in a daily session. When a rat achieved criterion performance for 2 consecutive days, it was taken to the next phase of the task where the wire mesh barriers were introduced.

Figure 4.

Figure 4.

High fat chocolate food and cocaine self-administration selectively potentiates oxA/hcrt-1-mediated NMDAR plasticity in VTA neurons. eEPSCs were recorded while neurons were voltage-clamped at +40 mV before and after a 5-min bath application of oxA/hcrt-1 (100 nm). A, OxA/hcrt-1 potentiated NMDAR eEPSCs in age-matched non-food-restricted naive rats (n = 7; open circles). Food restriction did not alter oxA/hcrt-1-mediated potentiation of NMDAR eEPSCs in FR rats (n = 7; open squares). OxA/hcrt-1 (100 nm, 5 min) potentiated NMDAR eEPSCs in regular food self-administering animals (n = 7; green squares). Potentiation of NMDAR eEPSCs by oxA/hcrt-1 was significantly enhanced after rats self-administered cocaine (n = 9; blue circles) or high fat chocolate food (n = 8; red triangles). B, Example traces of NMDAR eEPSCs before (black trace) and 15 min after oxA/hcrt-1 in naive (gray), FR (gray), food (green), cocaine (blue), or high fat chocolate food (red) self-administering rats. Stimulus artifact has been removed for clarity. Calibration: 50 ms, 50 pA. C, Maximal oxA/hcrt-1-mediated potentiation of NMDAR eEPSCs is significantly greater in cocaine and high fat chocolate food self-administering rats compared with naive, FR and regular food self-administering rats (p < 0.05). Each bar represents the mean and SEM of EPSCs over a period of 2 min, 15 min after a 5 min application of oxA/hcrt-1 (100 nm) as shown by the shaded bar in A. One-way ANOVA with a Bonferroni correction for multiple comparisons was used. D, The lateral hypothalamus was taken from horizontal midbrain slices used for electrophysiology 20–24 h after the final self-administration session. The tissue was “snap frozen” and processed later using a radio-immuno assay for determination of oxA/hcrt-1 protein concentrations from naive (n = 11, open bar), FR (n = 6; shaded bar), regular food (n = 9; green bar), cocaine (n = 9; blue bar) or high-fat chocolate food (n = 12; red bar) self-administering rats. There were no significant differences between each group (p > 0.05, one-way ANOVA). Each bar represents the mean and SEM.

For the first 2 d of barrier training rats received a total of 16 trials with the small (15 cm barrier) placed in the HF arm. On the first 8 trials, rats were forced to scale the barrier to receive 3 high fat pellets. On the subsequent 8 trials, rats were allowed to sample from both arms and were removed from the maze once rats made their first choice. On all subsequent trials, rats received a total of 18 trials per day, the first two of which were forced choice; for the subsequent 16 trials, rats were free to choose either the HF or RF arm. Rats were removed from the maze once they chose an arm. Each rat received daily training sessions until it achieved a criterion performance for 2 consecutive days. Fifteen minutes before the next session, rats were injected with vehicle solution (10% DMSO, 10% β-hydroxypropylcyclodextrin in distilled water, i.p.), and the following day rats were injected with SB334867 (10 mg/kg, i.p.) 15 min before the session.

After testing, the barrier size was increased to 30 cm, and training continued until the rat again achieved criterion performance for 2 consecutive days. The day after achieving criterion performance with the 30 cm barrier in the HF arm for 2 consecutive days, rats received a vehicle injection and were then tested on the 30 cm barrier 15 min later. The following day, rats received an injection of SB334867 (10 mg/kg) 15 min before being tested on the 30 cm barrier.

Pavlovian approach conditioning.

Twenty-two male Sprague Dawley rats were restricted to 85% body weight for 1 week before conditioning. At the same time each day, animals were given an injection of either SB-334867 (15 mg/kg, i.p.) or vehicle (10% DMSO and 2% β-cyclodextrin in water) 15 min before conditioning. Animals were then placed in operant chambers (Med Associates) for a conditioning session that lasted ∼30 min. The conditioning sessions were similar to that described by Stuber et al. (2008). Presentation of a 10 s conditioned stimulus (CS; a 5 kHz tone and illumination of two stimulus lights) occurred on a variable interval 30 s schedule. The termination of the CS was followed by delivery of two 45 mg food pellets (Bioserv) into a food cup located in an alcove between the two stimulus lights. The alcove contained an infrared photobeam that detected approaches toward the food cup. During each of seven conditioning sessions, rats received 30 presentations of the CS and food. Over these sessions, approaches toward the food cup during the intertrial interval delayed the onset of the CS by 3 s. The primary dependent measure of interest was the proportion of nosepokes directed toward the food cup during presentation of the CS relative to the number of total nosepokes made during the session (a measure of discriminative pavlovian approach).

Stress manipulations.

Similar to self-administration experiments, rats were restricted to 20 g of food per day for the duration of the experiment. Each day for 7 consecutive days, rats experienced unpredicted, intermittent footshocks in 30 min sessions delivered in operant chambers identical to those described above except that levers remained retracted throughout experimentation. A house light and exhaust fan operated during each session. Inescapable and unsignaled footshocks (0.8 mA, 0.1 s duration) were delivered on a variable interval 40 s schedule across a series of 8 floor poles at 40 Hz. Rats received a maximum of 35 shocks per session. After the session, rats were returned to the home cage and fed.

Stress hormone measurement.

Blood (∼600 μl) was collected from the left ventricle of pentobarbital-anesthetized rats just before aCSF perfusion and decapitation for midbrain slicing. Blood was immediately mixed with 60 μl of cold 48.3 mm EDTA. Samples were then centrifuged at 2000 RCF for 20 min at 4°C, serum decanted, and stored at −80°C until use. 125I labeled radioimmunoassays for ACTH (MP Biosciences) were performed according to manufacturer's instructions in duplicate or triplicate with the resulting supernatant decanted and pellet counted in a gamma counter (Beckmann Coulter) according to assay requirements. Nonspecific binding for ACTH was 7.9%. The percentage bound standard curve r2 was 0.97 using a logarithmic fit. Serum concentrations were determined from this curve.

OxA/Hcrt-1 peptide measurement.

Procedures for detection of oxA/hcrt-1 expression were performed in triplicate as described previously (Porkka-Heiskanen et al., 2004) and according to manufacturer instructions (Peninsula Laboratories). The region of lateral hypothalamus approximating that sampled for electrophysiological experiments was excised from a series of 250 μm horizontal slices in cold perfusion buffer using a scalpel for a total sample size of 2 × 2.5 mm per hemisphere. Samples were immediately stored at −80°C until whole cell lysates were obtained via homogenization on ice in cold 1% trifluoroacetic acid using 70 strokes of a glass/Teflon homogenizer. Samples were centrifuged at 12,000 × g for 20 min at 4°C, supernatant lyophilized, and resuspended in 0.5 ml of the provided buffer diluted with Millipore water. Samples (100 μl) were processed in triplicate and total protein content determined by the method of Lowry et al. (1951) from a 10 μl aliquot. Results are expressed as pg oxA/hcrt-1 per mg protein. The intra-assay coefficient of variation was 3.29%.

Electrophysiology.

All the electrophysiological recordings were performed in adult rats ranging from 350 to 400 g. Briefly, rats were deeply anesthetized with pentobarbital and perfused with ice-cold artificial CSF (aCSF) including (in mm): 225 sucrose, 119 NaCl, 2.5 KCl, 1.0 NaH2PO4, 4.9 MgCl2, 0.1 CaCl2, 26.2 NaHCO3, 1.25 glucose, 3 kynuretic acid. The brain was extracted and horizontal sections of the VTA (230 μm) were prepared with a Vibratome (Leica). Slices were placed in a holding chamber and allowed to recover for at least 1 h before being placed in the recording chamber and superfused with bicarbonate-buffered solution (aCSF) saturated with 95% O2/5% CO2 and containing (in mm): 119 NaCl, 1.6 KCl, 1.0 NaH2PO4, 1.3 MgCl2, 2.5 CaCl2, 26.2 NaHCO3 and 11 glucose (at 32−34°C). Picrotoxin (100 μm) was added to block GABAA receptor-mediated IPSCs. Cells were visualized using infrared differential interference contrast video microscopy. Whole-cell voltage clamp recordings were made using an Axopatch 1D amplifier (Molecular Devices). Electrodes (2.8–4.0 MΩ) contained (in mm): 120 cesium methanesulfonate, 20 HEPES, 0.4 EGTA, 2.8 NaCl, 5 TEA-Cl, 2.5 MgATP, and 0.25 NaGTP, pH 7.2–7.3 (270–285 mOsm). Series resistance (10–30 MΩ) and input resistance were monitored online with a 4 mV depolarizing step (50 ms) given just after every afferent stimulus. Dopaminergic VTA neurons were identified by the presence of a large Ih current (Lacey et al., 1990; Johnson and North, 1992). A bipolar stimulating electrode was placed 100–300 μm rostral to the recording electrode and was used to stimulate excitatory afferents at 0.1 Hz. Neurons were voltage-clamped at +40 mV to record NMDAR-mediated EPSCs. EPSCs were filtered at 2 kHz, digitized at 5–10 kHz and collected online using Igor Pro software (Wavemetrics). NMDAR traces were constructed by averaging 12 EPSCs (120 s) elicited at +40 mV. NMDAR EPSCs were evoked at +40 mV and measured 20 ms after the stimulus artifact, a time point whereby AMPAR currents have decayed. Miniature EPSCs (mEPSCs) were recorded in neurons voltage-clamped at –70 mV in the presence of tetrodotoxin (500 nm) to block action potential-driven spontaneous events. A within-cell design was used whereby mEPSCs were recorded before and 10 min after a 5 min application of oxA/hcrt-1 (100 nm). mEPSCs were selected based on their amplitude (>8 pA), decay time (<3 ms), and rise time (<1 ms) using the MiniAnalysis program (Synaptosoft).

Drugs.

SB334867 (10 mg/kg or 20 mg/kg) was dissolved in a vehicle solution containing 25% β-cyclodextrin, 5% DMSO and 0.9% saline, and administered in a volume of 3 ml/kg. GBR12909 and cocaine were dissolved in 0.9% saline, and administered in a volume of 3 ml/kg.

Data analysis.

All values are expressed as mean ± SEM. Statistical significance was assessed using a Repeated Measures ANOVA for multiple group comparisons of the same rats over 4 test days. A Bonferroni post hoc test following an ANOVA was used to test significant differences between groups. For electrophysiological experiments, a one-way ANOVA was used for multiple group comparisons with a Bonferroni post hoc test, unless otherwise indicated.

Results

Blockade of ox/hcrt-1R reduced the breakpoint for highly salient reinforcers

To establish whether the work required to obtain cocaine (0.5 mg/infusion), regular food (RF) pellets (fat: 5%; carbohydrate: 72%) or high fat chocolate-flavored (HF) food pellets (fat: 35%; carbohydrate: 37%) was altered by blockade of ox/hcrt-1R signaling, rats were tested under a progressive ratio (PR) schedule whereby the response requirement to earn a drug infusion or food pellet escalated after the delivery of each reinforcer. The maximal number of responses emitted to successfully complete the final ratio was defined as the breakpoint and is hypothesized to reflect the animal's motivational limit (Richardson and Roberts, 1996). SB334867 (10 mg/kg, i.p.) significantly reduced the breakpoint in cocaine self-administering rats (Fig. 1A) compared with their performance after vehicle injection. The final ratio achieved in the presence of SB334867 was 20 ± 5 compared with 37 ± 9 in vehicle treatment (p < 0.05, F(3,33) = 4.370, n = 12) (Fig. 1A). Significant divergence of cumulative presses for cocaine after SB334867 treatment compared with vehicle rats occurred when the response requirement for reinforcement increased (Fig. 1B; p < 0.05 at 160 min). In contrast, the breakpoint was not changed in rats lever pressing for RF after injection of SB334867 at either 10 mg/kg (n = 10) or 20 mg/kg,(n = 12) doses (F(3,44) = 0.25) (Fig. 1A,C). Cumulative presses for RF after SB334867 treatment (20 mg/kg) was not different from that observed after vehicle treatment (p > 0.05 at 160 min, n = 12, Fig. 1C). However, breakpoint for HF pellets was significantly reduced by SB334867 pretreatment at the lower dose (10 mg/kg) and was ineffective at reducing work exerted for RF (32 ± 9) compared with vehicle-treated rats (69 ± 11, p < 0.05; F = 11.52; n = 12) (Fig. 1A). Furthermore, when the work-effort requirement became greater, cumulative presses for HF pellets were significantly less after SB334867 relative to vehicle (p < 0.05 at 20 min) (Fig. 1D). Together, these results suggest that ox/hcrt-1R signaling may selectively modulate the amount of work that a rat is willing to produce to obtain cocaine or HF pellets, but not a less salient reward such as RF.

Figure 1.

Figure 1.

Ox/hcrt-1R signaling is involved in work for highly salient reinforcers. A, SB334867 (10 mg/kg) significantly reduced the breakpoint for cocaine (blue bars, n = 12, p < 0.05), high fat chocolate food pellets (red bars, n = 12, p < 0.05), but SB334867 [10 mg/kg (hatched green bars, n = 10) or 20 mg/kg (green bars, n = 12)] did not reduce the breakpoint for regular food self-administration (p > 0.05). B, Cumulative presses for cocaine were significantly reduced after SB334867 (10 mg/kg; blue line) compared with cumulative presses after a vehicle injection (black line) on the previous day (n = 12, p < 0.05 at 150 min). C, Cumulative presses for regular food were not significantly altered after animals were injected with SB334867 (20 mg/kg; green line) compared with vehicle (black line; n = 12; p > 0.05 at 175 min). D, Cumulative presses for high-fat chocolate food pellets were significantly reduced after SB334867 (10 mg/kg; red line) compared with cumulative presses after a vehicle injection (black line) on the previous day (n = 12, p < 0.05 at 20 min). Bars represent mean ± SEM. **p < 0.001.

To determine whether the reduction of work required to obtain HF pellets was due to the ox/hcrt-1R antagonist mediating satiety, we measured the amount of freely obtained RF or HF pellets consumed after 15 min. There was no significant difference in the amount of RF (n = 8) or HF (n = 9) pellets eaten after either vehicle (RF: 5.9 ± 1.9, HF: 6.8 ± 0.8) or SB334867 (RF: 5.8 ± 1.7, HF: 6.6 ± 0.9,10 mg/kg, i.p.) injection (p > 0.05). These data suggest that the dose of SB334867, which significantly reduced work exerted to obtain cocaine or HF, did not affect satiety in our paradigm.

Elevation of extracellular dopamine levels in the nucleus accumbens has been hypothesized to enhance the reinforcing properties of other paired stimuli. For example, after amphetamine administration, which increases dopamine levels, rats exhibit an enhanced motivation for RF under a PR schedule of reinforcement (Zhang et al., 2003). To assess how ox/hcrt-1R signaling may modulate the ability of increased dopamine transmission to amplify motivated responding, we gave systemic injections of cocaine (15 mg/kg, i.p.) or the selective dopamine transporter blocker, GBR 12909 (GBR; 5 mg/kg, i.p.) on days 2–4 of PR testing in a separate group of rats trained to lever press for RF pellets. Cocaine (Fig. 2A) or GBR (Fig. 2B) administration significantly increased the breakpoint compared with responding before treatment (F(3,38) = 5.08, p < 0.05). SB334867 (10 mg/kg) in the presence of cocaine or GBR blocked the increased breakpoint (Fig. 2A,B). The final ratio obtained in the presence of SB334867 and cocaine (78 ± 12, n = 12) or SB334867 and GBR (142 ± 22, n = 11) was significantly reduced compared with rats treated with either cocaine (165 ± 31, n = 12, p < 0.05) or GBR (332 ± 57, n = 11, p < 0.05) alone. Finally, there was no significant difference in breakpoint for RF when rats were given cocaine with SB334867 compared with no treatment or vehicle treatment (p > 0.05) (Fig. 2C). These results suggest that while ox/hcrt-1R signaling does not appear to modulate the motivation to work for RF, ox/hcrt-1R-mediated signaling is nonetheless involved in modulating the motivation to work for RF when the apparent motivational quality has been increased by substances known to elevate extracellular dopamine concentrations.

Figure 2.

Figure 2.

SB334867 blocks cocaine-potentiated food seeking. Rats learned to lever press for cocaine (0.5 mg/infusion), regular, or high fat chocolate food on a fixed ratio schedule. Each reinforced lever press on the active lever was associated with a tone and a light cue. Once stability criteria on Fixed Ratio 5 were met, rats were switched to a progressive ratio schedule of reinforcement for 4 consecutive days. Rats received i.p. injections of vehicle (Veh) and/or cocaine (Coc) (15 mg/kg) or GBR 12909 (GBR) (5 mg/kg) on days 2 and 3 and of the ox/hcrt-1R antagonist, SB334867 (SB) on day 4. A, Cocaine injections (15 mg/kg, i.p.) on days 2 and 3 significantly increased the breakpoint for regular food (#p < 0.05). SB334867 (10 mg/kg) injected 15 min before cocaine (15 mg/kg) significantly reduced the breakpoint for regular food (shaded bar) compared with that after vehicle injections (n = 11, **p < 0.01). B, GBR injections (5 mg/kg, i.p.) on days 2 and 3 significantly increased the breakpoint for regular food (#p < 0.05). SB334867 (10 mg/kg) injected 15 min before GBR (5 mg/kg) significantly reduced the breakpoint for regular food (black bar) compared with that after vehicle injections (n = 12, *p < 0.05). C, Rats received a vehicle injection (i.p.) on days 2 and 3 and an injection of SB334867 (10 mg/kg, i.p) with cocaine (15 mg/kg, i.p.) on day 4. In the presence of SB334867, a single cocaine exposure did not potentiate the breakpoint in regular food self-administering rats (p > 0.05). Bars represent mean and SEM of 11 rats. Repeated measures ANOVA was used.

Blockade of ox/hcrt-1R reduced effort-related choice of high fat chocolate food over regular food

To further explore the nature of how ox/hcrt-1R-mediated signaling modulates motivated behavior, we tested whether SB334867 modulated the rats' willingness to expend more effort to obtain HF over RF pellets (Fig. 3A–C). Rats were trained to criterion performance (≥75% high fat chocolate food arm entries for 2 consecutive days) on a “T-maze” with a mesh grid barrier at the entrance of the HF arm and free access to the regular food arm. The rats required 24 ± 4 training days to meet criterion performance on the 15 cm barrier and 29 ± 5 training days to meet criterion performance on the 30 cm barrier. Three of 12 animals did not meet criterion on the 15 cm barrier and were removed from the experiment. Of the remaining 9 animals, only 8 made it to criterion for the 30 cm barrier. Following injection of SB334867 (10 mg/kg, i.p), rats significantly reduced HF arm entries (71 ± 6%) compared with vehicle treated (92 ± 1%, p < 0.05) or naive (86 ± 3%, p < 0.01) rats trained on the 15 cm barrier (n = 9; F(2,26) = 11.1) (Fig. 3B). On the 30 cm barrier, SB334867 also significantly reduced HF arm entries (58 ± 2%) compared with vehicle treatment (92 ± 2%, p < 0.001) or no treatment (89 ± 2%, p < 0.001, n = 8; F(2,23) = 72.5) (Fig. 3C). Regardless of the baseline performance, each rat made substantially fewer entries into the barriered HF arm following injection of SB334867. Thus, under normal conditions, rats will work to obtain HF over RF. However, this preference is potently reduced by administration of an ox/hcrt-1R antagonist.

Figure 3.

Figure 3.

SB334867 reduces the effort, but not cue-learning for palatable reinforcers. In the effort based task, rats had free access to one arm on the T-maze baited with 3–45 mg of pellets of regular food or could climb a barrier to obtain equal pellets of high fat chocolate food. A, Timeline depicting the habituation, training and testing procedures used. B, C, Rats must climb (B) a 15 cm barrier (n = 8 rats) or (C) a 30 cm barrier (n = 9 rats) to obtain high fat food. Bars represent mean and SEM of the ratio of high fat chocolate food arm entries on the last day of untreated training (shaded bars), 15 min after a vehicle injection (open bars), or SB334867 (filled bars). Treatment of SB334867 significantly reduces the preference for the high fat chocolate food arm (*p < 0.05, **p < 0.001, repeated measures ANOVA). D, Schematic of the cue-conditioning paradigm. Delivery of a sucrose pellet was contingent on a tone/light conditioned stimulus (CS+) during a daily 30 min session. E, Conditioned-approach behavior, measured as the ratio of nosepokes during the CS+ to the nosepokes 30 s following CS+ presentation, was not different between rats having daily injections of vehicle (i.p., n = 11) or SB334867 (15 mg/kg, i.p., n = 11, p > 0.05).

Ox/hcrt-1R blockade does not modulate conditioned pavlovian approach

Ox/hcrt-1R signaling has been reported to underlie cue-associated reinstatement of ethanol (Lawrence et al., 2006) or cocaine-seeking (Smith et al., 2009). Perhaps ox/hcrt-1R signaling underlies the learning of cues that may be guiding the rats to obtain relevant reinforcers. To assess this possibility, we tested how blockade of ox/hcrt-1 signaling may affect the acquisition of discriminative pavlovian approach induced by stimuli paired with sucrose delivery. Rats underwent 7 daily conditioning sessions in which the onset of a cue light and tone preceded the delivery of two sucrose pellets (Fig. 3D). Cue-reward learning was assayed by the development of conditioned approach behavior in which rats displayed an increase in the proportion of goal-directed nosepokes into the pellet receptacle during presentation of the CS relative to nosepokes made during the intertrial interval (i.e., the discrimination ratio). Before each of the 7 training sessions, rats received injections of either vehicle (n = 11) or SB334867 (n = 11). As shown in Figure 3E, rats in both groups showed an increase in the proportion of nosepokes during the CS over 7 d of training. Analysis of these data revealed a significant main effect of training day (F(6,132) = 26.11, p < 0.01). However, there was no significant main effect of treatment group or treatment by training day interaction (both Fs < 1, n.s.). These data indicate that blockade of ox/hrct-1R signaling does not disrupt simple pavlovian approach learning. Thus, ox/hrct-1R activation may contribute to a bias toward high cost/high palatable food options, but does not appear to be required for learning an approach response induced by conditioned cues.

OxA/hcrt-1-induced plasticity in the VTA is enhanced following cocaine or HF self-administration

To determine whether cocaine, RF or HF pellet seeking enhanced oxA/hcrt-1-mediated glutamatergic synaptic transmission in the VTA, NMDAR evoked EPSCs (eEPSCs) were recorded using patch-clamp electrophysiology. To examine oxA/hcrt-1-mediated plasticity induced by operant history without the confounding aspect of a more complex PR responding for cocaine, RF, or HF seeking, the paradigm was modified so that rats received reinforcement on a modified, fixed schedule (fixed ratio 1 followed by a 20 s timeout). Recordings of VTA neurons from midbrain slices were made 20–24 h after rats obtained stable self-administration of cocaine, RF, or HF pellets (typically 14–17 d).

OxA/hcrt-1 (100 nm, 5 min) significantly potentiated NMDAR-mediated eEPSCs in naive adult rats (Fig. 4A,B). Food restriction (FR; 20 g of food per day as above) did not significantly alter oxA/hcrt-1-mediated plasticity in the VTA compared with naive rats (maximum potentiation in naive: 123 ± 7%, n = 7 vs sham: 129 ± 3%, n = 7, p > 0.05) (Fig. 4A–C). Similarly, RF pellet self-administration also did not alter oxA/hcrt-1-mediated potentiation of NMDAR currents (124 ± 10%, n = 7, p > 0.05) (Fig. 4A–C). In contrast, a significantly elevated oxA/hcrt-1-mediated potentiation of NMDAR eEPSCs (cocaine: 159 ± 10%, n = 9; HF: 156 ± 12%, n = 9) (Fig. 4A–C) was observed in cocaine or HF pellet self-administering rats compared with naive, sham or RF self-administering rats (p < 0.05).

The lateral hypothalamus was removed from horizontal VTA slices used for electrophysiology to determine whether prior self-administration history altered the expression of oxA/hcrt-1. Although there was a significant increase in oxA/hcrt-1 protein of RF and HF self-administering rats compared with naive rats (p < 0.05), no significant differences in oxA/hcrt-1 protein levels were found between naive and food-restricted rats, nor between RF, cocaine, or HF self-administration (Fig. 4D) (p > 0.05, one way ANOVA, Dunnett's multiple comparison test).

Potentiation of orexin A-mediated glutamatergic synaptic transmission is presynaptic

To determine the locus of synaptic change, we recorded the frequency and amplitude of AMPAR mEPSCs before (baseline) and 10 min after a 5 min bath application of oxA/hcrt-1 (100 nm). Frequency of mEPSCs was significantly increased by oxA/hcrt-1 (100 nm) in cocaine (before: 1.0 ± 0.2 Hz vs after: 1.3 ± 0.1, n = 8, p < 0.05, paired t test) (Fig. 5B,Ei) and HF (before: 1.3 ± 0.3 Hz vs after: 1.6 ± 0.4, n = 7, p < 0.05, paired t test) (Fig. 5C,Fi) self-administering rats compared with RF self-administering rats (before: 0.9 ± 0.1 Hz vs after: 0.8 ± 0.1, n = 8, p > 0.05, paired t test) (Fig. 5A,Di). OxA/hcrt-1 (100 nm) did not alter mEPSC amplitude in either RF (before: 11.3 ± 0.5 pA vs after: 11.0 ± 0.8 pA, n = 8, p > 0.05) (Fig. 5A,Dii), cocaine (before: 12.4 ± 0.6 pA vs after: 12.3 ± 0.8 pA, n = 8, p > 0.05) (Fig. 5B,Eii) or HF (before: 10.7 ± 0.5 pA vs after: 9.8 ± 0.4 pA, n = 7, p > 0.05) (Fig. 5C,Fii) self-administering rats. Because oxA/hcrt-1 increased frequency, but not amplitude of mEPSCs in cocaine or HF self-administering rats, these results suggest that a presynaptic increase in glutamatergic transmission occurs following cocaine or HF self-administration.

Figure 5.

Figure 5.

Cocaine or high fat self-administration increases presynaptic oxA/hcrt-1 signaling. mEPSCs were recorded while VTA neurons were voltage-clamped at –70 mV before and 10 min after a 5 min bath application of oxA/hcrt-1 (100 nm). A–C, Example recordings of AMPAR mEPSCs before (i) and 15 min after (ii) oxA/hcrt-1 application in VTA slices of rats self-administering (A) regular food, (B) cocaine, or (C) high-fat chocolate food. Calibrations: 50 pA, 200 ms. D, AMPAR mEPSC amplitude (i) or frequency (ii) was not significantly different after oxA/hcrt-1 application to VTA neurons from regular food self-administering rats (n = 8, p > 0.05). E, F, In contrast, mEPSC frequency (ii), but not amplitude (i), was significantly increased after oxA/hcrt-1 application in (E) cocaine (n = 8, p < 0.05) or (F) high fat chocolate food self-administering rats (n = 6, p < 0.05). Each bar represents the mean and SEM. Paired t tests. D–F, Cumulative probability plots of amplitude (i) or interevent interval (ii) before (black) and after (colored) oxA/hcrt-1 application in example VTA neurons from (D) regular food, (E) cocaine, or (F) high fat chocolate food self-administering rats.

To test whether prior self-administration resulted in a modification of ox/hcrt-1R sensitivity, a concentration of oxA/hcrt-1 (1 nm) that did not potentiate eEPSCs in VTA neurons of naive rats was tested on NMDAR eEPSCs in VTA neurons of RF, cocaine and HF self-administering rats (Fig. 6A) (n = 7). OxA/hcrt-1 significantly potentiated NMDAR currents in VTA neurons of cocaine (123 ± 4%, n = 7, p < 0.05) and HF self-administering rats (123 ± 6%, n = 8, p < 0.05), but not RF self-administering rats (104 ± 3%, n = 8, p > 0.05). These results suggest an alteration in the efficacy or availability of ox/hcrt-1Rs and/or cognate signal transduction machinery on excitatory VTA inputs to the VTA after cocaine or HF self-administration, but not RF self-administration.

Figure 6.

Figure 6.

Orexin/hypocretin receptor signaling is increased after cocaine or high fat chocolate food self-administration. Rats self-administered regular food, cocaine or high fat chocolate food pellets on a fixed ratio 1 schedule. Horizontal midbrain sections were prepared 24 h after the last session. eEPSCs were recorded while neurons were voltage-clamped at +40 mV before and after a 5-min bath application of oxA/hcrt-1 (1 nm). Peak NMDAR current was measured 20 ms after the artifact. A, Application of 1 nm oxA/hcrt-1 (5 min) did not potentiate NMDAR eEPSCs in VTA neurons of naive (open circles, n = 7) or regular food self-administering rats (green squares, n = 8). However, in rats self-administering cocaine (blue circles, n = 7) or high fat chocolate food (red triangles, n = 8), 1 nm oxA/hcrt-1 significantly potentiated NMDAR eEPSCs. B, Example traces of eEPSCs evoked at +40 mV before (black) and 10 min after (colored) oxA/hcrt-1 (1 nm, 5 min) from naive rats (i, gray) or rats self-administering regular food (ii, green), cocaine (iii, blue) or high fat chocolate food (iv, red). Stimulus artifacts have been removed for clarity. Calibrations: 50 pA, 50 ms.

Enhanced oxA/hcrt-1-mediated glutamatergic synaptic transmission in the VTA is important for salient positive reinforcers, but not aversive arousing stimuli

Potentiated excitatory synaptic transmission observed after cocaine or HF self-administration may be due to the arousing properties of these reinforcers as opposed to their incentive properties. Thus, we sought to determine whether inducing arousal with an aversive stimulus could potentiate oxA/hcrt-1-mediated excitatory synaptic transmission in the VTA in a manner similar to highly salient appetitive stimuli. In this experiment, food-restricted rats were exposed to repeated, unpredictable footshocks for 30 min per day for 7 d, a paradigm reported to produce stress in rats (Swiergiel et al., 2007) (Fig. 7A). As in previous electrophysiology experiments, VTA slices were taken 24 h after the last session. Despite an increase in NMDAR eEPSCs in VTA neurons of animals exposed to repeated footshock, the oxA/hcrt-1(100 nm)-mediated potentiation of NMDAR eEPSCs did not significantly differ from that previously determined in naive, FR, or regular food self-administering rats (125 ± 7%; n = 10, p > 0.05) (Fig. 7B). Furthermore, the oxA/hcrt-1-mediated presynaptic effect on VTA neurons was not observed following footshock. OxA/hcrt-1 (100 nm) did not significantly alter mEPSC amplitude (before: 12 ± 1 pA vs after: 12 ± 0.7 pA, n = 8, p > 0.05) (Fig. 7Ci,) or frequency (before: 1.2 ± 0.3 Hz vs after: 1.2 ± 0.3 Hz, n = 8, p > 0.05) (Fig. 7Cii). These results suggest that, in contrast to data reported above for positive reinforcement, an aversive, arousing stimulus such as unpredictable footshock stress does not potentiate oxA/hcrt-1-mediated excitatory synaptic transmission in VTA dopamine neurons.

Figure 7.

Figure 7.

Footshock stress does not potentiate oxA/hcrt-1-mediated excitatory synaptic transmission in VTA neurons. Rats received 30 min of random footshocks for 7 consecutive days. Cardiac blood was drawn from FR (n = 6) or stressed (n = 6) rats immediately before aCSF perfusion and decapitation 24 h after the final footshock session. A, ACTH levels in stressed rats (filled bar) were significantly increased compared with FR controls (open bar; p < 0.05). Bars represent mean and SEM. Unpaired Student's t test. Evoked EPSCs were recorded while neurons were voltage clamped at +40 mV before and after a 5 min bath application of oxA/hcrt-1 (100 nm). B, NMDAR eEPSCs of VTA neurons were potentiated by 100 nm oxA/hcrt-1 in stressed rats (n = 10). Inset is an example eEPSC evoked at +40 mV before (black) and 10 min after (purple) a 5 min application of oxA/hcrt-1. Calibration: 50 pA, 50 ms. C, mEPSCs were recorded while VTA neurons were voltage clamped at –70 mV before and 10 min after a 5-min bath application of oxA/hcrt-1 (100 nm). Example recordings of AMPAR mEPSCs before (i) and 15 min after (ii) oxA/hcrt-1 application in VTA slices of stressed rats. AMPAR mEPSC amplitude or frequency was not significantly different after oxA/hcrt-1 application to VTA neurons of stressed rats (n = 8, p > 0.05). Each bar represents the mean and SEM of 8 neurons from at least 3 rats. Paired t tests.

Discussion

In the present study, the ox/hcrt-1R antagonist, SB334867 decreased PR lever pressing selectively for cocaine and HF, but had no effect on PR responding for RF. Additionally, SB334867 reduced the effort required to obtain HF in an effort-based decision making task. Consistent with these findings, oxA/hcrt-1-mediated plasticity in the VTA was enhanced in animals self-administering cocaine or HF, but not RF. This increase in oxA/hcrt-1-mediated excitatory synaptic transmission observed in cocaine and HF groups was likely due to increased presynaptic signaling of ox/hcrt-1Rs and enhanced glutamate release. These experiments demonstrate a role for oxA/hcrt-1-mediated signaling in motivation specifically for positive reinforcers of high salience, such as cocaine or HF pellets.

SB334867 has at least 50-fold selectivity over ox/hcrt-1Rs than ox/hcrt-2Rs and a wide range of other G-protein-coupled receptors (Porter et al., 2001). This antagonist can penetrate the blood–brain-barrier and mediate behavioral effects following systemic administration. For example, an i.p. dose of 10 mg/kg yielded a brain concentration of 3.4 μm 2 h post administration and could block oxA/hcrt-1-induced grooming or feeding (Porter et al., 2001). We have observed inhibition of oxA/hcrt-1-mediated NMDAR currents of VTA dopamine neurons by 1 μm SB334867 in midbrain slices (Borgland et al., 2006), and thus we predict that SB334867 reduces work for reinforcers via antagonism of ox/hcrt-1Rs.

Dopamine action in the nucleus accumbens has been implicated in behavioral activation and effort-related processes, both components of motivated behavior (Salamone et al., 2007; Floresco et al., 2008). Our data indicates that ox/hcrt-1R-mediated signaling is important for enabling animals to overcome effort-related costs to obtain highly salient reinforcers. Systemic administration of SB334867 precludes precise determination of the specific neural regions where ox/hcrt-1 activity may mediate these effects. Nonetheless, our data reveal that oxA/hcrt-1 selectively potentiated presynaptic inputs into the VTA of animals self-administrating highly salient reinforcers. Thus, is it reasonable to propose that SB334867 may have reduced the actions of oxA/hcrt-1 on VTA neural activity, leading to attenuated dopamine activity in the nucleus accumbens. It is important to note that ox/hcrt-1Rs are expressed in other neurons of the mesocorticolimbic circuit underlying motivated behavior (Trivedi et al., 1998); therefore, future experiments may determine the exact locus of SB334867 action in reducing motivated behavior.

Our findings complement other studies showing that SB334867 also reduces PR responding for nicotine (Hollander et al., 2008), decreases the positive incentive properties of sexual behavior (Muschamp et al., 2007), and that centrally administered oxA/hcrt-1 augments the breakpoint for sucrose pellets (Thorpe et al., 2005). Additionally, a selective increase in consumption of HF versus RF has been observed after oxA/hcrt-1 administration (Clegg et al., 2002; Zheng et al., 2007). OxA/hcrt-1 can augment feeding during altered motivational states such as following 24 h food deprivation, restricted feeding, or presentation of a highly palatable diet (Clegg et al., 2002; Szekely et al., 2002; Zheng et al., 2007; Nair et al., 2008). Here, we observed that ox/hcrt-1R signaling was important for motivation for both cocaine and HF self-administration as well as effort to obtain HF pellets. Together, these data suggest that ox/hcrt-1R signaling underlies heightened motivation to obtain salient reinforcers.

The SB334867-induced reduction in responding for cocaine or HF could be due to disruption in memory for the reinforcer as the duration between reinforcer deliveries increased using the PR schedule (Akbari et al., 2007, 2008). However, this is unlikely because lever-pressing for RF pellets was maintained with SB33486. These data also suggest that the effects of SB334867 on responding for HF are unlikely to be attributable to satiety. Additionally, SB334867 did not affect the consumption of freely available RF or HF pellets in contrast with other reports showing that SB334867 reduces the hyperphagic response to i.c.v. oxA/hcrt-1 in fasted rats free feeding on regular chow (Haynes et al., 2000) or in nonrestricted animals consuming highly palatable foods (Rodgers et al., 2001). This discrepancy may be because the effect of SB334867 on feeding was only observed at higher doses (30 mg/kg) which also affected grooming, sniffing, rearing, and locomotion (Rodgers et al., 2001). Thus, the 10 mg/kg dose of SB334867 used in the present study may induce a selective effect on motivated responding for highly salient reinforcers while leaving more general processes relative to hunger and satiety relatively intact.

Ox/hcrt-1R signaling has been implicated in the ability of food-associated conditioned stimuli to induce reward seeking behaviors, given that SB334867 impairs place preference for morphine or food (Harris et al., 2005, 2007; Narita et al., 2006) and cue-induced reinstatement of ethanol- or cocaine-seeking behavior (Lawrence et al., 2006; Smith et al., 2009). Yet, we observed that SB334867 did not affect the acquisition of conditioned-approach behavior for sucrose. Thus, the effects of SB334867 reported here do not appear to be mediated by a disruption in associative learning about reward-related stimuli.

Internal metabolic drive-state has been hypothesized to activate orexin/hypocretin neurons (Thorpe et al., 2003; Yamanaka et al., 2003; Burdakov and Alexopoulos, 2005), which may promote foraging behavior. For example, the intrinsic firing rate of orexin/hypocretin neurons can be altered by fluctuations in the levels of circulating nutrients and appetite-regulating hormones (Yamanaka et al., 2003; Burdakov and Alexopoulos, 2005). Orexin/hypocretin-mediated activation of catecholaminergic regions may promote locomotor activity in association with motivated behaviors (Wisor et al., 2001; Yamanaka et al., 2003). The present data support this hypothesis by suggesting that ox/hcrt-1R signaling enhances motivation for highly salient reinforcers.

In our PR experiments, we observed lower breakpoints for cocaine versus RF or HF, which is likely attributable to the limitation of cocaine intake due to its peripheral effects (increased heart rate and blood pressure). Surprisingly, there were no differences in breakpoints in responding for HF or RF under control conditions, although ox/hcrt-1R blockade selectively reduced breakpoints in rats responding for HF or cocaine, but not RF. It is important to note that a number of factors can affect breakpoints and the lack of difference between animals working for RF or HF does not necessarily imply that the HF reinforcer was of equal salience to RF. Indeed, in a separate experiment, we demonstrated that when given the choice between the two reinforcers, rats are willing to expend more effort to climb a barrier to obtain HF pellets rather than choose freely available RF. Thus, the relative breakpoint among the different groups of vehicle-treated rats may not necessarily reflect the relative salience of the reinforcer, as has been discussed recently by Salamone et al. (2009). Because ox/hcrt-1R antagonism reduced a preference for the barriered HF arm, as well as the breakpoints for cocaine or HF, but not RF, these data further support the notion that ox/hcrt-1Rs mediate responding for highly salient, but not all reinforcers.

OxA/hcrt-1 potentiates NMDAR currents in VTA dopamine neurons in juvenile rats via protein kinase C-induced trafficking of postsynaptic NMDARs (Borgland et al., 2006). Similarly, oxA/hcrt-1 potentiates NMDARs in adult rats and this plasticity was not influenced by mild food restriction. Interestingly, self-administration of cocaine or HF, but not RF, enhanced the oxA/hcrt-1-mediated potentiation of NMDARs via an additional presynaptic increase in glutamate release as indicated by an increase in AMPAR mEPSC frequency but not amplitude. Furthermore, cocaine or HF pellet self-administration resulted in an enhanced sensitivity to low concentrations of oxA/hcrt-1 suggesting that self-administration of these highly salient reinforcers resulted in an alteration of ox/hcrt-1R coupling, or an enhancement in the signal transduction pathway in presynaptic afferents to the VTA.

Orexin/hypocretin neurons are activated by corticotropin releasing factor (CRF) and other stressful stimuli (Winsky-Sommerer et al., 2004; Boutrel and de Lecea, 2008). Stressful stimuli are also known to induce synaptic plasticity in the VTA in an NMDAR-dependent manner (Saal et al., 2003). Thus, we wanted to determine whether stress could potentiate oxA/hcrt-1-mediated excitatory synaptic transmission in the VTA in similar manner to that observed after cocaine or HF self-administration. After chronic footshock, there was no difference in oxA/hcrt-1 potentiated NMDAR currents compared with naive rats and no additional presynaptic effect as was observed with cocaine or HF self-administering rats. While it is possible that stress occludes the postsynaptic effect of oxA/hcrt-1 because both CRF and oxA/hcrt-1 induce trafficking of NMDARs through similar mechanisms (Ungless et al., 2003; Borgland et al., 2006), it is unlikely that an oxA/hcrt-1-medidated presynaptic effect would be occluded by stress. CRF and oxA/hcrt-1 likely act on separate neural inputs into the VTA as an ox/hcrt-1R antagonist did not block CRF-dependent footshock-induced reinstatement of cocaine seeking or associated glutamate or dopamine release in the VTA (Wang et al., 2009). Furthermore, reward and arousal functions of oxA/hcrt-1 have been hypothesized to be represented in different neural circuits whereby orexin/hypocretin neurons that are activated by stimuli associated with positive reinforcement are located in the lateral hypothalamus and project to the VTA, whereas orexin/hypocretin neurons of the dorsal medial hypothalamus and perifornical area mediate arousal and response to stress (Harris and Aston-Jones, 2006).

In conclusion, these data support a role for oxA/hcrt-1 in motivation for highly salient positive reinforcers. Enhanced oxA/hcrt-1-mediated potentiation of glutamatergic synaptic transmission in the VTA, only observed with highly salient appetitive reinforcers, may underlie the motivational drive to selectively seek cocaine or highly salient foods. We hypothesize that oxA/hcrt-1 transmission in the VTA strengthens reinforcing properties of highly salient stimuli, thus promoting motivation selectively for these rewards. These data contribute to our understanding of the role of orexin/hypocretin transmission in both normal reward processing for highly palatable foods as well as pathological reward processing for addictive drugs like cocaine.

Footnotes

This work was supported by a Natural Sciences and Engineering Research Council of Canada Discovery Grant (S.L.B.), National Alliance for Research on Schizophrenia and Depression Young Investigator Award (S.L.B.), National Institute on Drug Abuse Grant 1R01DA15096 (A.B.), and funding from the State of California for medical research on alcohol and substance abuse through the University of California, San Francisco (A.B.).

References

  1. Adamantidis AR, Zhang F, Aravanis AM, Deisseroth K, de Lecea L. Neural substrates of awakening probed with optogenetic control of hypocretin neurons. Nature. 2007;450:420–424. doi: 10.1038/nature06310. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Akbari E, Naghdi N, Motamedi F. The selective orexin 1 receptor antagonist SB-334867-A impairs acquisition and consolidation but not retrieval of spatial memory in Morris water maze. Peptides. 2007;28:650–656. doi: 10.1016/j.peptides.2006.11.002. [DOI] [PubMed] [Google Scholar]
  3. Akbari E, Motamedi F, Naghdi N, Noorbakhshnia M. The effect of antagonization of orexin 1 receptors in CA1 and dentate gyrus regions on memory processing in passive avoidance task. Behav Brain Res. 2008;187:172–177. doi: 10.1016/j.bbr.2007.09.019. [DOI] [PubMed] [Google Scholar]
  4. Aston-Jones G, Smith RJ, Moorman DE, Richardson KA. Role of lateral hypothalamic orexin neurons in reward processing and addiction. Neuropharmacology. 2009;56(Suppl 1):112–121. doi: 10.1016/j.neuropharm.2008.06.060. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Balcita-Pedicino JJ, Sesack SR. Orexin axons in the rat ventral tegmental area synapse infrequently onto dopamine and gamma-aminobutyric acid neurons. J Comp Neurol. 2007;503:668–684. doi: 10.1002/cne.21420. [DOI] [PubMed] [Google Scholar]
  6. Berridge KC. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology. 2007;191:391–431. doi: 10.1007/s00213-006-0578-x. [DOI] [PubMed] [Google Scholar]
  7. Borgland SL, Malenka RC, Bonci A. Acute and chronic cocaine-induced potentiation of synaptic strength in the VTA: electrophysiological and behavioral correlates in individual rats. J Neurosci. 2004;24:7482–7490. doi: 10.1523/JNEUROSCI.1312-04.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Borgland SL, Taha SA, Sarti F, Fields HL, Bonci A. Orexin A in the VTA is critical for the induction of synaptic plasticity and behavioral sensitization to cocaine. Neuron. 2006;49:589–601. doi: 10.1016/j.neuron.2006.01.016. [DOI] [PubMed] [Google Scholar]
  9. Boutrel B, de Lecea L. Addiction and arousal, the hypocretin connection. Physiol Behav. 2008;93:947–951. doi: 10.1016/j.physbeh.2007.11.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Boutrel B, Kenny PJ, Specio SE, Martin-Fardon R, Markou A, Koob GF, de Lecea L. Role for hypocretin in mediating stress-induced reinstatement of cocaine-seeking behavior. Proc Natl Acad Sci U S A. 2006;102:19168–19173. doi: 10.1073/pnas.0507480102. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Burdakov D, Alexopoulos H. Metabolic state signalling through central hypocretin/orexin neurons. J Cell Mol Med. 2005;9:795–803. doi: 10.1111/j.1582-4934.2005.tb00380.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Carelli RM, Ijames SG, Crumling AJ. Evidence that separate neural circuits in the nucleus accumbens encode cocaine versus “natural” (water and food) reward. J Neurosci. 2000;20:4255–4266. doi: 10.1523/JNEUROSCI.20-11-04255.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Clegg DJ, Air EL, Woods SC, Seeley RJ. Eating elicited by orexin-a, but not melanin-concentrating hormone, is opioid mediated. Endocrinology. 2002;143:2995–3000. doi: 10.1210/endo.143.8.8977. [DOI] [PubMed] [Google Scholar]
  14. de Lecea L, Kilduff TS, Peyron C, Gao X, Foye PE, Danielson PE, Fukuhara C, Battenberg EL, Gautvik VT, Bartless FS, 2nd, Frankel WN, van den Pol AN, Bloom FE, Gautvik KM, Sutcliffe JG. The hypocretins: hypothalamus-specific peptides with neuroexcitatory activity. Proc Natl Acad Sci U S A. 1998;95:322–327. doi: 10.1073/pnas.95.1.322. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Floresco SB, Ghods-Sharifi S. Amygdala-prefrontal cortical circuitry regulates effort-based decision making. Cereb Cortex. 2007;17:251–260. doi: 10.1093/cercor/bhj143. [DOI] [PubMed] [Google Scholar]
  16. Floresco SB, St. Onge JR, Ghods-Sharifi S, Winstanley CA. Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cogn Affect Behav Neurosci. 2008;8:375–389. doi: 10.3758/CABN.8.4.375. [DOI] [PubMed] [Google Scholar]
  17. Harris GC, Aston-Jones G. Arousal and reward: a dichotomy in orexin function. Trends Neurosci. 2006;29:571–577. doi: 10.1016/j.tins.2006.08.002. [DOI] [PubMed] [Google Scholar]
  18. Harris GC, Wimmer M, Aston-Jones G. A role for lateral hypothalamic orexin neurons in reward seeking. Nature. 2005;437:556–559. doi: 10.1038/nature04071. [DOI] [PubMed] [Google Scholar]
  19. Harris GC, Wimmer M, Randall-Thompson JF, Aston-Jones G. Lateral hypothalamic orexin neurons are critically involved in learning to associate an environment with morphine reward. Behav Brain Res. 2007;183:43–51. doi: 10.1016/j.bbr.2007.05.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Haynes AC, Jackson B, Chapman H, Tadayyon M, Johns A, Porter RA, Arch JR. A selective orexin-1 receptor antagonist reduces food consumption in male and female rats. Regul Pept. 2000;96:45–51. doi: 10.1016/s0167-0115(00)00199-3. [DOI] [PubMed] [Google Scholar]
  21. Hollander JA, Lu Q, Cameron MD, Kamenecka TM, Kenny PJ. Insular hypocretin transmission regulates nicotine reward. Proc Natl Acad Sci U S A. 2008;105:19480–19485. doi: 10.1073/pnas.0808023105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Johnson SW, North RA. Two types of neurone in the rat ventral tegmental area and their synaptic inputs. J Physiol. 1992;450:455–468. doi: 10.1113/jphysiol.1992.sp019136. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Jones S, Bonci A. Synaptic plasticity and drug addiction. Curr Opin Pharmacol. 2005;5:20–25. doi: 10.1016/j.coph.2004.08.011. [DOI] [PubMed] [Google Scholar]
  24. Korotkova TM, Sergeeva OA, Eriksson KS, Haas HL, Brown RE. Excitation of ventral tegmental area dopaminergic and nondopaminergic neurons by orexin/hypocretins. J Neurosci. 2003;23:7–11. doi: 10.1523/JNEUROSCI.23-01-00007.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Lacey MG, Mercuri NB, North RA. Actions of cocaine on rat dopaminergic neurons in vitro. Br J Pharmacol. 1990;99:731–735. doi: 10.1111/j.1476-5381.1990.tb12998.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Lawrence AJ, Cowen MS, Yang HJ, Chen F, Oldfield B. The orexin system regulates alcohol-seeking in rats. Br J Pharmacol. 2006;148:752–759. doi: 10.1038/sj.bjp.0706789. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Lowry OH, Rosebrough NJ, Farr AL, Randall RJ. Protein measurement with the folin phenol reagent. J Biol Chem. 1951;193:265–275. [PubMed] [Google Scholar]
  28. Mileykovskiy BY, Kiyashchenko LI, Siegel JM. Behavioral correlates of activity in identified hypocretin/orexin neurons. Neuron. 2005;46:787–798. doi: 10.1016/j.neuron.2005.04.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Muschamps JW, Dominguez JM, Sato SM, Shen RY, Hull EM. A role for hypocretin (orexin) in male sexual behaviour. J Neurosci. 2007;27:2837–2845. doi: 10.1523/JNEUROSCI.4121-06.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Nair SG, Golden SA, Shaham Y. Differential effects of the hypocretin 1 receptor antagonist SB334867 on high-fat food self-administration and reinstatement of food seeking in rats. Br J Pharmacol. 2008;154:1–11. doi: 10.1038/bjp.2008.3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Narita M, Nagumo Y, Hashimoto S, Narita M, Khotib J, Miyatake M, Sakurai T, Yanagisawa M, Nakamachi T, Shioda S, Suzuki T. Direct involvement of orexinergic systems in the activation of the mesolimbic dopamine pathway and related behaviors induced by morphine. J Neurosci. 2006;26:398–405. doi: 10.1523/JNEUROSCI.2761-05.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Peyron C, Tighe DK, van den Pol AN, de Lecea L, Heller HC, Sutcliffe JG, Kilduff TS. Neurons containing hypocretin (orexin) project to multiple neuronal systems. J Neurosci. 1998;18:9996–10015. doi: 10.1523/JNEUROSCI.18-23-09996.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Porkka-Heiskanen T, Kalinchuk A, Alanko L, Huhtaniemi I, Stenberg D. Orexin A and B levels in the hypothalamus of female rats: the effects of the estrous cycle and age. Eur J Endocrinol. 2004;150:737–742. doi: 10.1530/eje.0.1500737. [DOI] [PubMed] [Google Scholar]
  34. Porter RA, Chan WN, Coulton S, Johns A, Hadley MS, Widdowson K, Jerman JC, Brough SJ, Coldwell M, Smart D, Jewitt F, Jeffrey P, Austin N. Effects of chronic footshock, restraint and corticotropin-releasing factor on freezing, ultrasonic vocalization and forced swim behavior in rats. Bioorg Med Chem Lett. 2001;11:1907–1910. doi: 10.1016/s0960-894x(01)00343-2. [DOI] [PubMed] [Google Scholar]
  35. Richardson NR, Roberts DC. Progressive ratio schedules in drug self-administration studies in rats: a method to evaluate reinforcing efficacy. J Neurosci Methods. 1996;66:1–11. doi: 10.1016/0165-0270(95)00153-0. [DOI] [PubMed] [Google Scholar]
  36. Rodgers RJ, Halford JC, Nunes de Souza RL, Canto de Souza AL, Piper DC, Arch JR, Upton N, Porter RA, Johns A, Blundell JE. SB-334867, a selective orexin-1 receptor antagonist, enhances behavioural satiety and blocks the hyperphagic effect of orexin-A in rats. Eur J Neurosci. 2001;13:1444–1452. doi: 10.1046/j.0953-816x.2001.01518.x. [DOI] [PubMed] [Google Scholar]
  37. Saal D, Dong Y, Bonci A, Malenka RC. Drugs of abuse and stress trigger a common synaptic adaptation in dopamine neurons. Neuron. 2003;37:577–582. doi: 10.1016/s0896-6273(03)00021-7. [DOI] [PubMed] [Google Scholar]
  38. Sakurai T, Amemiya A, Ishii M, Matsuzaki I, Chemelli RM, Tanaka H, Williams SC, Richardson JA, Kozlowski GP, Wilson S, Arch JR, Buckingham RE, Haynes AC, Carr SA, Annan RS, McNulty DE, Liu WS, Terrett JA, Elshourbagy NA, Bergsma DJ, Yanagisawa M. Orexin and orexin receptors: a family of hypothalamic neuropeptides and G protein-coupled receptors that regulate feeding behavior. Cell. 1998;92:573–585. doi: 10.1016/s0092-8674(00)80949-6. [DOI] [PubMed] [Google Scholar]
  39. Salamone JD, Correa M, Farrar A, Mingote SM. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology. 2007;191:461–482. doi: 10.1007/s00213-006-0668-9. [DOI] [PubMed] [Google Scholar]
  40. Salamone JD, Correa M, Farrar M, Nunes EJ, Pardo M. Dopamine, behavioral economics, and effort. Front Behav Neurosci. 2009 doi: 10.3389/neuro.08.013.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Smith RJ, See RE, Aston-Jones G. Orexin/hypocretin signaling at the OX1 receptor regulates cue-elicited cocaine seeking. Eur J Neurosci. 2009;30:493–503. doi: 10.1111/j.1460-9568.2009.06844.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Stuber GD, Klanker M, de Ridder B, Bowers MS, Joosten RN, Feenstra MG, Bonci A. Reward predictive cues enhance excitatory synaptic strength onto midbrain dopamine neurons. Science. 2008;321:1690–1692. doi: 10.1126/science.1160873. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Swiergiel AH, Zhou Y, Dunn AJ. Effects of chronic footshock, restraint and corticotropin-releasing factor on freezing, ultrasonic vocalization and forced swim behavior in rats. Behav Brain Res. 2007;183:178–187. doi: 10.1016/j.bbr.2007.06.006. [DOI] [PubMed] [Google Scholar]
  44. Székely M, Pétervári E, Balaskó M, Hernádi I, Uzsoki B. Effects of orexins on energy balance and thermoregulation. Regul Pept. 2002;104:47–53. doi: 10.1016/s0167-0115(01)00348-2. [DOI] [PubMed] [Google Scholar]
  45. Thorpe AJ, Mullett MA, Wang C, Kotz CM. Regional, metabolic and circadian specificity of LH orexin A. Am J Physiol Regul Integr Comp Physiol. 2003;284:R1409–R1417. doi: 10.1152/ajpregu.00344.2002. [DOI] [PubMed] [Google Scholar]
  46. Thorpe AJ, Cleary JP, Levine AS, Kotz CM. Centrally administered orexin A increases motivation for sweet pellets in rats. Psychopharmacology. 2005;182:75–83. doi: 10.1007/s00213-005-0040-5. [DOI] [PubMed] [Google Scholar]
  47. Trivedi P, Yu H, MacNeil DJ, Van der Ploeg LH, Guan XM. Distribution of orexin receptor mRNA in the rat brain. FEBS Lett. 1998;438:71–75. doi: 10.1016/s0014-5793(98)01266-6. [DOI] [PubMed] [Google Scholar]
  48. Ungless MA, Whistler JL, Malenka RC, Bonci A. Single cocaine exposure in vivo induces long-term potentiation in dopamine neurons. Nature. 2001;411:583–587. doi: 10.1038/35079077. [DOI] [PubMed] [Google Scholar]
  49. Ungless MA, Singh V, Crowder TL, Yaka R, Ron D, Bonci A. Corticotropin-releasing factor requires CRF binding protein to potentiate NMDA receptors via CRF receptor 2 in dopamine neurons. Neuron. 2003;39:401–407. doi: 10.1016/s0896-6273(03)00461-6. [DOI] [PubMed] [Google Scholar]
  50. Vittoz NM, Berridge CW. Hypocretin/orexin selectively increases dopamine efflux within the prefrontal cortex: involvement of the ventral tegmental area. Neuropsychopharmacology. 2006;31:384–395. doi: 10.1038/sj.npp.1300807. [DOI] [PubMed] [Google Scholar]
  51. Vittoz NM, Schmeichel B, Berridge CW. Hypocretin/orexin preferentially activates caudomedial ventral tegmental area dopamine neurons. Eur J Neurosci. 2008;28:1629–1640. doi: 10.1111/j.1460-9568.2008.06453.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Wang B, You Z, Wise RA. Independence of VTA orexin and CRF mechanisms in the reinstatement of cocaine-seeking. Biol Psychiatry. 2009 doi: 10.1016/j.biopsych.2009.01.018. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Winsky-Sommerer R, Yamanaka A, Diano S, Borok E, Roberts AJ, Sakurai T, Kilduff TS, Horvath TL, de Lecea L. Interaction between the corticotropin-releasing factor system and hypocretins (orexins): a novel circuit mediating stress response. J Neurosci. 2004;24:11439–11448. doi: 10.1523/JNEUROSCI.3459-04.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Wisor JP, Nishino S, Sora I, Uhl GH, Mignot E, Edgar DM. Dopaminergic role in stimulant-induced wakefulness. J Neurosci. 2001;21:1787–1794. doi: 10.1523/JNEUROSCI.21-05-01787.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Yamanaka A, Beuckmann CT, Willie JT, Hara J, Tsujino N, Mieda M, Tominaga M, Yagami K, Sugiyama F, Goto K, Yanagisawa M, Sakurai T. Hypothalamic orexin neurons regulate arousal according to energy balance in mice. Neuron. 2003;38:701–713. doi: 10.1016/s0896-6273(03)00331-3. [DOI] [PubMed] [Google Scholar]
  56. Zhang M, Balmadrid C, Kelley AE. Nucleus accumbens opioid, GABaergic, and dopaminergic modulation of palatable food motivation: contrasting effects revealed by a progressive ratio study in the rat. Behav Neurosci. 2003;117:202–211. doi: 10.1037/0735-7044.117.2.202. [DOI] [PubMed] [Google Scholar]
  57. Zheng H, Patterson LM, Berthoud HR. Orexin signaling in the ventral tegmental area is required for high fat appetite induced by opioid stimulation of the nucleus accumbens. J Neurosci. 2007;27:11075–11082. doi: 10.1523/JNEUROSCI.3542-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from The Journal of Neuroscience are provided here courtesy of Society for Neuroscience

RESOURCES