Abstract
Behavioral flexibility, in the form of strategy switching or set shifting, helps animals cope with changing contingencies in familiar environments. The prelimbic (PL) and infralimbic (IL) regions of the rat prefrontal cortex (PFC) contribute to this ability so that rats trained to use one strategy have difficulty learning a new one if the PL/IL is inactivated. Thus, the PL/IL mediates learning new tasks in place of old ones, but it may also be required to switch between familiar tasks. To test this hypothesis, we trained rats to perform multiple task switches on a plus-shaped maze, alternating between two familiar tasks. Muscimol inactivation of the PL/IL never impaired switch acquisition, but did impair memory for the recently acquired switch 24 h later. Additional experiments determined that control rats continued to perform the new task 24 h after a switch, but rats with PL/IL inactivation had impaired memory and performed the same task that was learned before inactivation. This impairment was observed in multiple switches, demonstrating that PL/IL activity was required to remember which of two familiar tasks was most recently successful. After many switches, however, muscimol no longer impaired performance, and both saline- and muscimol-infused rats appeared to use immediate task contingencies rather than memory to select among familiar tasks. This strategy may account for the decreased effect of PL/IL inactivation observed after extensive training. Thus, although PL/IL activity contributed to memory for multiple task switches, it was not required for flexibly selecting among highly familiar tasks.
Keywords: prefrontal cortex, prelimbic, infralimbic, muscimol, task switch, strategy
Introduction
The PFC helps organize effective behavior and cognition (Nauta, 1971; Fuster, 1995), but the fundamental operations of the PFC, often described as “executive functions,” are not well understood. The guided activation theory (Miller and Cohen, 2001) proposes that PFC neurons alter activity in other brain areas so that appropriate sensory, memory, and motor circuits are activated to guide successful behavior. Such functions are important when the organization of behavior must be modified. Indeed, damage to the human dorsolateral PFC (dlPFC) typically produces perseverative or disorganized behavior (Milner, 1982; Owen et al., 1991; Ptak and Schnider, 2004) that is evident when new or unfamiliar responses must overcome previously learned ones (Drewe, 1974; Robinson et al., 1980; Stuss et al., 2000). Thus, switching to unfamiliar responses likely engages the dlPFC. The extent to which the structure is required for switching among familiar responses is unknown. The present experiments tested PFC contributions to flexible selection between two behavioral tasks in an animal model with varied degrees of strategy familiarity.
Strategy switching paradigms have assessed PFC function in rats. Although homology of frontal regions between rats and primates is debated (Pruess, 1995), comparative anatomy and neuropsychology suggest that the rat PL/IL is homologous to the primate dlPFC (Uylings et al., 2003). Therefore, PL/IL-dependent behavior in rats may provide a useful model for some aspects of human dlPFC function (Brown and Bowman, 2002). Maze tasks that must be solved by discriminating between subsets of available cues (e.g., allocentric spatial vs egocentric cues) operationally define task-solving “strategies” (e.g., “place” and “response” tasks, respectively) (Ragozzino et al., 1999b). In the place task, rats always entered the same goal arm [e.g., north (see Fig. 3)]; in the response task, rats were required to execute the same body turn (e.g., left) to enter a goal arm. Rats learned either task rapidly, even when the PL/IL was inactivated (Ragozzino et al., 1999b). The same treatment, however, impaired task (or strategy) switching (place to response or response to place). Like patients with dlPFC lesions, rats with PL/IL inactivation perseveratively engaged previously learned tasks (Ragozzino et al., 1999a,b, 2003). In contrast, PL/IL inactivation did not impair task reversals (e.g., north to south goals or right to left turns), showing that the PL/IL was not required for detecting or responding to new reward contingencies (Ragozzino et al., 1999b, 2003).
The present experiment aimed to clarify the cognitive processes involved in strategy switching. Although the PL/IL contributes to learning a new task that replaces an old one, task familiarity may alter this contribution. If PL/IL neurons mediate task switching per se, then their inactivation should impair switching, regardless of task familiarity. If PL/IL neurons specifically contribute to learning new tasks over old ones, inactivation should not impair switches among familiar tasks. We compared learning a novel switch to switching between two well learned tasks. For each switch, acquisition and retention were assessed independently. We found that PL/IL activity contributed to memory for task switches, even when both tasks were familiar, and suggest that the PL/IL acts to differentially bias memory systems involved in strategy switching to guide future behavior.
Materials and Methods
Animals.
Thirty-four male Long–Evans rats weighing 275–325 g at the beginning of the experiment were housed individually in a colony room held on 12 h light/dark cycle. After acclimating to the colony room for at least 5 d, rats were food-restricted to no <85% of their ad libitum body weight and maintained on a restricted diet for the duration of the experiment. All procedures with animals were performed in accordance with Institutional Animal Care and Use Committee guidelines and those established by the National Institutes of Health.
Maze.
An elevated plus-shaped maze, consisting of four wooden arms (65 × 8 cm) meeting at 90° angles was used. East and west arms were designated “start” arms and north and south arms were designated “goal” arms. Only one start arm was open on a given trial and a wooden block prevented access to the unused start arm. In each trial, both goal arms were open, but only one was baited. Food wells were drilled at the ends of all arms to hold cereal reward. The bottoms of the wells were made of mesh screen, below which an inaccessible food reward was placed to minimize the influence of odor cues in the task. A waiting platform was placed next to the maze. The maze and waiting platform were open to the testing room, which had several stationary visual cues on the walls.
Tasks.
Previous experiments operationalized different strategies by using tasks that depend on different memory systems (White and McDonald, 2002). A place task and a response task required similar overt behaviors, but (see Fig. 3) depend on different memory systems, the hippocampus or dorsal striatum, respectively (White and McDonald, 2002). In both tasks, the rat was placed on a start arm and trained to approach the choice point then enter a goal arm for food reward (half of a piece of Froot Loops cereal; Kellogs, Battlecreek, MI). In the place task, rats learned to approach one of the two goal arms (north or south) from both start arms. In the response task, rats learned to make either a right or a left body turn on every trial to enter the rewarded goal arm.
Maze acclimation.
Before surgery, all rats were handled and acclimated to the testing environment by allowing them to forage for food randomly scattered on the maze.
Surgery.
Rats were anesthetized with continuous-flow isoflurane and mounted in a stereotaxic frame. Rectal temperature was monitored and core temperature maintained with a heating pad. The scalp was shaved, scrubbed with betadine, and incised. Burr holes were drilled at stereotaxic coordinates +3.0 mm anterior and ±1.8 mm medial/lateral from bregma. Twenty-six-gauge cannulas (Plastics-One, Roanoake, VA) were implanted at a 14° angle to vertical and −2.0 mm ventral to dura. The cannulas were affixed to the skull with dental acrylic and skull screws. Dust caps with dummy cannulas extending 1.5 mm below the cannula tips were used to maintain patent cannulas. Rats were allowed to recover for 5–10 d after surgery before beginning maze training.
Pretraining.
After surgery, rats reacclimated to the maze with another foraging session. The next day, cereal reward was placed only in the food cups on both goal arms and one start arm was blocked. Rats were placed on each start arm twice and given access to both goal arms for four trials total. The direction of their first turn was recorded for each trial and three or more turns in the same direction was noted as a turning bias. If a rat displayed a turning bias and was required to learn the response task, then they were taught the response opposite to their turning bias.
Training.
Each rat was pseudorandomly assigned to either the place or response task (see Fig. 3). In each trial, the rat was placed at the distal end of a start arm (east or west arm) facing the center of the maze and allowed to enter one goal arm (north or south). Entering one full body-length into a goal arm was considered a choice, but the trial did not end until the rat either proceeded to the end of the arm or attempted to turn around and enter the other arm. If the rat chose the correct arm, it was allowed to consume the food and was then placed on the waiting platform until the start of the next trial. If the rat entered the incorrect arm, then it was returned to the waiting platform with no reward. Intertrial intervals were ∼5–8 s.
During training, the same start arm was used until the rat chose the correct goal arm on two consecutive trials. Then, the start arm was changed and another series of trials continued from the second start arm until the rat again entered the correct goal twice in a row, and then the start arm was changed again. Training proceeded in this manner until rats reached a training criterion of six consecutive correct trials with three start-arm reversals. Twenty-four hours after reaching this training criterion, the rats were given 24 trials with start arms selected pseudorandomly so that no more than three consecutive trials used the same start arm. During these tests, rats were required to perform at least 80% of trials correctly (four or fewer errors) each day. Rats were tested until they met this performance criterion for 2 d.
Switch/reversal training and evaluation.
Rats were assigned to perform either task switches (experiments 1–5) or spatial reversals (experiment 1 only). Twenty-four hours after reaching performance criterion in their initial task, rats in a switching group were required to switch tasks (from place to response or response to place), and rats in the reversal group performed a spatial reversal (north goal arm to south goal arm or vice versa). Both spatial reversals and response reversals are known to be PL/IL independent (Ragozzino et al., 1999b); here, we tested only serial spatial reversals to simplify the experimental design. No cues indicated that the task had changed; rather, the rats had to respond to the altered reward contingencies on the maze. Switching and reversing ability was scored in three phases.
TTC.
Switch and reversal training began with the same pattern of trials as described for initial task training; that is, each start arm was used repeatedly until two consecutive trials were performed correctly, and then the start arm was switched. The number of trials required for a rat to achieve six consecutive correct trials (with three start arm reversals) defined trials to criterion (TTC).
Errors at T = 0.
When a rat achieved TTC in the new task, testing continued for 24 more trials with start arms pseudorandomized as above. Errors were counted and recorded as errors at time 0 (T = 0).
Errors at T = 24.
The following day, the rats were again tested for 24 trials with the same task contingencies as 24 h before. Errors were counted and recorded as errors at time 24 h (T = 24). If a rat made more than four errors (performance <80% correct), it was given the same task the next day for another session of 24 trials. Only if the rat made four or less errors was it given a second switch or reversal the next day.
PL/IL inactivation.
On days when infusions were delivered, either muscimol or PBS (0.5 μl/cannula) was administered bilaterally. Muscimol (Sigma, St Louis, MO) was diluted in PBS to a concentration of 100 ng/μl. For all infusions, rats were briefly anesthetized with inhaled isoflurane. Dummy cannulas were removed and 33-gauge infusion cannulas extending 1.5 mm below the tip of the guide cannulas (final depth was −3.5 mm from dura) were inserted. Infusion cannulas were connected by Silastic tubing to syringes mounted in a pump that delivered infusions at a rate of 0.25 μl/min. Infusion cannulas were left in place for 3 min after injection to allow for diffusion. Rats were then placed back in their home cage to recover from the anesthesia. Twenty minutes after the infusions were completed, the rats were taken to the experimental room for testing. Behavior was also measured on days when no infusions were given to determine whether repeated muscimol infusion or isoflurane exposure altered behavior generally.
Histology.
After testing was complete, rats were deeply anesthetized with isoflurane and pentobarbital (50 mg/ml, i.p.) and perfused transcardially with ice-cold PBS followed by 4% paraformaldehyde. Brains were removed and postfixed in 4% paraformaldehyde for at least 24 h, then cryoprotected in 18% followed by 30% sucrose solution. Forty micrometer coronal sections were cut on a cryostat and mounted on slides. Sections were Nissl stained and compared with a standard brain atlas (Paxinos, 1986) to determine cannulas tip locations.
Results
Histology
In coronal sections, larger-diameter guide cannula and smaller-diameter internal cannula tracks were visible. Tips of the internal cannulas were located in either the PL or IL area, and were clustered around the PL/IL border (Fig. 1).
Experiment 1: multiple switches versus multiple reversals
To determine whether the PL/IL is required for the flexible selection and expression of familiar behaviors, 14 rats (the switch group) were trained to perform a series of 12 task switches over multiple days. To compare switching with a PL/IL-independent behavior that requires similar response flexibility (Ragozzino et al., 1999b), 10 rats (the reversal group) were trained to perform 12 spatial reversals.
Each rat in the switch group was assigned pseudorandomly to learn either response or place as an initial task. Each rat in the reversal group learned a spatial task and was assigned pseudorandomly to either the north or south goal arm as the initial rewarded location. After rats were trained in an initial task, serial switch or reversal training ensued (all training was performed as described above). TTC and errors at T = 0 were measured on each switch or reversal day, and errors at T = 24 were measured 24 h later. Therefore, three measurements were obtained for each of the 12 switch/reversals (Fig. 2). If a rat performed better than 80% correct at T = 24 h, it advanced to the next switch/reversal the following day. To assess switching among familiar tasks, each rat was trained repeatedly in two of the four possible start-goal combinations (Fig. 3). That is, if a rat learned the place task “go to the north arm” and the response task “turn left,” it switched between these two familiar tasks but never learned to approach the south goal arm or to make right turns. The task combinations were counterbalanced between rats.
Each rat was randomly assigned to receive either muscimol or saline infusions and was given the same type of infusion throughout experiment 1. Before switch or reversal numbers 1, 3, 6, 9, and 12 received infusions as described above (Fig. 2). No infusions were delivered during switches/reversals 2, 4, 5, 7, 8, 10, and 11 to monitor baseline behavior in both groups. No infusions were delivered before retention trials at T = 24 h.
To analyze learning and retention of switches and reversals, TTC and errors at T = 0 and T = 24 were compared separately on days when infusions were given (switch/reversal numbers 1, 3, 6, 9, and 12) using repeated-measures ANOVAs (drug by switch number). To test any persistent or nonspecific effects of muscimol, the same groups were similarly compared on days when no infusions were given (switch/reversal numbers 2, 4, 5, 7, 8, 10, and 11).
Experiment 1 results: PL/IL inactivation selectively impaired the maintenance of task switching
Muscimol-infused rats acquired task switches and initially performed the new task as well as saline-infused rats (TTC, F(1,12) = 3.32, p = 0.094) (Fig. 4a) (errors at T = 0, F(1,12) = 0.232, p = 0.639) (Fig. 4b). However, muscimol-infused rats made significantly more errors than saline-infused rats 24 h after switching (errors at T = 24, effect of drug, F(1,12) = 17.98, p = 0.001; post hoc tests, switches 1 and 3, t(12) > 2.49, p < 0.03) (Fig. 4c). No such impairment was found in the same rats when no infusions were given (errors at T = 24, F(1,12) = 029, p = 0.87) (Fig. 4c), or in the reversal group with or without infusions (errors at T = 24, infusions, F(1,8) = 0.024; p = 0.88; no infusions, F(6,48) = 0.59, p = 0.74) (data not shown).
As rats became familiar with task switching, their performance improved. On days when infusions were delivered, rats switched in fewer trials and made fewer errors over the course of the 12 switches (TTC, F(4,48) = 7.06, p < 0.001) (Fig. 4a) (errors at T = 24, F(4,48) = 2.57, p = 0.05) (Fig. 4c). Errors at T = 0 were unchanged across days (F(4,48) = 0.542; p = 0.705) (Fig. 4b). Muscimol did not change the rate of switching improvement over days (interaction of drug by switch number, TTC, F(4,48) = 1.88, p = 0.129; errors at T = 0, F(4,48) = 1.83, p = 0.139; errors at T = 24, F(4,48) = 1.69, p = 0.168). Improved performance across days was also found when no infusions were given and in the spatial reversal group (supplemental material, available at www.jneurosci.org). Therefore, by the end of experiment 1, rats became switching or reversing “experts.” In addition, effects of muscimol on switch retention appeared to decrease over the course of 12 switches (Fig. 4c). Indeed, a separate ANOVA at T = 24 in the muscimol group only showed that the effect of muscimol decreased over repeated switches (F(4,24) = 2.79; p = 0.05). Thus, after repeated switches, rats were less impaired by muscimol infusion at T = 24 h than earlier in training.
Experiment 2: task switching after extensive reversal training
Experiment 1 indicated that muscimol-induced deficits in switch retention decreased over the course of many switches. Although this decrease could be caused by familiarity with the task-switching paradigm, it could also be caused by other factors that changed over the course of the experiment (e.g., repeated intracranial infusions, increased familiarity with the maze environment, build-up of scar-tissue at the cannulas tips, etc.). To distinguish among these possibilities, rats that had performed repeated spatial reversals in experiment 1 were taught the egocentric task for the first time. These rats had cannulas for the same length of time, were given the same number of drug infusions, and were exposed the same maze environment as the task-switching rats, but had never switched between tasks.
Nine rats that had performed 12 spatial reversals were infused with muscimol (n = 4) or saline (n = 5) and taught to switch to the egocentric task as described in experiment 1. Rats were systematically assigned to receive saline or muscimol to counterbalance previous drug exposure from experiment 1. Testing procedures were the same as described above for task switching, and t tests assessed differences between rats receiving muscimol and saline in TTC, errors at T = 0, and errors at T = 24.
Experiment 2: results
Memory for the new task was impaired by muscimol infusion even after extensive experience in spatial reversals, so that “reversal experts” performed identically to naive rats given muscimol before their first switch trial. As in experiment 1, switch learning and performance were the same in both saline and muscimol groups during that day (TTC, t(7) = 1.92, p = 0.10; errors at T = 0, t(7) = 1.37, p = 0.21) (data not shown), but rats given muscimol infusions were impaired the next day (T = 24, t(7) = 4.16, p < 0.01) (Fig. 5). The results demonstrate that PL/IL function was not impaired by chronic cannulation or repeated infusion, that the brain structure remained crucial for remembering recent task switches, and that a factor specific to repeated task switching is crucial for the decreased impairment seen in experiment 1.
Experiment 3: effects of muscimol given immediately after a switch
Because muscimol infusion can reduce neuronal activity for hours (Givens and Olton, 1994; Lomber, 1999), PL/IL activity was likely suppressed both during and after switch training in experiment 1. To determine when PL/IL activity was required for task switching, a separate group of animals was taught a task switch, but given muscimol infusion immediately after switching. Ten experimentally naive rats were housed, trained, and implanted as described above. Each rat was trained in either the place or response task, and was given either muscimol or saline infusions 3–5 min after the time 0 test (the groups were counterbalanced for both variables). Rats were returned to their home cages after infusion and given no additional testing until the following day, when they were tested at T = 24. These data were compared with data from the first switch of the task-switching group in experiment 1. Thus, rats were given muscimol or saline before a switch in experiment 1 and identically trained rats received muscimol or saline after a switch in experiment 3. Data were analyzed with drug by time of infusion ANOVAs and post hoc comparisons.
Experiment 3: results
Postswitching injections had no effects on subsequent behavior. Unlike rats from experiment 1 who received infusions before behavior, rats given muscimol or saline infusions immediately after performing a task switch made few errors (T = 24 h, t(8) = 0.34, p = 0.74) (Fig. 6). Comparing the effect of muscimol injections between the two experiments suggested that its efficacy depended on whether it was delivered before or after the switch, although the interaction did not reach statistical significance (interaction of drug by time of infusion; T = 24, F(1,20) = 3.47, p = 0.077). Post hoc comparisons confirmed that errors increased significantly only when infusions were delivered before the switch (F(2,20) = 4.66; p = 0.02) (Fig. 6), indicating that PL/IL activity during, but not after behavior was required for normal task switching.
Experiment 4: double switch
The data from experiments 1–3 suggest that when control rats learned a task switch, they remembered and implemented that newly learned task 24 h later. If muscimol impaired this memory, then rats should revert to their preswitch task 24 h later. In this case, rats should make fewer errors if tested on the old, preswitch task 24 h after muscimol infusion. In contrast, saline-infused rats should remember the most recently acquired task and therefore make more errors if tested on the old, preswitch task. We tested this hypothesis by switching the contingencies at T = 24 back to the task performed 48 h previously. This testing sequence (switch from task A to B, test 24 h later in task A) will be referred to as a double switch.
Rats from experiment 3 were trained in two more task switches; no infusions were given on switch 2, but were given before switch 3, which was the double switch (Fig. 2). Therefore, the rats tested in the double-switch task had received the same type of training and had the same degree of maze and drug experience as the rats from experiment 1 during their switch 3. This approach allowed the outcome of the double switch to be compared with standard switches in experiment 1. In both experiments, the rats received muscimol or saline before switching, but rats from experiment 1 were tested 24 h later in the same task, whereas rats from experiment 3 were tested on the old task that had been performed 48 h before. A drug by switch type ANOVA tested for effects of drug and type of switch (switch or double switch).
Experiment 4: results
Twenty-four hours after a switch, saline-infused rats followed the task they had acquired most recently, making more errors when tested in the double-switch than in a normal switch. In contrast, muscimol-infused rats followed the task that they had performed 48 h before, making fewer errors in the double-switch than in the normal switch (drug by switch type, F(1,20) = 15.94, p < 0.001) (Fig. 7a). Muscimol thus appeared to impair retention of the most recently acquired task. Improved performance in the double switch also demonstrated that muscimol did not cause a general increase in error rates and did not disrupt task selection in general. Rather, PL/IL inactivation caused a selective deficit in the retention of newly learned tasks. Thus, muscimol and saline infusions differentially affected performance at T = 24 h, depending on whether rats were given a switch or a double switch. As in experiments 1–3, the acquisition of the double switch was unaffected by muscimol (TTC, F(1,20) = 0.031, p = 0.86) errors at T = 0 (F(1,20) = 0.007; p = 0.93).
Experiment 5: double switch, task switching after extensive training
Early in training, rats given saline preferentially followed the most recently acquired task, and muscimol infusions disrupted this behavior (experiment 4). Rats given extensive switch training, however, were unimpaired by muscimol infusion and appeared to treat the task switch differently. To assess whether rats that were highly familiar with task switching relied on PL/IL to retain a switch, the same methods used in experiment 4 were used to test rats from experiment 1 in the double-switch paradigm. After switch 12, task-switching animals (n = 8) from experiment 1 were tested in the double-switch paradigm as described above (experiment 4). Rats were assigned to muscimol and saline cohorts that were counterbalanced for previous drug exposure and taught a 13th switch. At T = 24 h they were tested on the task performed 48 h before (the double switch). t tests compared performance between muscimol and saline groups. Drug cohorts were collapsed to compare performance on switch number 12 (experiment 1) to the double switch at T = 24 h using a paired t test.
Experiment 5: results
All rats given extensive switch training performed well during the double-switch task, in contrast to rats with less switching experience. Rats infused with saline or muscimol that had performed 12 task switches performed similarly in the double switch (T = 24, t(6) = 0.56, p = 0.60) (Fig. 7b), just as the same groups of rats performed similarly during the normal switch 12 (experiment 1, errors at T = 24, t(6) = 1.88, p = 0.11). Because infusions had no effect in either the 12th (normal) or 13th (double) switch, the drug groups were collapsed to compare performance across switch type. Regardless of whether they were tested on the new or old task at T = 24 h, expert rats made few errors (t(7) = 0.154; p = 0.88), suggesting that they relied less on information from the previous day's maze experience to guide task selection. Furthermore, muscimol did not affect this flexible task selection, consistent with the idea that PL/IL inactivation specifically disrupted the memory of the most recent switch.
Discussion
PL/IL inactivation during, but not after, learning impaired the persistence of switches when assessed 24 h later. In contrast, inactivation did not impair switch acquisition, performance in a new task, reversals, or switching between highly familiar tasks. The results confirm past work showing the importance of the PL/IL for efficient task switching, and further suggests that the PFC helps mediate interactions between memory systems.
PL/IL inactivation impairs task switches, but not reversals
Experiment 1 verified that inactivating PL/IL impaired task switching, but not spatial reversals (Ragozzino et al., 1999a,b). Previous studies reported that PL/IL impaired switch acquisition (Ragozzino et al., 1999a,b, 2003), whereas the present results reveal an important contribution to switch maintenance (Ragozzino et al., 1999a,b). Indeed, muscimol did not affect any measure during switch acquisition (supplemental material, available at www.jneurosci.org). The following methodological factors likely explain these apparent discrepancies.
Inactivation method.
Although infusion site and volume were similar, our study injected muscimol, a GABAA agonist that inactivates cell bodies, whereas other studies injected Na+ channel blockers (Ragozzino et al., 1999a,b, 2003), which also inactivate fibers of passage. Whereas the muscimol infusion produced extensive inactivation of PL/IL neurons (supplemental material, available at www.jneurosci.org), Na+ blockers may have produced more extensive inactivation, including disconnection, and greater functional deficits.
Measures of switch acquisition and retention.
In other plus-shaped maze studies, switch acquisition was measured across days and the total number of trials were combined (Ragozzino et al., 1999b). If the rats given PL/IL inactivation and trained across days acquired a switch normally within a session, but the new task was not maintained effectively across days, as we observed, then the total number of trials to criterion would be increased and acquisition would appear impaired (cf. Ragozzino et al., 1999a).
Training protocols.
During switch training, rats started from the same arm repeatedly until two correct responses were made, then the start arm was changed. This procedure increased learning rates (Ragozzino et al., 1999b), perhaps by reducing interference caused by more rapid alternation of start arms. Proactive interference can alter the extent to which the PL/IL contributes to performance (Gisquet-Verrier and Delatour, 2006), and may differentially engage PL/IL function. Nonetheless, rats with PL/IL inactivation eventually acquire task switches (Ragozzino et al., 1999a,b), suggesting that although PL/IL activity may facilitate switching, other brain networks support learning the alternate task (albeit more slowly) without PL/IL input. The present data demonstrate that even when rats acquired and performed a switch normally, PL/IL activity influenced how the alternate task was learned, so that with normal function, the task switch was learned and remembered; with PL/IL inactivated, the task was learned, but not retained 24 h later.
Repeated task switching alters behavioral tactics
Performance improved over the course of 12 switches or reversals, so that both saline- and muscimol-infused rats acquired the alternate task faster and made fewer errors 24 h later. Muscimol effectively inactivated PL/IL even after repeated drug infusions and chronic cannulation (experiment 2), indicating that improved performance resulted from task-switching experience itself, and this experience influenced the tactical use of memory to select among familiar tasks (experiments 4 and 5). Early in training through switch 3, behavior was guided by memory for the task that was successful the day before. This memory-based approach was suggested by the good performance of control rats at T = 24 in experiment 1, and confirmed by poor performance in the double switch. At T = 24 in the double-switch, the previous day's task (e.g., “go to the north arm”) was incorrect, whereas the task from 48 h before (e.g., “turn right”) was correct. Remembering the most recently successful task would lead to perseverative errors (going north rather than turning right). But, if memory for the previous day's task (“go north”) were impaired by muscimol, while memory for the task performed 48 h earlier (“turn right”) remained intact, then muscimol should facilitate performance at 24 h in the double switch. Indeed, control rats made more errors than rats given muscimol. Thus, early in training, memory for the most recently successful task guided discriminative behavior.
Later in training, however, both groups performed well in the double switch. Rather than memory, immediate task contingencies seemed to guide behavior (experiment 5). This shift may reflect the rats' learning that tasks changed frequently across days, but only among two familiar tasks. Thus, rats may have tested each of the two tasks and rapidly adopted the successful one. Such a strategy would support high performance levels whether rats were tested in a standard or double switch, precisely as observed. Alternatively, repeated switches between two tasks may produce proactive interference, so that remembering the most recent task becomes more difficult than testing each until the correct one is verified. In either case, switching flexibly between two highly familiar tasks did not require PL/IL activity, as muscimol did not impair either standard or double switches late in training. Thus, between switch 3 and 12, rats acquired a new tactic for task selection. Converging evidence from the decreased effect of PL/IL inactivation, which also occurred between switch 3 and 12, is consistent with this hypothesis. Although these experiments cannot determine causation, they suggest that this new strategy eliminated the need for PL/IL activity in the task. PL/IL inactivation only impaired behavior that was guided by memory for the most recent task switch.
PL/IL function, task switching, and multiple memory systems
Converging data indicate that multiple brain systems contribute to task switching. PL/IL activity (1) is not required for acquiring or performing either the place or response task (Ragozzino et al., 1999b), (2) facilitates switch acquisition during learning (Ragozzino et al., 1999b) and persistence of that learning, and (3) is unlikely to store task memory, because previously learned tasks are unaffected by inactivation. Thus, PL/IL activity likely influences information processing and storage elsewhere. The hippocampal system is required for spatial and episodic-like memory and for performing the place task in the plus-shaped maze (O'Keefe, 1976; McDonald and White, 1993), whereas the dorsal striatal system is required for egocentric and cue-approach memory, and supports the response task (Cook and Kesner, 1988; Packard and McGaugh, 1996). The two memory systems normally function in parallel, and the plus-shaped maze can produce competition between them (White and McDonald, 2002). Indeed, hippocampal inactivation can facilitate dorsal-striatal learning (Chang and Gold, 2003). Switching, for example, from place to response should reduce the relative influence of hippocampal processing and increase that of dorsal striatal processing on ongoing behavior. PL/IL activity may contribute to this modulation.
Reciprocal connectivity between the PL/IL and both the hippocampus and the striatum could support functional modulation of memory systems in a manner analogous to Fuster's perception-action cycle (Fuster, 1995). The PL/IL receives direct afferents from the hippocampus (Jay et al., 1989; Jay and Witter, 1991; Conde et al., 1995) and innervates the hippocampal system via the nucleus reunions (Wouterlood et al., 1990; Wouterlood, 1991; Vertes, 2002; Vertes et al., 2006). The PL/IL is also interconnected with many regions of the striatum via corticostriatal loops (Groenewegen et al., 1990; Berendse et al., 1992). The PFC is thereby well situated to modulate each system. To perform such a function, the PL/IL should integrate afferent activity from these systems with reward information. The PL/IL is innervated by dopaminergic (DA) fibers from the ventral tegmental area (Fuxe et al., 1974; Lindvall et al., 1974; Berger et al., 1976; Descarries et al., 1987), and blockade of certain DA receptors in the PL/IL has the same effect as inactivation on task switching (Ragozzino, 2002; Floresco et al., 2006). DA release can reflect both unexpected reward and the absence of expected reward (Schultz, 1997, 2006), and could thereby “gate” (O'Reilly et al., 2002) PL/IL responses to other afferents. PL/IL efferents may then alter activity in different memory systems, either directly or via modification of cortical or subcortical afferents. Such a mechanism could allow PL/IL output to correlate reward information with hippocampal and striatal input, and coordinate these systems toward optimal task performance, either inhibiting brain systems that model task contingencies poorly, increasing activity in networks that optimize task contingencies, or both.
This view suggests that without competition between brain systems, PL/IL activity would be irrelevant, for example, when learning an initial task or adapting to a new contingency using the same memory system, as in reversals. Neither initial task learning nor the acquisition or maintenance of reversals are impaired by PL/IL inactivation (Ragozzino et al., 1999a,b, 2003; Chudasama et al., 2001). Conversely, the orbitofrontal cortex (OFC) contributes to task reversals (Schoenbaum et al., 2002; McAlonan and Brown, 2003), suggesting that the OFC may bias subnetworks within systems. IL inactivation also impairs the persistence, but not the acquisition, of conditioned fear extinction after the same temporal pattern described here for task switching (Morgan et al., 1993; Quirk et al., 2000; Lebron et al., 2004; Sierra-Mercado et al., 2006). These effects are mediated by IL-enhanced inhibition of amygdala circuits (Milad and Quirk, 2002; Quirk et al., 2003). Thus, both extinction of conditioned fear and task switching may exemplify dynamically guided activation (Miller and Cohen, 2001), in which neuronal signals from the PL/IL integrate and modulate other brain systems to help organize behaviors that best predict task contingencies.
Conclusions
The PL/IL contributes to the maintenance of task switches, perhaps by modulating activity between memory systems. Future investigations should assess differential PL and IL contributions to switching, and probe interactions between the PL, IL, hippocampus, and striatum. This paradigm is ideal for such investigations, because the brain systems supporting place and response tasks are dissociable and relatively well understood.
Footnotes
This work was supported by National Institutes of Health Grants MH65658, MH073689, and MH077431, and the Mount Sinai School of Medicine. We thank Janina Ferbinteanu, Pam Kennedy, and Jake Young for comments on a previous draft and Anna Balk for computer programming.
References
- Berendse HW, Galis-de Graaf Y, Groenewegen HJ. Topographical organization and relationship with ventral striatal compartments of prefrontal corticostriatal projections in the rat. J Comp Neurol. 1992;316:314–347. doi: 10.1002/cne.903160305. [DOI] [PubMed] [Google Scholar]
- Berger B, Thierry AM, Tassin JP, Moyne MA. Dopaminergic innervation of the rat prefrontal cortex: a fluorescence histochemical study. Brain Res. 1976;106:133–145. doi: 10.1016/0006-8993(76)90078-0. [DOI] [PubMed] [Google Scholar]
- Brown VJ, Bowman EM. Rodent models of prefrontal cortical function. Trends Neurosci. 2002;25:340–343. doi: 10.1016/s0166-2236(02)02164-1. [DOI] [PubMed] [Google Scholar]
- Chang Q, Gold PE. Intra-hippocampal lidocaine injections impair acquisition of a place task and facilitate acquisition of a response task in rats. Behav Brain Res. 2003;144:19–24. doi: 10.1016/s0166-4328(03)00063-9. [DOI] [PubMed] [Google Scholar]
- Chudasama Y, Bussey TJ, Muir JL. Effects of selective thalamic and prelimbic cortex lesions on two types of visual discrimination and reversal learning. Eur J Neurosci. 2001;14:1009–1020. doi: 10.1046/j.0953-816x.2001.01607.x. [DOI] [PubMed] [Google Scholar]
- Conde F, Maire-Lepoivre E, Audinat E, Crepel F. Afferent connections of the medial frontal cortex of the rat. II. Cortical and subcortical afferents. J Comp Neurol. 1995;352:567–593. doi: 10.1002/cne.903520407. [DOI] [PubMed] [Google Scholar]
- Cook D, Kesner RP. Caudate nucleus and memory for egocentric localization. Behav Neural Biol. 1988;49:332–343. doi: 10.1016/s0163-1047(88)90338-x. [DOI] [PubMed] [Google Scholar]
- Descarries L, Lemay B, Doucet G, Berger B. Regional and laminar density of the dopamine innervation in adult rat cerebral cortex. Neuroscience. 1987;21:807–824. doi: 10.1016/0306-4522(87)90038-8. [DOI] [PubMed] [Google Scholar]
- Drewe EA. The effect of type and area of brain lesion on Wisconsin card sorting test performance. Cortex. 1974;10:159–170. doi: 10.1016/s0010-9452(74)80006-7. [DOI] [PubMed] [Google Scholar]
- Floresco SB, Magyar O, Ghods-Sharifi S, Vexelman C, Tse MT. Multiple dopamine receptor subtypes in the medial prefrontal cortex of the rat regulate set-shifting. Neuropsychopharmacology. 2006;31:297–309. doi: 10.1038/sj.npp.1300825. [DOI] [PubMed] [Google Scholar]
- Fuster JM. Cambridge, MA: MIT; 1995. Memory in the cerebral cortex: an empirical approach to neural networks in the human and nonhuman primate. [Google Scholar]
- Fuxe K, Hokfelt T, Johansson O, Jonsson G, Lindbrink P, Ljundahl A. The origin of the dopamine nerve terminals in limbic and frontal cortex. Evidence for meso-cortico dopamine neurons. Brain Res. 1974;82:349–355. doi: 10.1016/0006-8993(74)90618-0. [DOI] [PubMed] [Google Scholar]
- Gisquet-Verrier P, Delatour B. The role of the rat prelimbic/infralimbic cortex in working memory: not involved in the short-term maintenance but in monitoring and processing functions. Neuroscience. 2006;141:585–596. doi: 10.1016/j.neuroscience.2006.04.009. [DOI] [PubMed] [Google Scholar]
- Givens B, Olton DS. Local modulation of basal forebrain: effects on working and reference memory. J Neurosci. 1994;14:3578–3587. doi: 10.1523/JNEUROSCI.14-06-03578.1994. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Groenewegen HJ, Berendse HW, Wolters JG, Lohman AH. The anatomical relationship of the prefrontal cortex with the striatopallidal system, the thalamus and the amygdala: evidence for a parallel organization. Prog Brain Res. 1990;85:95–116. doi: 10.1016/s0079-6123(08)62677-1. [DOI] [PubMed] [Google Scholar]
- Jay TM, Witter MP. Distribution of hippocampal CA1 and subicular efferents in the prefrontal cortex of the rat studied by means of anterograde transport of Phaseolus vulgaris-leucoagglutinin. J Comp Neurol. 1991;313:574–586. doi: 10.1002/cne.903130404. [DOI] [PubMed] [Google Scholar]
- Jay TM, Glowinski J, Thierry AM. Selectivity of the hippocampal projection to the prelimbic area of the prefrontal cortex in the rat. Brain Res. 1989;505:337–340. doi: 10.1016/0006-8993(89)91464-9. [DOI] [PubMed] [Google Scholar]
- Lebron K, Milad MR, Quirk GJ. Delayed recall of fear extinction in rats with lesions of ventral medial prefrontal cortex. Learn Mem. 2004;11:544–548. doi: 10.1101/lm.78604. [DOI] [PubMed] [Google Scholar]
- Lindvall O, Bjorklund A, Moore R, Stenevi U. Mesencephalic dopamine neurons projecting to neocortex. Brain Res. 1974;81:325–331. doi: 10.1016/0006-8993(74)90947-0. [DOI] [PubMed] [Google Scholar]
- Lomber SG. The advantages and limitations of permanent or reversible deactivation techniques in the assessment of neural function. J Neurosci Methods. 1999;86:109–117. doi: 10.1016/s0165-0270(98)00160-5. [DOI] [PubMed] [Google Scholar]
- McAlonan K, Brown VJ. Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat. Behav Brain Res. 2003;146:97–103. doi: 10.1016/j.bbr.2003.09.019. [DOI] [PubMed] [Google Scholar]
- McDonald RJ, White NM. A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. Behav Neurosci. 1993;107:3–22. doi: 10.1037//0735-7044.107.1.3. [DOI] [PubMed] [Google Scholar]
- Milad MR, Quirk GJ. Neurons in medial prefrontal cortex signal memory for fear extinction. Nature. 2002;420:70–74. doi: 10.1038/nature01138. [DOI] [PubMed] [Google Scholar]
- Miller EK, Cohen JD. An integrative theory of prefrontal cortex function. Annu Rev Neurosci. 2001;24:167–202. doi: 10.1146/annurev.neuro.24.1.167. [DOI] [PubMed] [Google Scholar]
- Milner B. Some cognitive effects of frontal-lobe lesions in man. Philos Trans R Soc Lond B Biol Sci. 1982;298:211–226. doi: 10.1098/rstb.1982.0083. [DOI] [PubMed] [Google Scholar]
- Morgan MA, Romanski LM, LeDoux JE. Extinction of emotional learning: contribution of medial prefrontal cortex. Neurosci Lett. 1993;163:109–113. doi: 10.1016/0304-3940(93)90241-c. [DOI] [PubMed] [Google Scholar]
- Nauta WJ. The problem of the frontal lobe: a reinterpretation. J Psychiatr Res. 1971;8:167–187. doi: 10.1016/0022-3956(71)90017-3. [DOI] [PubMed] [Google Scholar]
- O'Keefe J. Place units in the hippocampus of the freely moving rat. Exp Neurol. 1976;51:78–109. doi: 10.1016/0014-4886(76)90055-8. [DOI] [PubMed] [Google Scholar]
- O'Reilly RC, Noelle DC, Braver TS, Cohen JD. Prefrontal cortex and dynamic categorization tasks: representational organization and neuromodulatory control. Cereb Cortex. 2002;12:246–257. doi: 10.1093/cercor/12.3.246. [DOI] [PubMed] [Google Scholar]
- Owen AM, Roberts AC, Polkey CE, Sahakian BJ, Robbins TW. Extra-dimensional versus intra-dimensional set shifting performance following frontal lobe excisions, temporal lobe excisions or amygdalo-hippocampectomy in man. Neuropsychologia. 1991;29:993–1006. doi: 10.1016/0028-3932(91)90063-e. [DOI] [PubMed] [Google Scholar]
- Packard MG, McGaugh JL. Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol Learn Mem. 1996;65:65–72. doi: 10.1006/nlme.1996.0007. [DOI] [PubMed] [Google Scholar]
- Paxinos GW. Sydney: Academic; 1986. The rat brain in stereotaxic coordinates. [Google Scholar]
- Pruess TM. Do rats have a prefrontal cortex? The Rose-Woolsey-Akert program reconsidered. J Cogn Neurosci. 1995;7:1–24. doi: 10.1162/jocn.1995.7.1.1. [DOI] [PubMed] [Google Scholar]
- Ptak R, Schnider A. Disorganised memory after right dorsolateral prefrontal damage. Neurocase. 2004;10:52–59. doi: 10.1080/13554790490960495. [DOI] [PubMed] [Google Scholar]
- Quirk GJ, Russo GK, Barron JL, Lebron K. The role of ventromedial prefrontal cortex in the recovery of extinguished fear. J Neurosci. 2000;20:6225–6231. doi: 10.1523/JNEUROSCI.20-16-06225.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Quirk GJ, Likhtik E, Pelletier JG, Pare D. Stimulation of medial prefrontal cortex decreases the responsiveness of central amygdala output neurons. J Neurosci. 2003;23:8800–8807. doi: 10.1523/JNEUROSCI.23-25-08800.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ragozzino ME. The effects of dopamine D(1) receptor blockade in the prelimbic-infralimbic areas on behavioral flexibility. Learn Mem. 2002;9:18–28. doi: 10.1101/lm.45802. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ragozzino ME, Wilcox C, Raso M, Kesner RP. Involvement of rodent prefrontal cortex subregions in strategy switching. Behav Neurosci. 1999a;113:32–41. doi: 10.1037//0735-7044.113.1.32. [DOI] [PubMed] [Google Scholar]
- Ragozzino ME, Detrick S, Kesner RP. Involvement of the prelimbic-infralimbic areas of the rodent prefrontal cortex in behavioral flexibility for place and response learning. J Neurosci. 1999b;19:4585–4594. doi: 10.1523/JNEUROSCI.19-11-04585.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ragozzino ME, Kim J, Hassert D, Minniti N, Kiang C. The contribution of the rat prelimbic-infralimbic areas to different forms of task switching. Behav Neurosci. 2003;117:1054–1065. doi: 10.1037/0735-7044.117.5.1054. [DOI] [PubMed] [Google Scholar]
- Robinson AL, Heaton RK, Lehman RA, Stilson DW. The utility of the Wisconsin Card Sorting Test in detecting and localizing frontal lobe lesions. J Consult Clin Psychol. 1980;48:605–614. doi: 10.1037//0022-006x.48.5.605. [DOI] [PubMed] [Google Scholar]
- Schoenbaum G, Nugent SL, Saddoris MP, Setlow B. Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. NeuroReport. 2002;13:885–890. doi: 10.1097/00001756-200205070-00030. [DOI] [PubMed] [Google Scholar]
- Schultz W. Dopamine neurons and their role in reward mechanisms. Curr Opin Neurobiol. 1997;7:191–197. doi: 10.1016/s0959-4388(97)80007-4. [DOI] [PubMed] [Google Scholar]
- Schultz W. Behavioral theories and the neurophysiology of reward. Annu Rev Psychol. 2006;57:87–115. doi: 10.1146/annurev.psych.56.091103.070229. [DOI] [PubMed] [Google Scholar]
- Sierra-Mercado D, Jr, Corcoran KA, Lebron-Milad K, Quirk GJ. Inactivation of the ventromedial prefrontal cortex reduces expression of conditioned fear and impairs subsequent recall of extinction. Eur J Neurosci. 2006;24:1751–1758. doi: 10.1111/j.1460-9568.2006.05014.x. [DOI] [PubMed] [Google Scholar]
- Stuss DT, Levine B, Alexander MP, Hong J, Palumbo C, Hamer L, Murphy KJ, Izukawa D. Wisconsin Card Sorting Test performance in patients with focal frontal and posterior brain damage: effects of lesion location and test structure on separable cognitive processes. Neuropsychologia. 2000;38:388–402. doi: 10.1016/s0028-3932(99)00093-7. [DOI] [PubMed] [Google Scholar]
- Uylings HB, Groenewegen HJ, Kolb B. Do rats have a prefrontal cortex? Behav Brain Res. 2003;146:3–17. doi: 10.1016/j.bbr.2003.09.028. [DOI] [PubMed] [Google Scholar]
- Vertes RP. Analysis of projections from the medial prefrontal cortex to the thalamus in the rat, with emphasis on nucleus reuniens. J Comp Neurol. 2002;442:163–187. doi: 10.1002/cne.10083. [DOI] [PubMed] [Google Scholar]
- Vertes RP, Hoover WB, Do Valle AC, Sherman A, Rodriguez JJ. Efferent projections of reuniens and rhomboid nuclei of the thalamus in the rat. J Comp Neurol. 2006;499:768–796. doi: 10.1002/cne.21135. [DOI] [PubMed] [Google Scholar]
- White NM, McDonald RJ. Multiple parallel memory systems in the brain of the rat. Neurobiol Learn Mem. 2002;77:125–184. doi: 10.1006/nlme.2001.4008. [DOI] [PubMed] [Google Scholar]
- Wouterlood FG. Innervation of entorhinal principal cells by neurons of the nucleus reuniens thalami. anterograde PHA-L tracing combined with retrograde fluorescent tracing and intracellular injection with lucifer yellow in the rat. Eur J Neurosci. 1991;3:641–647. doi: 10.1111/j.1460-9568.1991.tb00850.x. [DOI] [PubMed] [Google Scholar]
- Wouterlood FG, Saldana E, Witter MP. Projection from the nucleus reuniens thalami to the hippocampal region: light and electron microscopic tracing study in the rat with the anterograde tracer phaseolus vulgaris-leucoagglutinin. J Comp Neurol. 1990;296:179–203. doi: 10.1002/cne.902960202. [DOI] [PubMed] [Google Scholar]