Abstract
Free-flying honeybees (Apis mellifera carnica) are known to learn the context to solve discrimination tasks. Here we apply classical conditioning of the proboscis extension response in restrained bees in combination with single-unit extracellular recordings from mushroom body (MB) extrinsic neurons elucidating the neural correlates of context-dependent olfactory discrimination. The contexts were light, colors, and temperatures, either alone or in combination. We found that bees learn context rules quickly and use them for better discrimination. They also solved a transwitching and a cue/context reversal task. Neurons extrinsic to the α lobe of the MB reduced the responses to the rewarded odor, whereas they increased their responses to the context. These results indicate that MB extrinsic neurons encode cues and contexts differently. Data are discussed with reference to MB function.
Introduction
An animal conditioned to respond to a cue (e.g., odor) in presence of a reinforcer such as food also learns the contexts and conditions, such as time of day, temperature, and visual stimuli. Rescorla (1972) argued that all stimuli present at the occurrence of the reinforcer are associated separately with the reinforcer, whereas Pearce (1994) favored the idea that co-occurring stimuli should be treated as unique combinations or configurations that are distinct from the elements. Elucidation of neural processing of cues and contexts may help to resolve this issue. Novel cues occur mostly in a precisely defined temporal manner along with the reward, whereas context stimuli are mostly present for longer periods of time and help to acquire and recall relevant memory. For example, in a study in humans, pairs of words were found to be best recalled under contexts similar to when learning occurred (Tulving and Thomson, 1973), and many studies with animals have documented context-specific memory formation and retrieval (Odling-Smee, 1975; Riccio et al., 1992; González et al., 2003; Matsumoto et al., 2004; Sato et al., 2006). In mammals, it has been shown that context-dependent learning depends on the hippocampus (Hirsh, 1974; Kesner et al., 1983; Phillips and LeDoux, 1992), whereas cued learning does not require the hippocampus (Hirsh, 1974; Gaskin et al., 2005), favoring the concept that cues and contexts are processed separately. It is also generally agreed that context-dependent learning is a more complex task requiring at least basic cognitive abilities (Cohen et al., 1999; Umbricht et al., 2000).
Free-flying bees differentiate between color cues, visual patterns, and directions of flights depending on where and when these cues were learned (von Frisch, 1967; Menzel and Giurfa, 2001; Menzel, 2007). Restrained bees conditioned to an odor in the presence of another odor learn both the elements of these configural stimuli and the unique cue (Gerber and Menzel, 2000; Deisig et al., 2003). Although bees do not show conditioned responses to the visual stimuli, their responses to the olfactory stimuli are enhanced for the learned combination of olfactory cue and visual context, indicating that the visual stimuli are associatively linked to the reward facilitating memory (Gerber and Smith, 1998).
To understand the neural mechanisms underlying context-dependent learning, we looked at mushroom body (MB) extrinsic neurons and focused on those exiting the α lobe (αL) at the β exit (Rybak and Menzel, 1993). MBs are high-order integration centers of the insect brain known to be involved in learning and memory formation (Heisenberg, 2003; Davis, 2011; Menzel, 2012). The αL output neurons receive input from MB intrinsic neurons, the Kenyon cells, which in turn receive inputs from various sensory modalities, such as visual, tactile, and olfactory (Gronenberg, 1986; Rybak and Menzel, 1993).
Our aim was to unravel whether MB β neurons change their responses differently for cue and context. Behavioral experiments helped us to optimize the context-dependent learning protocol that was then combined with single-unit extracellular recordings of MB β neurons.
Materials and Methods
We custom built a setup for context-dependent learning (Fig. 1) that consisted of three parts. (1) An odor delivery device (hereafter referred to as olfactometer) blew continuous stream of air over the bee's antennae and delivered odors with precise timing (Galizia et al., 1997; Komischke et al., 2002). (2) A light source with flexible light guides (KL 1500 LCD; Schott) illuminated the reflective paper placed in front of the honeybee. Two color filters (Tokyo blue #071, transmission maximum at 460 nm; and Medium yellow #010, transmission at >540 nm; Roscoe) were used as color contexts by inserting them into the filter slide of the light source. (3) A heating/cooling device was built to deliver hot (up to 34°C) or cold (up to 18°C) air.
Foraging (female) honeybees (Apis mellifera carnica) were caught at the entrance of the hives 24 h before an experiment. They were fed 30% sucrose solution and kept overnight under 12 h light/dark cycle in a humid box at ∼25–27°C. The next day they were cold anesthetized on ice and fixed inside plastic restraining tubes such that only the mandibles, proboscis, and antennae could move freely (Bitterman et al., 1983). For electrophysiological experiments, the scapes of the antennae were fixed onto the head using the low-temperature melting wax eicosane (Sigma) such that only the flagellae could move.
Bees were first tested for the proboscis extension response (PER) 10 min before the beginning of the conditioning procedure by touching the antennae with 30% sucrose solution, the unconditioned stimulus (US). Only bees that demonstrated the unconditioned response (UR) were used for the experiment (<5% were discarded). Three chemicals, 2-octanol, limonene, and peppermint, were used as odor stimuli [conditioned stimulus (CS)]. Light (bright and dark), color (yellow and blue), and temperature (hot and cold) were used as context stimuli. Bees were conditioned by presenting them with odors in the presence of one or a combination of two context stimuli. An experiment consisted of five conditioning trials and one or more test trials (extinction trial) at different intervals after the last trial. At the end of the experiment, bees were tested for UR, and only those that responded were used for analysis. Response to odors (PER) were entered into a Microsoft Excel spreadsheet for analysis.
Electrophysiology.
Custom-made copper wire electrodes were made as described previously (Mizunami et al., 1998; Okada et al., 1999, 2007). In short, two 14 μm copper wires (Electrisola) were glued together and served as differential electrodes. Additionally, two 100 μm silver wires were also used. All wires were connected to the differential four-channel amplifier (A-M Systems).
A restrained bee was placed under a microscope and dissected by cutting a rectangular window into the head capsule between the two compound eyes and between ocelli and antenna exposing the brain. One silver wire was inserted into the posterior eye region of the bee, which served as the ground electrode. A second silver wire was inserted between ocelli and eyes on the back of the head and recorded the activity of the M17 muscle, which fires when the bee extends its proboscis. The differential electrode was lowered into the brain at the ventral aspect of the MB αL (β exit) using a micromanipulator. The electrode was lowered carefully until 150 μm when action potentials appeared. The position of the electrode was manipulated until the signal-to-noise ratio of the neuron was at least 2. The odors (2-octanol, limonene, and peppermint) were puffed on the bee. Only those neurons that fired in response to all three odors were taken for analysis. To keep the recording stable, silicone gel (WPI) was added to the brain.
A differential amplifier (A-M Systems) was used to amplify the signals and filter them between 10 Hz and 10 kHz. Spike2 signal processing software (Cambridge Electronics Design) was used to acquire the recordings to the personal computer. Spike2 was also used to control olfactometer via computer keyboard. All recordings were passed through a digital filter of Spike2 to reduce fluctuations and improve signal-to-noise quality.
The resulting units were sorted with the Spike2 template matching tool to separate different units. After spike sorting, units were proof checked by overlapping all similar spikes, and if necessary they were manually separated. All spikes, including spike timing, odor markers, and context markers, were exported to a text file for analysis. During the recording, the amplitudes of the spikes varied considerably, but the template sorting method in Spike2 software was flexible enough for us to specify separate templates for increasing set of spikes and decreasing set of spikes. This ensured that all spikes were included in the analysis.
The neurons chosen for analysis were consistent in the following ways. They were recorded from the right αL of the MB β exit with electrode positioned close (±50 μm) to the same location on the surface of the brain before lowering. Only neurons between the depths of 170 and 210 μm from the surface of the brain were sampled and used for analysis. The spikes had an initial positive potential reaching a crest followed by a negative potential reaching a trough, and the crest-to-trough times for most neurons analyzed were between 1200 and 2200 Hz. All neurons responded to the three odors: 2-octanol, limonene, and peppermint. Based on the above criteria, neurons were pooled together for analysis.
For calculating the responses of the neurons, number of spikes before and after the onset of odor and context were quantified. The following spikes were counted to normalize the firing rate: (1) 1 s before odor onset (spontaneous spike activity); (2) 1 s after odor onset (odor-induced spike activity); (3) 5 s before the context onset (spontaneous spike activity); and (4) 5 s after context onset (context-induced spike activity). Odor-induced spike activity was normalized by taking the ratio between odor-induced spikes (2) and spontaneous spikes (1), and context-induced spike activity was normalized by taking the ratio between context-induced spikes (4) and spontaneous spikes (3). Both preconditioning and postconditioning spikes were normalized. We defined spike firing rate (ΔSFR) as the change in firing rate from preconditioning to postconditioning toward an odor or a context divided by total firing rate:
A positive ΔSFR means increased neuronal firing, a negative ΔSFR means decreased neuronal firing, and ΔSFR = 0 means no change in neuronal firing from preconditioning phase to postconditioning phase.
Statistics.
All statistics were performed on Prism and R statistical and programming software. Shapiro–Wilk normality test was used to determine normality of data. For behavioral data, G test and Cochran's Q test were used. For electrophysiology data, two-way repeated-measures ANOVA with Tukey's posttest, one sample t test, and Pearson's product moment correlation coefficients were used. Plots were made using Microsoft Excel spreadsheet.
Results
Bees show context-dependent learning
To address the question whether bees learn the contexts in our test conditions, we presented the bees with two contexts and two odors. In context 1, only odor A was rewarded and odor B not rewarded, and in context 2, neither odors A and B were rewarded. The two contexts were bright (white light) and dark (no light). Note that, in the dark context, a red light was used (wavelength, 630 nm) that was beyond the visible spectrum of bees' vision. The rewarded odors are indicated by the + symbol and unrewarded odors by the − symbol. Each conditioning trial lasted for 10 min (Fig. 2A). A trial started with an onset of first context (context 1) followed by the first odor (A+) 1 min later, which was puffed onto the bee's antennae for 4 s with an overlap of 1 s with 3 s sucrose reward (US). After 2.5 min, a second odor (B−) was puffed onto the antennae but without the US. Immediately after the offset of context 1, a second context (context 2) was turned on. After 1 min, odor A− was puffed without any reward, and 2.5 min later, odor B− was also puffed without any reinforcing reward. The trial ended with the offset of context 2. Each trial consisted of two 5 min contexts. After 5 such conditioning trials, a sixth trial, the test or extinction trial, was presented to the bees without any US. The sequence of contexts, odors, and rewards were changed in every experiment. In the control experiment, bees were subjected to the same sequence of odors and contexts but without any sucrose reward.
When bees learned an odor, they responded to the odor puff by extending their proboscises in anticipation of sugar reward. We used “1” or “0” to indicate a response or a no response of the bees toward an odor. For example, A1 B0 means that bees responded (extended their proboscises) to odor A and did not respond (did not extend their proboscises) to odor B. The expected response toward odors A+ B− in context 1 was A1 B0 and toward odors A− B− in context 2 was A0 B0 (Table 1). To test how many bees correctly learned the rewarded context and not the unrewarded context, we calculated the percentage of bees showing A1 B0 in context 1 and A0 B0 in context 2. Initially, bees generalized toward the rewarded odor A (Fig. 2B, green curve) but quickly learned the context rule and showed higher response toward odor A only in context 1. By the end of the final test trial, bees learned both light and dark contexts (Fig. 2B, light and dark blue, respectively), successfully showing significantly higher responses (G test: light, G = 12.62, p < 0.01; dark, G = 5.43, p < 0.05) compared with the control group (gray). Although the bees showed better context discrimination with light context (58%) compared with dark context (44%), this was not significant. Response toward unrewarded odor B was always <20% (data not shown). Also, control bees that were placed in both contexts and puffed with same sequence of odors but without rewards showed <20% response (gray curve).
Table 1.
Context 1: A+ B− | Context 2: A− B− | |
---|---|---|
Context learning | A1 B0 | A0 B0 |
Generalization | A1 B0 | A1 B0 |
A1 B1 | A1 B1 | |
No learning | A0 B0 | A0 B0 |
A+ means that odor A was rewarded, and B− means that odor B was not rewarded. A1 means response toward odor A, and B0 means no response toward odor B. The expected response toward A+ B− in context 1 was A1 B0 and toward A− B− in context 2 was A0 B0. Bees that showed these responses were known to have learned the contexts correctly. Bees that showed same response (A1 B0 or A1 B1) in both contexts were known to generalize. Bees that did not learn the context showed no response (A0 B0).
Bees learn an odor reversal rule during context-dependent learning
Next we tested whether bees could reverse a previously acquired learning rule, a more complex form of learning, in which they had to reverse their responses toward the rewarded odors depending on the context. For example, in context 1, odor A was rewarded and odor B was not rewarded (A+ B−), whereas in context 2, odor A was not rewarded and odor B was rewarded (A− B+). Bees that learned this reversal rule extended their proboscises toward odor A in context 1 and toward odor B in context 2. In other words, the expected response was A1 B0 for context 1 and A0 B1 for context 2. To test reversal learning in bees toward context 1 versus context 2, we used four context groups: for group 1 (color), blue versus yellow; for group 2 (low temperature range), 26°C versus 32°C; for group 3 (high temperature range), 19°C versus 32°C; and group 4 (color + high temperature range), yellow + 32°C versus blue + 19°C. The bees were randomly allocated to one of the four groups. Each group was conditioned to two odors in the presence of two contexts using the differential conditioning paradigm.
One conditioning trial lasted ∼10 min with 5 min for each context (Fig. 3A). The experiment started with the onset of the first context (context 1): after 1 min, the first odor (A+) was puffed on to the antennae for 4 s with an overlap of 1 s with 3 s sucrose reward (US). After 2.5 min, a second odor (B−) was puffed on to the antennae without reward. After 1 min, context 1 was turned off and immediately the second context (context 2) was turned on. After 1 min, odor B+ was puffed on to the antennae followed by the US, and after 2.5 min, odor A− was puffed on to the antennae without US. The conditioning trial ended with the offset of context 2. Therefore, each conditioning trial consisted of two contexts with four odor presentations in which two different odors were rewarded in two different contexts. After five conditioning trials, a final test trial was presented without any reward (extinction trial). Each of the four groups had a control in which odors and contexts were presented in the exact same sequence but without any reward. In all experiments, the orders of context and odor presentations were changed.
The purpose of this experiment was to determine whether contexts provide suitable information for the bees to be able to tell apart whether an odor is rewarded or not. The criteria were based on the successful prediction of bees to foresee an oncoming reward based on context alone. If bees were successful in predicting that a particular odor precedes a reward in one context while not in other context, then we called it a partial reversal. If bees could correctly predict oncoming rewards for both odors in both contexts, then we called it a complete reversal. If they showed the exact same response in both contexts, then we called it generalization.
Based on the PER displayed by each bee at the end of each trial, responses were grouped (Table 2) as complete reversal, partial reversal, generalization, and no learning. For complete reversal, bees learned to reverse their responses based on the context. They showed response A1 B0 toward A+ B− odors in context 1 and response A0 B1 toward A− B+ odors in context 2. For partial reversal, bees showed reversal only partially as they responded toward rewarded odors or did not respond toward unrewarded odors only in one of the two contexts. It was clear from their responses that they recognized the odors as differently rewarded CSs in the two different contexts, for example, A1 B0 toward A+ B− in context 1 and A0 B0 toward A− B+ in context 2 (for other possible responses, see Table 1). When bees generalized, they extended their proboscises toward the same odors or all odors in both the contexts. Here the bees never learned that two contexts were different, for example, A1 B1 toward A+ B− in context 1 and A1 B1 toward A− B+ in context 2. Bees that did not learn at all showed A0 B0 response in both contexts. Finally, control bees that were tested with only odors (no reward throughout the training) also showed A0 B0 response.
Table 2.
Context 1: A+ B− | Context 2: A− B+ | |
---|---|---|
Complete reversal | A1 B0 | A0 B1 |
Partial reversal | A1 B0 | A0 B0 |
A1 B0 | A1 B1 | |
A1 B1 | A0 B0 | |
Generalization | A1 B0 | A1 B0 |
A1 B1 | A1 B1 | |
No learning | A0 B0 | A0 B0 |
A+ means that A odor was rewarded, and B− means that B odor was not rewarded. A1 means response toward odor A, and B0 means no response toward odor B. The expected response after context learning (Fig. 3A) toward A+ B− was A1 B0 in context 1 and toward A− B+ was A0 B1 in context 2. This is complete reversal. Apart from this, bees also showed partial reversal with correct responses only in one of two contexts. Bees also showed generalization with same responses in both contexts (A1 B0 or A1B1). Finally, bees that did not learn either context showed no response (A0 B0).
Among the four groups [blue vs yellow (group 1), 26°C vs 32°C (group 2), 19°C vs 32°C (group 3), and yellow + 32°C vs blue + 19°C (group 4)], group 1 bees responded gradually during the conditioning, and at the end of conditioning, 35% of the bees showed partial reversal (Fig. 3B) and 7% showed complete reversal (Fig. 3C). The yellow color served as a more salient context than the blue color. Generalization was 47%. Group 2 bees showed the lowest response of all groups at the final test trial. After six trials of 26°C and six trials of 32°C, 30% of bees showed partial reversal and none of the bees showed complete reversal. Also ∼52% of the bees showed generalization (Fig. 3D). In group 3, the response toward the rewarded context increased gradually to 45% until the fourth trial and dropped to 35%. Response was stronger during the 32°C context compared with 19°C context. After conditioning, nearly 39% of the bees showed partial reversal and 5% of the bees showed complete reversal. Generalization was 41%. Group 4 bees showed the highest response. During the conditioning trials, nearly 55% of the bees showed partial reversal in the third trial but dropped to 42% at the fifth trial. Like in the group 3 bees, responses were stronger toward 32°C context compared with 19°C context. After conditioning the responses increased slightly to 47%. Also, ∼15% of the bees showed complete reversal. Generalization was 36%. Each of the above groups had controls that were presented with contexts and puffed with odors but without any reward. None of the groups showed complete reversal, and partial reversal was below 10%. Partial and complete reversals in all groups 1–4 were significantly higher than their respective unrewarded groups (G test: group 1, G = 9.19, p < 0.01; group 2, G = 7.99, p < 0.01; group 3, G = 12.40, p < 0.01; group 4, G = 18.99, p < 0.01). In summary, we found that, among the four groups of contexts, the group 4 context, yellow + 32°C versus blue + 19°C, provided the best conditions for reversal learning, with >60% of bees showing complete or partial reversals. Performance of bees in group 1 context (blue vs yellow) and group 3 context (32°C vs 19°C) was similar, with ∼40% of bees showing complete or partial reversals. Performance in group 2 context (26°C vs 32°C) was the lowest, with <30% reversals of any kind. Based on these results, we chose group 4 context to be the best for studying neuronal properties during reversal learning.
Neuronal activity of MB β neurons during learning
We studied neurons of the MBs at the β exit (MB β) of the αL to search for neural correlates of cue and context learning because these neurons are known to respond to multiple sensory modalities and change their properties during associative learning (Mauelshagen, 1993; Okada et al., 2007; Strube-Bloss et al., 2011). We first looked at general properties of αL extrinsic neurons, such as their firing rate (spikes per seconds), during spontaneous activity and in response to contexts and odors. In general, the firing rate of these neurons increased with the onset of contexts and odors (Figure 4A,B), but firing rates changed depending on conditioning protocols, which is discussed in the next section. The firing rate changed dramatically with the temperature context (Fig. 4C,D). During the 32°C context, the firing rate increased, and during 19°C context, firing rate decreased. The firing rate at 32°C was more than 10-fold compared with that at 19°C. Figure 4D shows the firing rate of a representative MB extrinsic neuron during 19°C and 32°C contexts. At 19°C, the firing rate was <10 Hz, but when temperature was increased, the firing rate increased to ∼70 Hz in 2 min and at 4 min the firing rate reached a saturation (∼80 Hz). When the temperature was decreased, the firing rate decreased to <25 Hz in 2 min and saturated after 4 min. Apart from the ΔSFR, the spike amplitude also increased during 32°C context and decreased or sometimes even disappeared during 19°C context (data not shown).
To compare neuronal properties before and after conditioning, we used a three-phase experimental design; (1) preconditioning phase: bees were puffed with three odors A, B, and C, in pseudorandom order two times each; (2) conditioning phase: bees were puffed with two odors A and B but only one odor was rewarded, and this was repeated five times; and (3) postconditioning phase: bees were puffed with odors A, B, and C in the same order as in the preconditioned phase. In context-dependent learning experiments, these three phases were repeated once in each context. We looked at the spontaneous neuronal activity (activity before the onset of odors or contexts) in all the experiments and calculated the interval between two spiking events [interspike interval (ISI)] during the preconditioning and post conditioning phases. We found that the ISI decreased from 27.8 ms in the preconditioning phase to 13.2 ms in the 120 min post-conditioning phase (Fig. 4E); in other words, the spontaneous activity of the neurons nearly doubled during the course of conditioning (two-way repeated-measures ANOVA: 15 and 60 min, p < 0.05; 120 min, p < 0.01; overall effect, F(3,220) = 5.44). Additionally, neuronal firing became more uniform at 15, 60, and 120 min after conditioning compared with preconditioning as indicated by a drop in SE.
Olfactory differential learning: neuronal activity is reduced toward rewarded odors
Next we looked at the responses of MB β neurons toward the rewarded odor cues by applying a differential odor conditioning protocol (Fig. 5A) in which only one of two odors was rewarded. Again, there were three phases: (1) preconditioning phase: bees received three puffs with three odors (A, B, and C) in random sequence at 1 min intervals; this was repeated twice and bees were left undisturbed for 5 min. (2) conditioning phase: bees were puffed with one odor (A+) followed by sugar reward (US), and after 1 min, a second odor (B−) was puffed without a reward; this was repeated five times; (3) postconditioning (or extinction) phase: bees were puffed with three odors (A, B, and C, the same odors as in first phase) at 15, 60, and 120 min after the last conditioning trial. The sequence of odor presentation was the same as in the preconditioning phase. The PERs were recorded for all the three phases. The change in neuronal responses toward the odors during the postconditioning phase were compared with that of the preconditioning phase. This was done by calculating the ΔSFR across the two phases and was defined as change in firing rate from preconditioning phase to postconditioning phase divided by total firing rate.
The change in neuronal response (ΔSFR) toward the rewarded odor (A+) gradually became negative with conditioning trials and became significantly negative at the 60 and 120 min postconditioning trials compared with the unrewarded odor B− and the neutral odor C (Fig. 5B; two-way repeated-measures ANOVA: 60 min, p < 0.05; 120 min, p < 0.01; overall effect, F(2,177) = 335.4). In addition, the change in neuronal response was significantly negative at 60 and 120 min compared with the hypothetical ΔSFR of 0, i.e., no change in neuronal response (one-sample t test: 60 min, p < 0.05, t = 2.72, df = 59; 120 min, p < 0.01, t = 3.45, df = 59). With respect to behavior, ∼55% of the bees showed PER toward the rewarded odor (A+) compared with PER toward unrewarded and neutral odors (B− and C, respectively), which was <15% at 15, 60, and 120 min after conditioning (Fig. 5C; Cochran's Q test: 15 min, Q = 46.08, df = 2, p < 0.01; 60 min, Q = 41.33, df = 2, p < 0.01; 120 min, Q = 48.67, df = 2, p < 0.01).
Context-dependent learning: rewarded odors reduce whereas rewarded contexts enhance neuronal firing
Next we wanted to understand how MB β neurons responded to simple context-dependent learning. In the context learning, bees had to learn that only one context and one odor is rewarded. This experiment also had three phases (Fig. 6A) like the previous experiment. In the preconditioning phase, the bee was puffed with three odors (A, B, and C) without US in each of two contexts (bright and dark). The protocol followed this sequence. Bright context was presented for 1 min followed by odors A, B, and C with 1 min between them. After 1 min, bright context was turned off, which was the start of the second context, dark. In the dark context, odors A, B, and C were puffed again with an interstimulus interval of 1 min. The trial ended when room lights were turned on, which was different from bright context. The preconditioning phase consisted of two such trials. In the conditioning phase, the bee was presented with two odors (A and B) in each context (bright and dark). The protocol started by presentation of bright context for 1 min followed by odor A, which was rewarded with US, and after 2.5 min, B was puffed without US. After 1 min, bright context was turned off, which started the second context, dark. In this context, both odors A and B were not rewarded. The interstimulus interval was 2.5. The trial ended when room lights were turned on. Conditioning phase consisted of five such trials. The postconditioning phase was the same as the preconditioning phase, except that bees were presented with extinction trials at 15, 60, and 120 min after the last conditioning trial. The order of context and odor presentations changed from experiment to experiment.
For the control animals, the procedure was exactly the same as above except that they were not rewarded during the entire experiment. PERs were noted during the preconditioning, conditioning, and postconditioning phase. The change in neuronal responses toward odors and contexts between preconditioning and postconditioning phases were compared by calculating the ΔSFR across phases.
The change in neuronal response toward the rewarded odor (A+) in the rewarded context became significantly negative compared with other odors at 60 and 120 min after conditioning (Fig. 6B; two-way repeated-measures ANOVA: 60 and 120 min, p < 0.01; overall effect, F(5,294) = 294.9). The change in neuronal response toward the rewarded context alone was significantly more positive compared with the unrewarded context as measured in the extinction trials 15, 60, and 120 min after conditioning (two-way repeated-measures ANOVA: 15, 60, and 120 min, p < 0.01; overall effect, F(1,98) = 1457). In addition, the change in neuronal response was negative toward rewarded odors at 60 and 120 min (one-sample t test: 60 min, p < 0.01, t = 17.20, df = 49; 120 min, p < 0.01, t = 52.44, df = 49) and positive toward rewarded contexts at 15, 60, and 120 min (one-sample t test: 15 min, p < 0.01, t = 23.81, df = 49; 60 min, p < 0.01, t = 39.19, df = 49; 120 min, p < 0.01, t = 26.12, df = 49) when compared with a hypothetical ΔSFR of 0. The firing rate toward odors in the unrewarded contexts was not significantly different. With respect to behavior (Fig. 6C), at postconditioning trials 15, 60, and 120 min, ∼40% bees learned the contexts correctly, i.e., they showed PER only toward the rewarded odor A in the rewarded context (context 1) and not toward odor A in unrewarded context (context 2). Percentage PER toward odors B and C was <10% (Cochran's Q test for PERs toward A versus B and C; 15 min, Q = 36.11, df = 2, p < 0.01; 60 min, Q = 36.11, df = 2, p < 0.01; 120 min, Q = 32.95, df = 2, p < 0.01). Also, the control bees that were placed in two contexts without any reward showed no particular preference to the any odors in either context (data not shown).
Context-dependent reversal learning
We then looked at the change in neuronal response of MB β neurons during reversal learning. Like the previous experiments, there were three phases (Fig. 7A). In the preconditioning phase, the bee was puffed with a random sequence of three odors A, B and C without US in each of the two compound contexts, yellow + 32°C and blue + 19°C. Bees were presented with the yellow + 32°C context for 1 min followed by odors A, B, and C with 1 min between them. After 1 min, the yellow + 32°C context was turned off and the second context blue + 19°C was turned on. After 1 min, odors A, B, and C were puffed with an interstimulus interval of 1 min. The trial ended when blue + 19°C context was turned off. The preconditioning phase consisted of two such trials. In the conditioning phase, the bee was subjected to two odors in each of these two contexts. The protocol was as follows: yellow + 32°C context was presented for 1 min followed by A, which was rewarded with US, and after 2.5 min, B was puffed without US. After 1 min, yellow + 32°C was turned off and the second context, blue + 19°C, was turned on. This time odor B was rewarded, and after 2.5 min, A was not rewarded. The trial ended when blue + 19°C context was turned off. The conditioning phase consisted of five such trials. In the postconditioning phase, the context and odor sequence was exactly the same as the preconditioning but with one extinction trial each at 15, 60, and 120 min after the conditioning phase. Note that the order of context and odor presentations changed from experiment to experiment. In the control animals, the procedure was exactly the same as above except that they were not rewarded during the entire experiment. PERs were noted down during the preconditioning, conditioning, and postconditioning phase.
Note that the normalization procedure (see Materials and Methods) cancels out the changes caused by temperature to the spike firing. Only a subset of the original data from 19°C could be used (ΔSFR >10 Hz) because spiking was completely absent in some bees during the 19°C context.
During the yellow + 32°C context, the spike firing of MB β neurons toward the rewarded odor A was significantly reduced at 60 and 120 min after conditioning, whereas in blue + 19°C context firing rate toward the rewarded odor B was reduced only at 120 min (Fig. 7B; two-way repeated-measures ANOVA: odor A in yellow + 32°C context, 60 min, p < 0.05; 120 min, p < 0.01; odor B in blue + 19°C context, 120 min, p < 0.05; overall effect, F(5,384) = 11.01). Although, both contexts were rewarded equally, spike firing toward the rewarded context yellow + 32°C was significantly increased at 60 and 120 min (p < 0.01; overall effect, F(1,128) = 7.985) after conditioning, whereas firing rate toward blue + 19°C context was not significant. This is probably because the bees did not learn the blue + 19°C context very well. In addition, the change in neuronal response was negative toward rewarded odors (one-sample t test: yellow + 32°C, 60 min, p < 0.01, t = 3.452, df = 64; 120 min, p < 0.01, t = 8.439, df = 64; blue + 19°C, 120 min, p < 0.01, t = 2.403, df = 64) and positive toward rewarded context yellow + 32°C (one-sample t test: 15 min, p < 0.01, t = 2.188, df = 64; 60 min: p < 0.01, t = 3.582, df = 64; 120 min, p < 0.01, t = 4.145, df = 64) when compared with a hypothetical ΔSFR of 0. With respect to learning the reversal rule (Table 2), ∼37% of the bees showed partial reversal during the conditioning trials (data not shown) and 25% (Fig. 7C) of the bees showed partial reversal during the three extinction trials in the postconditioning phase (Cochran's Q test: 15 min, Q = 28.1333, df = 2, p < 0.01; 60 min, Q = 34.11, df = 2, p < 0.01; 120 min, Q = 34.11, df = 2, p < 0.01). Also, ∼10% showed complete reversal (Cochran's Q test: 15 min, Q = 16.22, df = 2, p < 0.01; 60 min, Q = 10.33, df = 2, p < 0.01; 120 min, Q = 10.33, df = 2, p < 0.01). More than 70% of the bees learned the reversal learning rule better in the yellow + 32°C context than in the blue + 19°C context. The control bees that were placed in the context but not rewarded showed no preference to any particular context.
Finally, to understand the relationship between learning and neuronal activity, we correlated the learning scores with neuronal activity using Pearson's product moment correlation coefficient function. We first sorted the learning scores into groups such as 0–10%, 10–20%, and so forth and then averaged the entire neuronal data for each group of learning score. In the case of odors, we used PERs (from olfactory differential learning and context-dependent learning experiments), partial and complete reversals (from reversal learning experiment) as learning scores. We found a strong negative correlation (Pearson's correlation coefficient: R2 = 0.89) between learning scores and ΔSFR toward rewarded odors (Fig. 8A). Although we did not note the PERs during the contexts itself, we could use the PER data from odors in a particular context for the correlation analysis. Hence, we used PERs (from context-dependent learning experiments), partial and complete reversals (from reversal learning experiment) as learning scores. We observed a strong positive correlation (R2 = 0.96) between learning scores and ΔSFR toward rewarded contexts (Fig. 8B).
Discussion
Context learning is a term widely used for describing conditional discriminations that can be subsumed in the so-called occasion setting problem (Schmajuk et al., 1998). In this problem, a given stimulus, the occasion setter, informs the animal about the outcome of its choice. For instance, another form of occasion setting involving two occasion setters is the so-called transwitching problem. In this problem, an animal is trained differentially with two stimuli, A and B, and with two different occasion setters C1 and C2. When C1 is available, stimulus A is rewarded whereas stimulus B is not (A+ vs B−), whereas it is the opposite (A− vs B+) with C2. Focusing on the elements alone does not allow solving the problem because each element (A, B) appears equally as often rewarded and nonrewarded. Each occasion setter (C1, C2) is, in the same way, simultaneously rewarded and nonrewarded, depending on its association with A or B. Therefore, animals have to learn that C1 and C2 define the valid contingency and transwitching problem is considered a form of context learning because these occasion setters can be viewed as contexts determining the appropriateness of each choice.
Free-flying honeybees were found to solve various forms of context learning, including transwitching problems (for review, see Giurfa, 2003; Menzel, 2007). Restrained bees learn combinations of olfactory stimuli well and were found to follow a modified unique cue rule in binary odor mixture learning (Deisig et al., 2003). It has been shown that colors as context stimuli modulate odor learning in such a way that correct visual/odor combinations are learned and remembered better (Gerber and Smith, 1998). We introduced another context, temperature, that bees are known to associate as a cue together with a reward (Menzel et al., 2001).
We found that restrained honeybees learn context-dependent tasks and that the firing rate of the same MB extrinsic neurons is enhanced for rewarded contexts and reduced for rewarded cues. We addressed the unresolved problem of how elements of cue/context compounds are integrated neurally, as separate elements developing their specific associative strengths as proposed by Rescorla (1972), or as unique configurations that develop their respective combined associative strength as proposed by Pearce (1994)? Our data appear to support the Rescorla–Wagner model on a neural level opposing the interpretation of behavioral data in bees about learning of odor configurations (Lachnit, 2004).
We first found that context-dependent reversal learning lead to better and faster learning if two contexts were combined. The bees responded more quickly (third trial) toward the combined contexts and slowly (fourth or fifth trial) toward single contexts, indicating that combined contexts are easier to learn than a single context. Learning of the reversal of this transwitching rule was difficult; bees had to learn first to respond to an odor in one context and had to ignore the same odor in another context and later reverse this rule. Motivation dropped rather quickly because the bees were rewarded in both contexts equally and within a very short time (two times in 10 min). Toward the end of conditioning, we observed an overlearning reduction effect (Reid, 1953; Capaldi and Stevenson, 1957) in the high temperature context group in which the learning scores saturated early in the conditioning phase and improve only slightly. Additional studies are needed to examine drop in performance after overlearning as suggested by Yerkes and Dodson (1908).
In our search for neural correlates of context-dependent forms of learning, we focused on MB extrinsic neurons exiting the αL in its ventral aspect (β exit). The MB is known to be involved in learning, memory formation, and memory retrieval in the honeybee (Menzel et al., 2006) and Drosophila (Davis, 2011), and it can be expected that extrinsic neurons provide a readout of the learned induced neural restructuring within the MB. The MB β neurons have been recorded several times in the past and were found to change their response properties during olfactory conditioning (Mauelshagen, 1993; Grunewald, 1999; Okada et al., 2007; Haehnel and Menzel, 2010, 2012; Strube-Bloss et al., 2011). Simple differential conditioning experiments uncovered several associative phenomena. After conditioning, the ISIs during spontaneous activity reduced or, in other words, ΔSFR increased, and the firing became more stable (smaller deviations) (Fig. 4E). When we switched to context-dependent learning using temperature as a context stimulus, we needed to determine temperature dependence of neuronal activity. We found that heating (32°C) increased the spike firing and cooling (19°C) decreased or abolished spike firing (Fig. 4C,D). Honeybees sense temperature by thermoreceptive sensillae on the antennae (Yokohari, 1983); possibly sensory input from thermosensillae provides a neural drive that is required for central processing, which leads to change in firing rates at different temperatures. Even neurons in the mammalian brain are highly sensitive to body temperature, for example, the neuronal activity in the hippocampus increases with temperature (Moser et al., 1993).
Our olfactory differential conditioning corroborated previous findings that neuronal response decreases toward the learned odor (Okada et al., 2007). In this respect, the recorded neurons resemble properties of the PE1 but not of other neurons recorded in the same area (Strube-Bloss et al., 2011). In the first context-dependent conditioning combined with MB β neuron recordings, we used bright and dark contexts in which only one of the two odors in one of two contexts was rewarded. Similar to the behavior experiments, bees learned this simple rule quickly. The change in neuronal response of MB β neurons specifically was negative toward rewarded odors and positive toward rewarded contexts. Then we tested context-dependent reversal learning in which bees had to learn to reverse their responses in each context. During conditioning, we rewarded two different odors in two different contexts. For example, odor A was rewarded in yellow + 32°C context and odor B was rewarded in blue + 19°C context. Bees showed a bias toward yellow + 32°C context and hence quickly learned odor A in yellow + 32°C context much better than odor B in blue + 19°C context. The change in neuronal response toward rewarded odor in yellow + 32°C context was negative at 60 and 120 min after conditioning, whereas the responses toward the rewarded odor in blue + 19°C context was negative only at 120 min. The neuronal response toward contexts was opposite, the change in neuronal responses toward the yellow + 32°C context was significantly positive, whereas no change was seen toward blue + 19°C context, corroborating at least in part what was found with simpler form of context-dependent learning, namely that firing rates of MB β neurons are different for the cue and the context. Thus, we showed for the first time that the properties of MB β neurons are qualitatively different toward the rewarded cue context.
We also asked whether neuronal plasticity to the cue and the context depends on the amount of learning the task and found that the change in neuronal response to the learned cues correlated negatively with increasing learning scores for the cues and positively with increasing learning scores for contexts (Fig. 8).
Rewarded cues and context are obviously processed differently. In mammals, it has been shown that cued learning and context-dependent learning are related to different neural mechanisms (Phillips and LeDoux, 1992). It appears that context-dependent learning requires an intact hippocampus (Chen et al., 1996; Logue et al., 1997; Holland and Bouton, 1999; Anagnostaras et al., 2001; Corcoran and Maren, 2001), whereas cued learning does not require the hippocampus (Gould et al., 2002). In insects, visual and olfactory learning may involve the MB differently. Simple forms of visual learning are independent of the MB, but simple forms of olfactory learning require the MB (Heisenberg, 2003) whereas more complex forms of visual learning depend on a functional MB (Ren et al., 2012). In honeybees, the function of the MB can be compromised without significant loss of simple olfactory learning tasks (Scheiner et al., 2001; Malun et al., 2002), but complex forms of olfactory learning (e.g., side specific learning) depend on MB (Komischke et al., 2005). These results indicate the involvement of the MBs in solving elemental olfactory tasks whose complexity is enhanced by virtue of the number of stimuli, possibly by an effect on the inhibition of information exchange between brain hemispheres (Menzel, 2007). Nothing is known so far with respect to the MB function in visual and context learning, but it can be tentatively concluded that the full MB function is required for configural forms of learning, most likely including context-specific learning.
The picture emerging from our data is that the MB is a highly adaptive, high-order coding device that integrates across multiple sensory modalities, organizes associative plasticity of its intrinsic neurons according to the value of stimulus combinations and categorizes stimuli with respect to their indicative functions as cue and context. The differential coding of cues and contexts supports the view that the elements of stimulus combinations are processed separately, keeping a neural trace of their meaning in the stream of naturally occurring stimuli.
Footnotes
This work was supported by German Research Foundation Grant GRK 837. We thank Dr. Ryuichi Okada for his help with training S.A.H.
References
- Anagnostaras SG, Gale GD, Fanselow MS. Hippocampus and contextual fear conditioning: recent controversies and advances. Hippocampus. 2001;11:8–17. doi: 10.1002/1098-1063(2001)11:1<8::AID-HIPO1015>3.0.CO;2-7. [DOI] [PubMed] [Google Scholar]
- Bitterman ME, Menzel R, Fietz A, Schäfer S. Classical conditioning of proboscis extension in honeybees (Apis mellifera) J Comp Psychol. 1983;97:107–119. doi: 10.1037/0735-7036.97.2.107. [DOI] [PubMed] [Google Scholar]
- Capaldi EJ, Stevenson HW. Response reversal following different amounts of training. J Comp Physiol Psychol. 1957;50:195–198. doi: 10.1037/h0040624. [DOI] [PubMed] [Google Scholar]
- Chen C, Kim JJ, Thompson RF, Tonegawa S. Hippocampal lesions impair contextual fear conditioning in two strains of mice. Behav Neurosci. 1996;110:1177–1180. doi: 10.1037/0735-7044.110.5.1177. [DOI] [PubMed] [Google Scholar]
- Cohen JD, Barch DM, Carter C, Servan-Schreiber D. Context-processing deficits in schizophrenia: converging evidence from three theoretically motivated cognitive tasks. J Abnorm Psychol. 1999;108:120–133. doi: 10.1037/0021-843X.108.1.120. [DOI] [PubMed] [Google Scholar]
- Corcoran KA, Maren S. Hippocampal inactivation disrupts contextual retrieval of fear memory after extinction. J Neurosci. 2001;21:1720–1726. doi: 10.1523/JNEUROSCI.21-05-01720.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davis RL. Traces of Drosophila memory. Neuron. 2011;70:8–19. doi: 10.1016/j.neuron.2011.03.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Deisig N, Lachnit H, Sandoz JC, Lober K, Giurfa M. A modified version of the unique cue theory accounts for olfactory compound processing in honeybees. Learn Mem. 2003;10:199–208. doi: 10.1101/lm.55803. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Galizia CG, Joerges J, Küttner A, Faber T, Menzel R. A semi-in-vivo preparation for optical recording of the insect brain. J Neurosci Methods. 1997;76:61–69. doi: 10.1016/S0165-0270(97)00080-0. [DOI] [PubMed] [Google Scholar]
- Gaskin S, Chai SC, White NM. Inactivation of the dorsal hippocampus does not affect learning during exploration of a novel environment. Hippocampus. 2005;15:1085–1093. doi: 10.1002/hipo.20127. [DOI] [PubMed] [Google Scholar]
- Gerber B, Menzel R. Contextual modulation of memory consolidation. Learn Mem. 2000;7:151–158. doi: 10.1101/lm.7.3.151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gerber B, Smith BH. Visual modulation of olfactory learning in honeybees. J Exp Biol. 1998;201:2213–2217. doi: 10.1242/jeb.201.14.2213. [DOI] [PubMed] [Google Scholar]
- Giurfa M. Cognitive neuroethology: dissecting non-elemental learning in a honeybee brain. Curr Opin Neurobiol. 2003;13:726–735. doi: 10.1016/j.conb.2003.10.015. [DOI] [PubMed] [Google Scholar]
- González F, Quinn JJ, Fanselow MS. Differential effects of adding and removing components of a context on the generalization of conditional freezing. J Exp Psychol Anim Behav Process. 2003;29:78–83. doi: 10.1037/0097-7403.29.1.78. [DOI] [PubMed] [Google Scholar]
- Gould TJ, Rowe WB, Heman KL, Mesches MH, Young DA, Rose GM, Bickford PC. Effects of hippocampal lesions on patterned motor learning in the rat. Brain Res Bull. 2002;58:581–586. doi: 10.1016/S0361-9230(02)00832-8. [DOI] [PubMed] [Google Scholar]
- Gronenberg W. Physiological and anatomical properties of optical input-fibres to the mushroom body in the bee brain. J Insect Physiol. 1986;32:695–704. doi: 10.1016/0022-1910(86)90111-3. [DOI] [Google Scholar]
- Grunewald B. Physiological properties and response modulations of mushroom body feedback neurons during olfactory learning in the honeybee, Apis mellifera. J Comp Physiol A Neuroethol Sens Neural Behav Physiol. 1999;185:565–576. doi: 10.1007/s003590050417. [DOI] [Google Scholar]
- Haehnel M, Menzel R. Sensory representation and learning-related plasticity in mushroom body extrinsic feedback neurons of the protocerebral tract. Front Syst Neurosci. 2010;4:161. doi: 10.3389/fnsys.2010.00161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Haehnel M, Menzel R. Long-term memory and response generalization in mushroom body extrinsic neurons in the honeybee Apis mellifera. J Exp Biol. 2012;215:559–565. doi: 10.1242/jeb.059626. [DOI] [PubMed] [Google Scholar]
- Heisenberg M. Mushroom body memoir: from maps to models. Nat Rev Neurosci. 2003;4:266–275. doi: 10.1038/nrn1074. [DOI] [PubMed] [Google Scholar]
- Hirsh R. The hippocampus and contextual retrieval of information from memory: a theory. Behav Biol. 1974;12:421–444. doi: 10.1016/S0091-6773(74)92231-7. [DOI] [PubMed] [Google Scholar]
- Holland PC, Bouton ME. Hippocampus and context in classical conditioning. Curr Opin Neurobiol. 1999;9:195–202. doi: 10.1016/S0959-4388(99)80027-0. [DOI] [PubMed] [Google Scholar]
- Kesner RP, Hardy JD, Novak JM. Phencyclidine and behavior: II. Active avoidance learning and radial arm maze performance. Pharmacol Biochem Behav. 1983;18:351–356. doi: 10.1016/0091-3057(83)90453-7. [DOI] [PubMed] [Google Scholar]
- Komischke B, Giurfa M, Lachnit H, Malun D. Successive olfactory reversal learning in honeybees. Learn Mem. 2002;9:122–129. doi: 10.1101/lm.44602. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Komischke B, Sandoz JC, Malun D, Giurfa M. Partial unilateral lesions of the mushroom bodies affect olfactory learning in honeybees Apis mellifera L. Eur J Neurosci. 2005;21:477–485. doi: 10.1111/j.1460-9568.2005.03879.x. [DOI] [PubMed] [Google Scholar]
- Lachnit H. Odor processing in honeybees: is the whole equal to, more than, or different from the sum of its parts? In: Slater PJ, Rosenblatt JS, Roper TJ, Snowdon CT, Brockmann HJ, Naguib M, editors. Amsterdam: Elsevier; 2004. pp. 241–264. [Google Scholar]
- Logue SF, Paylor R, Wehner JM. Hippocampal lesions cause learning deficits in inbred mice in the Morris water maze and conditioned-fear task. Behav Neurosci. 1997;111:104–113. doi: 10.1037/0735-7044.111.1.104. [DOI] [PubMed] [Google Scholar]
- Malun D, Giurfa M, Galizia CG, Plath N, Brandt R, Gerber B, Eisermann B. Hydroxyurea-induced partial mushroom body ablation does not affect acquisition and retention of olfactory differential conditioning in honeybees. J Neurobiol. 2002;53:343–360. doi: 10.1002/neu.10119. [DOI] [PubMed] [Google Scholar]
- Matsumoto Y, Mizunami M. Context-dependent olfactory learning in an insect. Learn Mem. 2004;11:288–293. doi: 10.1101/lm.72504. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mauelshagen J. Neural correlates of olfactory learning paradigms in an identified neuron in the honeybee brain. J Neurophysiol. 1993;69:609–625. doi: 10.1152/jn.1993.69.2.609. [DOI] [PubMed] [Google Scholar]
- Menzel R. Cognition in invertebrates. In: Kaas JH, editor. Evolution of nervous systems, Vol II, Evolution of nervous systems in invertebrates. Oxford, UK: Academic; 2007. pp. 403–422. [Google Scholar]
- Menzel R. The honeybee as a model for understanding the basis of cognition. Nat Rev Neurosci. 2012;13:758–768. doi: 10.1038/nrn3357. [DOI] [PubMed] [Google Scholar]
- Menzel R, Giurfa M. Cognitive architecture of a mini-brain: the honeybee. Trends Cogn Sci. 2001;5:62–71. doi: 10.1016/S1364-6613(00)01601-6. [DOI] [PubMed] [Google Scholar]
- Menzel R, Manz G, Menzel R, Greggers U. Massed and spaced learning in honeybees: the role of CS, US, the intertrial interval, and the test interval. Learn Mem. 2001;8:198–208. doi: 10.1101/lm.40001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Menzel R, Leboulle G, Eisenhardt D. Small brains, bright minds. Cell. 2006;124:237–239. doi: 10.1016/j.cell.2006.01.011. [DOI] [PubMed] [Google Scholar]
- Mizunami M, Okada R, Li Y, Strausfeld NJ. Mushroom bodies of the cockroach: activity and identities of neurons recorded in freely moving animals. J Comp Neurol. 1998;402:501–519. doi: 10.1002/(SICI)1096-9861(19981228)402:4<501::AID-CNE5>3.0.CO;2-M. [DOI] [PubMed] [Google Scholar]
- Moser E, Mathiesen I, Andersen P. Association between brain temperature and dentate field potentials in exploring and swimming rats. Science. 1993;259:1324–1326. doi: 10.1126/science.8446900. [DOI] [PubMed] [Google Scholar]
- Odling-Smee FJ. Background stimuli and the inter-stimulus interval during pavlovian conditioning. Q J Exp Psychol. 1975;27:387–392. doi: 10.1080/14640747508400498. [DOI] [PubMed] [Google Scholar]
- Okada R, Ikeda J, Mizunami M. Sensory responses and movement-related activities in extrinsic neurons of the cockroach mushroom bodies. J Comp Physiol A Neuroethol Sens Neural Behav Physiol. 1999;185:115–129. doi: 10.1007/s003590050371. [DOI] [Google Scholar]
- Okada R, Rybak J, Manz G, Menzel R. Learning-related plasticity in PE1 and other mushroom body-extrinsic neurons in the honeybee brain. J Neurosci. 2007;27:11736–11747. doi: 10.1523/JNEUROSCI.2216-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pearce JM. Discrimination and categorization. In: Mackintosh NJ, editor. Animal learning and cognition. Handbook of perception and cognition. Ed 2. San Diego: Academic; 1994. [Google Scholar]
- Phillips RG, LeDoux JE. Differential contribution of amygdala and hippocampus to cued and contextual fear conditioning. Behav Neurosci. 1992;106:274–285. doi: 10.1037/0735-7044.106.2.274. [DOI] [PubMed] [Google Scholar]
- Reid LS. The development of noncontinuity behavior through continuity learning. J Exp Psychol. 1953;46:107–112. doi: 10.1037/h0062488. [DOI] [PubMed] [Google Scholar]
- Ren Q, Li H, Wu Y, Ren J, Guo A. A GABAergic inhibitory neural circuit regulates visual reversal learning in Drosophila. J Neurosci. 2012;32:11524–11538. doi: 10.1523/JNEUROSCI.0827-12.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rescorla RA. A theory of classical conditioning: variations in the effectiveness of reinforcement and non-reinforcement. In: Black AH, Prokasy WF, editors. Classical conditioning II: current research and theory. New York: Appleton-Century-Crofts; 1972. [Google Scholar]
- Riccio DC, Ackil J, Burch-Vernon A. Forgetting of stimulus attributes: methodological implications for assessing associative phenomena. Psychol Bull. 1992;112:433–445. doi: 10.1037/0033-2909.112.3.433. [DOI] [PubMed] [Google Scholar]
- Rybak J, Menzel R. Anatomy of the mushroom bodies in the honey bee brain: the neuronal connections of the alpha-lobe. J Comp Neurol. 1993;334:444–465. doi: 10.1002/cne.903340309. [DOI] [PubMed] [Google Scholar]
- Sato C, Matsumoto Y, Sakura M, Mizunami M. Contextual olfactory learning in cockroaches. Neuroreport. 2006;17:553–557. doi: 10.1097/01.wnr.0000209002.17610.79. [DOI] [PubMed] [Google Scholar]
- Scheiner R, Weiß A, Malun D, Erber J. Learning in honey bees with brain lesions: how partial mushroom-body ablations affect sucrose responsiveness and tactile antennal learning. Anim Cogn. 2001;3:227–235. doi: 10.1007/s100710100080. [DOI] [Google Scholar]
- Schmajuk NA, Lamoureux JA, Holland PC. Occasion setting: a neural network approach. Psychol Rev. 1998;105:3–32. doi: 10.1037/0033-295X.105.1.3. [DOI] [PubMed] [Google Scholar]
- Strube-Bloss MF, Nawrot MP, Menzel R. Mushroom body output neurons encode odor–reward associations. J Neurosci. 2011;31:3129–3140. doi: 10.1523/JNEUROSCI.2583-10.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tulving E, Thomson DM. Encoding specificity and retrieval processes in episodic memory. Psychol Rev. 1973;80:352–373. doi: 10.1037/h0020071. [DOI] [Google Scholar]
- Umbricht D, Schmid L, Koller R, Vollenweider FX, Hell D, Javitt DC. Ketamine-induced deficits in auditory and visual context-dependent processing in healthy volunteers: implications for models of cognitive deficits in schizophrenia. Arch Gen Psychiatry. 2000;57:1139–1147. doi: 10.1001/archpsyc.57.12.1139. [DOI] [PubMed] [Google Scholar]
- von Frisch K. The dance language and orientation of bees. Cambridge, MA: Harvard UP; 1967. [Google Scholar]
- Yerkes RM, Dodson JD. The relation of strength of stimulus to rapidity of habit-formation. J Comp Neurol Psychol. 1908;18:459–482. doi: 10.1002/cne.920180503. [DOI] [Google Scholar]
- Yokohari F. The coelocapitular sensillum, an antennal hygro- and thermoreceptive sensillum of the honey bee, Apis mellifera L. Cell Tissue Res. 1983;233:355–365. doi: 10.1007/BF00238302. [DOI] [PubMed] [Google Scholar]