Abstract
Dopamine signals reward in animal brains. A single presentation of a sugar reward to Drosophila activates distinct subsets of dopamine neurons that independently induce short- and long-term olfactory memories (STM and LTM, respectively). In this study, we show that a recurrent reward circuit underlies the formation and consolidation of LTM. This feedback circuit is composed of a single class of reward-signaling dopamine neurons (PAM-α1) projecting to a restricted region of the mushroom body (MB), and a specific MB output cell type, MBON-α1, whose dendrites arborize that same MB compartment. Both MBON-α1 and PAM-α1 neurons are required during the acquisition and consolidation of appetitive LTM. MBON-α1 additionally mediates the retrieval of LTM, which is dependent on the dopamine receptor signaling in the MB α/β neurons. Our results suggest that a reward signal transforms a nascent memory trace into a stable LTM using a feedback circuit at the cost of memory specificity.
DOI: http://dx.doi.org/10.7554/eLife.10719.001
Research organism: D. melanogaster
eLife digest
An animal that finds particularly nutritious and palatable food will often develop a long-lasting memory—even if they experience that event only once.
One example of this is the ability of the fruit fly Drosophila to form a long-term association between a sugar reward and a specific odor that was present when they received the reward. The consumption of sugar triggers the release of a chemical called dopamine on specific compartments of a brain structure called the mushroom body. Dopamine then acts to modify the connection between cells called “Kenyon cells”, which encode specific odors, and the neurons that send signals out from the mushroom body (called MBONs). The result is the formation of a memory that links the odor with the reward.
However, little is known about how this process differs for long-term vs. short-term memories, and how it can occur when the fly has experienced the odor and reward together on only a single occasion. To find out, Ichinose et al. combined behavioral testing of fruit flies with genetics. The results confirmed that the dopamine neurons and the MBONs that project to a single compartment of the mushroom body, called α1, are both required for the formation of long-term odor-reward memories, but not their short-term equivalents. These neurons are called PAM-α1 and MBON-α1, respectively.
Unexpectedly, anatomical data revealed that PAM-α1 dopamine neurons receive input from MBON-α1; that is, long-term memory formation involves a feedback circuit: from PAM-α1 to Kenyon cells, then to MBON-α1 and back to PAM-α1. Blocking feedback from the MBON-α1 onto the PAM-α1 neurons shortly after odor-reward training disrupted long-term memory formation. Conversely, blocking feedback at a later stage did not. This suggests that prolonged activation of PAM-α1 by MBON-α1 helps to strengthen newly established memories, converting them into memories that will last for a long time.
The discovery of a specific circuit that supports long-term, but not short-term, memory formation in fruit flies is consistent with evidence of distinct mechanisms underlying these processes in mammals. Further work is now required to determine whether feedback circuits similar to those in fruit flies also contribute to reward-based learning in other animals.
Introduction
Environmentally relevant information, such as poison or food, can trigger formation of long-term memory (LTM) in a single association event (Garcia et al., 1955; Alexander et al., 1984). Because LTM formation is energetically costly (Mery and Kawecki, 2005; Placais and Preat, 2013), it is advantageous for animals to refer to surrounding conditions when selecting what information to retain as stable LTM. Appetitive olfactory learning in Drosophila melanogaster provides an opportunity to uncover the mechanisms underlying such integration of information, as a single presentation of nutritious sugar and an odor drives robust short-term memory (STM) and LTM, while non-nutritious sugar induces only STM (Krashes and Waddell, 2008; Colomb et al., 2009; Burke and Waddell, 2011).
In Drosophila, sugar reward is mediated by a group of dopamine neurons called the protocerebral anterior medial (PAM) cluster (Burke et al., 2012; Liu et al., 2012). Artificial activation of the PAM cluster neurons in the presence of odor drives robust appetitive STM and LTM formation. Recent studies subdivided the PAM cluster neurons into STM- and LTM-inducing cell types and identified several cell types responsible for LTM formation, including PAM-α1 (Huetteroth et al., 2015; Yamagata et al., 2015). Interestingly, the induced LTM is undetectable immediately after conditioning but gradually develops with time (Das et al., 2014; Huetteroth et al., 2015; Yamagata et al., 2015).
Dopamine reward signals are conveyed by PAM cluster neurons to a brain structure called mushroom body (MB), where the convergence of the reward and the odor is assumed to take place (Schwaerzel et al., 2003; Krashes et al., 2007; Trannoy et al., 2011; Cervantes-Sandoval et al., 2013; Huang et al., 2013). The MB represents odors using a sparse subset of ∼2000 intrinsic neurons, Kenyon cells (KCs) (Turner et al., 2008; Aso et al., 2009; Honegger et al., 2011; Campbell et al., 2013). KCs send parallel fibers to form lobe structures, where multiple MB-output neuron (MBON) types elaborate spatially segregated dendritic arbors (Aso et al., 2014a). The KC-MBON synapses are presumed to be modified in the course of memory formation by the reinforcing dopamine neurons (Tomchik and Davis, 2009; Gervasi et al., 2010; Sejourne et al., 2011; Cervantes-Sandoval et al., 2013; Placais et al., 2013; Boto et al., 2014).
While there has been progress on the molecular and cellular mechanisms underlying LTM formation resulting from repetitive conditioning (Pagani et al., 2009; Placais et al., 2012; Philips et al., 2013), how a single presentation of a reward can trigger LTM remains to be understood. Here, we identify and behaviorally characterize a recurrent reward circuit that is essential for appetitive LTM formation and consolidation. The recurrent circuit consists of PAM-α1 dopamine neurons and a single MBON type, MBON-α1. This recurrent dopamine reward circuit may provide insights into a general mechanism for LTM formation.
Results
MBON-α1 provides a glutamatergic feedback to PAM-α1
PAM-α1 delivers reward signals essential for appetitive LTM formation (Yamagata et al., 2015). To understand the neuronal circuit that regulates rewards for LTM formation, we first sought to anatomically identify the input neurons to PAM-α1. The presynaptic terminals of PAM-α1 are localized to the basal compartment of the MB α lobe (α1) (Liu et al., 2012), whereas the dendrites stretch horizontally across the superior medial, intermediate, and lateral protocerebra (SMP, SIP, and SLP, respectively) (Aso et al., 2014a; Yamagata et al., 2015) (Figure 1A,B,H). By segmenting the dendrites of PAM-α1 in confocal images (Aso et al., 2014a), we queried a database of GAL4 expression patterns (Jenett et al., 2012) to computationally search for candidate upstream neurons. Strikingly, one of the input candidates we identified was the output neurons from the α1 compartment of the MB (MBON-α1) (Figure 1C,D). Transgenic expression of a presynaptic marker (Robinson et al., 2002) by MB310C-GAL4 revealed that the presynaptic terminals of MBON-α1 lie in close apposition to the dendrites of PAM-α1 (Figure 1E,I). The terminals of MBON-α1 were immunoreactive for the vesicular glutamate transporter (Figure 1F) (Daniels et al., 2008) but not for markers for GABAergic or cholinergic neurons (glutamic acid decarboxylase [Jackson et al., 1990] or choline acetyltransferase [Takagawa and Salvaterra, 1996], respectively) (Figure 1—figure supplement 1), consistent with MBON-α1 being glutamatergic (Aso et al., 2014a). Differential labeling of the individual MBON-α1 neurons in the same brain (Nern et al., 2015) revealed that MBON-α1 comprises two cells with very similar morphology (Figure 1G).
To precisely determine the relative arrangement of PAM-α1 and MBON-α1 neurites, we performed a double-labeling experiment using R72D01-LexA, which labels PAM-α1, and the split-GAL4 driver MB310C-GAL4, which labels MBON-α1 (Aso et al., 2014a). Confocal images revealed that the processes of MBON-α1 and PAM-α1 substantially intermingled both in the SIP and SLP, and in the α1 compartment of the MB—the input and output sites of PAM-α1, respectively (Figure 2A–E, Figure 2—figure supplement 1, Video 1). To observe these processes in SIP and SLP in even greater detail, we employed a microscope with a super resolution detection system and found bouton-like structures of MBON-α1 attached to the dendrites of PAM-α1 (Figure 2B–D). Furthermore, a GFP reconstitution across synaptic partners (GRASP) (Feinberg et al., 2008; Gordon and Scott, 2009) experiment using R72D01-LexA and MB310C-GAL4 revealed strong GRASP signals in SIP, SLP, and the α1 compartment (Figure 2F). This further supports the close juxtaposition between PAM-α1 and MBON-α1.
Video 1. Volume-rendered image of processes of PAM-α1 (magenta) and MBON-α1 (green) in SIP and SLP.
Figure 2. Processes of PAM-α1 and MBON-α1 intermingle each other.
(A) Double labeling of PAM-α1 and MBON-α1. PAM-α1 (magenta) and MBON-α1 (green) are visualized using R72D01-LexA and MB310C-GAL4, respectively. (B–D) Magnified substack images in SIP and SLP, obtained by a super-resolution detection system. (E) Magnified substack image in the α1 compartment in the MB. (F) GFP reconstitution across synaptic partner (GRASP) signals in SIP, SLP, and MB α1 support the contacts between PAM-α1 and MBON-α1. Scale bars, 10 µm (A, B, E, F), 1 µm (C, D).
Figure 2—figure supplement 1. Stereotyped projections of PAM-α1 and MBON-α1.
Appetitive LTM formation requires feedback from MBON-α1
If the MB feedback modulates PAM-α1, the output of MBON-α1 might be required for the acquisition of LTM of the sugar reward. We examined the requirement of PAM-α1 and MBON-α1 by expressing a temperature-sensitive dominant negative dynamin, Shibirets1 (Kitamoto, 2001) using the split-GAL4 drivers MB299B-GAL4 and MB310C-GAL4 (Figure 3B,F). MB299B-GAL4 has strong expression in PAM-α1 (Aso et al., 2014a; Yamagata et al., 2015) (Figure 3B). Consistent with our previous results (Yamagata et al., 2015), the blockade of PAM-α1 during conditioning did not significantly affect STM (Figure 3C), but led to a severe impairment of sucrose-rewarded LTM (Figure 3D). The unimpaired performance in appetitive STM demonstrates that flies of these genotypes have normal sugar and odor perception at the restrictive temperature. Intriguingly, we found a similar preferential impairment of LTM upon the blockade of MBON-α1, using MB310C-GAL4 driver (Figure 3H). The same blockade did not significantly impair STM (Figure 3G). We confirmed the preferential requirement of MBON-α1 for LTM using another driver, MB323B-GAL4 (Figure 3—figure supplement 1A), and obtained similar results (Figure 3G,H); neither MB310C/UAS-shi nor MB323B/UAS-shi flies showed a significant LTM impairment when trained and tested at the permissive temperature (Figure 3—figure supplement 1B).
Figure 3. Feedback from MBON-α1 is required for appetitive LTM formation.
(A) Diagram of the experiment. (B) Expression pattern of MB299B-GAL4. (C) Blockade of PAM-α1 does not impair STM significantly. 5-min appetitive memory was measured (n = 10, 10, 12). c: conditioning, t: test. (D) Blockade of PAM-α1 during conditioning impairs LTM. 24-hr appetitive LTM was measured (n = 9, 12, 12). (E) Diagram of experiment. (F) Expression pattern of MB310C-GAL4. (G) Blockade of MBON-α1 does not impair STM significantly (n = 6, 7, 10, 6, 10). (H) Blockade of MBON-α1 during conditioning impairs LTM. MB323B-GAL4 is a second driver line that expresses in MBON-α1 (see figure supplement; n = 23, 24, 13, 14, 24). Bar graphs are mean ± s.e.m. *: p < 0.05, ***: p < 0.001, n.s.: p > 0.05. Scale bars, 20 µm.
Figure 3—figure supplement 1. (A) Expression pattern of MB323B-GAL4.
We next examined whether glutamatergic input to PAM-α1 is required for LTM formation by down-regulating the expression of glutamate receptors using MB299B-GAL4. For efficient and cell-type-specific manipulation, we used UAS-RNAi fly strains based on the shRNA technique (Ni et al., 2011). Intriguingly, knocking down either dNR-1 or dNR-2, which together form the functional NMDA receptor (Xia et al., 2005), impaired LTM (Figure 4C) but not STM (Figure 4B). This preferential requirement in LTM is similar to the blockade of MBON-α1 and PAM-α1, suggesting the direct glutamatergic feedback.
Figure 4. NMDA receptors in PAM-α1 are required for appetitive LTM.
(A) The subunits of NMDA receptor are down-regulated in PAM-α1. (B, C) Knocking down NMDA receptor subunits does not impair 5-min memory (B: n = 16, 8, 13, 12, 13) but impairs 24-hr memory significantly (C: n = 18, 8, 22, 20, 29). Bar graphs are mean ± s.e.m. *: p < 0.05, **: p < 0.01, n.s.: p > 0.05. Scale bars, 20 µm.
Given that thermogenetic stimulation of PAM-α1 with a temperature-sensitive cation channel dTrpA1 (Hamada et al., 2008) can provide the reward signal for LTM formation (Yamagata et al., 2015), we asked if activation of MBON-α1 would also be capable of inducing appetitive LTM (Figure 5A). Indeed, we found appetitive LTM upon thermo-activation of MBON-α1 in the presence of an odor (Figure 5B). These results, together with the consistent requirements of MBON-α1 and NMDAR-signaling in PAM-α1, are most easily explained if the glutamatergic feedback regulation from MBON-α1 augments dopamine reward signaling by PAM-α1.
Figure 5. MBON-α1 signals reward for appetitive LTM.
(A) Activation of MBON-α1 was paired with odor presentations and 24-hr memory was measured. (B) Activation of MBON-α1 induces appetitive LTM formation (n = 16, 24, 24). Bar graphs are mean ± s.e.m. *: p < 0.05, n.s.: p > 0.05. Scale bars, 20 µm.
DopR1-mediated appetitive LTM trace is formed in α/β KCs
Several lines of evidence suggest that D1-like dopamine receptor (DopR1) is required in KCs for appetitive memory (Kim et al., 2007; Liu et al., 2012; Boto et al., 2014). However, previous studies focused on only STM. To identify the receiving site of dopamine for LTM formation, we knocked down DopR1, either in α/β KCs or in MBON-α1, the potential targets of dopamine from PAM-α1, and measured appetitive LTM. To target the expression specifically to the α/β KCs, we employed two driver lines, MB008B-GAL4 (Aso et al., 2014a; Vogt et al., 2014) (Figure 6—figure supplement 1A) and c739-GAL4 (Yang et al., 1995). Interestingly, knocking down DopR1 in the α/β KCs, using c739-GAL4 or MB008B-GAL4, resulted in a severe impairment of appetitive LTM (Figure 6A) while leaving STM unaffected (Figure 6—figure supplement 1B). These results are consistent with the observation that the coincidence detector adenylate cyclase encoded by rutabaga, thought to act downstream of the dopamine receptor (Tomchik and Davis, 2009; Gervasi et al., 2010; Boto et al., 2014), functions for LTM in the α/β KCs (Trannoy et al., 2011). On the other hand, knocking down DopR1 in MBON-α1 did not significantly impair either appetitive LTM or STM (Figure 6A and Figure 6—figure supplement 1B).
Figure 6. α/β KCs receive dopamine signals through DopR1 for LTM formation.
(A) Knocking down DopR1 in α/β Kenyon cells (KCs) but not in MBON-α1 impairs appetitive LTM (n = 17, 10, 11, 11, 18, 12, 7, 12, 27). (B) KC expression of DopR1 in the dumb2 mutant background fully rescues the LTM impairment (n = 12, 10, 7, 13). Bar graphs are mean ± s.e.m. *: p < 0.05, ***: p < 0.001.
Figure 6—figure supplement 1. (A) Expression pattern of MB008B-GAL4.
To further localize the role of DopR1 in KCs, we performed a rescue experiment, using a piggyBac insertion mutant, dumb2 (Liu et al., 2012; Qin et al., 2012). dumb2 mutant flies showed severely impaired appetitive LTM. Targeting wild-type DopR1 gene expression in KCs fully rescued the defects (Figure 6B). Together, although we cannot exclude the possible role of other dopamine receptors in MBON-α1, we propose that DopR1-mediated memory trace is formed in α/β KCs not in MBON-α1.
Output from the α/β KCs is required during conditioning
Previous studies have highlighted the role of the output from α/β KCs for memory retrieval (Krashes et al., 2007; Trannoy et al., 2011; Cervantes-Sandoval et al., 2013; Perisse et al., 2013). Given the requirement of MBON-α1 for the acquisition of appetitive LTM, the output of the α/β KCs during conditioning may be important for LTM formation. To test this possibility, we blocked the output of the α/β KCs with Shits1. Strikingly, the blockade of the α/β KCs during conditioning significantly impaired appetitive LTM, but not STM (Figure 7A,B), similar to the blockade of PAM-α1 and MBON-α1 (Figure 3). When the flies were trained and tested at the permissive temperature, no significant impairment of appetitive LTM was observed (Figure 7—figure supplement 1). The requirement for α/β KC synaptic signaling during LTM formation supports our model that MBON-α1 provides information about the memory trace, formed in the α/β KCs, to the reward signaling PAM-α1 neurons.
Figure 7. Output of α/β KCs has an essential role in the acquisition of appetitive LTM.
(A) Blockade of α/β KCs does not impair STM significantly (n = 8, 7, 7, 8, 9). (B) Blockade of α/β KCs during conditioning impairs LTM (n = 7, 7, 18, 19, 20). Bar graphs are mean ± s.e.m. *: p < 0.05, n.s.: p > 0.05.
Figure 7—figure supplement 1. Training and testing c739/UAS-shi and MB008B/UAS-shi flies at the permissive temperature do not impair appetitive LTM (n = 7, 6, 8, 9, 6).
LTM retrieval requires MBON-α1
If the nascent memory trace in α/β KCs is communicated by MBON-α1 during conditioning, MBON-α1 might also convey the read-out of LTM. Intriguingly, when MBON-α1 was blocked only during the test phase of LTM, we found a severe impairment of conditioned odor approach (Figure 8A). In contrast, the blockade of PAM-α1 during LTM retrieval did not have a significant effect (Figure 8B). These results imply that MBON-α1 plays a dual role in both formation and retrieval of LTM; different post-synaptic targets of MBON-α1 would be used in these two roles, with the recurrent PAM-α1-MBON-α1 circuit selectively involved in LTM formation.
Figure 8. Appetitive LTM is read out through MBON-α1.
(A) Blocking MBON-α1 during test impairs appetitive LTM retrieval (n = 20, 21, 11, 13, 20). (B) Blocking PAM-α1 during test does not significantly impair LTM retrieval (n = 7, 7, 10). Bar graphs are mean ± s.e.m. *: p < 0.05, **: p < 0.01, n.s.: p > 0.05.
Post-training dopamine release consolidates the nascent memory trace at the cost of memory specificity
The glutamatergic input from MBON-α1 might provide an excitatory feedback on the PAM-α1 neurons via the NMDA receptor thereby prolonging the dopamine release after the cessation of sugar presentation. If this model were correct, the post-training blockade of the feedback circuit might be expected to impair appetitive LTM. Consistent with this idea, blocking any component of the feedback circuit for 1 hr immediately following conditioning resulted in a significant impairment of appetitive LTM (Figure 9A,C,E), whereas the same blockade 22 hr after training did not (Figure 9B,D,F). These results strongly suggest that the recurrent circuit has an ongoing activity, which plays a key role in early phase of appetitive LTM consolidation.
Figure 9. Dopamine release from PAM-α1 is required for appetitive LTM consolidation.
(A, C, E) Blocking PAM-α1 (A), MBON-α1 (C), or α/β−KC (E) for 1 hr immediately after conditioning impairs appetitive LTM (n = 16, 15, 22 (A); n = 15, 16, 14, 20, 34 (C); n = 9, 8, 10, 7, 15 (E)). (B, D, F) Blocking PAM-α1 (B), MBON-α1 (D), or α/β−KC (F) for 1 hr, 22 hr after conditioning does not impair appetitive LTM (n = 15, 15, 14 (B); n = 16, 15, 13, 13, 23 (D); n = 12, 12, 15, 12, 15 (F)). Bar graphs are mean ± s.e.m. *: p < 0.05, ***: p < 0.001, n.s.: p > 0.05.
Prolonged dopamine release in the absence of odor may also modulate KCs that do not respond to the rewarded odor. If so, the odor specificity of appetitive LTM might be compromised compared to STM. Thus, we measured the generalization profile of STM and LTM by testing with the graded mixtures of ‘contaminating’ odors (Figure 10). Odor mixtures were created by systematically varying the relative contents of the contaminant (trained odor: contaminant = 100:0, 80:20, 60:40, 40:60, 20:80, or 0:100): if the memory is specific to the trained odor, the performance quickly decreases with the increasing contaminant ratio. Strikingly, the performance decline is shallower in LTM compared to STM (Figure 10C,D). We confirmed these results with another set of odorants, suggesting that compromised stimulus specificity in LTM is general (Figure 10—figure supplement 1). Considering that the only difference between these groups is the retention time, there may be a trade-off between consolidation and specificity, possibly due to the prolonged dopamine release in the MB following memory acquisition.
Figure 10. LTM specificity is compromised.
(A) Chemical structures of odorants. (B) Design of the experiment. For one group, presentation of 4-methylcyclohexanol was paired with sugar reward. The reciprocal group received sugar without odor. In the test situation, flies of each group were allowed to choose between the air and the mixture of the trained odor and the ‘contaminant’ (2-methylcyclohexanol). (C, D) The performance index declined more sharply with the increasing contamination ratio in STM (C; n = 16 for each) than in LTM (D; n = 24 for each). Each group was compared to the group that was tested without the contaminant (left most bar). Bar graphs are mean ± s.e.m. *: p < 0.05, **: p < 0.01, ***: p < 0.001, n.s.: p > 0.05.
Figure 10—figure supplement 1. LTM is less specific with another pair of odors.
Discussion
Function of a recurrent reward circuit
Prior studies on the role of MBONs in learning and memory have focused on memory retrieval (Sejourne et al., 2011; Pai et al., 2013; Placais et al., 2013; Aso et al., 2014b). Here, we extend the known role of MBONs and show that MB output through MBON-α1 is required not only for the retrieval, but also for the acquisition and early consolidation of long-term appetitive olfactory memory. This unanticipated aspect of the MB output for LTM formation appears to function through a recurrent loop (Figure 11): MBON-α1 dendrites and the terminals of PAM-α1 occupy the same MB compartment (Aso et al., 2014a); the DopR1 dopamine receptor is required in the KCs of that compartment (Figure 6); MBON-α1 in turn sends a portion of its outputs to the dendrites of PAM-α1 (Figures 1, 2) closing the loop; synaptic signaling by all three cell types—α/β KCs, MBON-α1, and PAM-α1—is required during LTM formation and consolidation (Figures 3, 7, 9). These findings strongly support our model that feedback signals from α/β KCs, mediated by MBON-α1, play a critical role in controlling the rewarding dopamine signals from PAM-α1 (Figure 11). Inhibitory recurrent circuits in the MBs have been implicated in appetitive learning of honeybees (Grunewald, 1999a, 1999b). Our present study reveals a new circuit motif, a feedback circuit that is required for dopamine neurons to provide reinforcement during appetitive LTM formation.
Figure 11. Recurrent reward circuit drives appetitive LTM formation.
Feedback circuit model of appetitive LTM formation. Neuronal signal of a sugar reward mediated by PAM-α1 converges with olfactory information in the α/β KCs. The coincidental signal is read out through MBON-α1 to give glutamatergic feedback onto PAM-α1 for the gain control of the dopamine release. Appetitive LTM is read out through MBON-α1 to activate other downstream targets.
Dopamine has been thought to simply relay rewarding or punitive stimuli (Gerber et al., 2004; Waddell, 2013). However, our results call into question this prevailing circuit model. More specifically, PAM-α1 might integrate simultaneous inputs from sugar perception and the nascent memory trace to augment and sustain the dopamine release to gate LTM formation (Figure 11). The requirement of the NMDA receptor in PAM-α1 (Figure 4) further supports this model. Such integration by PAM-α1 might enhance the reward gain selectively in relevant sensory environments. In other words, the reinforcing signal for LTM formation may depend on the presence of other sensory stimuli (e.g., odor). As LTM formation is energetically costly (Mery and Kawecki, 2005; Placais and Preat, 2013; Musso et al., 2015), this gain control of the reinforcing signal might serve to restrict LTM formation to ecologically relevant situations. Although the requirement of NMDA receptor in PAM-α1 implies that MBON-α1 provides excitatory input, the synaptic connectivity between MBON-α1 and PAM-α1 awaits physiological demonstration, given functional inhibitory glutamate receptor signaling (Liu and Wilson, 2013).
In addition to the role in memory acquisition, the PAM-α1 output is required during consolidation (Figure 9A,B). The dopamine release is likely to be sustained by the ongoing activity of the recurrent circuit (Figure 9C–F). A recent study reported a consistent finding that the output from α/β KCs during consolidation has an essential role for appetitive and aversive LTM (Huang et al., 2012) in addition to their role in retrieval (Krashes et al., 2007; Trannoy et al., 2011; Cervantes-Sandoval et al., 2013; Xie et al., 2013). Recent studies revealed a gradual development of appetitive LTM after conditioning (Das et al., 2014; Huetteroth et al., 2015; Yamagata et al., 2015). Ongoing activity in the recurrent loop we propose here may provide a circuit mechanism for the gradual LTM development. In addition, previous studies reported that LTM consolidation in Drosophila (Placais et al., 2012; Musso et al., 2015) or in rats (Rossato et al., 2009) requires post-training dopamine inputs.
Our generalization experiments show that appetitive LTM is less specific to the trained odor, compared to STM (Figure 10). This result fits well into previous studies in mice and bees, demonstrating that long-lasting memories are more generalized (Stach and Giurfa, 2005; Wiltgen and Silva, 2007). More generalizable LTM makes sense from an ecological viewpoint: it is worth taking a chance for survival even if the smell is not exactly the same as learned.
In the fly brain, distinct types of dopamine neurons signal reward for STM and LTM, and these memories are independently formed in different MB lobes (Trannoy et al., 2011; Huetteroth et al., 2015; Yamagata et al., 2015). Octopamine has been widely accepted as a positive reinforcement signal in insects (Hammer, 1993; Hammer and Menzel, 1998; Schwaerzel et al., 2003; Schroll et al., 2006; Perry and Barron, 2013). In Drosophila, it is considered to provide inputs to dopamine neurons that induce STM formation (Burke et al., 2012; Das et al., 2014; Huetteroth et al., 2015). Recent studies in mammals reached a similar conclusion that memories with different temporal dynamics are mutually conflicting and formed in distinct areas, to which different classes of dopamine neurons project (Liljenstrom, 2003; Abraham and Robins, 2005; Kim and Hikosaka, 2013; Kim et al., 2014). Independent processing of STM and LTM might be a conserved strategy among animals.
Circuit mechanism of memory-guided behavior
In addition to the function in the recurrent reward circuit, MBON-α1 mediates retrieval of the LTM trace in the MB (Figure 8). MBON-α1 samples from the MB-α1 and terminates in the SIP and the SLP. Another type of MBONs also mediates appetitive LTM retrieval: MBON-α3 (also known as MB-V3) (Placais et al., 2013). In contrast to MBON-α1, blocking MBON-α3 during conditioning does not impair appetitive LTM acquisition (Placais et al., 2013). MBON-α3 arborizes dendrites in the tip of the α lobe and projects to the SMP and the SIP where the terminals of MBON-α1 and MBON-α3 are intermingled (Aso et al., 2014a). Therefore, appetitive LTM formed in the α/β KCs is read out through at least two different classes of MBONs. These MBONs converge in the SIP (Aso et al., 2014a) and might activate shared downstream targets to guide conditioned odor approach.
Interplay between reinforcing signals and learned information
The recent comprehensive connectivity map of the afferent and efferent neurons of the Drosophila MB revealed many potential feedback connections outside the MB (Aso et al., 2014a). Considering the central role of the MB in sensory integration and memory-guided behavior (Aso et al., 2014b), recurrent computation between learned information and reinforcement signals might be a fundamental principle of memory processing.
In both vertebrates and invertebrates, the activity of reinforcement neurons is modified upon associative learning (Hammer, 1993; Mirenowicz and Schultz, 1994; Riemensperger et al., 2005; Cohen et al., 2012; Schultz, 2013). Our results delineated such a feedback circuit, which was predicted by a physiological study in Drosophila (Riemensperger et al., 2005). In this circuit, MBON-α1 mediates monosynaptic feedback to the dopamine neurons. In contrast, there is no monosynaptic feedback to the dopamine neurons found in mammals, rather anatomical studies suggest such a feedback to be polysynaptic (Lisman and Grace, 2005; Watabe-Uchida et al., 2012). Further comparative studies should assess how the recurrent circuit motif of reinforcement is implemented in different animal brains.
Materials and methods
Flies
Canton-S was used as a wild-type strain. Generation and basic characterization of the split-GAL4 drivers (MB008B-GAL4, MB299B-GAL4, MB310C-GAL4, and MB323B-GAL4) are described in Aso et al. (2014a). R72D01-LexA was constructed using the methods described in Pfeiffer et al. (2010) and inserted into attP40. c739-GAL4 is an enhancer-trap GAL4 driver described in Yang et al. (1995). Flies were raised at 60% relative humidity at 24°C. Flies for the NMDAR knock down (Figure 4) were incubated at 30°C for 4–5 days prior to the experiment to facilitate the GAL4 activity.
The synaptic blockade experiments (Figures 3, 7-9) used F1 progeny of crosses between females of w;;UAS-shits1 (single copy of UAS-shits1 from Thomas Preat laboratory, CNRS, France) or w and males of the GAL4 drivers. The thermoactivation experiment (Figure 5) used F1 progeny of crosses between females of w; UAS-dTrpA1 (Hamada et al., 2008) or w and males of MB310C-GAL4 or w. The receptor knock down experiments (Figures 4, 6) used F1 progeny of crosses between females of UAS-Nmdar1RNAi (P(TRiP.HMS02200) attP40; Bloomington stock center #41667), UAS-Nmdar2RNAi (P(TRiP.HMS02012) attP2; Bloomington stock center #40846), UAS-DopR1RNAi (P(TRiP.HMC02344) attP2; Bloomington stock center #55239) (Ni et al., 2011) or CS and males of the GAL4 drivers. The dumb2 rescue experiments (Figure 6B) used F1 progeny of crosses between females of UAS-DopR1;;dumb2 or CS and males of MB247-GAL4; dumb2 or dumb2. CS flies were used as wild type (Figures 6B, 10).
For immunohistochemistry, the following reporter strains were crossed to the respective GAL4 or LexA drivers: pJFRC2-10xUAS-mCD8GFP in VK00005 (Figure 1A–D), pJFRC200-10XUAS-IVS-myr::smGFP-HA in attP18 (Figure 2A–D; Figure 2—figure supplement 1; Figure 3B,F; Figure 6—figure supplement 1A) and pJFRC216-13XLexAop2-IVS-myr::smGFP-V5 in su(Hw)attP8 (Figure 2A-E; Figure 2—figure supplement 1), pJFRC206-5xUAS-IVS-myr-smGFP-FLAG in VK00005 (Figure 1E,F; Figure 1—figure supplement 1; Figure 3—figure supplement 1A), pJFRC51-3xUAS-Syt-smHA in su(Hw)attP1 (presynaptic marker; Figure 1E), UAS-CD4::spGFP1-10 and LexAop-CD4::spGFP11 (Figure 2F).
pJFRC2 is described in Pfeiffer et al. (2010). pJFRC200 and pJFRC206 are described in Viswanathan et al. (2015) and pJFRC216 in Nern et al. (2015). pJFRC51 was generated by standard methods described in Pfeiffer et al. (2010). UAS-CD4::spGFP1-10 and LexAop-CD4::spGFP11 are described in Gordon and Scott (2009).
Multicolor flp-out (MCFO; Figure 1G) is a stochastic method that labels individual cells in different colors using a set of three UAS-STOP-epitope constructs that each expresses a different epitope when the STOP cassette is removed. The STOP cassettes in these constructs are each flanked by FRT sites that are removed in a stochastic way by limited expression of flp recombinase. Reagents for MCFO are described in Nern et al. (2015).
Immunohistochemistry
Dissection and immunohistochemistry of fly brains were done as previously described (Aso et al., 2014a). The following antibodies were used: rabbit-anti-GFP (1:1000; A11122; Invitrogen), mouse-anti-GFP (1:200; UC Davis/NIH Neuromab Facility; clone N86/38; for GRASP), mouse anti-nc82 (1:33.3; Developmental Studies Hybridoma Bank, Univ. Iowa, Iowa City, IA, United States) (Hofbauer et al., 2009), rat-anti-nCad (1:200; DN-Ex #8; Developmental Studies Hybridoma Bank, University of Iowa), rabbit anti-HA (1:300; Cell Signaling Technology, MA, United States), rat anti-FLAG (1:200; Novus Biologicals, Littleton, CO, United States), mouse anti-Drosophila ChAT (ChAT4B1; 1: 100; Developmental Studies Hybridoma Bank, Univ. Iowa) (Takagawa and Salvaterra, 1996), rabbit anti-Drosophila GAD1 (1:1000; a gift from Dr FR Jackson) (Featherstone et al., 2000), rabbit anti-DvGluT (1:5000; a gift from Dr A DiAntonio) (Daniels et al., 2008) as primary antibodies, and cross-adsorbed secondary antibodies to IgG (H+L): AlexaFluor-488 donkey anti-mouse (1:400; Jackson Labs), Cy3 donkey anti-rabbit (1:500; Jackson Labs), AlexaFluor-647 donkey anti-rat (1:300; Jackson Labs), AlexaFluor-488 goat anti-rabbit (1:800; A11034; Invitrogen, Carlsbad, CA, United States), and AlexaFluor-568 goat anti-mouse (1:400; A11031; Invitrogen).
Confocal images were obtained by using LSM710 (Zeiss, Oberkochen, Germany) (Figures 1A–F, 2A,E, 3B,F, Figure 1—figure supplement 1, Figure 2—figure supplement 1, Figure 3—figure supplement 1, Figure 6—figure supplement 1) and FV1200 (Olympus, Tokyo, Japan) (Figure 2F) and processed by using ImageJ. The magnified images in SIP and SLP (Figure 2B–D) were obtained by using LSM880 (Zeiss) with Airyscan and were deconvoluted using the Fiji plugin provided by Bob Dougherty (http://fiji.sc/Deconvolution). Airyscan is equipped with 32 GaAsP detectors that collect light from one illumination spot. It can resolve 140 nm (lateral) or 400 nm (axial) at 488-nm wavelength. For the 3D rendering video, confocal images from LSM710 were deconvoluted using the Fiji plugin and then were subjected to 3D image rendering software (Volocity: from PerkinElmer, Waltham, MA, United States).
Behavioral assays
The conditioning and testing protocol was as described previously with minor modifications (Liu et al., 2012; Aso et al., 2014b; Yamagata et al., 2015). Briefly, a group of approximately 50 flies in a training tube alternately received octan-3-ol (3-OCT; Merck) and 4-methylcyclohexanol (4-MCH; Sigma–Aldrich, St. Louis, MO, United States) for 1 min in a constant air stream with or without dried sucrose paper. 3-OCT and 4-MCH were diluted 1% and 2%, respectively, in paraffin oil (Sigma–Aldrich), placed in a cup with a diameter of 14 mm and presented to flies. For thermoactivation experiments (Figure 5), 3-OCT and 4-MCH were diluted 10% in paraffin oil, placed in a cup with a diameter of 3 mm and 5, respectively, and presented to flies. For the generalization experiments (Figure 10), 1% 1-octen-3-ol (Sigma–Aldrich) and 2% 2-methylcyclohexanol (Sigma–Aldrich) were also utilized. These diluted odors were mixed with the respective ratios. The restrictive temperature for the experiments with UAS-shits1 was 32°C and the permissive temperature was 24°C, measured with Venta-Hygrometer (Venta Luftwäscher GmbH, Weingarten, Germany). At the test, the trained flies were allowed to choose between MCH and OCT for 2 min in a custom-made transparent Plexiglas T-maze, illuminated by infrared LEDs (Osram 720-SFH487P, Mouser electronics, Mansfield, TX, United States), and the walls were covered with Fluon (Insect-a-Slip, PTFE30, BioQuip Products, Inc., Rancho Dominguez, CA, United States) and the distribution of flies was imaged by cameras (FFMV-03M2M, Point Grey, Richmond, Canada). Captured images were sent to the computer and the fly number in each tube was counted by a custom-made ImageJ macro. The preference index was calculated by taking the mean indices of the last 60 s in the 2-min choice and the learning index was calculated by taking the mean of preference indices of the two reciprocally trained groups. Half of the trained groups received reinforcement together with the first presented odor and the other half with the second odor to cancel the effect of the order of reinforcement.
For thermoactivation with dTrpA1 (Figure 5), flies were trained by being transferred from a background temperature of 24°C to a prewarmed tube in a climate box (30°C) and presented with the training odorant for 1 min.
Flies were aged 3–10 days after eclosion and were starved so that the mortality rate reaches 5–15% at the test. Between the training and the test, flies were kept without food. Conditioning was performed in dim red light and testing was in darkness.
Statistics
Statistical analyses were performed with StatPlus and Prism5 (GraphPad, La Jolla, CA, United States). Data did not violate the assumption of normal distribution (Shapiro–Wilk test) and homogeneity of variance (Bartlett test). Therefore, the data were analyzed with parametric statistics: one-sample t-test or one-way analysis of variance followed by the planned pairwise multiple comparisons (Bonferroni). The significance level of statistical tests was set to 0.05.
Acknowledgements
We thank AB Friedrich, A Kucher, S Prech, T Tagawa, and T Onodera for excellent technical assistance; L Nevin, K Tsutsui, K Oyama, B Gerber, and Tanimoto-lab members for critical reading and discussions. We are also grateful to T Preat, J Dubnau, Bloomington stock center, and the TRiP at Harvard Medical School (NIH/NIGMS R01-GM084947) for flies. We also thank members of the Janelia FlyLight Project Team and Janelia Scientific Computing and fly facility for experimental assistance.
Funding Statement
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Funding Information
This paper was supported by the following grants:
Deutsche Forschungsgemeinschaft (DFG) TA 552/5-1 to Hiromu Tanimoto.
MEXT/JSPS KAKENHI 266646 to Toshiharu Ichinose.
MEXT/JSPS KAKENHI 15K14307 to Hiromu Tanimoto.
MEXT/JSPS KAKENHI 26840110 to Nobuhiro Yamagata.
MEXT/JSPS KAKENHI 25890003 to Hiromu Tanimoto.
MEXT/JSPS KAKENHI 26250001 to Hiromu Tanimoto.
MEXT/JSPS KAKENHI 26120705 to Hiromu Tanimoto.
MEXT/JSPS KAKENHI 26119503 to Hiromu Tanimoto.
Naito Foundation to Hiromu Tanimoto.
Kurata Memorial Hitachi Science and Technology Foundation to Nobuhiro Yamagata.
Uehara Memorial Foundation to Nobuhiro Yamagata.
Howard Hughes Medical Institute (HHMI) to Yoshinori Aso, Gerald M Rubin.
The Strategic Research Program for Brain Sciences to Hiromu Tanimoto.
Additional information
Competing interests
The authors declare that no competing interests exist.
Author contributions
TI, Conception and design, Acquisition of data, Analysis and interpretation of data, Drafting or revising the article.
YA, Conception and design, Acquisition of data, Analysis and interpretation of data, Contributed unpublished essential data or reagents.
NY, Conception and design, Acquisition of data, Analysis and interpretation of data.
AA, Acquisition of data, Analysis and interpretation of data.
GMR, Analysis and interpretation of data, Drafting or revising the article, Contributed unpublished essential data or reagents.
HT, Conception and design, Analysis and interpretation of data, Drafting or revising the article.
References
- Abraham WC, Robins A. Memory retention–the synaptic stability versus plasticity dilemma. Trends in Neurosciences. 2005;28:73–78. doi: 10.1016/j.tins.2004.12.003. [DOI] [PubMed] [Google Scholar]
- Alexander J, Jr, Audesirk TE, Audesirk GJ. One-trial reward learning in the snail Lymnea stagnalis. Journal of Neurobiology. 1984;15:67–72. doi: 10.1002/neu.480150107. [DOI] [PubMed] [Google Scholar]
- Aso Y, Grubel K, Busch S, Friedrich AB, Siwanowicz I, Tanimoto H. The mushroom body of adult Drosophila characterized by GAL4 drivers. Journal of Neurogenetics. 2009;23:156–172. doi: 10.1080/01677060802471718. [DOI] [PubMed] [Google Scholar]
- Aso Y, Hattori D, Yu Y, Johnston RM, Iyer NA, Ngo TT, Dionne H, Abbott L, Axel R, Tanimoto H, Rubin GM. The neuronal architecture of the mushroom body provides a logic for associative learning. eLife. 2014a;3:e04577. doi: 10.7554/eLife.04577. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aso Y, Sitaraman D, Ichinose T, Kaun KR, Vogt K, Belliart-Guerin G, Placais PY, Robie AA, Yamagata N, Schnaitmann C, Rowell WJ, Johnston RM, Ngo TT, Chen N, Korff W, Nitabach MN, Heberlein U, Preat T, Branson KM, Tanimoto H, Rubin GM. Mushroom body output neurons encode valence and guide memory-based action selection in Drosophila. eLife. 2014b;3:e04580. doi: 10.7554/eLife.04580. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boto T, Louis T, Jindachomthong K, Jalink K, Tomchik SM. Dopaminergic modulation of cAMP drives nonlinear plasticity across the Drosophila mushroom body lobes. Current Biology. 2014;24:822–831. doi: 10.1016/j.cub.2014.03.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burke CJ, Huetteroth W, Owald D, Perisse E, Krashes MJ, Das G, Gohl D, Silies M, Certel S, Waddell S. Layered reward signalling through octopamine and dopamine in Drosophila. Nature. 2012;492:433–437. doi: 10.1038/nature11614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burke CJ, Waddell S. Remembering nutrient quality of sugar in Drosophila. Current Biology. 2011;21:746–750. doi: 10.1016/j.cub.2011.03.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Campbell RA, Honegger KS, Qin H, Li W, Demir E, Turner GC. Imaging a population code for odor identity in the Drosophila mushroom body. The Journal of Neuroscience. 2013;33:10568–10581. doi: 10.1523/JNEUROSCI.0682-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cervantes-Sandoval I, Martin-Pena A, Berry JA, Davis RL. System-like consolidation of olfactory memories in Drosophila. The Journal of Neuroscience. 2013;33:9846–9854. doi: 10.1523/JNEUROSCI.0451-13.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen JY, Haesler S, Vong L, Lowell BB, Uchida N. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature. 2012;482:85–88. doi: 10.1038/nature10754. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Colomb J, Kaiser L, Chabaud MA, Preat T. Parametric and genetic analysis of Drosophila appetitive long-term memory and sugar motivation. Genes, brain, and behavior. 2009;8:407–415. doi: 10.1111/j.1601-183X.2009.00482.x. [DOI] [PubMed] [Google Scholar]
- Daniels RW, Gelfand MV, Collins CA, DiAntonio A. Visualizing glutamatergic cell bodies and synapses in Drosophila larval and adult CNS. The Journal of Comparative Neurology. 2008;508:131–152. doi: 10.1002/cne.21670. [DOI] [PubMed] [Google Scholar]
- Das G, Klappenbach M, Vrontou E, Perisse E, Clark CM, Burke CJ, Waddell S. Drosophila learn opposing components of a compound food stimulus. Current biology. 2014;24:1723–1730. doi: 10.1016/j.cub.2014.05.078. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Featherstone DE, Rushton EM, Hilderbrand-Chae M, Phillips AM, Jackson FR, Broadie K. Presynaptic glutamic acid decarboxylase is required for induction of the postsynaptic receptor field at a glutamatergic synapse. Neuron. 2000;27:71–84. doi: 10.1016/S0896-6273(00)00010-6. [DOI] [PubMed] [Google Scholar]
- Feinberg EH, Vanhoven MK, Bendesky A, Wang G, Fetter RD, Shen K, Bargmann CI. GFP reconstitution across synaptic partners (GRASP) defines cell contacts and synapses in living nervous systems. Neuron. 2008;57:353–363. doi: 10.1016/j.neuron.2007.11.030. [DOI] [PubMed] [Google Scholar]
- Garcia J, Kimeldorf DJ, Koelling RA. Conditioned aversion to saccharin resulting from exposure to gamma radiation. Science. 1955;122:157–158. [PubMed] [Google Scholar]
- Gerber B, Tanimoto H, Heisenberg M. An engram found? Evaluating the evidence from fruit flies. Current Opinion in Neurobiology. 2004;14:737–744. doi: 10.1016/j.conb.2004.10.014. [DOI] [PubMed] [Google Scholar]
- Gervasi N, Tchenio P, Preat T. PKA dynamics in a Drosophila learning center: coincidence detection by rutabaga adenylyl cyclase and spatial regulation by dunce phosphodiesterase. Neuron. 2010;65:516–529. doi: 10.1016/j.neuron.2010.01.014. [DOI] [PubMed] [Google Scholar]
- Gordon MD, Scott K. Motor control in a Drosophila taste circuit. Neuron. 2009;61:373–384. doi: 10.1016/j.neuron.2008.12.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grunewald B. Morphology of feedback neurons in the mushroom body of the honeybee, Apis mellifera. The Journal of Comparative Neurology. 1999a;404:114–126. doi: 10.1002/(sici)1096-9861(19990201)404:1<114::aid-cne9>3.3.co;2-r. [DOI] [PubMed] [Google Scholar]
- Grunewald B. Physiological properties and response modulations of mushroom body feedback neurons during olfactory learning in the honeybee, Apis mellifera. Journal of Comparative Physiology A. 1999b;185:565–576. [Google Scholar]
- Hamada FN, Rosenzweig M, Kang K, Pulver SR, Ghezzi A, Jegla TJ, Garrity PA. An internal thermal sensor controlling temperature preference in Drosophila. Nature. 2008;454:217–220. doi: 10.1038/nature07001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hammer M. An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees. Nature. 1993;366:59–63. doi: 10.1038/366059a0. [DOI] [PubMed] [Google Scholar]
- Hammer M, Menzel R. Multiple sites of associative odor learning as revealed by local brain microinjections of octopamine in honeybees. Learning & Memory. 1998;5:146–156. [PMC free article] [PubMed] [Google Scholar]
- Hofbauer A, Ebel T, Waltenspiel B, Oswald P, Chen YC, Halder P, Biskup S, Lewandrowski U, Winkler C, Sickmann A, Buchner S, Buchner E. The Wuerzburg hybridoma library against Drosophila brain. Journal of Neurogenetics. 2009;23:78–91. doi: 10.1080/0167706080247162. [DOI] [PubMed] [Google Scholar]
- Honegger KS, Campbell RA, Turner GC. Cellular-resolution population imaging reveals robust sparse coding in the Drosophila mushroom body. The Journal of Neuroscience. 2011;31:11772–11785. doi: 10.1523/JNEUROSCI.1099-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huang C, Wang P, Xie Z, Wang L, Zhong Y. The differential requirement of mushroom body alpha/beta subdivisions in long-term memory retrieval in Drosophila. Protein & Cell. 2013;4:512–519. doi: 10.1007/s13238-013-3035-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huang C, Zheng X, Zhao H, Li M, Wang P, Xie Z, Wang L, Zhong Y. A permissive role of mushroom body alpha/beta core neurons in long-term memory consolidation in Drosophila. Current Biology. 2012;22:1981–1989. doi: 10.1016/j.cub.2012.08.048. [DOI] [PubMed] [Google Scholar]
- Huetteroth W, Perisse E, Lin S, Klappenbach M, Burke C, Waddell S. Sweet taste and nutrient value subdivide rewarding dopaminergic neurons in Drosophila. Current Biology. 2015;25:751–758. doi: 10.1016/j.cub.2015.01.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jackson FR, Newby LM, Kulkarni SJ. Drosophila GABAergic systems: sequence and expression of glutamic acid decarboxylase. Journal of Neurochemistry. 1990;54:1068–1078. doi: 10.1111/j.1471-4159.1990.tb02359.x. [DOI] [PubMed] [Google Scholar]
- Jenett A, Rubin GM, Ngo TT, Shepherd D, Murphy C, Dionne H, Pfeiffer BD, Cavallaro A, Hall D, Jeter J, Iyer N, Fetter D, Hausenfluck JH, Peng H, Trautman ET, Svirskas RR, Myers EW, Iwinski ZR, Aso Y, DePasquale GM, Enos A, Hulamm P, Lam SC, Li HH, Laverty TR, Long F, Qu L, Murphy SD, Rokicki K, Safford T, Shaw K, Simpson JH, Sowell A, Tae S, Yu Y, Zugates CT. A GAL4-driver line resource for Drosophila neurobiology. Cell Reports. 2012;2:991–1001. doi: 10.1016/j.celrep.2012.09.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kim HF, Ghazizadeh A, Hikosaka O. Separate groups of dopamine neurons innervate caudate head and tail encoding flexible and stable value memories. Frontiers in neuroanatomy. 2014;8:120. doi: 10.3389/fnana.2014.00120. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kim HF, Hikosaka O. Distinct basal ganglia circuits controlling behaviors guided by flexible and stable values. Neuron. 2013;79:1001–1010. doi: 10.1016/j.neuron.2013.06.044. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kim YC, Lee HG, Han KA. D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. The Journal of Neuroscience. 2007;27:7640–7647. doi: 10.1523/JNEUROSCI.1167-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kitamoto T. Conditional modification of behavior in Drosophila by targeted expression of a temperature-sensitive shibire allele in defined neurons. Journal of Neurobiology. 2001;47:81–92. doi: 10.1002/neu.1018. [DOI] [PubMed] [Google Scholar]
- Krashes MJ, Keene AC, Leung B, Armstrong JD, Waddell S. Sequential use of mushroom body neuron subsets during Drosophila odor memory processing. Neuron. 2007;53:103–115. doi: 10.1016/j.neuron.2006.11.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krashes MJ, Waddell S. Rapid consolidation to a radish and protein synthesis-dependent long-term memory after single-session appetitive olfactory conditioning in Drosophila. The Journal of Neuroscience. 2008;28:3103–3113. doi: 10.1523/JNEUROSCI.5333-07.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liljenstrom H. Neural stability and flexibility: a computational approach. Neuropsychopharmacology. 2003;28(Suppl 1):S64–S73. doi: 10.1038/sj.npp.1300137. [DOI] [PubMed] [Google Scholar]
- Lisman JE, Grace AA. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron. 2005;46:703–713. doi: 10.1016/j.neuron.2005.05.002. [DOI] [PubMed] [Google Scholar]
- Liu C, Placais PY, Yamagata N, Pfeiffer BD, Aso Y, Friedrich AB, Siwanowicz I, Rubin GM, Preat T, Tanimoto H. A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature. 2012;488:512–516. doi: 10.1038/nature11304. [DOI] [PubMed] [Google Scholar]
- Liu WW, Wilson RI. Glutamate is an inhibitory neurotransmitter in the Drosophila olfactory system. Proceedings of the National Academy of Sciences of USA. 2013;110:10294–10299. doi: 10.1073/pnas.1220560110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mery F, Kawecki TJ. A cost of long-term memory in Drosophila. Science. 2005;308:1148. doi: 10.1126/science.1111331. [DOI] [PubMed] [Google Scholar]
- Mirenowicz J, Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. Journal of Neurophysiology. 1994;72:1024–1027. doi: 10.1152/jn.1994.72.2.1024. [DOI] [PubMed] [Google Scholar]
- Musso PY, Tchenio P, Preat T. Delayed dopamine signaling of energy level builds appetitive long-term memory in Drosophila. Cell Reports. 2015;10:1023–1031. doi: 10.1016/j.celrep.2015.01.036. [DOI] [PubMed] [Google Scholar]
- Nern A, Pfeiffer BD, Rubin GM. Optimized tools for multicolor stochastic labeling reveal diverse stereotyped cell arrangements in the fly visual system. Proceedings of the National Academy of Sciences of USA. 2015;112:E2967–E2976. doi: 10.1073/pnas.1506763112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ni JQ, Zhou R, Czech B, Liu LP, Holderbaum L, Yang-Zhou D, Shim HS, Tao R, Handler D, Karpowicz P, Binari R, Booker M, Brennecke J, Perkins LA, Hannon GJ, Perrimon N. A genome-scale shRNA resource for transgenic RNAi in Drosophila. Nature Methods. 2011;8:405–407. doi: 10.1038/nmeth.1592. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pagani MR, Oishi K, Gelb BD, Zhong Y. The phosphatase SHP2 regulates the spacing effect for long-term memory induction. Cell. 2009;139:186–198. doi: 10.1016/j.cell.2009.08.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pai TP, Chen CC, Lin HH, Chin AL, Lai JS, Lee PT, Tully T, Chiang AS. Drosophila ORB protein in two mushroom body output neurons is necessary for long-term memory formation. Proceedings of the National Academy of Sciences of USA. 2013;110:7898–7903. doi: 10.1073/pnas.1216336110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perisse E, Yin Y, Lin AC, Lin S, Huetteroth W, Waddell S. Different kenyon cell populations drive learned approach and avoidance in Drosophila. Neuron. 2013;79:945–956. doi: 10.1016/j.neuron.2013.07.045. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perry CJ, Barron AB. Neural mechanisms of reward in insects. Annual Review of Entomology. 2013;58:543–562. doi: 10.1146/annurev-ento-120811-153631. [DOI] [PubMed] [Google Scholar]
- Pfeiffer BD, Ngo TT, Hibbard KL, Murphy C, Jenett A, Truman JW, Rubin GM. Refinement of tools for targeted gene expression in Drosophila. Genetics. 2010;186:735–755. doi: 10.1534/genetics.110.119917. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Philips GT, Kopec AM, Carew TJ. Pattern and predictability in memory formation: from molecular mechanisms to clinical relevance. Neurobiology of Learning and Memory. 2013;105:117–124. doi: 10.1016/j.nlm.2013.05.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Placais PY, Preat T. To favor survival under food shortage, the brain disables costly memory. Science. 2013;339:440–442. doi: 10.1126/science.1226018. [DOI] [PubMed] [Google Scholar]
- Placais PY, Trannoy S, Friedrich AB, Tanimoto H, Preat T. Two pairs of mushroom body efferent neurons are required for appetitive long-term memory retrieval in Drosophila. Cell Reports. 2013;5:769–780. doi: 10.1016/j.celrep.2013.09.032. [DOI] [PubMed] [Google Scholar]
- Placais PY, Trannoy S, Isabel G, Aso Y, Siwanowicz I, Belliart-Guerin G, Vernier P, Birman S, Tanimoto H, Preat T. Slow oscillations in two pairs of dopaminergic neurons gate long-term memory formation in Drosophila. Nature Neuroscience. 2012;15:592–599. doi: 10.1038/nn.3055. [DOI] [PubMed] [Google Scholar]
- Qin H, Cressy M, Li W, Coravos JS, Izzi SA, Dubnau J. Gamma neurons mediate dopaminergic input during aversive olfactory memory formation in Drosophila. Current Biology. 2012;22:608–614. doi: 10.1016/j.cub.2012.02.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Riemensperger T, Voller T, Stock P, Buchner E, Fiala A. Punishment prediction by dopaminergic neurons in Drosophila. Current Biology. 2005;15:1953–1960. doi: 10.1016/j.cub.2005.09.042. [DOI] [PubMed] [Google Scholar]
- Robinson IM, Ranjan R, Schwarz TL. Synaptotagmins I and IV promote transmitter release independently of Ca(2+) binding in the C(2)A domain. Nature. 2002;418:336–340. doi: 10.1038/nature00915. [DOI] [PubMed] [Google Scholar]
- Rossato JI, Bevilaqua LR, Izquierdo I, Medina JH, Cammarota M. Dopamine controls persistence of long-term memory storage. Science. 2009;325:1017–1020. doi: 10.1126/science.1172545. [DOI] [PubMed] [Google Scholar]
- Schroll C, Riemensperger T, Bucher D, Ehmer J, Völler T, Erbguth K, Gerber B, Hendel T, Nagel G, Buchner E, Fiala A. Light-induced activation of distinct modulatory neurons triggers appetitive or aversive learning in Drosophila larvae. Current Biology. 2006;16:1741–1747. doi: 10.1016/j.cub.2006.07.023. [DOI] [PubMed] [Google Scholar]
- Schultz W. Updating dopamine reward signals. Current Opinion in Neurobiology. 2013;23:229–238. doi: 10.1016/j.conb.2012.11.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schwaerzel M, Monastirioti M, Scholz H, Friggi-Grelin F, Birman S, Heisenberg M. Dopamine and octopamine differentiate between aversive and appetitive olfactory memories in Drosophila. The Journal of Neuroscience. 2003;23:10495–10502. doi: 10.1523/JNEUROSCI.23-33-10495.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sejourne J, Placais PY, Aso Y, Siwanowicz I, Trannoy S, Thoma V, Tedjakumala SR, Rubin GM, Tchénio P, Ito K, Isabel G, Tanimoto H, Preat T. Mushroom body efferent neurons responsible for aversive olfactory memory retrieval in Drosophila. Nature Neuroscience. 2011;14:903–910. doi: 10.1038/nn.2846. [DOI] [PubMed] [Google Scholar]
- Stach S, Giurfa M. The influence of training length on generalization of visual feature assemblies in honeybees. Behavioural Brain Research. 2005;161:8–17. doi: 10.1016/j.bbr.2005.02.008. [DOI] [PubMed] [Google Scholar]
- Takagawa K, Salvaterra P. Analysis of choline acetyltransferase protein in temperature sensitive mutant flies using newly generated monoclonal antibody. Neuroscience Research. 1996;24:237–243. doi: 10.1016/0168-0102(95)00999-X. [DOI] [PubMed] [Google Scholar]
- Tomchik SM, Davis RL. Dynamics of learning-related cAMP signaling and stimulus integration in the Drosophila olfactory pathway. Neuron. 2009;64:510–521. doi: 10.1016/j.neuron.2009.09.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Trannoy S, Redt-Clouet C, Dura JM, Preat T. Parallel processing of appetitive short- and long-term memories in Drosophila. Current Biology. 2011;21:1647–1653. doi: 10.1016/j.cub.2011.08.032. [DOI] [PubMed] [Google Scholar]
- Turner GC, Bazhenov M, Laurent G. Olfactory representations by Drosophila mushroom body neurons. Journal of Neurophysiology. 2008;99:734–746. doi: 10.1152/jn.01283.2007. [DOI] [PubMed] [Google Scholar]
- Viswanathan S, Williams ME, Bloss EB, Stasevich TJ, Speer CM, Nern A, Pfeiffer BD, Hooks BM, Li WP, English BP, Tian T, Henry GL, Macklin JJ, Patel R, Gerfen CR, Zhuang X, Wang Y, Rubin GM, Looger LL. High-performance probes for light and electron microscopy. Nature Methods. 2015;12:568–576. doi: 10.1038/nmeth.3365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vogt K, Schnaitmann C, Dylla KV, Knapek S, Aso Y, Rubin GM, Tanimoto H. Shared mushroom body circuits underlie visual and olfactory memories in Drosophila. eLife. 2014;3:e02395. doi: 10.7554/eLife.02395. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Waddell S. Reinforcement signalling in Drosophila; dopamine does it all after all. Current Opinion in Neurobiology. 2013;23:324–329. doi: 10.1016/j.conb.2013.01.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Watabe-Uchida M, Zhu L, Ogawa SK, Vamanrao A, Uchida N. Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron. 2012;74:858–873. doi: 10.1016/j.neuron.2012.03.017. [DOI] [PubMed] [Google Scholar]
- Wiltgen BJ, Silva AJ. Memory for context becomes less specific with time. Learning & Memory. 2007;14:313–317. doi: 10.1101/lm.430907. [DOI] [PubMed] [Google Scholar]
- Xia S, Miyashita T, Fu TF, Lin WY, Wu CL, Pyzocha L, Lin IR, Saitoe M, Tully T, Chiang AS. NMDA receptors mediate olfactory learning and memory in Drosophila. Current Biology. 2005;15:603–615. doi: 10.1016/j.cub.2005.02.059. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xie Z, Huang C, Ci B, Wang L, Zhong Y. Requirement of the combination of mushroom body gamma lobe and alpha/beta lobes for the retrieval of both aversive and appetitive early memories in Drosophila. Learning & Memory. 2013;20:474–481. doi: 10.1101/lm.031823.113. [DOI] [PubMed] [Google Scholar]
- Yamagata N, Ichinose T, Aso Y, Placais PY, Friedrich AB, Sima RJ, Preat T, Rubin GM, Tanimoto H. Distinct dopamine neurons mediate reward signals for short- and long-term memories. Proceedings of the National Academy of Sciences of USA. 2015;112:578–583. doi: 10.1073/pnas.1421930112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yang MY, Armstrong JD, Vilinsky I, Strausfeld NJ, Kaiser K. Subdivision of the Drosophila mushroom bodies by enhancer-trap expression patterns. Neuron. 1995;15:45–54. doi: 10.1016/0896-6273(95)90063-2. [DOI] [PubMed] [Google Scholar]