Abstract
Insects are widely used as models to study neural mechanisms of learning and memory. Our recent studies on crickets, together with reports on other insect species, suggest that some fundamental differences exist in neural and molecular mechanisms of learning and memory among different species of insects, particularly between crickets and fruit flies. First, we suggested that in crickets octopamine (OA) and dopamine (DA) neurons convey reward and punishment signals, respectively, in associated learning. On the other hand, it has been reported that in fruit flies different sets of DA neurons convey reward or punishment signals. Secondly, we have suggested that in crickets OA and DA neurons participate in the retrieval of appetitive and aversive memories, respectively, while this is not the case in fruit flies. Thirdly, cyclic AMP signaling is critical for short-term memory formation in fruit flies, but not in crickets. Finally, nitric oxide-cyclic GMP signaling and calcium-calmodulin signaling are critical for long-term memory (LTM) formation in crickets, but such roles have not been reported in fruit flies. Not all of these differences can be ascribed to different experimental methods used in studies. We thus suggest that there are unexpected diversities in basic mechanisms of learning and memory among different insect species, especially between crickets and fruit flies. Studies on a larger number of insect species will help clarify the diversity of learning and memory mechanisms in relation to functional adaptation to the environment and evolutionary history.
Keywords: Crickets, Insects, Olfactory learning, Octopamine, Dopamine, Long-term memory, Evolution
Introduction
Insects have excellent learning and memory capabilities despite the relative simplicity of their central nervous systems, and thus they have been used as models to study basic mechanisms underlying learning and memory [1-5]. Much knowledge has been accumulated regarding neural and molecular mechanisms of learning and memory in a few species of insects, such as the fruit fly Drosophila melanogaster, the honeybee Apis mellifera, and the cricket Gryllus bimaculatus. In our studies in crickets, we noted that some of the basic features of neural mechanisms of learning and memory in crickets differ from those reported in fruit flies, although they are similar to those reported in honeybees. Such differences among insects have not been recognized in previous studies.
Here we review our major findings on learning and memory in crickets, and discuss how they are similar or different from those reported in other species. We also discuss whether the observed differences reflect species-specific features or can be explained by other factors such as the different experimental methods used. Finally, we briefly discuss the possible evolutionary perspective on diversity in learning and memory mechanisms in insects.
Review
Procedures for conditioning
We first briefly describe the experimental procedure used in our study of classical conditioning in crickets. We used a “classical conditioning and operant testing procedure”, which is based on the transfer of memory formed during classical conditioning to an operant testing situation [6,7]. For conditioning, crickets were individually placed in a beaker (Figure 1A). A filter paper soaked with an odor (conditioned stimulus, CS) was presented to the antennae, and then a drop of water or 20% sodium chloride solution (appetitive or aversive unconditioned stimulus, US) was applied to the mouth. In the operant odor preference test, crickets were individually placed in a test chamber and allowed to freely visit two odor sources on the floor (Figure 1B). The time that the crickets spent exploring each odor source with either the mouth or palpi was measured to evaluate relative odor preference of the crickets. In most experiments, crickets were subjected to an absolute appetitive or aversive conditioning procedure, in which an odor (CS+ or CS–) was paired with appetitive US or aversive US, and their preferences between the CS and a control odor were tested before and after conditioning. In other experiments, we used a differential conditioning procedure, in which an odor (CS+) was paired with appetitive US and another odor (CS–) was paired with aversive US. For pharmacological analysis, drugs were dissolved in cricket saline and injected into the hemolymph at 30 min before conditioning. Both within-group and between-group comparisons were used to evaluate the conditioning effect. Preferences before and after conditioning of a given group, as well as preferences after conditioning of different groups, were statistically compared.
Crickets exhibited excellent olfactory learning capabilities. One appetitive or aversive conditioning trial led to memory that lasted for at most a few hours, which is insensitive to amnestic treatment and to protein synthesis inhibitors, and is characterized as mid-term memory (MTM). Multiple conditioning trials led to memory that lasted for at least 24 hours, which requires de novo protein synthesis and is characterized as long-term memory (LTM) (Figure 2) [6,8]. The excellent olfactory learning capabilities of crickets are evidenced by our findings that (1) training on three consecutive days on fourth-instar nymphal crickets leads to lifetime memory retention, which is readily rewritten in response to new experience [9], (2) crickets can memorize seven pairs of odors at the same time [10], and (3) crickets can exhibit some forms of higher-order learning, including context-dependent discrimination learning [11], second-order conditioning [12], and sensory preconditioning [13].
Studies of classical conditioning on fruit flies and honeybees have been performed using somewhat different procedures. In aversive classical conditioning in the fruit fly Drosophila, a group of flies was exposed to two odors in the training chamber, one of which is paired with electric shock and the other is not. The animals were then exposed to both odors in a T-maze, one odor from each side [14]. For appetitive conditioning, a group of flies was exposed to an odor during presentation of sucrose solution and then exposed to another odor without presentation of sucrose [15]. In appetitive conditioning in honeybees, a bee was placed in a metal tube and an odor was presented to the antennae and then sucrose solution was presented to the antennae and the mouth. After training, the bee extended its proboscis in response to the presentation of conditioned odor [2]. For aversive conditioning, a harnessed bee was presented with an odor and then electric shock. After training, the bee exhibited sting extension in response to the conditioned odor [16]. On account of differences in conditioning procedures, previous studies concluded that many features of learning and memory are much the same among different insects. Here we focus on our recent findings that do not support the general notion that basic features of learning and memory systems are much the same among insects.
Roles of octopamine neurons and dopamine neurons in conveying reward and punishment signals
Elucidation of the neural mechanisms mediating reward or punishment signals in learning is one of the major subjects in neuroscience. In mammals, dopamine (DA) neurons in the midbrain mediate reward and punishment signals in associative learning [17]. We studied the effects of octopamine (OA) and DA receptor antagonists on appetitive and aversive olfactory conditioning in crickets [7]. Crickets injected with an OA receptor antagonist (epinastine or mianserin) into the hemolymph before conditioning exhibited impairment of appetitive conditioning of an odor with water reward (Figure 3A). On the other hand, such crickets exhibited no impairment of aversive conditioning of the same odor with sodium chloride punishment (Figure 3B). Their responses to water reward were also intact. Thus, OA receptor antagonists do not impair perception of olfactory CS or gustatory US. We thus concluded that OA neurons are specifically involved in conveying water reward in conditioning. We also found that injection of a DA receptor antagonist (fluphenazine, chlorpromazine, or spiperone) completely impaired aversive conditioning of an odor with sodium chloride punishment (Figure 3C). In contrast, it did not impair appetitive conditioning of the odor with water reward or aversive response to sodium chloride solution, indicating that DA receptor antagonists do not impair sensory functions necessary for learning (Figure 3D). These results similarly suggest that DA neurons are specifically involved in conveying sodium chloride punishment in conditioning. We also studied the roles of OA and DA neurons in appetitive and aversive conditioning of a visual pattern [18] and a color cue [19] and obtained the same results.
These findings in crickets are consistent with those in honeybees. In bees, it has been reported that OA neurons play roles in appetitive olfactory conditioning with sucrose reward [20,21], whereas DA neurons play roles in aversive olfactory conditioning with electric shock [16].
In fruit flies, some early neurogenetic studies suggested that OA and DA neurons convey sucrose reward and electric shock punishment, respectively, in olfactory conditioning [15,22], but recent extended studies have revealed that different subsets of DA neurons projecting to the mushroom body convey reward or punishment signals in olfactory learning [23-27]. The mushroom body is a higher-order olfactory and multisensory center in the insect brain that is implicated in olfactory and other forms of learning [1,2,4,28,29,30]. In fruit flies, OA neurons have been shown to act upstream of DA neurons and send sweet taste signal to DA neurons in appetitive learning [26,27]. The critical difference between fruit flies and crickets, therefore, is that DA neurons play critical roles in appetitive learning in fruit flies, but not in crickets. In fruit flies, it has been shown that appetitive reinforcement by DA neurons is mediated by Type 1 dopamine receptor (DopR1).
It can be argued that the observed difference in the roles of DA neurons in appetitive learning may be attributed to the difference of appetitive US used in the experiments; namely, water was reward in crickets whereas sucrose reward was used in fruit flies. This argument, however, does not match the finding in honeybees that OA neurons mediate sucrose reward in appetitive learning [20,21].
Roles of octopamine neurons and dopamine neurons in appetitive and aversive memory retrieval
We also found that OA and DA neurons participate in appetitive and aversive memory retrieval, respectively, in crickets [12]. Crickets were subjected to appetitive or aversive olfactory conditioning and were injected with an OA or DA receptor antagonist before a retention test. Injection of an OA receptor antagonist (epinastine or mianserin) impaired appetitive olfactory memory retrieval, but had no effect on aversive olfactory memory retrieval (Figure 4A). On the other hand, injection of a DA receptor antagonist (fluphenazine, chlorpromazine, or spiperone) impaired aversive memory retrieval but had no effect on appetitive memory retrieval (Figure 4B). We also found that injection of OA and DA receptor antagonists impaired appetitive and aversive memory retrieval, respectively, in visual pattern conditioning [12]. Therefore we concluded that OA and DA neurons participate in the retrieval of appetitive memory and aversive memory, respectively, in both olfactory and visual pattern learning.
This is in accordance with finding in honeybees that disruption of OA-ergic transmission in the antennal lobe, the primary olfactory center, by an OA receptor antagonist (mianserin) or by RNAi of the OA receptor gene disrupted appetitive olfactory memory retrieval [21]. The possible roles of DA neurons in aversive memory retrieval, however, have not been tested in honeybees.
In fruit flies, DA neurons participate in formation, but not retrieval, of electric shock-induced aversive memory [15]. In addition, it has been concluded that a subset of DA neurons projecting to the mushroom body (called PAM neurons) participates in formation, but not retrieval, of sugar-induced appetitive memory [24]. Thus, it appears that OA and DA neurons participate in memory retrieve in crickets but not in fruit flies. We discuss the implications of these findings in the next section.
Models of classical conditioning in insects
Because our findings in crickets that OA or DA neurons participate in appetitive or aversive memory retrieval, respectively, were not consistent with conventional neural models of classical conditioning proposed in fruit flies [15], we propose a new model [12]. Figure 5A depicts a model proposed by Schwaerzel et al. [15] to account for the roles of extrinsic and intrinsic neurons of the mushroom body in appetitive or aversive olfactory conditioning with sucrose reward or electric shock punishment in the fruit fly. The neural events that this model assumes are as follows: (1) “CS” neurons (intrinsic neurons comprising the mushroom body, called Kenyon cells) that convey signals about a CS make synaptic connections with dendrites of “CR” neurons (efferent neurons of the mushroom body lobe), activation of which leads to a conditioned response (CR) that mimics an unconditioned response (UR), but these synaptic connections are silent or very weak before conditioning, (2) OA- and DA-ergic efferent neurons projecting to the lobes (“OA/DA” neurons), which convey signals for appetitive and aversive US, respectively, make synaptic connections with axon terminals of “CS” neurons, and (3) the efficacy of synaptic transmission from “CS” neurons to “CR” neurons that induces a conditioned response (“CS–CR” synapse, which might not be monosynaptic) is strengthened by coincident activation of “CS” neurons and “OA/DA” neurons during conditioning.
We have proposed a new model (Figure 5B), with minimal modifications to the previous one by Schwaerzel et al. [15]. In our model, we assumed that (1) co-activation of “OA/DA” neurons and “CS” neurons are needed to activate “CR” neurons after conditioning (AND gate) and (2) synaptic connection from “CS” neurons to “OA/DA” neurons representing US (“CS–OA/DA” synapse) is strengthened by coincident activation of “CS” neurons and “OA/DA” neurons by pairing of a CS with a US. Strengthening of this synapse allows activation of “OA/DA” neurons by CS presentation and by subsequent activation of “CS” neurons, which then allows activation of “CR” neurons. In short, our model assumes enhancement of two synapses, “CS-CR” synapses and “CS-OA/DA” synapses, by conditioning; namely, it assumes formation of multiple memory traces [12,31]. It also assumes Kandelian synaptic plasticity for “CS–CR” synapses and Hebbian plasticity for “CS–OA/DA” synapses.
We also showed participation of OA and DA neurons in appetitive and aversive forms of second-order conditioning [12] and sensory preconditioning [13], and showed that these high-order learning phenomena can be accounted for by our new models with some modification of the above model.
Roles of cyclic AMP signaling in formation of short-term memory
In fruit flies, cyclic AMP (cAMP) signaling plays critical roles in formation of olfactory short-term memory (STM), a memory phase that lasts a few minutes after conditioning and is sensitive to amnestic treatment [4]. For example, rutabaga mutants, with defects in adenylyl cyclase, an enzyme producing cAMP, and dunce mutants, with defects in phosphodiesterase (PDE), which degrades cAMP, both exhibit deficiency in STM. In crickets, on the other hand, pharmacological intervention of cAMP signaling by an inhibitor of adenylyl cyclase or cAMP-dependent protein kinase (PKA) impairs formation of LTM but neither STM nor MTM [32]. A recent study in honeybees also showed that inhibitors of adenylyl cyclase do not block STM and MTM [33], indicating that biochemical processes underlying STM in crickets and honeybees differ from those in fruit flies.
It has been shown that rutabaga mutants exhibit a low but significant level of olfactory STM, and thus fruit flies possess a cAMP-independent component of STM [4]. Whether this minor component of STM in flies is based on biochemical processes similar to those underlying STM in crickets and honeybees remains a subject for future studies.
Roles of nitric oxide-cyclic GMP signaling in formation of long-term memory
Nitric oxide (NO) is a membrane-permeable molecule that functions in intercellular signaling [34]. It is produced by NO synthase (NOS), diffuses into neighboring cells, and stimulates soluble guanylyl cyclase (sGC) to produce cyclic GMP (cGMP) [34]. We found that injection of inhibitors of the enzyme catalyzing the formation of NO, cGMP, or cAMP prior to multiple-trial conditioning blocks LTM (Figure 6), whereas injection of an NO donor, a cGMP analogue, or a cAMP analogue prior to single-trial conditioning induces LTM. These observations suggest that the NO-cGMP pathway and cAMP pathway participate in LTM formation [32,35]. LTM induced by injection of an NO donor or a cGMP analogue paired with single-trial conditioning was blocked by inhibition of the cAMP pathway, but induction of LTM by a cAMP analogue was unaffected by inhibition of the NO-cGMP pathway, suggesting that the cAMP pathway is a downstream target of the NO-cGMP pathway for LTM formation. Inhibitors of the cyclic nucleotide-gated channel (CNG channel) or calmodulin blocked induction of LTM by the cGMP analogue paired with single-trial conditioning, but they did not affect induction of LTM by the cAMP analogue. Moreover, we recently obtained evidence to suggest that CaMKII intervenes between calmodulin and adenylyl cyclase, an enzyme producing cAMP [36]. These results suggest that the CNG channel and calcium-calmodulin and CaMKII are downstream targets of the NO-cGMP pathway and are upstream of the cAMP pathway (Figure 7). We also found that NO-cGMP signaling plays a critical role in LTM formation in visual learning in crickets [37].
We also demonstrated that RNAi of the NOS gene impairs olfactory LTM formation in crickets [38]. In situ hybridization demonstrated a high level of NOS mRNA expression in outer Kenyon cells of the mushroom body, in addition to some neurons around the antennal lobe and the base of the optic lobe. We thus assume that olfactory LTM is formed in the mushroom body, by interaction of outer and inner Kenyon cells.
We also demonstrated participation of NO signaling in LTM formation in cockroaches. Cockroaches exhibit an increased level of salivation in response to an odor paired with sucrose reward [39], which can be monitored by changes in responses of salivary neurons to odors [40,41]. Injection of an NOS inhibitor impairs formation of LTM, but not that of STM or MTM, in olfactory conditioning of activities of salivary neurons [42].
Studies in honeybees also suggested that the NO-cGMP signaling pathway and cAMP pathway in the antennal lobe act in parallel and are complementary for the formation of LTM [43,44]. This is in contrast to our conclusion that the NO-cGMP system and the cAMP system are serially arranged for LTM formation in crickets [35]. Thus, the manner by which NO signaling contributes to LTM formation may not be identical between crickets and honeybees. Participation of the CNG channel, calcium-calmodulin and CaMKII in LTM formation has also been demonstrated in honeybees [42].
Interestingly, so far no report has suggested the involvement of NO-cGMP signaling, or calcium-calmodulin signaling in biochemical cascades underlying LTM formation in fruit flies, although there have been extensive studies on biochemical cascades underlying LTM formation [4]. Biochemical cascades for LTM formation in fruit flies may differ from those in crickets and honeybees.
Evolutionary considerations
The findings discussed in this review, summarized in Table 1, suggest that many features of cellular and biochemical processes underlying learning and memory in fruit flies differ from those in crickets and honeybees. In contrast, the features of neural processes underlying learning and memory in honeybees are similar to those in crickets (Table 1). Crickets belong to an evolutionary basal group (the order Orthoptera), and fruit flies and honeybees belong to the order Diptera and Hymenoptera, respectively, both of which have emerged more recently. If the unique features of learning and memory in fruit flies represent those of dipteran insects, they may be due to re-organization of their central nervous system during the course of evolution. Dipterans are highly adapted for rapid aerial movement. They have short and streamlined bodies and large compound eyes, the hindwings are changed to halteres that function as gyroscopes, the mechanoreceptors of which inform the insect about rotation of the body during flight, and the brain is characterized by a large optic lobe (visual center) and a small mushroom body. Learning and memory mechanisms of dipterans may have been simplified as a trade-off to develop sophisticated neural mechanisms for visual and mechanosensory control of swift movement in the air. On the other hand, honeybees and other hymenopteran insects posses a high capability to learn the location, color, shape and odor of foods [2] and thus they may have retained, or elaborated, learning and memory systems established in earlier stages of insect evolution. Comparisons of only three species, however, do not allow deeper discussion on evolution, and studies on of a larger number of species, including apterygotes, are needed for better understanding of commonalities and diversities of learning and memory systems among insects.
Table 1.
Crickets ( Gryllus bimaculatus ) | Fruit flies ( Drosophila melanogaster ) | Honeybees ( Apis mellifera ) (A or B?) | |
---|---|---|---|
Learning | A: OA and DA neurons mediate reward and punishment signals, respectively [7,18,19]. | B: DA neurons mediate both reward and punishment signals; OA neurons send reward signal to DA neurons in appetitive learning [23,24,26]. | A [16,20,21] |
Memory retrieval | A: OA and DA neurons participate in appetitive and aversive memory retrieval, respectively [12]. | B: OA or DA neurons do not participate in memory retrieval [15,24]. | A [21] |
STM formation | A: cAMP signaling does not participate in STM formation [32,35]. | B: cAMP signaling participates in STM formation [4]. | A [33] |
LTM formation | A: NO-cGMP signaling participates in LTM formation [32,35]. | B: There is no report on participation of NO-cGMP signaling in LTM formation. | A [43,44] |
LTM: long-term memory: STM: short-term memory.
Conclusion
We conclude that there are unexpected diversities in basic mechanisms of learning and memory among different insect species, especially between crickets and fruit-flies. We recently found that the discrepancy, or error, between the actual US and the predicted US determines whether learning occurs in crickets [45], indicating that the prediction error theory is applicable to crickets. It is of great significance to study whether this finding is applicable to other species of insects. Insects are one of the most successful animals group in terms of species richness and diversity of life styles [46,47]. Elucidation of diversity of learning and memory mechanisms in insects in relation to functional adaptation to the environments and evolutionary history should emerge as a fascinating future subject.
Acknowledgements
This study was supported by a grant-in-aid from the Ministry of Education, Science, Sports and Culture of Japan to MM (Grant # 21370028, 24657049, 24370030).
Abbreviations
- OA
Octopamine
- DA
Dopamine
- cAMP
Cyclic adenosine monophosphate
- cGMP
Cyclic guanosine monophosphate
- LTM
Long-term memory
- MTM
Mid-term memory
- STM
Short-term memory
- US
Unconditioned stimulus
- CS
Conditioned stimulus
- UR
Unconditioned response
- CR
Conditioned response
- DopR1
Type 1 dopamine receptor
- PDE
Phosphodiesterase
- PKA
Cyclic AMP-dependent protein kinase
- NO
Nitric oxide
- CNG channel
Cyclic nucleotide-gated channel
- CaMKII
Calcium/calmodulin-dependent kinase II
- NOS
NO synthase
- sGC
Soluble guanylyl cyclase
- CREB
Cyclic AMP-responsive element-binding protein
Footnotes
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
MM wrote the manuscript, YH and HN made critical revision of the manuscript. All authors read and approved the final manuscript.
Contributor Information
Makoto Mizunami, Email: mizunami@sci.hokudai.ac.jp.
Yoshitaka Hamanaka, Email: hamanaka@sci.hokudai.ac.jp.
Hiroshi Nishino, Email: nishino@es.hokudai.ac.jp.
References
- 1.Heisenberg M. Mushroom body memoir: from maps to models. Nat Rev Neurosci. 2003;4:266–275. doi: 10.1038/nrn1074. [DOI] [PubMed] [Google Scholar]
- 2.Menzel R, Giurfa M. Dimensions of cognition in an insect, the honeybee. Behav Cogn Neurosci Rev. 2006;5:24–40. doi: 10.1177/1534582306289522. [DOI] [PubMed] [Google Scholar]
- 3.Giurfa M. Behavioral and neural analysis of associative learning in the honeybee: a taste from the magic well. J Comp Physiol A. 2007;193:801–824. doi: 10.1007/s00359-007-0235-9. [DOI] [PubMed] [Google Scholar]
- 4.Davis RL. Traces of Drosophila memory. Neuron. 2011;70:8–19. doi: 10.1016/j.neuron.2011.03.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Mizunami M, Matsumoto Y, Watanabe H, Nishino H. Chapter 41: Olfactory and visual learning in cockroaches and crickets. In: Menzel M, Benjamin PR, editors. Invertebrate Learning and Memory. Berlin: Springer; 2013. pp. 547–558. [Google Scholar]
- 6.Matsumoto Y, Mizunami M. Temporal determinants of olfactory long-term retention in the cricket Gryllus bimaculatus. J Exp Biol. 2002;205:1429–1437. doi: 10.1242/jeb.205.10.1429. [DOI] [PubMed] [Google Scholar]
- 7.Unoki S, Matsumoto Y, Mizunami M. Participation of octopaminergic reward system and dopaminergic punishment system in insect olfactory learning revealed by pharmacological study. Eur J Neurosci. 2005;22:1409–1416. doi: 10.1111/j.1460-9568.2005.04318.x. [DOI] [PubMed] [Google Scholar]
- 8.Matsumoto Y, Noji S, Mizunami M. Time course of protein synthesis-dependent phase of olfactory memory in the cricket Gryllus bimaculatus. Zool Sci. 2003;20:409–416. doi: 10.2108/zsj.20.409. [DOI] [PubMed] [Google Scholar]
- 9.Matsumoto Y, Mizunami M. Lifetime olfactory memory in the cricket Gryllus bimaculatus. J Comp Physiol A. 2002;188:295–299. doi: 10.1007/s00359-002-0303-0. [DOI] [PubMed] [Google Scholar]
- 10.Matsumoto Y, Mizunami M. Olfactory memory capacity of the cricket Gryllus bimaculatus. Biol Letters. 2006;2:608–610. doi: 10.1098/rsbl.2006.0540. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Matsumoto Y, Mizunami M. Context-dependent olfactory learning in an insect. Learn Mem. 2004;11:288–293. doi: 10.1101/lm.72504. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Mizunami M, Unoki S, Mori Y, Hirashima D, Hatano A, Matsumoto Y. Roles of octopaminergic and dopaminergic neurons in appetitive and aversive memory recall in an insect. BMC Biol. 2009;7:46. doi: 10.1186/1741-7007-7-46. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Matsumoto Y, Hirashima D, Mizunami M. Analysis and modeling of neural processes underlying sensory preconditioning. Neurobiol Learn Mem. 2013;101:103–113. doi: 10.1016/j.nlm.2013.01.008. [DOI] [PubMed] [Google Scholar]
- 14.Tully T, Quinn WG. Classical conditioning and retention in normal and mutant Drosophila melanogaster. J Comp Physiol A. 1985;157:263–277. doi: 10.1007/BF01350033. [DOI] [PubMed] [Google Scholar]
- 15.Schwaerzel M, Monastirioti M, Scholz H, Friggi-Grelin F, Birman S, Heisenberg M. Dopamine and octopamine differentiate between aversive and appetitive olfactory memories in Drosophila. J Neurosci. 2003;23:10495–10502. doi: 10.1523/JNEUROSCI.23-33-10495.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Vergoz V, Roussel E, Sandoz JC, Giurfa M. Aversive learning in honeybees revealed by the olfactory conditioning of the sting extension reflex. PLoS One. 2007;2:e288. doi: 10.1371/journal.pone.0000288. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Schultz W. Behavioral theories and the neurophysiology of reward. Annu Rev Psychol. 2006;57:87–115. doi: 10.1146/annurev.psych.56.091103.070229. [DOI] [PubMed] [Google Scholar]
- 18.Unoki S, Matsumoto Y, Mizunami M. Roles of octopaminergic and dopaminergic neurons in mediating reward and punishment signals in insect visual learning. Eur J Neurosci. 2006;24:2031–2038. doi: 10.1111/j.1460-9568.2006.05099.x. [DOI] [PubMed] [Google Scholar]
- 19.Nakatani Y, Matsumoto Y, Mori Y, Hirashima D, Nishino H, Arikawa K, et al. Why the carrot is more effective than the stick: Different dynamics of punishment memory and reward memory and its possible biological basis. Neurobiol Learn Mem. 2009;92:370–380. doi: 10.1016/j.nlm.2009.05.003. [DOI] [PubMed] [Google Scholar]
- 20.Hammer MR, Menzel R. Multiple sites of associative odor learning as revealed by local brain microinjections of octopamine in honeybees. Learn Mem. 1998;5:146–156. [PMC free article] [PubMed] [Google Scholar]
- 21.Farooqui T, Robinson K, Vaessin H, Smith BH. Modulation of early olfactory processing by an octopaminergic reinforcement pathway in the honeybee. J Neurosci. 2003;23:5370–5380. doi: 10.1523/JNEUROSCI.23-12-05370.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Schroll C, Riemensperger T, Bucher D, Ehmer J, Völler T, Erbguth K, et al. Light-induced activation of distinct modulatory neurons triggers appetitive or aversive learning in Drosophila larvae. Curr Biol. 2006;16:1741–1747. doi: 10.1016/j.cub.2006.07.023. [DOI] [PubMed] [Google Scholar]
- 23.Kim YC, Lee HG, Han KA. D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. J Neurosci. 2007;27:7640–7647. doi: 10.1523/JNEUROSCI.1167-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Liu C, Plaçais PY, Yamagata N, Pfeiffer BD, Aso Y, Friedrich AB, et al. A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature. 2012;488:512–516. doi: 10.1038/nature11304. [DOI] [PubMed] [Google Scholar]
- 25.Perry CJ, Barron AB. Neural mechanisms of reward in insects. Annu Rev Entomol. 2013;58:543–562. doi: 10.1146/annurev-ento-120811-153631. [DOI] [PubMed] [Google Scholar]
- 26.Burke CJ, Huetteroth W, Owald D, Perisse E, Krashes MJ, Das G, et al. Layered reward signalling through octopamine and dopamine in Drosophila. Nature. 2012;492:433–437. doi: 10.1038/nature11614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Waddell S. Reinforcement signalling in Drosophila; dopamine does it all after all. Curr Opin Neurobiol. 2013;23:324–329. doi: 10.1016/j.conb.2013.01.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Mizunami M, Okada R, Li Y, Strausfeld NJ. Mushroom bodies of the cockroach: The activity and identities of neurons recorded in freely moving animals. J Comp Neurol. 1998;402:501–519. doi: 10.1002/(SICI)1096-9861(19981228)402:4<501::AID-CNE5>3.0.CO;2-M. [DOI] [PubMed] [Google Scholar]
- 29.Mizunami M, Weibrecht JM, Strausfeld NJ. Mushroom bodies of the cockroach: Their participation in place memory. J Comp Neurol. 1998;402:520–537. doi: 10.1002/(SICI)1096-9861(19981228)402:4<520::AID-CNE6>3.0.CO;2-K. [DOI] [PubMed] [Google Scholar]
- 30.Watanabe H, Matsumoto SC, Nishino H, Mizunami M. Critical roles of mecamylamine-sensitive mushroom body neurons in insect olfactory learning. Neurobiol Learn Mem. 2011;95:1–13. doi: 10.1016/j.nlm.2010.10.004. [DOI] [PubMed] [Google Scholar]
- 31.Mizunami M, Matsumoto Y. Roles of aminergic neurons in formation and recall of associative memory in crickets. Frontiers Behav Neurosci. 2010;4:172. doi: 10.3389/fnbeh.2010.00172. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Matsumoto Y, Unoki S, Aonuma H, Mizunami M. Critical role of nitric oxide-cGMP cascade in the formation of cAMP-dependent long-term memory. Learn Mem. 2006;13:35–44. doi: 10.1101/lm.130506. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Matsumoto Y, Sandoz JC, Devaud JM, Lormant F, Mizunami M, Giurfa M. Cyclic nucleotide-gated channels, calmodulin, adenylyl cyclase and calcium/calmodulin- dependent kinase II are required for late but not early long-term memory formation in the honey bee. Learn Mem. 2014;21:272–286. doi: 10.1101/lm.032037.113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Garthwaite J, Charles SL, Chess-Williams R. Endothelium-derived relaxing factor release on activation of NMDA receptors suggests a role as intracellular messenger in the brain. Nature. 1988;336:385–388. doi: 10.1038/336385a0. [DOI] [PubMed] [Google Scholar]
- 35.Matsumoto Y, Hatano A, Unoki S, Mizunami M. Stimulation of the cAMP system by the nitric oxide-cGMP system underlying the formation of long-term memory in an insect. Neurosci Lett. 2009;467:81–85. doi: 10.1016/j.neulet.2009.10.008. [DOI] [PubMed] [Google Scholar]
- 36.Mizunami M, Nemoto Y, Terao K, Hamanaka Y, Matsumoto Y. Roles of calcium/calmodulin-dependent kinase II in long-term memory formation in crickets. PLoS One. 2014;9:9. doi: 10.1371/journal.pone.0107442. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Matsumoto Y, Hirashima D, Terao K, Mizunami M. Roles of NO signaling in long-term memory formation in visual learning in an insect. PLoS One. 2013;8:e68538. doi: 10.1371/journal.pone.0068538. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Takahashi T, Hamada A, Miyawaki K, Matsumoto Y, Mito T, Noji S, et al. Systemic RNA interference for the study of learning and memory in an insect. J Neurosci Methods. 2009;179:9–15. doi: 10.1016/j.jneumeth.2009.01.002. [DOI] [PubMed] [Google Scholar]
- 39.Watanabe H, Mizunami M. Pavlov’s cockroach: classical conditioning of salivation in an insect. PLoS One. 2007;6:e529. doi: 10.1371/journal.pone.0000529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Watanabe H, Mizunami M. Classical conditioning of activities of salivary neurons in an insect. J Exp Biol. 2006;209:766–779. doi: 10.1242/jeb.02049. [DOI] [PubMed] [Google Scholar]
- 41.Watanabe H, Sato C, Kuramochi T, Nishino H, Mizunami M. Salivary conditioning with antennal gustatory unconditioned stimulus in an insect. Neurobiol Learn Mem. 2008;90:245–254. doi: 10.1016/j.nlm.2008.03.009. [DOI] [PubMed] [Google Scholar]
- 42.Matsumoto CS, Kuramochi T, Matsumoto Y, Watanabe H, Nishino H, Mizunami M. Participation of NO signaling in formation of long-term memory in salivary conditioning of the cockroach. Neurosci Lett. 2013;541:4–8. doi: 10.1016/j.neulet.2013.01.010. [DOI] [PubMed] [Google Scholar]
- 43.Müller U. Inhibition of nitric oxide synthase impairs a distinct form of long-term memory in the honeybee, Apis mellifera. Neuron. 1996;16:541–549. doi: 10.1016/S0896-6273(00)80073-2. [DOI] [PubMed] [Google Scholar]
- 44.Müller U. Prolonged activation of cAMP-dependent protein kinase during conditioning induces long-term memory in honeybees. Neuron. 2000;27:159–168. doi: 10.1016/S0896-6273(00)00017-9. [DOI] [PubMed] [Google Scholar]
- 45.Terao K, Matsumoto Y, Mizunami M. Critical evidence for the prediction error theory in associative learning. Sci Rep. 2015; (in press). [DOI] [PMC free article] [PubMed]
- 46.Mizunami M, Yokohari F, Takahata M. Exploration into the adaptive design of the arthropod “microbrain”. Zool Sci. 1999;16:703–709. doi: 10.2108/zsj.16.703. [DOI] [PubMed] [Google Scholar]
- 47.Mizunami M, Yokohari F, Takahata M. Further exploration into the adaptive design of the arthropod “microbrain”: I. Sensory and memory-processing systems. Zool Sci. 2004;21:1141–1151. doi: 10.2108/zsj.21.1141. [DOI] [PubMed] [Google Scholar]