Abstract
Curiosity plays a fundamental role for learning and memory, but the neural mechanisms that stimulate curiosity and its effect on memory are poorly understood. Accumulating evidence suggests that curiosity states are related to modulations in activity in the dopaminergic circuit and that these modulations impact memory encoding and consolidation for both targets of curiosity and incidental information encountered during curiosity states. To account for this evidence, we propose the Prediction, Appraisal, Curiosity, and Exploration (PACE) framework, which attempts to explain curiosity and memory in terms of cognitive processes, neural circuits, behavior, and subjective experience. The PACE framework generates testable predictions that can stimulate future investigation of the mechanisms underlying curiosity-related memory enhancements.
Keywords: curiosity, memory, hippocampus, prediction, appraisal, exploration
Highlights
A fledgling line of curiosity research shows how states of curiosity enhance learning and retention.
To account for the current evidence, we propose the Prediction, Appraisal, Curiosity, and Exploration (PACE) framework, which integrates the emergent research on curiosity and draws on a range of ideas from psychology, cognitive neuroscience, and systems neuroscience.
PACE proposes that curiosity is triggered by significant prediction errors that are appraised. This cycle enhances memory encoding through increased attention, exploration, and information seeking and enhances the consolidation of information acquired while in a curious state through dopaminergic neuromodulation of the hippocampus.
The PACE framework provides a common reference scheme for future research on curiosity-mediated memory and generates testable predictions to stimulate further research.
Understanding Curiosity as a Cognitive State
Curiosity is assumed to have a fundamental impact on learning and memory and thus has been a major topic of interest to educators [1]. Although early research on curiosity primarily focused on curiosity described as a stable tendency to experience curiosity (i.e., trait curiosity) [2], there has been increased interest in curiosity as a cognitive state (i.e., state curiosity) 3, 4, 5, 6. Researchers generally describe state curiosity as a motivational state that stimulates exploration and information seeking to reduce uncertainty 7, 8, 9, 10. State curiosity resembles states that fall under the umbrella of ‘reward motivation’, in the sense that information that resolves uncertainty can be seen as having a value comparable with other rewards 11, 12, 13, 14. Although several recent reviews have highlighted the importance of state curiosity in learning 2, 8, 9, 11, 13, this nascent field currently lacks a theoretical framework that attempts to explain curiosity and memory in terms of cognitive processes and their underlying neural circuits.
In this Opinion article, we propose a framework that integrates emergent research on curiosity, drawing on a broad range of evidence and ideas from psychology 4, 15, 16, 17, cognitive neuroscience 3, 5, 6, 18, 19, and systems neuroscience 14, 20, 21. Specifically, we propose that the effects of curiosity and memory can be understood as emerging from a cycle that involves Prediction errors, Appraisal, Curiosity, and Exploration (PACE; Figure 1, Key Figure). This framework proposes that curiosity is first triggered by significant prediction errors that are appraised as an indicator of information that could be valuable in the future. This cycle enhances memory encoding through increased attention, exploration, and information seeking and enhances the consolidation of information acquired while in a curious state through dopaminergic neuromodulation of the hippocampus. The framework leads to testable predictions and provides a common reference scheme for future research on curiosity and its relationship with memory. Below, we start by briefly overviewing the behavioral evidence on how state curiosity enhances learning and memory. Subsequently, we lay out our arguments and speculations for each component of the PACE framework and synthesize the theoretical ideas along with the neuroscientific evidence that support our predictions.
What Is Curiosity and How Does It Influence Learning?
One key difference between state curiosity and states associated with reward motivation is that reward delivery is generally thought to motivate future behavior that leads to the same reward. By contrast, information that completely resolves uncertainty no longer motivates exploratory behavior. Therefore, curiosity motivates us to constantly seek new, unknown information 7, 22. Consistent with this idea, initial behavioral and fMRI studies on curiosity highlight that uncertainty is a key driver of curiosity 6, 18, 23. Furthermore, the effects of reward and curiosity are not additive, and reward has been shown to undermine curiosity and its effect on memory 24, 25. Thus, curiosity can be seen as a motivational state that is at least partially distinct from states that motivate the acquisition of primary reinforcers.
Recent studies have demonstrated that curiosity significantly enhances learning and retention of information over time. Most studies that have addressed the relationship between curiosity and memory have used a trivia paradigm [15] in which participants are tested on memory for the answers to trivia questions that elicit different levels of curiosity (see Box 1 for an overview of the measurements of curiosity). These studies demonstrated that participants are better at remembering answers to questions that elicited high levels of curiosity 3, 4, 5, 15, 16, 18, 19, 25, 26, 27, 28. Curiosity-related memory enhancements are evident in immediate 5, 15, 16, 19, 26, 28 and delayed (i.e., 1 day to several weeks) 3, 4, 5, 16, 19, 25, 27 memory tests, suggesting that curiosity might enhance both memory encoding and consolidation 1, 5, 19. The effects of curiosity on memory for trivia answers does not seem to be driven by expertise or arousal, as studies suggest that curiosity-related memory enhancements are independent of the effects of prior knowledge 19, 28 and the effects of emotional arousal on memory [4]. In addition to enhancing memory in young adults, curiosity also enhances memory in healthy older adults 15, 16, 29 and in children and adolescents 30, 31.
Box 1. Eliciting and Measuring Curiosity in the Laboratory.
Curiosity Paradigms
The currently dominant paradigm to elicit curiosity is a trivia paradigm in which participants encode trivia questions and their associated answers. For each question, participants usually rate their level of curiosity and confidence about knowing the answer to the trivia question. The ratings are obtained either during the encoding phase 3, 4, 15 or during a prescreening phase 5, 19. After an anticipation phase, the correct answer to the trivia question is usually shown at the end of the trial (but see [18] for a 50% probability of presentation of the answer).
In addition to the trivia paradigm that elicits epistemic curiosity, other paradigms have been recently adopted to examine perceptual curiosity and to better dissociate different processes underlying curiosity. For example, one study used blurred visual stimuli compared with clear visual stimuli to induce perceptual curiosity [23]. After an anticipation period, 50% of the stimuli were shown as clear visual stimuli. To investigate the neural mechanisms underlying perceptual curiosity, stimuli that were preceded by their associated blurry version (blurry–clear stimuli) were contrasted with images that were presented in a clear version for the whole trial (clear–clear stimuli) [23]. Another recent curiosity study used a lottery task in which participants had to anticipate different levels of monetary rewards [6]. The paradigm allows disentangling of how outcome uncertainty and information value contribute to curiosity.
Curiosity Measures
To measure different degrees of curiosity during a state of curiosity, most studies have relied on participants’ self-reported subjective curiosity ratings 5, 15, 16, 23, 26, 27. Other studies have operationalized curiosity in a more objective manner by measuring willingness to wait for an answer 3, 4, 6 or to sacrifice rewards (e.g., water in nonhuman primate studies, limited tokens or money in humans) 3, 20, 71 or by giving participants a choice of which stimuli they would like to experience 48, 49, 89. In general, the available evidence suggests that subjective curiosity ratings positively correlate with objective curiosity measures that implicitly test curiosity via willingness to sacrifice scarce resources 3, 4, 6. Furthermore, it has been suggested that eye-sensitive measures might be indicative of curiosity states. One study using eye tracking found that states of high curiosity, elicited by the presentation of a trivia question, were associated with participants’ anticipatory gaze toward the expected location of the answer [17] (for an oculomotor exploration task to study curiosity in nonhuman primates, see [21]). Another study showed that pupil dilations during a curiosity state are also predictive of the level of curiosity [3]. In summary, ‘willingness to sacrifice resources’, eye gaze, and pupil dilations appear to be promising objective curiosity measures in addition to self-report curiosity measures to investigate the mechanisms underlying curiosity.
Although it might seem unsurprising that people are better at learning answers to questions that piqued their curiosity, the available evidence suggests that the curiosity-related memory enhancement spreads beyond the target of a person’s curiosity. For instance, studies have used a version of the trivia paradigm in which participants were incidentally exposed to faces as they anticipated the answers to trivia questions. Although the faces were irrelevant to the trivia answers, participants showed enhanced recognition of faces learned during high-curiosity states compared with faces learned during low-curiosity states 5, 15, 19. Based on these behavioral findings of curiosity-related memory enhancements, psychological theories on curiosity, and initial neuroscientific evidence, we now lay out our arguments and speculations for each component of the PACE framework.
Context-Based Prediction Errors: A Potential Role of the Hippocampus
Prior knowledge enables people to make predictions about the environment and, conversely, prediction errors occur in situations where there is little prior knowledge (e.g., arriving in a novel place) or when events violate one’s expectations (e.g., arriving in a familiar place to find that the furniture has been rearranged). It has been proposed that the hippocampus forms cognitive maps that allow one to generate predictions based on past experiences in similar contexts and situations [32]. Violations of hippocampally generated predictions (i.e., context-based prediction errors), in turn, were proposed to stimulate responses within a subpopulation of hippocampal neurons (termed the ‘misplace system’) that can potentially trigger exploration to resolve the uncertainty [32]. Thus, the hippocampus can be seen as playing a role in stimulating curiosity.
There is reason to think that surprising or truly novel experiences elicit curiosity. For instance, humans tend to spend more time looking at novel than familiar objects or scenes 33, 34, 35, and novelty-induced exploration appears to depend on the hippocampus 36, 37. Importantly, one study using a scene-viewing task showed that individual differences in participants’ trait curiosity predicted how well participants visually explored the novel scenes [38]. In addition, curiosity may be triggered by stimuli that are not novel per se, if they violate one’s expectations. For instance, people will spend time visually exploring parts of scenes that have changed relative to what they had previously seen 39, 40, and this effect also depends on the hippocampus 41, 42.
In addition to curiosity-related visual exploration, when people await the presentation of information that resolves uncertainty, eye movement behavior might also depend on curiosity. Consistent with this idea, one study using the trivia paradigm found that participants oriented their gaze earlier toward the location of an answer if the answer was anticipated with high compared with low curiosity [17]. In addition, individual variation in this earlier curiosity-triggered anticipatory gaze correlated with individual differences in trait curiosity. In summary, initial studies on curiosity using eye tracking indicate enhanced curiosity-based exploration and information seeking 7, 43, which might be elicited by context-based prediction errors dependent on hippocampal functioning [37].
Information-Based Prediction Errors: A Potential Role of the Anterior Cingulate Cortex
Prediction errors are not limited to events in the outside world: a prediction error can also be triggered when an event violates one’s expectations about his or her knowledge on a particular topic (i.e., ‘information-based prediction errors’ or ‘information gaps’ 7, 10, 44). In an early psychological theory of curiosity, Berlyne [45] conceptualized the idea of information gaps in terms of cognitive conflict: ‘Conflicting elements or requirements often characterize the “problems” that start us off inquiring or experimenting or thinking’. Inspired by these theoretical ideas, neuroscientists proposed that the anterior cingulate cortex (ACC) is recruited during states of cognitive conflict [46]. ACC activation, in turn, stimulates recruitment of regions in the lateral prefrontal cortex (PFC) to direct actions to resolve the conflict 46, 47. Applying this concept to curiosity, we propose that the ACC might signal cognitive conflict when one is faced with an information gap and this can stimulate curiosity to find the necessary information to resolve the conflict.
Consistent with this idea, the large majority of fMRI studies on curiosity have reported activation in the ACC 5, 18, 23, 48, 49. For example, whole-brain analyses demonstrate enhanced ACC activation elicited by high- compared with low-curiosity trivia questions 5, 18 and by high compared with low perceptual uncertainty about an upcoming scene image [23]. In addition, curiosity-related ACC activity seems to be evident in curiosity paradigms in which participants act on their curiosity and choose which stimuli that they would like to see 48, 49. For example, if participants are highly curious about the revelation of a magic trick that is also associated with receiving a potential electric shock, participants show increased ACC activity when they accept the risk to satisfy their curiosity about the magic trick [48]. In addition, enhanced ACC activity seems to be evident when participants choose to see negatively valued information (i.e., morbid curiosity) compared with passively viewing the choice cue [49]. Overall, these findings support the idea that the ACC might signal information gaps due to cognitive conflicts that can trigger curiosity.
Appraisal: A Potential Role of the Lateral PFC
In our framework, information- or environmentally triggered prediction errors might not be sufficient to trigger curiosity. Under certain circumstances these factors might have the opposite effect and induce anxiety. Relevant to this point, the hippocampus and ACC have been implicated in exploration but also in the inhibition of exploratory behavior during anxiety states 50, 51. If the hippocampus and ACC contribute to both curiosity-based exploration and anxiety-based behavioral inhibition [52], there must be an additional step that leads to curiosity and exploration.
We propose that prediction errors and information gaps trigger an appraisal process that determines one’s actions (i.e., inhibition or exploration) along with its subjective experience (i.e., anxiety or curiosity). Our framework proposes that such appraisal is supported by the lateral PFC. The importance of appraisal processes has been highlighted by behavioral studies suggesting that curiosity depends on the appraisal of one’s ability to resolve the challenges raised by the prediction error 53, 54, 55. More specifically, the appraisal is needed to determine whether the current state of uncertainty reflects a potential threat and, if not, whether one has the skills, expertise, and resources needed to resolve the uncertainty 54, 55.
In this framework, a prediction error could trigger curiosity and exploration if one feels that one has the capability to resolve the uncertainty (i.e., appraisal of higher coping potential) or it could trigger anxiety and behavioral inhibition if one believes that one has no ability to cope with the prediction error (i.e., appraisal of low coping potential). For instance, imagine that you hear a loud sound while walking in an unfamiliar neighborhood. If you think you heard the sound of a cork popping with music in the background, you might respond with curiosity and seek out the source of the sound. Alternatively, if you think the sound was a gunshot, you might respond with anxiety and rush to a safe place. In a similar vein, a student who discovers an information gap as he completes a homework assignment might become curious if he focused on the value of the necessary information on a future test. However, he could become anxious and procrastinate if he instead interpreted the information gap as a sign of his incompetence and inability to understand the topic. In these examples, we can see how an appraisal of the current situation can determine the subjective and behavioral response to a context-based prediction error or information gap.
As noted above, theories of cognitive control propose that ACC-mediated conflict signals stimulate networks in the lateral PFC that select the responses that are needed to resolve the conflict 46, 47. Substantial evidence suggests that this function can be extended to appraisal processes that mediate emotional states and emotion regulation [56]. We therefore propose that regions in the lateral PFC support appraisals that determine whether an individual will respond with curiosity in the face of uncertainty. Consistent with this idea, neuroimaging studies using the trivia paradigm have found that trivia questions associated with high compared with low curiosity showed enhanced activity in the lateral PFC potentially reflecting stronger appraisal for high- compared with low-curiosity questions 3, 5, 18, 57. Other curiosity studies also showed stronger lateral PFC activity when participants anticipated visual images with high compared with low uncertainty [23] and when participants chose to reveal an image of an unknown scene [49]. Perhaps contrary to the predictions of our framework, one study using the trivia paradigm showed that a context with highly surprising information reduced the increase of curiosity-related activation in the lateral PFC and the ACC [18]. However, further research is needed to understand how temporally extended surprising contexts relate to the sparking of item-level curiosity states.
Curiosity Triggers Dopaminergic Neuromodulation
Substantial evidence suggests that curiosity motivates and energizes an individual to seek information to relieve that state 44, 45, 58. There are many ways that this might occur and the evidence suggests that neuromodulatory systems are likely to play an important role. Regions in the lateral PFC that we proposed to support appraisal also provide input to the dopaminergic midbrain [substantia nigra/ventral tegmental area (SN/VTA)], the origin of dopamine release 59, 60. Thus, the lateral PFC is in a position to stimulate widespread dopaminergic neuromodulation, which, as we describe below, stimulates exploratory behavior and information seeking and enhances encoding and memory consolidation 61, 62, 63.
Several models have suggested that dopaminergic neuromodulation enhances exploratory behavior along with the motivation to seek a reward 62, 64, 65. In line with these ideas and related to curiosity, ample evidence in rodents highlights the role of dopamine during exploration and, in turn, its effect on memory consolidation 66, 67, 68. For example, blockade of D1/D5 dopaminergic receptors during exploration of novel environments decreases the consolidation of new spatial maps [66], suggesting a causal link between exploration-triggered dopamine and memory consolidation. Also consistent with the idea that curiosity triggers enhanced information seeking, several studies have shown how nonhuman primates and humans have a strong preference for advance information-seeking 14, 20, 69, 70, 71. That is, if individuals have the possibility of receiving advance information about the value of an upcoming reward, they have a strong bias to select the advance information even if this option is associated with sacrificing parts of the reward. Critically, in nonhuman primates, it has been shown that such information-seeking preference for advance information is associated with enhanced dopaminergic activity in the midbrain [14].
The research on the relationship between dopaminergic activity and information seeking/exploration dovetails with prominent curiosity theories that define curiosity as a state that stimulates active exploration and information seeking to reduce uncertainty and to close information gaps 7, 44, 45, 72. Consistent with these ideas, several fMRI studies have reported that curiosity enhances activity in striatal areas that heavily depend on dopamine release by the SN/VTA 3, 5, 18, 48, 49, 57. In particular, while some studies reported activity in the dorsal striatum 3, 48, other studies showed activation throughout the striatum including the ventral striatum 5, 49. One study found that curiosity-related activity in the ventral striatum might be potentially related to the ‘tip of the tongue’ phenomenon [18], often reported as an intense feeling of ‘almost knowing’ the information and accompanied by very high curiosity [7]. Critically, studies using the trivia paradigm revealed that the dopaminergic midbrain (SN/VTA) shows increased activity for high- compared with low-curiosity trivia questions 5, 57. Another study related to curiosity revealed increased activation in the SN/VTA and ventral striatum when participants anticipated gaining information about future favorable outcomes [73]. In addition to dopaminergic activity during curiosity states, one study also found enhanced midbrain activity during the presentation of previously unknown answers [3].
Curiosity Enhances Hippocampus-Dependent Encoding and Memory Consolidation via Dopaminergic Neuromodulation
Studies on reward and dopamine have shown that dopamine leads to an immediate attentional bias toward stimuli that have an association with past or future rewards (‘reward-based salience’) 8, 74, 75. Consistent with this, one study (also reported above) using eye tracking has shown how curiosity increases such attentional bias [17]. That is, states of high compared with low curiosity, elicited by the presentation of trivia questions, were associated with participants’ anticipatory gaze toward the expected location of the answer [17]. Further evidence for the role of increased attention in curiosity comes from neuroimaging studies that have shown that curiosity elicits activity in frontal and parietal brain areas that support attention and cognitive control 6, 23.
In line with the findings that curiosity enhances attention and that dopaminergic activity can affect immediate learning 63, 76, curiosity-related memory enhancements are evident when memory is tested immediately or after a short delay following encoding 5, 15, 16, 19, 26, 28. Neuroimaging research has demonstrated the positive influence of dopaminergic activity on curiosity-based learning. It has been shown that, when a high-curiosity trivia question is presented, curiosity-elicited activity in the ventral striatum and the hippocampus predicts curiosity-related memory enhancements for trivia answers [5]. In addition, individual differences in curiosity-based activation in the SN/VTA and hippocampus along with SN/VTA–hippocampal functional connectivity predict the magnitude of curiosity-related memory enhancements for incidental face images that are presented during curiosity states [5]. The findings are in line with the idea that curiosity enhances attentional and dopaminergic processes during learning that lead to immediate memory benefits.
In addition, prominent models and recent findings have suggested that dopamine especially enhances hippocampus-dependent consolidation 61, 63, 77, 78, 79. Consistent with these findings, curiosity-based memory enhancement for trivia answers has been shown in 12- or 24-h overnight-delayed 5, 19 and in 1–3-week delayed 3, 4, 16, 25, 27 memory tests, suggesting a role of enhanced memory consolidation for curiosity-related information. Furthermore, dopamine-related ‘tag-and-capture’ models suggest that novelty-mediated increases in dopamine availability enhance the retention of memories for events that occur before or after the novel event takes place 61, 62, 80. These ideas and findings align well with recent findings in curiosity research that show enhanced retention of incidental material that was presented during high-curiosity states 5, 19. Consistent with the role of enhanced hippocampal consolidation via dopaminergic modulation, it has recently been shown that intrinsically regulated learning (potentially related to curiosity) engages SN/VTA–hippocampal processes and in turn promotes consolidation-related enhancements 81, 82.
How a PACE Cycle Influences Memory
Having laid out the proposed components of the PACE framework along with the supporting evidence, we are in a position to better understand how curiosity shapes learning and memory. As we have outlined, it becomes apparent that there is not a single factor that elicits curiosity and no single process through which curiosity affects memory. Instead, there are several factors that trigger curiosity and curiosity affects memory in multiple ways. In general, our framework provides a model of how external, context-based and internal, information-based prediction errors – supported by the hippocampus and ACC, respectively – stimulate appraisal in the lateral PFC. Such lateral PFC-related appraisal then leads to either anxiety/inhibition related to amygdalar processes [52] or curiosity/exploration related to dopaminergic processes [1]. If curiosity is sparked, curiosity enhances learning via increased attentional processes 3, 5, 17 and retention via enhanced memory consolidation 4, 5, 19. The aspect of the PACE framework of how curiosity shapes learning and memory via dopaminergic functions is in line with theoretical models on how dopaminergic activity enhances hippocampus-dependent encoding and memory consolidation 61, 62, 63. Importantly, the PACE framework extends these previous models and proposes how lateral PFC-related appraisal mediates how hippocampus- and ACC-related prediction errors trigger curiosity-related neuromodulation. Although our proposed framework focuses on state curiosity and its effect on memory, the individual components of the PACE framework might also be influenced by individual variation in trait curiosity (Box 2).
Box 2. Trait Curiosity and the PACE Framework.
Although our framework focuses on state curiosity and its effects on memory, prior research has focused primarily on trait curiosity – the tendency to experience curiosity as a stable personality characteristic (for a review see 1, 2). Importantly, theories of curiosity have suggested a link between trait and state curiosity. That is, individuals who show higher trait curiosity engage in enhanced information seeking and curiosity-based exploration 7, 43. In line with this idea, recent experimental studies have also emphasized how individual differences in trait curiosity affect curiosity-driven exploration 70, 90. Within our framework, it is possible that the degree of involvement of the proposed PACE components might rely on individual variation in trait curiosity (Box 3).
For the context- and information-based prediction error components, it might be possible that individual differences in trait curiosity differently elicit hippocampus- and ACC-dependent prediction errors. Potentially consistent with this idea, the degree of curiosity-based exploration measured via eye movements 17, 38 – potentially underlying hippocampus-dependent context-based prediction errors [37] – has been shown to correlate with trait curiosity. In addition, the degree of information-seeking behavior in an experiment in which participants searched different Wikipedia articles also correlated with trait curiosity; specifically, the particular aspect of trait curiosity that is related to closing an information gap (i.e., deprivation sensitivity) [90]. Therefore, relationships between trait curiosity and curiosity-based behavior might rely on individual differences in the sensitivity to hippocampus- and ACC-related prediction errors.
Regarding the appraisal component, appraisal of the current situation will depend not just on the current state of uncertainty but also on a person’s trait curiosity. It has been shown that individual differences in the strength of appraisal (i.e., how well a person can cope with the uncertainty) explains the individual differences in trait curiosity [53]. That is, ‘curious people appear to be curious because they are more likely to appraise their ability to understand as high’ ([53], see p. 108). Consistent with this finding, a series of experiments has shown that participants with high coping potential show higher curiosity/interest in complex novel products and inventions [55], suggesting that appraisal leads to curiosity only if the prediction errors seem manageable.
Does the curiosity component, which triggers information seeking and exploration, potentially depend on individual differences in trait curiosity as well? Here, it might be relevant to consider that individual differences in the more general personality trait ‘openness to experience’ – which encompasses curiosity as a critical subcomponent – has been linked to dopaminergic functions 91, 92. This suggests that dopaminergic functions also extend to ‘cognitive exploration’. Consistent with this relationship between dopamine and cognitive exploration, it has been shown that the strength of a white matter connection between dopaminergic regions and the hippocampus 93, 94 (i.e., via the fornix) correlates with the degree of trait curiosity [95].
Regarding the final PACE component of how curiosity enhances memory, it has also been shown how trait curiosity enhances real-world learning 96, 97, 98. For example, it has been shown that trait curiosity mediates the effect on learning during a medical training program [97]. In addition, trait curiosity predicts academic performance even if the effects of intelligence and effort on academic performance are controlled [96].
Within our framework, a PACE cycle will be completed once uncertainty is resolved and curiosity is satisfied by closing an information gap. However, in many cases the presentation of the information that was associated with curiosity might elicit a further context- or information-based prediction error. In line with this idea, several studies using the trivia paradigm demonstrate how prediction errors triggered by the trivia answers themselves benefit memory 4, 16, 18, 27, 30. Within our framework, we propose that such further prediction errors will start a new PACE cycle, which could then further benefit memory and promote knowledge acquisition [83].
Critically, new paradigms will need to be developed to test several predictions of the PACE framework. For example, future neuroimaging studies would need to investigate how active exploration and information seeking (rather than the passive awaiting of information associated with different levels of curiosity) enhances curiosity-related memory. Furthermore, it will be central to rigorously test the proposed role of each component within the PACE framework and how the proposed components functionally interact with each other in support of curiosity-based memory. In Box 3 we outline the currently most relevant predictions of the PACE framework.
Box 3. Currently Most Relevant Predictions of the PACE Framework.
Prediction Error Components Supported by Hippocampus and ACC
-
(i)Larger context- and information-based prediction errors elicit increased activity in the hippocampus and ACC, respectively.
-
(a)Recruitment of specific hippocampal regions depends on the functions along the longitudinal axis of the hippocampus (from gist-based to detailed information in the anterior to posterior hippocampus, respectively).
-
(a)
-
(ii)The two types of prediction error are elicited in parallel but depending on the situation one type of prediction error may play a larger role than the other.
-
(a)Unexpected changes in the environment (e.g., surprise in the environment) relies more on hippocampus-dependent prediction errors.
-
(b)Information that elicits higher cognitive conflict (e.g., ambivalent information, incongruent information to prior knowledge) relies more on ACC-dependent prediction errors.
-
(a)
-
(iii)
To support successful appraisal, larger prediction errors result in stronger hippocampal–lateral PFC and ACC–lateral PFC coupling for context- and information-based prediction errors, respectively.
Appraisal Component Supported by Lateral PFC
-
(i)
Enhanced recruitment of lateral PFC in situations that require more appraisal (e.g., situations that introduce a choice or even a dilemma about whether to explore or to abstain from information).
-
(ii)
The lateral PFC will appraise information related to hippocampus- and ACC-dependent prediction errors and mediate the effect of prediction errors to elicit curiosity or anxiety.
-
(iii)
Individual differences in coping strategies affect lateral PFC-related appraisal and the subsequent elicitation of anxiety or curiosity. For example, appraisal in individuals with higher stress tolerance might be more likely to elicit curiosity than anxiety.
-
(iv)
Subpopulations and patients with suboptimal PFC functions rely less on appraisal in eliciting curiosity. Such suboptimal appraisal mechanisms may lead to altered curiosity (e.g., more inconsistent curiosity). For example, less developed PFC functions in children may lead to differences in curiosity (less mediated by appraisal and potentially more variable) compared with adults.
Curiosity Component Supported by SN/VTA and Striatum
-
(i)
Exploratory behavior and eye movements related to curiosity are supported by activity in the ventral striatum and SN/VTA.
-
(ii)
The strength of lateral PFC–SN/VTA functional connectivity predicts the degree of curiosity and exploratory behavior. By contrast, lateral PFC–amygdala functional connectivity predicts whether appraisal leads to anxiety-related behavioral inhibition.
-
(iii)
Dopaminergic functions within the striatum and SN/VTA vary across individuals in the healthy population and are decreased in older adults and in certain clinical conditions (e.g., Parkinson’s disease, schizophrenia, depression, Alzheimer’s disease). Such alterations in dopaminergic functions lead to decreased levels of curiosity and exploratory behavior.
Enhanced Encoding and Consolidation Component Supported by Hippocampus
-
(i)
Curiosity-related eye movements and exploratory behavior predict curiosity-based memory enhancements.
-
(ii)
While memory enhancements for curiosity target information (e.g., trivia answers) might depend on hippocampal processes both during encoding and during consolidation, memory enhancements for incidental information (i.e., unrelated information that is temporally contiguous to a curious state) depend more on enhanced consolidation than encoding processes.
-
(iii)
Individual variability in functional and structural connections between the hippocampus and dopaminergic regions predicts curiosity-based memory enhancements.
-
(iv)
Alterations in dopaminergic functions in subpopulations and certain clinical conditions (e.g., Parkinson’s disease, schizophrenia, depression, Alzheimer’s disease) decrease the positive effects of curiosity on hippocampus-dependent memory.
Concluding Remarks
In recent years there have been exciting developments in the study of curiosity and its impact on memory. Drawing from converging evidence in psychology and neuroscience, we proposed the PACE framework, which integrates theories about curiosity with existing models on prediction errors, appraisal, exploration, and the neuromodulation of hippocampus-dependent memory.
At this point, it is important to point out that we do not mean to imply that the above framework captures all of the relevant processes and experiences. Moreover, we are certain that the underlying neural substrates of curiosity-related memory enhancements are much more complex than what we have proposed. At the same time, the PACE framework provides a starting point for understanding how curiosity can influence memory by bringing together a wide range of findings and by specifying potential links across multiple levels of analysis (i.e., process, neural, behavioral, and subjective level). We believe that the PACE framework will be useful for the emerging research field of curiosity and memory to stimulate future research (Box 3; see Outstanding Questions).
Outstanding Questions.
What are the relationships between curious states and curiosity traits and how do they jointly or independently influence learning and memory?
How does curiosity interact with post-information processes in support of learning (e.g., surprise, interestingness, novelty)?
How does curiosity interact with emotional effects on memory?
How does curiosity affect early and late memory consolidation during awake rest and sleep periods?
What are the boundary conditions of curiosity-related memory enhancement for incidental information that is temporally contiguous to a state of high curiosity?
How does curiosity affect learning and memory across the lifespan?
How does curiosity influence memory in patients with memory impairments?
Do curiosity-related memory enhancements depend solely on dopamine or also on other neurotransmitters (e.g., noradrenaline or acetylcholine, which have been proposed to support different types of uncertainty)?
Can we translate laboratory-based findings on curiosity-related memory enhancements to the classroom and clinical settings?
How can the findings on the neural mechanisms of curiosity-based learning be translated for artificial intelligence/robotics applications?
Understanding the neural mechanisms of how curiosity enhances learning is likely to be of interest in the rapidly expanding field of artificial intelligence 84, 85 as it might be a critical approach to stimulate independent, curiosity-guided learning in artificial systems. Furthermore, future research on curiosity and memory has potentially far-reaching implications for education 86, 87, 88; that is, to guide policymaking and to inform teachers of how curiosity can be harnessed in the most effective way in the classroom. It would therefore be promising to test how laboratory-based findings on curiosity and memory translate to applied settings (see Outstanding Questions).
Acknowledgments
We thank Charlotte Murphy, Andrew Lawrence, Chiara Gambi, Vishnu ‘Deepu’ Murty, Maureen Ritchey, Yana Fandakova, all members of the Cardiff University Motivation and Memory Lab, and all anonymous reviewers for their helpful suggestions on earlier versions of the manuscript. M.J.G. was supported by a COFUND Early Career Fellowship from the European Commission and the Welsh Government and a Sir Henry Dale Fellowship from Wellcome and the Royal Society. C.R. was supported by a Guggenheim Fellowship and by a Vannevar Bush Faculty Fellowship (Office of Naval Research Grant N00014-15-1-0033) from the US Department of Defense. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the Office of Naval Research or the US Department of Defense.
Contributor Information
Matthias J. Gruber, Email: GruberM@cardiff.ac.uk.
Charan Ranganath, Email: cranganath@ucdavis.edu.
References
- 1.Gruber M.J. Curiosity and learning: a neuroscientific perspective. In: Renniger K.A., Hidi S., editors. The Cambridge Handbook of Motivation and Learning. Cambridge University Press; 2019. pp. 397–417. [Google Scholar]
- 2.Grossnickle E.M. Disentangling curiosity: dimensionality, definitions, and distinctions from interest in educational contexts. Educ. Psychol. Rev. 2016;28:23–60. [Google Scholar]
- 3.Kang M.J. The wick in the candle of learning: epistemic curiosity activates reward circuitry and enhances memory. Psychol. Sci. 2009;20:963–973. doi: 10.1111/j.1467-9280.2009.02402.x. [DOI] [PubMed] [Google Scholar]
- 4.Marvin C.B., Shohamy D. Curiosity and reward: valence predicts choice and information prediction errors enhance learning. J. Exp. Psychol. Gen. 2016;145:266–272. doi: 10.1037/xge0000140. [DOI] [PubMed] [Google Scholar]
- 5.Gruber M.J. States of curiosity modulate hippocampus-dependent learning via the dopaminergic circuit. Neuron. 2014;84:486–496. doi: 10.1016/j.neuron.2014.08.060. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.van Lieshout L.L.F. Induction and relief of curiosity elicit parietal and frontal activity. J. Neurosci. 2018;38:2579–2588. doi: 10.1523/JNEUROSCI.2816-17.2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Litman J. Epistemic curiosity, feeling-of-knowing, and exploratory behaviour. Cogn. Emot. 2005;19:559–582. [Google Scholar]
- 8.Gottlieb J., Oudeyer P.-Y. Towards a neuroscience of active sampling and curiosity. Nat. Rev. Neurosci. 2018;19:758–770. doi: 10.1038/s41583-018-0078-0. [DOI] [PubMed] [Google Scholar]
- 9.Kidd C., Hayden B.Y. The psychology and neuroscience of curiosity. Neuron. 2015;88:449–460. doi: 10.1016/j.neuron.2015.09.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Berlyne D.E. Curiosity and exploration. Science. 1966;153:25–33. doi: 10.1126/science.153.3731.25. [DOI] [PubMed] [Google Scholar]
- 11.Gottlieb J. Information-seeking, curiosity, and attention: computational and neural mechanisms. Trends Cogn. Sci. 2013;17:585–593. doi: 10.1016/j.tics.2013.09.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Friston K.J. Active inference, curiosity and insight. Neural Comput. 2017;29:2633–2683. doi: 10.1162/neco_a_00999. [DOI] [PubMed] [Google Scholar]
- 13.Renninger K.A., Hidi S. Routledge; 2015. The Power of Interest for Motivation and Engagement. [Google Scholar]
- 14.Bromberg-Martin E.S., Hikosaka O. Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron. 2009;63:119–126. doi: 10.1016/j.neuron.2009.06.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Galli G. Learning facts during aging: the benefits of curiosity. Exp. Aging Res. 2018;44:311–328. doi: 10.1080/0361073X.2018.1477355. [DOI] [PubMed] [Google Scholar]
- 16.McGillivray S. Thirst for knowledge: the effects of curiosity and interest on memory in younger and older adults. Psychol. Aging. 2015;30:835–841. doi: 10.1037/a0039801. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Baranes A. Eye movements reveal epistemic curiosity in human observers. Vision Res. 2015;117:81–90. doi: 10.1016/j.visres.2015.10.009. [DOI] [PubMed] [Google Scholar]
- 18.Ligneul R. From relief to surprise: dual control of epistemic curiosity in the human brain. Neuroimage. 2018;181:490–500. doi: 10.1016/j.neuroimage.2018.07.038. [DOI] [PubMed] [Google Scholar]
- 19.Stare C.J. Curiosity-driven memory enhancement persists over time but does not benefit from post-learning sleep. Cogn. Neurosci. 2018;9:100–115. doi: 10.1080/17588928.2018.1513399. [DOI] [PubMed] [Google Scholar]
- 20.Blanchard T.C. Orbitofrontal cortex uses distinct codes for different choice attributes in decisions motivated by curiosity. Neuron. 2015;85:602–614. doi: 10.1016/j.neuron.2014.12.050. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Daddaoua N. Intrinsically motivated oculomotor exploration guided by uncertainty reduction and conditioned reinforcement in non-human primates. Sci. Rep. 2016;6:20202. doi: 10.1038/srep20202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Berlyne D.E. Novelty and curiosity as determinants of exploratory behaviour. Br. J. Psychol. 1950;41:68–80. [Google Scholar]
- 23.Jepma M. Neural mechanisms underlying the induction and relief of perceptual curiosity. Front. Behav. Neurosci. 2012;6:5. doi: 10.3389/fnbeh.2012.00005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Murayama K. Neural basis of the undermining effect of monetary reward on intrinsic motivation. Proc. Natl Acad. Sci. U. S. A. 2010;107:20911–20916. doi: 10.1073/pnas.1013305107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Murayama K., Kuhbandner C. Money enhances memory consolidation – but only for boring material. Cognition. 2011;119:120–124. doi: 10.1016/j.cognition.2011.01.001. [DOI] [PubMed] [Google Scholar]
- 26.Mullaney K.M. Waiting for feedback helps if you want to know the answer: the role of curiosity in the delay-of-feedback benefit. Mem. Cognit. 2014;42:1273–1284. doi: 10.3758/s13421-014-0441-y. [DOI] [PubMed] [Google Scholar]
- 27.Fastrich G.M. The role of interest in memory for trivia questions: an investigation with a large-scale database. Motiv. Sci. 2018;4:227–250. doi: 10.1037/mot0000087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Wade S., Kidd C. The role of prior knowledge and curiosity in learning. Psychon. Bull. Rev. 2019;26:1377–1387. doi: 10.3758/s13423-019-01598-6. [DOI] [PubMed] [Google Scholar]
- 29.Sakaki M. Curiosity in old age: a possible key to achieving adaptive aging. Neurosci. Biobehav. Rev. 2018;88:106–116. doi: 10.1016/j.neubiorev.2018.03.007. [DOI] [PubMed] [Google Scholar]
- 30.Fandakova Y., Gruber M. The influence of curiosity states on learning of incidental information in children and adolescents. Open Science Framework. 2019 Published online June 12, 2019. [Google Scholar]
- 31.Walin H., Xu F. Proceedings of the 38th Annual Conference of the Cognitive Science Society. Philadelphia, PA; 2016. Curiosity and its influence on children’s memory; pp. 872–876.https://par.nsf.gov/servlets/purl/10062657 [Google Scholar]
- 32.O’Keefe J., Nadel L. Clarendon Press; 1978. The Hippocampus as a Cognitive Map. [Google Scholar]
- 33.Smock C.D., Holt B.G. Children’s reactions to novelty: an experimental study of “curiosity motivation”. Child Dev. 1962;33:631–642. [PubMed] [Google Scholar]
- 34.Althoff R.R., Cohen N.J. Eye-movement-based memory effect: a reprocessing effect in face perception. J. Exp. Psychol. Learn. Mem. Cogn. 1999;25:997–1010. doi: 10.1037//0278-7393.25.4.997. [DOI] [PubMed] [Google Scholar]
- 35.Ryan J.D. Amnesia is a deficit in relational memory. Psychol. Sci. 2000;11:454–461. doi: 10.1111/1467-9280.00288. [DOI] [PubMed] [Google Scholar]
- 36.Meister M.L.R., Buffalo E.A. Getting directions from the hippocampus: the neural connection between looking and memory. Neurobiol. Learn. Mem. 2016;134:135–144. doi: 10.1016/j.nlm.2015.12.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Voss J.L. A closer look at the hippocampus and memory. Trends Cogn. Sci. 2017;21:577–588. doi: 10.1016/j.tics.2017.05.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Risko E.F. Curious eyes: individual differences in personality predict eye movement behavior in scene-viewing. Cognition. 2012;122:86–90. doi: 10.1016/j.cognition.2011.08.014. [DOI] [PubMed] [Google Scholar]
- 39.Hannula D.E. The eyes know: eye movements as a veridical index of memory. Psychol. Sci. 2012;23:278–287. doi: 10.1177/0956797611429799. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Ryan J.D., Cohen N.J. The nature of change detection and online representations of scenes. J. Exp. Psychol. Hum. Percept. Perform. 2004;30:988–1015. doi: 10.1037/0096-1523.30.5.988. [DOI] [PubMed] [Google Scholar]
- 41.Liu Z.-X. Visual sampling predicts hippocampal activity. J. Neurosci. 2017;37:599–609. doi: 10.1523/JNEUROSCI.2610-16.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Hannula D.E., Ranganath C. The eyes have it: hippocampal activity predicts expression of memory in eye movements. Neuron. 2009;63:592–599. doi: 10.1016/j.neuron.2009.08.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Kashdan T.B., Steger M.F. Curiosity and pathways to well-being and meaning in life: traits, states, and everyday behaviors. Motiv. Emot. 2007;31:159–173. [Google Scholar]
- 44.Loewenstein G. The psychology of curiosity: a review and reinterpretation. Psychol. Bull. 1994;116:75–98. [Google Scholar]
- 45.Berlyne D.E. McGraw-Hill; 1960. McGraw-Hill Series in Psychology. Conflict, Arousal, and Curiosity. [Google Scholar]
- 46.Botvinick M.M. Conflict monitoring and cognitive control. Psychol. Rev. 2001;108:624–652. doi: 10.1037/0033-295x.108.3.624. [DOI] [PubMed] [Google Scholar]
- 47.Shenhav A. The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron. 2013;79:217–240. doi: 10.1016/j.neuron.2013.07.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Lau J.K.L. Hunger for knowledge: how the irresistible lure of curiosity is generated in the brain. bioRxiv. 2018 Published online November 22, 2018. [Google Scholar]
- 49.Oosterwijk S. Choosing to view morbid information involves reward circuitry. bioRxiv. 2019 doi: 10.1038/s41598-020-71662-y. Published online October 7, 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Bannerman D.M. Ventral hippocampal lesions affect anxiety but not spatial learning. Behav. Brain Res. 2003;139:197–213. doi: 10.1016/s0166-4328(02)00268-1. [DOI] [PubMed] [Google Scholar]
- 51.Cullen P.K. Activity of the anterior cingulate cortex and ventral hippocampus underlie increases in contextual fear generalization. Neurobiol. Learn. Mem. 2015;124:19–27. doi: 10.1016/j.nlm.2015.07.001. [DOI] [PubMed] [Google Scholar]
- 52.Ortiz S. Anterior cingulate cortex and ventral hippocampal inputs to the basolateral amygdala selectively control generalized fear. J. Neurosci. 2019;39:6526–6539. doi: 10.1523/JNEUROSCI.0810-19.2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Silvia P.J. Appraisal components and emotion traits: examining the appraisal basis of trait curiosity. Cogn. Emot. 2008;22:94–113. [Google Scholar]
- 54.Silvia P.J. What is interesting? Exploring the appraisal structure of interest. Emotion. 2005;5:89–102. doi: 10.1037/1528-3542.5.1.89. [DOI] [PubMed] [Google Scholar]
- 55.Noordewier M.K., van Dijk E. Interest in complex novelty. Basic Appl. Soc. Psychol. 2016;38:98–110. [Google Scholar]
- 56.Wager T.D. Prefrontal–subcortical pathways mediating successful emotion regulation. Neuron. 2008;59:1037–1050. doi: 10.1016/j.neuron.2008.09.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Chiew K.S., Adcock R.A. Motivated memory: integrating cognitive and affective neuroscience. In: Renninger K.A., Hidi S., editors. The Cambridge Handbook of Motivation and Learning. Cambridge University Press; 2019. pp. 517–546. [Google Scholar]
- 58.Litman J.A. Interest and deprivation factors of epistemic curiosity. Pers. Individ. Dif. 2008;44:1585–1595. [Google Scholar]
- 59.Ballard I.C. Dorsolateral prefrontal cortex drives mesolimbic dopaminergic regions to initiate motivated behavior. J. Neurosci. 2011;31:10340–10346. doi: 10.1523/JNEUROSCI.0895-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Frankle W.G. Prefrontal cortical projections to the midbrain in primates: evidence for a sparse connection. Neuropsychopharmacology. 2006;31:1627–1636. doi: 10.1038/sj.npp.1300990. [DOI] [PubMed] [Google Scholar]
- 61.Lisman J.E., Grace A.A. The hippocampal–VTA loop: controlling the entry of information into long-term memory. Neuron. 2005;46:703–713. doi: 10.1016/j.neuron.2005.05.002. [DOI] [PubMed] [Google Scholar]
- 62.Düzel E. NOvelty-related Motivation of Anticipation and exploration by Dopamine (NOMAD): implications for healthy aging. Neurosci. Biobehav. Rev. 2010;34:660–669. doi: 10.1016/j.neubiorev.2009.08.006. [DOI] [PubMed] [Google Scholar]
- 63.Shohamy D., Adcock R.A. Dopamine and adaptive memory. Trends Cogn. Sci. 2010;14:464–472. doi: 10.1016/j.tics.2010.08.002. [DOI] [PubMed] [Google Scholar]
- 64.Kakade S., Dayan P. Dopamine: generalization and bonuses. Neural Netw. 2002;15:549–559. doi: 10.1016/s0893-6080(02)00048-5. [DOI] [PubMed] [Google Scholar]
- 65.Berridge K.C. Evolving concepts of emotion and motivation. Front. Psychol. 2018;9:68. doi: 10.3389/fpsyg.2018.01647. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Kentros C.G. Increased attention to spatial context increases both place field stability and spatial memory. Neuron. 2004;42:283–295. doi: 10.1016/s0896-6273(04)00192-8. [DOI] [PubMed] [Google Scholar]
- 67.Li S. Dopamine-dependent facilitation of LTP induction in hippocampal CA1 by exposure to spatial novelty. Nat. Neurosci. 2003;6:526–531. doi: 10.1038/nn1049. [DOI] [PubMed] [Google Scholar]
- 68.McNamara C.G. Dopaminergic neurons promote hippocampal reactivation and spatial memory persistence. Nat. Neurosci. 2014;17:1658–1660. doi: 10.1038/nn.3843. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Rodriguez Cabrero J.A.M. Costly curiosity: people pay a price to resolve an uncertain gamble early. Behav. Processes. 2019;160:20–25. doi: 10.1016/j.beproc.2018.12.015. [DOI] [PubMed] [Google Scholar]
- 70.Kobayashi K. Diverse motives for human curiosity. Nat. Hum. Behav. 2019;3:587–595. doi: 10.1038/s41562-019-0589-3. [DOI] [PubMed] [Google Scholar]
- 71.Brydevall M. The neural encoding of information prediction errors during non-instrumental information seeking. Sci. Rep. 2018;8:6134. doi: 10.1038/s41598-018-24566-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Berlyne D.E. Uncertainty and conflict: a point of contact between information-theory and behavior-theory concepts. Psychol. Rev. 1957;64:329–339. doi: 10.1037/h0041135. [DOI] [PubMed] [Google Scholar]
- 73.Charpentier C.J. Valuation of knowledge and ignorance in mesolimbic reward circuitry. Proc. Natl Acad. Sci. U. S. A. 2018;115:E7255–E7264. doi: 10.1073/pnas.1800547115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Hickey C. Reward changes salience in human vision via the anterior cingulate. J. Neurosci. 2010;30:11096–11103. doi: 10.1523/JNEUROSCI.1026-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Anderson B.A. The attention habit: how reward learning shapes attentional selection. Ann. N. Y. Acad. Sci. 2016;1369:24–39. doi: 10.1111/nyas.12957. [DOI] [PubMed] [Google Scholar]
- 76.Stanek J.K. Expected reward value and reward uncertainty have temporally dissociable effects on memory formation. J. Cogn. Neurosci. 2019;31:1443–1454. doi: 10.1162/jocn_a_01411. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Lisman J. A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP. Trends Neurosci. 2011;34:536–547. doi: 10.1016/j.tins.2011.07.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Murayama K., Kitagami S. Consolidation power of extrinsic rewards: reward cues enhance long-term memory for irrelevant past events. J. Exp. Psychol. Gen. 2014;143:15–20. doi: 10.1037/a0031992. [DOI] [PubMed] [Google Scholar]
- 79.Patil A. Reward retroactively enhances memory consolidation for related items. Learn. Mem. 2017;24:65–69. doi: 10.1101/lm.042978.116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Redondo R.L., Morris R.G.M. Making memories last: the synaptic tagging and capture hypothesis. Nat. Rev. Neurosci. 2011;12:17–30. doi: 10.1038/nrn2963. [DOI] [PubMed] [Google Scholar]
- 81.Ripollés P. Intrinsically regulated learning is modulated by synaptic dopamine signaling. eLife. 2018;7:e38113. doi: 10.7554/eLife.38113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Ripollés P. Intrinsic monitoring of learning success facilitates memory encoding via the activation of the SN/VTA–hippocampal loop. eLife. 2016;5:e17441. doi: 10.7554/eLife.17441. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Murayama K. A reward-learning framework of autonomous knowledge acquisition: an integrated account of curiosity, interest, and intrinsic-extrinsic rewards. Open Science Framework. 2019 doi: 10.1037/rev0000349. Published online June 2, 2019. [DOI] [PubMed] [Google Scholar]
- 84.Oudeyer P.-Y. Intrinsic motivation systems for autonomous mental development. IEEE Trans. Evol. Comput. 2007;11:265–286. [Google Scholar]
- 85.Moran M., Gordon G. Curious feature selection. Inf. Sci. 2019;485:42–54. [Google Scholar]
- 86.Hidi S., Renninger K.A. The four-phase model of interest development. Educ. Psychol. 2006;41:111–127. [Google Scholar]
- 87.Engel S. Children’s need to know: curiosity in schools. Harvard Educ. Rev. 2011;81:625–645. [Google Scholar]
- 88.Jirout J., Klahr D. Children’s scientific curiosity: in search of an operational definition of an elusive concept. Dev. Rev. 2012;32:125–160. [Google Scholar]
- 89.Hsee C.K., Ruan B. The Pandora effect: the power and peril of curiosity. Psychol. Sci. 2016;27:659–666. doi: 10.1177/0956797616631733. [DOI] [PubMed] [Google Scholar]
- 90.Lydon-Staley D.M. Hunters, busybodies, and the knowledge network building associated with curiosity. PsyArXiv. 2019 doi: 10.1038/s41562-020-00985-7. Published online June 11, 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Deyoung C.G. The neuromodulator of exploration: a unifying theory of the role of dopamine in personality. Front. Hum. Neurosci. 2013;7:762. doi: 10.3389/fnhum.2013.00762. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.DeYoung C.G. Openness/intellect: a dimension of personality reflecting cognitive exploration. In: Mikulincer M., editor. APA Handbook of Personality and Social Psychology. Vol. 4. American Psychological Association; 2014. pp. 369–399. [Google Scholar]
- 93.Scatton B. Origin of dopaminergic innervation of the rat hippocampal formation. Neurosci. Lett. 1980;18:125–131. doi: 10.1016/0304-3940(80)90314-6. [DOI] [PubMed] [Google Scholar]
- 94.Mitchell S.N. Activation of the retrohippocampal region in the rat causes dopamine release in the nucleus accumbens: disruption by fornix section. Eur. J. Pharmacol. 2000;407:131–138. doi: 10.1016/s0014-2999(00)00741-x. [DOI] [PubMed] [Google Scholar]
- 95.Valji A. Curious connections: white matter pathways supporting individual differences in epistemic and perceptual curiosity. bioRxiv. 2019 Published online May 20,2019. [Google Scholar]
- 96.von Stumm S. The hungry mind: intellectual curiosity is the third pillar of academic performance. Perspect. Psychol. Sci. 2011;6:574–588. doi: 10.1177/1745691611421204. [DOI] [PubMed] [Google Scholar]
- 97.Hassan M.M. Personality, learning, and the mediating role of epistemic curiosity: a case of continuing education in medical physicians. Learn. Individ. Differ. 2015;42:83–89. [Google Scholar]
- 98.Kashdan T.B., Yuen M. Whether highly curious students thrive academically depends on perceptions about the school learning environment: a study of Hong Kong adolescents. Motiv. Emot. 2007;31:260–270. [Google Scholar]