Abstract
Pessoa and colleagues recently reported the novel finding that objective awareness of a negative stimulus is associated with coactivation of the amygdala and fusiform gyrus. Based on the neuroanatomical connections of the amygdala, we suggest that the amygdala is acting to increase neural activity in the fusiform gyrus, thereby increasing the likelihood that visual representations that have affective value reach awareness. The psychological consequence is that a person’s momentary affective state might help to select the contents of conscious experience.
Introduction
There are well-documented projections between the amygdala and the ventral visual stream in primates [1]. Neuroimaging studies show that ‘affective’ objects (i.e. objects that are known to elicit an affective change, such as faces depicting emotion) increase activity in both the amygdala and ventral visual cortex [2]. The psychological consequences of these projections and the coactivation of the amygdala and ventral visual stream are the subject of intense research interest. We believe that a recent study by Pessoa and colleagues [3] enables novel speculation of the role of the amygdala in visual awareness, suggests provocative hypotheses regarding the relationship between affective states and sensory processing, and raises important questions about whether the distinction between affect and cognition is respected by the human brain.
The role of the amygdala in visual awareness
Emerging evidence suggests that amygdala activity is linked to the visual awareness of objects [4]. A recent fMRI study by Pessoa and colleagues [3] builds on these findings by demonstrating that amygdala activation is associated with the likelihood that visual representations that have affective value reach awareness. In this study, participants viewed backwardly masked presentations of faces that depicted fear, happiness or neutrality. Each target face was presented for 33 or 67 ms, after which participants indicated whether the face depicted fear or not. A signal detection analysis yielded an index of objective awareness for each presentation time (i.e. responding in a behaviorally correct way at a greater-than-chance level, even in the absence of conscious awareness). All participants showed amygdala–fusiform gyrus (FG) coactivation and objective awareness on 67 ms trials. In the 33 ms trials, only participants who had objective awareness of the faces depicting fear (N = 8) showed enhanced activity in the amygdala and FG; no such increase was observed among participants who did not show objective awareness of these faces (N = 19) (Figure 1). These findings demonstrate that activity in the amygdala and FG (a portion of the ventral visual stream where activity is associated with normal conscious awareness of stimuli [5]) is related to awareness of visual objects.
Figure 1.
Visual awareness is associated with amygdala activation. In the Pessoa et al. study [3], participants viewed backwardly masked images of faces that depicted fear, presented for either 33 ms or 67 ms. All participants showed greater amygdala activation when viewing fearful faces that were presented for 67 ms, compared with faces that depicted neutral expressions. (a) Pessoa et al. found an increase in amygdala activation (as well as fusiform gyrus activation, which is not shown in the figure) only among those participants who showed objective awareness of 33 ms presentations of faces that depicted fear. (b) Participants who did not show objective awareness did not have significant increases in amygdala activation. Given the excitatory projections from the amygdala to the ventral visual stream, this finding suggests that the amygdala enhances visual awareness for objectives with affective value. [Note that low-frequency spatial information reaches the amygdala via the magnocellular visual pathways of the thalamus [15], suggesting possible amygdala activation in (b)].
Pessoa et al. hypothesized that amygdala activity depends on visual awareness (for a discussion on the debate regarding whether amygdala activity is attention dependent, see Ref. [6]). However, neuroanatomical evidence suggests an alternative hypothesis: the amygdala enhances visual awareness. In primates, the basal nucleus of the amygdala projects to the entire ventral visual stream, from association cortex back to primary visual cortex; projections in the other direction are sparse [1]. Also, individuals who have amygdala lesions show decreased FG responses to affective objects compared with normal individuals [7], further supporting the idea that the amygdala enhances activity in the ventral visual stream and, correspondingly, visual awareness of affective objects. (The suggestion that amygdala activation is necessary for visual awareness does not imply that such activation always produces awareness.)
Implications for the role of affect in visual awareness
Our interpretation of the Pessoa et al. [3] study suggests several provocative implications for a science of the mind. First, the variability in people’s conscious awareness of briefly presented affective objects (reported by Pessoa et al.) means that the environment might literally look different to different people. Previous studies using fast presentations of affective stimuli have relied on subjective estimates of visual awareness to demonstrate that the target objects of interest were not seen (e.g. asking participants whether they saw the targets after the scanning session). Using an objective measure of awareness, Pessoa and colleagues found that many participants are aware of faces that are presented for short durations, which implies that, in real life, these people might also see microexpressions of smiles and frowns (that are invisible to others). Such variability might instantiate individual differences in personality dimensions, typified by sensitivity to affective information (e.g. neuroticism and introversion) and might serve as a risk factor for developing clinical disorders, typified by an enhanced sensitivity to unpleasant stimuli or a lowered sensitivity to positive stimuli (e.g. anxiety and depression).
Second, what people literally see in the world around them might be partially determined by their basic (or core) affective state. The amygdala is an integral component of a distributed affective circuit in the mammalian brain that computes a psychologically primitive state of pleasantness or unpleasantness (a ‘core affective state’ [8]). This circuit (which includes the ventral striatum, orbitofrontal cortex and ventromedial prefrontal cortex) instantiates a core affective state by integrating sensory information about a stimulus with a representation of how the stimulus affects the person’s internal (somatovisceral) state [9,10]. A provocative implication of the Pessoa et al. findings is that core affective states not only influence how people interpret objects already seen but might determine what people visually detect in the first place. As a result, individuals in unpleasant affective states might be more likely to be visually aware of brief visual events (e.g. quick changes in facial muscle movements) or have an enhanced ability to detect objects that blend into their background (e.g. snakes in the grass). In some circumstances (e.g. where the base rate of the threat is low), such vigilance might pose a risk for mental illness. (Note that there is debate over the role of the amygdala in affective experience, and studies have shown that patients who have amygdala damage report the same levels of positive and negative affective experience as healthy controls [11]. However, these studies used retrospective reports of affective experience, which rely on beliefs about emotional experience and might not accurately reflect the actual experiences [12].)
The third, and perhaps broadest, implication of Pessoa et al. is that the cognition–affect distinction might not be respected in the brain. Traditionally, affect is thought to be cognitively impenetrable and implemented in subcortical regions of the brain, whereas cognitive processes that are implemented in prefrontal areas regulate affective processing after the fact (discussed in Ref. [4]). Therefore, it has been assumed that cognition and affect represent a neurobiological distinction. However, if parts of the brain that are involved in instantiating an affective state modulate sensory processing, then this distinction is called into question. Cognition has typically been defined as any process that modulates sensory processing [13]. If the amygdala, along with other areas that together compute core affective states, modulates activity in the ventral visual stream, then affect acts as a form of cognition.
Prospects for the future
Further research is needed to understand the ability of the amygdala to modulate sensory processing and awareness of objects in the physical world, but perhaps the real innovation of the findings from Pessoa et al. [3] lies in the provocative implication that it is possible for core affective circuitry to select the contents of consciousness. Neuroanatomical evidence indicates that the amygdala and other parts of core affective circuitry modulate the attentional matrix in the brain. Affective circuitry might enhance sensory processing (i.e. apply attention) by direct projections to sensory cortex (consistent with the Pessoa et al. study), but it might also modulate the attentional matrix through indirect projections to the dorsolateral prefrontal cortex (via the orbitofrontal cortex), thereby influencing goal-based attention. Core affective circuitry also projects to the basal forebrain, brainstem and thalamic nuclei, which are important sources of bottom-up forms of attention that have a role in unifying conscious experience [14]. Through these projections, brain regions that are involved in establishing a core affective state might have strong control over processing throughout the entire cortical mantle, influencing which contents are experienced in the moment and which are likely to be stored in long-term memory.
Acknowledgments
We would like to thank Luiz Pessoa for his comments on an earlier draft of this manuscript. Preparation of this manuscript was supported by NIMH grant K02 MH001981 to Lisa Feldman Barrett.
Footnotes
Publisher's Disclaimer: This article was originally published in a journal published by Elsevier, and the attached copy is provided by Elsevier for the author's benefit and for the benefit of the author's institution, for non-commercial research and educational use including without limitation use in instruction at your institution, sending it to specific colleagues that you know, and providing a copy to your institution's administrator. All other uses, reproduction and distribution, including without limitation commercial reprints, selling or licensing copies or access, or posting on open internet sites, your personal or institution's website or repository, are prohibited. For exceptions, permission may be sought for such use through Elsevier's permissions site at:http://www.elsevier.com/locate/permissionusematerial
References
- 1.Freese JL, Amaral DG. The organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkey. J Comp Neurol. 2005;486:295–317. doi: 10.1002/cne.20520. [DOI] [PubMed] [Google Scholar]
- 2.Pessoa L, et al. Neuroimaging studies of attention: from modulation of sensory processing to top-down control. J Neurosci. 2003;23:3990–3998. doi: 10.1523/JNEUROSCI.23-10-03990.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Pessoa L, et al. Target visibility and visual awareness modulate amygdala responses to fearful faces. Cereb Cortex. 2006;16:366–375. doi: 10.1093/cercor/bhi115. [DOI] [PubMed] [Google Scholar]
- 4.Duncan S, Barrett LF. Affect is a form of cognition: a neurobiological analysis. Cogn Emot. doi: 10.1080/02699930701437931. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Tong F, et al. Binocular rivalry and visual awareness in human extrastriate cortex. Neuron. 1998;21:753–759. doi: 10.1016/s0896-6273(00)80592-9. [DOI] [PubMed] [Google Scholar]
- 6.Eimer M, Holmes A. Event-related brain potential correlates of emotional face processing. Neuropsychologia. 2007;45:15–31. doi: 10.1016/j.neuropsychologia.2006.04.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Vuilleumier P, et al. Distant influences of amygdala lesion on visual cortical activation during emotional face processing. Nat Neurosci. 2004;7:1271–1278. doi: 10.1038/nn1341. [DOI] [PubMed] [Google Scholar]
- 8.Barrett LF, et al. The experience of emotion. Annu Rev Psychol. 2007;58:373–403. doi: 10.1146/annurev.psych.58.110405.085709. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Barbas H, et al. Serial pathways from primate prefrontal cortex to autonomic areas may influence emotional expression. BMC Neurosci. 2003;4:25. doi: 10.1186/1471-2202-4-25. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Ongur D, Price JL. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb Cortex. 2000;10:206–219. doi: 10.1093/cercor/10.3.206. [DOI] [PubMed] [Google Scholar]
- 11.Anderson AK, Phelps EA. Is the human amygdala critical for the subjective experience of emotion? Evidence of intact dispositional affect in patients with amygdala lesions. J Cogn Neurosci. 2002;14:709–720. doi: 10.1162/08989290260138618. [DOI] [PubMed] [Google Scholar]
- 12.Robinson MD, Clore GL. Episodic and semantic knowledge in emotional self-report: evidence for two judgment processes. J Pers Soc Psychol. 2002;83:198–215. [PubMed] [Google Scholar]
- 13.Neisser U. Cognitive Psychology. Appleton-Century Crofts; 1967. [Google Scholar]
- 14.Edelman GM, Tononi G. Basic Books. 2000. A Universe of Consciousness: How Matter Becomes Imagination. [Google Scholar]
- 15.Vuilleumier P, Pourtois G. Distributed and interactive brain mechanisms during emotion face perception: evidence from functional neuroimaging. Neuropsychologia. 2007;45:15–31. doi: 10.1016/j.neuropsychologia.2006.06.003. [DOI] [PubMed] [Google Scholar]

