Abstract
Functional magnetic resonance imaging (fMRI) of the human brain was used to study whether the amygdala is activated in response to emotional stimuli, even in the absence of explicit knowledge that such stimuli were presented. Pictures of human faces bearing fearful or happy expressions were presented to 10 normal, healthy subjects by using a backward masking procedure that resulted in 8 of 10 subjects reporting that they had not seen these facial expressions. The backward masking procedure consisted of 33 msec presentations of fearful or happy facial expressions, their offset coincident with the onset of 167 msec presentations of neutral facial expressions. Although subjects reported seeing only neutral faces, blood oxygen level-dependent (BOLD) fMRI signal in the amygdala was significantly higher during viewing of masked fearful faces than during the viewing of masked happy faces. This difference was composed of significant signal increases in the amygdala to masked fearful faces as well as significant signal decreases to masked happy faces, consistent with the notion that the level of amygdala activation is affected differentially by the emotional valence of external stimuli. In addition, these facial expressions activated the sublenticular substantia innominata (SI), where signal increases were observed to both fearful and happy faces—suggesting a spatial dissociation of territories that respond to emotional valence versus salience or arousal value. This study, using fMRI in conjunction with masked stimulus presentations, represents an initial step toward determining the role of the amygdala in nonconscious processing.
Keywords: amygdala, extended amygdala, substantia innominata, nucleus basalis of Meynert, bed nucleus of the stria terminalis, emotion, facial expression, backward masking, awareness, fMRI, neuroimaging
Neuroscientific research provides many examples of tasks executed below the level of awareness (Schacter et al., 1993; He et al., 1996; Berns et al., 1997; Rauch et al., 1997). It has been argued that initial responses to affective stimuli are automatic and do not require awareness (Zajonc, 1980). The amygdala is a brain area located within the medial temporal lobe that is known to process affective or emotionally valenced stimuli (see Aggleton, 1992). On the basis, in part, of animal studies demonstrating a direct short-latency pathway from the thalamus to the amygdala (LeDoux et al., 1985), LeDoux (1996) has proposed that the amygdala might survey emotionally valenced stimuli without awareness. Consistent with this notion, studies of human subjects by Öhman and colleagues (Öhman, 1992) have demonstrated skin conductance responses to emotionally valenced facial expressions conditioned to predict an aversive electrical shock when these expressions were presented in a manner that prevented awareness (i.e., backward masking). Taking a lead from human lesion data (Adolphs et al., 1995; Calder et al., 1996), recent neuroimaging reports in humans have demonstrated activation within the amygdala in response to facial expressions of emotion (Breiter et al., 1996; Morris et al., 1996). The present study used functional magnetic resonance imaging (fMRI) during the presentation of backwardly masked facial expressions to determine whether amygdala activation might be demonstrated in humans in the absence of explicit knowledge.
A backward masking procedure previously demonstrated to interrupt processing of emotionally expressive faces (Esteves and Öhman, 1993; Rolls and Tovee, 1994) was used. Each masked stimulus consisted of a 33 msec fearful or happy expression face (target), its offset coincident with the onset of a 167 msec neutral expression face (mask).Esteves and Öhman (1993) demonstrated that if the stimulus onset asynchrony (SOA; i.e., the interval between the onset of the target and the mask) was sufficiently brief (<40 msec), human subjects were not aware of the emotionally expressive target face, as defined by objective forced choice tasks and subjective report. In the present study 10 human subjects viewed repeating 28 sec epochs that consisted of either fearful faces masked by neutral faces, happy faces masked by neutral faces, or a single cross (+) that served as a fixation point baseline. We predicted that, although subjects would report seeing only the neutral masks, blood oxygen level-dependent (BOLD) fMRI signal intensity (Kwong et al., 1992; Ogawa et al., 1992) would increase in the amygdala in response to masked fearful targets when compared with masked happy targets. In addition, we predicted that presentation of masked emotional facial expressions would serve to isolate amygdala activation in contrast to previous neuroimaging studies of nonmasked facial expressions, which have demonstrated activation of the amygdala along with numerous additional brain regions (Breiter et al., 1996;Morris et al., 1996).
MATERIALS AND METHODS
Subjects. Ten right-handed males aged 19–32 (mean, 23.8 years) provided informed consent before participation in this study, according to guidelines established by the Subcommittee on Human Studies at the Massachusetts General Hospital. Handedness was defined by the Edinburgh Inventory (Oldfield, 1971). Subjects were told that they would be presented with pictures of faces. All subjects were naive to the face stimuli used and to our hypotheses pertaining to the emotional expressions of faces. For this initial experiment a single gender cohort was studied to minimize heterogeneity, thereby improving statistical power. Future studies of female subjects will be necessary to determine the generalizability of the current results.
Selection of fear faces as threat-related stimuli. Face stimuli consisted of fearful, happy, and neutral expressions of eight individuals (numbers 021, 030, 040, 081, 101, 121, 131, 140; Ekman and Friesen, 1976). We selected fearful faces as our negatively valenced stimuli because human lesion studies document a deficit in the processing of fearful faces after amygdala lesions (Adolphs et al., 1995; Calder et al., 1996), and previous neuroimaging studies demonstrate amygdala activation to these stimuli (Breiter et al., 1996;Morris et al., 1996). We offer the concept that, unlike an angry face that represents a direct threat, the relationship of a fearful face to threat is ambiguous in that a fearful face signals the presence of danger, but not its source. In this sense, a fearful face can be conceptualized as a contextual stimulus, whereas an angry face can be conceptualized as a specific cue.
Paradigm. Subjects were presented with alternating 28 sec epochs of masked fearful face targets (F), masked happy face targets (H), or a single cross that served as a low-level fixation condition (+). During each epoch subjects viewed either 56 masked fearful stimuli or 56 masked happy stimuli (each of eight fearful or happy faces was masked by the neutral expression for each of the other seven individuals).
Masked stimuli were presented twice per second in a random order. Each 200 msec masked stimulus consisted of a 33 msec fearful or happy expression (target) immediately followed by a 167 msec neutral expression (mask).
The order of 28 sec epochs containing 56 fearful or happy masked stimuli was counterbalanced within and across subjects; one-half of the subjects viewed masked fearful, followed by masked happy, targets during their first run (+,F,H,+,F,H,+,F,H,+); the other half viewed masked happy, followed by masked fearful, targets during their first run (+,H,F,+,H,F,+,H,F,+). Then the order of fearful and happy target epochs was reversed for the second run for all subjects. These 10 epochs comprised a 4 min and 40 sec run. Each subject viewed two runs.
Subject debriefing. Subjective report measures were used to assess the subjects’ explicit knowledge of presented masked facial expressions of emotion after the completion of all stimulus presentations. Immediately after the experiment the subjects were asked to describe any aspect of the presented faces. Next, the subjects were asked to comment on the emotional expressions of the faces. Then the subjects were asked if they had seen any happy or smiling faces and asked if they had seen any fearful or afraid faces. Finally, the subjects were shown all face stimuli (fearful, happy, and neutral) and asked to point out the specific faces they had referred to in response to earlier questions.
Stimuli and apparatus. Face stimuli consisted of PICT files that were assembled frame by frame into a film, using Adobe Premiere software. Specialized hardware (Media 100, Marlboro, MA) was used to transfer the digital PICT information to videotape synchronized with the headsweeps of the VCR so as not to distort the stimuli. A VCR was used to play the tape, and the output was projected (Sharp XG-2000U LCD) onto a screen within the imaging chamber, viewable by a mirror (1.5 × 3.5 inches) ∼6.5 inches from the subject’s face. The play speed of the VCR was 30 frames/sec, creating a 33 msec/frame presentation rate.
Pulse rate was measured from the right index finger of all subjects during stimulus presentations via pulse oximetry (In Vivo Systems, Orlando, FL).
Functional magnetic resonance images were collected in a General Electric Signa 1.5 Tesla high-speed imaging device (modified by Advanced NMR Systems, Wilmington, MA), using a quadrature head coil. Our Instascan software is a variant of the echo planar technique first described by Mansfield (1977). Head stabilization was achieved with a plastic bite bar molded to each subject’s dentition.
Image acquisition and data analysis. Our standard image acquisition protocol was used and previously has been detailed elsewhere (Cohen and Weisskoff, 1991; Kwong, 1995). An initial sagittal localizer [spoiled gradient recall acquisition in a steady state (SPGR), 60 slices, resolution 0.898 × 0.898 × 2.8 mm] was performed to provide a reference for future slice selection and for eventual localization within Talairach space (Talairach and Tournoux, 1988). After automated shimming (Reese et al., 1995) to maximize field homogeneity, a magnetic resonance (MR) angiogram (SPGR, resolution 0.78125 × 0.78125 × 2.8 mm) was acquired to identify large- and medium-diameter vessels. Then a set of T1-weighted high-resolution transaxial anatomic scans (resolution 3.125 × 3.125 × 8 mm) was acquired. For the functional series, asymmetric spin echo (ASE) sequences were used to minimize macrovascular signal contributions. Functional ASE data were acquired as 15 contiguous, interleaved, horizontal 8 mm slices that paralleled the intercommissural plane (voxel size 3.125 × 3.125 × 8 mm; 100 images per slice, TR/TE/Flip = 2800 msec/70 msec/90°).
Automated data analytic techniques began with a quantification of subject motion and then correction, using an algorithm developed byJiang et al. (1995), based on Woods et al. (1992). Both functional and high-resolution structural data were placed into normalized Talairach space and resliced into 3.125 × 3.125 × 3 mm voxels in the coronal plane. Then data from individuals were baseline-normalized and concatenated (averaged). Nonparametric statistical maps were calculated with the Kolmogorov–Smirnov (KS) statistic, displayed in pseudocolor, scaled according to significance, and superimposed on T1-weighted high-resolution images also placed into Talairach space and resliced in the coronal plane. Because we predicted only amygdala activation to the present experimental manipulation, our a priori significance threshold (p < 6.6 × 10−4) represents a Bonferroni-corrected 0.05 probability level based on the ∼76 voxels that make up the amygdaloid region (Filipek et al., 1994).
RESULTS
Subject debriefing
Immediately after the experiment, the subjects were asked to describe any aspect of the presented faces. Two of the 10 subjects offered descriptions indicating that they had seen features of the emotional target stimuli. The remaining eight subjects were asked next to comment on the emotional expressions of the faces, and all responded with reference to the neutral mask stimuli alone. Then the subjects were asked if they had seen any happy or fearful faces. All eight subjects reported that they had not seen these expressions. Finally, these eight subjects were shown all face stimuli (fearful, happy, and neutral) and asked to point out the specific faces they had seen. Subjects selected only neutral faces. Therefore, we present here brain activation data for the eight subjects who reported having seen only the neutral faces.
Pulse rate data
Pulse rate was measured in the eight subjects who reported not having seen the masked fearful and happy faces (sampled approximately every 5 sec). Technical problems prevented measurement within the magnet for two of these subjects. Results revealed no significant pulse rate changes to the presentation of fearful or happy faces when compared with one another or the fixation baseline condition (p > 0.05).
fMRI data
Figure 1 presents BOLD signal changes across whole brain in response to masked fearful faces versus masked happy faces for the eight subjects who demonstrated no explicit knowledge of the presence of these stimuli. Note the relative absence of activation outside the amygdaloid region.
Figure 2A presents the most posterior coronal slice from the amygdaloid region of activation depicted in Figure 1. Significantly higher BOLD signal is observed in the amygdala in response to masked fearful faces (467.56 ± 0.41, mean ± SEM) when compared with masked happy faces (464.85 ± 0.43, mean ± SEM). Four contiguous voxels within the right amygdala met the threshold for statistical significance (p < 6.6 × 10 −4; see Materials and Methods). We then assessed the direction of signal change to fearful or happy faces in comparison to the fixation baseline epochs. We considered only the four significantly activated voxels from the fear versus happy contrast depicted in Figure 2A; the masked fear versus fixation contrast revealed a significant increase in signal intensity, whereas the masked happy versus fixation contrast revealed a significant decrease in signal intensity. For this comparison we treated the four voxels in the amygdala (defined by the overall fear vs happy contrast) as one region of interest (ROI). Mean signal intensity within this ROI demonstrated a significant increase to masked fearful faces and a significant decrease to masked happy faces when compared with fixation (p < 0.05). Thus, the larger overall fear versus happy statistical effect (p < 6.6 × 10−4) demonstrated across these four voxels depends on both a response to the fearful faces (increase) and the happy faces (decrease). By considering only voxels activated in the fear versus happy contrast, we are assured of describing only the nature of signal changes specifically attributable to the emotional expressions.
To delineate the effect of repeated presentations of these stimuli, Figure 2B presents BOLD signal changes in the amygdala for the significant ROI depicted in Figure2A across all epochs of presentation. First, notice that BOLD signal in the amygdala is always higher during presentation of masked fear faces when compared with the contiguous (counterbalanced) epoch of masked happy faces. For this group of eight subjects the average percentage of change in signal intensity between conditions (masked fear vs masked happy) ranged from 0.77 to 0.35% across epochs. When compared with the fixation baseline condition, signal intensity increases in response to fearful faces occurred during the first two fear presentation epochs but were attenuated to baseline with subsequent stimulus presentations. In contrast, however, note that signal intensity decreases in response to happy faces persisted through all presentation epochs.
Figure 3A depicts BOLD fMRI signal changes for the masked fear versus happy contrast in the most anterior coronal slice from the amygdaloid region of activation depicted in Figure 1. The ventral portion of this activation is within the temporal lobe, where the most anterior extent of the amygdala is located; however, this activation extends immediately rostral and dorsal to the traditionally defined amygdala within the region of the sublenticular substantia innominata (SI) of the basal forebrain (seeHeimer et al., 1997). Within the SI this activation extends in a dorsomedial direction to the base of the anterior commissure.
Although BOLD signal changes in the ventral portion of this activation increased to fearful faces and decreased to happy faces (similar to the activation in Fig. 2), significant BOLD signal changes in the dorsal portion of this activation for the masked fear versus masked happy contrast (p < 6.6 × 10−4) were created by signal increases toboth fearful and happy faces, in which increases to fearful faces were significantly larger. Figure 3B presents an enlargement of the significant voxels of activation from the masked fear versus masked happy contrast pictured in Figure 3A. The activation is presented twice: once for the fear versus fixation contrast and again for the happy versus fixation contrast. Numbers overlying the voxels present the average percentage of BOLD signal change from the fixation baseline across all stimulus presentations. Note that, in response to masked fear faces, all voxels of activation—the most ventral voxels located in the amygdala and the most dorsal voxels located in the SI—demonstrate signal increases. In contrast, in response to masked happy faces, ventrally located voxels demonstrate signal decreases (similar to the amygdala response depicted in Fig. 2), whereas dorsal voxels located in the SI demonstrate signal increases.
Table 1 presents Talairach coordinates (Talairach and Tournoux, 1988) and probability values of activated brain regions for the masked fear versus happy contrast for the eight subjects that reported not having seen the masked fearful and happy faces. Activation within the left and right amygdala exceeded the a priori threshold for significant activation (p< 6.6 × 10−4). To obviate bias, we report here all areas of activation across whole brain that met this threshold. One other brain area, left inferior prefrontal cortex, also met this criterion (see Fig. 1, row one, slice nine). Because it was not predicted, we note then that activation in this region did not achieve the appropriate Bonferroni-corrected threshold for whole brain (p < 1.0 × 10−7).
Table 1.
No. | Location in brain | pvalue | Talairach coordinates | ||
---|---|---|---|---|---|
x | y | z | |||
1. | Amygdala | 3.7 × 10−5 | 18 | −6 | −15 |
2a. | Amygdala/ | 1.6 × 10−4 | −15 | 0 | −12 |
2b. | Substantia innominata | 2.9 × 10−4 | −12 | 0 | −9 |
3. | Inferior prefrontal cortex | 1.6 × 10−4 | −28 | 42 | 9 |
Areas of significantly increased BOLD fMRI signal intensity across whole brain during presentation of masked fearful faces versus masked happy faces. Similar to Figures 1, 2, 3, data presented are for the eight subjects who reported not having seen fearful or happy faces. Reported probability values and Talairach coordinates reflect the maximum activated voxel. Activation 1 corresponds to the activation pictured in Figure 2. Activation 2a, b corresponds to the activation pictured in Figure 3. The location of maximum voxels within the temporal lobe (amygdala) and basal forebrain (substantia innominata) are reported in 2a and 2b, respectively. The Talairach atlas (Talairach and Tournoux, 1988) suggests that the location of Activation 2a should be described as temporal cortex. Our designation of this locus as within the amygdala is based on (1) inspection of high resolution structural data, (2) other human structural atlases (DeArmond et al., 1993) depicting the amygdala as prominent at the anterior to posterior location of the anterior commissure (y = 0), and (3) the similar response topography to the amygdala activation in Figure 2(increase to fear, decrease to happy). Because activation of inferior frontal cortex was not predicted and our Bonferroni corrected significance threshold is based on the smaller size of the amygdala, we note that activation of this region did not achieve the appropriate Bonferroni corrected threshold for whole brain (see Results).
Technical considerations
Quantification of motion—Corrected motion during functional image acquisition was <1.5 mm for all subjects. Missing data—A computer failure during image acquisition of subject number 7 caused his first run to be lost. This did not affect the results, because statistical effects were similar whether six, seven, or eight subjects were considered. The fact that the results were similar to those of six subjects is important, because loss of these data did not compromise the protection afforded by counterbalancing. Vessel effects—To rule out the possibility that the observed activations were attributable to flow through large vessels located medial to the temporal lobe (e.g., inferior carotid, middle cerebral artery), we acquired MR angiograms for these eight subjects, placed them into normalized Talairach space, and then averaged them across the subjects. Thus, the composite activations for eight subjects did not overlie the location of large vessels on averaged MR angiograms. Susceptibility artifact—It is unlikely that the observed activation is an artifact of changes in the nearby field of susceptibility because (1) inspection of animated raw signal intensity changes over time revealed no obvious systematic changes in susceptibility that mirrored counterbalanced conditions, and (2) these results (i.e., increased signal to fear, decreased signal to happy) are consistent with a previous positron emission tomography (PET) study using nonmasked stimuli, where susceptibility is not a concern.
DISCUSSION
Significance of amygdala activation to masked stimuli
Amygdala activation was observed in response to masked fearful faces versus masked happy target faces that subjects reported not having seen. As predicted, the backward masking of emotional facial expressions resulted in impressive isolation of the amygdala. This finding is particularly striking when considered in light of an earlier neuroimaging study demonstrating activation of the amygdala and four additional brain regions to presentation of nonmasked fearful faces versus happy faces (Morris et al., 1996).
These data highlight the automaticity of the amygdala response and are consistent with the assertion of LeDoux (1996) that the amygdala responds to early, crude representations of external stimuli. Although consistent with the notion that the amygdala might receive stimulus information directly from the thalamus (LeDoux et al., 1985), prior or parallel to elaborate cortical processing, the temporal resolution of the present design (based on 28 sec epoch lengths) does not address this issue directly. In addition, portions of candidate cortical areas that also might survey masked facial stimuli [e.g., temporal visual cortex (Hasselmo et al., 1989) and ventral prefrontal cortex (Tranel et al., 1995; Hornak et al., 1996)] may not have been visualized in the present study because of characteristic signal drop-out associated with fMRI caused by the nearby sinus space. Replication of the present effect using PET (where susceptibility drop-out is not an issue) would address this concern.
Direction of signal changes in the amygdala
Within the amygdala, signal intensity increased to masked fear faces and decreased to masked happy faces, consistent with a previous imaging study (Morris et al., 1996). In addition, signal increases to masked fearful faces habituated. Habituation of response within the amygdala to emotionally valenced stimuli that have proven inconsequential is consistent with previous reports in both animals (Bordi et al., 1993) and humans (Breiter et al., 1996; Irwin et al., 1996). In contrast, however, signal intensity decreases in response to happy faces persisted through all presentation epochs. Happy faces appear to provide information of enduring importance and, in this sense, might be conceptualized as safety signals. One interpretation of these data is that both fearful and happy faces provide information about the potential for threat in a given environment, differentially affecting the level of activity in the amygdala.
This differential amygdala response, based on the valence of facial expressions, is consistent with a recent study of human infants in which presentation of negatively valenced (angry) faces produced increased eyeblink magnitudes and positively valenced (happy) faces produced decreased eyeblink magnitudes [Balaban (1995); see also Lang (1995)]. Activation of the amygdala is known to modulate eyeblink reflex sensitivity (Davis, 1992). To elaborate, although direct electrical stimulation of the amygdala in animals does not produce an eyeblink, the magnitude of the next eyeblink that is elicited after amygdala stimulation is modified (Whalen and Kapp, 1991). These converging results imply that, although amygdala activation to experimental presentation of emotionally valenced facial expressions may not produce obvious overt responses, it modifies overt responses tosubsequent sensory information through numerous efferent pathways (see Kapp et al., 1992).
Significance of SI activation
The present experiment also produced activation that extended into the sublenticular SI of the basal forebrain, consistent with recent PET studies demonstrating blood flow changes within the SI that correlate with (1) recall of negatively valenced film stimuli (Cahill et al., 1996) as well as (2) thalamic responses to aversively conditioned stimuli (Morris et al., 1997). These data are also consistent with an emerging understanding of the inter-related anatomy of this region. For example, the “extended amygdala,” including the bed nucleus of the stria terminalis (BNST; see Davis et al., 1997), describes a subset of neurons within the SI characterized as a functional and anatomical continuum of the traditionally defined amygdala, based on similarities in cytoarchitecture as well as neurotransmitter and projection systems (Heimer et al., 1997). In addition, the amygdala is known to project directly to the SI (Russchen et al., 1985) where the cholinergic nucleus basalis of Meynert (NBM) neurons are located (Mesulam et al., 1983).
The present demonstration of increased activation of the SI toboth fearful and happy faces is consistent with (1) data in primates demonstrating increased neuronal responses in the SI to both positive (Richardson et al., 1988; Wilson and Rolls, 1990) and negative (Whalen et al., 1994) stimuli, (2) the well established role of the NBM in the modulation of cortical neuronal excitability (Celesia and Jasper, 1966; Szerb, 1967; Sillitto and Kemp, 1983; Metherate and Ashe, 1991), and (3) the fact that the activity of these neurons is more closely associated with an animal’s overall state of vigilance or arousal rather than with its response to specific stimulus presentations (Detari and Vanderwolf, 1987; Whalen et al., 1994). Thus, activation of the SI to both fearful and happy facial expressions might represent a more generalized response to the salience (see Morris et al., 1997) or arousal value (see Kapp et al., 1992; Whalen et al., 1994) of these stimuli.
The dissociation between an amygdala response based on valence and an SI response based on arousal offers a possible neuroanatomical substrate for psychophysiological responses long hypothesized by Lang and colleagues to reflect emotional “action dispositions,” based on the valence versus arousal value of presented stimuli (see Lang, 1995;Shupp et al., 1997). In addition, this response dissociation replicates both the earlier Morris et al. (1996) and Breiter et al. (1996)findings and clarifies response differences between the two studies. To elaborate, in the present study the amygdala demonstrated increases to fear and decreases to happy faces, similar to Morris et al. (1996); activations that extended into the SI demonstrated increases to both fear and happy faces, similar to Breiter et al. (1996).
Explicit knowledge and the determination of awareness
The present study was designed as a demonstration of the automaticity of amygdala response and as an initial effort toward determining whether awareness is a prerequisite for amygdala activation. Toward this end we used a stimulus onset asynchrony (SOA) parameter (33 msec) below a threshold previously determined to prevent awareness of masked emotional facial expressions (Esteves andÖhman, 1993). Still, numerous methodological differences between the present and previous studies preclude generalizations about awareness on the basis of the parameter of SOA alone.
There are several challenges associated with the measurement of awareness (see Merikle, 1992; Greenwald et al., 1996). These include the timing of measurement [during interstimulus intervals (ISIs) vs after completion of all stimulus presentations] and thetype of measurement (objective vs subjective; recall vs recognition). For this initial study we chose to assess awareness subjectively after completion of all stimulus presentations, emphasizing recall versus recognition measures. The timing we chose does limit interpretation, to the extent that debriefing results may not accurately reflect the subjects’ awareness at the time of presentation. However, this strategy (1) allowed for shorter ISIs, maximizing the number of masked facial expressions presented within each epoch and thereby protecting against type II error in terms of amygdala activation, and (2) obviated the need for subjects to be informed of the presence of masked stimuli before the study so that findings would not be confounded by explicit attempts to detect emotional expressions. Our reliance on recall versus recognition measures of explicit knowledge was guided by research demonstrating that recognition tasks requiring discrimination of very similar stimuli are more susceptible to incorrect identification of target items (Underwood, 1965; Roediger, 1980; Hintzman et al., 1992; Hintzman and Curran, 1995; Mäntylä, 1997). With specific reference to face stimuli, Mäntylä has demonstrated that recognition of faces is driven by familiarity processes versus detailed episodic information (Mäntylä, 1997).
An interstimulus objective forced choice task remains the “gold standard” for the definition of awareness in behavioral psychology (see Greenwald et al., 1996). Future studies using such an interstimulus measure would address the question of awareness directly but would change the nature of the task fundamentally (active search vs passive viewing). Use of an objective forced choice measure after completion of all stimulus presentations may enable the objective assessment of awareness during a passive viewing task, although this approach assumes that only consciously perceived information will influence objective responses (see Jacoby, 1991; Merikle, 1992; Seamon et al., 1995).
Conclusions and future direction
The role of the amygdala in fear conditioning is well established (Aggleton, 1992), and the more recent reports of its involvement in the processing of emotional facial expression (Adolphs et al., 1995;Breiter et al., 1996; Calder et al., 1996; Morris et al., 1996) are consistent with this role. The present study builds on the growing number of neuroimaging studies demonstrating that human amygdala activation in response to emotionally valenced stimuli is a reliable phenomenon (Breiter et al., 1996; Cahill et al., 1996; Irwin et al., 1996; Morris et al., 1996; Reiman et al., 1997). Specifically, we demonstrated isolated amygdala activation in response to masked presentations of facial expressions that prevented explicit knowledge. These data underscore the automaticity (see McNally, 1995) of the processing of the emotional facial expressions of the amygdala and are consistent with data implicating the amygdala in the nonconscious monitoring of emotional stimuli (Halgren, 1992; Öhman, 1992;LeDoux, 1996).
In light of the present findings, we note that subjects with anxiety disorders demonstrate (1) amygdala activation in association with symptoms (see Rauch and Shin, 1997) and (2) information-processing biases during nonconscious processing (see Öhman, 1992; Mathews and MacLeod, 1994; Mogg et al., 1995; McNally et al., 1996). We are developing fMRI probes, using masked stimulus presentations, in an attempt to elucidate the role of the amygdala in the clinical phenomena observed across the anxiety disorders (e.g., hypervigilance, failure to habituate, exaggerated startle, etc.).
Footnotes
This work was supported by a Harvard Medical School Clinical Research Training Program (CRTP) Fellowship to P.J.W. (MH-16259; Robert McCarley and Stuart Hauser, Program Directors), MH-01215 and National Alliance for Research on Schizophrenia and Depression Award to S.L.R., and the David A. Judah Fund to M.A.J. We thank Terry Campbell, Mary Foley, Ivan Audouin, Sherry Pai, Aiping Jiang, and George Bush for technical assistance; and Richard McNally, Bruce Kapp, Tim Curran, Daniel Schacter, Robert Savoy, Randy Buckner, Cary Savage, Elizabeth Phelps, and Bruce Rosen for advice and comments.
Correspondence should be addressed to Dr. Paul J. Whalen, Department of Psychiatry, Massachusetts General Hospital, 13th Street, Building 149, CNY-9, Charlestown, MA 02129. E-mail: paulw@nmr.mgh.harvard.edu
REFERENCES
- 1.Adolphs R, Tranel D, Damasio H, Damasio A. Fear and the human amygdala. J Neurosci. 1995;15:5879–5891. doi: 10.1523/JNEUROSCI.15-09-05879.1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Aggleton JP, editor. The amygdala: neurobiological aspects of emotion, memory, and mental dysfunction. Wiley; New York: 1992. [Google Scholar]
- 3.Balaban MT. Affective influences on startle in five month old infants: reactions to facial expressions of emotion. Child Dev. 1995;66:28–36. doi: 10.1111/j.1467-8624.1995.tb00853.x. [DOI] [PubMed] [Google Scholar]
- 4.Berns GS, Cohen JD, Mintun MA. Brain regions responsive to novelty in the absence of awareness. Science. 1997;276:1272–1275. doi: 10.1126/science.276.5316.1272. [DOI] [PubMed] [Google Scholar]
- 5.Bordi F, LeDoux JE, Clugnet MC, Pavlides C. Single-unit activity in the lateral nucleus of the amygdala and overlying areas of striatum in freely behaving rats: rates, discharge patterns, and responses to acoustic stimuli. Behav Neurosci. 1993;107:757–769. doi: 10.1037/0735-7044.107.5.757. [DOI] [PubMed] [Google Scholar]
- 6.Breiter HC, Etcoff NL, Whalen PJ, Kennedy WA, Rauch SL, Buckner RL, Strauss MM, Hyman SE, Rosen BR. Response and habituation of the human amygdala during visual processing of facial expression. Neuron. 1996;17:875–887. doi: 10.1016/s0896-6273(00)80219-6. [DOI] [PubMed] [Google Scholar]
- 7.Cahill L, Haier RJ, Fallon J, Alkire MT, Tang C, Keator D, Wu J, McGaugh JL. Amygdala activity at encoding correlated with long-term, free recall of emotional information. Proc Natl Acad Sci USA. 1996;93:8016–8021. doi: 10.1073/pnas.93.15.8016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Calder AJ, Young AW, Rowland D, Perrett DI, Hodges JR, Etcoff NL. Facial emotion recognition after bilateral amygdala damage: differentially severe impairment of fear. Cognit Neuropsychol. 1996;13:699–745. [Google Scholar]
- 9.Celesia GG, Jasper HH. Acetylcholine released from cerebral cortex in relation to state of activation. Neurology. 1966;16:1053–1064. doi: 10.1212/wnl.16.11.1053. [DOI] [PubMed] [Google Scholar]
- 10.Cohen MS, Weisskoff RM. Ultra-fast imaging. Magn Reson Imaging. 1991;9:1–37. doi: 10.1016/0730-725x(91)90094-3. [DOI] [PubMed] [Google Scholar]
- 11.Davis M. The role of the amygdala in conditioned fear. In: Aggleton JP, editor. The amygdala: neurobiological aspects of emotion, memory, and mental dysfunction. Wiley; New York: 1992. pp. 255–306. [Google Scholar]
- 12.Davis M, Walker DL, Lee Y. Roles of the amygdala and bed nucleus of the stria terminalis in fear and anxiety measured with the acoustic startle reflex. In: Yehuda R, McFarlane AC, editors. Psychobiology of posttraumatic stress disorder. New York Academy of Sciences; New York: 1997. pp. 305–331. [DOI] [PubMed] [Google Scholar]
- 13.DeArmond SJ, Fusco MM, Dewey MM. Structure of the human brain, 3rd Ed, pp 140–141. Oxford UP; New York: 1993. [Google Scholar]
- 14.Detari L, Vanderwolf CH. Activity of identified cortically projecting and other basal forebrain neurones during large slow waves and cortical activation in anesthetized rats. Brain Res. 1987;437:1–8. doi: 10.1016/0006-8993(87)91521-6. [DOI] [PubMed] [Google Scholar]
- 15.Ekman P, Friesen WV. Pictures of facial affect. Consulting Psychologists; Palo Alto, CA: 1976. [Google Scholar]
- 16.Esteves F, Öhman A. Masking the face: recognition of emotional facial expressions as a function of the parameters of backward masking. Scand J Psychol. 1993;34:1–18. doi: 10.1111/j.1467-9450.1993.tb01096.x. [DOI] [PubMed] [Google Scholar]
- 17.Filipek P, Richelme C, Kennedy D, Caviness V. The young adult human brain: an MRI-based morphometric analysis. Cereb Cortex. 1994;4:344–360. doi: 10.1093/cercor/4.4.344. [DOI] [PubMed] [Google Scholar]
- 18.Greenwald AG, Draine SC, Abrams RL. Three cognitive markers of unconscious semantic activation. Science. 1996;273:1699–1702. doi: 10.1126/science.273.5282.1699. [DOI] [PubMed] [Google Scholar]
- 19.Halgren E. Emotional neurophysiology of the human amygdala within the context of human cognition. In: Aggleton JP, editor. The amygdala: neurobiological aspects of emotion, memory, and mental dysfunction. Wiley; New York: 1992. pp. 191–228. [Google Scholar]
- 20.Hasselmo ME, Rolls ET, Baylis GC. The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behav Brain Res. 1989;32:203–218. doi: 10.1016/s0166-4328(89)80054-3. [DOI] [PubMed] [Google Scholar]
- 21.He S, Cavanaugh P, Intrilligator J. Attentional resolution and locus of visual awareness. Nature. 1996;383:334–337. doi: 10.1038/383334a0. [DOI] [PubMed] [Google Scholar]
- 22.Heimer L, Harlan RE, Alheid GF, Garcia MM, De Olmos J. Substantia innominata: a notion which impedes clinical–anatomical correlations in neuropsychiatric disorders. Neuroscience. 1997;76:957–1006. doi: 10.1016/s0306-4522(96)00405-8. [DOI] [PubMed] [Google Scholar]
- 23.Hintzman DL, Curran T. When encoding fails: instructions, feedback, and registration without learning. Mem Cognit. 1995;23:213–226. doi: 10.3758/bf03197223. [DOI] [PubMed] [Google Scholar]
- 24.Hintzman DL, Curran T, Oppy B. Effects of similarity and repetition on memory: registration without learning? J Exp Psychol. 1992;18:667–680. doi: 10.1037//0278-7393.18.4.667. [DOI] [PubMed] [Google Scholar]
- 25.Hornak J, Rolls ET, Wade D. Face and voice expression identification in patients with emotional and behavioural changes following ventral frontal lobe damage. Neuropsychologia. 1996;34:247–261. doi: 10.1016/0028-3932(95)00106-9. [DOI] [PubMed] [Google Scholar]
- 26.Irwin W, Davidson RJ, Lowe MJ, Mock BJ, Sorenson JA, Turski PA. Human amygdala activation detected with echo-planar functional magnetic resonance imaging. NeuroReport. 1996;7:1765–1769. doi: 10.1097/00001756-199607290-00014. [DOI] [PubMed] [Google Scholar]
- 27.Jacoby LL. A process dissociation framework: separating automatic from intentional uses of memory. J Mem Language. 1991;30:513–541. [Google Scholar]
- 28.Jiang A, Kennedy DN, Baker JR, Weiskoff RM, Tootell RBH, Woods RP, Benson RR, Kwong KK, Brady TJ, Rosen BR, Belliveau JW. Motion detection and correction in functional MR imaging. Hum Brain Mapp. 1995;3:224–235. [Google Scholar]
- 29.Kapp BS, Whalen PJ, Supple WF, Pascoe J. Amygdaloid contributions to conditioned arousal and sensory information processing. In: Aggleton JP, editor. The amygdala: neurobiological aspects of emotion, memory, and mental dysfunction. Wiley; New York: 1992. pp. 229–254. [Google Scholar]
- 30.Kwong KK. Functional magnetic resonance imaging with echo planar imaging. Magn Reson Q. 1995;11:1–20. [PubMed] [Google Scholar]
- 31.Kwong KK, Belliveau JW, Chesler DA, Goldberg IE, Weisskoff RM, Poncelet BP, Kennedy DN, Hoppel BE, Cohen MS, Turner R, Cheng HM, Brady TJ, Rosen BR. Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. Proc Natl Acad Sci USA. 1992;89:5675–5679. doi: 10.1073/pnas.89.12.5675. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Lang PJ. The emotion probe: studies of motivation and attention. Am Psychologist. 1995;50:372–385. doi: 10.1037//0003-066x.50.5.372. [DOI] [PubMed] [Google Scholar]
- 33.LeDoux JE. The emotional brain. Simon and Shuster; New York: 1996. [Google Scholar]
- 34.LeDoux JE, Ruggiero DA, Reis DJ. Projections to the subcortical forebrain from anatomically defined regions of the medial geniculate body in the rat. J Comp Neurol. 1985;242:182–213. doi: 10.1002/cne.902420204. [DOI] [PubMed] [Google Scholar]
- 35.Mansfield P. Multi-planar image formation using NMR spin echoes. J Physics [Suppl C] 1977;10:L55–L58. [Google Scholar]
- 36.Mäntylä T. Recollection of faces: remembering differences and knowing similarities. J Exp Psychol. 1997;23:1203–1216. doi: 10.1037//0278-7393.23.5.1203. [DOI] [PubMed] [Google Scholar]
- 37.Mathews A, MacLeod C. Cognitive approaches to emotion and emotional disorders. Annu Rev Psychol. 1994;45:25–50. doi: 10.1146/annurev.ps.45.020194.000325. [DOI] [PubMed] [Google Scholar]
- 38.McNally RJ. Automaticity and the anxiety disorders. Behav Res Ther. 1995;33:747–754. doi: 10.1016/0005-7967(95)00015-p. [DOI] [PubMed] [Google Scholar]
- 39.McNally RJ, Amir N, Lipke HJ. Subliminal processing of threat cues in posttraumatic stress disorder? J Anxiety Disord. 1996;10:115–128. [Google Scholar]
- 40.Merikle PM. Perception without awareness: critical issues. Am Psychologist. 1992;47:792–796. doi: 10.1037//0003-066x.47.6.792. [DOI] [PubMed] [Google Scholar]
- 41.Mesulam M-M, Mufson EI, Wainer BH, Levey AI. Central cholinergic pathways in the rat: an overview based on an alternative nomenclature (Ch1–Ch6). Neuroscience. 1983;10:1185–1201. doi: 10.1016/0306-4522(83)90108-2. [DOI] [PubMed] [Google Scholar]
- 42.Metherate R, Ashe JH. Basal forebrain stimulation modifies auditory cortex responsiveness by an action at muscarinic receptors. Brain Res. 1991;559:163–167. doi: 10.1016/0006-8993(91)90301-b. [DOI] [PubMed] [Google Scholar]
- 43.Mogg K, Bradley BP, Williams R. Attentional bias in anxiety and depression: the role of awareness. Br J Clin Psychol. 1995;34:17–36. doi: 10.1111/j.2044-8260.1995.tb01434.x. [DOI] [PubMed] [Google Scholar]
- 44.Morris JS, Frith CD, Perrett DI, Rowland D, Young AW, Calder AJ, Dolan RJ. A differential neural response in the human amygdala to fearful and happy facial expressions. Nature. 1996;383:812–815. doi: 10.1038/383812a0. [DOI] [PubMed] [Google Scholar]
- 45.Morris JS, Friston KJ, Dolan RJ. Neural responses to salient visual stimuli. Proc R Soc Lond [Biol] 1997;264:769–775. doi: 10.1098/rspb.1997.0109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Ogawa S, Tank DW, Menon R, Ellermann JM, Kim SG, Merkle H, Ugurbil K. Intrinsic signal changes accompanying sensory stimulation: functional brain mapping using MRI. Proc Natl Acad Sci USA. 1992;89:5951–5955. doi: 10.1073/pnas.89.13.5951. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Öhman A. Fear and anxiety as emotional phenomena: clinical phenomenology, evolutionary perspectives, and information-processing mechanisms. In: Lewis M, Haviland JM, editors. Handbook of emotions. Guilford; New York: 1992. pp. 511–536. [Google Scholar]
- 48.Oldfield RC. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 1971;9:97–113. doi: 10.1016/0028-3932(71)90067-4. [DOI] [PubMed] [Google Scholar]
- 49.Rauch SL, Shin LM. Functional neuroimaging studies in posttraumatic stress disorder. In: Yehuda R, McFarlane AC, editors. Psychobiology of posttraumatic stress disorder. New York Academy of Sciences; New York: 1997. pp. 83–98. [DOI] [PubMed] [Google Scholar]
- 50.Rauch SL, Whalen PJ, Savage CR, Curran T, Kendrick A, Brown HD, Bush G, Breiter HC, Rosen BR. Striatal recruitment during an implicit sequence learning task as measured by functional magnetic resonance imaging. Hum Brain Mapp. 1997;5:124–132. [PubMed] [Google Scholar]
- 51.Reese TG, Davis TL, Weisskoff RM. Automated shimming at 1.5 T using echo-planar image frequency maps. J Magn Reson Imaging. 1995;5:739–745. doi: 10.1002/jmri.1880050621. [DOI] [PubMed] [Google Scholar]
- 52.Reiman EM, Lane RD, Ahern GL, Schwartz GE, Davidson RJ, Friston KJ, Yun L, Chen K. Neuroanatomical correlates of externally and internally generated human emotion. Am J Psychiatry. 1997;154:918–925. doi: 10.1176/ajp.154.7.918. [DOI] [PubMed] [Google Scholar]
- 53.Richardson RT, Mitchell SJ, Baker FH, DeLong MR. Responses of nucleus basalis of Meynert neurons in behaving monkeys. In: Woody CD, Alkon DL, McGaugh JL, editors. Cellular mechanisms of conditioning and behavioral plasticity. Plenum; New York: 1988. pp. 161–173. [Google Scholar]
- 54.Roediger HL. Memory metaphors in cognitive psychology. Mem Cognit. 1980;8:231–246. doi: 10.3758/bf03197611. [DOI] [PubMed] [Google Scholar]
- 55.Rolls ET, Tovee MJ. Processing speed in the cerebral cortex and the neurophysiology of visual masking. Proc R Soc Lond [Biol] 1994;257:9–15. doi: 10.1098/rspb.1994.0087. [DOI] [PubMed] [Google Scholar]
- 56.Russchen FT, Amaral DG, Price JL. The afferent connections of the substantia innominata in the monkey, Macaca fascicularis. J Comp Neurol. 1985;242:1–27. doi: 10.1002/cne.902420102. [DOI] [PubMed] [Google Scholar]
- 57.Schacter DS, Chiu P, Ochsner KN. Implicit memory: a selective review. Annu Rev Neurosci. 1993;16:159–182. doi: 10.1146/annurev.ne.16.030193.001111. [DOI] [PubMed] [Google Scholar]
- 58.Seamon JG, Williams PC, Crowley MJ, Kim IJ, Langer SA, Orne PJ, Wishengrad DL. The mere exposure effect is based on implicit memory: effects of stimulus type, encoding conditions and number of exposures on recognition and affect judgments. J Exp Psychol. 1995;21:711–721. [Google Scholar]
- 59.Shupp HT, Cuthbert BN, Bradley MM, Birbaumer N, Lang P. Probe P3 and blinks: two measures of affective startle modulation. Psychophysiology. 1997;34:1–6. doi: 10.1111/j.1469-8986.1997.tb02409.x. [DOI] [PubMed] [Google Scholar]
- 60.Sillitto AM, Kemp JA. Cholinergic modulation of the functional organization of the cat visual cortex. Brain Res. 1983;289:143–155. doi: 10.1016/0006-8993(83)90015-x. [DOI] [PubMed] [Google Scholar]
- 61.Szerb JC. Cortical acetylcholine release and electroencephalographic arousal. J Physiol (Lond) 1967;192:329–345. doi: 10.1113/jphysiol.1967.sp008303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Talairach J, Tournoux P. Co-planar stereotaxic atlas of the human brain. Theime; New York: 1988. [Google Scholar]
- 63.Tranel D, Damasio H, Damasio AR. Double dissociation between overt and covert face recognition. J Cognit Neurosci. 1995;7:425–432. doi: 10.1162/jocn.1995.7.4.425. [DOI] [PubMed] [Google Scholar]
- 64.Underwood BJ. False recognition produced by implicit verbal responses. J Exp Psychol. 1965;70:122–129. doi: 10.1037/h0022014. [DOI] [PubMed] [Google Scholar]
- 65.Whalen PJ, Kapp BS. Contributions of the amygdaloid central nucleus to the modulation of the nictitating membrane reflex in the rabbit. Behav Neurosci. 1991;104:141–153. doi: 10.1037//0735-7044.105.1.141. [DOI] [PubMed] [Google Scholar]
- 66.Whalen PJ, Kapp BS, Pascoe J. Neuronal activity within the nucleus basalis and conditioned neocortical electroencephalographic activation. J Neurosci. 1994;14:1623–1633. doi: 10.1523/JNEUROSCI.14-03-01623.1994. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Wilson FAW, Rolls ET. Neuronal responses related to reinforcement in the primate basal forebrain. Exp Brain Res. 1990;509:213–231. doi: 10.1016/0006-8993(90)90546-n. [DOI] [PubMed] [Google Scholar]
- 68.Woods RP, Cherry SR, Mazziotta JC. Automated algorithm for aligning tomographic images. II. Cross-modality MRI–PET registration. J Comput Assist Tomogr. 1992;16:620–633. doi: 10.1097/00004728-199207000-00024. [DOI] [PubMed] [Google Scholar]
- 69.Zajonc RB. Feeling and thinking: preferences need no inferences. Am Psychologist. 1980;35:151–175. [Google Scholar]