Abstract
Cognitive control mechanisms allow individuals to behave adaptively in the face of complex and sometimes conflicting information. Although the neural bases of these control mechanisms have been examined in many contexts, almost no attention has been paid to their role in resolving conflicts between competing social cues, which is surprising given that cognitive conflicts are part of many social interactions. Evidence about the neural processing of social information suggests that two systems—the mirror neuron system (MNS) and mental state attribution system (MSAS)—are specialized for processing nonverbal and contextual social cues, respectively. This could support a model of social cognitive conflict resolution in which competition between social cues would recruit domain-general cognitive control mechanisms, which in turn would bias processing toward the MNS or MSAS. Such biasing could also alter social behaviors, such as inferences made about the internal states of others. We tested this model by scanning participants using functional magnetic resonance imaging while they drew inferences about the social targets' emotional states based on congruent or incongruent nonverbal and contextual social cues. Conflicts between social cues recruited the anterior cingulate and lateral prefrontal cortex, brain areas associated with domain-general control processes. This activation was accompanied by biasing of neural activity toward areas in the MNS or MSAS, which tracked, respectively, with perceivers' behavioral reliance on nonverbal or contextual cues when drawing inferences about targets' emotions. Together, these data provide evidence about both domain-general and domain-specific mechanisms involved in resolving social cognitive conflicts.
Introduction
Everyday life continually requires selection of, and response to, goal-relevant stimuli in the face of complex and sometimes conflicting information. This ability is reliably associated with engagement of posterior medial and lateral prefrontal regions implicated in processing response conflicts and task-related uncertainty (Botvinick et al., 2001; Critchley et al., 2001) and flexibly determining which information is relevant to current goals (Thompson-Schill et al., 1997; Konishi et al., 1998). These regions constitute a domain-general cognitive control system that resolves conflict by amplifying or attenuating activity in “downstream” neural structures responsible for processing relevant information (Desimone and Duncan, 1995; Miller and Cohen, 2001) ranging from spatial locations (Corbetta et al., 1991) to affective cues (Bishop et al., 2004; Ochsner et al., 2009).
Although control over information processing is a central topic in cognitive neuroscience, extant research has essentially ignored the role of control processes in social cognition. This is surprising, because much of human cognition is aimed at guiding social behavior (Tomasello, 2000), often on the basis of complex and conflicting cues. For example, during social interactions, a perceiver may have to decide how a social target (i.e., another person) feels based on incongruent cues (e.g., a target smiling while describing an upsetting event). Such situations require the resolution of conflicts between the mental states implied by competing cues. To date, little is known about the neural systems underlying this ability.
To investigate this issue, we used functional magnetic resonance imaging (fMRI) to scan perceivers while they judged social targets' emotions based on nonverbal (silent videos of targets describing emotional events) and contextual (verbal descriptions of emotional events) cues that suggested emotions of the same or different valence. We tested two hypotheses. First, we predicted that conflicts between cues would recruit domain-general cognitive control centers in medial and lateral prefrontal cortex, a hypothesis consistent with previous work examining the processing of incongruent social cues (Decety and Chaminade, 2003; Mitchell, 2006; Wittfoth et al., 2009).
Second, we predicted that these control systems would help resolve conflict by “biasing” processing toward domain-specific neural systems involved in responding to social cues deemed to be task relevant, as reflected in perceivers' behavioral reliance on a given cue type when rating target affect. On the one hand, to the extent that perceivers behaviorally rely on nonverbal cues, biasing could increase activity in regions responsible for processing such cues, including premotor and parietal regions comprising the putative mirror neuron system (MNS) (Rizzolatti and Craighero, 2004). On the other hand, to the extent that perceivers deem contextual cues more relevant, processing could be biased toward systems implicated in drawing inferences about non-observable mental states such as beliefs, including the medial prefrontal, posterior cingulate, temporopolar, and temporoparietal regions comprising the mental state attribution system (MSAS) (Ochsner et al., 2004; Amodio and Frith, 2006; Mitchell, 2009a). Because these systems are functionally dissociable (Van Overwalle and Baetens, 2009) and may in some cases inhibit each other (Brass et al., 2009), they are strong candidate targets for the effects of social cognitive conflict resolution.
Materials and Methods
Participants
Eighteen healthy, right-handed volunteers (nine female, mean age of 24.5 years) were recruited in compliance with the human subjects regulations of Columbia University and provided informed consent. All were screened for any neurological/psychological conditions or medications that could influence the measurement of cerebral blood flow with an fMRI safety screening form. Two participants were excluded from analysis because of low response rates (>25% of trials missed), leaving 16 participants (eight female, mean age of 23.9 years).
Stimuli
Stimuli for this study were silent video clips and sentences describing moderately emotional events.
Nonverbal stimuli.
In a previous study, Zaki et al. (2008) collected a library of stimulus videos. Fourteen targets (seven female, mean age of 26.5 years) were videotaped while describing positive and negative autobiographical emotional events. After recording, the videos were played back to the targets as they used a sliding 9-point Likert scale, ranging from 1 (very negative) to 9 (very positive), to continuously rate the valence of the affective response they had felt while discussing these events.
From these recordings, 10 s video clips were selected during which targets' self-ratings were positive (mean rating >5 throughout the 10 s clip; z score > 0.25 based on all of an individual target's self-ratings) as well as negative (mean rating <5 throughout the 10 s clip; z score < −0.25 based on all of an individual target's self-ratings). Thirty-six positive clips (mean target rating of 7.55 ± 0.85) from seven targets and 36 negative clips (mean target rating of 2.46 ± 1.04) from eight targets were used as experimental stimuli, presented silently. To independently assess the emotional valence of these clips, 18 pilot subjects (10 female) rated each clip using the same Likert scale described above. These pilot ratings demonstrated that perceivers' ratings of nonverbal social cues were less affectively valenced than targets' own. Nonetheless, perceivers reliably rated clips in a valence-congruent manner based on nonverbal information alone (mean rating of positive stimuli of 6.03 ± 97; mean rating of negative stimuli of 4.05 ± 0.78).
Contextual stimuli.
Contextual stimuli were 128 sentences describing moderately affective events relevant to college students (examples: “My friends surprised me on my birthday” or “My parents don't approve of my career choice”) that could describe plausible contexts for the nonverbal videos; sentences were generated by J.Z. and K.H. These stimuli were normed in a manner similar to the nonverbal stimuli. Fourteen volunteers (six female) provided pilot valence ratings of these sentences using a 9-point Likert scale ranging from 1 (very negative) to 9 (very positive). Based on these ratings, 36 positive and 36 negative sentences were chosen as stimuli for the current study; these contextual cues alone reliably produced affect-congruent ratings from perceivers (mean rating of positive stimuli, 7.42 ± 0.44; mean rating of negative stimuli, 2.69 ± 0.51). Positive and negative sentences were controlled with respect to word length (with mean word counts of 9.81 ± 2.38 and 9.31 ± 2.91, respectively; t(70) < 1; p > 0.25).
Experimental conditions
The current task was designed to produce a type of response conflict often encountered in the social world, in which multiple social cues simultaneously suggest opposing, but equally plausible, inferences concerning the internal states of a social target. Perceivers were presented with two main trial types, both of which presented simultaneous nonverbal and contextual social cues. During congruent trials, nonverbal and contextual cues were shown that matched with respect to the valence of emotion they suggested targets were experiencing (e.g., a positive video and a positive sentence). Conversely, during incongruent trials, nonverbal and contextual cues suggested emotions of opposing valence (e.g., a positive video and a negative sentence); videos and sentences in incongruent trials always differed—with respect to their normed affect ratings—by a minimum of 2 points on the 9-point Likert scale (mean difference of 3.41 points). During both congruent and incongruent trials, perceivers were asked to make a judgment about the target's affective state. Perceivers were not instructed to pay attention to one modality or the other and thus were required to determine, on a trial-by-trial basis, which cue type seemed most relevant to the social inference task.
Unimodal trials (on which nonverbal or contextual cues were presented in isolation) also were included to localize brain regions preferentially engaged by nonverbal and contextual cues, so that activity in these regions during multimodal trials could be interrogated (for schematic of trial types, see Fig. 1A). Nonverbal and contextual cues were pseudorandomly assigned to trial types such that each participant was presented with unique pairings of cues during congruent and incongruent trials and that each nonverbal and contextual cue was presented close to an equal number of times in each condition across subjects (each cue was presented in each condition 6 ± 1 times across 18 subjects). Trials in all conditions were evenly split between positive and negative cues.
Paradigm and procedure
Before entering the scanner, participants were given instructions and completed one block of trials as described below, using cues not included in the main stimulus set. They were told that social targets in the silent video clips were discussing emotional autobiographical events. Importantly, they were told that, when nonverbal and contextual cues were paired, contextual cues were a one-sentence summary of what targets in the silent video were describing. In actuality, the contextual sentences did not describe what participants in the videos truly were discussing and instead were paired with videos in the counterbalanced manner described above. Perceivers were asked to use all the information provided (nonverbal only, contextual only, or multimodal) to assess how the target felt. Participants were also instructed to “try to make the ratings as best you can” when a description of what the target was talking about was not present (nonverbal only trials) or when targets could not be seen (context only trials). Thus, participants were instructed to decide how a social target would feel even in instances when a sentence was presented without a visible target.
After entering the scanner, perceivers completed six blocks comprising 16 trials each. A run contained four trials from each of the four conditions, split evenly across valences and valence combinations. Each trial began with a fixation cross, presented for a jittered duration ranging from 2–6 s, followed by presentation of nonverbal and/or contextual cues for 10 s, depending on the trial type. After the stimulus terminated, the question “How do you think this person felt?” appeared on the presentation screen along with a 9-point Likert scale identical to the one described above. Participants were given 4 s to respond. For schematic of trial timeline, see Figure 1A.
fMRI data acquisition
Images were acquired using a 1.5 tesla GE Twin Speed MRI scanner equipped to acquire gradient-echo, echoplanar T2*-weighted images with blood oxygenation level-dependent contrast. Each volume comprised 25 axial slices of 4.5 mm thickness and a 3.5 × 3.5 mm in-plane resolution, aligned along the anterior commissure–posterior commissure axis. Volumes were acquired continuously every 2 s. Six functional runs were acquired from each subject, and each run began with five “dummy” volumes, which were discarded from additional analyses, and 190 volumes of additional functional data. At the end of the scanning session, a T1-weighted structural image was acquired for each subject.
Behavioral analysis
Our main behavioral analysis of interest was an information usage index (IUI) for incongruent trials, which served as a measure of perceivers' relative reliance on nonverbal or contextual information. For each incongruent trial, we computed the IUI as the distance along the Likert scale between the rating a perceiver made based on a context sentence/nonverbal video clip pair to the average of the ratings given to the constituent video and context sentence in that pair during stimulus norming (Fig. 1B). For example, imagine that the normative affect rating made about a given nonverbal video seen in isolation was 7 on the Likert scale and the normative rating of a given context sentence seen in isolation was 3. If a perceiver sees a combination of that video and sentence and rates a target's affect as 4, then their rating would be 1 point away from the mean (i.e., 5) of the normed video and sentence ratings. Such a case would result in an IUI of “1c,” indicating that the perceiver's rating was 1 scale point closer to the mean normative rating of the contextual cue alone than it was to the midpoint between normative ratings made of the nonverbal and contextual cues; in other words, the perceiver in this case would have relied more on contextual, as opposed to nonverbal, cues in making their rating. The opposite case, in which ratings would be 1 point closer to normative ratings of the nonverbal cue alone, would be given a score of “1n.”
We also assessed the overall affective intensity participants ascribed to each video/sentence pair by comparing perceiver ratings to the neutral point of the scale: 5. Thus, if a given rating had a value of r, the intensity rating of canonically positive stimuli was computed as r − 5, and intensity of ratings for negative stimuli was computed as 5 − r. Note that this could result in negative intensity ratings, for example, if a positive stimulus was rated below 5.
fMRI data analysis
Images were preprocessed and analyzed using SPM2 (Wellcome Department of Imaging Neuroscience, London, UK) and using custom code in Matlab 7.1 (MathWorks). All functional volumes from each run were realigned to the first volume of that run, spatially normalized to the standard Montreal Neurological Institute (MNI)-152 template, and smoothed using a Gaussian kernel with a full-width half-maximum of 6 mm. Mean intensity of all volumes from each run were centered at a mean value of 100, trimmed to remove volumes with intensity levels >3 SDs from the run mean, and detrended by removing the line of best fit. After this processing, all three runs were concatenated into one consecutive time series for the regression analysis.
After preprocessing, analyses were performed using the general linear model and random effects models for second-level analyses. Three analytic approaches were used.
First, main effects contrasts were used to identify brain regions whose activity was greater in the nonverbal only or the context only conditions and also to examine activity that was greater for incongruent, as opposed to congruent, trials. The aim of comparing nonverbal-only and contextual-only conditions was to isolate brain regions differentially involved in processing each cue modality. Based on previous research, we believed that this comparison would reveal regions responsive to the specific perceptual characteristics and task demands associated with each cue type (e.g., extrastriate visual cortex regions associated with face perception during nonverbal cue presentation and left lateralized temporal cortex regions associated with processing semantic information during contextual cue presentation). Furthermore, we believed that nonverbal and contextual cues would preferentially engage the MNS (Iacoboni, 2009; Wolf et al., 2010) and MSAS (Saxe, 2006; Mitchell, 2009a), respectively.
Second, we used parametric analyses to identify neural activity tracking with perceivers' reliance on nonverbal or contextual cues when drawing inferences based on conflicting social cues on incongruent trials. For this analysis, normalized IUI values were used as parametric modulators providing regression weights for each incongruent trial. Using this method, we identified clusters of brain activity that tracked—within perceivers—with the relative amount perceivers had relied on nonverbal or contextual cues on a given trial. Based on our hypothesis that biased processing favoring the MNS and MSAS should also drive perceivers' reliance on that cue type in situations of response conflict, we were most interested in overlap between regions identified by this parametric analysis and those identified by main effects contrasts comparing processing of nonverbal and contextual cues. As such, we computed a conjunction between the parametric analysis and this main effect contrast, using the minimum statistic approach advocated by Nichols et al. (2005).
Third, we used functional connectivity analyses to test the hypothesis that, during incongruent trials, domain-general cognitive control centers would be involved in biasing processing toward brain regions responsible for processing domain-specific social cues. This analysis was conducted using in-house Matlab scripts analogous to the psychophysiologic interactions described by Friston et al. (1997). We first defined seed regions of interest (ROIs) associated with domain-general cognitive conflict detection and resolution, defined by the contrast of incongruent versus congruent multimodal social cues. Three such conflict-related peaks were defined: in the dorsal anterior cingulate cortex (ACC) (MNI coordinates: −4, 40, 34), the posterior dorsomedial prefrontal cortex (pDMPFC) (MNI coordinates: −12, 24, 58), and the right ventrolateral prefrontal cortex (VLPFC) (MNI coordinates: 48, 24, −8). ROIs were defined as spheres with a radius of 6 mm about these peaks, and the average time course for all voxels in each one were extracted.
We then searched for areas whose functional covariance with these seed regions corresponded with perceivers' increasing reliance on nonverbal or contextual cues. This analysis used three regressors: (1) the raw time course—averaging across all voxels—of the seed ROI, (2) behavioral reliance on the relevant type of social cue, operationalized using the IUI measure described above, and (3) the interaction between these first two factors. Contrasts were then assessed for regressor 3, whereas regressors 1 and 2 were included as covariates of no interest. Thus, this analysis specifically isolated regions whose functional covariance with seed regions increased as perceivers relied on one type of social cue or the other and not regions simply covarying with the seed region regardless of behavioral reliance or demonstrating activity related to behavioral reliance per se.
The results of this analysis were constrained in a theory-driven way using a three-way conjunction interaction, by masking these contrasts with functional maps derived from the main effects and parametric analyses described above. Thus, in total, regions identified here were required to meet three conditions: (1) they must be more engaged by one type of social cue viewed in isolation compared with the other (e.g., more engaged by nonverbal than by contextual cues), (2) they must demonstrate activity tracking with behavioral reliance on that cue type (e.g., increasing activity as perceivers behaviorally rely more on nonverbal cues, and (3) they must demonstrate connectivity with a seed region that increases as reliance on a given (e.g., nonverbal) cue type also increases.
Main effect maps (nonverbal vs contextual and incongruent vs congruent) were thresholded at p < 0.005, with a spatial extent threshold of k = 55, corresponding to a threshold of p < 0.05, corrected for multiple comparison, as assessed through Monte Carlo simulations implemented in Matlab (S. Slotnick, Boston College, Boston, MA). To compute appropriate thresholds for maps of the two-way conjunction between main effects and parametric analyses, and the three-way conjunction between main effects, parametric analysis, and connectivity analyses, we used Fisher's methods (Fisher, 1925), which combines probabilities of multiple hypothesis tests using the following formula:
where pi is the p value for the ith test being combined, k is the number of tests being combined, and the resulting statistic has a χ2 distribution with 2k degrees of freedom. Thus, thresholding each test at a p values of 0.0100 for a two-way conjunction and of 0.0235 for a three-way conjunction corresponded to a combined threshold p value of 0.001, uncorrected. We combined these values with an extent threshold of k = 35, again corresponding to a corrected threshold of p < 0.05 as assessed using simulations.
Results
Behavioral results
Consistent with domain-general studies of cognitive control, incongruent, as opposed to congruent, social cues were associated with slower responses (t(15) = 2.53; p < 0.05) (for bar plots of mean response times across conditions, see supplemental Fig. S1, available at www.jneurosci.org as supplemental material). Response times did not vary with the valence of either nonverbal or contextual cues (all p values >0.30). Because there was no “correct” answer to the affect inferences perceivers drew, error rates could not be calculated.
The IUI (described above) revealed that, during incongruent trials, contextual information predominantly influenced perceivers' ratings of target affect. That is, the ratings perceivers made about incongruent sentence/video pairs were closer to normed ratings of context sentences alone than to ratings of nonverbal videos alone (mean information usage index of 0.54c; t(15) = 5.58; p < .001) (for a distribution of IUI values, see Fig. 1C). Nonetheless, reliance on nonverbal or contextual cues on also varied greatly (mean within-subject IUI SD of 0.99 units), with all perceivers showing a wide range of reliance on nonverbal or contextual cues across trials. This allowed us to correct for each perceiver's mean IUI and search for brain activity tracking with behavioral biasing toward each type of cue relative to that mean.
Neuroimaging results
Main effect of conflict
The presence of social cognitive response conflict (i.e., the comparison of incongruent vs congruent trials) recruited activity in several regions associated with domain-general conflict monitoring and control, including the anterior cingulate cortex, right ventrolateral prefrontal cortex, right middle frontal gyrus, and posterior dorsomedial prefrontal cortex (Fig. 2) (supplemental Table S1 and, for data on the comparison of congruent > incongruent trials, supplemental Results, available at www.jneurosci.org as supplemental material).
Localization of regions specific to processing nonverbal and contextual cues
We used main effect comparisons between nonverbal-only and contextual-only conditions to identify activity related to processing each type of cue, with the expectation that areas associated the MNS and MSAS would involved in processing nonverbal and contextual cues, respectively. Consistent with this prediction and with extant research, nonverbal, compared with contextual, cues more strongly engaged much of the right MNS, including the frontal operculum, inferior parietal lobe, and intraparietal sulcus. Nonverbal cues also engaged the bilateral amygdala, superior temporal sulcus, and fusiform face area more than contextual cues (Fig. 3A) (supplemental Table S1, available at www.jneurosci.org as supplemental material). Contextual, compared with nonverbal, cues engaged regions in the MSAS, notably rostral portions of the medial prefrontal cortex, the medial parietal lobe, and bilateral temporal pole. Contextual cues also preferentially engaged a swath of left-lateralized cortex stretching from the inferior frontal gyrus (including Broca's area) through the superior temporal and angular gyri (encompassing Wernicke's area) (Fig. 3B) (supplemental Table S2, available at www.jneurosci.org as supplemental material).
Conflict resolution through biased processing in the MNS and MSAS
Our second analytic strategy tested the hypotheses (1) that, during social cognitive conflict, processing would be biased toward either regions associated with the MNS or MSAS, and (2) that this biased processing would track with reliance on nonverbal or contextual cues during affective inference. This analysis searched for brain regions whose activity tracked with the IUI described above (see Materials and Methods). That is, we searched for brain regions whose activity tracked parametrically with the extent to which perceivers' relied on nonverbal or contextual information on a trial-by-trial basis when judging target affect. Our specific hypothesis was that behavioral reliance on nonverbal and contextual cues would track with amplification, or enhancement, of activity in regions associated with the MNS and MSAS, respectively. As such, we masked the parametric analyses with main effects contrasts used to localize responses to nonverbal and contextual cues, respectively, and identified elements of the MNS and MSAS as noted above.
Results were consistent with our predictions. On one hand, as a perceiver relied more on contextual cues in making judgments about targets, they increasingly recruited areas within the MSAS (rostral medial prefrontal cortex and bilateral temporal poles), as well as the left angular gyrus. On the other hand, as perceivers relied more on nonverbal information, they increasingly recruited right-lateralized areas within the MNS (dorsal premotor cortex, inferior parietal lobule, and intraparietal sulcus) as well as the right fusiform gyrus (Fig. 3C,D) (supplemental Table S3, available at www.jneurosci.org as supplemental material).
Relation of domain-general cognitive control to domain-specific processing bias
Our third analysis explored a more specific hypothesis: that biased processing in areas responsible for processing behaviorally relevant nonverbal and contextual cues would be instantiated through functional coupling between these regions and brain areas involved in detection and control of domain general conflict. To test this idea, we selected seed ROIs related to domain-general conflict detection and resolution (ACC, pDMPFC, and right VLPFC regions in the incongruent > congruent contrast) and searched for regions whose functional connectivity with these seed regions increased as perceivers relied more on nonverbal or contextual social cues. These analyses were also masked by main effects and parametric contrasts described above, ensuring that connectivity analyses would be focused on regions of theoretical interest that had been identified in these previous analyses.
Two key results were observed. On the one hand, as participants relied more on nonverbal cues, the ACC and VLPFC (and, at a more lenient extent threshold of k = 10, the pDMPFC) became more functionally coupled with the right premotor cortex but no other regions. On the other hand, as participants relied more on contextual cues, the pDMPFC and ACC became increasingly coupled with the left angular gyrus but not other regions. At a more lenient extent threshold of k = 10, the VLPFC also demonstrated increasing connectivity with the left temporal pole (Fig. 4) (supplemental Table S4, available at www.jneurosci.org as supplemental material). These results add converging support for the hypothesis that control-related regions actually do bias processing in certain “downstream” areas responsible for processing motoric and semantic information as perceivers judgments increasingly rely on nonverbal and contextual social cues, respectively.
Discussion
Every day, perceivers integrate complex and sometimes conflicting social cues into a coherent sense of what others are experiencing. Although the neural bases of other types of conflict resolution have been extensively examined, the mechanisms underlying the resolution of social cognitive conflict have remained unclear. The present study addressed this issue by asking perceivers to draw inferences about social targets' affective states based on incongruent social cues. We capitalized on previous work demonstrating that nonverbal and contextual social cues preferentially engage elements of the MNS and MSAS (Fletcher et al., 1995; Carr et al., 2003; Ochsner et al., 2004; Iacoboni et al., 2005; Gobbini et al., 2007) to generate the hypothesis that social cognitive conflict would engage brain areas responsive to domain-general cognitive control, and this engagement would be accompanied by biased processing regions associated with the MNS and MSAS.
Findings were consistent with these hypotheses. First, perceivers encountering incongruent, as opposed to congruent, social cues engaged dorsal anterior cingulate, posterior medial prefrontal, and ventrolateral prefrontal regions broadly implicated in monitoring response conflict across cognitive and affective domains (Blair et al., 2007; Luo et al., 2007; Ochsner et al., 2009; Wittfoth et al., 2010) and in selecting goal-relevant information (Miller and Cohen, 2001; Aron et al., 2004; Wager et al., 2004; Badre et al., 2005; Ochsner and Gross, 2005). Second, during social cognitive conflict, processing of social cues was “biased” through increased engagement of areas within the MNS or MSAS that tracked, respectively, with perceivers' behavioral reliance on nonverbal or contextual cues during social cognitive inference. Other regions related to processing modality-specific information—for example, left temporal cortex and angular gyrus, which are known to be involved in processing semantic information present in contextual cues (Binder et al., 1997; Price, 2000)—also demonstrated such biasing. Third, some of the regions exhibiting biased processing (the premotor cortex for nonverbal cues and the angular gyrus and temporal pole for contextual cues) also demonstrated increasing functional coupling with domain-general control regions, an inter-regional relationship that increased in strength as perceivers behaviorally relied more on the relevant type of social cue.
The current results have implications relevant to the neural bases of cognitive control and social cognition. With respect to cognitive control, this study joins work on the resolution of affective conflict (Bishop et al., 2004; Etkin et al., 2006; Egner et al., 2008; Ochsner and Gross, 2008; Ochsner et al., 2009) in suggesting that control over specific types of information may recruit unique neural mechanisms. Affective and social information have both been labeled “special,” in that they may warrant specialized information processing mechanisms (Ostrom, 1984; LeDoux, 2000), instantiated in functionally specialized neural systems (Olsson and Ochsner, 2008; Mitchell, 2009b). It is therefore sensible that exerting control over conflict in emotional and social domains should affect processing in these specialized neural systems.
With respect to social cognition, the current experiment joins a small but growing number of neuroimaging studies capitalizing on the characterization of the MNS and MSAS by relating engagement of these systems to social behavior (de Lange et al., 2008; Schiller et al., 2009; Zaki et al., 2009; Spunt et al., 2010; Wolf et al., 2010). Data from these studies complement work identifying neural systems involved in processing isolated “pieces” of social information by demonstrating that these systems are flexibly engaged when perceivers put these pieces together in the service of complex social inferences. Such data can also help researchers bypass an often unproductive debate about whether perceivers understand targets primarily using the MSAS or MNS (Gallese et al., 2004; Saxe, 2005; Apperly, 2008). An emerging view suggests that, although the MNS and MSAS may be functionally dissociable (Van Overwalle and Baetens, 2009), interactions between these systems and domain-general cognitive control mechanisms best characterize everyday social cognition (Zaki and Ochsner, 2009).
Conclusion and future directions
Together, these data support a novel model of social cognitive conflict resolution: responding to incongruent social cues recruits domain-general cognitive control mechanisms, which direct behavior by biasing engagement of domain-specific neural systems specialized for processing specific types of social cues. As such, this study suggests new directions for the study of both typical and abnormal social cognition.
In typical contexts, future studies could further characterize the basic mechanisms underlying social cognitive conflict resolution in a number of ways. For example, future work could manipulate judgment and stimulus factors to explain why some, but not all, of the behaviorally related biasing in the MNS and MSAS was accompanied by increased connectivity with domain-general control centers. Along these lines, future studies could more closely examine the directionality and temporal characteristics of these effects. Although we have theorized that cognitive control mechanisms act on systems that represent specific types of social cues, because the connectivity analyses we used cannot establish the directionality of these effects, it is possible (although less plausible) that areas related to processing different types of social cues drive activity in domain-general control centers instead of the reverse. Studies designed to test directional connectivity could help to resolve this issue.
Studies of social cognitive conflict also could make additional contact with the broader literature on cognitive control. For example, previous studies have generated affective conflict through “Stroop-like” tasks that instruct participants to concentrate on one cue while ignoring irrelevant emotional distracters. Although the current task also presents cues whose valence conflicts, the social cognitive judgment participants perform here—like social inferences more generally—does not involve simply ignoring one cue in favor of another. Instead, participants must decide how to integrate multiple cues to assess target emotion on a scale with many response options. Conflict in this situation arises because responses are underdetermined (Botvinick et al., 2001). In other cases of underdetermined responding (e.g., word stem completion tasks), the relative strength of association between each cue and a response can increase or reduce conflict and relevant brain activity (Barch et al., 2000). Social inferences may follow this pattern: for example, in the face of an extremely intense nonverbal cue (e.g., a social target grimacing in pain), contextual cues may be discounted, and conflict may be low, whereas in the face of two relatively ambiguous cues, conflict may be high. Systematically varying the ambiguity of each cue type could allow for more formal parameterization of social cognitive conflict signals.
Finally, future research could examine how social cognitive conflict resolution adapts to perceivers' learning histories. Data increasingly suggest that medial frontal regions involved in cognitive control also integrate information about reinforcement history when selecting relevant information (Behrens et al., 2007; Rushworth et al., 2007). Control over social behavior likely involves similar mechanisms, especially because perceivers typically encounter certain targets (e.g., friends) repeatedly. When these targets display conflicting social cues, perceivers' conflict resolution may be informed by their learning history. For example, if relying on nonverbal cues tended to produce adaptive decisions about a given target's affective states, perceivers may learn over time to weigh nonverbal cues more strongly when subsequently encountering that target. Furthermore, perceivers' sense of the “diagnostic value” of behaviors in predicting targets' traits (Trope and Burnstein, 1975) could contribute to weighting of those behaviors in future social inferences. For example, if conflicting cues are seen by a perceiver as actually being consistent (e.g., someone crying after winning an award who is viewed as especially happy), perceivers may not learn to weigh one type of behavior or the other during later inferences. Future studies should use feedback and manipulate the diagnostic values of behaviors to model perceivers' integration of learning histories during social cognitive decision-making.
The current approach can also inform research on disorders of social cognition, such as autism spectrum disorders (ASDs). Individuals with ASDs demonstrate deficits in responding to both nonverbal and contextual social cues (Baron-Cohen et al., 1997, 2001; Rogers et al., 2003), as well as abnormal recruitment of both the MSAS and the MNS (Dapretto et al., 2006; Hadjikhani et al., 2006; Wang et al., 2007). Although these data have motivated theories of ASDs as a failure of either one of these systems or the other (Oberman and Ramachandran, 2007), a more integrative account would suggest that both of these systems—and their interaction when processing complex information—may underlie social symptoms in ASDs. An intriguing hypothesis emerging from the current study is that individuals with ASDs may have difficulty biasing their processing of social information based on current goals. Such deficits could be caused by functional decoupling of frontal control centers and domain-specific neural systems involved in processing social cues, a prediction consistent with abnormalities in long-distance connectivity between frontal and posterior cortical regions that characterize ASDs (Courchesne and Pierce, 2005).
Ultimately, models of social cognitive conflict resolution will have to account for both biased competition in processing social cues and the breakdown of control over conflict in populations with social cognitive abnormalities. The current data take initial steps toward these goals by demonstrating one way in which domain-general control mechanisms interact with domain-specific systems to resolve social cognitive conflict.
Footnotes
This work was supported by Autism Speaks Grant 4787 (J.Z.), National Institute on Drug Abuse Grant DA022541 (K.N.O.), and National Institutes of Health Grant MH076137 (K.N.O.). We thank Marget Thomas and Annie Knickman for assistance in data collection.
References
- Amodio DM, Frith CD. Meeting of minds: the medial frontal cortex and social cognition. Nat Rev Neurosci. 2006;7:268–277. doi: 10.1038/nrn1884. [DOI] [PubMed] [Google Scholar]
- Apperly IA. Beyond simulation-theory and theory-theory: why social cognitive neuroscience should use its own concepts to study “theory of mind.”. Cognition. 2008;107:266–283. doi: 10.1016/j.cognition.2007.07.019. [DOI] [PubMed] [Google Scholar]
- Aron AR, Robbins TW, Poldrack RA. Inhibition and the right inferior frontal cortex. Trends Cogn Sci. 2004;8:170–177. doi: 10.1016/j.tics.2004.02.010. [DOI] [PubMed] [Google Scholar]
- Badre D, Poldrack RA, Paré-Blagoev EJ, Insler RZ, Wagner AD. Dissociable controlled retrieval and generalized selection mechanisms in ventrolateral prefrontal cortex. Neuron. 2005;47:907–918. doi: 10.1016/j.neuron.2005.07.023. [DOI] [PubMed] [Google Scholar]
- Barch DM, Braver TS, Sabb FW, Noll DC. Anterior cingulate and the monitoriing of response conflict: evidence from an fMRI study of overt verb generation. J Cogn Neurosci. 2000;12:298–309. doi: 10.1162/089892900562110. [DOI] [PubMed] [Google Scholar]
- Baron-Cohen S, Jolliffe T, Mortimore C, Robertson M. Another advanced test of theory of mind: evidence from very high functioning adults with autism or asperger syndrome. J Child Psychol Psychiatry. 1997;38:813–822. doi: 10.1111/j.1469-7610.1997.tb01599.x. [DOI] [PubMed] [Google Scholar]
- Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I. The “Reading the Mind in the Eyes” Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. J Child Psychol Psychiatry. 2001;42:241–251. [PubMed] [Google Scholar]
- Behrens TE, Woolrich MW, Walton ME, Rushworth MF. Learning the value of information in an uncertain world. Nat Neurosci. 2007;10:1214–1221. doi: 10.1038/nn1954. [DOI] [PubMed] [Google Scholar]
- Binder JR, Frost JA, Hammeke TA, Cox RW, Rao SM, Prieto T. Human brain language areas identified by functional magnetic resonance imaging. J Neurosci. 1997;17:353–362. doi: 10.1523/JNEUROSCI.17-01-00353.1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bishop S, Duncan J, Brett M, Lawrence AD. Prefrontal cortical function and anxiety: controlling attention to threat-related stimuli. Nat Neurosci. 2004;7:184–188. doi: 10.1038/nn1173. [DOI] [PubMed] [Google Scholar]
- Blair KS, Smith BW, Mitchell DG, Morton J, Vythilingam M, Pessoa L, Fridberg D, Zametkin A, Sturman D, Nelson EE, Drevets WC, Pine DS, Martin A, Blair RJ. Modulation of emotion by cognition and cognition by emotion. Neuroimage. 2007;35:430–440. doi: 10.1016/j.neuroimage.2006.11.048. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD. Conflict monitoring and cognitive control. Psychol Rev. 2001;108:624–652. doi: 10.1037/0033-295x.108.3.624. [DOI] [PubMed] [Google Scholar]
- Brass M, Ruby P, Spengler S. Inhibition of imitative behaviour and social cognition. Philos Trans R Soc Lond B Biol Sci. 2009;364:2359–2367. doi: 10.1098/rstb.2009.0066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carr L, Iacoboni M, Dubeau MC, Mazziotta JC, Lenzi GL. Neural mechanisms of empathy in humans: a relay from neural systems for imitation to limbic areas. Proc Natl Acad Sci U S A. 2003;100:5497–5502. doi: 10.1073/pnas.0935845100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Corbetta M, Miezin FM, Shulman GL, Petersen SE. Selective attention modulates extrastriate visual regions in humans during visual feature discrimination and recognition. Ciba Found Symp. 1991;163:165–175. doi: 10.1002/9780470514184.ch10. discussion 175–180. [DOI] [PubMed] [Google Scholar]
- Courchesne E, Pierce K. Why the frontal cortex in autism might be talking only to itself: local over-connectivity but long-distance disconnection. Curr Opin Neurobiol. 2005;15:225–230. doi: 10.1016/j.conb.2005.03.001. [DOI] [PubMed] [Google Scholar]
- Critchley HD, Mathias CJ, Dolan RJ. Neural activity in the human brain relating to uncertainty and arousal during anticipation. Neuron. 2001;29:537–545. doi: 10.1016/s0896-6273(01)00225-2. [DOI] [PubMed] [Google Scholar]
- Dapretto M, Davies MS, Pfeifer JH, Scott AA, Sigman M, Bookheimer SY, Iacoboni M. Understanding emotions in others: mirror neuron dysfunction in children with autism spectrum disorders. Nat Neurosci. 2006;9:28–30. doi: 10.1038/nn1611. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Decety J, Chaminade T. Neural correlates of feeling sympathy. Neuropsychologia. 2003;41:127–138. doi: 10.1016/s0028-3932(02)00143-4. [DOI] [PubMed] [Google Scholar]
- de Lange FP, Spronk M, Willems RM, Toni I, Bekkering H. Complementary systems for understanding action intentions. Curr Biol. 2008;18:454–457. doi: 10.1016/j.cub.2008.02.057. [DOI] [PubMed] [Google Scholar]
- Desimone R, Duncan J. Neural mechanisms of selective visual attention. Annu Rev Neurosci. 1995;18:193–222. doi: 10.1146/annurev.ne.18.030195.001205. [DOI] [PubMed] [Google Scholar]
- Egner T, Etkin A, Gale S, Hirsch J. Dissociable neural systems resolve conflict from emotional versus nonemotional distracters. Cereb Cortex. 2008;18:1475–1484. doi: 10.1093/cercor/bhm179. [DOI] [PubMed] [Google Scholar]
- Etkin A, Egner T, Peraza DM, Kandel ER, Hirsch J. Resolving emotional conflict: a role for the rostral anterior cingulate cortex in modulating activity in the amygdala. Neuron. 2006;51:871–882. doi: 10.1016/j.neuron.2006.07.029. [DOI] [PubMed] [Google Scholar]
- Fisher RA. Statistical methods for research workers. Edinburgh: Oliver and Boyd; 1925. [Google Scholar]
- Fletcher PC, Happé F, Frith U, Baker SC, Dolan RJ, Frackowiak RS, Frith CD. Other minds in the brain: a functional imaging study of “theory of mind” in story comprehension. Cognition. 1995;57:109–128. doi: 10.1016/0010-0277(95)00692-r. [DOI] [PubMed] [Google Scholar]
- Friston KJ, Buechel C, Fink GR, Morris J, Rolls E, Dolan RJ. Psychophysiological and modulatory interactions in neuroimaging. Neuroimage. 1997;6:218–229. doi: 10.1006/nimg.1997.0291. [DOI] [PubMed] [Google Scholar]
- Gallese V, Keysers C, Rizzolatti G. A unifying view of the basis of social cognition. Trends Cogn Sci. 2004;8:396–403. doi: 10.1016/j.tics.2004.07.002. [DOI] [PubMed] [Google Scholar]
- Gobbini MI, Koralek AC, Bryan RE, Montgomery KJ, Haxby JV. Two takes on the social brain: a comparison of theory of mind tasks. J Cogn Neurosci. 2007;19:1803–1814. doi: 10.1162/jocn.2007.19.11.1803. [DOI] [PubMed] [Google Scholar]
- Hadjikhani N, Joseph RM, Snyder J, Tager-Flusberg H. Anatomical differences in the mirror neuron system and social cognition network in autism. Cereb Cortex. 2006;16:1276–1282. doi: 10.1093/cercor/bhj069. [DOI] [PubMed] [Google Scholar]
- Iacoboni M. Imitation, empathy, and mirror neurons. Annu Rev Psychol. 2009;60:653–670. doi: 10.1146/annurev.psych.60.110707.163604. [DOI] [PubMed] [Google Scholar]
- Iacoboni M, Molnar-Szakacs I, Gallese V, Buccino G, Mazziotta JC, Rizzolatti G. Grasping the intentions of others with one's own mirror neuron system. PLoS Biol. 2005;3:e79. doi: 10.1371/journal.pbio.0030079. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Konishi S, Nakajima K, Uchida I, Kameyama M, Nakahara K, Sekihara K, Miyashita Y. Transient activation of inferior prefrontal cortex during cognitive set shifting. Nat Neurosci. 1998;1:80–84. doi: 10.1038/283. [DOI] [PubMed] [Google Scholar]
- LeDoux JE. Emotion circuits in the brain. Annu Rev Neurosci. 2000;23:155–184. doi: 10.1146/annurev.neuro.23.1.155. [DOI] [PubMed] [Google Scholar]
- Luo Q, Mitchell D, Jones M, Mondillo K, Vythilingam M, Blair RJ. Common regions of dorsal anterior cingulate and prefrontal-parietal cortices provide attentional control of distracters varying in emotionality and visibility. Neuroimage. 2007;38:631–639. doi: 10.1016/j.neuroimage.2007.07.051. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller EK, Cohen JD. An integrative theory of prefrontal cortex function. Annu Rev Neurosci. 2001;24:167–202. doi: 10.1146/annurev.neuro.24.1.167. [DOI] [PubMed] [Google Scholar]
- Mitchell JP. Inferences about mental states. Philos Trans R Soc Lond B Biol Sci. 2009a;364:1309–1316. doi: 10.1098/rstb.2008.0318. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mitchell JP. Social psychology as a natural kind. Trends Cogn Sci. 2009b;13:246–251. doi: 10.1016/j.tics.2009.03.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mitchell RL. How does the brain mediate interpretation of incongruent auditory emotions? The neural response to prosody in the presence of conflicting lexico-semantic cues. Eur J Neurosci. 2006;24:3611–3618. doi: 10.1111/j.1460-9568.2006.05231.x. [DOI] [PubMed] [Google Scholar]
- Nichols T, Brett M, Andersson J, Wager T, Poline JB. Valid conjunction inference with the minimum statistic. Neuroimage. 2005;25:653–660. doi: 10.1016/j.neuroimage.2004.12.005. [DOI] [PubMed] [Google Scholar]
- Oberman LM, Ramachandran VS. The simulating social mind: the role of the mirror neuron system and simulation in the social and communicative deficits of autism spectrum disorders. Psychol Bull. 2007;133:310–327. doi: 10.1037/0033-2909.133.2.310. [DOI] [PubMed] [Google Scholar]
- Ochsner KN, Gross JJ. The cognitive control of emotion. Trends Cogn Sci. 2005;9:242–249. doi: 10.1016/j.tics.2005.03.010. [DOI] [PubMed] [Google Scholar]
- Ochsner KN, Gross J. Cognitive emotion regulation: Insights from social cognitive and affective neuroscience. Curr Direct Psychol Sci. 2008;17:153–158. doi: 10.1111/j.1467-8721.2008.00566.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ochsner KN, Knierim K, Ludlow DH, Hanelin J, Ramachandran T, Glover G, Mackey SC. Reflecting upon feelings: an fMRI study of neural systems supporting the attribution of emotion to self and other. J Cogn Neurosci. 2004;16:1746–1772. doi: 10.1162/0898929042947829. [DOI] [PubMed] [Google Scholar]
- Ochsner KN, Hughes B, Robertson ER, Cooper JC, Gabrieli JD. Neural systems supporting the control of affective and cognitive conflicts. J Cogn Neurosci. 2009;21:1842–1855. doi: 10.1162/jocn.2009.21129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Olsson A, Ochsner KN. The role of social cognition in emotion. Trends Cogn Sci. 2008;12:65–71. doi: 10.1016/j.tics.2007.11.010. [DOI] [PubMed] [Google Scholar]
- Ostrom T. Handbook of social cognition. Princeton: Erlbaum; 1984. The sovereignty of social cognition. [Google Scholar]
- Price CJ. The anatomy of language: contributions from functional neuroimaging. J Anat. 2000;197:335–359. doi: 10.1046/j.1469-7580.2000.19730335.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rizzolatti G, Craighero L. The mirror-neuron system. Annu Rev Neurosci. 2004;27:169–192. doi: 10.1146/annurev.neuro.27.070203.144230. [DOI] [PubMed] [Google Scholar]
- Rogers SJ, Hepburn SL, Stackhouse T, Wehner E. Imitation performance in toddlers with autism and those with other developmental disorders. J Child Psychol Psychiatry. 2003;44:763–781. doi: 10.1111/1469-7610.00162. [DOI] [PubMed] [Google Scholar]
- Rushworth MF, Buckley MJ, Behrens TE, Walton ME, Bannerman DM. Functional organization of the medial frontal cortex. Curr Opin Neurobiol. 2007;17:220–227. doi: 10.1016/j.conb.2007.03.001. [DOI] [PubMed] [Google Scholar]
- Saxe R. Against simulation: the argument from error. Trends Cogn Sci. 2005;9:174–179. doi: 10.1016/j.tics.2005.01.012. [DOI] [PubMed] [Google Scholar]
- Saxe R. Uniquely human social cognition. Curr Opin Neurobiol. 2006;16:235–239. doi: 10.1016/j.conb.2006.03.001. [DOI] [PubMed] [Google Scholar]
- Schiller D, Freeman JB, Mitchell JP, Uleman JS, Phelps EA. A neural mechanism of first impressions. Nat Neurosci. 2009;12:508–514. doi: 10.1038/nn.2278. [DOI] [PubMed] [Google Scholar]
- Spunt RP, Satpute AB, Lieberman MD. Identifying the what, why, and how of an observed action: an fMRI study of mentalizing and mechanizing during action observation. J Cogn Neurosci. 2010 doi: 10.1162/jocn.2010.21446. [DOI] [PubMed] [Google Scholar]
- Thompson-Schill SL, D'Esposito M, Aguirre GK, Farah MJ. Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. Proc Natl Acad Sci U S A. 1997;94:14792–14797. doi: 10.1073/pnas.94.26.14792. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tomasello M. The cultural origin of human cognition. Cambridge, MA: Harvard UP; 2000. [Google Scholar]
- Trope Y, Burnstein E. Processing the information contained in another's behavior. J Exp Soc Psych. 1975;11:439–458. [Google Scholar]
- Van Overwalle F, Baetens K. Understanding others' actions and goals by mirror and mentalizing systems: a meta-analysis. Neuroimage. 2009;48:564–584. doi: 10.1016/j.neuroimage.2009.06.009. [DOI] [PubMed] [Google Scholar]
- Wager TD, Jonides J, Reading S. Neuroimaging studies of shifting attention: a meta-analysis. Neuroimage. 2004;22:1679–1693. doi: 10.1016/j.neuroimage.2004.03.052. [DOI] [PubMed] [Google Scholar]
- Wang AT, Lee SS, Sigman M, Dapretto M. Reading affect in the face and voice: neural correlates of interpreting communicative intent in children and adolescents with autism spectrum disorders. Arch Gen Psychiatry. 2007;64:698–708. doi: 10.1001/archpsyc.64.6.698. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wittfoth M, Schröder C, Schardt DM, Dengler R, Heinze HJ, Kotz SA. On emotional conflict: interference resolution of happy and angry prosody reveals valence-specific effects. Cereb Cortex. 2010;20:383–392. doi: 10.1093/cercor/bhp106. [DOI] [PubMed] [Google Scholar]
- Wolf I, Dziobek I, Heekeren HR. Neural correlates of social cognition in naturalistic settings: a model-free analysis approach. Neuroimage. 2010;49:894–904. doi: 10.1016/j.neuroimage.2009.08.060. [DOI] [PubMed] [Google Scholar]
- Zaki J, Ochsner K. The need for a cognitive neuroscience of naturalistic social cognition. Ann NY Acad Sci. 2009;1167:16–30. doi: 10.1111/j.1749-6632.2009.04601.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zaki J, Bolger N, Ochsner K. It takes two: the interpersonal nature of empathic accuracy. Psychol Sci. 2008;19:399–404. doi: 10.1111/j.1467-9280.2008.02099.x. [DOI] [PubMed] [Google Scholar]
- Zaki J, Weber J, Bolger N, Ochsner K. The neural bases of empathic accuracy. Proc Natl Acad Sci U S A. 2009;106:11382–11387. doi: 10.1073/pnas.0902666106. [DOI] [PMC free article] [PubMed] [Google Scholar]