Abstract
The anticipation of control over aversive events in life is relevant for our mental health. Insights on the underlying neural mechanisms remain limited. We developed a new functional magnetic resonance imaging (fMRI) task that uses auditory stimuli to explore the neural correlates of (1) the anticipation of control over aversion and (2) the processing of aversion. In a sample of 25 healthy adults, we observed increased neural activation in the medial prefrontal cortex (ventromedial prefrontal cortex and rostral anterior cingulate cortex), other brain areas relevant for reward anticipation (ventral striatum, brainstem [ventral tegmental area], midcingulate cortex), and the posterior cingulate cortex when they anticipated control over aversion compared with anticipating no control (1). The processing of aversive sounds compared to neutral sounds (2) was associated with increased neural activation in the bilateral posterior insula. Our findings provide evidence for the important role of medial prefrontal regions in control anticipation and highlight the relevance of conceiving the neural mechanisms involved within a reward‐based framework.
Keywords: aversion, control anticipation, functional magnetic resonance imaging, medial prefrontal cortex
The anticipation of control over aversive events in life is relevant for our mental health. In healthy adults, control anticipation over aversive sounds is associated with increased neural activation in the medial prefrontal cortex and other brain areas relevant for reward anticipation.
1. INTRODUCTION
The anticipation of aversive events serves an adaptive purpose in human life: it is a preparatory response that allows us to forecast dangers and avoid negative or harmful experiences (Andrzejewski, Greenberg, & Carlson, 2019; Butz, Sigaud, & Gérard, 2003). The perception of control is an important dimension of anticipating aversive events affecting our cognitive, emotional, and behavioral responses (Bandura, 1983; Lazarus & Folkman, 1984). The anticipation of control over future events is generally highly relevant for our mental health, a fact reflected by multiple psychological concepts and a broad array of behavioral research (cf. Skinner & Greene, 2008). Moreover, aberrant perception of control has been identified as an important factor in the pathogenesis of affective disorders (Gallagher, Bentley, & Barlow, 2014; Liu, Kleiman, Nestor, & Cheek, 2015). Most prominently, the concept of learned helplessness, that is, the anticipation of no control over the outcome of a situation, has been a major theme in depression research (Pryce et al., 2011). It stems from the pioneering work of Maier & Seligman, 2016 demonstrating that exposing animals to an inescapable aversive stimulation leads to a failure to escape in an analogous subsequent situation. The authors thus assumed a generalized loss of control in these animals. In 2016, Maier and Seligman altered their original theoretical formulations in light of recent findings in the neurosciences (Maier & Seligman, 2016). They postulated that passivity in reaction to an aversive stimulation actually is the “default” response and what animals and humans learn is that they can exert control over an aversive stimulation. Based on findings of mostly rodent studies, they postulated that crucial brain regions for the processing of aversive stimulation and the anticipation to control aversive stimulation are the dorsal raphe nucleus and the ventromedial prefrontal cortex (vmPFC). Hereby, the vmPFC is thought to play a crucial role in both detecting control over an aversive stimulus and inhibiting activation of the dorsal raphe nucleus. Neural projections of the dorsal raphe nucleus connect to other brain structures such as the amygdala and the dorsal periaqueductal gray, which are thought to underpin typical learned helplessness behavior.
So far, only a few studies have explored the neural correlates of the anticipation of control in the context of aversive stimulation in humans. A functional magnetic resonance imaging (fMRI) study by Kerr, McLaren, Mathy, and Nitschke (2012) showed that increased vmPFC activation is associated with the controllability of exposure to phobic stimuli, thereby providing further evidence for the implication of the vmPFC in the perception of control. In contrast, a study exploring neural activation in a fear‐conditioning task found that diminished vmPFC activity related to threat predictability and controllability (Wood et al., 2015). Another study showed that the perception of pain depends on its perceived controllability and is predicted by neural activation in the ventrolateral prefrontal cortex and the rostral anterior cingulate cortex (rACC) (Salomons, Johnstone, Backonja, Shackman, & Davidson, 2007). Moreover, a study using repetitive transcranial magnetic stimulation of the left dorsolateral prefrontal cortex in an aversive stimulation paradigm yielded inconclusive results (Taylor et al., 2014). In sum, these insights on neural correlates of the anticipation of control over an aversive stimulation in humans remain limited and are partly contradictory. In view of these contradictory findings, it is important to address that Maier and Seligman's (2016) assumptions concerning vmPFC function are mainly based on evidence in rodents. Control over an aversive stimulation in rodents needs to be differentiated from the concept of cognitive control in human research. Here, evidence suggests the differential implication of prefrontal regions. For instance, Dixon, Thiruchselvam, Todd, and Christoff (2017) proposed a composite model of regulatory cognitive functions of different parts of the frontal lobe in the context of emotion processing. They emphasize that lateral parts of the prefrontal lobe take a crucial part in appraisal and regulation whereas the rostral part of the vmPFC plays a central role in the processing of self‐relevant information. The implication of more lateral or more medial parts of the prefrontal lobe in the anticipation of control in humans remains to be clarified.
The anticipation of control over an aversive stimulation can also be conceptualized within a reward‐based framework (Ly, Wang, Bhanji, & Delgado, 2019). Such a framework stresses that conceiving control anticipation as a consequence of reinforced learning (i.e., learned associations of certain behavior with certain outcomes and the generalization of these associations to novel situations) may be too restrictive. Emotional and motivational aspects, especially concerning outcome and choice, may also have an important impact on the development of control anticipation. For instance, the nature of the outcome evoked may influence our learning. Moreover, anticipating control may reflect a basic human need or desire for control (White, 1959). However, the exact mechanisms underlying the anticipation of control over aversive stimulation are still not fully understood. In specific, the role of the reward system in these mechanisms is still debated as reward involvement is not necessary for the avoidance of aversive stimulation which can also be explained by operant reinforcement through aversion (Bouton, 2007).
Not taking into account the dimension of control, there is a consistent body of research referring to the neural basis of the anticipation and the processing of aversive stimulation. A recent meta‐analysis of the neural correlates of aversive anticipation identified a core circuit including the anterior insula, the anterior cingulate cortex (ACC), the midcingulate cortex (MCC), the amygdala, thalamus, and caudate nucleus (Andrzejewski et al., 2019). Many of these regions overlap with areas identified as being crucial for the anticipation of rewards (Gu et al., 2019; X. Liu, Hairston, Schrier, & Fan, 2011; Wilson et al., 2018). Concerning the actual processing of aversive stimulation, Hayes and Northoff (2011) showed that the most consistent findings across both human and animal studies demonstrate the implication of the amygdala, the anterior insula, the ventrolateral orbitofrontal cortex, and the rACC. Both of these meta‐analyses on the anticipation and the processing of aversive stimulation (Andrzejewski et al., 2019; Hayes & Northoff, 2011) considered studies using different sensory modalities. So far, only few studies have used auditory aversive stimuli (Bolstad et al., 2013; Carlson, Greenberg, Rubin, & Mujica‐Parodi, 2011) despite of the potential that auditory stimulation hold for experimental tasks, for example, in the context of fMRI with humans.
1.1. Aims and hypotheses
The main aim of this study was to explore the neural correlates of the anticipation of control over aversive auditory stimulation. Second, we explored the neural basis of the processing of aversive auditory stimulation. We developed a new fMRI task where we manipulated participants' anticipation of control, that is, their expectation of whether they had an influence on the length of different aversive sounds. We tested this fMRI task in healthy participants and investigated neural activation (1) during the anticipation of control over aversive sounds and (2) during the processing of aversive sounds. For (1) we expected to see enhanced neural activation in the vmPFC given previous evidence (mostly from rodent studies) demonstrating its implication in control anticipation (Maier & Seligman, 2016). Moreover, we hypothesized that participants of our task would experience control anticipation as rewarding. In consequence, we assumed that additional regions of the reward system would show modulated neural activation. We expected the implication of regions of the reward system that also mediate anticipatory responses, both in the context of aversion and reward (Andrzejewski et al., 2019; Gu et al., 2019; Wilson et al., 2018): the rACC, the anterior insula, the ventral striatum, and the amygdala. Finally, concerning (2) and in line with Hayes and Northoff (2011), we hypothesized that neural activation would increase in the anterior insula, the rACC, the ventrolateral orbitofrontal cortex, and the amygdala when participants processed aversive compared to neutral sounds. These regions have been most consistently implicated in the processing of aversive stimuli.
2. METHODS
2.1. Participants
Subjects were eligible for study participation if they were between 18 and 65 years of age and presented characteristics conform with MRI safety regulations (such as no pregnancy, no metallic implants, no claustrophobia, …). Exclusion criteria were any type of current mental disorder and any history of substance abuse or of a depressive or psychotic disorder. Psychiatric symptoms were assessed in a diagnostic short interview for mental disorders (mini‐DIPS [Diagnostisches Kurz‐Interview bei psychischen Störungen], Margraf, 1994). Twenty‐eight participants were recruited via a university mailing list, a local Internet platform, and the distribution of flyers in a nearby orthopedic hospital and the university campus. Three participants had to be excluded: One participant was not able to perform the task in the MRI scanner and abandoned, for one participant the logfiles of the stimuli presentation and therefore the task's timing parameters were missing, and one participant had to be excluded post hoc due to excessive head movement (>3 mm). This resulted in a final sample of 25. Mean age was 36.11 (SD = 13.51), education averaged 14 years (SD = 3.77), 17 participants were female. The ethics committee of the canton of Zurich approved the study, and all participants gave their written informed consent.
2.2. Procedures
Before fMRI scanning, a psychologist conducted the mini‐DIPS (diagnostic short interview for mental disorders [Diagnostisches Kurz‐Interview bei psychischen Störungen], Margraf, 1994) with the participants. Participants read a written instruction of the fMRI task, performed a test trial outside the MRI scanner, and then proceeded with the fMRI task in the MRI scanner.
2.3. FMRI task
Visual and auditory stimuli were presented in an event‐related design. The task consisted of four runs with 30 trials each. The design of one trial is illustrated in Figure 1a. Each trial was composed of an anticipation phase (I), a sound phase (II), and, sometimes, a rating phase (III). During the anticipation phase (I) an arrow indicated if participants (A) had an influence over the length of the sound (control), (B) had no influence over the length of the sound (no control), or (C) should passively listen to the sound (passive listening). If (A) or (B) was indicated, participants were instructed to press a button when they saw a rectangle appear during the presentation of the sound. The participants did not have actual control over the length of the presented sound. During the sound phase (II), participants were exposed to either aversive (i) or neutral sounds (ii). During the rating phase (III), participants rated the aversiveness of the sounds on a 10‐point visual analogue scale from 0 (not aversive) to 9 (very aversive). Each trial was followed by a break during which participants viewed a black screen for 5 to 11 s (pseudorandomized duration) followed by a fixation cross for 1 to 3 s (pseudorandomized duration).
Figure 1b illustrates the arrangement of trials during each of the four runs. During the anticipation phases of each run, 12 arrows indicated (A), 12 arrows (B), and 6 arrows (C). The presentation time of the arrows was pseudorandomized to 4 to 8 s. The arrow was followed by a fixation cross. During the sound phases of each run, 30 sounds were presented out of a repertoire of 14 different sounds. Fifteen sounds were of an aversive quality (e.g., metal scratching, screaming in a high pitch, etc.) (i), and 15 sounds were neutral (e.g., a child laughing, bubbling water, etc.) (ii). The duration of the sound was pseudorandomized to 2.4 to 10 s. During the sound, a fixation cross was shown. Additionally, a rectangle was presented for 0.6 s during the sound indicating that participants should press a button. During the rating phases in each run, each combination of (A), (B), (C), and (i) or (ii) was rated once. The visual analog scale, on which the rating was performed, was presented for 4 s
The duration of a run varied between 10 min 54 s and 12 min 10s. The overall duration of the task including all four runs, a sound test, and the acquisition of a structural T1 scan was ~51 min 31 s. Participants performed 2 to 4 runs (14 performed 4 runs, 10 performed 3 runs, 1 performed 2 runs). The variation in the number of performed runs resulted from the individual (e.g., fatigue) and organizational (e.g., limited scanning resources) constraints. In the case of one participant, 2 runs out of 4, and in the case of five participants, 1 run out of 3 or 4 had to be excluded due to head motion >3 mm. In consequence, we included data of 10 participants with 4 runs, 10 with 3 runs, and 5 with 2 runs in our data analyses. We controlled for these different numbers of runs in our statistical model.
2.4. FMRI data acquisition
Data acquisition was performed on a Philips Intera 3 T whole‐body MR unit equipped with a 32‐channel Philips SENSE head coil. Functional time series were acquired with a T2*‐weighted, sensitivity‐encoded single‐shot echo‐planar sequence (SENSE‐sshEPI) (Pruessmann, Weiger, Scheidegger, & Boesiger, 1999). The following acquisition parameters were used in the fMRI protocol: echo time = 35 ms, field of view (FOV) = 220 mm x 220 mm x 128 mm, acquisition matrix = 80 x 80, voxel size: 2.75 mm x 2.75 mm x 4 mm, SENSE acceleration factor R = 2.0. Using a mid‐sagittal scout image, 32 contiguous axial slices were placed along the anterior–posterior commissure plane covering the entire brain with a TR of 2000 ms for task‐based fMRI (θ = 80°) and 3,000 ms for rsfMRI (θ = 82°). Slices were collected in ascending order. The first five acquisitions were discarded to eliminate the influence of T1 saturation effects. An anatomical T1‐weighted structural image was also acquired (FOV = 220 x 220 x 135 mm; acquisition matrix = 224 x 187, interpolated to 224 x 224; reconstructed voxel size = 0.98 x 0.98 x 1.5mm3, 180 slices).
2.5. Task‐based fMRI analyses
Task‐based fMRI data were analyzed using Matlab version 2015a (The MathWorks, Inc. 2015) and SPM 12 (Statistical Parametric Mapping, Welcome Department of Cognitive Neurology, 2014). Functional images were corrected for time differences in slice acquisition and head motion using the slice time and realign functions of SPM12. We performed segmentation and spatial normalization to Montreal Neurological Institute (MNI) space. Images were smoothed using a Gaussian kernel of 8 mm full width at half maximum (FWHM). None of the participants had to be excluded due to signal dropout. One participant had to be excluded post hoc due to excessive head movement (>3 mm, cf. section Participants), and, in the case of six participants, we had to exclude single runs of the fMRI task post hoc due to excessive head movement (>3 mm, cf. section FMRI task). At the single‐subject level, we computed a general linear model to obtain parameter estimates of event‐related activity at each voxel, for each condition, and each subject, and statistical parametric maps of the t statistic resulting from linear contrasts between different conditions. We modeled the conditions anticipation of control, the anticipation of no control, aversive sound, and neutral sound. Six movement parameters extracted from realignment were entered as regressors. We convolved all explanatory variables with the canonical hemodynamic response function. Our contrasts of interest were (a) anticipation of control > anticipation of no control, and (b) aversive sound > neutral sound. Beta‐weight estimates of contrasts were scaled depending on the number of runs performed by the participants. The individual contrast estimates of all participants were entered into a random‐effects model. Within‐group activation was assessed using one‐sample t tests. Whole‐brain cluster inference was completed using false discovery rate (FDR) corrected for multiple comparisons with a threshold of p = 0.05. The cluster‐forming height threshold was set to p = .001 uncorrected.
3. RESULTS
For the main contrast (a) anticipation of control > anticipation of no control, we found increased neural activation in a large prefrontal cluster comprising the vmPFC and rACC and several reward relevant regions such as the left ventral striatum (cluster extending into the putamen), brainstem—a region consistent with the ventral tegmental area (VTA)—, and MCC (cluster extending into the primary somatosensory cortex) (cf. Table 1 and Figure 2). We also observed increased neural activation in a large cluster comprising the posterior cingulate cortex (PCC) and precuneus, and in smaller clusters in the right posterior insula, left fusiform gyrus, and right inferior occipital gyrus.
TABLE 1.
Brain region | Hemi‐sphere | BA | Coordinates | Cluster size | Cluster p(FDR‐corr) | ||
---|---|---|---|---|---|---|---|
x | y | z | |||||
vmPFC/rACC | R/L | 32, 10 | 4 | 48 | 0 | 2,158 | <.001 |
PCC/precuneus | R/L | 31 | 20 | −60 | 18 | 7,422 | <.001 |
Ventral striatum/putamen | L | 34 | −30 | 6 | −8 | 1763 | <.001 |
Brainstem (VTA) | R/L | −2 | −30 | −22 | 1997 | <.001 | |
MCC/ primary somatosensory cortex | L | 3 | −24 | −28 | 56 | 241 | <.05 |
Posterior insula | R | 13 | 44 | −28 | 20 | 161 | <.05 |
Fusiform gyrus | L | 37 | −34 | −48 | −18 | 237 | <.05 |
Inferior occipital gyrus | R | 19 | 42 | −80 | −2 | 203 | <.05 |
Abbreviations: BA, Brodman Area; FDR, false discovery rate; L, left; MCC, midcingulate cortex; PCC, posterior cingulate cortex; R, right; rACC, rostral anterior cingulate cortex; vmPFC, ventromedial prefrontal cortex; VTA, ventral tegmental area.
In the contrast (b) aversive sound > neutral sound, we observed increased neural activation in the bilateral posterior insula (cf. Table 2 and Figure 3). These relatively large clusters of neural activation extended into the superior part of the temporal lobe including the auditory cortex (Brodman Areas 41, 22).
TABLE 2.
Brain region | Hemis‐phere | BA | Coordinates | Cluster size | Cluster p(FDR‐corr) | ||
---|---|---|---|---|---|---|---|
x | y | z | |||||
Posterior insula/ superior temporal gyrus | R | 13, 41, 22 | 34 | −28 | 10 | 638 | <.001 |
Posterior insula/ superior temporal gyrus | L | 13, 41, 22 | −40 | −12 | −4 | 843 | <.001 |
Abbreviations: BA, Brodman area; FDR, false discovery rate; L, left; R, right.
4. DISCUSSION
The aim of this study was to explore neural correlates of (1) the anticipation of control over aversive auditory stimulation and (2) the processing of aversive auditory stimulation in a newly developed fMRI task with healthy participants. We found that (1) anticipating control in contrast to no control over aversion was accompanied by a higher neural activation in a large medial prefrontal cluster comprising the vmPFC and rACC, several other regions of the reward system such as the left ventral striatum and the brainstem (in a region consistent with the VTA), and the PCC. We observed (2) increased neural activation in the bilateral posterior insula during the processing of aversive compared to neutral auditory stimulation. Our findings suggest the implication of medial prefrontal areas and additional brain regions important for the processing of rewards and self‐relevant stimuli in control anticipation in humans.
4.1. Neural correlates of the anticipation of control over aversive auditory stimulation
Our findings mostly align with our initial hypotheses expecting increased neural activation in regions implicated in the anticipation of control over aversion and rewards such as the vmPFC, rACC, and ventral striatum. However, we did not find the expected modulations of neural activation in the amygdala and anterior insula.
These results provide evidence for the implication of the medial prefrontal cortex in the anticipation of control over aversion in humans: In our fMRI task, anticipating control was associated with increased neural activation in a large medial prefrontal cluster including the vmPFC and rACC. Based on findings mostly in rodents, Maier and Seligman (2016) postulated that the vmPFC takes a crucial role in the expectation to control aversive stimulation. Evidence from neuroimaging studies in humans had remained inconclusive so far (Kerr et al., 2012; Wood et al., 2015). Shenhav, Cohen, and Botvinick (2016) highlight the implication of the rACC in both cognitive control and reward processing. They proposed that the rACC is crucial for allocating control resources dependent on the expected benefit for the organism, a process likely mobilized by control anticipation in our task.
Additionally, we observed increased neural activation in the ventral striatum and the brainstem (in a region consistent with the VTA) during control anticipation. Together with the vmPFC and rACC, the ventral striatum and the VTA have been consistently associated with reward processing and its anticipation (Gu et al., 2019; Smith & Delgado, 2015; Wilson et al., 2018). These regions are part of the mesocorticolimbic dopamine pathways, which originate in the VTA and project into the ventral striatum and prefrontal cortex (Arias‐Carrión, Stamelou, Murillo‐Rodríguez, Menéndez‐González, & Pöppel, 2010). In line with Ly et al. (2019), we argue that this implication of reward‐processing regions may be linked to the affective and motivational aspects of control anticipation. In fact, anticipating control over aversive stimulation may have an inherent appetitive value for the study participants in our fMRI task. Several other studies have demonstrated that exercising control is inherently rewarding (for a review, see Leotti, Iyengar, & Ochsner, 2010). The implication of striatal regions in these processes is well‐established. For instance, Tricomi, Delgado, and Fiez (2004) showed that having a choice in a reward or punishment entailing oddball paradigm was associated with increased striatal activation. Similarly, Coricelli et al. (2005) observed higher neural activation in the ventral striatum during a gambling task only when participants had a choice. Different parts of the striatum seem to be functionally related to different characteristics of choices (representations of the value of freedom and opportunity to choose) (Fujiwara et al., 2013). Leotti and Delgado (2011) used a monetary reward task where cues indicated choice, potential choice, or no choice. Similar to our findings, the authors showed that expecting a choice was associated with increased neural activation in the ventral striatum and the dorsal ACC. In a subsequent study, Leotti and Delgado (2014) explored if neural circuits involved in choice opportunity depended on the valence of potential outcomes. They demonstrated that choice entailed greater ventral striatal activation when processing losses but not when gains were involved in the experimental procedure. This indicates that the affective and motivational aspects of control anticipation are context dependent. In sum, our findings of increased neural activation in the vmPFC, rACC, ventral striatum, and VTA fit well into the existing literature that emphasizes the implication of reward‐processing regions in control anticipation. However, it should be noted that our results do not necessarily have to reflect reward processing but might also be (partially) described by Pavlovian transfer in the aversive domain. For instance, Geurts, Huys, den Ouden, and Cools (2013) found aversive Pavlovian transfer to be reflected in neural activation within the amygdala and the ventral striatum. Consequently, our findings within the ventral striatum could also be explained by aversive Pavlovian transfer.
We also observed increased MCC activation during control anticipation in a large cluster that extended into the primary somatosensory cortex. The MCC has also been associated with the anticipation of rewards and aversion (Andrzejewski et al., 2019; Wilson et al., 2018). Andrzejewski et al. (2019) pointed out that the MCC may be implicated in the initiation or modulation of the autonomic response to a threat. Vogt (2016), however, described a broader array of behavioral and cognitive processes mediated by the MCC. He clarified the differential functional and structural properties of the anterior and posterior parts of the MCC. The anterior MCC has high dopaminergic afferents and is implicated in action‐reinforcement association and approach or avoidance decision‐making. We assume that our task mobilized these types of processes more strongly when participants anticipated control compared to no control. However, this interpretation is only one among many possible ones as the MCC is likely implicated in many cognitive and behavioral processes (Vogt, 2016).
Furthermore, control anticipation was associated with increased neural activation in a large cluster comprising the PCC and precuneus. Together with the medial prefrontal cortex, these are the core nodes of the default mode network (DMN). The DMN is typically deactivated during tasks and underpins mind wandering and thoughts related to one's self (Raichle, 2015). It has also been demonstrated that these medial core regions of the DMN underpin self‐relevant decision‐making (Andrews‐Hanna, Reidler, Sepulcre, Poulin, & Buckner, 2010). Anticipating control in contrast to anticipating no control may mobilize an experience of agency that is underpinned by similar neural pathways as previously observed for self‐relevant decision‐making. In this line of thought, it is noteworthy that recent meta‐analyses demonstrated that neuroimaging studies of reward and self‐referential processes found neural activation in both differential and common brain regions (Frewen et al., 2020). Common brain regions were especially identified in the medial prefrontal cortex including the vmPFC and rACC where we observed increased neural activation during control anticipation.
Overall, these findings suggest that control anticipation is mediated by medial prefrontal regions that have been implicated in control anticipation in rodents and the allocation of control resources in humans as well as reward processing. Control anticipation was further associated with increased neural activation in additional regions important for reward anticipation such as the ventral striatum and brainstem (VTA). Finally, control anticipation led to increased neural activation in medial brain regions of the DMN that typically activate during the processing of self‐relevant stimuli. It is important to address that most of these brain regions underpin complex cognitive and affective functions. Additional and divergent functional interpretations of their activation during control anticipation are thus possible.
4.2. Neural correlates of the processing of aversive auditory stimulation
We observed enhanced neural activation in the bilateral posterior insula during the processing of aversive compared to neutral sounds. These results did not match our initial hypotheses concerning the neural activation during the processing of aversive compared to neutral sounds. We had expected increased neural activation in the bilateral anterior insula, the rACC, bilateral ventrolateral orbitofrontal cortex, and bilateral amygdala, yet observed no modulation of neural activation in these brain regions. Concerning insular activation, we had expected an increase in its anterior and not posterior part as this has been a relatively consistent finding in the context of experiencing pain. Interestingly, some studies also suggest that the posterior part of the insula may specifically play a role in pain processing. For instance, Lamm, Decety, and Singer (2011) suggested a posterior‐to‐anterior gradient within the insula with posterior parts of the insula being only activated by pain directly perceived by oneself while the anterior insula covering both self‐perceived pain and pain inflicted in others. Consequently, our findings in the posterior insula may reflect pain processing. Nonetheless, it is important to note the absence of activation in other brain areas, which does not match the commonly observed results of previous studies on pain (Hayes & Northoff, 2012; Lamm et al., 2011). We speculate that this inconsistency may link to the intensity of the aversive experience induced by the auditory stimuli employed in our task. Possibly, these auditory stimuli were experienced as less aversive compared with aversive stimulation used in previous studies such as for example, inflicting tactile pain. However, this speculation is contradicted by observations of two meta‐analyses on the anticipation and processing of aversion (Andrzejewski et al., 2019; Hayes & Northoff, 2011), which had found no difference in neural activation depending on the modality of stimuli used.
The clusters of neural activation in the posterior insula were large and extended into parts of the superior temporal lobe including the auditory cortex. This finding aligns with previous observations demonstrating that negatively valanced auditory stimuli are associated with increased neural activation in the auditory cortex (Kumar, von Kriegstein, Friston, & Griffiths, 2012; Viinikainen, Kätsyri, & Sams, 2012). Kumar et al. (2012) proposed that the auditory cortex first processes salient auditory stimuli before an emotional response can be coordinated in other brain areas. It is also interesting to note that an fMRI study on the neural underpinnings of mourning found neural activation in bilateral superior temporal clusters similarly located to the ones we observed here (Labek et al., 2017). Labek et al. (2017) argued that these temporal regions are part of a posterior network important for the appraisal of pain and especially its sensory experience, which is consistent with our findings.
4.3. Limitations
Our study is not without limitations. First, our fMRI task does not allow to differentiate between control anticipation over aversion or rewards. Its focus was to explore neural correlates of the anticipation of control over aversive auditory stimuli only. Our fMRI task could have been complemented by a condition where the anticipation of control related to rewarding stimuli. This would have enabled us to differentiate between control anticipation over aversive and rewarding stimuli. Second, a substantial limitation of the analyses reported here is that we did not account for the subjective experience of control anticipation and aversion. We did not consider any subjective ratings of these aspects. Third, participants did not have actual control over the lengths of the sounds that were presented. We do not know if this caused feelings of frustration or confounded the difference of the control versus no control condition during the course of the experiment. Fourth, our sample size limits the power of our analyses. Therefore, our results need to be interpreted with caution and necessitate replication in a larger sample. Fifth, our sample is imbalanced in terms of gender (17 females, 8 males). We did not explore the effects of gender due to our limited sample size.
4.4. Future directions
Anticipating control over future events is highly relevant for our mental health and the anticipation of aversion is important to avoid harmful experiences. Aberrant control anticipation and altered aversion processing is an important component of pathological pathways in several mental disorders such as depression, anxiety disorders, schizophrenia, and addiction (Gallagher et al., 2014; Hayes & Northoff, 2011; Liu et al., 2015). It will thus be interesting to explore the neural correlates of such altered processes in psychopathology. Our fMRI task can be a useful instrument for such an endeavor.
CONFLICT OF INTERESTS
The authors declare no conflicts of interest.
ACKNOWLEDGMENTS
The authors would like to thank all study participants for their time invested in this study and Eleonora Fadel, Lina Dietiker, Niklas Bürgi, and Robin Thoma for their help conducting fMRI scans. Laura Wade‐Bohleber gratefully acknowledges funding by the Stiftung zur Förderung von Psychiatrie und Psychotherapie, Zurich, Switzerland, to work on this project
Wade‐Bohleber, L. M., Haugg, A., Huber, S., Ernst, J., Grimm, S., Recher, D., Richter, A., Seifritz, E., Boeker, H., & Northoff, G. (2021). Anticipating control over aversive stimuli is mediated by the medial prefrontal cortex: An fMRI study with healthy adults. Human Brain Mapping, 42(13), 4327–4335. 10.1002/hbm.25549
Boeker Heinz and Northoff Georg share senior authorship.
Funding information Stiftung zur Förderung von Psychiatrie und Psychotherapie, Zurich, Switzerland., Grant/Award Number: NaN
DATA AVAILABILITY STATEMENT
The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.
REFERENCES
- Andrews‐Hanna, J. R., Reidler, J. S., Sepulcre, J., Poulin, R., & Buckner, R. L. (2010). Functional‐anatomic fractionation of the Brain's default network. Neuron, 65(4), 550–562. 10.1016/j.neuron.2010.02.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Andrzejewski, J. A., Greenberg, T., & Carlson, J. M. (2019). Neural correlates of aversive anticipation: An activation likelihood estimate meta‐analysis across multiple sensory modalities. Cognitive, Affective, & Behavioral Neuroscience, 19(6), 1379–1390. 10.3758/s13415-019-00747-7 [DOI] [PubMed] [Google Scholar]
- Arias‐Carrión, O., Stamelou, M., Murillo‐Rodríguez, E., Menéndez‐González, M., & Pöppel, E. (2010). Dopaminergic reward system: A short integrative review. International Archives of Medicine, 3(1), 24. 10.1186/1755-7682-3-24 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bandura, A. (1983). Self‐efficacy determinants of anticipated fears and calamities. Journal of Personality and Social Psychology, 45(2), 464–469. 10.1037/0022-3514.45.2.464 [DOI] [Google Scholar]
- Bolstad, I., Andreassen, O. A., Reckless, G. E., Sigvartsen, N. P., Server, A., & Jensen, J. (2013). Aversive event anticipation affects connectivity between the ventral striatum and the orbitofrontal cortex in an fMRI avoidance task. PLoS One, 8(6), e68494. 10.1371/journal.pone.0068494 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouton, M. E. (2007). Learning and behavior: A contemporary synthesis (p. xiii, 482). Sunderland, MA: Sinauer Associates. [Google Scholar]
- Butz, M. V., Sigaud, O., & Gérard, P. (2003). Anticipatory behavior: Exploiting knowledge about the future to improve current behavior. In Butz M. V., Sigaud O., & Gérard P. (Eds.), Anticipatory behavior in adaptive learning systems: Foundations, theories, and systems (pp. 1–10). Heidelberg, Germany: Springer. 10.1007/978-3-540-45002-3_1 [DOI] [Google Scholar]
- Carlson, J. M., Greenberg, T., Rubin, D., & Mujica‐Parodi, L. R. (2011). Feeling anxious: Anticipatory amygdalo‐insular response predicts the feeling of anxious anticipation. Social Cognitive and Affective Neuroscience, 6(1), 74–81. 10.1093/scan/nsq017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Coricelli, G., Critchley, H. D., Joffily, M., O'Doherty, J. P., Sirigu, A., & Dolan, R. J. (2005). Regret and its avoidance: A neuroimaging study of choice behavior. Nature Neuroscience, 8(9), 1255–1262. 10.1038/nn1514 [DOI] [PubMed] [Google Scholar]
- Dixon, M. L., Thiruchselvam, R., Todd, R., & Christoff, K. (2017). Emotion and the prefrontal cortex: An integrative review. Psychological Bulletin, 143(10), 1033–1081. 10.1037/bul0000096 [DOI] [PubMed] [Google Scholar]
- Frewen, P., Schroeter, M. L., Riva, G., Cipresso, P., Fairfield, B., Padulo, C., … Northoff, G. (2020). Neuroimaging the consciousness of self: Review, and conceptual‐methodological framework. Neuroscience & Biobehavioral Reviews, 112, 164–212. 10.1016/j.neubiorev.2020.01.023 [DOI] [PubMed] [Google Scholar]
- Fujiwara, J., Usui, N., Park, S. Q., Williams, T., Iijima, T., Taira, M., … Tobler, P. N. (2013). Value of freedom to choose encoded by the human brain. Journal of Neurophysiology, 110(8), 1915–1929. 10.1152/jn.01057.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gallagher, M. W., Bentley, K. H., & Barlow, D. H. (2014). Perceived control and vulnerability to anxiety disorders: A meta‐analytic review. Cognitive Therapy and Research, 38(6), 571–584. 10.1007/s10608-014-9624-x [DOI] [Google Scholar]
- Geurts, D. E. M., Huys, Q. J. M., den Ouden, H. E. M., & Cools, R. (2013). Aversive Pavlovian control of instrumental behavior in humans. Journal of Cognitive Neuroscience, 25(9), 1428–1441. 10.1162/jocn_a_00425 [DOI] [PubMed] [Google Scholar]
- Gu, R., Huang, W., Camilleri, J., Xu, P., Wei, P., Eickhoff, S. B., & Feng, C. (2019). Love is analogous to money in human brain: Coordinate‐based and functional connectivity meta‐analyses of social and monetary reward anticipation. Neuroscience & Biobehavioral Reviews, 100, 108–128. 10.1016/j.neubiorev.2019.02.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hayes, D. J., & Northoff, G. (2011). Identifying a network of brain regions involved in aversion‐related processing: A cross‐species translational investigation. Frontiers in Integrative Neuroscience, 5, 49. 10.3389/fnint.2011.00049 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hayes, D. J., & Northoff, G. (2012). Common brain activations for painful and non‐painful aversive stimuli. BMC Neuroscience, 13(1), 60. 10.1186/1471-2202-13-60 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kerr, D. L., McLaren, D. G., Mathy, R. M., & Nitschke, J. B. (2012). Controllability modulates the anticipatory response in the human ventromedial prefrontal cortex. Frontiers in Psychology, 3, 557. 10.3389/fpsyg.2012.00557 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kumar, S., von Kriegstein, K., Friston, K., & Griffiths, T. D. (2012). Features versus feelings: Dissociable representations of the acoustic features and valence of aversive sounds. Journal of Neuroscience, 32(41), 14184–14192. 10.1523/JNEUROSCI.1759-12.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Labek, K., Berger, S., Buchheim, A., Bosch, J., Spohrs, J., Dommes, L., … Viviani, R. (2017). The iconography of mourning and its neural correlates: A functional neuroimaging study. Social Cognitive and Affective Neuroscience, 12(8), 1303–1313. 10.1093/scan/nsx058 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lamm, C., Decety, J., & Singer, T. (2011). Meta‐analytic evidence for common and distinct neural networks associated with directly experienced pain and empathy for pain. NeuroImage, 54(3), 2492–2502. 10.1016/j.neuroimage.2010.10.014 [DOI] [PubMed] [Google Scholar]
- Lazarus, R. S., & Folkman, S. (1984). Stress, appraisal, and coping. New York, NY: Springer. [Google Scholar]
- Leotti, L. A., & Delgado, M. R. (2011). The inherent reward of choice. Psychological Science, 22(10), 1310–1318. 10.1177/0956797611417005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Leotti, L. A., & Delgado, M. R. (2014). The value of exercising control over monetary gains and losses. Psychological Science, 25(2), 596–604. 10.1177/0956797613514589 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Leotti, L. A., Iyengar, S. S., & Ochsner, K. N. (2010). Born to choose: The origins and value of the need for control. Trends in Cognitive Sciences, 14(10), 457–463. 10.1016/j.tics.2010.08.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liu, R. T., Kleiman, E. M., Nestor, B. A., & Cheek, S. M. (2015). The hopelessness theory of depression: A quarter‐century in review. Clinical Psychology: Science and Practice, 22(4), 345–365. 10.1111/cpsp.12125 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liu, X., Hairston, J., Schrier, M., & Fan, J. (2011). Common and distinct networks underlying reward valence and processing stages: A meta‐analysis of functional neuroimaging studies. Neuroscience & Biobehavioral Reviews, 35(5), 1219–1236. 10.1016/j.neubiorev.2010.12.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ly, V., Wang, K. S., Bhanji, J., & Delgado, M. R. (2019). A reward‐based framework of perceived control. Frontiers in Neuroscience, 13, 65. 10.3389/fnins.2019.00065 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maier, S. F., & Seligman, M. E. P. (2016). Learned helplessness at fifty: Insights from neuroscience. Psychological Review, 123(4), 349–367. 10.1037/rev0000033 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Margraf, J. (1994). Mini‐DIPS. Diagnostisches Kurz‐Interview bei psychischen Störungen. Heidelberg, Germany: Springer‐Verlag. [Google Scholar]
- Pruessmann, K. P., Weiger, M., Scheidegger, M. B., Boesiger, P. (1999). SENSE: sensitivity encoding for fast MRI. Magnetic Resonance in Medicine, 42(5), 952–962. [PubMed] [Google Scholar]
- Pryce, C. R., Azzinnari, D., Spinelli, S., Seifritz, E., Tegethoff, M., & Meinlschmidt, G. (2011). Helplessness: A systematic translational review of theory and evidence for its relevance to understanding and treating depression. Pharmacology & Therapeutics, 132(3), 242–267. 10.1016/j.pharmthera.2011.06.006 [DOI] [PubMed] [Google Scholar]
- Raichle, M. E. (2015). The Brain's default mode network. Annual Review of Neuroscience, 38(1), 433–447. 10.1146/annurev-neuro-071013-014030 [DOI] [PubMed] [Google Scholar]
- Salomons, T. V., Johnstone, T., Backonja, M.‐M., Shackman, A. J., & Davidson, R. J. (2007). Individual differences in the effects of perceived controllability on pain perception: Critical role of the prefrontal cortex. Journal of Cognitive Neuroscience, 19(6), 993–1003. 10.1162/jocn.2007.19.6.993 [DOI] [PubMed] [Google Scholar]
- Shenhav, A., Cohen, J. D., & Botvinick, M. M. (2016). Dorsal anterior cingulate cortex and the value of control. Nature Neuroscience, 19(10), 1286–1291. 10.1038/nn.4384 [DOI] [PubMed] [Google Scholar]
- Skinner, E., & Greene, T. (2008). Perceived control: Engagement, coping, and development. In Good T. L. (Ed.), 21st century education: A reference handbook (pp. 121–130). Newbury Park, CA: Sage Publications. [Google Scholar]
- Smith, D. V., & Delgado, M. (2015). Reward processing. In Toga A. W. (Ed.), Brain mapping: An Encyclopedic reference (Vol. 3, 1st ed., pp. 361–366). Waltham, MA: Academic Press. 10.1016/B978-0-12-397025-1.00255-4 [DOI] [Google Scholar]
- Taylor, J. J., Neitzke, D. J., Khouri, G., Borckardt, J. J., Acierno, R., Tuerk, P. W., … George, M. S. (2014). A pilot study to investigate the induction and manipulation of learned helplessness in healthy adults. Psychiatry Research, 219(3), 631–637. 10.1016/j.psychres.2014.05.045 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tricomi, E. M., Delgado, M. R., & Fiez, J. A. (2004). Modulation of caudate activity by action contingency. Neuron, 41(2), 281–292. 10.1016/S0896-6273(03)00848-1 [DOI] [PubMed] [Google Scholar]
- Viinikainen, M., Kätsyri, J., & Sams, M. (2012). Representation of perceived sound valence in the human brain. Human Brain Mapping, 33(10), 2295–2305. 10.1002/hbm.21362 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vogt, B. A. (2016). Midcingulate cortex: Structure, connections, homologies, functions and diseases. Journal of Chemical Neuroanatomy, 74, 28–46. 10.1016/j.jchemneu.2016.01.010 [DOI] [PubMed] [Google Scholar]
- White, R. W. (1959). Motivation reconsidered: The concept of competence. Psychological Review, 66(5), 297–333. 10.1037/h0040934 [DOI] [PubMed] [Google Scholar]
- Wilson, R. P., Colizzi, M., Bossong, M. G., Allen, P., Kempton, M., Abe, N., … MTAC . (2018). The neural substrate of reward anticipation in health: A meta‐analysis of fMRI findings in the monetary incentive delay task. Neuropsychology Review, 28(4), 496–506. 10.1007/s11065-018-9385-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wood, K. H., Wheelock, M. D., Shumen, J. R., Bowen, K. H., Ver Hoef, L. W., & Knight, D. C. (2015). Controllability modulates the neural response to predictable but not unpredictable threat in humans. NeuroImage, 119, 371–381. 10.1016/j.neuroimage.2015.06.086 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.