Abstract
What makes us laugh? One crucial component of many jokes is the disambiguation of words with multiple meanings. In this functional MRI study of normal participants, the neural mechanisms that underlie our experience of ‘getting’ a joke that depends on the resolution of semantically ambiguous words were explored. Jokes that contained ambiguous words were compared to sentences that contained ambiguous words but were not funny, as well as to matched verbal jokes that did not depend on semantic ambiguity. The results confirm that both the left inferior temporal gyrus and left inferior frontal gyrus are involved in processing the semantic aspects of language comprehension, while a more widespread network that includes both of these regions and the temporoparietal junction bilaterally, is involved in processing humorous verbal jokes when compared to matched non-humorous material. In addition, hearing jokes was associated with increased activity in a network of subcortical regions, including the amygdala, the ventral striatum and the midbrain, that have all been implicated in experiencing positive reward. Moreover, activity in these regions correlated with the subjective ratings of funniness of the presented material. These results allow a more precise account of how the neural and cognitive processes that are involved in ambiguity resolution contribute to the appreciation of jokes that depend on semantic ambiguity.
Keywords: Humour, semantic ambiguity, fMRI, reward, inferior frontal gyrus, ventral striatum
Introduction
What makes us laugh? This is an age old question, but how humour is instantiated in the brain has only recently lent itself to neuroscientific investigation (Goel and Dolan, 2001). Recent functional neuroimaging studies have demonstrated that verbal jokes (Goel and Dolan, 2001), humorous TV shows (Moran et al., 2004) and visual ‘gags’ (Gallagher et al., 2000; Marjoram et al., 2006, Wild et al., 2006; Samson et al., 2009), all increase activity in the left inferior frontal gyrus (IFG) and the posterior temporal lobe.
One crucial component of many jokes is the disambiguation of words with multiple meanings (Attardo, 2001; Goel and Dolan, 2001). For example, in the joke “Why don’t cannibals eat clowns? Because they taste funny!”, the punchline depends on two alternative meanings of the word ‘funny’ (amusing and odd/bad). Both meanings are appropriate in this joke. Thus, “Why don’t cannibals eat rotten eggs? Because they taste funny!”, is not humorous, because a single meaning of ‘funny’ prevails. Both the IFG and left inferior temporal gyrus (LITG) have been activated in response to (non-humorous) semantically ambiguous sentences (Rodd et al., 2005; Zempleni et al., 2007); Do these regions play a similar role in our ability to ‘get’ a joke?
However, many jokes do not use words with multiple meanings, “Why did Cleopatra bathe in milk? Because she couldn’t find a cow tall enough for a shower!” has a similar structure as the joke about the cannibals, but does not depend on semantic ambiguity. This distinction between jokes that do and don’t rely on ambiguity may map on to the incongruity resolution model of humour (Hempelman and Ruch, 2005) with ambiguous jokes having ‘unresolvable’ incongruity (both meanings of ‘funny’ remain possible in the clown joke) and unambiguous jokes being more resolved (Cleopatra’s shower). A critical test of this account concerns the impact of ambiguous words in stimuli that are not funny. Many common words in English have multiple meanings (Rodd et al., 2002), yet sentences containing ambiguous word are rarely funny (e.g. “what was the problem with the other coat? It was difficult to put on with the paint-roller”). Using these materials we can assess whether common neural mechanisms are involved in ambiguity resolution in sentences and puns that depend on unresolvable ambiguity. By testing for interactions between humour and ambiguity resolution, we can assess mechanisms associated with ambiguity/incongruity resolution in puns.
In this study, we used fMRI to investigate the relationship between semantic ambiguity and humour using four types of tightly-matched sentences that crossed two factors; the presence/absence of humour (jokes vs. non-jokes), and the presence/absence of ambiguous words. We predicted that jokes would activate a network of brain regions involving the IFG and the LITG, but only if they involved semantically ambiguous words. In addition, by comparing these items to semantically unambiguous jokes and non-jokes containing semantic ambiguity we sought to reveal those aspects of ‘getting a joke’ that are not dependent of semantic ambiguity and the extent to which conventional ambiguity resolution dissociates from humour processing.
Methods
Materials
There were five experimental conditions: (i) ambiguous sentences in which critical content words had multiple meanings (AS), (ii) matched unambiguous sentences (US), (iii) ambiguous jokes (AJ), (iv) low-ambiguity jokes (UJ) and (v) signal correlated noise. Materials in the AS and US conditions were versions of those used by Rodd et al., 2010a Experiment 2, that were modified to follow the same set-up and punch line structure as the jokes, to have similar syntactic structures and to be closely matched for the number of words and syllables. To generate disambiguations in the AS condition that were as ‘surprising’ as those in the AJ condition, the sentences used contained an ambiguous word that was (typically) at the offset of the set-up line and was disambiguated with a low frequency meaning at the end of the punch line (e.g. ‘What happened to the post? As usual, it was given to the best-qualified applicant’, post is more commonly a “wooden pole” or “mail delivery” rather than a “job”). Existing work has shown that such disambiguations are both unexpected (as quantified by sentence completion pre-tests), and give rise to elevated frontal-temporal activation (Rodd et al., 2005; Zempleni et al., 2007), yet are not funny.
One important difference between the AS and AJ conditions was that, in the AJ condition, the ambiguous word typically occurred at the end of the punch line and involved a paradoxical disambiguation in which both meanings were relevant (e.g. “why were the teacher’s eyes crossed? Because she could not control her pupils.”). Ambiguous words in the AS and AJ conditions were either homonyms (for which both meanings have identical spelling, e.g. pupils), or homophones (for which the two meanings have the same pronunciation, but different spellings, e.g. mussel/muscle). The stimuli in all four conditions were recorded by a native English speaker using a lively prosody, rhythm and intonation suitable for telling jokes. The duration of the individual sentences and jokes were matched across conditions and varied between 3.1 s to 7.5 s.
A set of 23 jokes and sentences sampled approximately equally from the four conditions were converted into speech-spectrum signal-correlated noise (SCN; Schroeder, 1968) using Praat software (http://www.praat.org). These stimuli have the same spectral profile and amplitude envelope as the original speech, but because all spectral detail is replaced with noise, they are entirely unintelligible. Although the amplitude envelope of speech (which is preserved in signal correlated noise) can, in theory, provide cues to some forms of rhythmic and phonological information (Rosen, 1992), such cues are insufficient for the listener to recognize lexical items and extract any information about sentence meaning (Davis and Johnsrude, 2003).
Participants
Eighteen right-handed volunteers (9 females), aged 18-35 were scanned; data from three participants were discarded due to excessive head movement and in a further three participants’ data were discarded due to scanner faults during data acquisition the remaining twelve participants were included in the analysis. All participants were native speakers of English without any history of neurological illness, head injury or hearing impairment. The study was approved by the Addenbrooke’s Hospital Local Research Ethics Committee (Cambridge) and written informed consent was obtained from all participants.
Procedure
Volunteers were instructed to listen attentively to all of the stimuli and were advised that some of the sentences might be humorous but given no other task to do. An Interleaved Silent Steady State (ISSS) imaging technique was used (Schwarzbauer et al., 2006). This sequence provides an optimal combination of high temporal-resolution echo-planar imaging (EPI) data following a silent interscan interval such that there is minimal interference from concurrent scanner noise during stimulus presentation. The sequence also avoids T1-related signal decay during the acquisition of the EPI volumes by maintaining the steady-state longitudinal magnetisation with a train of silent slice-selective excitation pulses during the (silent) period when auditory stimuli are presented. Volunteers heard a single sentence (or noise equivalent) in the 9 s silent period before a 12 s period of scanning. Stimulus presentation was timed so that the final word of the joke or sentence finished immediately prior to the onset of the sequence of scans. There were 23 trials of each stimulus type, including signal correlated noise, and an additional 23 silent trials for the purpose of monitoring data quality (138 trials total). The experiment was divided into three sessions of 46 trials with a single silent trial added at the start of each scanning run to allow for the T1 signal to reach asymptote before stimulus presentation commenced. The order of stimulus items was pseudo-randomized to ensure that the experimental conditions and rest scans were approximately evenly distributed among the three scanning sessions, and that each condition occurred equally often after each of the other conditions. Session order was counterbalanced across participants. Stimuli were presented to both ears over high-quality headphones (Resonance Technology, Commander XG system) using DMDX software running on a Windows PC (Forster & Forster, 2003). To further attenuate scanner noise, participants wore insert earplugs.
Functional neuroimaging data was acquired using a Bruker Medspec (Ettlingen, Germany) 3T MR system with a head gradient set. Echo-planar image volumes were collected for each volunteer with a TR of 1.5 seconds, 8 TRs following each of the 46 trials in each of the three 16 minute scanning sessions. The silent interval between trials lasted 9 seconds (i.e. 6 TRs). The following imaging parameters were used: slice thickness, 4 mm; inter-slice gap, 1 mm; number of slices, 27; slice orientation, axial oblique; field of view, 24 × 24 cm, matrix size, 64 × 64, in-plane spatial resolution 3.75 × 3.75 mm × 4 mm. The gradient ramp and plateau times for the ISSS sequence were TRamp = 3.0 ms and TP = 1.0 ms (see Schwarzbauer et al., 2006 for details). Acquisition was transverse-oblique, angled away from the eyes, and covered the whole brain.
The fMRI data were pre-processed and analysed using Statistical Parametric Mapping software (SPM2, Wellcome Trust Centre for Neuroimaging, London, UK). Pre-processing steps included within-subject realignment, spatial normalization of the functional images to a standard EPI template and spatial smoothing using a Gaussian kernel of 12 mm, suitable for random-effects analysis (Xiong et al., 2000). First level statistical analysis was performed using a general linear model constructed and estimated for each participant. We used an FIR basis set, such that each of the eight scans that followed the stimuli in each of the 5 experimental conditions were separately averaged. Scans following silent inter-scan intervals were included in the model as an unmodelled, implicit baseline. Movement parameters from the realignment stage of the preprocessing and dummy variables coding the three separate scanning sessions were included as covariates of no interest. No high-pass filtering or correction for serial auto-correlation was used in estimating the least-mean-squares fit of single-subject models. Although this prevents accurate assessment of the statistical significance of activation differences in single participants (as no correction is made for temporal correlations between scans) this has no impact on the validity of random effect, group analyses. The mean activity level in each condition over time can be reliably computed for each participant tested, as unmodelled temporal auto-correlation has no impact on estimates of the mean effect, only on estimates of the degree of scan-to-scan variation (for further discussion see, Schwarzbauer et al., 2006). Our analysis procedure focuses on the significance of activation estimates across the group of participants tested using inter-subject variation as a random effect. Following estimation, contrasts between conditions were computed using weights derived from the predicted magnitude of the BOLD response over the 8 time points in the FIR model using the SPM canonical HRF. In a subsequent analysis, participant-specific parametric modulators were added to each of the joke and non-jokes conditions in order to investigate the relationship between neural responses and the rated funniness of each of the (joke and non-joke) sentences.
Images containing weighted parameter estimates from each participant were entered into second-level group analyses in which inter-subject variation was treated as a random effect (Friston et al., 1999). Given the hypotheses derived from previous work in this area a region-of-interest (ROI) statistical analysis was carried out (Poldrack et al., 2008). Using the MarsBar SPM toolbox (Brett et al., 2002) ten ROIs were defined. Three of these were defined based on the results of the comparison between sentences containing ambiguous words and sentences with no ambiguous words reported previously by Rodd et al., 2005. Specifically, a left posterior inferior frontal region (−45, 19, 25; 6584mm3), right inferior frontal region (36, 25, 3; 800mm3), and a left inferior temporal region (−51, −49, −9; 6696 mm3). Two further cortical ROIs were defined, based on the results of an earlier study of verbal jokes by Goel and Dolan, (2001) and included the anterior IFG (pars triangularis) (−52, 36, 6; 4144mm3) and the ventromedial prefrontal cortex (0, 45, −12; 3984mm3). In several previous studies of humour, ratings of ‘funniness’ have been shown to correlate with activity in subcortical structures (amygdalae, ventral striatum and midbrain) suggesting that these regions code for the reward that is often subjectively associated with ‘getting the joke’ (Mobbs et al., 2003; Mobbs et al., 2005; Azim et al., 2005). Therefore in this study, the amygdalae were identified from the MNI ROI atlas (left/right −23/23, −2, −19; 1760mm3) , small spherical ROIs were created for the left/right ventral striatum (−16/16, 7, −7; 896mm3) and midbrain (0, −20, −11; 896mm3). The ROI threshold was set at p<0.05, corrected for multiple comparisons. All ROIs selected are displayed in figure 2.
After the scanning session each participant was interviewed and asked to rate the funniness of every joke and non-joke sentence that had been presented during the scanning session on a 1 to 7 scale (1= not funny at all, 7 = very funny).
Results
Behavioural results
The participants rated the joke stimuli significantly funnier than the non-joke sentences. Thus, a two-way repeated measures ANOVA revealed a main effect of sentence type (jokes versus non-jokes), F[1,11]=97.75, p<0.0001. The main effect of ambiguity was not significant (F[1,11]=0.51, p=0.49) and there was no significant interaction between ambiguity and sentence type (F[1,11]=3.02, p=0.11). Funniness ratings did not predict head movements during the scanning session, R2=0.12, ns.
fMRI results
Region of interest
On the basis of previous work in this area, an ROI analysis was carried out to characterize the different contributions of each sentence type in terms of semantic ambiguity and funniness. Ten ROIs were included, as described above. When all stimuli containing ambiguous words (both jokes and non-jokes) were compared with matched jokes/non-jokes without ambiguous words, significant activity was observed in the left ITG (t=2.76; p=0.009) and in the left anterior IFG (t=2.03; p=0.033) (Figure 1). The former results replicate the findings of Rodd et al., (2005) who reported significant ambiguity-related activity in the same region of the ITG. The latter result demonstrates that there is a significant ambiguity-related change in the region identified by Goel and Dolan (2001) as being involved in hearing verbal jokes. This region was anterior to the inferior frontal region previously reported by Rodd et al., (2005).
The jokes versus non-jokes contrast revealed a much stronger and more widely spread activity with significant differences between conditions in all ROIs but higher activity in the amygdalae (left t=2.95; p=0.006; right t=2.77; p=0.009) and midbrain (t=3.03; p=0.006). The interaction between the joke/non-joke and ambiguity factors revealed significant activity only in the left anterior IFG ROI (t=2.44; p=0.016) (Figure 1).
Ratings of ‘funniness’ were correlated with activity in the ten ROIs (Figure 2). There were strong associations between BOLD signal change and funniness in the midbrain (t=3.08; p=0.005), the left ventral striatum (t=2.78; p=0.008) and the left anterior (t=3.99; p=0.001) and posterior IFG (t=3.34; p=0.003).
Whole-brain analysis
A supplementary whole-brain analysis was also carried out in order to examine whether the regions explored in the ROIs were the only ones active during the main contrasts and interactions (a liberal threshold was set to p<0.001, uncorrected, 10 voxels cluster). When jokes were compared to non–joke sentences, substantial activity (outside the ROIs) was observed in the temporoparietal junction, from the angular gyrus bilaterally, spreading to the posterior superior and middle temporal gyri (Brodmann - BA) areas 39 and 21; left side 1512 voxels, right side 1682 voxels). A significant increase in activity was also observed in the left inferior frontal gyrus (BA 6/44, 273 voxels) (see Figure 3 and Table 1). Sub-cortically, the ventral tegmental area (VTA) was activated (929 voxels) (see Figure 4) and a cluster of activity was observed that included the left hypothalamus, amygdala and ventral striatum (367 voxels) (see Figure 4 and Table 1). The reverse contrast between non-joke sentences and jokes revealed no significant areas of activity.
Table 1. fMRI activations.
Jokes vs. non-jokes |
Coordinates |
||||
---|---|---|---|---|---|
BA | Region | X | Y | Z | Z-score |
39-21 | upper L MTG | −42 | −66 | 18 | 6.64 |
−52 | −60 | 22 | 6.2 | ||
|
|||||
39 | Upper RMTG | 48 | −58 | 18 | 4.98 |
22-21 | posterior R MTG | 64 | −40 | 6 | 4.93 |
62 | −28 | −6 | 4.64 | ||
|
|||||
Midbrain | −4 | −30 | −2 | 4.8 | |
0 | −22 | −2 | 4.71 | ||
6 | −30 | 0 | 4.64 | ||
|
|||||
R- amigdala/ V Str. | 10 | 0 | −20 | 4.66 | |
23 | L posterior cingulum | 0 | −54 | 24 | 4.46 |
19 | L-upper occipital | −34 | −78 | 40 | 4.07 |
38 -21 | R superior Temporal Pole | 54 | 6 | −12 | 3.85 |
46 | 8 | −24 | 3.58 | ||
|
|||||
L hippocampus/amigdala/ V Str. | −16 | 0 | −26 | 3.75 | |
−42 | −8 | −12 | 3.56 | ||
−48 | 2 | −12 | 3.56 | ||
|
|||||
38-47 | L orbitofrontal | −42 | 30 | −18 | 3.72 |
−34 | 26 | −14 | 3.27 | ||
|
|||||
20 | R fusiform | 40 | −32 | −24 | 3.61 |
44 | L frontal operculum | −52 | 12 | 14 | 3.61 |
−40 | 4 | 22 | 3.54 | ||
|
|||||
20 | L MTG | −58 | −26 | −12 | 3.61 |
48 | R IFG triangularis | 32 | 16 | 24 | 3.57 |
20-30 | L fusiform / L hippocampus | −32 | −24 | −28 | 3.52 |
−22 | −20 | −28 | 3.15 | ||
|
|||||
32-10 | L SFG / L anterior Cingulum | 0 | 52 | 16 | 3.48 |
−4 | 48 | 2 | 3.35 | ||
|
|||||
22 | L MTG | −60 | −34 | 6 | 3.41 |
Pons-midbrain junction | 0 | −26 | −24 | 3.38 | |
47-11 | R orbitofrontal | 32 | 24 | −18 | 3.28 |
24 | R anterior cingulum | 2 | 20 | 22 | 3.27 |
6 | L precentral | −50 | −2 | 46 | 3.27 |
−46 | 6 | 46 | 3.27 | ||
|
|||||
6 | L SFG | −16 | 8 | 60 | 3.18 |
Ambiguous vs unambiguous sentences
|
|||||
19 | L fusiform | −42 | −62 | −16 | 5.23 |
37 | L ITG | −44 | −48 | −20 | 4.89 |
Unambiguous vs ambiguous sentences
|
|||||
39 | L ang / R MTG | −44 | −62 | 26 | 5.92 |
21 | Upper R MTG | 50 | −52 | 14 | 5.84 |
Jokes/ambiguity Interaction
|
|||||
47-11 | L orbitofrontal / IFG triangularis | −24 | 42 | −2 | 4.87 |
−32 | 36 | 4 | 4.73 | ||
|
|||||
R hippocampus | 40 | −6 | −24 | 4.59 |
The other main contrast, between all ambiguous and non-ambiguous sentences (including both jokes and non-jokes), revealed an area of activation in the left posterior temporal lobe (BA 37/20, 168 voxels), that included portions of the left fusiform and inferior temporal gyri (see Figure 3). The location of this peak of activity was very similar to that of a peak reported previously by Goel and Dolan (2001) during verbal jokes. This change in activity was also very similar to a peak observed previously by Rodd et al., (2005), when (non-joke) sentences containing ambiguous words were compared with sentences containing no ambiguous words. The reverse contrast, between non-ambiguous and ambiguous stimuli, revealed clusters of activity in the temporoparietal junction, centred in the left angular gyrus (BA 39, 599 voxels) and spreading through the superior temporal gyrus to the upper tip of the right middle temporal gyrus (BA 21, 549 voxels) (Table 1 and figure 5). This effect seems to be driven by both jokes and non-jokes; although there is a trend towards higher activity in the unambiguous jokes as compared to the ambiguous jokes this simple effect was not reliable. In the left and right TPJ there are areas of common activity between the main contrast jokes vs non-jokes ( AJ + UJ ) > ( AS + US) and the reverse contrast unambiguous vs. ambiguous stimuli ( UJ + US ) > ( AJ + AS) (Figure 5).
When the interaction between ambiguity and jokes was examined, a significant change in activity was observed in the left IFG orbitalis and triangularis spreading to the middle frontal gyrus (BA 45/47, 658 voxels), which was specifically associated with ambiguous jokes (see Table 1). No other significant effects were observed, nor did any brain areas show an interaction consistent with additional activity for unambiguous jokes.
BOLD activity correlated with funniness in the left IFG (anterior and posterior) (BA 45, 145 voxels) and the dorsolateral prefrontal cortex, bilaterally, including the precentral gyrus, with activity spreading to the IFG and MFG on the left, and IFG pars opercularis on the right. In the parietal lobe the response in the angular gyri were also correlated with the degree of funniness (BA 40/7, left 294 voxels, right 235 voxels).
Discussion
In this study jokes that depend on semantically ambiguous words were compared to similar high-ambiguity sentences that were not funny, and to verbal jokes that did not depend on semantic ambiguity. The results confirm that both the left ITG and IFG are involved in resolving semantic ambiguities (Rodd et al., 2005; Rodd et al., 2010b), while a more widespread network (that includes both regions) is involved in processing humorous jokes when compared to matched non-humorous material. Hearing jokes was associated with increased activity in a network of subcortical regions, including the amygdalae, the ventral striatum and the midbrain, that have been implicated in experiencing positive reward. Moreover, activity in these regions correlated with the subjective ratings of funniness of the material.
That effects of both humour and ambiguity are seen in a common fronto-temporal network has important implications for neuroscientific theories of humour in general. Previous work has shown that language-dependent humour generates more IFG activity than matched visual humour (Watson et al., 2007). Here we show that these same inferior frontal regions respond more strongly to the processing of humourous material and even more for jokes that depend on semantic ambiguity. Clearly then, the role of these regions extends beyond those processes that are involved in perceiving and understanding semantically ambiguous words in sentences (see Rodd et al., 2005; Zempleni et al., 2007).
While there exists an extensive psychological literature on the cognitive processes that underpin humour, relatively little has been done to relate these processes to specific brain regions (Goel and Dolan, 2001; Moran et al., 2004; Gallagher et al., 2000; Marjoram et al., 2006; Mobbs et al., 2003; Mobbs et al., 2005; Azim et al., 2005; Wild et al., 2006; Samson et al., 2009). One framework, the incongruity-resolution model (Suls, 1972; Ruch et al., 1992), considers humour to be a problem-solving task, where incongruity between the punch line and the set-up line must be solved by a change of frame of reference, or a shift of context. Ruch and colleagues propose three aspects of humour: incongruity-resolution, nonsense and sexual humour (Hempelmann and Ruch, 2005). The last is primarily related to joke content while the other two refer to a two-stage process of understanding humour. This states that there is first a discovery of incongruity and, second a stage where it resolves, partially resolves, or creates new absurdities or incongruities. Similarly, the coherence account (Coulson, 2001), proposes a frame-shifting step that involves the comparison of information in working memory with pre-existing long-term knowledge. Within either framework, the current study allows the purely semantic aspects of jokes to be disentangled from surprise or reestablishment of coherence. We included controlled forms of semantic ambiguity in humorous (jokes) and non-humorous (non-jokes) contexts. In both cases, elevated fronto-temporal activity was observed for ambiguous relative to matched control conditions, but an additional response specific to ambiguous jokes was also seen in the left anterior IFG, confirmed by a significant interaction between ambiguity and humour.
Our study allows, therefore, a more precise account of how IFG involvement in incongruity resolution contributes to the appreciation of jokes that depend on semantic ambiguity. It is not the frame shift or resolution of incongruity that creates humour (since this is present in non-joke semantic ambiguity resolution), but rather a continuing process of ambiguity resolution that is unique to the ambiguous jokes. A critical difference is that in puns such as “Why don’t cannibals eat clowns? Because they taste funny!”, the critical word (funny) activates multiple meanings (e.g. ‘odd/bad’ and ‘amusing’). Crucially, both possible meanings are relevant and remain plausible given the overall meaning of the punchline (Alexander, 1997). In the context of the incongruity-resolution model (Hempelmann and Ruch, 2005) these stimuli are moderately incongruous since there is no resolution of the incongruity created by the semantic ambiguity, nevertheless both meanings are possible. This is unlike the process that occurs during comprehension of sentences containing ambiguous words in which one or other meaning is ultimately selected (e.g. “what was the problem with the other coat? It was difficult to put on with the paint-roller”, coat here only refers to a ‘layer of paint’ once the ambiguity has been resolved, and can no longer refer to a ‘garment’). The results of the current study reveal increased anterior IFG activity associated with paradoxical disambiguations, in which both meanings remain plausible, as in humourous puns, compared both to conventional disambiguation of ambiguous words and to jokes that do not depend on ambiguity.
The analysis of the neural bases of the incongruity-resolution model have been explicitly tested in a series of studies (Wild et al., 2006; Samson et al., 2008, 2009) showing the temporoparietal junction as a key area in the detection and processing of incongruity. Consistent with this finding, we observed left and right TPJ activated by jokes vs non-jokes. However, our results also showed that these areas were more strongly activated by unambiguous than ambiguous stimuli irrespective of humour, without any significant interaction. Thus, our study did not provide evidence for increased TPJ activity during incongruity resolution humour vs. nonsense humour (Samson et al., 2009).
The results of the main comparisons also provide evidence concerning the role of the LITG in semantic ambiguity resolution. We show that the LITG participates in both, semantic aspects of language comprehension (such as resolution of ambiguity) and processing of the bistable meanings in puns. But to successfully process the “set changes” in the joke stimuli the network recruited is broader, involving a frontoparietal network as found in other executive processes (Naccache and Dehaene, 2001; Owen and Duncan, 2002).
The cognitive processes underlying the resolution of verbal humour seem to be part of executive functions (set-shifting, reestablishment of context). These functions have been largely related to conscious processing in behavioural and functional imaging studies (Posner and Rothbart, 1998; Koch and Tsuchiya, 2007) and it has been suggested that this pattern of activation is a prerequisite for conscious processing (Dehaene and Changeaux, 2003). The psychology of mirth suggests that the understanding of a funny situation requires awareness (Attardo, 2001), and the cortical activation associated with getting the joke in this study suggests that the frontoparietal network is a neural correlate of the specific conscious process of mirth.
Some of the brain regions that were activated in the comparison between jokes and non-jokes are related to the reward associated with ‘getting’ a joke (Azim et al., 2005). Previous investigations have suggested that various sub-cortical structures (e.g. amygdala, nucleus accumbens, ventral tegmental area, hypothalamus) contribute to this aspect of humour appreciation (Mobbs et al., 2003, 2005; Moran et al., 2004, Schwartz et al., 2008), as opposed to frontal and posterior temporal regions, which are assumed to be more involved in humour processing. In our study, it was the midbrain, the left ventral striatum and left IFG that correlated most highly with subjective ratings of funniness (an estimate of the pleasure caused by the jokes), suggesting that the dopaminergic reward system is coding the funniness (and pleasure). Both the ventral striatum and the VTA reflect positive reward prediction errors (D’Ardenne et al., 2008, O’Doherty et al., 2006) and have been identified as relays in the reward system which are active in self-reported happiness and monetary rewards (Knutson et al., 2001), during the detection of attractive faces (Cloutier et al., 2008) and in addiction (Reuter et al., 2005). Other possible interpretations suggest that part of the subcortical network activated could be due to feelings of exhilaration and/or motor/autonomous reaction such as smiling and changes in heart rate (Wild et al., 2003). Since we did not monitor autonomic reactions or face muscle activity, we cannot rule out these explanations. Nevertheless, the correlation between funniness and midbrain, the left ventral striatum and left IFG, and the lack of correlation between funniness and movement parameters during scanning suggest that the reward system was involved. A combined study of brain imaging and autonomic and facial muscle monitoring may help to disentangle these different contributions.
Clearly, more work is needed to fully dissect the neural and cognitive bases of the many different aspects and sources of humour that we encounter in our daily lives. The work presented here takes a step in this direction by showing neural continuity between the mechanisms involved in selecting the appropriate single meaning of ambiguous words in non-joke sentences and the humour created by selecting both meanings of an ambiguous word in puns. The association that was observed between the presence of double meanings in puns and activity in anterior regions of the left IFG associated with semantic selection processes, illustrates one way in which humour builds on neurocognitive mechanisms for routine aspects of language comprehension. It will be for future work to find similar neural homologies in the mechanisms that underpin the other social and cognitive processes that evoke humour.
Acknowledgements
Tristan Bekinschtein was supported by an Alban European Union doctoral fellowship, a CONICET fellowship and Marie Curie IIF Grant. In addition, this research was supported by the Medical Research Council (U.1055.01.002.00007.01 and U.1055.01.002.00001.01) and by generous funding from the James S. McDonnell Foundation. We would like to thank Christian Schwarzbauer for developing the ISSS sequence, the radiographers and staff at the Wolfson Brain Imaging Centre, University of Cambridge for their help with data acquisition, Jack Rogers for analysis of the behavioural data, Matthew Brett for advice on image processing.
References
- Alexander RJ. Aspects of verbal humour in English. Narr; Tubingen, Germany: 1997. [Google Scholar]
- Attardo S. Humorous texts: A semantic and pragmatic analysis. Mouton de Gruyter; Berlin/NYC: 2001. [Google Scholar]
- Azim E, Mobbs D, Jo B, Menon V, Reiss AL. Sex differences in brain activation elicited by humor. Proc Natl Acad Sci USA. 2005;102:16496–16501. doi: 10.1073/pnas.0408456102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brett M, Anton J-L, Valabregue R, Poline J-B. Region of interest analysis using an SPM toolbox. Neuroimage; 8th International Conference on Functional Mapping of the Human Brain; Sendai, Japan. 2002; 2002. 16. [Google Scholar]
- Cloutier J, Heatherton TF, Whalen PJ, Kelley WM. Are attractive people rewarding? Sex differences in the neural substrates of facial attractiveness. J Cogn Neurosci. 2008;20:941–51. doi: 10.1162/jocn.2008.20062. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Coulson S. Semantic Leaps: Frame-shifting and Conceptual Blending in Meaning Construction. Cambridge University Press; Cambridge, UK: 2001. [Google Scholar]
- Dehaene S, Changeux JP. Ongoing spontaneous activity controls access to consciousness: a neuronal model for inattentional blindness. PLoS Biol. 2005;3:e141. doi: 10.1371/journal.pbio.0030141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duncan J, Owen AM. Common regions of the human frontal lobe recruited by diverse cognitive demands. Trends Neurosci. 2002;23:475–83. doi: 10.1016/s0166-2236(00)01633-7. [DOI] [PubMed] [Google Scholar]
- D’Ardenne K, McClure SM, Nystrom LE, Cohen JD. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science. 2008;319:1264–7. doi: 10.1126/science.1150605. [DOI] [PubMed] [Google Scholar]
- Davis MH, Johnsrude IS. Hierarchical processing in spoken language comprehension. J Neurosci. 2003;23:3423–31. doi: 10.1523/JNEUROSCI.23-08-03423.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Forster KI, Forster JC. DMDX: a windows display program with millisecond accuracy. Behav Res Methods Instrum Comput. 2003;35:116–124. doi: 10.3758/bf03195503. [DOI] [PubMed] [Google Scholar]
- Friston KJ, Holmes AP, Price CJ, Büchel C, Worsley KJ. Multisubject fMRI studies and conjunction analyses. Neuroimage. 1999;10:385–96. doi: 10.1006/nimg.1999.0484. [DOI] [PubMed] [Google Scholar]
- Gallagher HL, Happe F, Brunswick N, Fletcher PC, Frith U, Frith CD. Reading the mind in cartoons and stories: an fMRI study of ‘theory of mind’ in verbal and nonverbal tasks. Neuropsychologia. 2000;38:11–21. doi: 10.1016/s0028-3932(99)00053-6. [DOI] [PubMed] [Google Scholar]
- Goel V, Dolan RJ. The functional anatomy of humor: segregating cogni- tive and affective components. Nat Neurosci. 2001;4:237–238. doi: 10.1038/85076. [DOI] [PubMed] [Google Scholar]
- Hempelmann CF, Ruch W. 3WD meets GTVH: Breaking the ground for interdisciplinary humor research. Humour. 2005;18:313–387. [Google Scholar]
- Knutson B, Adams CM, Fong GW, Hommer D. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci. 2001;21:59–53. doi: 10.1523/JNEUROSCI.21-16-j0002.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Koch C, Tsuchiya N. Attention and consciousness: two distinct brain processes. Trends Cogn Sci. 2007;11:16–22. doi: 10.1016/j.tics.2006.10.012. [DOI] [PubMed] [Google Scholar]
- Marjoram D, Job DE, Whalley HC, Gountouna VE, McIntosh AM, Simonotto E, Cunningham-Owens D, Johnstone EC, Lawrie S. A visual joke fMRI investigation into Theory of Mind and enhanced risk of schizophrenia. Neuroimage. 2006;31:1850–8. doi: 10.1016/j.neuroimage.2006.02.011. [DOI] [PubMed] [Google Scholar]
- Mobbs D, Hagan CC, Azim E, Menon V, Reiss AL. Personality predicts activity in reward and emotional regions associated with humor. Proc Natl Acad Sci USA. 2005;102:16502–16506. doi: 10.1073/pnas.0408457102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mobbs D, Greicius MD, Abdel-Azim E, Menon V, Reiss AL. Humor modulates the mesolimbic reward centers. Neuron. 2003;40:1041–1048. doi: 10.1016/s0896-6273(03)00751-7. [DOI] [PubMed] [Google Scholar]
- Moran JM, Wig GS, Adams RB, Jr., Janata P, Kelley WM. Neural correlates of humor detection and appreciation. Neuroimage. 2004;21:1055–1060. doi: 10.1016/j.neuroimage.2003.10.017. [DOI] [PubMed] [Google Scholar]
- Naccache L, Dehaene S. Unconscious semantic priming extends to novel unseen stimuli. Cognition. 2001;80:215–29. doi: 10.1016/s0010-0277(00)00139-6. [DOI] [PubMed] [Google Scholar]
- O’Doherty JP, Buchanan TW, Seymour B, Dolan RJ. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron. 2006;49:157–66. doi: 10.1016/j.neuron.2005.11.014. [DOI] [PubMed] [Google Scholar]
- Poldrack RA, Fletcher PC, Henson RN, Worsley KJ, Brett M, Nichols TE. Guidelines for reporting an fMRI study. Neuroimage. 2008;40:409–14. doi: 10.1016/j.neuroimage.2007.11.048. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Posner MI, Rothbart MK. Attention, self-regulation and consciousness. Philos Trans R Soc Lond B Biol Sci. 1998;353:1915–27. doi: 10.1098/rstb.1998.0344. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reuter J, Raedler T, Rose M, Hand I, Gläscher J, Büchel C. Pathological gambling is linked to reduced activation of the mesolimbic reward system. Nat Neurosci. 2005;8:147–8. doi: 10.1038/nn1378. [DOI] [PubMed] [Google Scholar]
- Rodd JM, Davis MH, Johnsrude IS. The neural mechanisms of speech comprehension: fMRI studies of semantic ambiguity. Cereb Cortex. 2005;15:1261–9. doi: 10.1093/cercor/bhi009. [DOI] [PubMed] [Google Scholar]
- Rodd JM, Gaskell MG, Marslen-Wilson WD. Making sense of semantic ambiguity: semantic competition in lexical access. J Mem Lang. 2002;46:245–266. [Google Scholar]
- Rodd JM, Johnsrude IS, Davis MH. The role of domain-general frontal systems in language comprehension: evidence from dual-task interference and semantic ambiguity. Brain Lang. 2010a;115:182–8. doi: 10.1016/j.bandl.2010.07.005. [DOI] [PubMed] [Google Scholar]
- Rodd JM, Longe OA, Randall B, Tyler LK. The functional organisation of the front-temporal language system: evidence from syntactic and semantic ambiguity. Neuropsychologia. 2010b;48:1324–1335. doi: 10.1016/j.neuropsychologia.2009.12.035. [DOI] [PubMed] [Google Scholar]
- Rosen S. Temporal information in speech: acoustic, auditory and linguistic aspects. Philos Trans R Soc Lond B Biol Sci. 1992;336:367–373. doi: 10.1098/rstb.1992.0070. [DOI] [PubMed] [Google Scholar]
- Ruch W. Assessment of appreciation of humor: Studies with the 3WD humor test. In: Butcher JN, Spielberger CD, editors. Advances in personality assessment. Erlbaum; Hillsdale, NJ: 1992. pp. 27–75. [Google Scholar]
- Samson AC, Hempelmann CF, Huber O, Zysset S. Neural substrates of incongruity-resolution and nonsense humor. Neuropsychologia. 2009;47:1023–1033. doi: 10.1016/j.neuropsychologia.2008.10.028. [DOI] [PubMed] [Google Scholar]
- Samson AC, Zysset S, Huber O. Cognitive humor processing: different logical mechanisms in nonverbal cartoons--an fMRI study. Soc. neuroscience. 2008;3:125–140. doi: 10.1080/17470910701745858. [DOI] [PubMed] [Google Scholar]
- Schroeder MR. Reference signal for signal quality studies. J Acoust Soc Am. 1968;44:1735–1736. [Google Scholar]
- Schwartz S, Ponz A, Poryazova R, Werth E, Boesiger P, Khatami R, Bassetti CL. Abnormal activity in hypothalamus and amygdala during humour processing in human narcolepsy with cataplexy. Brain. 2008;131:514–522. doi: 10.1093/brain/awm292. [DOI] [PubMed] [Google Scholar]
- Schwarzbauer C, Davis MH, Rodd JM, Johnsrude I. Interleaved silent steady state (ISSS) imaging: a new sparse imaging method applied to auditory fMRI. Neuroimage. 2006;29:774–82. doi: 10.1016/j.neuroimage.2005.08.025. [DOI] [PubMed] [Google Scholar]
- Suls J. A two stage model for the appreciation of jokes and cartoons. In: Goldstein J, McGhee P, editors. Psychology of humor. Academic Press; New York, USA: 1972. [Google Scholar]
- Watson KK, Matthews BJ, Allman JM. Brain activation during sight gags and language-dependent humor. Cereb Cortex. 2007;17:314–24. doi: 10.1093/cercor/bhj149. [DOI] [PubMed] [Google Scholar]
- Wild B, Rodden FA, Rapp A, Erb M, Grodd W, Ruch W. Humor and smiling: Cortical regions selective for cognitive, affective and volitional components. Neurology. 2006;66:887–893. doi: 10.1212/01.wnl.0000203123.68747.02. [DOI] [PubMed] [Google Scholar]
- Wild B, Rhodden FA, Grodd W, Ruch W. Neural correlates of laughter and humour. Brain. 2003;126:2121–38. doi: 10.1093/brain/awg226. [DOI] [PubMed] [Google Scholar]
- Xiong J, Rao S, Jerabek P, Zamarripa F, Woldorff M, Lancaster J, Fox PT. Intersubject variability in cortical activations during a complex language task. NeuroImage. 2000;12:326–339. doi: 10.1006/nimg.2000.0621. [DOI] [PubMed] [Google Scholar]
- Zempleni M-Z, Renken R, Hoeks JCJ, Hoogduin JM, Stowe LA. Semantic ambiguity processing in sentence context: Evidence from event-related fMRI. NeuroImage. 2007;34:1270–1279. doi: 10.1016/j.neuroimage.2006.09.048. [DOI] [PubMed] [Google Scholar]