Skip to main content
Schizophrenia Research: Cognition logoLink to Schizophrenia Research: Cognition
. 2020 May 21;21:100181. doi: 10.1016/j.scog.2020.100181

Gaze direction biases emotion categorisation in schizophrenia

Nathan Caruana a,b,, Christine Inkley b, Marwa El Zein c
PMCID: PMC7248285  PMID: 32477892

Abstract

The successful integration of eye gaze direction and emotion cues from faces is important not only for co-ordinated interactions, but also for the detection of social signals alerting us to threat posed by a conspecific, or elsewhere in our immediate environment. It is now well-established that people with schizophrenia experience aberrant eye gaze and facial emotion processing. These social-cognitive differences might contribute to the maintenance of socially-themed delusions which are characterised by the hyper-attribution of threatening intentions to others. However, no study has directly examined whether the mechanisms which govern the integration of eye gaze and emotion information diverge in schizophrenia, and more importantly, whether this reflects a fundamental ‘bottom-up’ perceptual deficit or a ‘top-down’ cognitive bias. Fifteen outpatients diagnosed with schizophrenia and 21 healthy age- and IQ-matched controls performed an emotion categorisation task (anger/fear) on morphed facial expressions of anger or fear, displaying either direct or averted gaze. Results in both controls and patients replicated the previous finding that combinations of anger with direct gaze, and fear with averted gaze – which signal a relevant threat to the observer – benefited from more accurate emotion recognition than alternate gaze-emotion combinations. Bayesian model selection revealed that for patients this effect was mediated by a shift in decision bias towards emotions which signal self-relevant threat, rather than a change in sensitivity as observed in controls. These results critically highlight a different cognitive mechanism governing gaze and face-cued emotion integration in schizophrenia, which has a top-down influence on the evaluation of perceptual input.

Keywords: Face processing, Emotion, Gaze, Social perception, Computational modelling, Schizophrenia

1. Introduction

Schizophrenia is a psychiatric condition that affects multiple cognitive processes – including social and affective cognition – which can negatively impact social functioning and quality of life (Kee et al., 2003; Penn et al., 1996). It is well established that the processing of social information conveyed by facial expressions and eye gaze is divergent in schizophrenia (see Billeke and Aboitiz, 2013 for review). In particular, meta analyses estimate large overall effect sizes for face-related emotion processing deficits in schizophrenia compared to healthy controls (e.g., d = −0.91, d = −0.85, and g = 0.89 respectively; Chan et al., 2010; Kohler et al., 2010; Savla et al., 2013). However, studies of face perception have been unable to directly test whether these differences in schizophrenia – and poor social cognition more broadly – stem from a fundamental, ‘bottom-up’ aberration in the perception of social stimuli (e.g., Darke et al., 2013; Doop and Park, 2009; Fletcher and Frith, 2009; Silverstein, 2016; Uhlhaas and Mishara, 2006) or a cognitive bias which has a ‘top-down’ influence on the conscious evaluation of perceptual information. Recent work on the psychometric assessment of social cognition in schizophrenia highlights the need to make this distinction between cognitive deficits and biases clearer (Pinkham et al., 2016b; Roberts and Pinkham, 2013; Walss-Bass et al., 2013). Such a distinction is key to achieving more specific explanations of divergent social functioning in schizophrenia.

Despite the dearth of direct empirical evidence, there are several streams of indirect evidence which suggest a top-down cognitive bias in schizophrenia, rather than a fundamental perceptual deficit, drives the divergent processing of social cues in faces. First, whilst there is very substantial evidence of face processing deficits in schizophrenia (see above) this is based on a body of literature in which experimental studies have required patients to make conscious face judgements. However, recent studies using continuous flash suppression (CFS) tasks – which temporarily supress visual stimuli from conscious awareness, and do not require participants to make stimulus judgments – have shown that patients, like healthy controls, demonstrate intact visual prioritisation of faces over non-face stimuli (Caruana et al., 2019c) and faces with direct gaze over averted gaze (Seymour et al., 2016). As such, these studies suggest that a top-down cognitive bias might offer a more likely explanation for deficits observed in conscious face evaluation tasks.

A second stream of studies suggests that patients are more likely to detect intentionality and threat in the social signals conveyed by others (e.g., Blakemore et al., 2003; Haggard et al., 2003). Furthermore, impairments of emotion categorisation from faces seem to be exacerbated in schizophrenia for faces with threat-relevant emotions (e.g., anger, fear, disgust and sadness; also see Bediou et al., 2005; Brüne, 2005; Comparelli et al., 2014; Edwards et al., 2001; Kohler et al., 2003; Pinkham et al., 2003). Indeed, patients in general have an increased tendency to over-attribute meaning to irrelevant or ambiguous stimuli (Phillips et al., 2003). Together, this suggests that the potential for threat to be signalled by face stimuli may drive differences in the evaluation of these faces in schizophrenia, rather than a reduced capacity to process the configural features of faces which convey expressed emotions. In line with such an interpretation, actively-paranoid patients have been found to (1) be more likely to mis-categorise neutral faces as angry (Pinkham et al., 2011); (2) be more likely to mis-categorise neutral words as unpleasant (Holt et al., 2006); and (3) demonstrate more profound social-cognitive biases and poorer social functioning than non-paranoid patients (Pinkham et al., 2016a). Specifically, on standardised social-cognitive tasks, paranoid patients are more likely to interpret the intentions of others in ambiguous social situations as hostile, and to evaluate ambiguous faces as untrustworthy. Critically, this study revealed that differences were only seen on psychometric tasks that provided measures of social-cognitive ‘bias’ rather than ‘capacity’ (see Roberts and Pinkham, 2013; Walss-Bass et al., 2013 for a broader discussion on this distinction). Together, these findings indicate an over-attribution of threat to ambiguous stimuli in schizophrenia, particularly in those who are actively experiencing paranoid delusions. It is therefore possible that these biases result from the long-term maintenance of persecutory delusions in which others are believed to be untrustworthy with intentions to inflict harm.

Finally, evidence for cognitive biases influencing social information processing comes from studies of gaze processing in schizophrenia. Much like the face-cued emotion processing literature, gaze processing studies in schizophrenia have largely examined the conscious evaluation of eye gaze direction. For instance, gaze-cueing studies have shown that patients with schizophrenia exhibit an enhanced gaze congruency advantage (e.g., Langdon et al., 2006; Langdon et al., 2017). Under conditions of brief stimulus presentation, patients have also been more likely than healthy controls to claim that averted gaze is directed at them (Hooker and Park, 2005; Rosse et al., 1994; Tso et al., 2012). This ‘direct gaze bias’ has been shown to persist even when the eyes were edited out of the face stimulus entirely, once again suggesting a top-down cognitive bias, rather than aberrant perceptual processing (Hooker and Park, 2005). Further, studies that do not involve a self-referential judgement (e.g., “Are the eyes looking at you?”), but simply instruct participants to report whether the eyes are averted to the left or right, have failed to reliably identify a direct gaze bias in patients. Together, these findings again suggest that aberrant gaze processing in schizophrenia likely reflects an evaluative, self-referential bias rather than deficits in visual perception (Franck et al., 1998, Franck et al., 2002; Seymour et al., 2017). Yet, despite these converging streams of evidence – which support the view that a cognitive bias mechanism drives aberrations in the evaluation of emotions from faces in schizophrenia – no study has provided a paradigm which can directly test this claim.

1.1. Examining the interactions of gaze direction and emotion cues

Promise for such a paradigm comes from recent work examining the integration of gaze direction and emotion cues in faces. In healthy adults, it is now well-established that humans use gaze direction cues to facilitate the categorisation of angry and fearful expressions which can signal threat to an observer (e.g., Adams Jr and Kleck, 2003, Adams Jr and Kleck, 2005; Cristinzio et al., 2009; El Zein et al., 2015b; N'diaye et al., 2009; Sander et al., 2007). This is because gaze direction contextualises the locus of the potential threat. Specifically, angry faces with direct gaze may signal that the observed person intends to harm the observer. Alternatively, a fearful face with averted gaze may signal an external but proximal source of danger (e.g., a predator) which may pose a relevant threat to both the observer and the observed (Sander et al., 2007). Recently, the mechanism underlying the increased recognition of these self-relevant gaze and emotion combinations (hereafter referred to as “Threat+” faces) was established in a signal detection theory framework (El Zein et al., 2015b; Ioannou et al., 2017). In this framework, there are two competing models which explain the underlying mechanism driving this contextual influence of gaze direction on emotion recognition: (1) a perceptual sensitivity mechanism or (2) a decision bias mechanism.

1.1.1. Perceptual sensitivity

The perceptual sensitivity model in this framework assumes that gaze direction increases the observer's sensitivity to the perceptual features that allow them to categorise a face as angry or fearful. As such, angry faces with direct gaze would be perceived as more angry – and fearful faces with averted gaze as more fearful – than alternate gaze-emotion combinations (i.e., anger-averted, fear-direct; hereafter referred to as “Threat−” faces). This sharpening of perceptual sensitivity would correspond to a boost in the bottom-up perceptual processing of Threat+ faces, especially when faces show anger and fear emotions at very low intensities (but not for neutral faces), which in turn would enable observers to more readily and accurately categorise the emotion conveyed by the face (El Zein et al., 2015a, El Zein et al., 2015b, Ioannou et al., 2017). Using Bayesian model selection methods, previous studies have now consistently demonstrated that this perceptual sensitivity model best accounts for the increased emotion categorisation accuracy for Threat+ over Threat− faces in healthy adults and adolescents (El Zein et al., 2015a, El Zein et al., 2015b; Ioannou et al., 2017).

1.1.2. Decision bias

Alternatively, the decision bias model assumes that gaze direction cues bias the observer's decision about whether a face is angry or fearful in the direction of the combination signalling a higher threat. Maximal effects of this bias would be observed for neutral face expressions, in which direct gaze will bias observers to categorise the face as angry and neutral faces with averted gaze as fearful. This shift in decision bias – which also impacts on the categorisation of neutral faces with no perceptual emotion cues – would correspond to a top-down contextual influence of gaze cues on the recognition of emotional expression.

1.2. Current study

The current study aimed to adopt El Zein et al., 2015a, El Zein et al., 2015b emotion categorisation paradigm to investigate whether patients – like healthy adults – exhibit an increased perceptual sensitivity for Threat+ faces, or rather, whether gaze direction cues bias the evaluation of faces as expressing the emotion that would convey a self-relevant threat. In line with the latter, we anticipated that emotion categorisation performance in patients would be best characterised by a decision bias model. This means that even for neutral faces, patients would exhibit a decision bias towards anger when presented with direct gaze, and a bias towards fear for averted gaze. Contrastingly, we expected – as has been consistently demonstrated in past studies – that categorisation performance in healthy controls would be better characterised by a perceptual sensitivity model with more accurate categorisations of Threat+ combinations, even when the intensity of emotion cues are low. Together, such findings would directly evidence a top-down cognitive bias mechanism in schizophrenia which influences the appraisal of visual social cues as signals for self-directed threat.

2. Method

2.1. Ethical statement

This study was approved by the Human Research Ethics Committee at Macquarie University (MQ; reference number: 5201200021). Participants received payment for their time and provided written consent before participating.

2.2. Participants

Twenty outpatients diagnosed with Schizophrenia or Schizoaffective Disorder (10M/10F) and 21 healthy controls (14M/7F) participated in this study. To classify for inclusion in the study participants could not have had any current or past neurological disease or injury resulting in a concussion or being unconscious for more than 1 h. All participants were additionally screened for any history of substance abuse (as per DSM-V criteria) and were required to have a minimum eight years of formal education. Finally, all participants had normal or corrected-to-normal vision.

Five patients were excluded from analyses because they failed to accurately categorise emotions on at least 60% of trials, resulting in a final sample of 15 patients (6 M, 9F). This ensured adequate individual data to reliably characterise the mechanisms underlying the influence of gaze direction on emotion categorisation. Groups did not differ significantly on age (Patients M = 53.93, SD = 8.37; Control M = 48.14, SD = 13.47; t(34) = −1.47, p = 0.150, BF10 = 0.746). The National Adult Reading Test was administered as a measure of premorbid intelligence (NART; Nelson and Willison, 1991). Again, groups did not significantly differ on the NART full-scale IQ estimate (Patients M = 106.47, SD = 9.61; Control M = 106.53, SD = 9.89; t(34) = 0.02, p = 0.986, BF10 = 0.325).

Patients were recruited from the Macquarie University Belief Formation Volunteer Register. All patients were diagnosed by a clinical psychologist or psychiatrist before being recruited into the study and were on a stable dose of antipsychotic medication. Participants were also assessed against current DSM-V criteria using the Diagnostic Interview for Psychosis (Castle et al., 2006). Symptom severity was assessed using the Scales for Assessment of Positive and Negative Symptoms (SAPS & SANS; Andreasen, 1983, Andreasen, 1984). This revealed that the patients in our sample were stable with mild symptomology (see Table 1).

Table 1.

Symptom ratings for patients on the SAPS and SANS.

M SD Range
Negative symptoms (SANS)
 Affective flattening or blunting 1.90 1.17 0–4
 Alogia 0.95 1.10 0–3
 Apathy 2.75 1.12 0–4
 Anhedonia 3.00 1.26 0–5
 Attention 1.05 1.10 0–3
Positive symptoms (SAPS)a
 Hallucinations 1.60 1.50 0–4
 Delusions 1.90 1.45 0–4
 Bizarre behaviour 0.80 1.01 0–2
 Positive thought disorder 1.65 1.23 0–4

Note. Ratings on the SAPS and SANS are provided on a 5-point scale; 0 = not present; 1 = questionable; 2 = mild; 3 = moderate; 4 = marked; 5 = severe.

We used a structured interview to screen controls. This interview was based on the affective, psychotic and substance abuse screening modules from the Structural Clinical Interview for Axis 1 Disorders previously outlined under DSM-IV (SCID-1; First et al., 2002). This interview allowed us to screen for and exclude controls who had a psychiatric diagnosis of any kind, including but not limited to schizophrenia. Control participants also completed the brief version of the Schizotypal Personality Questionnaire (SPQ—B; Raine and Benishay, 1995). The range of obtained scores (M = 4.38, SD = 3.67) were consistent with previous studies involving non-clinical community samples (e.g., Compton et al., 2007).

2.3. Apparatus and stimuli

The stimulus set comprised 20 identities (10 females) adapted from the Radboud Faces Database (for a detailed description of stimulus properties and development see; El Zein et al., 2015a, El Zein et al., 2015b; Langner et al., 2010) and have been used in several previous studies examining gaze-emotion integration (Caruana et al., 2019a; El Zein et al., 2015a, El Zein et al., 2015b; Ioannou et al., 2017). Within each identity, the face stimuli varied in emotion (neutral, angry or fearful) and gaze direction (directed at the participant or averted 45° to the left or right). Each face identity set comprised seven levels of emotion morphs from neutral to angry and from neutral to fearful. This resulted in 30 face stimuli per identity: [(7 levels of morphs ∗ 2 emotions ∗ 2 gaze directions = 28) + (2 neutral stimuli with direct and averted gaze)]. With 20 identity sets, this resulted in a total stimulus set of 600 faces (see Fig. 1A for an example). The morphing was previously calibrated between angry and fearful expressions such that the emotional expressions of anger and fear conveyed the same intensity of emotion expressions (see Caruana et al., 2019a; El Zein et al., 2015a, El Zein et al., 2015b for detailed accounts on the stimulus calibration method). All faces appeared as greyscale images and were cropped to remove any visible hair.

Fig. 1.

Fig. 1

(A) Stimuli and (B) trial sequence for emotion categorisation task. Threat+ faces (in red frames) comprised anger and direct gaze or fear and averted gaze combinations. Threat− faces (in grey frames) comprised anger and averted or fear and direct gaze combinations. Three levels of morphs are shown for each emotion as examples, however, the stimuli comprised of 7 levels of morphs,

2.4. Procedure

Using the Psychophysics-3 Toolbox (Brainard, 1997; Pelli, 1997), stimuli were projected on a black screen. Each trial began with a white oval for 500 ms, followed by a white fixation point presented within the oval at participants' eye-level for 1000 ms. Following fixation, the face stimuli appeared within the oval for 250 ms, and then disappeared. The participants' task was to decide whether the faces expressed Anger or Fear by pressing one of two keyboard buttons with the left or right hand (Fig. 1B). An Anger/Fear response mapping was used (e.g., Anger: Left hand, Fear: Right hand) which was kept constant for each subject, but counterbalanced across subjects. All stimuli were presented once, resulting in a total of 600 trials. The experiment was divided into five blocks, each comprising 120 trials, that were balanced for emotion, gaze directions, gender and morph levels.

2.5. Analyses

A repeated-measures ANOVA was performed on the percentage of correct responses with gaze direction (direct, averted), emotion (anger, fear), and intensity (7 levels of morphs) as within-subjects factors, and group (patients, controls) as a between-subject factor. The same analysis was performed within each group independently. Student t-tests were conducted to directly compare performance between Threat+ and Threat− face conditions.

2.5.1. Model selection

To characterise the mechanisms underlying the enhanced categorisation of Threat+ faces, we performed model-based analyses inspired by signal detection theory (see El Zein et al., 2015a, El Zein et al., 2015b; Ioannou et al., 2017). We compared between two models which assumed two different mechanisms accounting for an increased emotion categorisation accuracy for Threat+ over Threat− faces; (1) a change in perceptual sensitivity and (2) a change in decision bias.

2.5.1.1. Model 1 – perceptual sensitivity model

In our previous studies conducted with healthy adults and adolescents, as well as adolescents with autism (El Zein et al., 2015a, El Zein et al., 2015b; Ioannou et al., 2017), a perceptual sensitivity model was found to best characterise the emotion categorisation data. In this model, gaze direction was found to selectively increase categorisation sensitivity to emotions signalling higher threat (i.e., Threat+ versus Threat− faces). This model assigns a different sensitivity to emotions in Threat+ versus Threat− conditions.

2.5.1.2. Model 2 – decision bias model

Alternatively, the decision bias model assumes that gaze direction biases emotion recognition in favour of the interpretation signalling higher threat (i.e., anger for a direct gaze, fear for an averted gaze).

For our comparison between these two models, we used a Bayesian model selection method based on the model evidence (i.e., log-likelihood). This method allows us to quantify the support of one model over the other, by estimating which model best fits the observed data. As both compared models have the same number of parameters, we did not use any method to account for the complexity of the model (i.e., number of parameters). Fixed-effects and random-effects statistics are reported. The fixed-effect comparison assumes all the participants relied on the same mechanisms to generate their decisions. The random-effects comparison is more conservative and allows each participant to rely on different mechanisms in order to generate their decisions. For the former, we report the Bayes factor as the ratio of model evidence for the compared model (Jeffreys, 1961; Kass and Raftery, 1995). For the latter, we computed support for the winning model by the exceedance probability (pexc), which is the probability that participants' behaviour was governed by the model's assumed mechanism, compared to that of the alternative model. Once we identified the winning model for each group (controls and patients), we ran statistical analyses on the maximum-likelihood parameter estimates extracted from the winning model. We report the statistical analyses from the winning model in each group, and depict on the results figure below, only the parameter estimates extracted from these winning models.

3. Results

3.1. Performance

Emotion categorisation accuracy increased with the level of displayed emotions for both groups (F(6,204) = 91.74, p < 0.001, η2 = 0.175). A main effect of emotion was also observed as anger was better categorised than fear (F(1,34) = 4.19, p = 0.048, η2 = 0.023). Importantly – and in line with our predictions and previous literature – we found evidence for a significant emotion by gaze interaction (F(1,34) = 11.61, p = 0.002, η2 = 0.008). This effect, however, did not interact with group (F(1,34) = 0.0218 p = 0.893, η2 = 0.000), and was significant in both patients (F(1,14) = 5.34, p = 0.037, η2 = 0.007) and controls (F(1,20) = 6.46, p = 0.019, η2 = 0.009) when analysed separately. This emotion by gaze interaction was characterised by more accurate categorisation of Threat+ than Threat− faces in both controls (t(20) = 2.26, p = 0.03, d = 0.494; see Fig. 2A) and patients (t(14) = 2.66, p = 0.018, d = 0.688; see Fig. 2B).

Fig. 2.

Fig. 2

Emotion categorisation performance and model selection. (A) Percentage of correct responses for Threat+ and Threat− in controls (B) Percentage of correct responses for Threat+ and Threat− in patients. (C) Sensitivity parameter estimate for Threat+ and Threat− from the winning model in controls. (D) Bias parameter for direct and averted gaze from the winning model in patients. Positive values indicate a bias towards anger response, whilst negative values indicate a bias towards fear responses. *p < 0.05 (two tailed t-test in A–B, one-tailed t-test in C–D).

3.1.1. Model selection

In order to characterise the mechanisms underlying better performance for Threat+ than Threat− faces, we compared the perceptual sensitivity model (i.e., Model 1: testing for an effect of sensitivity to emotional expression intensity) and decision bias model (i.e., Model 2: testing for a bias towards one emotion over another). Our Bayesian model selection analysis revealed that Model 1 (perceptual sensitivity) explained the control group data better than Model 2 (decision bias shift; BF10 ≈ 102.22, exceedance probability pexc > 0.86). Maximum-likelihood estimates of the perceptual sensitivity parameter extracted from the winning model were significantly larger for Threat+ than Threat− faces (one tailed t-test, t(20) = 1.93, p = 0.034, d = 0.423; Fig. 2C). This means that for controls, anger with direct gaze and fear with averted gaze benefited from an increased perceptual recognition as compared to the other gaze-emotion combinations.

Contrastingly, for the patient group, Model 2 (decision bias shift) explained the data better than Model 1 (perceptual sensitivity; BF10 ≈ 103.17, pexc > 0.84). Maximum-likelihood estimates of the bias parameter extracted from the winning model differed significantly for direct and averted gaze (one tailed t-test, t(14) = 2.54, p = 0.01, d = 0.657; Fig. 2D). This reveals that for patients, direct gaze biased emotion categorisation responses towards ‘angry’, and averted gaze biased responses towards ‘fear’. We have also included comparisons with a third model in Supplementary material 1 which includes a possible effect of both perceptual sensitivity and decision bias. These additional model comparisons rule out the possibility that the increased accuracy for Threat+ over Threat− faces is explained by both a change in the sensitivity and bias parameter. Altogether, these results provide further evidence that the effects in each group were specific to a change in sensitivity for controls, and a change in decision bias for patients.

4. Discussion

The capacity to detect threat signalled by the faces of conspecifics is important for enabling humans to avoid threats posed by either other humans, or external sources of danger in the immediate environment (Sander et al., 2007). Recent research has revealed that humans integrate gaze direction cues when categorising face-cued emotions to increase their perceptual sensitivity for faces that potentially convey a self- and threat-relevant signal (El Zein et al., 2015a, El Zein et al., 2015b). This suggests that in healthy adults, gaze direction cues have a bottom-up influence on the evaluation of emotion expressions, such that fearful faces with averted gaze and angry faces with direct gaze (i.e., Threat+ faces) are categorised more accurately than alternative gaze-emotion combinations (i.e., Threat− faces). The current study aimed to examine whether this ability is supported by a different mechanism in schizophrenia, in line with a top-down cognitive bias account of social-cognitive difficulties.

We found that, like healthy controls, patients were more accurate in categorising Threat+ than Threat− faces. Critically, however, Bayesian modelling of the emotion categorisation data revealed that the underlying mechanism driving this effect differed in patients. Previous modelling of emotion categorisation data has revealed that this phenomenon in neurotypical humans is likely driven by a ‘perceptual sensitivity’ mechanism – whereby gaze direction acts as a contextual cue which increases one's ability to sensitively (i.e., more accurately) categorise emotions (El Zein et al., 2015a, El Zein et al., 2015b). This finding has been replicated several times now, in another study involving autistic and neurotypical adolescents (Ioannou et al., 2017), and again in the control participants of the current study. However, contrastingly, data from the patient group in the current study was best explained by a ‘decision bias’ model. This suggests, that in patients the increased accuracy for categorising Threat+ faces was driven by direct gaze biasing patients towards the categorisation of angry faces, and likewise, averted gaze biasing patients towards categorising fearful faces. This bias in patients is most clearly observed when categorising neutral faces, as they were more likely to categorise a neutral face as (1) angry when gaze was directed at the participant, and (2) fearful when gaze was averted. In other words, patients were biased to assume that the face displayed the emotion that would be most threatening to themselves given the gaze cue provided. This bias manifests for neutral faces even though they offer no visual evidence for either emotion. This direct evidence for a decision bias mechanism aligns with indirect supporting evidence from the emotion and gaze processing literature in schizophrenia, which until now have largely remained separate.

Previous studies revealed that patients with schizophrenia exhibit deficits in emotion categorisation from faces – particularly for negatively-expressed emotions – even when positive symptoms are mild and effectively controlled using medication (Kohler et al., 2010). In contrast, impairments in recognising identities from faces are not reliably observed in schizophrenia, suggesting that the perceptual processing of invariant face features is intact (see Darke et al., 2013; Watson, 2013 for relevant reviews). These discrepant findings may therefore reflect variation in the higher-level cognitive demands of the tasks used to assess face perception (Bortolon et al., 2015; Kohler et al., 2010). As such emotion processing impairments may reflect a primarily top-down cognitive bias which impacts the conscious evaluation of perceptual input – rather than an aberration of basic perceptual mechanisms. Indeed, this may reflect a downstream consequence of the mentalising impairments widely reported in patients with schizophrenia – which in turn may facilitate the maintenance of positive symptoms such as persecutory delusions (Brüne, 2005; Langdon et al., 2014; Sprong et al., 2007). In line with this view, actively-paranoid patients are also more likely to mis-categorise neutral faces as angry (Pinkham et al., 2011), which reflects a top-down bias to perceive a neutral stimulus as emotionally salient and threatening. Our modelling analyses also support this last finding, as they suggest that patients tend to perceive neutral stimuli as being more threat-relevant. However, more work is needed to better characterise the directionality between cognitive biases and persecutory delusions in schizophrenia.

Studies of gaze processing have also provided evidence for self-relevance biases influencing the perception of gaze direction in schizophrenia. Specifically, substantial evidence has been put forward suggesting that patients are biased to perceive direct gaze when gaze is averted, or in some cases, where there is no physical eye stimulus at all (Hooker and Park, 2005; Rosse et al., 1994; Tso et al., 2012). This body of work also reveals that this bias is likely to reflect a top-down cognitive phenomenon, rather than an aberration of low-level visual processing. Indeed, CFS techniques have revealed that the early visual encoding of faces (Caruana et al., 2019c) and gaze direction (Seymour et al., 2016) are intact in schizophrenia. Patients with schizophrenia have also demonstrated intact processing of gaze direction in conscious viewing tasks that do not involve a self-relevant evaluation of gaze direction (also see Palmer et al., 2018a, Palmer et al., 2018b). Moreover, recent studies have evidenced increased responsivity to communicative gaze cues in patients with schizophrenia (Caruana et al., 2019b). Once again, it has been suggested in the gaze processing literature that these biases may contribute to the experience of persecutory delusions in which the actions of others are perceived as being intentional, communicative and threatening (Abu-Akel and Bailey, 2000; Frith, 2004).

5. Conclusion

Paranoid and persecutory delusions (i.e., beliefs that ‘others intend to do me harm’) are a common belief formation aberration experienced in schizophrenia which can cause significant distress for patients (see Appelbaum et al., 1999). The current findings suggest that perhaps in schizophrenia, this may either maintain, or be maintained by, an underlying bias towards the representation of self-directed threat – rather than an increased sensitivity to genuine threat signals. Arguably, the latter is more adaptive for survival as it increases our sensitivity to genuine threat signals. A bias towards the perception of threat however, can potentially be adaptive when the threat signal is truly present – but maladaptive when this bias leads to the persistent perception of threat in ambiguous or non-threatening situations. Further work is needed to explore this bias in other social information processing paradigms, whilst examining its association with persecutory delusion symptoms in order to verify whether these biases maintain paranoid beliefs, or are shaped by them.

CRediT authorship contribution statement

Nathan Caruana:Conceptualization, Formal analysis, Writing - review & editing, Writing - review & editing.Christine Inkley:Investigation, Writing - review & editing.Marwa El Zein:Conceptualization, Formal analysis, Writing - review & editing, Writing - review & editing.

Declaration of competing interest

This research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

Acknowledgements

This work was supported by the Australian Research Council (ARC) and the ARC Centre of Excellence in Cognition and its Disorders (CCD; www.ccd.edu.au) [CE110001021]. Dr. Caruana was a recipient of an ARC CCD Cross Program Support Scheme grant as well as a Macquarie University Research Fellowship which directly supported this work. Dr. El Zein is funded by the Wellcome Trust grant number 204702. We wish to thank Julie Grezes and Valentin Wyart who initially designed the experimental paradigm with Marwa El Zein.

Role of the funding source

The funding sources for this project were not involved in any decision-making, data collection, analysis or dissemination of this study. The scientific process of this study was independent of any relationship with the funding sources that could be construed as a potential conflict of interest.

Footnotes

Appendix A

Supplementary data to this article can be found online at https://doi.org/10.1016/j.scog.2020.100181.

Appendix A. Supplementary data

Additional Model Comparisons.

mmc1.docx (13KB, docx)

References

  1. Abu-Akel A., Bailey A.L. The possibility of different forms of theory of mind impairment in psychiatric and developmental disorders. Psychol. Med. 2000;30(3):735–738. doi: 10.1017/s0033291799002123. [DOI] [PubMed] [Google Scholar]
  2. Adams R.B., Jr., Kleck R.E. Perceived gaze direction and the processing of facial displays of emotion. Psychol. Sci. 2003;14(6):644–647. doi: 10.1046/j.0956-7976.2003.psci_1479.x. [DOI] [PubMed] [Google Scholar]
  3. Adams R.B., Jr., Kleck R.E. Effects of direct and averted gaze on the perception of facially communicated emotion. Emotion. 2005;5(1):3. doi: 10.1037/1528-3542.5.1.3. [DOI] [PubMed] [Google Scholar]
  4. Andreasen N.C. University of Iowa; Iowa City, IA: 1983. The Scale for the Assessment of Negative Symptoms (SANS) [Google Scholar]
  5. Andreasen N.C. University of Iowa; Iowa City, IA: 1984. Scale for the Assessment of Positive Symptoms (SAPS) [Google Scholar]
  6. Appelbaum P.S., Robbins P.C., Roth L.H. Dimensional approach to delusions: comparison across types and diagnoses. Am. J. Psychiatr. 1999;156(12):1938–1943. doi: 10.1176/ajp.156.12.1938. [DOI] [PubMed] [Google Scholar]
  7. Bediou B., Franck N., Saoud M., Baudouin J.-Y., Tiberghien G., Daléry J., d'Amato T. Effects of emotion and identity on facial affect processing in schizophrenia. Psychiatry Res. 2005;133(2):149–157. doi: 10.1016/j.psychres.2004.08.008. [DOI] [PubMed] [Google Scholar]
  8. Billeke P., Aboitiz F. Social cognition in schizophrenia: from social stimuli processing to social engagement. Front. Psychiatry. 2013;4:1–11. doi: 10.3389/fpsyt.2013.00004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Blakemore S.J., Sarfati Y., Bazin N., Decety J. The detection of intentional contingencies in simple animations in patients with delusions of persecution. Psychol. Med. 2003;33(8):1433–1441. doi: 10.1017/s0033291703008341. [DOI] [PubMed] [Google Scholar]
  10. Bortolon C., Capdevielle D., Raffard S. Facial affect recognition and information processing in schizophrenia and bipolar disorder. Neurosci. Biobehav. Rev. 2015;53:79. doi: 10.1016/j.neubiorev.2015.03.006. [DOI] [PubMed] [Google Scholar]
  11. Brainard D.H. The psychophysics toolbox. Spat. Vis. 1997;10(4):433–436. https://www.ncbi.nlm.nih.gov/pubmed/9176952 Retrieved from. [PubMed] [Google Scholar]
  12. Brüne M. “Theory of mind” in schizophrenia: a review of the literature. Schizophr. Bull. 2005;31(1):21–42. doi: 10.1093/schbul/sbi002. [DOI] [PubMed] [Google Scholar]
  13. Caruana N., Inkley C., Zein M.E., Seymour K. No influence of eye gaze on emotional face processing in the absence of conscious awareness. Sci. Rep. 2019;9 doi: 10.1038/s41598-019-52728-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Caruana N., Seymour K., Brock J., Langdon R. Responding to joint attention bids in schizophrenia: an interactive eye-tracking study. Q. J. Exp. Psychol. 2019;72(8):2068–2083. doi: 10.1177/1747021819829718. [DOI] [PubMed] [Google Scholar]
  15. Caruana N., Stein T., Watson T., Williams N., Seymour K. Intact prioritisation of unconscious face processing in schizophrenia. Cogn. Neuropsychiatry. 2019;24(2):135–151. doi: 10.1080/13546805.2019.1590189. [DOI] [PubMed] [Google Scholar]
  16. Castle D.J., Jablensky A.J., McGrath J.J., Carr V.C., Morg V., Waterreu A., Farmers A. The diagnostic interview for psychoses (DIP): development, reliability and applications. Psychol. Med. 2006;36:69–80. doi: 10.1017/S0033291705005969. [DOI] [PubMed] [Google Scholar]
  17. Chan R.C., Li H., Cheung E.F., Gong Q.Y. Impaired facial emotion perception in schizophrenia: a meta-analysis. Psychiatry Res. 2010;178(2):381–390. doi: 10.1016/j.psychres.2009.03.035. [DOI] [PubMed] [Google Scholar]
  18. Comparelli A., De Carolis A., Emili E., Rigucci S., Falcone I., Corigliano V.…Girardi P. Basic symptoms and psychotic symptoms: their relationships in the at risk mental states, first episode and multi-episode schizophrenia. Compr. Psychiatry. 2014;55(4):785–791. doi: 10.1016/j.comppsych.2014.01.006. [DOI] [PubMed] [Google Scholar]
  19. Compton M.T., Chien V.H., Bollini A.M. Psychometric properties of the Brief Version of the Schizotypal Personality Questionnaire in relatives of patients with schizophrenia-spectrum disorders and non-psychiatric controls. Schizophr. Res. 2007;91:122–123. doi: 10.1016/j.schres.2006.12.005. [DOI] [PubMed] [Google Scholar]
  20. Cristinzio C., N'Diaye K., Seeck M., Vuilleumier P., Sander D. Integration of gaze direction and facial expression in patients with unilateral amygdala damage. Brain. 2009;133(1):248–261. doi: 10.1093/brain/awp255. [DOI] [PubMed] [Google Scholar]
  21. Darke H., Peterman J.S., Park S., Sundram S., Carter O. Are patients with schizophrenia impaired in processing non-emotional features of human faces? Front. Psychol. 2013;4:529. doi: 10.3389/fpsyg.2013.00529. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Doop M.L., Park S. Facial expression and face orientation processing in schizophrenia. Psychiatry Res. 2009;170(2–3):103–107. doi: 10.1016/j.psychres.2009.06.009. [DOI] [PubMed] [Google Scholar]
  23. Edwards J., Pattison P.E., Jackson H.J., Wales R.J. Facial affect and affective prosody recognition in first-episode schizophrenia. Schizophr. Res. 2001;48(2–3):235–253. doi: 10.1016/s0920-9964(00)00099-2. [DOI] [PubMed] [Google Scholar]
  24. El Zein M., Gamond L., Conty L., Grèzes J. Selective attention effects on early integration of social signals: same timing, modulated neural sources. NeuroImage. 2015;106:182–188. doi: 10.1016/j.neuroimage.2014.10.063. [DOI] [PubMed] [Google Scholar]
  25. El Zein M., Wyart V., Grezes J. Anxiety dissociates the adaptive functions of sensory and motor response enhancements to social threats. Elife. 2015;4 doi: 10.7554/eLife.10274. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. First M.B., Spitzer R.L., Gibbon M., Williams J.B.W. Biometrics Research, New York State Psychiatric Institute; New York: 2002. Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition With Psychotic Screen (SCID-I/P W/PSY SCREEN) [Google Scholar]
  27. Fletcher P.C., Frith C. Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia. Nat. Rev. Neurosci. 2009;10:48–58. doi: 10.1038/nrn2536. [DOI] [PubMed] [Google Scholar]
  28. Franck N., Daprati E., Michel F., Saoud M., Dalery J., Marie-Cardine M., Georgieff N. Gaze discrimination is unimpaired in schizophrenia. Psychiatry Res. 1998;81:67–75. doi: 10.1016/s0165-1781(98)00082-1. [DOI] [PubMed] [Google Scholar]
  29. Franck N., Montoute T., Labruyere N., Tiberghien G., Marie-Cardine M., Dalery J., Georgieff N. Gaze direction determination in schizophrenia. Schizophr. Res. 2002;56:225. doi: 10.1016/s0920-9964(01)00263-8. [DOI] [PubMed] [Google Scholar]
  30. Frith C. Is autism a disconnection disorder? Lancet Neurol. 2004;3(10) doi: 10.1016/s1474-4422(04)00875-0. [DOI] [PubMed] [Google Scholar]
  31. Haggard P., Martin F., Taylor-Clarke M., Jeannerod M., Franck N. Awareness of action in schizophrenia. Neuroreport. 2003;14(7):1081–1085. doi: 10.1097/01.wnr.0000073684.00308.c0. [DOI] [PubMed] [Google Scholar]
  32. Holt, D. J., Titone, D., Long, L. S., Goff, D. C., Cather, C., Rauch, S. L., … Kuperberg, G. R. (2006). The misattribution of salience in delusional patients with schizophrenia. Schizophr. Res., 83(2–3), 247–256. doi: 10.1016/j.schres.2005.12.858. [DOI] [PubMed]
  33. Hooker C., Park S. You must be looking at me: the nature of gaze perception in patients with schizophrenia. Cogn. Neuropsychiatry. 2005;10:327–354. doi: 10.1080/13546800444000083. [DOI] [PubMed] [Google Scholar]
  34. Ioannou C., Zein M.E., Wyart V., Scheid I., Amsellem F., Delorme R.…Grèzes J. Shared mechanism for emotion processing in adolescents with and without autism. Sci. Rep. 2017;7(1) doi: 10.1038/srep42696. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Jeffreys H. 3rd ed. Oxford University Press; Oxford: 1961. The Theory of Probability. [Google Scholar]
  36. Kass R.E., Raftery A.E. Bayes factors. J. Am. Stat. Assoc. 1995;90(430):773–795. doi: 10.1080/01621459.1995.10476572. [DOI] [Google Scholar]
  37. Kee K.S., Green M.F., Mintz K., Brekke J.S. Is emotion processing a predictor of functional outcome in schizophrenia? Schizophr. Bull. 2003;29:487–497. doi: 10.1093/oxfordjournals.schbul.a007021. [DOI] [PubMed] [Google Scholar]
  38. Kohler C.G., Turner T.H., Bilker W.B., Brensinger C.M., Siegel S.J., Kanes S.J.…Gur R.C. Facial emotion recognition in schizophrenia: intensity effects and error pattern. Am. J. Psychiatry. 2003;160(10):1768–1774. doi: 10.1176/appi.ajp.160.10.1768. [DOI] [PubMed] [Google Scholar]
  39. Kohler C.G., Walker J.B., Martin E.A., Healey K.M., Moberg P.J. Facial emotion perception in schizophrenia: a meta-analytic review. Schizophr. Bull. 2010;36(5):1009–1019. doi: 10.1093/schbul/sbn192. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Langdon R., Corner T., McLaren J., Ward P.B., Coltheart M. Externalizing and personalizing biases in persecutory delusions: the relationship with poor insight and theory-of-mind. Behav. Res. Ther. 2006;44(5):699–713. doi: 10.1016/j.brat.2005.03.012. [DOI] [PubMed] [Google Scholar]
  41. Langdon R., Still M., Connors M.H., Ward P.B., Catts S.V. Jumping to delusions in early psychosis. Cogn. Neuropsychiatry. 2014;19(3):241–256. doi: 10.1080/13546805.2013.854198. [DOI] [PubMed] [Google Scholar]
  42. Langdon R., Seymour K., Williams T., Ward P.B. Automatic attentional orienting to other people's gaze in schizophrenia. Q. J. Exp. Psychol. 2017;70(8):1549–1558. doi: 10.1080/17470218.2016.1192658. [DOI] [PubMed] [Google Scholar]
  43. Langner O., Dotsch R., Bijlstra G., Wigboldus D.H.J., Hawk S.T., van Knippenberg A. Presentation and validation of the Radboud Faces Database. Cognit. Emot. 2010;24(8):1377–1388. doi: 10.1080/02699930903485076. (doi:Pii 930020275) [DOI] [Google Scholar]
  44. N'diaye K., Sander D., Vuilleumier P. Self-relevance processing in the human amygdala: gaze direction, facial expression, and emotion intensity. Emotion. 2009;9(6):798. doi: 10.1037/a0017845. [DOI] [PubMed] [Google Scholar]
  45. Nelson H., Willison J. 2nd edn. NFER- Nelson; Windsor: 1991. The Revised National Adult Reading Test (NART) – Test Manual. [Google Scholar]
  46. Palmer C.J., Caruana N., Clifford C.W.G., Seymour K.J. Adaptive sensory coding of gaze direction in schizophrenia. R. Soc. Open Sci. 2018;5(12):180886. doi: 10.1098/rsos.180886. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Palmer C.J., Caruana N., Clifford C.W.G., Seymour K.J. Perceptual integration of head and eye cues to gaze direction in schizophrenia. R. Soc. Open Sci. 2018;5(12) doi: 10.1098/rsos.180885. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Pelli D.G. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat. Vis. 1997;10(4):437–442. doi: 10.1163/156856897x00366. [DOI] [PubMed] [Google Scholar]
  49. Penn D.L., Spaulding W., Reed D., Sullivan M. The relationship of social cognition to ward behaviour in chronic schizophrenia. Schizophr. Res. 1996;20:327–335. doi: 10.1016/0920-9964(96)00010-2. [DOI] [PubMed] [Google Scholar]
  50. Phillips M.L., Drevets W.C., Rauch S.L., Lane R. Neurobiology of emotion perception II: implications for major psychiatric disorders. Biol. Psychiatry. 2003;54(5):515–528. doi: 10.1016/s0006-3223(03)00171-9. [DOI] [PubMed] [Google Scholar]
  51. Pinkham A.E., Penn D.L., Perkins D.O., Lieberman J. Implications for the neural basis of social cognition for the study of schizophrenia. Am. J. Psychiatry. 2003;160(5):815–824. doi: 10.1176/appi.ajp.160.5.815. [DOI] [PubMed] [Google Scholar]
  52. Pinkham A.E., Brensinger C., Kohler C., Gur R.E., Gur R.C. Actively paranoid patients with schizophrenia over attribute anger to neutral faces. Schizophr. Res. 2011;125(2–3):174–178. doi: 10.1016/j.schres.2010.11.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Pinkham A.E., Harvey P.D., Penn D.L. Paranoid individuals with schizophrenia show greater social cognitive bias and worse social functioning than non-paranoid individuals with schizophrenia. Schizophr. Res. Cogn. 2016;3:33–38. doi: 10.1016/j.scog.2015.11.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Pinkham A.E., Penn D.L., Green M.F., Harvey P.D. Social cognition psychometric evaluation: results of the initial psychometric study. Schizophr. Bull. 2016;42(2):494–504. doi: 10.1093/schbul/sbv056. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Raine A., Benishay D. The SPQ-B: a brief screening instrument for schizotypal personality disorder. J. Personal. Disord. 1995;9:346–355. doi: 10.1521/pedi.1995.9.4.346. [DOI] [Google Scholar]
  56. Roberts D.L., Pinkham A.E. The future of social cognition in schizophrenia: implications for the normative literature. In: Roberts D.L., Penn D.L., editors. Social Cognition in Schizophrenia. Oxford University Press; New York, NY: 2013. pp. 401–414. 2013. [Google Scholar]
  57. Rosse R.B., Fay-McCarthy M., Collins J.P., Jr., Alim T.N., Deutsch S.I. The relationship between cocaine-induced paranoia and compulsive foraging: a preliminary report. Addiction. 1994;89(9):1097–1104. doi: 10.1111/j.1360-0443.1994.tb02786.x. [DOI] [PubMed] [Google Scholar]
  58. Sander D., Grandjean D., Kaiser S., Wehrle T., Scherer K.R. Interaction effects of perceived gaze direction and dynamic facial expression: evidence for appraisal theories of emotion. Eur. J. Cogn. Psychol. 2007;19(3):470–480. [Google Scholar]
  59. Savla G.N., Vella L., Armstrong C.C., Penn D.L., Twamley E.W. Deficits in domains of social cognition in schizophrenia: a meta-analysis of the empirical evidence. Schizophr. Bull. 2013;39(5):979–992. doi: 10.1093/schbul/sbs080. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Seymour K., Rhodes G., Stein T., Langdon R. Intact unconscious processing of eye contact in schizophrenia. Schizophr. Res. Cogn. 2016;3:15–19. doi: 10.1016/j.scog.2015.11.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Seymour K., Rhodes G., McGuire J., Williams N., Jeffery L., Langdon R. Assessing early processing of eye gaze in schizophrenia: measuring the cone of direct gaze and reflexive orienting of attention. Cogn. Neuropsychiatry. 2017;22(2):122–136. doi: 10.1080/13546805.2017.1285755. [DOI] [PubMed] [Google Scholar]
  62. Silverstein S.M. 2016. The Neuropsychopathology of Schizophrenia; pp. 77–132. [Google Scholar]
  63. Sprong M., Schothorst P., Vos E., Hox J., van Engeland H. Theory of mind in schizophrenia: meta-analysis. Br. J. Psychiatry. 2007;191(1):5–13. doi: 10.1192/bjp.bp.107.035899. [DOI] [PubMed] [Google Scholar]
  64. Tso I.F., Mui M.L., Taylor S.F., Deldin P.J. Eye-contact perception in schizophrenia: relationship with symptoms and socioemotional functioning. J. Abnorm. Psychol. 2012;121:616–627. doi: 10.1037/a0026596. [DOI] [PubMed] [Google Scholar]
  65. Uhlhaas P.J., Mishara A.L. Perceptual anomalies in schizophrenia: integrating phenomenology and cognitive neuroscience. Schizophr. Bull. 2006;33:142–156. doi: 10.1093/schbul/sbl047. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Walss-Bass C., Fernandes J., Roberts D., Service H., Velligan D. Differential correlations between plasma oxytocin and social cognitive capacity and bias in schizophrenia. Schizophr. Res. 2013;147:387–392. doi: 10.1016/j.schres.2013.04.003. [DOI] [PubMed] [Google Scholar]
  67. Watson T.L. Implications of holistic face processing in autism and schizophrenia. Front. Psychol. 2013;4:1–11. doi: 10.3389/fpsyg.2013.00414. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional Model Comparisons.

mmc1.docx (13KB, docx)

Articles from Schizophrenia Research: Cognition are provided here courtesy of Elsevier

RESOURCES