Abstract
Background
Deficits in face emotion perception are among the most pervasive aspects of schizophrenia impairments which strongly affects interpersonal communication and social skills.
Material/Methods
Schizophrenic patients (PSZ) and healthy control subjects (HCS) performed 2 psychophysical tasks. One, the SAFFIMAP test, was designed to determine the impact of subliminally presented affective or neutral images on the accuracy of face-expression (angry or neutral) perception. In the second test, FEP, subjects saw pictures of face-expression and were asked to rate them as angry, happy, or neutral. The following clinical scales were used to determine the acute symptoms in PSZ: Positive and Negative Syndrome (PANSS), Young Mania Rating (YMRS), Hamilton Depression (HAM-D), and Hamilton Anxiety (HAM-A).
Results
On the SAFFIMAP test, different from the HCS group, the PSZ group tended to categorize the neutral expression of test faces as angry and their response to the test-face expression was not influenced by the affective content of the primes. In PSZ, the PANSS-positive score was significantly correlated with correct perception of angry faces for aggressive or pleasant primes. YMRS scores were strongly correlated with PSZ’s tendency to recognize angry face expressions when the prime was a pleasant or a neutral image. The HAM-D score was positively correlated with categorizing the test-faces as neutral, regardless of the affective content of the prime or of the test-face expression (angry or neutral).
Conclusions
Despite its exploratory nature, this study provides the first evidence that conscious perception and categorization of facial emotions (neutral or angry) in PSZ is directly affected by their positive or negative symptoms of the disease as defined by their individual scores on the clinical diagnostic scales.
MeSH Keywords: Affective Symptoms, Schizophrenia, Subliminal Stimulation
Background
Research in schizophrenia has provided robust empirical support for the clinical observation that PSZ (patients with schizophrenia) are impaired in a broad range of interpersonal skills necessary for appropriate functioning in the everyday environment. A consistent finding is that PSZ are profoundly impaired in recognizing other people’s emotions from face expression [1–7], an ability that is at the core of normal social behavior and, when impaired, leads to difficulties in communication and comprehension of nonverbal and emotional cues. Therefore, it is important to better understand what determines or impairs the ability to recognize face expressions.
In this study we were interested in determining whether priming with emotionally charged images (aggressive, pleasant) or neutral images influenced PSZ subjects’ recognition of face expressions (angry or neutral). In individuals without schizophrenia, affective primes of different emotional valence have a fast and significant effect on behavior [8–10]. Furthermore, even in the absence of conscious awareness (subliminal priming), different classes of emotional stimuli influence conscious response [11]. Interestingly, this is true even when a prime is presented subliminally, although the subject is not aware of it. When the prime is semantically related to the target, it will facilitate recognition [12,13]. In this study we investigated whether subliminally-presented emotional or neutral information in the priming images affect conscious perception and the accuracy of discrimination between emotional (angry) and neutral face expressions in PSZ and whether the patients’ performance differs from that of the healthy control subjects (HCS). There are previous reports that although PSZ tend to be impaired in processing conscious, attentional, information, they are normal on automatic, subconscious, non-attentionally modulated processing [14].
Material and Methods
Participants
In total, 8 PSZ subjects (mean age 41.63±4.24 SD, 7 females, all right-handed [15]) participated in this study. The patients were recruited before they were admitted into the psychiatric hospital for inpatient treatment for acute symptoms of schizophrenia. All patients underwent diagnostic examination with the Structured Clinical Interview of DSM-V–TM criteria [16] and met criteria for schizophrenia. Criteria for diagnosis of schizophrenia are 2 or more of the following: delusions, hallucinations, disorganized speech or incoherence, or grossly disorganized behavior. The patients also presented some of the typical negative symptoms – diminished emotional expression, social withdrawal, and lack of spontaneity and flow of conversation. Psychopathological symptoms were assessed by a psychiatrist (IC, one of the authors) using several psychological tests: PANSS, a scale for measuring the severity of schizophrenia [17], YMRS [18], HAM-D [19], and HAM-A [20]. None of the PSZ had a history of neurological or additional psychiatric illness, head injury, substance-abuse, or learning disabilities. All PSZs were administered these clinical scales and performed the 2 behavioral experiments after admission into the hospital but prior to starting treatment with antipsychotic medication.
Six healthy control subjects (mean age 35.33±8.36 SD, 3 females, all right-handed) with no history of psychiatric disorders and no first-degree relatives with psychiatric illness were recruited from the general community. Mental health of the HCS was assessed using a clinical interview. HCS subjects with a personal or family history of schizophrenia, or affective illness, or previously treated with neuroleptic drugs or long-term taking of tranquilizers were excluded.
All the data were collected at the Department of Psychiatry, County Emergency Clinical Hospital, Arad, Romania. To confirm that subjects understood the requirements of the experimental tests, all subjects completed a short practice block at the beginning of the tests (described below). The practice trials incorporated the same emotional valences but had a different set of priming images and pictures of faces with an angry or neutral expression (like in the test itself).
Table 1 shows the results on the clinical scales administered to the PSZ subjects. Table 2 provides specific subject information and the percent correct responses on the Face Emotion Processing (FEP) test.
Table 1.
Patient scores on clinical scales. Patients are listed by their anonymized 3-letter codes. Clinical scales are Positive and Negative Syndrome Scale (PANSS) Total, PANSS-Positive, PANSS-Negative, PANSS-General, Young Mania Rating Scale (YMRS), Hamilton Rating Scale for Depression (HAM-D), Hamilton Rating Scale for Anxiety (HAM-A).
| Initials | Age | PANSS-Total | PANSS-Positive | PANSS-Negative | PANSS-General | YMRS | HAM-D | HAM-A |
|---|---|---|---|---|---|---|---|---|
| BSO | 45 | 106 | 28 | 28 | 50 | 12 | 18 | 20 |
| RSI | 45 | 91 | 18 | 22 | 51 | 17 | 18 | 6 |
| ACA | 39 | 108 | 40 | 18 | 50 | 19 | 10 | 16 |
| AST | 37 | 73 | 15 | 17 | 41 | 4 | 18 | 16 |
| TAN | 47 | 92 | 22 | 21 | 49 | 5 | 19 | 23 |
| BLI | 42 | 97 | 28 | 24 | 45 | 16 | 9 | 15 |
| PDO | 35 | 106 | 31 | 28 | 47 | 11 | 10 | 18 |
| BSI | 43 | 92 | 23 | 24 | 45 | 22 | 4 | 7 |
Table 2.
Validation test performance across subjects by their coded initials, subject type (Patient (P) or Control (C)) across ratings of angry, happy, and neutral test faces. Percentages reported are equal to the percentage of images in that category that were correctly rated as angry, pleasant, or neutral.
| Initials | Type | Age | Test faces | ||
|---|---|---|---|---|---|
| Angry | Happy | Neutral | |||
| BSO | Patient (P) | 45 | 89.3% | 67.9% | 64.3% |
| RSI | Patient (P) | 45 | 75.0% | 75.0% | 71.4% |
| ACA | Patient (P) | 39 | 64.3% | 96.4% | 85.7% |
| AST | Patient (P) | 37 | 78.6% | 89.3% | 92.9% |
| TAN | Patient (P) | 47 | 78.6% | 96.4% | 57.1% |
| BLI | Patient (P) | 42 | 89.3% | 100.0% | 78.6% |
| PDO | Patient (P) | 35 | 78.6% | 71.4% | 39.3% |
| BSI | Patient (P) | 43 | 67.9% | 32.1% | 57.1% |
| NLU | Control (C) | 29 | 89.3% | 92.9% | 85.7% |
| VLA | Control (C) | 28 | 100.0% | 100.0% | 92.9% |
| CIO | Control (C) | 27 | 100.0% | 100.0% | 92.9% |
| MFL | Control (C) | 39 | 92.9% | 96.4% | 85.7% |
| GPE | Control (C) | 43 | 96.4% | 100.0% | 100.0% |
| CNE | Control (C) | 46 | 89.3% | 100.0% | 57.1% |
This investigation was carried out in accordance with the Declaration of Helsinki for standards for ethical treatment of participants and was approved by the local ethics Committee. All participants signed a written informed consent.
Experimental procedures and stimuli
Participants sat in a dimly lit room 60 cm from the computer screen. Both experimental tasks were administered using an Apple Macintosh computer. The experiments were written in BraviShell, a Matlab (MATLAB and Statistics Toolbox Release 2009a, The MathWorks, Inc., Natick, Massachusetts, United States) software package developed in the Brain and Vision Research Laboratory (Biomedical Engineering Department, Boston University, Boston, MA, 2005–2014) based on the Psychophysics Toolbox extensions [21–23], which also controlled stimulus presentation, and collected responses. Participants entered their responses by keypresses using the fingers of the right hand. Throughout the stimulus presentation, subjects were required to fixate on a white cross (0.3 deg) displayed at the center of the computer screen.
The SAFFIMAP test was designed to evaluate ability to correctly identify the emotional valence of a face expression, neutral or angry, shown after a brief presentation of a priming affective image (pleasant, neutral, or aggressive.) followed by a mask. The FEP test assessed the participants’ ability to recognize angry, happy, or neutral face expressions.
Image stimuli
The behavioral experiments contained 3 different stimuli: priming-image, mask, and face-test images. All priming images were either selected from the International Affective Picture System (IAPS) database [24] or were public domain images available on the internet. Indices of the images selected from the IAPS database are as follows: aggressive: 12, 163, 257, 1380, 1653, 1790, 1865, 1886, 1965, 1999, 2214, 2217, 2227, 2244, 2248, 2258; pleasant: 7, 18, 57, 58, 64, 124, 224, 455, 516, 538, 541, 726, 730, 743, 765, 775, 796, 815, 887, 896, 956, 969, 991, 1190, 1318, 1320, 1527. To establish the validity and reliability of the image primes, a sample of 5 healthy controls was asked to categorize each image according to its affective content: as aggressive, pleasant or neutral. We chose 120 images that were assigned by all 5 observers to the same affective category, 40 in each, aggressive, pleasant, or neutral. The images were cropped and resized to 512×512 pixels and then normalized to a constant luminance and contrast using the SHINE toolbox [25].
Each prime was followed by a mask generated by dividing the image into 16×16 pixels blocks (0.78×0.78 degrees) and randomly shuffling them in horizontal and vertical positions. The result was a scrambled version of the prime, where local image information remained the same, but the content of the image was destroyed.
The test face stimuli consisted of pictures of unfamiliar faces displaying either an angry or a neutral expression. We selected 28 pictures of each face expression (angry, happy, and neutral) from the Karolinska Directed Emotional Faces (KDEF) database [26]. The face pictures were cropped and normalized in the same way as the prime images. To make the face expression discrimination more challenging, we further divided the face pictures into 8×8 pixel blocks (23.4 arcminutes in height and width) and replaced 50% of the blocks with a color whose RGB (red, green, blue) components were sampled randomly from a normal distribution with mean and covariance equal to that of the RGB components of the full image.
Subliminal Affective Image Priming Task (SAFFIMAP)
This test assessed the effect of subliminally-presented affective prime images (aggressive, pleasant, or neutral) on the processing of a face expression (neutral or angry). A schematic view of the stimulus is presented in Figure 1. To assure that observers were fully alert and attentive to the stimuli, each trial started with an exclamation mark (6 degrees in height) displayed in the center of the computer screen. To begin a trial, participants indicated that they were ready by a keypress. This was followed by a 500-ms blank screen at a neutral gray intensity (42 cd/m2), followed by a fixation cross presented in the center of the screen for 500 ms. Next, a prime selected pseudo-randomly from the 120 images (described in section ‘Between-group analyses’) was presented for 16 ms, and then immediately followed by a mask (described in section ‘Between-group analyses’) shown for 100 ms. Both the prime and the mask subtended 12.5×12.5 degrees, and were presented exactly in the same spatial location, at the center of the computer screen. After a 50-ms delay, a test-face (described in section ‘Between-group analyses’) was displayed for 500 ms. Subjects indicated by a keypress whether they assessed the face expression as neutral or angry (pressed 1 for neutral, 2 for angry). The next trial began immediately after the subject’s response, or after 4000 ms if no response was entered. There were in total 120 trials, each with a unique prime image, 40 in each affective category, with a randomly selected face image with replacement.
Figure 1.
Timeline of a single trial in the facial expression recognition task with subliminally presented primes. First, an exclamation mark appears (prompt) where the subject must press a key to continue the trial. Next, there is a delay period for 500 ms with a blank neutral gray screen. After 500 ms, a fixation mark appears. Then, after 500 ms, the prime image is shown for 16 ms. Immediately following the prime is the mask, consisting of a scrambled version of the prime image lasting 100 ms. Next, the test face appears. After 500 ms, the test face disappears and the subject is asked to respond to the facial expression of the test face (angry or neutral) via keypress. The next trial begins after the subject presses a key or after 4000 ms if no response is entered.
Face Emotion Processing Test (FEP)
In a 3-alternative forced choice task (3AFC), subjects were presented, for 500 ms, front-view pictures of human faces expressions: angry, happy, or neutral. The angry and neutral faces were the same as those used in the SAFFIMAP test, except here no distracting noise was superimposed on the face picture. The happy face expressions were also selected from the KDEF database. There were 84 unique trials, with 28 trials portraying 1 face of each of the 3 face emotions. The timeline of each trial is shown in Figure 2. As in the SAFFIMAP test, each trial began with an exclamation mark prompt followed by a 500-ms blank screen (at neutral gray, 42 cd/m2). After another 500 ms, the picture of a face expression to be evaluated was presented for 500 ms. Subjects reported via keypress (1, 2, 3) whether they perceived the face expression as angry, happy, or neutral. If the subject did not respond in 4000 ms, the next trial began.
Figure 2.
Timeline of a single trial in the FEP task. First, an exclamation mark appears (prompt) where the subject must press a key to continue the trial. Next, there is a delay period for 500 ms with a blank neutral gray screen. After 500 ms, a fixation mark appears. Then, after 500 ms, the test face appears and lasts for another 500 ms. Then, the subject is asked respond to the facial expression of the test face (angry, happy, or neutral) via keypress. The next trial begins after the subject presses a key or after 4000 ms if no response is entered.
Data analysis methods
Between-group analyses
To determine that PSZ and HCS subjects were able to perceive face emotions, we administered the FEP test (section ‘Subliminal Affective Image Priming Task (SAFFIMAP)’). The results (percent correct) are shown in Table 2.
The SAFFIMAP test interrogates the effect of subliminally presented affective or neutral primes on the perception of face expression (angry or neutral). Because the behavioral data was not normally distributed, we used a General Linear Mixed Model (GLMM) that captures binary response data (correct vs. incorrect) through a probit link function. The GLMMs were computed over the prime categories (aggressive, neutral, or pleasant), the test face expression category (angry or neutral), and the subject group (HCS or PSZ) (Table 3). We treated the subject identifier as a random effects variable nested within the subject group. The results from this GLMM analysis provided general trends that discriminate between the performance of the PSZ and the HCS groups. To further investigate differences in performance within and between HCS and PSZ groups for each test-face expression and prime category, we computed the binomial proportions test between pairs of combinations within categories found to be significantly different in the GLMM analysis.
Table 3.
GLMM results over evaluation of response (correct vs. incorrect) for group comparison between PSZ and HCS. Variable codes are as follows: subjtype – Subject Type (PSZ vs. HCS), affectivecat – Affective Category (aggressive, pleasant, neutral,), testfacetype – Test Facial Expression Category (angry vs. neutral).
| Source | F | df1 | df2 | Sig |
|---|---|---|---|---|
| Affectivecat | 3.529 | 2 | 1 668 | 0.300 |
| Testfacetype | 0.496 | 1 | 1 668 | 0.481 |
| Affectivecat*testfacetype | 4.610 | 2 | 1 668 | 0.010 |
| Subjtype | 22.223 | 1 | 7 | 0.002 |
| Subjtype*affectivecat | 0.527 | 2 | 1 668 | 0.590 |
| Subjtype*testfacetype | 5.425 | 1 | 1 668 | 0.020 |
| Subjtype*affectivecat*testfacetype | 4.283 | 2 | 1 668 | 0.014 |
Single-patient comparison to the control group
Due to the variability in performance of the PSZ, for each type of the test-face (angry or neutral) we further computed additional GLMMs to compare each individual patient to the HCS group. The GLMM was applied to the main effects of the affective prime categories and subject type and we considered the 2-way interactions with the subject type.
Correlation between Clinical Scores and Patient Performance
We used the Pearson correlation test to correlate the PSZ’s performance on classifying test-face expressions as angry or neutral in each prime category (aggressive, pleasant, or neutral) with their scores on the clinical scales: PANSS-Positive, PANSS-Negative, PANSS-General, Young Mania Rating Scale (YMRS), Hamilton Rating Scale for Depression (HAM-D), and Hamilton Rating Scale for Anxiety (HAM-A). Significance scores of correlation were computed using a Student’s t-distribution implemented in Matlab’s corr function.
Results
Between-group analyses
We assessed the performance of PSZ and HCS ability to classify face expressions as happy, angry, or neutral using the FEP test. We report the performance of each subject individually in Table 2. Patient PDO performed poorly on the recognition of neutral face expression (39.3%), and patient BSI was very impaired on recognizing happy faces (32.1%). The other patients and all the healthy controls scored significantly above chance (33%).
The results of the GLMM analysis, used to compare HCS and PSZ performance on test-face expression in the SAFFIMAP task (Table 3), revealed a significant effect of subject type on the performance (F(1,7)=22.223, p=0.002). Figure 3A illustrates that, overall, PSZ performed significantly worse than HCS (estimated mean of PSZ=58.23%, estimated mean of HCS=79.17%) (p<0.001). There were additional significant effects of the interaction between subject type and other factors, which show that performance differences resulted not only from overall higher error rates in the PSZ group, but also from differences in performance between groups related to the content of the priming stimuli, particularly the affective primes (pleasant and aggressive). There was no significant effect of the interaction between subject type and the affective category in the priming images (F(2,1668)=0.527, p=0.590).
Figure 3.
(A) Mean performance of healthy controls and patients on the SAFFIMAP task. (B) Mean performance of healthy control and patients on the SAFFIMAP task on the perception of test face category (angry facial expression or neutral facial expression). (C) Mean performance of healthy controls (left) and patients (right) on the perception of test face category (angry facial expression or neutral facial expression) for each affective prime category (Aggressive, Pleasant, Neutral) in the SAFFIMAP task. Error bars represent the 95% binomial confidence interval.
However, discriminating performance between the category of test face (angry vs. neutral) showed significant differences. There were a significant statistical differences in the interaction between subject type (PSZ or HCS) and test-face category (F(1,1668)=5.425, p=0.020). Figure 3B shows the performance of PSZ and HCS groups on the categorizing of test faces as angry or neutral. There was no significant difference between the control group’s performance and the patient group’s performance (mean of correct responses: HCS=68.75%, PSZ=66.15%, p=0.476) in the responses to the angry face expression; however, in the assessment of neutral face expression, the performance of the 2 groups differed significantly (mean: HCS=86.11%, PZ=52.95%, p<0.001).
There was also a statistically significant difference in the interaction between subject type, test face-expression category, and affective prime category (F(2,1668)=4.283, p=0.014). HCS subjects’ performance was strongly influenced by the affective content of the prime images. They scored higher on test-face emotion categorization when the prime images were aggressive or pleasant than when they were neutral (performance means for aggressive primes=87.50%, pleasant primes=90.97%, and neutral primes=79.86%; the p-value significance of difference in performance between aggressive and pleasant primes=0.3418, between pleasant and neutral=0.0076, and between aggressive and neutral=0.0794, p-value significance of difference between affective (aggressive+pleasant) and neutral=0.0277) (Figure 3C). The PSZ had a poorer performance than the HCS on the task, regardless of the affective content of the primes, which did not affect task performance in the PSZ subjects (mean performance on aggressive primes=54.69%, pleasant primes=53.65%, and neutral primes=50.52%,; the p-value significance of difference between aggressive and pleasant primes=0.8377, between pleasant and neutral=0.5399; between aggressive and neutral=0.4136, and between affective (aggressive+pleasant) and neutral=0.4745).
Single subject analysis
Subject-by-subject comparisons revealed a number of results unique to each patient. The significances of response evaluation for angry face expressions are summarized in Table 4A and those for neutral face expressions are summarized in Table 4B. The results of the GLMMs analysis showed that the overall performance differences between each individual patient and the controls was non-significant, and that explanatory factors for patient differences required the interactions with the affective prime categories to have significance.
Table 4.
GLMM results over evaluation of response (correct vs. incorrect) for comparison between individual patients and the Healthy controls group limited to subject type and subject type interactions for (A) Angry Test Facial Expressions and (B) Neutral Test Facial Expressions. Variable codes are as follows: subjtype – Subject Type (PSZ vs. HCS), affectivecat – Affective Category (aggressive, pleasant, neutral).
| (A) | BSO | RSI | ACA | AST | TAN | BLI | PDO | BSI |
|---|---|---|---|---|---|---|---|---|
| Subjtype | 0.826 | 0.776 | 0.771 | 0.776 | 0.763 | 0.733 | 0.740 | 0.773 |
| Subjtype*affectivecat | 0.000 | 0.001 | 0.000 | 0.000 | 0.235 | 0.000 | 0.000 | 0.000 |
| (B) | BSO | RSI | ACA | AST | TAN | BLI | PDO | BSI |
| Subjtype | 0.777 | 0.642 | 0.703 | 0.715 | 0.618 | 0.555 | 0.561 | 0.746 |
| Subjtype*affectivecat | 0.172 | 0.001 | 0.000 | 0.678 | 0.000 | 0.000 | 0.013 | 0.030 |
Correlation of performance on Subliminal Affective Image Priming task (SAFFIMAP) and on clinical scales for measuring symptoms severity
We used the Pearson correlation test to determine whether the schizophrenic patients’ (PSZ) score on the clinical scales was correlated with performance on the SAFFIMAP test in each prime and test face categories. Figure 4 shows the correlation between PANSS-Positive score and performance of patients in affective prime categories separated by the test-face category. The general trend in the data shows that higher PANSS-Positive scores tended to lead to increased response that the test face was an angry face. The most significant effects were found when presenting angry test faces and when the priming image was aggressive (p=0.089) or pleasant (p=0.041). Figure 5 shows the strong correlation between the YMRS score, measuring mania, and performance when patients were presented an angry test face and a neutral (p=0.012) or a pleasant prime (p=0.083). Figure 6 shows the correlations with HAM-D scores. These results show that subjects with higher HAM-D scores tended to rate the test face as neutral. For all primes – pleasant, angry or neutral – the angry face expression were significantly negatively correlated with the HAM-D score and the neutral face expression was significantly positively correlated with the HAM-D score.
Figure 4.
Performance vs. PANSS-Positive score in affective categories (aggressive, pleasant, neutral) for angry test face (top) and neutral test faces (bottom). The grey line is the line of best fit for data. Corresponding Pearson’s correlation rho and p-value are reported.
Figure 5.
Performance vs. YMRS score in affective categories (aggressive, pleasant, and neutral) for angry test face (top) and neutral test faces (bottom). The grey line is the line of best fit for data. Corresponding Pearson’s correlation rho and p-value are reported.
Figure 6.
Performance vs. HAM-D score in affective categories (aggressive, pleasant, neutral) for angry test face (top) and neutral test faces (bottom). The grey line is the line of best fit for data. Corresponding Pearson’s correlation rho and p-value are reported.
Discussion
This study has 2 emerging findings. First, in the FEP test, we found that, different from the HCS group, the PSZ group tended to rate the test face expressions as angry, even when it was neutral or angry. This is consistent with the reports that PSZ are generally impaired in the perception of face emotions [27, 28, for a detailed meta-analysis see 29] and that they are prone to negative affective judgment [30]. In the SAFFIMAP test, the HCS group performed significantly better on correctly categorizing neutral test-face expressions when the prime images were portrayed emotions (aggressive or pleasant) than when the primes were neutral. This effect was not seen for angry test-face expressions. We suggest that the emotional content of the angry face expressions may override the effect of the affective content of the prime. In the PSZ group, however, the emotional content of the prime image categories did not affect performance on the test-face categorization in the angry or neutral category. This outcome is in contrast with the results reported by Höschel and Irle [30], on an emotional subliminal priming test. These authors reported that in healthy control subjects, especially negative priming images (negative face expressions) strongly influenced the judgment of the emotional expression in the test face (a face with neutral expression). This effect was much stronger in the schizophrenic subjects. In particular, they found a significantly lower percentage of rating the face expression as pleasant in the negative prime condition. There may be several possible reasons for this drastic difference between our study and the study by Höschel and Irle [30]. Their experiment, similar to the SAFFIMAP test, contained a subliminal affective prime, a mask, and then a test face. However the mask (shown only for 20 ms) was always the same, while in SAFFIMAP the mask (shown for 100 ms) was obtained from scrambling the prime image; thus, the 2 images were locally identical. It is therefore possible that in their case, the very short mask duration and the fact that in all trials they used the same mask (unrelated to the content of the prime), the affective content of the prime may have reached conscious perception. Also, their primes were emotional expressions of faces (selected according to [31] face expressions categories), which may have a stronger impact on judging another face expression. Most of our prime images did not contain faces. The test-face image in their experiment was always the same (neutral face expression), while in ours it differed from trial to trial, providing a factor of continuous novelty. Finally, as the authors themselves comment, the fact that the target presentation was repeated 4 times could have lead to an exposure effect.
The second important finding of our study is in the pattern of correlations between the PSZ performance on the SAFFIMAP test (categorize the test faces as angry or neutral), with their scores on the clinical scales administered, and with their sensitivity to the affective category of the priming images. In the PSZ we found significant correlations between the scores on the clinical scales and performance on test-face categorization. This result is not in conflict with the findings discussed above, as there were interested in the overall trend in the performance of the PSZ group, without considering their individual scores on the clinical scales used to profile the symptoms of the disease. Figure 5 shows that a high PANSS-Positive score, indicative of presence of delusions, suspiciousness, and hostility, was significantly correlated (or approached significance) with PSZ’s higher tendency to evaluate the test face as angry in the trials where the prime was either aggressive or pleasant, but not when it was neutral. This suggests that even subliminally presented affective images, while not consciously perceived and recognized, color the follow-up conscious perception of face expressions with a negative emotion. This also suggests that the 100-ms mask, either was not long enough to inhibit the effect of the emotional connotation of the prime, or that the emotion (pleasant or angry) traveled very fast to the cortex and influenced the categorization of test-face stimuli. Patients with a higher HAM-D score, indicating depression, had a higher tendency towards categorizing the test-face images as neutral. PSZ subjects with higher YMRS scores, indicative of mania, tended to correctly classify angry face expressions when the primes were positive or neutral, but not when the primes portrayed aggression. If manic state involves a more acute sensitivity to negative images or situations, it is plausible that the subliminally presented negative primes could have blocked response to the angry-face category.
There are a few methodological limitations in this study, which we have corrected in the follow-up longitudinal study that we recently started that will include a larger number of subjects. In the new, already ongoing study, we compare performance of patients with acute symptoms before starting medication and after they have been hospitalized for 3 weeks and medicated for their symptoms. For all the patients a follow up will be scheduled at 2 months after discharge from the hospital. Given that some of these patients will be lost to follow up, we will have a large sample size in order to have sufficient power to obtain meaningful repeated measures. In this study, we have not specifically assessed cognitive and perceptual abilities of the schizophrenic patients, using classical neuropsychological tests [32], including the Benton test for measuring face recognition ability [33]. In the new study, will compare direct (accuracy) and indirect (response time) measures of stimuli perception [34] in measuring the effect of the subliminal primes in the PSZ and HCS. Our experimental design permits us to investigate additional attributes of the prime images: the presence of a face, portraying emotions, and whether the vantage point of the prime image is towards the viewer (egocentric) or away (allocentric).
Conclusions
We believe that a detailed, larger-scale study along these lines will contribute significantly to defining the behavioral/emotional signature of schizophrenia. Furthermore, we will be able to determine whether programmatic administration of medication to schizophrenic patients [35] will lead to an amelioration of their ability to perceive and categorize facial emotions; this, in turn, will lead to an improvement of their social skills.
Footnotes
Source of support: This work was supported, in part, by the Brain and Vision research fund to LMV
References
- 1.Walker E, McGuire M, Bettes B. Recognition and identification of facial stimuli by schizophrenics and patients with affective disorders. Br J Clin Psychol. 1984;23(1):37–44. doi: 10.1111/j.2044-8260.1984.tb00624.x. [DOI] [PubMed] [Google Scholar]
- 2.Feinberg TE, Rifkin A, Schaffer C, Walker E. FAcial discrimination and emotional recognition in schizophrenia and affective disorders. Arch Gen Psychiatry. 1986;43(3):276–79. doi: 10.1001/archpsyc.1986.01800030094010. [DOI] [PubMed] [Google Scholar]
- 3.Mandal MK, Pandey R, Prasad AB. Facial expressions of emotions and schizophrenia: A review. Schizophr Bull. 1998l;24(3):399–412. doi: 10.1093/oxfordjournals.schbul.a033335. [DOI] [PubMed] [Google Scholar]
- 4.Zuroff DC, Colussy SA. Emotion recognition in schizophrenic and depressed inpatients. J Clin Psychol. 1986;42(3):411–17. doi: 10.1002/1097-4679(198605)42:3<411::aid-jclp2270420302>3.0.co;2-t. [DOI] [PubMed] [Google Scholar]
- 5.Borod JC, Martin CC, Alpert M, et al. Perception of Facial Emotion in Schizophrenic and Right Brain-Damaged Patients. J Nerv Ment Dis. 1993;181(8):494–502. doi: 10.1097/00005053-199308000-00004. [DOI] [PubMed] [Google Scholar]
- 6.Heimberg C, Gur RE, Erwin RJ, et al. Facial emotion discrimination: III. Behavioral findings in schizophrenia. Psychiatry Res. 1992;42(3):253–65. doi: 10.1016/0165-1781(92)90117-l. [DOI] [PubMed] [Google Scholar]
- 7.Hooker C, Park S. Emotion processing and its relationship to social functioning in schizophrenia patients. Psychiatry Res. 2002;112(1):41–50. doi: 10.1016/s0165-1781(02)00177-4. [DOI] [PubMed] [Google Scholar]
- 8.Murphy ST, Zajonc RB. Affect, cognition, and awareness: Affective priming with optimal and suboptimal stimulus exposures. J Pers Soc Psychol. 1993;64(5):723–39. doi: 10.1037//0022-3514.64.5.723. [DOI] [PubMed] [Google Scholar]
- 9.Fazio RH. On the automatic activation of associated evaluations: An overview. Cognition and Emotion. 2001;15(2):115–41. [Google Scholar]
- 10.Gibbons H. Evaluative priming from subliminal emotional words: Insights from event-related potentials and individual differences related to anxiety. Conscious Cogn. 2009;18(2):383–400. doi: 10.1016/j.concog.2009.02.007. [DOI] [PubMed] [Google Scholar]
- 11.Greenwald AG, Klinger MR, Liu TJ. Unconscious processing of dichoptically masked words. Mem Cognit. 1989;17(1):35–47. doi: 10.3758/bf03199555. [DOI] [PubMed] [Google Scholar]
- 12.McCauley C, Parmelee CM, Sperber RD, Carr TH. Early extraction of meaning from pictures and its relation to conscious identification. J Exp Psychol Hum Percept Perform. 1980;6(2):265–76. doi: 10.1037//0096-1523.6.2.265. [DOI] [PubMed] [Google Scholar]
- 13.Dagenbach D, Carr TH, Wilhelmsen A. Task-induced strategies and near-threshold priming: Conscious influences on unconscious perception. Journal of Memory and Language. 1989;28(4):412–43. [Google Scholar]
- 14.Callaway E, Naghdi S. An information processing model for schizophrenia. Arch Gen Psychiatry. 1982;39(3):339–47. doi: 10.1001/archpsyc.1982.04290030069012. [DOI] [PubMed] [Google Scholar]
- 15.Oldfield RC. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 1971;9:97–113. doi: 10.1016/0028-3932(71)90067-4. [DOI] [PubMed] [Google Scholar]
- 16.American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC: American Psychiatric Association; 2013. [Google Scholar]
- 17.Kay SR, Flszbein A, Opfer LA. The Positive and Negative Syndrome Scale (PANSS) for Schizophrenia. Schizophr Bull. 1987;13(2):261–76. doi: 10.1093/schbul/13.2.261. [DOI] [PubMed] [Google Scholar]
- 18.Young RC, Biggs JT, Ziegler VE, Meyer DA. A rating scale for mania: reliability, validity and sensitivity. Br J Psychiatry. 1978;133(5):429–35. doi: 10.1192/bjp.133.5.429. [DOI] [PubMed] [Google Scholar]
- 19.Hamilton M. A Rating Scale for Depression. J Neurol Neurosurg Psychiatry. 1960;23(1):56–62. doi: 10.1136/jnnp.23.1.56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Hamilton M. The Assessment of Anxiety States By Rating. Br J Med Psychol. 1959;32(1):50–55. doi: 10.1111/j.2044-8341.1959.tb00467.x. [DOI] [PubMed] [Google Scholar]
- 21.Brainard DH. The Psychophysics Toolbox. Spat Vis. 1997;10(4):433–36. [PubMed] [Google Scholar]
- 22.Pelli DG. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis. 1997;10(4):437–42. [PubMed] [Google Scholar]
- 23.Kleiner M, et al. What’s new in Psychtoolbox-3. Perception. 2007;36(14):11–16. [Google Scholar]
- 24.Lang PJ, Bradley MM, Cuthbert BN. International affective picture system (IAPS): Affective ratings of pictures and instruction manual 2005. NIMH, Center for the Study of Emotion & Attention; [Google Scholar]
- 25.Willenbockel V, Sadr J, Fiset D, et al. Controlling low-level image properties: The SHINE toolbox. Behav Res Methods. 2010;42(3):671–84. doi: 10.3758/BRM.42.3.671. [DOI] [PubMed] [Google Scholar]
- 26.Lundqvist D, Flykt A, Öhman A. The Karolinska Directed Emotional Faces (KDEF) Department of Neurosciences Karolinska Hospital; Stockholm, Sweden: 1998. [Google Scholar]
- 27.Morrison RL, Bellack AS, Mueser KT. Deficits in Facial-Affect Recognition and Schizophrenia. Schizophr Bull. 1988;14(1):67–83. doi: 10.1093/schbul/14.1.67. [DOI] [PubMed] [Google Scholar]
- 28.Wölwer W, Streit M, Polzer U, Gaebel W. Facial affect recognition in the course of schizophrenia. Eur Arch Psychiatry Clin Neurosci. 1996;246(3):165–70. doi: 10.1007/BF02189118. [DOI] [PubMed] [Google Scholar]
- 29.Kohler CG, Walker JB, Martin EA, et al. Facial Emotion Perception in Schizophrenia: A Meta-analytic Review. Schizophr Bull. 2010;36(5):1009–19. doi: 10.1093/schbul/sbn192. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Höschel K, Irle E. Emotional Priming of Facial Affect Identification in Schizophrenia. Schizophr Bull. 2001;27(2):317–27. doi: 10.1093/oxfordjournals.schbul.a006877. [DOI] [PubMed] [Google Scholar]
- 31.Ekman P, Friesen WV. Unmasking the face: A guide to recognizing emotions from facial cues. Englewood Cliffs, NJ: Prentice Hall; 1975. [Google Scholar]
- 32.Pachalska M, Grochmal-Bach B, MacQueen BD, et al. Neuropsychological diagnosis and treatment after closed-head injury in a patient with a psychiatric history of schizophrenia. Med Sci Monit. 2008;14(8):CS76–85. [PubMed] [Google Scholar]
- 33.Benton AL, Van Allen MW. Impairment in facial recognition in patients with cerebral disease. Trans Am Neurol Assoc. 1968;93:38–42. [PubMed] [Google Scholar]
- 34.Reingold EM, Merikle PM. Using direct and indirect measures to study perception without awareness. Percept Psychophys. 1988;44(6):563–75. doi: 10.3758/bf03207490. [DOI] [PubMed] [Google Scholar]
- 35.Kucharska-Pietura K, Tylec A, Czernikiewicz A, Mortimer A. Attentional and emotional functioning in schizophrenia patients treated with conventional and atypical antipsychotic drugs. Med Sci Monit. 2012;18(1):CR44–49. doi: 10.12659/MSM.882202. [DOI] [PMC free article] [PubMed] [Google Scholar]






