The influence of neuroticism and psychological symptoms on the assessment of images in three-dimensional emotion space

Abstract

Objective: The present study investigated the influence of neuroticism (NEO Five-Factor Inventory (NEO-FFI)) and psychological symptoms (Brief Symptom Inventory (BSI)) on pleasure, arousal, and dominance (PAD) ratings of the International Affective Picture System (IAPS).

Methods: The subjects (N=131) were presented with images from the IAPS (30 images) and new images (30 images). The influence of neuroticism and BSI (median split: high vs. low) on the assessment of pleasure, arousal and dominance of the images was examined. Correlations of pleasure, arousal and dominance were presented in a 3-D video animation.

Results: Subjects with high scores (compared to subjects with low scores by median split) of neuroticism and psychological symptoms of the BSI rated the presented emotional images more negative in the valence dimension (pleasure), higher in arousal and less dominant.

Conclusion: Neuroticism and psychological symptoms influence the subjective emotional evaluation of emotional images. Therefore the location in the three-dimensional emotion space depends on individual differences. Such differences must be kept in mind, if correlations between emotion ratings and other variables like psychobiological measures are analyzed.

Introduction

This study analysis the influence of neuroticism and psychological symptoms on the subjective assessment of emotional images. Emotional stimuli are selected from the International Affective Picture System (IAPS, [1]). The IAPS is among the most commonly used methods of experimental emotional psychology and psychobiology. This comprehensive set of images (956 images) was developed to visually induce emotions in a standardized and controlled fashion. It has been used, for example, in EEG and fMRI studies [2], [3], [4], [5], [6], [7], [8]. In addition studies with clinical samples used IAPS images for emotional stimulation [9], [10], [11].

Bradley and Lang [8] state that the IAPS images were selected from a broad spectrum of semantic categories (e.g. buildings, landscapes, animals, waterfalls, etc.). Each image was rated by 100 subjects [1] with respect to the three dimensions of pleasure (positive vs. negative), arousal (excited vs. relaxed) and dominance (being controlled vs. being in control). Although the IAPS studies are based on the paradigm of three-dimensional emotion space (originally published by Osgood et al. [12]) quite frequently only the two variables of pleasure and arousal are included in empirical studies. Even the IAPS manuals contain neither a graphical representation of the variable of dominance nor a true three-dimensional illustration [1].

The original IAPS does not capture the entire three-dimensional space. Bradley and Lang [8] represent an U-shaped distribution (between valence and arousal). Drawing on arguments advanced by Tellegen [13], Bradley and Lang consider this U-shaped distribution a consequence of evolutionary development, in as much as negative emotions of high intensity (activating the defensive system) and positive emotions of high intensity (activating the appetitive system) are important for survival. In this respect, Bradley and Lang consider this U-shaped distribution as biologically determined. Nonetheless, to minimize the gaps in the emotion space, we have selected in addition to IAPS stimuli new stock free images from public domains resources for the present study.

Additionally, Libkumann [14] noted that the IAPS images are lower rated in the arousal dimension in contemporary studies compared to the original ratings leading to additional gaps beyond an arousal mean >7.5). It must be kept in mind that the typical gaps of the PAD ratings – particularly the area of arousal 7.5 to 9 – possibly result from the averaging procedure which neglects the original variance within the samples. To our knowledge only few studies measured ratings (PAD) of the experimentally used IAPS stimuli in samples with variance above healthy subjects. E.g. Duley et al. [15] presented subjects with the IAPS and analyzed the PAD-ratings in and than correlated the scale for “fear of failure” with PAD. This resulted in significant positive correlations with respect to an increased fear of failure and neuroticism for arousal when presented with negative images.

Research question

This study measured the variables of neuroticism (from the NEO-FFI; [16]) and the psychological symptoms from the Brief Symptom Inventory (BSI; [17]) in healthy subjects and examined their influence on IAPS ratings of valence (pleasure), arousal and dominance. Neuroticism represents a personality dimension and BSI measures the extend of psychopathology, both constructs which may influence the processing of emotional stimuli:

At “high” (median split) degrees of neuroticism and psychological symptoms, more negative pleasure is rated than in case of “low” degrees.

At “high” (median split) degrees of neuroticism and psychological symptoms, more arousal is rated than in case of “low” degrees.

At “high” (median split) degrees of neuroticism and psychological symptoms, less dominance is rated than in case of “low” degrees.

It will be explored, in what sector (Category 1: “negative pleasure/low arousal/high dominance”, Category 2: “neutral pleasure/low arousal/high dominance”, Category 3: “positive pleasure/low arousal/high dominance”, Category 4: “positive pleasure/high arousal/high dominance”, Category 5: “neutral pleasure/high arousal/neutral dominance”, and Category 6: “negative pleasure/high arousal/low dominance) of the PAD space these hypotheses are confirmed. (More about defininition of PAD space sectors in the methods.)

Methods

Subjects

N=141 students participated in the experiment. The subjects signed a consent form for voluntary participation in the study according to the guidelines of the Ethics Committee of Ulm University (245/08-UBB/se). The subjects were between 18 and 40 years old (M=21.6 years; SD=3.3 years); 81 were female (57.0%). Ten people were excluded from the sample because of incomplete questionnaires, leaving a total of N=131 subjects.

Images

Thirty stimuli were selected from the IAPS according to Lang et al. [1], which best matched the “traditional” three areas with regard to rating levels: “positive pleasure/high arousal/high dominance” (n=10; images: 8470, 5470, 5621, 8030, 8080, 8180, 8186, 8370, 8400, 8490), “negative pleasure/high arousal/low dominance” (n=10; images: 6150, 7006, 7009, 7010, 7025, 7035, 7110, 7150, 7161, 7175) and “neutral pleasure/low arousal/high dominance” (n=10; images: 1525, 2730, 3000, 3053, 3120, 3170, 3500, 6300, 9250, 9921).

Thirty images were systematically selected from image databases of the German Press Agency on the basis of the theoretical conceptualizations of the PAD (pleasure, arousal, dominance) dimensions: “positive pleasure/low arousal/high dominance” (n=10), “negative pleasure/low arousal/high dominance” (n=10) and “neutral pleasure/high arousal/neutral dominance” (n=10). According to the descriptions of the dimensions, the images should have the following properties: The dimension of “positive pleasure/low arousal/high dominance” should reflect themes such as harmony, relaxation, peace, quiet, etc. The images should be richly colored. People and animals should be depicted in a relaxed or sleeping state. A typical example would be a couple in white bathrobes, lying head-to-head, smiling with closed eyes. The dimension of “negative pleasure/low arousal/high dominance” should express depression, sadness, passivity, etc. The images should be weakly colored (e.g. winter landscapes). People and animals should be in a rigid state. A typical image would be a gravestone in a winter landscape. The category “neutral pleasure/high arousal/neutral dominance” should include the following aspects: risk, energy, excitement, etc. The mentioned aspects should still be under control, however. The images should be very strongly colored and depict people, animals and other objects in motion. A typical image would be a man on a cliff.

Instructions

The subjects received the German language instructions, which were based on the original instructions by Lang et al. [1], in the form of a PowerPoint presentation. In addition to explanations regarding the procedure, the instructions particularly focused on the three dimensions to be rated, namely pleasure, arousal and dominance, and the Self-Assessment Manikin (SAM; see below) rating method. The authors will gladly make the exact instruction text available upon request.

Procedure

The experiment was conducted with the help of specially developed software. A total of 60 stimulus pictures were presented in random order for a duration of 6 s each. After the presentation of each picture, the image was rated with regard to the degrees of pleasure, arousal and dominance on the basis of the SAM [18] using a scale of 1–9. The rating scale was divided as follows: for pleasure, “1” absolutely negative, “5” neutral, and “9” absolutely positive; for arousal, “1” absolutely relaxed, “5” medium arousal, and “9” highly aroused; for dominance, “1” absolute loss of emotional control, “5” medium emotional control, and “9” absolute control. After completion of the last rating, a fixation cross appeared for 2 seconds, followed by the next image.

The stimuli were presented separately for each participant on a 19" TFT monitor at a resolution of 1024×768 pixels and a color depth of 32 bit. The distance between participant and screen was approximately 60 centimeters. The visual angle between participant and monitor was approximately 24°. The experiment was conducted in a laboratory where light levels were kept constant. One half of the subject group was asked to complete the NEO-FFI and BSI questionnaires before the experiment, and the other half after the experiment.

Questionnaires

NEO-FFI: The NEO-FFI [13] is a factor-analytic questionnaire that captures individual characteristics in the areas of neuroticism, extraversion, openness to experience, agreeableness, and conscientiousness. Of the 60 questions in the inventory, twelve questions each are related to the following five key areas: Subjects with high neuroticism values tend to be nervous, anxious, sad, insecure, self-conscious and worry about their health. They tend to have unrealistic ideas and are less able to control their needs and respond appropriately to stressful situations. The term neuroticism in this context should not be equated with the homonymous psychiatric category.

BSI: The BSI [14], a short form of the Symptom Check List (SCL-90-R), is an instrument for assessing subjective impairment due to physical and psychological symptoms. The 53 items, which are summarized into 9 scales and three global parameters – analogous to the SCL-90-R – (somatization, obsession-compulsion, interpersonal sensitivity, depression, anxiety, hostility, phobic anxiety, paranoid ideation, psychoticism, and global severity index), enable statements about the severity of symptoms. The items are formulated in simple language and avoid psychopathological terminology, if they have not yet found their way into the vernacular.

Statistics and graphical representation

Median splits were calculated for neuroticism and symptom expression. It is possibly to distinguish between a group with high vs. low neuroticism and symptom expression. T tests were calculated for the influences of high vs. low symptom expression on pleasure, arousal, and dominance ratings. The test was one-sided; the significance level was α=0.05 (α=0.1 was interpreted as a trend, α=0.01 as highly significant, and α=0.001 as extremely significant). Additionally, effect sizes were determined for total calculation independent of the specific PAD categories (1–6). For this, 30 IAPS image topics were differentiated that according to Lang et al. fill ideal-typical PAD spaces. The new images were examined regarding the question of whether the ratings of the images had represented the corresponding subspaces. The following categories were distinguished: Category 1: “negative pleasure/low arousal/high dominance”, Category 2: “neutral pleasure/low arousal/high dominance”, Category 3: “positive pleasure/low arousal/high dominance”, Category 4: “positive pleasure/high arousal/high dominance”, Category 5: “neutral pleasure/high arousal/neutral dominance”, and Category 6: “negative pleasure/high arousal/low dominance.”

Due to the technical possibilities available at an online journal we depicted, for the first time, the empirical rating data of the manual by Lang [1] in 3D (Video 1 ), to illustrate to the reader the configuration of the PAD space. Furthermore, the average of Category 6: “negative pleasure/high arousal/low dominance” for the variable of neuroticism was individually represented in 3D (Video 2 ). The average ratings of the IAPS and the new images (Video 3 ) were also rendered in 3D.

Results

Correlations between neuroticism, psychological symptoms and PAD ratings

The following correlations can be found for neuroticism and BSI: somatization (r=0.21, p<0.05), obsession-compulsion (r=0.41, p<0.001), interpersonal sensitivity (r=0.56, p<0.001), depression (r=0.65, p<0.001), anxiety (r=0.30, p<0.001), hostility (r=0.41, p=0.001), phobic anxiety (r=0.31, p=0.001), paranoid ideation (r=0.31, p<0.001), psychoticism (r=0.43, p<.001) and Global Severity Index (r=0.52, p<0.001).

The comparison for neuroticism high (Nh>2.67, median split) vs neuroticism low (Nl≤2.67, median split) is significant for pleasure (d=–0.38) and arousal (d=0.40) and not significant for dominance (d=–0.14) (see Table 1 (Tab. 1)). Effects were also observed for the categories “positive pleasure/low arousal/high dominance” and “negative pleasure/high arousal/low dominance”. The remaining categories show no significant differences.

Table 1. Influence of neuroticism (high vs. low, median split = 2.67) on pleasure (V), arousal- (A), dominance (D) ratings by categories (T test, one-sided, scale: 1–9, N=131, M = means and SD = standard deviation).

Table 2 (Tab. 2) shows the results of the BSI for pleasure, arousal, and dominance. Significant effects were found for arousal (d=0.36) and dominance (d=–0.32) for the variable of depression, and significant effects in all three dimensions for the variable of anxiety. In addition, effects were found for obsession-compulsion, phobic fear, paranoid ideation, psychoticism and the Global Severity Index. Table 3 (Tab. 3) shows the results differentiated for each category. There were mostly effects for images in the category “negative pleasure/low arousal/high dominance.”

Table 2. Influence of the Brief Symptom Inventory (high vs. low) on pleasure (V), arousal (A), dominance (D) ratings by categories (T test, one-sided, scale: 1–9, N=131, M = mean and SD = standard deviation).

Table 3. Influence of the Brief Symptom Inventory (detailed, high vs. low) on pleasure (V), arousal (A), dominance (D) ratings by categories (T test, one-sided, scale: 1–9, N=131, M = mean and SD = standard deviation).

3D representation of the emotion space and correlations between PAD ratings

Video 1 shows the distribution of the original IAPS images in three-dimensional space. This representation can be rotated around a visual axis with VLC-Mediaplayer^© or similar software. In the seconds from approx. 0–16, 26–35, and 46–59 one can see the correlation between pleasure and arousal, from approx. 17–25 and 36–45 the correlation between pleasure and dominance, and from approx. 1:06–1:17 min the correlation between arousal and dominance.

In Video 2 , the emotion space “negative pleasure/high arousal/low dominance” for low (green) vs. high neuroticism (red) is individually depicted for all subjects. It shows descriptively that subjects with high neuroticism values in the PAD space tended to rate pleasure more negative and arousal higher while viewing the images.

As mentioned in Lang et al. [1], the following gaps are revealed for the relationship between pleasure and arousal: negative pleasure/low arousal, positive pleasure/low arousal and neutral pleasure/high arousal (correlation pleasure/arousal: pleasure ≤ 5: r=–0.67; pleasure >5: r=0.38). The relationship between pleasure and dominance is graphically a linear relationship, with two large gaps: positive pleasure/low dominance and negative pleasure/high dominance (correlation: pleasure/dominance: r=.80). The relationship between arousal and dominance (correlation: arousal/dominance: pleasure ≤5: r=–0.85; pleasure >5: r=–0.34) shows gaps for low arousal/low dominance and high arousal/high dominance.

Comparison between IAPS and the Ulm images

The average values of the Ulm image rating (Table 4 (Tab. 4)) and the Lang sample [1] were represented in an animation in three-dimensional emotion space independent of the psychological symptoms (Video 3 ) (scale: IAPS rating Lang [gray]; IAPS rating Ulm [N=30, red]; new image material: negative pleasure/low arousal/high dominance [N=10, blue]; new image material: positive pleasure/low arousal/high dominance [N=10, green]; new image material: neutral pleasure/high arousal/neutral dominance [N=10, pink]). It shows descriptively that the new images will help to fill existing PAD gaps.

Table 4. Ratings of new images (30 images; N=131) for pleasure, arousal, dominance.

The following correlative relationships result between arousal and negative pleasure (pleasure 1–5: r=–.73, p<.001) and between arousal and positive pleasure (pleasure 5–9: r=.13, ns.) for pleasure and dominance (r=.62, p<.001) and for arousal and dominance (r=–.89, p<.001). Furthermore, correlations between the two ratings (Lang vs. Ulm) were determined for the 30 IAPS images (pleasure: r=.94, p<.001; arousal: r=.96, p<.001; dominance: r=.92, p<.001).

Discussion

Correlations between neuroticism, psychological symptoms and PAD image ratings

The present study showed that the variables of neuroticism and psychological symptoms tend to influence the PAD configuration.

It was demonstrated statistically that significant differences (median split) between the groups of the variables of neuroticism high vs. neuroticism low exist for all variables of the PAD space, particularly for Category 6: “negative pleasure/high arousal/low dominance.” This category therefore has the most continuous significant effects concerning the comparison of the degree of neuroticism (high vs. low) in the PAD space (for all three variables). In this respect, the emotional configuration arising from highly excitable negative stimuli and high neuroticism values is found in the “extreme areas” of pleasure/arousal/dominance.

The variable of neuroticism is a measure of the NEO-FFI [16] for the expression of emotional stability and instability, not a clinical measure. It is therefore important how the comparison of symptom expression for the BSI variables – which is a clinical inventory – is represented with regard to the PAD space. The clearest effects occur for anxiety, depression, phobic anxiety, psychoticism and Global Severity Index in Category 1 with the new stimuli for “negative pleasure/low arousal/high dominance. ”This illustrates that the paradigm of neuroticism-NEO-FFI vs. BSI exhibits another PAD rating configuration (in the 6 categories). The correlations between neuroticism and BSI variables indeed show significant relationships, but the expression of the correlation is in the mid to low range.

We interpret the significant results of the images in Category 1: “negative pleasure/low arousal/high dominance,” particularly in “everyday unpleasant” situations (fear of social decline, death, and loneliness) we expect differences in the PAD configuration, as expressed by the images. However, for anxiety and phobic anxiety, in such a way that it is possible that people with severe symptoms do not differ from people with mild symptoms in extreme conditions (wars and other forms of violence).

All significant effects for the variables of arousal and dominance follow the expected direction of the hypotheses. However, we found a higher positive pleasure rating for severe symptom depression in the category “positive pleasure/low arousal/high dominance” (with new images) – which does not support the hypotheses. This could indicate that depressed persons have a strong need for harmony. This trend can also be seen for other symptoms, although the effects are not significant. The different categories and symptom areas show that it is also possible that individuals with severe symptoms exhibit a significant difference in dominance (control vs. loss of control), while there are no effects for pleasure and arousal. This indicates that emotions may not be perceived more strongly in case of severe symptoms, but that they are harder to control. As expected, there are only few effects for obsession-compulsion, since this disorder is based on obsessive behavior or thinking rather than on a loss of emotion control.

Overall, the results of the present study can provide information regarding the PAD configuration with respect to the personality variable of neuroticism and in particular for the specific clinical symptom severity (of the BSI).

Video 2 illustrates that a variety of emotional profiles can be individually represented in the category “negative pleasure/high arousal/low dominance” with respect to the variable of neuroticism. This fills an area of the space that would constitute a gap in typical cases where the IAPS ratings [1] are averaged across the entire sample. This invalidates Libkuman’s statement that the area of arousal >7.5 does not exist in the rating of images per se [14].

Limitations

Regarding the limitations of the results it is worth mentioning that the sample was composed solely of medical students from Ulm University. The generalization potential of the results is therefore limited. On the other hand, stronger effects could be expected for clinical samples due to an increase in variance.

It turns out that despite significant differences, the size of the effects are small. No correction for overall type I error was applied.

3D representation of the emotion space

The 3D representation makes an important contribution towards improving the illustration of the PAD rating configuration. In addition, we recommend actually capturing and representing dominance (in print journals: pleasure[y-axis]/dominance[x-axis], arousal[y-axis]/dominance[x-axis]) in future studies (especially in clinical ones).

Comparison between original IAPS and the new Ulm stimuli

The graphical representation of the pleasure, arousal, and dominance rating without consideration of the symptoms shows that the sparsely populated area of “positive pleasure/low arousal/high dominance” can bet better filled by means of a top-down approach. This applies only partially to the gap of “negative pleasure/low arousal/high dominance” and only to one image in the category of “neutral pleasure/high arousal/neutral dominance.” Practically this means that additional stimuli can be made available to future studies which intend to induce emotions with the help of images.

A significant correlation was found between pleasure and arousal for negative pleasure (<5) – similar to that observed by Bradley and Lang [8]. This is consistent with Bradley’s and Lang’s evolutionary approach. There are no significant correlations for positive pleasure (>5). In this respect, the present study can only give limited proof of the dependence on arousal in the pleasure space >5. The result appears plausible, since positive emotions, such as relaxation (e.g., vacation, spa treatments, yoga, autogenous training, Tai Chi) were presumably of little evolutionary importance compared to negative emotions (e.g. flight). It is noteworthy that the set of Lang et al. [1] does not contain images relating to relaxation. The reason for this could be that the authors [1] gave less attention to these areas of the emotion space because of their evolutionary presuppositions.

Although only a limited number of stimuli exist for the emotion space of “negative pleasure/low arousal/high dominance” (e.g. grief, hopelessness, resignation), it shows that even the sparsely populated area (pleasure 3–4; arousal 3–4; dominance 5–6) can be filled by means of a top-down strategy.

Without fundamentally questioning the evolutionary explanation for the three gaps, this study succeeded in minimizing vacant PAD areas of the emotion space by means of emotional stimuli. These stimuli can be used in future studies that examine emotional responses induced by visual emotion stimuli with low intensity.

Notes

Acknowledgement

This research was part of the SFB/Transregio 62 – Companion Technology for Cognitive Systems project – funded by the German Research Foundation. An earlier version of the paper was translated by Claudia Nitzschmenn. We thank two anonymous reviewers for their critical, but constructive comments. We grateful acknowledge the very helpful editorial work of Jörn von Wietersheim.

Competing interests

The authors declare that they have no competing interests.