Abstract
Emotions and temperature are closely related through embodied processes, and people seem to associate temperature concepts with emotions. While this relationship is often evidenced by everyday language (e.g., cold and warm feelings), what remains missing to date is a systematic study that holistically analyzes how and why people associate specific temperatures with emotions. The present research aimed to investigate the associations between temperature concepts and emotion adjectives on both explicit and implicit levels. In Experiment 1, we evaluated explicit associations between twelve pairs of emotion adjectives derived from the circumplex model of affect, and five different temperature concepts ranging from 0°C to 40°C, based on responses from 403 native speakers of four different languages (English, Spanish, Japanese, Chinese). The results of Experiment 1 revealed that, across languages, the temperatures were associated with different regions of the circumplex model. The 0°C and 10°C were associated with negative-valanced, low-arousal emotions, while 20°C was associated with positive-valanced, low-to-medium-arousal emotions. Moreover, 30°C was associated with positive-valanced, high-arousal emotions; and 40°C was associated with high-arousal and either positive- or negative-valanced emotions. In Experiment 2 (N = 102), we explored whether these temperature-emotion associations were also present at the implicit level, by conducting Implicit Association Tests (IATs) with temperature words (cold and hot) and opposing pairs of emotional adjectives for each dimension of valence (Unhappy/Dissatisfied vs. Happy/Satisfied) and arousal (Passive/Quiet vs. Active/Alert) on native English speakers. The results of Experiment 2 revealed that participants held implicit associations between the word hot and positive-valanced and high-arousal emotions. Additionally, the word cold was associated with negative-valanced and low-arousal emotions. These findings provide evidence for the existence of temperature-emotion associations at both explicit and implicit levels across languages.
Introduction
People tend to associate emotions with feelings of warmth and coldness as evidenced by colloquial language [1–4]. For example, expressions such as ‘warm love’, ‘chilled with fear’, and ‘heartwarming’ are commonly used in everyday English language. Such types of expressions are also found in other languages. For instance, the phrase ‘abrazo cálido’, which translates to ‘warm hug’ is commonly used in the Spanish language. The phrase ‘温かい心’, which means ‘warm heart’ is commonly used in the Japanese language. Waggoner [5] found that both children and adults describe love and anger with high temperatures, but they associate fear with low temperatures. Furthermore, the concept of emotional temperature is widely used in business and advertising [6]. Aaker et al. [7] defined emotional warmth as a “positive, mild, volatile emotion involving physiological arousal and precipitated by experiencing directly or vicariously a love, family, or friendship relationship” (p. 377). Warmer temperatures, object-based or environmental, can increase feelings of emotional attachment towards friends and family [8].
Previous research has investigated effects of ambient temperature on emotions and behaviors, which highlights the importance of studying the relationship between temperature and emotions. Different studies have found that extreme hot temperatures can negatively affect emotions and wellbeing. For instance, using data from the USA during the period 2008–2013, Noelke et al. [9] found that, compared to average daily temperatures of 10–16°C, temperatures above 21°C—especially above 32°C—significantly reduce positive emotions and increase negative ones. Examining data from 55 countries, Van de Vliert et al. [10] found that people in low-income countries are less happy than the average of the 55 nations when temperatures deviate upwards or downwards from 24°C. On the other hand, people in high-income countries are happier when temperatures deviate upwards or downwards from 23°C. Keller et al. [11] found that higher temperatures improve mood and memory during the spring because of the preceding lower temperatures during the winter, but during the summer, higher temperatures negatively affect mood. However, Parker and Tavassoli [12] suggested that people in hot climates, compared to cold ones, present higher affective expressiveness, as well as higher sensitivity to emotional stimulation, both positive and negative.
In terms of behavior, there seems to be a relationship between extreme high temperatures and aggression. Through a series of five experiments, Anderson et al. [13] found that people hold general beliefs that hot temperatures, relative to warmth comfortable ones, increase feelings of anger and hostility, as well as aggressive and violence behaviors. Moreover, they found that temperatures deviating upwards and downwards from 24°C, increase aggressive behaviors. These results are echoed by Younan et al.’s [14] findings that long-term exposure to high ambient temperatures is associated with aggressive behaviors in children and adolescents in urban areas. Similarly, using data from South Wales, Australia, Stevens et al. [15] found a similar effect of high temperatures on assaults. However, the authors found that high temperatures were associated with a decrease in anger expressed in social media, as measured by counts of angry tweets. The authors suggested that these opposing patterns may occur because higher temperatures promote behaviors that foster assaults (e.g., more time spent outside, social interactions, higher alcohol consumption) that at the same time decrease opportunity, motivation, or ability to be active in social media. Furthermore, related to behaviors, Lee and Sohn [16] analyzed hourly weather data in New York City and yellow taxicab data in 2013 and found a significant positive relationship between extreme cold and hot outdoor temperatures and increased tipping. The authors suggested that this behavior was mediated by mood, as the comfortable indoor temperatures provided by the taxi drivers improved mood and therefore empathy and gratitude, and ultimately generosity, as measured by the tipping amounts.
Regarding product valuation, Zwebner et al. [17] found that exposure to physical and ambient warmth (in the form of thermoclimate, room temperature, and direct contact with a therapeutic pad) can increase product valuation and willingness to pay. The authors found that these effects were mediated by the positive affective reactions that physical warmth induced [17]. However, Motoki et al. [18] failed to replicate this study.
The associations between emotions and temperature also work inversely, so that emotional states affect temperature assessments. Wang and Liu [19] found that emotional states can influence thermal comfort and thermal sensation during light physical activities. In their study, the authors found that participants’ thermal comfort in light activities (i.e., sitting and standing) was lower under the induced boring emotion condition compared to the joyful and the neutral ones. In other words, participants felt warmer under the boring emotion state.
Related to the present study, Bergman et al. [20] studied implicit semantic associations between temperature and emotional valence, as well as implicit associations between the experience of physical temperature and emotional valence using two separate Implicit Association Tests (IATs). The authors found that thermal words related to high temperatures, as well as physical warmth, were associated to positively valanced words. Thermal words related to low temperatures, as well as physical coldness, were related to negatively valanced words.
Despite the documented relationship between temperature and emotions, systematic research on the association between different emotions and physical temperatures (and temperature concepts) is scarce. The present article contributes to the literature on emotions and to the understanding of associations of abstract concepts with concrete experiences by adopting a comprehensive approach in terms of the nature of these associations (explicit and implicit), coverage of emotion adjectives (and their underlying dimensions) and consistency across languages. We aimed to uncover explicit and implicit associations between different temperature concepts and emotion adjectives, and across four different languages, to maximize the generalizability of our results. To this end, we conducted two experiments. In Experiment 1, we used a questionnaire-based design to evaluate people’s explicit associations of twelve pairs of emotion words with five different visual temperature scales going from cold (0°C) to hot (40°C) in 10-degree intervals. We conducted Experiment 1 with native speakers of four languages (i.e., English, Spanish, Japanese, Chinese) and explored the consistency in the associations across the languages. In Experiment 2, we conducted Implicit Association Tests (IATs) with two temperature words (cold and hot) and opposing pairs of emotion adjectives in terms of valence and arousal. The study of associations between temperature and emotions is of great relevance for both the academic and practitioner-oriented literatures due to the documented effect of temperature on emotional states, decision-making, and consumer behavior. Beyond theoretical contributions to the literature on embodied cognition and learning from statistical regularities in the environment, insights from the study of these associations can guide the development of working spaces, products, and marketing activities.
The origin of temperature-emotion associations
Metaphors are pervasive in people’s lives and are present in literature, as well as everyday language. In their early conceptual metaphor theory (CMT), Lakoff and Johnson [21] suggested that the human conceptual system plays an important role in defining reality, and that this conceptual system, is to a large extent metaphorical. Conceptual metaphors are a way of understanding—often abstract—realms of experiences in terms of another—typically concrete—domain. The authors suggested that metaphors unite reason and imagination, and are therefore critical in contributing to our understanding of the world (see also [22, 23]). Hence, metaphors shape the way people think and experience the world. Associations between temperature and emotions may be an illustration of conceptual metaphors in play where one domain is mapped to another one [22]. While people commonly use these temperature-emotion associations to make sense of the world, their origin is not completely understood. Nonetheless, the theory of constructed emotion provides a useful framework to explain these associations.
The theory of constructed emotion [24, 25] suggests that emotions are categorizations of past experiences molded by embodied knowledge. Emotions do not come from specific brain structures, rather the brain creates them as concepts by parsing situated sensory information, affect, and physiological changes. Based on previous knowledge and experiences, the brain makes predictions and develops situated conceptualizations [26] to identify incoming sensory inputs, find an explanation, and guide responses towards them. For instance, following this constructionist approach, the emotion concepts related to anger found in previous literature may arise from the parsing of the negative valence and high arousal caused by the repeated exposure of extreme temperatures into this emotion category. An important part of the theory of constructed emotion related to the present study is that new sensory information is encoded and unified whenever the brain predicts it will trigger physiological changes in the perceiver [25], and emotion concepts are triggered when the brain infers the meaning of these physiological processes [27, 28]. Hence, emotions are tightly linked to these processes that help in achieving homeostasis [5, 7]. As the theory of constructed emotion would suggest, individuals create emotion categories based on their experience, and these categories can be used to label sensations that occur together with different temperatures [25, 29]. In this way, the associations between temperature and emotions can be explained by the categorization of experiences that coincide and incorporate either bodily temperature feelings or externally perceived temperature, whether the latter relates to the temperature of a living being or an object in close proximity, or whether it relates to environmental temperature.
Bridging the theory of constructed emotion and homeostatic processes can help explain associations between emotions and temperature since both work together to help in maintaining the body’s optimal temperature. Emotions can serve as homeostatic responses through two mechanisms [30]. First, emotions can have a direct effect on the body’s physiological condition—including temperature changes, and homeostatic processes can bring the body back to thermal equilibrium. For example, being accompanied by a loved person can increase the heartrate and raise the internal body temperature. This often results in blushing, which serves as a thermoregulatory mechanism to cool down the body by drawing more blood to the cheeks, where heat exchange is more efficient [31–33]. In this way, the (increased) internal body temperature experienced would be associated with the situation, as well as its valence and arousal, that triggered the physiological process. The emotion-temperature association can also come from the perception of the warmth generated by the bodily heat of the other person and the core affect and feelings experienced during the encounter. Additionally, emotions can facilitate homeostatic balance by simulating bodily states through thoughts and memories. Bruno et al. [1] found that consumers’ perception of emotional stimuli depends on their homeostatic state. For instance, when consumers felt physically cold, they perceived emotionally warm stimuli (i.e., print advertisements that evoked emotions related to love and affection) more favorably than emotionally cold stimuli (i.e., print advertisements that evoked emotions related to disgust). On the other hand, when consumers felt physically hot, they perceived the emotionally cold stimuli more favorably than the emotionally warm ones. However, there were no differences in the evaluation of these stimuli when consumers were at their homeostatic optimum. The authors suggested that these effects occurred because the emotional stimuli brought people further away from their homeostatic optimum when the emotional temperature and the divergence from the optimum was in the same direction.
Language differences in temperature-emotion associations
It is possible that the associations between temperature and emotions are shaped by language. Previous research has uncovered variations in the subjective experience of emotions and their taxonomy brought by culture and language [34]. Language plays a critical role in cognition because it serves as a medium to ground abstract and general concepts, as well as their emotional connections, in the brain. In this way, emotions have meanings and are experienced differently based on the concepts with which they are associated [35]. Language influences how emotions are conceptualized and categorized across cultures, whether it is through the impact of language on the conceptualization of experiences or the effect of culture on the experience and linguistic representation of emotions [36, 37]. Relevant to the present study, cultural and linguistic differences in emotions may influence the associations between emotions and temperature.
Previous literature has shown differences of emotional and conceptual content across languages [35, 38–40]. Differences in temperature-emotion associations might occur because the underlying meanings and concepts associated to specific emotions can vary with language. There is evidence of significant variations in the associations of emotion concepts in twenty of the language families [27]. Therefore, people across different languages would be evaluating inherently different concepts. Nonetheless, some studies point to a large degree of similarity in the experience of emotions across cultures [41, 42]. Thus, to increase the generalizability of our study and explore the extent to which specific temperature-emotion associations hold beyond one language, we conducted Experiment 1 using four different languages (i.e., English, Spanish, Japanese, Chinese). Furthermore, we analyzed how consistent were the associations across the four languages. We focused on native speakers on these languages since a great part of emotional concepts and understanding is formed interdependently with language during childhood with interactions with caregivers and peers [43–45].
Another potential source of variation in the associations studied here relates to how people experience and evaluate different temperature conditions across cultures, and to how they impact emotions. While warm pleasant temperatures have been associated with positive mood in western countries [11, 46], the way people react to and the emotions that these temperatures elicit, or with which they are associated, may differ due to repeated exposure and the difference in ranges and fluctuations of temperature [47, 48]. An example of the influence of environmental factors on associations with emotions was described by Jonauskaite et al. [49] in a study across fifty-five countries. The authors found that associations between yellow and joyful emotions are stronger when temperatures are moderate, and rain is plentiful. Moreover, related to the role of culture and environmental attitudes, Knez and Thorsson [50] studied evaluations of a park with Japanese and Swedish participants. Japanese participants evaluated the park as warmer and more pleasant than the Swedish participants, despite both groups physically experiencing similar thermal conditions.
Hypotheses development
We built our hypotheses based on the theory of grounded cognition [51] and the model of core affect [52]. The theory of grounded cognition proposes that abstract concepts are grounded in concrete experiences [51, 53]. A critical aspect of this theory is based on the role of mental simulations on cognition [54], which suggests that the brain captures, merges, and stores different states across modalities—including perception and introspection—during an experience and later re-enacts this cohesive multimodal representation as needed. According to the model of core affect, the cognitive structure of human emotions can be conceptualized and represented by spanning the dimensions of valence and arousal in a circumplex model, which makes it possible to decompose emotions into varying levels of the two components [52, 55]; see also [56, 57].
In terms of valence, previous research points to a correlation between higher temperatures and positive emotions [1, 17, 18, 20, 58–61]. Nevertheless, the study of associations between emotions and temperature requires a nuanced approach since there are differences in temperature levels (i.e., mild vs. extreme) and how they are experienced (i.e., ambient vs. object-based) that may affect these associations. Some of these studies have used beverages (coffee and tea) as object-based thermal stimuli [59, 60] and have found that beverages at hotter temperatures (above 65°C) tend to be characterized with more positive emotions. Pramudya and Seo [59] found that when the beverages were at lower temperatures (as low as 5°C), they elicited more negative emotions.
However, research studying ambient temperature have found that hotter temperatures are associated with negative emotions and well-being. Using Facebook and Twitter data during the period between 2009 and 2016 to analyze the effect of temperature on emotions, Baylis et al., [62] found that expressions of positive emotions peaked at 20°C. Past 30°C, positive emotions decreased while negative emotions increased. Noelke et al. [9] found that temperatures above 32°C significantly reduced positive emotions and increased negative emotions and fatigue in the U.S. population above 18 years old. Other studies have found that higher ambient temperatures tend to increase aggressive behaviors [63–65]. Furthermore, while warm temperatures are correlated with higher mood in the springtime, higher temperatures in the summer are associated with lower mood [11]. Based on this literature, we expected to observe an inverted U-shape relationship between valence and temperature where extreme temperature concepts (both hot and cold) are associated with negative-valanced emotion adjectives while mild warmer temperature concepts are associated with positive-valanced emotion adjectives. More formally, we hypothesized that:
H1A: Mildly warm (vs. mildly cool) temperature concepts are associated with positively (vs. negatively) valanced emotion adjectives.
H1B: Extreme (vs. mild) temperature concepts are associated with negatively (vs. positively) valanced emotions adjectives.
Regarding the arousal dimension, Cavanaugh et al. [2] found that people tend to differentiate low arousal emotions with the word cold compared to high arousal emotions with the word hot. From a physiological perspective, a few studies have found that higher levels of emotional excitation, independent of valence, can elicit an increase in body temperature. For instance, Salazar-López et al. [66] demonstrated that when participants were presented with high arousal images from the International Affective Picture System (IAPS) with both positive and negative valences, the temperature of the tip of their nose experienced significant increases in temperature. Similarly, Levenson [67] found that increases in skin temperature were correlated with excitement. Hahn et al. [68] found that facial temperature increases in response to arousal during interpersonal interaction. Stress in adults caused by performing complex mental tasks or lying can trigger a temperature increase in the forehead and periorbital regions [69]. Thus, we propose that high-arousal emotions are associated with higher temperatures, whereas low-arousal emotions are associated with colder temperatures. More formally we hypothesize that:
H2: Hotter (vs. colder) temperature concepts are associated with higher (vs. lower) arousal emotion adjectives.
Regarding the effect of language on temperature-emotion associations, given the mixed findings of the literature so far in terms of differences in the experience of emotions across cultures, we aimed to explore whether there was an overall similar pattern in the associations across languages in Experiment 1. Thus, in Experiment 1 we used five levels of temperature concepts and twelve specific emotion adjectives radiating from the valence-arousal core affect model. Furthermore, in Experiment 2, we used opposing adjectives of the core affect model in the two dimensions and two opposing words to refer to temperature.
Experiment 1
In Experiment 1, we evaluated to what extent the general population associated a range of five specific temperature concepts with twelve different emotion words varying along the dimensions of valence and arousal [70]. In this experiment, we focused on explicit associations and evaluated these potential associations in four languages (i.e., English, Spanish, Japanese, and Chinese).
Methods
Participants
A total of 451 participants completed the experiment online. Participants were recruited through a combination of different methods, including Prolific (https://www.prolific.co/) (n = 271), Lancers (https://www.lancers.jp/) (n = 61), and the authors’ academic and professional network via social media (n = 119). Those participants recruited from Prolific received GBP 0.60 for their participation, and those recruited from Lancers received JPY 50. The participants recruited through the authors’ academic and professional network consisted of business school students and alumni from different demographic, academic, and professional background. The experiment lasted approximately eight minutes and was performed on Qualtrics (https://www.qualtrics.com/). Data from participants that had an overall duration of two standard deviations below or above the mean were not included in the analysis (n = 4). The questionnaire was available in four different languages, namely, English, Spanish, Japanese, and Chinese; and participants were instructed to complete the questionnaire in their first language. To reduce the potential confounding effects of other cultures or languages, only those observation in which participants’ reported first language matched the language in which the experiment was completed were retained for the analysis. The final data comprised observations from 403 participants from 28 different countries (221 females, 180 males, and 2 did not reveal their gender; age range = 18–78 years, Mage = 35.01 years, SDage = 11.32). The division of participants by language and age statistics is presented in Table 1. The number of participants per country and language is detailed in S1 Table in S1 File.
Table 1. Participant number, age, and starting emotional state of participants by language group in Experiment 1.
n | Age | Valence | Arousal | ||||
---|---|---|---|---|---|---|---|
M | SD | M | SD | M | SD | ||
Overall | 403 | 35.01 | 11.32 | 5.94 | 1.54 | 4.49 | 1.81 |
English | 154 | 33.68 | 12.46 | 6.12 | 1.51 | 6.12 | 1.51 |
Spanish | 94 | 33.51 | 7.85 | 6.14 | 1.52 | 6.14 | 1.52 |
Japanese | 79 | 40.92 | 9.50 | 5.29 | 1.44 | 5.29 | 1.44 |
Chinese | 76 | 33.41 | 12.15 | 5.99 | 1.54 | 5.99 | 1.54 |
As a simple online questionnaire, the studies reported in this research comply with the policies and requirements stated by the Aarhus University Research Ethics Committee and was therefore exempted from the need for formal ethical approval. All participants, however, gave their informed written consent before taking part in the experiments.
Experimental stimuli
The emotion stimuli consisted of the twelve pairs of adjectives proposed by Jaeger et al. [70] to evenly span the circumplex emotional space defined by valence (x-axis) and arousal (y-axis). S1 Fig in S1 File shows the canonical circumplex model of affect. This set of emotion words allowed us to have high granularity while maintaining a clear guideline on the relevant dimensions to study. Since these emotions are derived from the valence and arousal dimensions, they allowed us to have a better control of the composition of the emotions and reduce potential confounding effects from an endless pool of emotions. Furthermore, this set of emotion words mitigates the risk of vague emotions and poor usability as it has been validated in product-oriented research [70–72] and therefore has the potential to be applied in multiple fields.
Design and procedure
Participants consented to take part in the study by agreeing to a statement of informed consent. Before starting the main part of the study, they were asked to evaluate their current emotional state with Bradley and Lang’s [73] 9-point Self-Assessment Manikin (SAM) (see Table 1). Following, participants were asked to evaluate how well each of the twelve pairs of emotions matched each of five different temperature concepts (0, 10, 20, 30, and 40 degrees Celsius) with a dropdown box with the options “Not well at all”, “Slightly well”, “Moderately well”, “Very well”, and “Extremely well”, representing the values 1 to 5 respectively. The different temperatures were presented with a visual representation of an alcohol thermometer filled at different levels with the temperature stated in degrees Celsius (°C) and its equivalent in degrees Fahrenheit (°F) (see Fig 1). These temperatures were chosen since they cover a spectrum from relatively cold to relatively hot, including a standard reference for room temperature level at 20°C [74]. Moreover, the visual representation of the temperatures was chosen to provide a common frame of reference for temperature and to mitigate potential confounds brought by personal and language-related interpretations of different temperature words. The order of the emotion words and the temperature visual representations was randomized for each participant. After evaluating the twelve emotion words, participants were asked some demographic questions (i.e., age, gender, first language, current country of residence, closest city).
Data analysis
First, the mean ratings of the associations between temperatures and emotions including all languages were computed. To obtain an overall perspective of the associations between emotion adjectives and temperature concepts, a Principal Component Analysis (PCA) with Varimax rotation was performed on the mean ratings of the association with each temperature for all emotions within each language. In all the plots, the color coding of the emotion words follows the order of Jaeger et al.’s [70] circumplex starting with Tense/Bothered in the second quadrant and moving clockwise. The circumplex model in the four languages can be seen in S1 Fig in S1 File.
Furthermore, given that the data violated the assumptions of normality and homoscedasticity, separate rank-based analysis of variance-type statistics (ATS) were conducted on the association ratings for each temperature. Emotion (12 levels) was taken as a within-subject factor and language (4 levels) as a between-subject factor. The ATS were conducted using the R Statistical software package {nparLD} [75]. ATS is suitable for studies with non-normal distributions (as it makes virtually no assumptions regarding the distribution of the data), small sample sizes, and outliers [76]. Moreover, ATS does not assume equal variances as other non-parametric methods, such as the Kruskal-Wallis test or the van der Waerden (VDW) test do. Compared to classical non-parametric statistical methods (e.g., Mann-Whitney-Wilcoxon, Kruskal-Wallis) that are not robust to heteroscedastic data, as well as factorial designs, ATS does not suffer from these limitations [76, 77], and it performs better than the Wald-type statistic as it better controls for the type I error in multiway factorial designs [78]. Next, Bonferroni-Holm corrected Wilcoxon Signed Rank tests were performed on the significant effects of temperature within each language.
In addition, to have a better understanding of the trend in the associations between temperature and the circumplex model of emotions, as well as the overall effect of language, age, and gender, we converted the association ratings of the different temperature categories into a continuous variable and fit a Linear Mixed Model (LMM) using the lmer function of the {lme4} R package [79]. To compute the continuous temperature variable, we first transformed the 1–5 rating scale to a 0–4 scale to avoid confounds between ratings of 1 and associations with 0°C. Next, we calculated the weighted average of the temperature categories. The p-values of the LMM were calculated with the Satterwhite method using the {lmerTest} [80] and {pbkrtest} [81] R packages. We incrementally fit three LMM models using the continuous temperature measure as dependent variable and tested them using a likelihood ratio test (LRT). Moreover, the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC) were used to select the best fitting model. The reduced null model (Model 0) included only subject ID as a random factor; Model 1 included the interaction between emotion and language; age and gender were added as covariates in Model 2.
To analyze the overall degree of similarity of the associations across the different languages, Pearson’s correlations (r) between each pair of language’s 12 (emotions) × 5 (temperatures) ratings matrices were computed. This procedure was similar to the one used by Jonauskaite et al. [82] to analyze the similarity patterns in the associations of colors and emotions across languages.
Results
To determine the overall temperature-emotion associations, a matrix with the average ratings including all the data was created (see Fig 2). The highest mean values for 0°C were observed with Blue/Uninspired, and for 10°C, the highest values occurred with Passive/Quiet and Blue/Uninspired. For 20°C, the highest mean values were with Secure/at ease, Relaxed/Calm, and Happy/Satisfied. For 30°C the highest mean values occurred with Energetic/Excited, and for 40°C, the highest values occurred with Energetic/Excited and with Tense/Bothered.
The PCA revealed that the first two dimensions explained 96.53% of the variance in the data, where the first principal component (PC1) accounted for 69.20%, and the second principal component (PC2) accounted for 27.33% (the corresponding factor loadings are presented in S2 Table in S1 File). The PCA revealed that the temperature categories were associated with different areas of the circumplex (Fig 3). Given these results, it seems as if the first and second dimensions described arousal and valence, respectively. In the PCA projection, increasing temperatures moved clockwise starting with 0°C in the third quadrant and ending with 40°C in the fourth quadrant.
When the results are interpreted referenced to the “canonical” circumplex model of affect (S1 Fig in S1 File), in which valence is located in the x-axis and valence is located in the y-axis, they revealed a counterclockwise movement in the associations between emotions and temperature. More specifically, the emotions on the third quadrant—including Blue/Uninspired—were associated with 0°C. From here, the associations moved counterclockwise in the circumplex model of core affect with increasing temperatures, ending at 40°C in the second quadrant, which includes the Tense/Bothered emotion.
Moreover, as the PCA showed, the associations between temperature and emotions were highly similar across the four languages.
The ATS analysis revealed significant main effects and interactions for all the temperatures, except for the main effect of language in the 40°C temperature (see Table 2). For 0°C, the analysis revealed significant main effects of emotion and language, as well as significant effects of their interaction. For 10°C, emotion, language, and their interaction were significant. Moreover, for the 20°C temperature, the analysis revealed significant main effects of emotion, language, and their interaction. For 30°C, emotion and language, as well as their interaction were significant. Finally, for the 40°C temperature, the analysis revealed a significant main effect of emotion and a significant interaction effect between emotion and language. However, the analysis did not reveal a significant main effect of language.
Table 2. ATS results in Experiment 1.
Factor | df | F | p-value |
---|---|---|---|
Temperature: 0°C | |||
Emotion | 6.874 | 171.32 | < .001 |
Language | 2.87 | 4.98 | .002 |
Emotion × Language | 18.07 | 5.31 | < .001 |
Temperature: 10°C | |||
Emotion | 7.547 | 88.28 | < .001 |
Language | 2.881 | 12.68 | < .001 |
Emotion × Language | 20.819 | 4.08 | < .001 |
Temperature: 20°C | |||
Emotion | 6.046 | 145.92 | < .001 |
Language | 2.862 | 14.68 | < .001 |
Emotion × Language | 16.582 | 3.03 | < .001 |
Temperature: 30°C | |||
Emotion | 7.181 | 143.81 | < .001 |
Language | 2.857 | 3.41 | .018 |
Emotion × Language | 19.518 | 3.46 | < .001 |
Temperature: 40°C | |||
Emotion | 5.745 | 122.77 | < .001 |
Language | 2.627 | 0.78 | .492 |
Emotion × Language | 15.76 | 5.85 | < .001 |
Furthermore, the Wilcoxon Signed Ranked test revealed significant differences between various emotion words for each temperature in all the languages. As Fig 4 showed, there were peaks in the average ratings of emotions corresponding to different areas to the circumplex as temperature increases. More specifically, as temperature moved from 0°C to 40°C, the highest association ratings moved from the emotions on the rightmost side, next to the middle, and lastly to the leftmost side. These results are consistent with the PCA, and they revealed that the associations moved counterclockwise from the lower left side of the circumplex (third quadrant) to the upper left side (second quadrant). The main and interaction relative treatment effects are presented in S3 Table in S1 File.
The LMM results of Model 1 (with continuous temperature as dependent variable, the interaction of emotion and language as key independent variables, and subject ID as random factor) revealed significant main effects of emotion, F(11,4341) = 198.48, p < .001, and language, F(3,394) = 4.43, p = .004, as well as a significant interaction effect of emotion and language, F(33,4341) = 6.73, p < .001. The results of Model 2 (Model 1 plus age and gender as covariates) revealed main effects of emotion, F(11,4341) = 198.47, p < .001, and language, F(3,394) = 4.63, p = .003, as well as a significant interaction effect of emotion and language, F(33,4341) = 6.74, p < .001. However, age, F(1,390) = 0.54, p = .545, and gender, F(2,423) = 1.81, p = .165, were not significant. The LRT revealed that Model 1 was significantly better than Model 0 (null model with only subject ID as random factor), χ2(47) = 2208.42, p < .001. Adding age and gender in Model 2 did not contribute towards explaining the data, χ2(3) = 4.10, p = .251. In addition, the model comparison showed that both AIC and BIC decreased from 34781 and 34800, respectively, for Model 0, to 32667 and 32990, respectively, for Model 1. Both AIC and BIC increased to 32668 and 3,012, respectively, for Model 2. We also explored controlling for the recruitment platform (Prolific, Lancers, authors’ networks) in this model. Our variables of interest (i.e., emotion, language, and their interaction) remained the same, while gender, F(2,421) = 3.29, p = .038, and platform, F(2,389) = 7.21, p < .001, were significant. Although there may be small differences in the temperature ratings based on gender and recruitment platform (main effects), overall, our results are largely unchanged. We therefore proceeded with the most parsimonious Model 1. The LMM analysis provided further evidence that, overall, the associations with emotions as temperature increased moved counterclockwise in the circumplex model of affect (Fig 5). These associations were fairly consistent across languages, with the largest differences occurring in the Tense/Bothered and Jittery/Nervous. Moreover, age and gender did not have a significant effect in our data.
Moreover, the results of the LMM revealed that, while the temperatures associated with the different emotions were highly consistent across languages, there were some clear differences. In particular, the Chinese-speaking participants seemed to associate high arousal emotions, independent of valence, with lower temperatures compared to the speakers of the other languages. This was more prominent for the Tense/Bothered and Jittery/Nervous (negative valence emotions); although it was similar to Japanese in Tense/Bothered. In addition, the largest heterogeneity across the languages occurred in the Enthusiastic/Inspired and Passive/Quiet emotions.
The analysis also revealed large similarities in the associations between emotion adjectives and temperature concepts across languages. All the language-to-language similarity levels (r) were above.80. The highest degree of similarity occurred between Spanish and English (r = .920, 95% CI = [.870, .952], p < .001) followed by Chinese and Spanish (r = .895, 95% CI = [.829, .936], p < .001). The lowest similarity level was between Japanese and Spanish (r = .837, 95% CI = [.741, .900], p < .001). See Fig 6 for all the language-to-language similarity levels.
Overall, the results of Experiment 1 provided evidence that participants had consistent explicit associations between specific areas of the valence-arousal emotion circumplex and different temperature concepts. The highest mean associations ratings moved from the lower left side of the circumplex to the upper left side as temperature increased. The results revealed that the lower temperatures (0°C and 10°C) were associated with negatively valanced, low arousal emotions (third quadrant). Additionally, 20°C was associated with positively valanced, neutral arousal emotions (positive x-axis), as well as positively valanced, low arousal emotions (fourth quadrant). The warm temperature (30°C) was associated with positively valanced, high arousal emotions (first quadrant). Finally, 40°C was associated with high arousal emotions, both positively (first quadrant) and negatively (second quadrant) valanced. These findings revealed that in the mild range, higher temperature concepts were associated with more positively valanced emotion adjectives, which supported H1A. The results provided partial support for H1B as the “extreme” cold and hot temperature concepts (0 and 40°C) were associated with negatively valanced emotion adjectives, but 40°C was also associated with a positive emotion adjective. Furthermore, the findings showed a linear relationship between higher temperature concepts and high arousal emotion adjectives, supporting H2. Despite some minor differences, the emotions that the participants from the four languages associated with the different temperatures were highly correlated. However, it is important to note that our sample included native speakers of the same specific language from different countries. Hence, due to the specificities of a same language across countries and regions, the sample size does not allow for a generalization of these associations across the languages. Moreover, there may be potential confounding factors, such as country of residence and birth, and dialect, among others affecting the languages.
Experiment 2
The purpose of Experiment 2 was to expand the findings of Experiment 1 and evaluate whether people also exhibit associations between emotions and temperature concepts at an implicit level. To this end, we conducted a modified Implicit Associated Test (IAT) similar to the one employed by Crisinel and Spence [83] and Chen et al. [84], including the improved IAT scoring algorithm suggested by Greenwald et al. [85]. Given that the emotions evaluated in Experiment 1 were derived from different combinations in the valence-arousal space and these dimensions were related to the temperatures, in Experiment 2, we used the positive and negative poles of both dimensions according to the emotion circumplex proposed by Jaeger et al. [70] as stimuli in two separate versions of the IAT. Furthermore, as the different languages shared highly similar associations, in this experiment, we focused only on English-speaking participants from a single country (UK). Experiment 2 is similar to Bergman et al. [20] where the authors conducted an IAT in which participants were tasked to categorize ten thermal words or ten emotion words. However, in said study, the authors only evaluated valence.
Methods
Participants
A total of 102 native English-speaking participants from the UK took part in the online experiment. Two participants indicated they were also native speakers of another language in addition to English, one French and the other one Serbian. They were recruited from Prolific (https://www.prolific.co/) and received GBP 0.60 for their participation. The experiment was conducted on Gorilla (https://gorilla.sc/) and took nine minutes on average. Following Greenwald et al.’s [85] improved IAT scoring algorithm, the data from one participant was excluded from the study as 10% of their trials had response times greater than 300 ms. At the beginning of the experiment, participants were automatically and randomly assigned to a version of the IAT test involving emotion words along either the valence (Experiment 2A) or the arousal (Experiment 2B) dimension. The final dataset comprised 51 participants (32 females and 19 males; age range = 18–74 years, Mage = 31.27 years, SDage = 12.84) who completed the valence dimension, and 50 participants (34 females and 16 males; age range = 19–73 years, Mage = 35.08 years, SDage = 14.24) who completed the arousal dimension.
Design and procedure
The IAT was programmed and conducted in Gorilla, and participants completed the experiment online using their desktop or laptop computers. The experiment followed a similar design to the one used in Crisinel and Spence [83]. The experiment comprised seven blocks (see Table 3) in which participants were asked to match the stimulus according to a specific mapping by pressing one of two keys (i.e., left key “F” and right key “J”). The first two blocks consisted of the single task practice trials in which participants matched an emotion word (first block) and a temperature word (second block) according to the corresponding key assigned to it. The third and fourth blocks consisted of the combined task experimental trials where participants matched either an emotion word or a temperature word according to the given mapping. The fifth block consisted of the reversed emotion single task practice trials. The sixth and seventh blocks consisted of the reversed combined task experimental trials.
Table 3. Blocks and response mappings in Experiment 2.
Block | Task | Valence | Arousal | Trials | ||
---|---|---|---|---|---|---|
Left key | Right key | Left key | Right key | |||
1 | Single—Emotion | Unhappy, Dissatisfied | Happy, Satisfied | Passive, Quiet | Active, Alert | 6 |
2 | Single—Temperature | Cold | Hot | Cold | Hot | 6 |
3 | Combined—Congruent | Unhappy, Dissatisfied / Cold | Happy, Satisfied / Hot | Passive, Quiet / Cold | Active, Alert / Hot | 16 |
4 | Combined—Congruent | Unhappy, Dissatisfied / Cold | Happy, Satisfied / Hot | Passive, Quiet / Cold | Active, Alert / Hot | 48 |
5 | Single—Emotion | Happy, Satisfied | Unhappy, Dissatisfied | Active, Alert | Passive, Quiet | 6 |
6 | Combined—Incongruent | Happy, Satisfied / Cold | Unhappy, Dissatisfied / Hot | Active, Alert / Cold | Passive, Quiet / Hot | 32 |
7 | Combined—Incongruent | Happy, Satisfied / Cold | Unhappy, Dissatisfied / Hot | Active, Alert / Cold | Passive, Quiet / Hot | 48 |
In the combined tasks, responses were mapped based on the findings of Experiment 1. The hot and the positive valence/high arousal words were mapped to the same key, which constituted the congruent blocks. On the same token, the cold and negative valence/low arousal words were mapped to the same key, which constituted the incongruent blocks (see Fig 7). The order in which participants were exposed to either the congruent trials first, in blocks three and four or later in blocks sixth and seventh, was randomized. Moreover, the response keys assigned to the temperature words were counterbalanced (i.e., left key to the word cold or the word hot). According to Greenwald et al.’s [85] suggestion, all the combined task trials were used in the analysis.
Participants first agreed to the informed consent and were then given general instructions for the experiment. Participants were instructed to maintain their fixation on the center of the screen and to match the stimulus presented as promptly and accurately as possible according to a given mapping by pressing either the “F” (left) or the “J” (right) key. The mappings were provided to participants before each block of trials. Moreover, during the trials, the words assigned to each key remained on the upper left- and right-hand sides of the screen, respectively. Each trial started with a fixation cross at the center of the screen for a randomized interval of 500–600 ms. Later, an interstimulus interval of 300–400 ms was presented. Next, the target stimulus (either a temperature or an emotion word) was presented. If the incorrect key was pressed, a red “X” appeared in the center of the screen. Participants needed to press the correct key to continue. Given that the experiment was conducted online, different factors, such as device and internet connection speeds, could affect the timings in the study. The intervals in which the target stimulus was presented were of special importance since participants could miss the stimuli due to low technical capabilities. Thus, to avoid participants missing the stimuli, as well as large discrepancies in the timing, the target stimuli remained visible until the correct key was pressed. That being said, Gorilla has been proven to be an accurate and precise online experiments platform [86–88] and a top performer compared to the most popular packages, including PsychoPy. Bridges et al. [87] conducted a large study investigating the accuracy and precision of visual and auditory stimulus timing and response times of several experiment platforms. The authors found that with visual stimuli, Gorilla had low variability across browsers (Firefox, Chrome, Safari, Edge) and operating systems (Windows, Ubuntu, Macintosh). It presented under 6 ms inter-trial variability in all browsers and sub-millisecond variability in Chrome and Ubuntu. Hence, the performance of the platform provides great confidence in the results.
In the single task practice trials, each stimulus was repeated 3 times. Thus, blocks 1, 2, and 5 consisted of 6 trials each. In the combined task experimental trials, each stimulus was repeated four times in block 3, eight times in block 6, and twelve times in blocks 4 and 7. Hence, block 3 consisted of 16 trials, block 6 consisted of 32 trials, and blocks 4 and 7 consisted of 48 trials each. Therefore, participants completed a total of 144 experimental trials (Table 3 provides further details on the blocks and trials).
Data analysis
First, ATS were conducted on the Response Times (RTs) for the congruent and incongruent conditions. Bonferroni-Holm corrected Wilcoxon Signed Rank tests were performed on the significant main effects. To measure effect sizes, Cliff’s Delta (CD) was used as per the R package {effsize} [89]. CD values range from -1 to 1. A value of 0 means total overlap between the distributions, while values of -1 and 1 mean no overlap [90]. Next, D values using RTs were analyzed following the improved scoring algorithm proposed by Greenwald et al. [85] (see also [83]). More specifically, the response times of the error trials were replaced by the mean response time of the block plus two standard deviations. This treatment allows the inclusion of error rates while introducing a penalty. As Richetin et al. [91] found, error rates should not be discarded since they contain important information that increases the validity and reliability of the analysis, in addition to increase the statistical power. The RTs of the correct trials, along with the modified response times of the incorrect trials were used to compute D values. The D values consisted of the mean of the difference in RTs between the initial congruent and incongruent blocks and between the last congruent and incongruent blocks, each divided by their pooled standard deviation. The D values were analyzed with one-sample t-tests. Finally, error rates for the congruent and incongruent conditions were analyzed similarly to the response times.
Results
The ATS revealed a significant effect of congruence on response times in the valence dimension, FATS(1, ∞) = 47.23, p < .001, as well as the arousal dimension, FATS(1, ∞) = 46.37, p < .001. The results showed significant differences between the conditions (see Fig 8A). Regarding the valence dimension, participants responded significantly more rapidly when the negative valence emotion was paired with the word cold and the positive valence emotion with the word hot (M = 684.36 ms, SD = 188.55) that when the negative valence emotion was paired with the word hot and the positive valence emotion was paired with the word cold (M = 821.24 ms, SD = 243.09; p < .001, CD = .408, 95% CI [.189, .588]). In the arousal dimension, participants responded more rapidly when the deactivation emotion was paired with the word cold and the activation emotion was paired with the word hot (M = 626.96 ms, SD = 178.13) than when the deactivation emotion was paired with the word hot and the activation emotion with the word cold (M = 924.67 ms, SD = 1045.97; p < .001, CD = .478, 95% CI [.264, .648]).
Furthermore, the one-sample t-test of the D values was significantly different than zero for both the valence (M = 0.51, SD = 0.49, t50 = 7.46, p < .001) and the arousal (M = 0.57, SD = 0.53, t49 = 7.62, p < .001) versions of the IAT tests. These results indicated that, in the valence dimension, the congruent associations—between the negative valence emotion (Unhappy/Dissatisfied) and the word cold, and between the positive valence emotion (Happy/Satisfied) and the word hot—were stronger than the incongruent associations—those between the negative valence emotion and the word hot, and between the positive valence emotion and the word cold. Moreover, in the arousal dimension, the congruent associations between the deactivation emotion (Passive/Quiet) and cold, and between the activation emotion (Active/Alert) and hot, were stronger than the incongruent associations between the deactivation emotion and hot, and between activation and cold. To obtain a sense of the magnitude of these effects, the effect sizes found here were stronger those reported in studies using similar methodologies. For instance, taking an example of a study in crossmodal correspondences, Crisinel and Spence [83] reported an effect size of D = 0.29 for the association between sweet tastes and high-pitched sounds.
The analysis of the error rates showed a similar pattern. There was a significant main effect of congruence in the valence dimension, FATS(1, ∞) = 28.46, p < .001, as well as the arousal dimension, FATS(1, ∞) = 11.05, p < .001. In terms of valence, participants’ error rates in the congruent pairings (M = 0.034, SD = 0.035) were significantly lower than in the incongruent ones (M = 0.072, SD = 0.060; p < .001, CD = .407, 95% CI [.187, .588]). Similarly, in the arousal dimension, participants made significantly fewer mistakes in the congruent pairings (M = 0.037, SD = 0.032) than in the incongruent ones (M = 0.074, SD = 0.077; p < .001, CD = .269, 95% CI [.036, .474]) (See Fig 8B).
Taken together, the results of Experiment 2 demonstrated that participants exhibited implicit associations between the word hot and words related to positively valanced emotions and high arousal emotions. Moreover, they presented implicit associations between words related to negatively valanced and low arousal emotions with the word cold. In terms of valence, the results are partially consistent with H1B but seem to be more in line with H1A since the word cold, but not hot, was associated with the negative valanced emotion. It is possible that the casual use of the word hot is not necessarily associated with 40°C or extreme temperatures. These results are consistent with those in Bergman et al.’s [20] study where the authors found that participants associated higher temperature words with positive emotions. Regarding arousal, the findings provided support for H2. It is important to note that the difference in response times between the congruent and incongruent matches was slightly weaker for the valence dimension than for arousal, which could indicate a more clear-cut relationship between temperature and arousal, compared to valence. Despite these results, it cannot be discarded that the words hot and cold could have different semantic meanings besides temperature.
General discussion
In the present study, we aimed to uncover how people associate a range of adjectives spanning the emotional circumplex model with different temperature concepts. To this end, we conducted two experiments. In Experiment 1, we evaluated the explicit associations between twelve different emotion adjectives, varying in valence and arousal, and five different temperature concepts on native speakers of four different languages (English, Spanish, Japanese, and Chinese). In Experiment 2, we evaluated native English speakers in terms of their implicit associations between temperature words (hot and cold) and emotion adjectives at the opposite ends of both the valence (Unhappy/Dissatisfied and Happy/Satisfied) and the arousal (Passive/Quiet and Active/Alert) dimensions.
Altogether, the results provided evidence for the existence of explicit and implicit associations between emotions adjectives and temperature concepts. The results of Experiment 1 showed that, regardless of language, the peak of the association ratings moved counterclockwise in the canonical circumplex model of core affect from the lower left side (third quadrant) to the upper left side (second quadrant) as temperature increased from 0°C to 40°C. The results of the IATs in Experiment 2 revealed that participants had faster response times when the word hot was independently matched with the positive-valence and the high-arousal emotion words, than when these emotion words were matched with the word cold. Furthermore, as evidenced by the magnitude of the D values, the associations in the arousal dimension were stronger than in the valence dimension, potentially due to a more linear relationship between temperature and arousal, compared to valance. Therefore, consistent with Experiment 1, the results of Experiment 2 revealed that participants implicitly associated the word cold with the low arousal emotion and the word hot with the high arousal emotion. While some studies have hinted at the existence of temperature-emotion associations, to the best of our knowledge, this is the first study to uncover associations between them explicitly and implicitly and explore their similarity across languages.
Our results may be interpreted from the theory of grounded cognition [51, 53]. It is possible that the associations uncovered here arise from the multimodal representations encoded in the brain incorporating the temperature (body or ambient) experienced during specific emotional states repeated. For instance, the robust associations of 20°C with positive valence, low arousal emotions can be a product of the physical comfort this temperature generates for most people. It is also possible that the associations between emotions and temperature arose because there is causal relationship between them, whether it is in the case where emotions trigger physiological responses that affect bodily temperature [92], or in the case where ambient temperatures trigger affective states [17].
The results of Experiment 1 showed that there was a positive relationship between temperature concepts and the arousal dimension of the emotions. In line with our hypotheses, the results also revealed an inverted U-shaped relationship between temperature concepts and valence since the extreme temperature concepts, both cold and hot, were associated with negatively valanced emotions, whereas the milder ambient temperature was associated with positive valanced emotions. A possibility is that valence is related to embodied process of comfort as warmer temperatures are comfortable but extreme temperatures at both ends can generate discomfort [47]. These results are consistent with Wilkowski et al. [93] as the authors suggested people from different cultures use metaphorical expressions of hot and negative emotions (e.g., anger). These results also are also in line with Baylis et al. [62], who found that expressions of positive emotions in social media were the highest at 20°C and decreased beyond 30°C, at which point negative emotions also increased. It is worth noting that the present study did not control for whether participants interpreted the temperature concepts presented as coming from the environment or from a specific object, despite the visual representations used. Hence the temperature range considered comfortable might differ. The results of Experiment 2 were partially consistent with studies that have implied that warmer temperatures are positively valanced [17, 59, 60]. It is important to note that only two temperature words were used. Experiment 2 also revealed that the association between temperature and arousal was more robust than that between temperature and valence, potentially because associations with valence at higher temperatures is less clear as hotter temperatures can be evaluated positively or negatively, as Experiment 1 showed.
Furthermore, people may associate high arousal emotions, whether they are positively or negatively valanced, with higher temperatures because body temperature increases when they experience those emotions. Some studies that have shown that the temperature of peripheral body regions decreases during negative-valanced, high-arousal emotional states [31, 67, 94, 95]. Nevertheless, other studies have indicated that body temperature changes which are triggered by emotions generally accompany arousal, but are independent of the valence of the emotions [92, 96], which seems to be consistent with the associations of the higher temperature concepts in Experiment 1 and the smaller difference across dimensions of Experiment 2. Examining the inverse relationship between temperature and emotions, in which certain temperatures trigger specific emotional states, the associations can come from high ambient temperatures or activities that increase body temperature and hence arousal. For example, physical exercise increases body temperature and at the same time may increase excitement and energy levels. Similarly, it is possible that the associations between positive emotions with low levels of arousal and ambient temperatures arise because at this temperature, people are at their homeostatic optimum [1, 12, 30] and therefore feel calm, secure, or happy.
The results of Experiment 1 showed that the associations across the four languages exhibited a high degree of similarity and followed the same overall direction towards the two dimensions of the emotions. These findings are consistent with other studies that have found large similarities in associations between emotions and colors [49, 82, 97, 98] and emotions and brightness [99] across languages. The large similarity in temperature-emotion associations can be the result of highly comparable concepts linked to emotions across languages, which can potentially be captured by broad categories. As Ogarkova [37] suggested, emotional categories in most languages have similar hierarchical structures and the variance of emotion lexicons can be explained by a few relevant dimensions. Another potential explanation of these results is that the subjective experience of emotions did not differ significantly across speakers of the various languages. It is possible that the emotion-temperature associations are fundamentally driven by core affect, which according to the constructionist theory of emotion, is parsed into specific emotion categories [24, 100]. As Sievers et al. [101] suggested, there is a high degree of similarity in how people understand expressions of emotional arousal since they are signaled with a multisensory code based on variations in magnitude. Our findings agree with Jackson et al. [27] in that they seem to reflect the existence of a common semantic framework of emotions across language based on valence and arousal, which are linked to neurophysiological systems that keep homeostasis, although there exists cultural differences.
Despite the high degree of similarity in the emotion-temperature associations across languages, small differences were present. These differences may arise because of linguistic discrepancies and what the various emotions mean in across languages, as well as countries [27]. As Lindquist [36] suggested, languages encode emotions differently, and emotional perception is culturally relative. Additionally, these differences may be caused by environmental factors and the degree of exposure native speakers of a given language that predominantly live-in specific countries have with different temperature ranges. For example, Jonauskaite et al. [49] found that the association between yellow and the concept of joy varied depending on overall exposure to sunshine. Temperature may affect the expression of affect, as well as the subjective experience of similarly intense affective stimuli [12].
Regarding the lower temperature associations for high-arousal emotions in Chinese-speaking participants, it is possible that these differences are the result of a restrained view of the experience and reporting of intense emotions [102]. Intriguingly, there was a slightly higher correlation in the associations between Chinese- and Spanish-speaking participants compared to that between Chinese- and Japanese-speaking participants, as based on geographical and linguistic distance, the latter should be higher [103]. It is possible that this was caused by a greater international cultural exposure from both language groups. However, further research is needed to strip out the effect behind these differences.
Limitations and future directions
One of the main limitations of the present work relates to the set of emotions used. While we focused on emotions that derived from the valence and arousal dimensions, the pool of emotions that can be studied is virtually endless, and other emotions that could have associations with temperature were not included. For instance, romantic or sensual emotions were not analyzed. Future studies may focus on associations with a much more precise set of emotions that have greater relevance for specific fields or applications. That said, the emotion adjectives [70] have been validated across cultures in 23 consumer studies (each with 104–270 participants) involving New Zealand and Chinese consumers. The adjectives were also validated with different types of stimuli (i.e., text, images, aromas, and taste). The emotion circumplex covers a wide range of relevant emotions while remaining parsimonious and is applicable to extensive classes of stimuli. Another aspect to consider when applying these temperature-emotion associations in real world scenarios, is that both temperature and emotions can be product- or context-specific. For instance, while companies may want to generate associations between refreshing beverages and positive emotions, using warm temperatures associations would not be ideal.
Another limitation comes from the method in which the temperatures were presented (visual representations in Experiment 1 and temperature words in Experiment 2). Since no actual temperatures were used, it is not possible to rule out potential semantic effects. People could have also interpreted emotion or temperature words differently, thus introducing some variability. In Experiment 1, people from different countries may not be equally used to certain temperatures. in Experiment 2, people could have had considered diverse temperature ranges for the words hot and cold. Nevertheless, the results provide considerable confidence since the experiment captured relative differences given its within-subjects design. The five temperatures and their visual representations (along with the specific values in°C and°F) in Experiment 1 were chosen as way to cover a broad range of the ambient temperature spectrum, reduce potential language biases, and increase familiarity with temperature measurements. However, it is not certain that participants thought about ambient temperature with these representations. Future studies could expand the range of temperatures and represent them in different ways so that the meaning of temperature is less ambiguous. Moreover, exploring potential differences in the associations between emotions and environmental and object-based temperatures could generate interesting insights. For instance, similar versions of IATs could be designed using pictures of objects or scenes evoking different temperatures combined with facial expressions, such as emojis. Another limitation, especially in the IATs, comes from the possibility that, when evaluating the emotion-temperature associations explicitly or pressing a key in the IAT, participants may not have read the entirety of the pairs of emotion words but instead relied only on the first word. That being said, the use of these emotion adjectives has been extensively validated in multiple studies [70–72].
In recent years, the interest in crossmodal correspondences has seen a rapid growth from academics and practitioners. Research on these correspondences has found a myriad of associations between different modalities (see [104]), and temperature-based correspondences has recently regained the interest of researchers relates to temperature [105, 106]. Spence [107] has recently reviewed the literature on temperature-related crossmodal correspondences. The present study provides valuable insights to advance the study of crossmodal correspondences since the explicit and implicit associations found here may help deepen the understanding of temperature-based crossmodal correspondences mediated by emotions and the role language might play in them. More specifically, these results can guide future studies on the mechanisms behind temperature-based crossmodal correspondences.
To conclude, our findings provide evidence of the existence of consistent associations between emotions and temperature concepts at the explicit level across languages. The findings also provide evidence that some explicit associations also translate to the implicit level. The present study also adds to the literature on emotions and their associations with abstract concepts, and to research on the bidirectionally causal embodied processes between emotions and temperature. Furthermore, the present article contributes to the discussion of how conceptual metaphors can help people understand abstract concepts by interpreting them in terms of concrete experiences, and how using these metaphors can change both how people view the world and their subsequent behavior.
Supporting information
Data Availability
All data and scripts associated with the manuscript are available in OSF. DOI: 10.17605/OSF.IO/TCBG5 URL: https://osf.io/tcbg5/.
Funding Statement
This study was partially supported by a Carlsberg Foundation Young Researcher Fellowship (CF19-0587) awarded to QJW. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1. Bruno P, Melnyk V, Völckner F. Temperature and emotions: Effects of physical temperature on responses to emotional advertising. International Journal of Research in Marketing. 2017;34(1):302–320. doi: 10.1016/j.ijresmar.2016.08.005 [DOI] [Google Scholar]
- 2. Cavanaugh LA, Macinnis DJ, Weiss AM. Perceptual dimensions differentiate emotions. Cognition and Emotion. 2016;30(8):1430–1445. doi: 10.1080/02699931.2015.1070119 [DOI] [PubMed] [Google Scholar]
- 3. Fetterman AK, Wilkowski BM, Robinson MD. On feeling warm and being warm: Daily perceptions of physical warmth fluctuate with interpersonal warmth. Social Psychological and Personality Science. 2018;9(5):560–567. doi: 10.1177/1948550617712032 [DOI] [Google Scholar]
- 4. Huang X, Zhang M, Hui MK, Wyer RS. Warmth and conformity: The effects of ambient temperature on product preferences and financial decisions. Journal of Consumer Psychology. 2014;24(2):241–250. doi: 10.1016/j.jcps.2013.09.009 [DOI] [Google Scholar]
- 5. Waggoner JE. Temperature-based metonymies for emotions in children and adults. Psychological Reports. 2010;106(1):233–245. doi: 10.2466/PR0.106.1.233-245 [DOI] [PubMed] [Google Scholar]
- 6. Pham MT, Geuens M, De Pelsmacker P. The influence of ad-evoked feelings on brand evaluations: Empirical generalizations from consumer responses to more than 1000 TV commercials. International Journal of Research in Marketing. 2013;30(4):383–394. doi: 10.1016/j.ijresmar.2013.04.004 [DOI] [Google Scholar]
- 7. Aaker DA, Stayman DM, Hagerty MR. Warmth in advertising: Measurement, impact, and sequence effects. Journal of Consumer Research. 1986;12(4):365–381. doi: 10.1086/208524 [DOI] [Google Scholar]
- 8. IJzerman H, Semin GR. The thermometer of social relations: Mapping social proximity on temperature. Psychological Science. 2009;20(10):1214–1220. doi: 10.1111/j.1467-9280.2009.02434.x [DOI] [PubMed] [Google Scholar]
- 9. Noelke C, McGovern M, Corsi DJ, Jimenez MP, Stern A, Wing IS, et al. Increasing ambient temperature reduces emotional well-being. Environmental Research. 2016;151:124–129. doi: 10.1016/j.envres.2016.06.045 [DOI] [PubMed] [Google Scholar]
- 10. Van de Vliert E, Huang X, Parker PM. Do colder and hotter climates make richer societies more, but poorer societies less, happy and altruistic? Journal of Environmental Psychology. 2004;24(1):17–30. doi: 10.1016/S0272-4944(03)00021-5 [DOI] [Google Scholar]
- 11. Keller MC, Fredrickson BL, Ybarra O, Cote S, Johnson K, Mikels J, et al. A warm heart and a clear head: The contingent effects of weather on mood and cognition. Psychological Science. 2005;16(9):724–731. doi: 10.1111/j.1467-9280.2005.01602.x [DOI] [PubMed] [Google Scholar]
- 12. Parker PM, Tavassoli NT. Homeostasis and consumer behavior across cultures. International Journal of Research in Marketing. 2000;17(1):33–53. doi: 10.1016/S0167-8116(00)00006-9 [DOI] [Google Scholar]
- 13. Anderson CA, Anderson KB, Dorr N, DeNeve, Kristina M Flanagan M. Temperature and aggression. In: Zanna MP, editor. Advances in experimental social psychology, Vol. 32. Academic Press; 2000. p. 63–133. [Google Scholar]
- 14. Younan D, Li L, Tuvblad C, Wu J, Lurmann F, Franklin M, et al. Long-term ambient temperature and externalizing behaviors in adolescents. American Journal of Epidemiology. 2018;187(9):1931–1941. doi: 10.1093/aje/kwy104 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Stevens HR, Graham PL, Beggs PJ, Hanigan IC. In cold weather we bark, but in hot weather we bite: Patterns in social media anger, aggressive Behavior, and temperature. Environment and Behavior. 2020; p. 1–19. doi: 10.1177/0013916520937455 [DOI] [Google Scholar]
- 16. Lee WK, Sohn SY. A large-scale data-based investigation on the relationship between bad weather and taxi tipping. Journal of Environmental Psychology. 2020;70:101458. doi: 10.1016/j.jenvp.2020.101458 [DOI] [Google Scholar]
- 17. Zwebner Y, Lee L, Goldenberg J. The temperature premium: Warm temperatures increase product valuation. Journal of Consumer Psychology. 2014;24(2):251–259. doi: 10.1016/j.jcps.2013.11.003 [DOI] [Google Scholar]
- 18. Motoki K, Saito T, Nouchi R, Kawashima R, Sugiura M. Light colors and comfortable warmth: Crossmodal correspondences between thermal sensations and color lightness influence consumer behavior. Food Quality and Preference. 2019;72:45–55. doi: 10.1016/j.foodqual.2018.09.004 [DOI] [Google Scholar]
- 19. Wang H, Liu L. Experimental investigation about effect of emotion state on people’s thermal comfort. Energy and Buildings. 2020;211:109789. doi: 10.1016/j.enbuild.2020.109789 [DOI] [Google Scholar]
- 20. Bergman P, Ho HN, Koizumi A, Tajadura-Jiménez A, Kitagawa N. The pleasant heat? Evidence for thermal-emotional implicit associations occurring with semantic and physical thermal stimulation. Cognitive Neuroscience. 2015;6(1):24–30. doi: 10.1080/17588928.2014.988132 [DOI] [PubMed] [Google Scholar]
- 21. Lakoff G, Johnson M. Metaphors we live by. Chicago: University of Chicago Press; 1980. [Google Scholar]
- 22. Kövecses Z. A brief outline of “standard” conceptual metaphor theory and some outstanding issues. In: Extended conceptual metaphor theory. Cambridge: Cambridge University Press; 2020. p. 1–21. [Google Scholar]
- 23. Marks LE. On perceptual metaphors. Metaphor and Symbol. 1996;11(1):39–66. doi: 10.1207/s15327868ms1101_3 [DOI] [Google Scholar]
- 24. Barrett LF. Solving the emotion paradox: Categorization and the experience of emotion. Personality and Social Psychology Review. 2006;10(1):20–46. doi: 10.1207/s15327957pspr1001_2 [DOI] [PubMed] [Google Scholar]
- 25. Barrett LF. How emotions are made: The secret life of the brain. New York, NY: Houghton-Mifflin-Harcourt; 2017. [Google Scholar]
- 26. Barsalou L. Situated simulation in the human conceptual system. Language and Cognitive Processes. 2003;18(5-6):513–562. doi: 10.1080/01690960344000026 [DOI] [Google Scholar]
- 27. Jackson JC, Watts J, Henry TR, List JM, Forkel R, Mucha PJ, et al. Emotion semantics show both cultural variation and universal structure. Science. 2019;366(6472):1517–1522. doi: 10.1126/science.aaw8160 [DOI] [PubMed] [Google Scholar]
- 28. Lindquist KA, Wager TD, Kober H, Bliss-Moreau E, Barrett LF. The brain basis of emotion: A meta-analytic review. Behavioral and Brain Sciences. 2012;35(3):121–143. doi: 10.1017/S0140525X11000446 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Fugate JMB, Franco CL. What color is your anger? Assessing color-emotion pairings in English speakers. Frontiers in Psychology. 2019;10:206. doi: 10.3389/fpsyg.2019.00206 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Zhou X, Wildschut T, Sedikides C, Chen X, Vingerhoets AJJM. Heartwarming memories: Nostalgia maintains physiological comfort. Emotion. 2012;12(4):678–684. doi: 10.1037/a0027236 [DOI] [PubMed] [Google Scholar]
- 31. Ioannou S, Morris PH, Baker M, Reddy V, Gallese V. Seeing a blush on the visible and invisible spectrum: A functional thermal infrared imaging study. Frontiers in Human Neuroscience. 2017;11:525. doi: 10.3389/fnhum.2017.00525 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Levenson RW. The intrapersonal functions of emotion. Cognition & Emotion. 1999;13(5):481–504. doi: 10.1080/026999399379159 [DOI] [Google Scholar]
- 33. Shadmehr R. Motor learning: A cortical system for adaptive motor control. Current Biology. 2018;28(14):R793–R795. doi: 10.1016/j.cub.2018.05.071 [DOI] [PubMed] [Google Scholar]
- 34. Mesquita B, Frijda NH. Cultural variations in emotions: A review. Psychological Bulletin. 1992;112(2):179–204. doi: 10.1037/0033-2909.112.2.179 [DOI] [PubMed] [Google Scholar]
- 35. Perlovsky LI. Physics of the mind. Frontiers in Systems Neuroscience. 2016;10:84. doi: 10.3389/fnsys.2016.00084 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Lindquist KA. The role of language in emotion: Existing evidence and future directions. Current Opinion in Psychology. 2017;17:135–139. doi: 10.1016/j.copsyc.2017.07.006 [DOI] [PubMed] [Google Scholar]
- 37. Ogarkova A. Folk emotion concepts: Lexicalization of emotional experiences across languages and cultures. In: Fontaine JJR, Scherer KR, Soriano Salinas C, editors. Components of emotional meaning: A sourcebook. Oxford: Oxford University Press; 2013. p. 46–62. [Google Scholar]
- 38. Buchanan TW, Lutz K, Mirzazade S, Specht K, Shah NJ, Zilles K, et al. Recognition of emotional prosody and verbal components of spoken language: An fMRI study. Cognitive Brain Research. 2000;9(3):227–238. doi: 10.1016/S0926-6410(99)00060-9 [DOI] [PubMed] [Google Scholar]
- 39.Perlovsky LI. Integrated emotions, cognition, and language. In: The 2006 IEEE International Joint Conference on Neural Network Proceedings. Vancouver, BC: IEEE; 2006. p. 1570–1575.
- 40. Whorf BL. The relation of habitual thought and behavior to language. In: Coupland N, Jaworski A, editors. Socioloinguistics. Modern Linguistics Series. London: Palgrave; 1997. p. 35–58. [Google Scholar]
- 41. Levenson RW. Basic emotion questions. Emotion Review. 2011;3(4):379–386. doi: 10.1177/1754073911410743 [DOI] [Google Scholar]
- 42. Tsai JL, Knutson B, Fung HH. Cultural variation in affect valuation. Journal of Personality and Social Psychology. 2006;90(2):288–307. doi: 10.1037/0022-3514.90.2.288 [DOI] [PubMed] [Google Scholar]
- 43. Bosacki SL, Moore C. Preschoolers’ understanding of simple and complex emotions: Links with gender and language. Sex Roles. 2004;50(9/10):659–675. doi: 10.1023/B:SERS.0000027568.26966.27 [DOI] [Google Scholar]
- 44. Gergen KJ. Social construction in context. London: Sage; 2001. [Google Scholar]
- 45. Kitayama S, Markus HR, Matsumoto H. Culture, self, and emotion: A cultural perspective on “self-conscious” emotions. In: Tangney JP, Fischer KW, editors. Self-conscious emotions: The psychology of shame, guilt, embarrassment, and pride. Guilford Press; 1995. p. 439–464. [Google Scholar]
- 46. Guéguen N. Weather and smiling contagion: A quasi experiment with the smiling sunshine. Journal of Nonverbal Behavior. 2013;37:51–55. doi: 10.1007/s10919-012-0140-y [DOI] [Google Scholar]
- 47. Fischer R, Van De Vliert E. Does climate undermine subjective well-being? A 58-nation study. Personality and Social Psychology Bulletin. 2011;37(8):1031–1041. doi: 10.1177/0146167211407075 [DOI] [PubMed] [Google Scholar]
- 48. Howe PD, Boudet H, Leiserowitz A, Maibach EW. Mapping the shadow of experience of extreme weather events. Climatic Change. 2014;127(2):381–389. doi: 10.1007/s10584-014-1253-6 [DOI] [Google Scholar]
- 49. Jonauskaite D, Abdel-Khalek AM, Abu-Akel A, Al-Rasheed AS, Antonietti JP, Ásgeirsson ÁG, et al. The sun is no fun without rain: Physical environments affect how we feel about yellow across 55 countries. Journal of Environmental Psychology. 2019;66:101350. doi: 10.1016/j.jenvp.2019.101350 [DOI] [Google Scholar]
- 50. Knez I, Thorsson S. Thermal, emotional and perceptual evaluations of a park: Cross-cultural and environmental attitude comparisons. Building and Environment. 2008;43(9):1483–1490. doi: 10.1016/j.buildenv.2007.08.002 [DOI] [Google Scholar]
- 51. Barsalou LW. Grounded cognition. Annual Review of Psychology. 2008;59(1):617–645. doi: 10.1146/annurev.psych.59.103006.093639 [DOI] [PubMed] [Google Scholar]
- 52. Russell JA. A circumplex model of affect. Journal of Personality and Social Psychology. 1980;39(6):1161–1178. doi: 10.1037/h0077714 [DOI] [Google Scholar]
- 53. Barsalou LW. Grounded cognition: Past, present, and future. Topics in Cognitive Science. 2010;2(4):716–724. doi: 10.1111/j.1756-8765.2010.01115.x [DOI] [PubMed] [Google Scholar]
- 54. Decety J, Grèzes J. The power of simulation: Imagining one’s own and other’s behavior. Brain Research. 2006;1079(1):4–14. doi: 10.1016/j.brainres.2005.12.115 [DOI] [PubMed] [Google Scholar]
- 55. Russell JA. Core affect and the psychological construction of emotion. Psychological Review. 2003;110(1):145–172. doi: 10.1037/0033-295X.110.1.145 [DOI] [PubMed] [Google Scholar]
- 56. Russell JA. Cross-cultural similarities and differences in affective processing and expression. In: Jeon M, editor. Emotions and affect in human factors and human-computer interaction. San Diego: Academic Press; 2017. p. 123–141. [Google Scholar]
- 57. Wilson-Mendenhall CD, Barrett LF, Barsalou LW. Neural evidence that human emotions share core affective properties. Psychological Science. 2013;24(6):947–956. doi: 10.1177/0956797612464242 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58. Balters S, Steinert M. Capturing emotion reactivity through physiology measurement as a foundation for affective engineering in engineering design science and engineering practices. Journal of Intelligent Manufacturing. 2017;28(7):1585–1607. doi: 10.1007/s10845-015-1145-2 [DOI] [Google Scholar]
- 59. Pramudya RC, Seo HS. Influences of product temperature on emotional responses to, and sensory attributes of, coffee and green tea beverages. Frontiers in Psychology. 2018;8:2264. doi: 10.3389/fpsyg.2017.02264 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60. Stokes CN, O’Sullivan MG, Kerry JP. Assessment of black coffee temperature profiles consumed from paper-based cups and effect on affective and descriptive product sensory attributes. International Journal of Food Science and Technology. 2016;51(9):2041–2048. doi: 10.1111/ijfs.13176 [DOI] [Google Scholar]
- 61. Vanden P, Maclachlan DL, Maclachlan DL. Process tracing of emotional responses to TV ads: Revisiting the warmth monitor. Journal of Consumer Research. 1994;20(4):586–600. doi: 10.1086/209372 [DOI] [Google Scholar]
- 62. Baylis P, Obradovich N, Kryvasheyeu Y, Chen H, Coviello L, Moro E, et al. Weather impacts expressed sentiment. PLOS ONE. 2018;13(4):1–11. doi: 10.1371/journal.pone.0195750 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63. Anderson CA, Deuser WE, DeNeve KM. Hot temperatures, hostile affect, hostile cognition, and arousal: Tests of a general model of affective aggression. Personality and Social Psychology Bulletin. 1995;21(5):434–448. doi: 10.1177/0146167295215002 [DOI] [Google Scholar]
- 64. Baron RA. Aggression as a function of ambient temperature and prior anger arousal. Journal of Personality and Social Psychology. 1972;21(2):183–189. doi: 10.1037/h0032892 [DOI] [PubMed] [Google Scholar]
- 65. Baron RA, Bell PA. Aggression and heat: The influence of ambient temperature, negative affect, and a cooling drink on physical aggression. Journal of Personality and Social Psychology. 1976;33(3):245–255. doi: 10.1037/0022-3514.33.3.245 [DOI] [PubMed] [Google Scholar]
- 66. Salazar-López E, Domínguez E, Juárez Ramos V, de la Fuente J, Meins A, Iborra O, et al. The mental and subjective skin: Emotion, empathy, feelings and thermography. Consciousness and Cognition. 2015;34:149–162. doi: 10.1016/j.concog.2015.04.003 [DOI] [PubMed] [Google Scholar]
- 67. Levenson RW. Blood, sweat, and fears. Annals of the New York Academy of Sciences. 2003;1000(1):348–366. doi: 10.1196/annals.1280.016 [DOI] [PubMed] [Google Scholar]
- 68. Hahn AC, Whitehead RD, Albrecht M, Lefevre CE, Perrett DI. Hot or not? Thermal reactions to social contact. Biology Letters. 2012;8(5):864–867. doi: 10.1098/rsbl.2012.0338 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69. Pavlidis I, Levine JA. Thermal image analysis for polygraph testing. IEEE Engineering in Medicine and Biology Magazine. 2002;21(6):56–64. doi: 10.1109/MEMB.2002.1175139 [DOI] [PubMed] [Google Scholar]
- 70. Jaeger SR, Roigard CM, Jin D, Xia YX, Zhong F, Hedderley DI. A single-response emotion word questionnaire for measuring product-related emotional associations inspired by a circumplex model of core affect: Method characterisation with an applied focus. Food Quality and Preference. 2020;83:103805. doi: 10.1016/j.foodqual.2019.103805 [DOI] [Google Scholar]
- 71. Jaeger SR, Roigard CM, Chheang SL. The valence × arousal circumplex-inspired emotion questionnaire (CEQ): Effect of response format and question layout. Food Quality and Preference. 2021;90:104172. doi: 10.1016/j.foodqual.2020.104172 [DOI] [Google Scholar]
- 72. Jaeger SR, Xia YX, Le Blond M, Beresford MK, Hedderley DI, Cardello AV. Supplementing hedonic and sensory consumer research on beer with cognitive and emotional measures, and additional insights via consumer segmentation. Food Quality and Preference. 2019;73:117–134. doi: 10.1016/j.foodqual.2018.11.015 [DOI] [Google Scholar]
- 73. Bradley M, Lang PJ. Mesuring emotion: The self-assessment semantic manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry. 1994;25(1):49–59. doi: 10.1016/0005-7916(94)90063-9 [DOI] [PubMed] [Google Scholar]
- 74.International Organization for Standardization. Geometrical product specifications (GPS)—Standard reference temperature for the specification of geometrical and dimensional properties (ISO Standard No. 1:2016); 2016. Available from: https://www.iso.org/standard/67630.html.
- 75. Noguchi K, Gel YR, Brunner E, Konietschke F. nparLD: An R software package for the nonparametric analysis of longitudinal data in factorial experiments. Journal of Statistical Software. 2012;50(12):1–23. doi: 10.18637/jss.v050.i1225317082 [DOI] [Google Scholar]
- 76. Erceg-Hurn DM, Mirosevich VM. Modern robust statistical methods: An easy way to maximize the accuracy and power of your research. American Psychologist. 2008;63(7):591–601. doi: 10.1037/0003-066X.63.7.591 [DOI] [PubMed] [Google Scholar]
- 77. Zimmerman DW. Statistical significance levels of nonparametric tests biased by heterogeneous variances of treatment groups. Journal of General Psychology. 2000;127(4):354–364. doi: 10.1080/00221300009598589 [DOI] [PubMed] [Google Scholar]
- 78. Bathke AC, Schabenberger O, Tobias RD, Madden LV. Greenhouse-Geisser adjustment and the ANOVA-type statistic: Cousins or twins? The American Statistician. 2009;63(3):239–246. doi: 10.1198/tast.2009.08187 [DOI] [Google Scholar]
- 79. Bates D, Mächler M, Bolker BM, Walker SC. Fitting linear mixed-effects models using lme4. Journal of Statistical Software. 2015;67(1):1–48. doi: 10.18637/jss.v067.i01 [DOI] [Google Scholar]
- 80. Kuznetsova A. lmerTest package: Tests in linear mixed effects models. Journal of Statistical Software. 2017;82(13):1–26. doi: 10.18637/jss.v082.i13 [DOI] [Google Scholar]
- 81. Halekoh U, Højsgaard S. A Kenward-Roger Approximation and parametric bootstrap methods for tests in linear mixed models—The R package pbkrtest. Journal of Statistical Software. 2014;59(9):1–32. doi: 10.18637/jss.v059.i0926917999 [DOI] [Google Scholar]
- 82. Jonauskaite D, Abu-Akel A, Dael N, Oberfeld D, Abdel-Khalek AM, Al-Rasheed AS, et al. Universal patterns in color-emotion associations are further shaped by linguistic and geographic proximity. Psychological Science. 2020; p. 1–16. doi: 10.1177/0956797620948810 [DOI] [PubMed] [Google Scholar]
- 83. Crisinel AS, Spence C. A sweet sound? Food names reveal implicit associations between taste and pitch. Perception. 2010;39(3):417–425. doi: 10.1068/p6574 [DOI] [PubMed] [Google Scholar]
- 84. Chen N, Tanaka K, Watanabe K. Color-shape associations revealed with Implicit Association Tests. PLOS ONE. 2015;10(1):1–15. doi: 10.1371/journal.pone.0116954 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85. Greenwald AG, Nosek BA, Banaji MR. Understanding and using the Implicit Association Test: I. An improved scoring algorithm. Journal of Personality and Social Psychology. 2003;85(2):197–216. doi: 10.1037/0022-3514.85.2.197 [DOI] [PubMed] [Google Scholar]
- 86. Anwyl-irvine A, Dalmaijer ES, Hodges N, Evershed JK. Realistic precision and accuracy of online experiment platforms, web browsers, and devices. Behavior Research Methods. 2020. doi: 10.3758/s13428-020-01501-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87. Bridges D, Pitiot A, Macaskill MR, Peirce JW. The timing mega-study: Comparing a range of experiment generators, both lab-based and online. PeerJ. 2020;8:e9414. doi: 10.7717/peerj.9414 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88. Woods AT, Velasco C, Levitan CA, Wan X, Spence C. Conducting perception research over the internet: A tutorial review. PeerJ. 2015;3:e1058. doi: 10.7717/peerj.1058 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Torchiano M. effsize: Efficient effect size computation. R package version 0.8.0; 2020. Available from: https://cran.r-project.org/package = effsize.
- 90. Cliff N. Answering ordinal questions with ordinal data using ordinal statistics. Multivariate Behavioral Research. 1996;31(3):331–350. doi: 10.1207/s15327906mbr3103_4 [DOI] [PubMed] [Google Scholar]
- 91. Richetin J, Costantini G, Perugini M, Schönbrodt F. Should we stop looking for a better scoring algorithm for handling implicit association test data? Test of the role of errors, extreme latencies treatment, scoring formula, and practice trials on reliability and validity. PLOS ONE. 2015;10(6):1–23. doi: 10.1371/journal.pone.0129601 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92. Ermatinger FA, Brügger RK, Burkart JM. The use of infrared thermography to investigate emotions in common marmosets. Physiology & Behavior. 2019;211:112672. doi: 10.1016/j.physbeh.2019.112672 [DOI] [PubMed] [Google Scholar]
- 93. Wilkowski BM, Meier BP, Robinson MD, Carter MS, Feltman R. “Hot-headed” is more than an expression: The embodied representation of anger in terms of heat. Emotion. 2009;9(4):464–477. doi: 10.1037/a0015764 [DOI] [PubMed] [Google Scholar]
- 94. Kistler A, Mariauzouls C, Berlepsch KV. Fingertip temperature as an indicator for sympathetic responses. International Journal of Psychophysiology. 1998;29(1):35–41. doi: 10.1016/S0167-8760(97)00087-1 [DOI] [PubMed] [Google Scholar]
- 95. Or CKL, Duffy VG. Development of a facial skin temperature-based methodology for non-intrusive mental workload measurement. Occupational Ergonomics. 2007;7(2):83–94. [Google Scholar]
- 96. Kosonogov V, De Zorzi L, Honoré J, Martínez-Velázquez ES, Nandrino JL, Martinez-Selva JM, et al. Facial thermal variations: A new marker of emotional arousal. PLOS ONE. 2017;12(9):e0183592. doi: 10.1371/journal.pone.0183592 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 97. Adams FM, Osgood CE. A cross-cultural study of the affective meanings of color. Journal of Cross-Cultural Psychology. 1973;4(2):135–156. doi: 10.1177/002202217300400201 [DOI] [Google Scholar]
- 98. Ou LC, Yuan Y, Sato T, Lee WY, Szabó F, Sueeprasan S, et al. Universal models of colour emotion and colour harmony. Color Research and Application. 2018;43(5):736–748. doi: 10.1002/col.22243 [DOI] [Google Scholar]
- 99. Specker E, Leder H, Rosenberg R, Hegelmaier LM, Brinkmann H, Mikuni J, et al. The universal and automatic association between brightness and positivity. Acta Psychologica. 2018;186:47–53. doi: 10.1016/j.actpsy.2018.04.007 [DOI] [PubMed] [Google Scholar]
- 100. Lindquist KA. Emotions emerge from more basic psychological ingredients: A modern psychological constructionist model. Emotion Review. 2013;5(4):356–368. doi: 10.1177/1754073913489750 [DOI] [Google Scholar]
- 101. Sievers B, Lee C, Haslett W, Wheatley T. A multi-sensory code for emotional arousal. Proceedings of the Royal Society B: Biological Sciences. 2019;286 (1906). doi: 10.1098/rspb.2019.0513 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 102. Soto JA, Levenson RW, Ebling R. Cultures of moderation and expression: Emotional experience, behavior, and physiology in Chinese Americans and Mexican Americans. Emotion. 2005;5(2):154–165. doi: 10.1037/1528-3542.5.2.154 [DOI] [PubMed] [Google Scholar]
- 103. Jäger G. Global-scale phylogenetic linguistic inference from lexical resources. Scientific Data. 2018;5:180189. doi: 10.1038/sdata.2018.189 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 104. Spence C. Crossmodal correspondences: A tutorial review. Attention, Perception, and Psychophysics. 2011;73(4):971–995. doi: 10.3758/s13414-010-0073-7 [DOI] [PubMed] [Google Scholar]
- 105. Velasco C, Jones R, King S, Spence C. The sound of temperature: What information do pouring sounds convey concerning the temperature of a beverage. Journal of Sensory Studies. 2013;28(5):335–345. doi: 10.1111/joss.12052 [DOI] [Google Scholar]
- 106. Wang QJ, Spence C. The role of pitch and tempo in sound-temperature crossmodal correspondences. Multisensory Research. 2017;30(3-5):307–320. doi: 10.1163/22134808-00002564 [DOI] [PubMed] [Google Scholar]
- 107. Spence C. Temperature-based crossmodal correspondences: Causes and consequences. Multisensory Research. 2020;33(6):1–38. doi: 10.1163/22134808-20191494 [DOI] [PubMed] [Google Scholar]