Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Jun 3;16(6):e0252408. doi: 10.1371/journal.pone.0252408

The temperature of emotions

Francisco Barbosa Escobar 1,*, Carlos Velasco 2, Kosuke Motoki 3, Derek Victor Byrne 1, Qian Janice Wang 1
Editor: Hedwig Eisenbarth4
PMCID: PMC8174739  PMID: 34081750

Abstract

Emotions and temperature are closely related through embodied processes, and people seem to associate temperature concepts with emotions. While this relationship is often evidenced by everyday language (e.g., cold and warm feelings), what remains missing to date is a systematic study that holistically analyzes how and why people associate specific temperatures with emotions. The present research aimed to investigate the associations between temperature concepts and emotion adjectives on both explicit and implicit levels. In Experiment 1, we evaluated explicit associations between twelve pairs of emotion adjectives derived from the circumplex model of affect, and five different temperature concepts ranging from 0°C to 40°C, based on responses from 403 native speakers of four different languages (English, Spanish, Japanese, Chinese). The results of Experiment 1 revealed that, across languages, the temperatures were associated with different regions of the circumplex model. The 0°C and 10°C were associated with negative-valanced, low-arousal emotions, while 20°C was associated with positive-valanced, low-to-medium-arousal emotions. Moreover, 30°C was associated with positive-valanced, high-arousal emotions; and 40°C was associated with high-arousal and either positive- or negative-valanced emotions. In Experiment 2 (N = 102), we explored whether these temperature-emotion associations were also present at the implicit level, by conducting Implicit Association Tests (IATs) with temperature words (cold and hot) and opposing pairs of emotional adjectives for each dimension of valence (Unhappy/Dissatisfied vs. Happy/Satisfied) and arousal (Passive/Quiet vs. Active/Alert) on native English speakers. The results of Experiment 2 revealed that participants held implicit associations between the word hot and positive-valanced and high-arousal emotions. Additionally, the word cold was associated with negative-valanced and low-arousal emotions. These findings provide evidence for the existence of temperature-emotion associations at both explicit and implicit levels across languages.

Introduction

People tend to associate emotions with feelings of warmth and coldness as evidenced by colloquial language [14]. For example, expressions such as ‘warm love’, ‘chilled with fear’, and ‘heartwarming’ are commonly used in everyday English language. Such types of expressions are also found in other languages. For instance, the phrase ‘abrazo cálido’, which translates to ‘warm hug’ is commonly used in the Spanish language. The phrase ‘温かい心’, which means ‘warm heart’ is commonly used in the Japanese language. Waggoner [5] found that both children and adults describe love and anger with high temperatures, but they associate fear with low temperatures. Furthermore, the concept of emotional temperature is widely used in business and advertising [6]. Aaker et al. [7] defined emotional warmth as a “positive, mild, volatile emotion involving physiological arousal and precipitated by experiencing directly or vicariously a love, family, or friendship relationship” (p. 377). Warmer temperatures, object-based or environmental, can increase feelings of emotional attachment towards friends and family [8].

Previous research has investigated effects of ambient temperature on emotions and behaviors, which highlights the importance of studying the relationship between temperature and emotions. Different studies have found that extreme hot temperatures can negatively affect emotions and wellbeing. For instance, using data from the USA during the period 2008–2013, Noelke et al. [9] found that, compared to average daily temperatures of 10–16°C, temperatures above 21°C—especially above 32°C—significantly reduce positive emotions and increase negative ones. Examining data from 55 countries, Van de Vliert et al. [10] found that people in low-income countries are less happy than the average of the 55 nations when temperatures deviate upwards or downwards from 24°C. On the other hand, people in high-income countries are happier when temperatures deviate upwards or downwards from 23°C. Keller et al. [11] found that higher temperatures improve mood and memory during the spring because of the preceding lower temperatures during the winter, but during the summer, higher temperatures negatively affect mood. However, Parker and Tavassoli [12] suggested that people in hot climates, compared to cold ones, present higher affective expressiveness, as well as higher sensitivity to emotional stimulation, both positive and negative.

In terms of behavior, there seems to be a relationship between extreme high temperatures and aggression. Through a series of five experiments, Anderson et al. [13] found that people hold general beliefs that hot temperatures, relative to warmth comfortable ones, increase feelings of anger and hostility, as well as aggressive and violence behaviors. Moreover, they found that temperatures deviating upwards and downwards from 24°C, increase aggressive behaviors. These results are echoed by Younan et al.’s [14] findings that long-term exposure to high ambient temperatures is associated with aggressive behaviors in children and adolescents in urban areas. Similarly, using data from South Wales, Australia, Stevens et al. [15] found a similar effect of high temperatures on assaults. However, the authors found that high temperatures were associated with a decrease in anger expressed in social media, as measured by counts of angry tweets. The authors suggested that these opposing patterns may occur because higher temperatures promote behaviors that foster assaults (e.g., more time spent outside, social interactions, higher alcohol consumption) that at the same time decrease opportunity, motivation, or ability to be active in social media. Furthermore, related to behaviors, Lee and Sohn [16] analyzed hourly weather data in New York City and yellow taxicab data in 2013 and found a significant positive relationship between extreme cold and hot outdoor temperatures and increased tipping. The authors suggested that this behavior was mediated by mood, as the comfortable indoor temperatures provided by the taxi drivers improved mood and therefore empathy and gratitude, and ultimately generosity, as measured by the tipping amounts.

Regarding product valuation, Zwebner et al. [17] found that exposure to physical and ambient warmth (in the form of thermoclimate, room temperature, and direct contact with a therapeutic pad) can increase product valuation and willingness to pay. The authors found that these effects were mediated by the positive affective reactions that physical warmth induced [17]. However, Motoki et al. [18] failed to replicate this study.

The associations between emotions and temperature also work inversely, so that emotional states affect temperature assessments. Wang and Liu [19] found that emotional states can influence thermal comfort and thermal sensation during light physical activities. In their study, the authors found that participants’ thermal comfort in light activities (i.e., sitting and standing) was lower under the induced boring emotion condition compared to the joyful and the neutral ones. In other words, participants felt warmer under the boring emotion state.

Related to the present study, Bergman et al. [20] studied implicit semantic associations between temperature and emotional valence, as well as implicit associations between the experience of physical temperature and emotional valence using two separate Implicit Association Tests (IATs). The authors found that thermal words related to high temperatures, as well as physical warmth, were associated to positively valanced words. Thermal words related to low temperatures, as well as physical coldness, were related to negatively valanced words.

Despite the documented relationship between temperature and emotions, systematic research on the association between different emotions and physical temperatures (and temperature concepts) is scarce. The present article contributes to the literature on emotions and to the understanding of associations of abstract concepts with concrete experiences by adopting a comprehensive approach in terms of the nature of these associations (explicit and implicit), coverage of emotion adjectives (and their underlying dimensions) and consistency across languages. We aimed to uncover explicit and implicit associations between different temperature concepts and emotion adjectives, and across four different languages, to maximize the generalizability of our results. To this end, we conducted two experiments. In Experiment 1, we used a questionnaire-based design to evaluate people’s explicit associations of twelve pairs of emotion words with five different visual temperature scales going from cold (0°C) to hot (40°C) in 10-degree intervals. We conducted Experiment 1 with native speakers of four languages (i.e., English, Spanish, Japanese, Chinese) and explored the consistency in the associations across the languages. In Experiment 2, we conducted Implicit Association Tests (IATs) with two temperature words (cold and hot) and opposing pairs of emotion adjectives in terms of valence and arousal. The study of associations between temperature and emotions is of great relevance for both the academic and practitioner-oriented literatures due to the documented effect of temperature on emotional states, decision-making, and consumer behavior. Beyond theoretical contributions to the literature on embodied cognition and learning from statistical regularities in the environment, insights from the study of these associations can guide the development of working spaces, products, and marketing activities.

The origin of temperature-emotion associations

Metaphors are pervasive in people’s lives and are present in literature, as well as everyday language. In their early conceptual metaphor theory (CMT), Lakoff and Johnson [21] suggested that the human conceptual system plays an important role in defining reality, and that this conceptual system, is to a large extent metaphorical. Conceptual metaphors are a way of understanding—often abstract—realms of experiences in terms of another—typically concrete—domain. The authors suggested that metaphors unite reason and imagination, and are therefore critical in contributing to our understanding of the world (see also [22, 23]). Hence, metaphors shape the way people think and experience the world. Associations between temperature and emotions may be an illustration of conceptual metaphors in play where one domain is mapped to another one [22]. While people commonly use these temperature-emotion associations to make sense of the world, their origin is not completely understood. Nonetheless, the theory of constructed emotion provides a useful framework to explain these associations.

The theory of constructed emotion [24, 25] suggests that emotions are categorizations of past experiences molded by embodied knowledge. Emotions do not come from specific brain structures, rather the brain creates them as concepts by parsing situated sensory information, affect, and physiological changes. Based on previous knowledge and experiences, the brain makes predictions and develops situated conceptualizations [26] to identify incoming sensory inputs, find an explanation, and guide responses towards them. For instance, following this constructionist approach, the emotion concepts related to anger found in previous literature may arise from the parsing of the negative valence and high arousal caused by the repeated exposure of extreme temperatures into this emotion category. An important part of the theory of constructed emotion related to the present study is that new sensory information is encoded and unified whenever the brain predicts it will trigger physiological changes in the perceiver [25], and emotion concepts are triggered when the brain infers the meaning of these physiological processes [27, 28]. Hence, emotions are tightly linked to these processes that help in achieving homeostasis [5, 7]. As the theory of constructed emotion would suggest, individuals create emotion categories based on their experience, and these categories can be used to label sensations that occur together with different temperatures [25, 29]. In this way, the associations between temperature and emotions can be explained by the categorization of experiences that coincide and incorporate either bodily temperature feelings or externally perceived temperature, whether the latter relates to the temperature of a living being or an object in close proximity, or whether it relates to environmental temperature.

Bridging the theory of constructed emotion and homeostatic processes can help explain associations between emotions and temperature since both work together to help in maintaining the body’s optimal temperature. Emotions can serve as homeostatic responses through two mechanisms [30]. First, emotions can have a direct effect on the body’s physiological condition—including temperature changes, and homeostatic processes can bring the body back to thermal equilibrium. For example, being accompanied by a loved person can increase the heartrate and raise the internal body temperature. This often results in blushing, which serves as a thermoregulatory mechanism to cool down the body by drawing more blood to the cheeks, where heat exchange is more efficient [3133]. In this way, the (increased) internal body temperature experienced would be associated with the situation, as well as its valence and arousal, that triggered the physiological process. The emotion-temperature association can also come from the perception of the warmth generated by the bodily heat of the other person and the core affect and feelings experienced during the encounter. Additionally, emotions can facilitate homeostatic balance by simulating bodily states through thoughts and memories. Bruno et al. [1] found that consumers’ perception of emotional stimuli depends on their homeostatic state. For instance, when consumers felt physically cold, they perceived emotionally warm stimuli (i.e., print advertisements that evoked emotions related to love and affection) more favorably than emotionally cold stimuli (i.e., print advertisements that evoked emotions related to disgust). On the other hand, when consumers felt physically hot, they perceived the emotionally cold stimuli more favorably than the emotionally warm ones. However, there were no differences in the evaluation of these stimuli when consumers were at their homeostatic optimum. The authors suggested that these effects occurred because the emotional stimuli brought people further away from their homeostatic optimum when the emotional temperature and the divergence from the optimum was in the same direction.

Language differences in temperature-emotion associations

It is possible that the associations between temperature and emotions are shaped by language. Previous research has uncovered variations in the subjective experience of emotions and their taxonomy brought by culture and language [34]. Language plays a critical role in cognition because it serves as a medium to ground abstract and general concepts, as well as their emotional connections, in the brain. In this way, emotions have meanings and are experienced differently based on the concepts with which they are associated [35]. Language influences how emotions are conceptualized and categorized across cultures, whether it is through the impact of language on the conceptualization of experiences or the effect of culture on the experience and linguistic representation of emotions [36, 37]. Relevant to the present study, cultural and linguistic differences in emotions may influence the associations between emotions and temperature.

Previous literature has shown differences of emotional and conceptual content across languages [35, 3840]. Differences in temperature-emotion associations might occur because the underlying meanings and concepts associated to specific emotions can vary with language. There is evidence of significant variations in the associations of emotion concepts in twenty of the language families [27]. Therefore, people across different languages would be evaluating inherently different concepts. Nonetheless, some studies point to a large degree of similarity in the experience of emotions across cultures [41, 42]. Thus, to increase the generalizability of our study and explore the extent to which specific temperature-emotion associations hold beyond one language, we conducted Experiment 1 using four different languages (i.e., English, Spanish, Japanese, Chinese). Furthermore, we analyzed how consistent were the associations across the four languages. We focused on native speakers on these languages since a great part of emotional concepts and understanding is formed interdependently with language during childhood with interactions with caregivers and peers [4345].

Another potential source of variation in the associations studied here relates to how people experience and evaluate different temperature conditions across cultures, and to how they impact emotions. While warm pleasant temperatures have been associated with positive mood in western countries [11, 46], the way people react to and the emotions that these temperatures elicit, or with which they are associated, may differ due to repeated exposure and the difference in ranges and fluctuations of temperature [47, 48]. An example of the influence of environmental factors on associations with emotions was described by Jonauskaite et al. [49] in a study across fifty-five countries. The authors found that associations between yellow and joyful emotions are stronger when temperatures are moderate, and rain is plentiful. Moreover, related to the role of culture and environmental attitudes, Knez and Thorsson [50] studied evaluations of a park with Japanese and Swedish participants. Japanese participants evaluated the park as warmer and more pleasant than the Swedish participants, despite both groups physically experiencing similar thermal conditions.

Hypotheses development

We built our hypotheses based on the theory of grounded cognition [51] and the model of core affect [52]. The theory of grounded cognition proposes that abstract concepts are grounded in concrete experiences [51, 53]. A critical aspect of this theory is based on the role of mental simulations on cognition [54], which suggests that the brain captures, merges, and stores different states across modalities—including perception and introspection—during an experience and later re-enacts this cohesive multimodal representation as needed. According to the model of core affect, the cognitive structure of human emotions can be conceptualized and represented by spanning the dimensions of valence and arousal in a circumplex model, which makes it possible to decompose emotions into varying levels of the two components [52, 55]; see also [56, 57].

In terms of valence, previous research points to a correlation between higher temperatures and positive emotions [1, 17, 18, 20, 5861]. Nevertheless, the study of associations between emotions and temperature requires a nuanced approach since there are differences in temperature levels (i.e., mild vs. extreme) and how they are experienced (i.e., ambient vs. object-based) that may affect these associations. Some of these studies have used beverages (coffee and tea) as object-based thermal stimuli [59, 60] and have found that beverages at hotter temperatures (above 65°C) tend to be characterized with more positive emotions. Pramudya and Seo [59] found that when the beverages were at lower temperatures (as low as 5°C), they elicited more negative emotions.

However, research studying ambient temperature have found that hotter temperatures are associated with negative emotions and well-being. Using Facebook and Twitter data during the period between 2009 and 2016 to analyze the effect of temperature on emotions, Baylis et al., [62] found that expressions of positive emotions peaked at 20°C. Past 30°C, positive emotions decreased while negative emotions increased. Noelke et al. [9] found that temperatures above 32°C significantly reduced positive emotions and increased negative emotions and fatigue in the U.S. population above 18 years old. Other studies have found that higher ambient temperatures tend to increase aggressive behaviors [6365]. Furthermore, while warm temperatures are correlated with higher mood in the springtime, higher temperatures in the summer are associated with lower mood [11]. Based on this literature, we expected to observe an inverted U-shape relationship between valence and temperature where extreme temperature concepts (both hot and cold) are associated with negative-valanced emotion adjectives while mild warmer temperature concepts are associated with positive-valanced emotion adjectives. More formally, we hypothesized that:

  • H1A: Mildly warm (vs. mildly cool) temperature concepts are associated with positively (vs. negatively) valanced emotion adjectives.

  • H1B: Extreme (vs. mild) temperature concepts are associated with negatively (vs. positively) valanced emotions adjectives.

Regarding the arousal dimension, Cavanaugh et al. [2] found that people tend to differentiate low arousal emotions with the word cold compared to high arousal emotions with the word hot. From a physiological perspective, a few studies have found that higher levels of emotional excitation, independent of valence, can elicit an increase in body temperature. For instance, Salazar-López et al. [66] demonstrated that when participants were presented with high arousal images from the International Affective Picture System (IAPS) with both positive and negative valences, the temperature of the tip of their nose experienced significant increases in temperature. Similarly, Levenson [67] found that increases in skin temperature were correlated with excitement. Hahn et al. [68] found that facial temperature increases in response to arousal during interpersonal interaction. Stress in adults caused by performing complex mental tasks or lying can trigger a temperature increase in the forehead and periorbital regions [69]. Thus, we propose that high-arousal emotions are associated with higher temperatures, whereas low-arousal emotions are associated with colder temperatures. More formally we hypothesize that:

  • H2: Hotter (vs. colder) temperature concepts are associated with higher (vs. lower) arousal emotion adjectives.

Regarding the effect of language on temperature-emotion associations, given the mixed findings of the literature so far in terms of differences in the experience of emotions across cultures, we aimed to explore whether there was an overall similar pattern in the associations across languages in Experiment 1. Thus, in Experiment 1 we used five levels of temperature concepts and twelve specific emotion adjectives radiating from the valence-arousal core affect model. Furthermore, in Experiment 2, we used opposing adjectives of the core affect model in the two dimensions and two opposing words to refer to temperature.

Experiment 1

In Experiment 1, we evaluated to what extent the general population associated a range of five specific temperature concepts with twelve different emotion words varying along the dimensions of valence and arousal [70]. In this experiment, we focused on explicit associations and evaluated these potential associations in four languages (i.e., English, Spanish, Japanese, and Chinese).

Methods

Participants

A total of 451 participants completed the experiment online. Participants were recruited through a combination of different methods, including Prolific (https://www.prolific.co/) (n = 271), Lancers (https://www.lancers.jp/) (n = 61), and the authors’ academic and professional network via social media (n = 119). Those participants recruited from Prolific received GBP 0.60 for their participation, and those recruited from Lancers received JPY 50. The participants recruited through the authors’ academic and professional network consisted of business school students and alumni from different demographic, academic, and professional background. The experiment lasted approximately eight minutes and was performed on Qualtrics (https://www.qualtrics.com/). Data from participants that had an overall duration of two standard deviations below or above the mean were not included in the analysis (n = 4). The questionnaire was available in four different languages, namely, English, Spanish, Japanese, and Chinese; and participants were instructed to complete the questionnaire in their first language. To reduce the potential confounding effects of other cultures or languages, only those observation in which participants’ reported first language matched the language in which the experiment was completed were retained for the analysis. The final data comprised observations from 403 participants from 28 different countries (221 females, 180 males, and 2 did not reveal their gender; age range = 18–78 years, Mage = 35.01 years, SDage = 11.32). The division of participants by language and age statistics is presented in Table 1. The number of participants per country and language is detailed in S1 Table in S1 File.

Table 1. Participant number, age, and starting emotional state of participants by language group in Experiment 1.
n Age Valence Arousal
M SD M SD M SD
Overall 403 35.01 11.32 5.94 1.54 4.49 1.81
English 154 33.68 12.46 6.12 1.51 6.12 1.51
Spanish 94 33.51 7.85 6.14 1.52 6.14 1.52
Japanese 79 40.92 9.50 5.29 1.44 5.29 1.44
Chinese 76 33.41 12.15 5.99 1.54 5.99 1.54

As a simple online questionnaire, the studies reported in this research comply with the policies and requirements stated by the Aarhus University Research Ethics Committee and was therefore exempted from the need for formal ethical approval. All participants, however, gave their informed written consent before taking part in the experiments.

Experimental stimuli

The emotion stimuli consisted of the twelve pairs of adjectives proposed by Jaeger et al. [70] to evenly span the circumplex emotional space defined by valence (x-axis) and arousal (y-axis). S1 Fig in S1 File shows the canonical circumplex model of affect. This set of emotion words allowed us to have high granularity while maintaining a clear guideline on the relevant dimensions to study. Since these emotions are derived from the valence and arousal dimensions, they allowed us to have a better control of the composition of the emotions and reduce potential confounding effects from an endless pool of emotions. Furthermore, this set of emotion words mitigates the risk of vague emotions and poor usability as it has been validated in product-oriented research [7072] and therefore has the potential to be applied in multiple fields.

Design and procedure

Participants consented to take part in the study by agreeing to a statement of informed consent. Before starting the main part of the study, they were asked to evaluate their current emotional state with Bradley and Lang’s [73] 9-point Self-Assessment Manikin (SAM) (see Table 1). Following, participants were asked to evaluate how well each of the twelve pairs of emotions matched each of five different temperature concepts (0, 10, 20, 30, and 40 degrees Celsius) with a dropdown box with the options “Not well at all”, “Slightly well”, “Moderately well”, “Very well”, and “Extremely well”, representing the values 1 to 5 respectively. The different temperatures were presented with a visual representation of an alcohol thermometer filled at different levels with the temperature stated in degrees Celsius (°C) and its equivalent in degrees Fahrenheit (°F) (see Fig 1). These temperatures were chosen since they cover a spectrum from relatively cold to relatively hot, including a standard reference for room temperature level at 20°C [74]. Moreover, the visual representation of the temperatures was chosen to provide a common frame of reference for temperature and to mitigate potential confounds brought by personal and language-related interpretations of different temperature words. The order of the emotion words and the temperature visual representations was randomized for each participant. After evaluating the twelve emotion words, participants were asked some demographic questions (i.e., age, gender, first language, current country of residence, closest city).

Fig 1. Temperature visual scales used in Experiment 1.

Fig 1

The scales correspond to 0, 10, 20, 30, and 40 Degrees Celsius (°C) and their equivalent in Degrees Fahrenheit (°F).

Data analysis

First, the mean ratings of the associations between temperatures and emotions including all languages were computed. To obtain an overall perspective of the associations between emotion adjectives and temperature concepts, a Principal Component Analysis (PCA) with Varimax rotation was performed on the mean ratings of the association with each temperature for all emotions within each language. In all the plots, the color coding of the emotion words follows the order of Jaeger et al.’s [70] circumplex starting with Tense/Bothered in the second quadrant and moving clockwise. The circumplex model in the four languages can be seen in S1 Fig in S1 File.

Furthermore, given that the data violated the assumptions of normality and homoscedasticity, separate rank-based analysis of variance-type statistics (ATS) were conducted on the association ratings for each temperature. Emotion (12 levels) was taken as a within-subject factor and language (4 levels) as a between-subject factor. The ATS were conducted using the R Statistical software package {nparLD} [75]. ATS is suitable for studies with non-normal distributions (as it makes virtually no assumptions regarding the distribution of the data), small sample sizes, and outliers [76]. Moreover, ATS does not assume equal variances as other non-parametric methods, such as the Kruskal-Wallis test or the van der Waerden (VDW) test do. Compared to classical non-parametric statistical methods (e.g., Mann-Whitney-Wilcoxon, Kruskal-Wallis) that are not robust to heteroscedastic data, as well as factorial designs, ATS does not suffer from these limitations [76, 77], and it performs better than the Wald-type statistic as it better controls for the type I error in multiway factorial designs [78]. Next, Bonferroni-Holm corrected Wilcoxon Signed Rank tests were performed on the significant effects of temperature within each language.

In addition, to have a better understanding of the trend in the associations between temperature and the circumplex model of emotions, as well as the overall effect of language, age, and gender, we converted the association ratings of the different temperature categories into a continuous variable and fit a Linear Mixed Model (LMM) using the lmer function of the {lme4} R package [79]. To compute the continuous temperature variable, we first transformed the 1–5 rating scale to a 0–4 scale to avoid confounds between ratings of 1 and associations with 0°C. Next, we calculated the weighted average of the temperature categories. The p-values of the LMM were calculated with the Satterwhite method using the {lmerTest} [80] and {pbkrtest} [81] R packages. We incrementally fit three LMM models using the continuous temperature measure as dependent variable and tested them using a likelihood ratio test (LRT). Moreover, the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC) were used to select the best fitting model. The reduced null model (Model 0) included only subject ID as a random factor; Model 1 included the interaction between emotion and language; age and gender were added as covariates in Model 2.

To analyze the overall degree of similarity of the associations across the different languages, Pearson’s correlations (r) between each pair of language’s 12 (emotions) × 5 (temperatures) ratings matrices were computed. This procedure was similar to the one used by Jonauskaite et al. [82] to analyze the similarity patterns in the associations of colors and emotions across languages.

Results

To determine the overall temperature-emotion associations, a matrix with the average ratings including all the data was created (see Fig 2). The highest mean values for 0°C were observed with Blue/Uninspired, and for 10°C, the highest values occurred with Passive/Quiet and Blue/Uninspired. For 20°C, the highest mean values were with Secure/at ease, Relaxed/Calm, and Happy/Satisfied. For 30°C the highest mean values occurred with Energetic/Excited, and for 40°C, the highest values occurred with Energetic/Excited and with Tense/Bothered.

Fig 2. Heatmap of overall associations in Experiment 1.

Fig 2

The heatmap shows the average ratings of the temperature-emotion associations with all the data. Less saturated red or orange indicates stronger associations.

The PCA revealed that the first two dimensions explained 96.53% of the variance in the data, where the first principal component (PC1) accounted for 69.20%, and the second principal component (PC2) accounted for 27.33% (the corresponding factor loadings are presented in S2 Table in S1 File). The PCA revealed that the temperature categories were associated with different areas of the circumplex (Fig 3). Given these results, it seems as if the first and second dimensions described arousal and valence, respectively. In the PCA projection, increasing temperatures moved clockwise starting with 0°C in the third quadrant and ending with 40°C in the fourth quadrant.

Fig 3. Principal Component Analysis (PCA) biplot in Experiment 1.

Fig 3

The variables visualized are the temperature-emotion association ratings for the different temperatures. The individual observations of emotions per each language (in different colors and shapes) are superimposed. The emotion categories are color-coded following the canonical circumplex model of affect, starting with Tense/Bothered in the third quadrant. Dimension 1 seems to describe arousal, and Dimension 2 seems to describe valence. Associations in the PCA move clockwise with increasing temperature starting from 0°C in the third quadrant, which translates into a counterclockwise movement in the canonical circumplex model of affect.

When the results are interpreted referenced to the “canonical” circumplex model of affect (S1 Fig in S1 File), in which valence is located in the x-axis and valence is located in the y-axis, they revealed a counterclockwise movement in the associations between emotions and temperature. More specifically, the emotions on the third quadrant—including Blue/Uninspired—were associated with 0°C. From here, the associations moved counterclockwise in the circumplex model of core affect with increasing temperatures, ending at 40°C in the second quadrant, which includes the Tense/Bothered emotion.

Moreover, as the PCA showed, the associations between temperature and emotions were highly similar across the four languages.

The ATS analysis revealed significant main effects and interactions for all the temperatures, except for the main effect of language in the 40°C temperature (see Table 2). For 0°C, the analysis revealed significant main effects of emotion and language, as well as significant effects of their interaction. For 10°C, emotion, language, and their interaction were significant. Moreover, for the 20°C temperature, the analysis revealed significant main effects of emotion, language, and their interaction. For 30°C, emotion and language, as well as their interaction were significant. Finally, for the 40°C temperature, the analysis revealed a significant main effect of emotion and a significant interaction effect between emotion and language. However, the analysis did not reveal a significant main effect of language.

Table 2. ATS results in Experiment 1.

Factor df F p-value
Temperature: 0°C
Emotion 6.874 171.32 < .001
Language 2.87 4.98 .002
Emotion × Language 18.07 5.31 < .001
Temperature: 10°C
Emotion 7.547 88.28 < .001
Language 2.881 12.68 < .001
Emotion × Language 20.819 4.08 < .001
Temperature: 20°C
Emotion 6.046 145.92 < .001
Language 2.862 14.68 < .001
Emotion × Language 16.582 3.03 < .001
Temperature: 30°C
Emotion 7.181 143.81 < .001
Language 2.857 3.41 .018
Emotion × Language 19.518 3.46 < .001
Temperature: 40°C
Emotion 5.745 122.77 < .001
Language 2.627 0.78 .492
Emotion × Language 15.76 5.85 < .001

Furthermore, the Wilcoxon Signed Ranked test revealed significant differences between various emotion words for each temperature in all the languages. As Fig 4 showed, there were peaks in the average ratings of emotions corresponding to different areas to the circumplex as temperature increases. More specifically, as temperature moved from 0°C to 40°C, the highest association ratings moved from the emotions on the rightmost side, next to the middle, and lastly to the leftmost side. These results are consistent with the PCA, and they revealed that the associations moved counterclockwise from the lower left side of the circumplex (third quadrant) to the upper left side (second quadrant). The main and interaction relative treatment effects are presented in S3 Table in S1 File.

Fig 4. Mean ratings and Wilcoxon Signed Ranked test results for the temperature-emotion association ratings in Experiment 1.

Fig 4

The y-axis is on a 1–5 scale, where 1 indicates the emotion and the temperature do not match well at all, and 5 indicates they match very well. The plots are divided into different blocks for each temperature (horizontally) within each language (vertically). The error bars represent the standard errors of the mean. The letters represent the different significance groups (p < .05) within each temperature and language as per the Wilcoxon Signed Rank Test.

The LMM results of Model 1 (with continuous temperature as dependent variable, the interaction of emotion and language as key independent variables, and subject ID as random factor) revealed significant main effects of emotion, F(11,4341) = 198.48, p < .001, and language, F(3,394) = 4.43, p = .004, as well as a significant interaction effect of emotion and language, F(33,4341) = 6.73, p < .001. The results of Model 2 (Model 1 plus age and gender as covariates) revealed main effects of emotion, F(11,4341) = 198.47, p < .001, and language, F(3,394) = 4.63, p = .003, as well as a significant interaction effect of emotion and language, F(33,4341) = 6.74, p < .001. However, age, F(1,390) = 0.54, p = .545, and gender, F(2,423) = 1.81, p = .165, were not significant. The LRT revealed that Model 1 was significantly better than Model 0 (null model with only subject ID as random factor), χ2(47) = 2208.42, p < .001. Adding age and gender in Model 2 did not contribute towards explaining the data, χ2(3) = 4.10, p = .251. In addition, the model comparison showed that both AIC and BIC decreased from 34781 and 34800, respectively, for Model 0, to 32667 and 32990, respectively, for Model 1. Both AIC and BIC increased to 32668 and 3,012, respectively, for Model 2. We also explored controlling for the recruitment platform (Prolific, Lancers, authors’ networks) in this model. Our variables of interest (i.e., emotion, language, and their interaction) remained the same, while gender, F(2,421) = 3.29, p = .038, and platform, F(2,389) = 7.21, p < .001, were significant. Although there may be small differences in the temperature ratings based on gender and recruitment platform (main effects), overall, our results are largely unchanged. We therefore proceeded with the most parsimonious Model 1. The LMM analysis provided further evidence that, overall, the associations with emotions as temperature increased moved counterclockwise in the circumplex model of affect (Fig 5). These associations were fairly consistent across languages, with the largest differences occurring in the Tense/Bothered and Jittery/Nervous. Moreover, age and gender did not have a significant effect in our data.

Fig 5. Mean temperature association ratings following Model 1 of the linear mixed model (LMM) analysis using temperature as a continuous variable.

Fig 5

The emotion adjectives appear in the x-axis, and the languages are color-coded. The error bars represent the confidence intervals.

Moreover, the results of the LMM revealed that, while the temperatures associated with the different emotions were highly consistent across languages, there were some clear differences. In particular, the Chinese-speaking participants seemed to associate high arousal emotions, independent of valence, with lower temperatures compared to the speakers of the other languages. This was more prominent for the Tense/Bothered and Jittery/Nervous (negative valence emotions); although it was similar to Japanese in Tense/Bothered. In addition, the largest heterogeneity across the languages occurred in the Enthusiastic/Inspired and Passive/Quiet emotions.

The analysis also revealed large similarities in the associations between emotion adjectives and temperature concepts across languages. All the language-to-language similarity levels (r) were above.80. The highest degree of similarity occurred between Spanish and English (r = .920, 95% CI = [.870, .952], p < .001) followed by Chinese and Spanish (r = .895, 95% CI = [.829, .936], p < .001). The lowest similarity level was between Japanese and Spanish (r = .837, 95% CI = [.741, .900], p < .001). See Fig 6 for all the language-to-language similarity levels.

Fig 6. Language-to-language associations similarity in Experiment 1.

Fig 6

The matrix shows the Pearson correlation values (r) between each pair of language’s 12 × 5 temperature-emotion associations matrix. Higher values indicate higher similarity between the associations.

Overall, the results of Experiment 1 provided evidence that participants had consistent explicit associations between specific areas of the valence-arousal emotion circumplex and different temperature concepts. The highest mean associations ratings moved from the lower left side of the circumplex to the upper left side as temperature increased. The results revealed that the lower temperatures (0°C and 10°C) were associated with negatively valanced, low arousal emotions (third quadrant). Additionally, 20°C was associated with positively valanced, neutral arousal emotions (positive x-axis), as well as positively valanced, low arousal emotions (fourth quadrant). The warm temperature (30°C) was associated with positively valanced, high arousal emotions (first quadrant). Finally, 40°C was associated with high arousal emotions, both positively (first quadrant) and negatively (second quadrant) valanced. These findings revealed that in the mild range, higher temperature concepts were associated with more positively valanced emotion adjectives, which supported H1A. The results provided partial support for H1B as the “extreme” cold and hot temperature concepts (0 and 40°C) were associated with negatively valanced emotion adjectives, but 40°C was also associated with a positive emotion adjective. Furthermore, the findings showed a linear relationship between higher temperature concepts and high arousal emotion adjectives, supporting H2. Despite some minor differences, the emotions that the participants from the four languages associated with the different temperatures were highly correlated. However, it is important to note that our sample included native speakers of the same specific language from different countries. Hence, due to the specificities of a same language across countries and regions, the sample size does not allow for a generalization of these associations across the languages. Moreover, there may be potential confounding factors, such as country of residence and birth, and dialect, among others affecting the languages.

Experiment 2

The purpose of Experiment 2 was to expand the findings of Experiment 1 and evaluate whether people also exhibit associations between emotions and temperature concepts at an implicit level. To this end, we conducted a modified Implicit Associated Test (IAT) similar to the one employed by Crisinel and Spence [83] and Chen et al. [84], including the improved IAT scoring algorithm suggested by Greenwald et al. [85]. Given that the emotions evaluated in Experiment 1 were derived from different combinations in the valence-arousal space and these dimensions were related to the temperatures, in Experiment 2, we used the positive and negative poles of both dimensions according to the emotion circumplex proposed by Jaeger et al. [70] as stimuli in two separate versions of the IAT. Furthermore, as the different languages shared highly similar associations, in this experiment, we focused only on English-speaking participants from a single country (UK). Experiment 2 is similar to Bergman et al. [20] where the authors conducted an IAT in which participants were tasked to categorize ten thermal words or ten emotion words. However, in said study, the authors only evaluated valence.

Methods

Participants

A total of 102 native English-speaking participants from the UK took part in the online experiment. Two participants indicated they were also native speakers of another language in addition to English, one French and the other one Serbian. They were recruited from Prolific (https://www.prolific.co/) and received GBP 0.60 for their participation. The experiment was conducted on Gorilla (https://gorilla.sc/) and took nine minutes on average. Following Greenwald et al.’s [85] improved IAT scoring algorithm, the data from one participant was excluded from the study as 10% of their trials had response times greater than 300 ms. At the beginning of the experiment, participants were automatically and randomly assigned to a version of the IAT test involving emotion words along either the valence (Experiment 2A) or the arousal (Experiment 2B) dimension. The final dataset comprised 51 participants (32 females and 19 males; age range = 18–74 years, Mage = 31.27 years, SDage = 12.84) who completed the valence dimension, and 50 participants (34 females and 16 males; age range = 19–73 years, Mage = 35.08 years, SDage = 14.24) who completed the arousal dimension.

Design and procedure

The IAT was programmed and conducted in Gorilla, and participants completed the experiment online using their desktop or laptop computers. The experiment followed a similar design to the one used in Crisinel and Spence [83]. The experiment comprised seven blocks (see Table 3) in which participants were asked to match the stimulus according to a specific mapping by pressing one of two keys (i.e., left key “F” and right key “J”). The first two blocks consisted of the single task practice trials in which participants matched an emotion word (first block) and a temperature word (second block) according to the corresponding key assigned to it. The third and fourth blocks consisted of the combined task experimental trials where participants matched either an emotion word or a temperature word according to the given mapping. The fifth block consisted of the reversed emotion single task practice trials. The sixth and seventh blocks consisted of the reversed combined task experimental trials.

Table 3. Blocks and response mappings in Experiment 2.
Block Task Valence Arousal Trials
Left key Right key Left key Right key
1 Single—Emotion Unhappy, Dissatisfied Happy, Satisfied Passive, Quiet Active, Alert 6
2 Single—Temperature Cold Hot Cold Hot 6
3 Combined—Congruent Unhappy, Dissatisfied / Cold Happy, Satisfied / Hot Passive, Quiet / Cold Active, Alert / Hot 16
4 Combined—Congruent Unhappy, Dissatisfied / Cold Happy, Satisfied / Hot Passive, Quiet / Cold Active, Alert / Hot 48
5 Single—Emotion Happy, Satisfied Unhappy, Dissatisfied Active, Alert Passive, Quiet 6
6 Combined—Incongruent Happy, Satisfied / Cold Unhappy, Dissatisfied / Hot Active, Alert / Cold Passive, Quiet / Hot 32
7 Combined—Incongruent Happy, Satisfied / Cold Unhappy, Dissatisfied / Hot Active, Alert / Cold Passive, Quiet / Hot 48

In the combined tasks, responses were mapped based on the findings of Experiment 1. The hot and the positive valence/high arousal words were mapped to the same key, which constituted the congruent blocks. On the same token, the cold and negative valence/low arousal words were mapped to the same key, which constituted the incongruent blocks (see Fig 7). The order in which participants were exposed to either the congruent trials first, in blocks three and four or later in blocks sixth and seventh, was randomized. Moreover, the response keys assigned to the temperature words were counterbalanced (i.e., left key to the word cold or the word hot). According to Greenwald et al.’s [85] suggestion, all the combined task trials were used in the analysis.

Fig 7. Stimulus-response key assignment in Experiment 2.

Fig 7

The left-hand side (A1, A2) corresponds to assignments in the valence dimension, and the right-hand side (B1, B2) corresponds to the arousal dimension. Congruent assignments are presented in the upper panels and incongruent assignments are presented in the lower panels.

Participants first agreed to the informed consent and were then given general instructions for the experiment. Participants were instructed to maintain their fixation on the center of the screen and to match the stimulus presented as promptly and accurately as possible according to a given mapping by pressing either the “F” (left) or the “J” (right) key. The mappings were provided to participants before each block of trials. Moreover, during the trials, the words assigned to each key remained on the upper left- and right-hand sides of the screen, respectively. Each trial started with a fixation cross at the center of the screen for a randomized interval of 500–600 ms. Later, an interstimulus interval of 300–400 ms was presented. Next, the target stimulus (either a temperature or an emotion word) was presented. If the incorrect key was pressed, a red “X” appeared in the center of the screen. Participants needed to press the correct key to continue. Given that the experiment was conducted online, different factors, such as device and internet connection speeds, could affect the timings in the study. The intervals in which the target stimulus was presented were of special importance since participants could miss the stimuli due to low technical capabilities. Thus, to avoid participants missing the stimuli, as well as large discrepancies in the timing, the target stimuli remained visible until the correct key was pressed. That being said, Gorilla has been proven to be an accurate and precise online experiments platform [8688] and a top performer compared to the most popular packages, including PsychoPy. Bridges et al. [87] conducted a large study investigating the accuracy and precision of visual and auditory stimulus timing and response times of several experiment platforms. The authors found that with visual stimuli, Gorilla had low variability across browsers (Firefox, Chrome, Safari, Edge) and operating systems (Windows, Ubuntu, Macintosh). It presented under 6 ms inter-trial variability in all browsers and sub-millisecond variability in Chrome and Ubuntu. Hence, the performance of the platform provides great confidence in the results.

In the single task practice trials, each stimulus was repeated 3 times. Thus, blocks 1, 2, and 5 consisted of 6 trials each. In the combined task experimental trials, each stimulus was repeated four times in block 3, eight times in block 6, and twelve times in blocks 4 and 7. Hence, block 3 consisted of 16 trials, block 6 consisted of 32 trials, and blocks 4 and 7 consisted of 48 trials each. Therefore, participants completed a total of 144 experimental trials (Table 3 provides further details on the blocks and trials).

Data analysis

First, ATS were conducted on the Response Times (RTs) for the congruent and incongruent conditions. Bonferroni-Holm corrected Wilcoxon Signed Rank tests were performed on the significant main effects. To measure effect sizes, Cliff’s Delta (CD) was used as per the R package {effsize} [89]. CD values range from -1 to 1. A value of 0 means total overlap between the distributions, while values of -1 and 1 mean no overlap [90]. Next, D values using RTs were analyzed following the improved scoring algorithm proposed by Greenwald et al. [85] (see also [83]). More specifically, the response times of the error trials were replaced by the mean response time of the block plus two standard deviations. This treatment allows the inclusion of error rates while introducing a penalty. As Richetin et al. [91] found, error rates should not be discarded since they contain important information that increases the validity and reliability of the analysis, in addition to increase the statistical power. The RTs of the correct trials, along with the modified response times of the incorrect trials were used to compute D values. The D values consisted of the mean of the difference in RTs between the initial congruent and incongruent blocks and between the last congruent and incongruent blocks, each divided by their pooled standard deviation. The D values were analyzed with one-sample t-tests. Finally, error rates for the congruent and incongruent conditions were analyzed similarly to the response times.

Results

The ATS revealed a significant effect of congruence on response times in the valence dimension, FATS(1, ∞) = 47.23, p < .001, as well as the arousal dimension, FATS(1, ∞) = 46.37, p < .001. The results showed significant differences between the conditions (see Fig 8A). Regarding the valence dimension, participants responded significantly more rapidly when the negative valence emotion was paired with the word cold and the positive valence emotion with the word hot (M = 684.36 ms, SD = 188.55) that when the negative valence emotion was paired with the word hot and the positive valence emotion was paired with the word cold (M = 821.24 ms, SD = 243.09; p < .001, CD = .408, 95% CI [.189, .588]). In the arousal dimension, participants responded more rapidly when the deactivation emotion was paired with the word cold and the activation emotion was paired with the word hot (M = 626.96 ms, SD = 178.13) than when the deactivation emotion was paired with the word hot and the activation emotion with the word cold (M = 924.67 ms, SD = 1045.97; p < .001, CD = .478, 95% CI [.264, .648]).

Fig 8. Experiment 2 results.

Fig 8

Mean response times (A) and mean error rates (B) in the congruent pairings and incongruent pairings in the valence and arousal dimensions. Error bars represent the standard errors of the mean. The asterisks indicate statistically significant differences at p < .01 (**).

Furthermore, the one-sample t-test of the D values was significantly different than zero for both the valence (M = 0.51, SD = 0.49, t50 = 7.46, p < .001) and the arousal (M = 0.57, SD = 0.53, t49 = 7.62, p < .001) versions of the IAT tests. These results indicated that, in the valence dimension, the congruent associations—between the negative valence emotion (Unhappy/Dissatisfied) and the word cold, and between the positive valence emotion (Happy/Satisfied) and the word hot—were stronger than the incongruent associations—those between the negative valence emotion and the word hot, and between the positive valence emotion and the word cold. Moreover, in the arousal dimension, the congruent associations between the deactivation emotion (Passive/Quiet) and cold, and between the activation emotion (Active/Alert) and hot, were stronger than the incongruent associations between the deactivation emotion and hot, and between activation and cold. To obtain a sense of the magnitude of these effects, the effect sizes found here were stronger those reported in studies using similar methodologies. For instance, taking an example of a study in crossmodal correspondences, Crisinel and Spence [83] reported an effect size of D = 0.29 for the association between sweet tastes and high-pitched sounds.

The analysis of the error rates showed a similar pattern. There was a significant main effect of congruence in the valence dimension, FATS(1, ∞) = 28.46, p < .001, as well as the arousal dimension, FATS(1, ∞) = 11.05, p < .001. In terms of valence, participants’ error rates in the congruent pairings (M = 0.034, SD = 0.035) were significantly lower than in the incongruent ones (M = 0.072, SD = 0.060; p < .001, CD = .407, 95% CI [.187, .588]). Similarly, in the arousal dimension, participants made significantly fewer mistakes in the congruent pairings (M = 0.037, SD = 0.032) than in the incongruent ones (M = 0.074, SD = 0.077; p < .001, CD = .269, 95% CI [.036, .474]) (See Fig 8B).

Taken together, the results of Experiment 2 demonstrated that participants exhibited implicit associations between the word hot and words related to positively valanced emotions and high arousal emotions. Moreover, they presented implicit associations between words related to negatively valanced and low arousal emotions with the word cold. In terms of valence, the results are partially consistent with H1B but seem to be more in line with H1A since the word cold, but not hot, was associated with the negative valanced emotion. It is possible that the casual use of the word hot is not necessarily associated with 40°C or extreme temperatures. These results are consistent with those in Bergman et al.’s [20] study where the authors found that participants associated higher temperature words with positive emotions. Regarding arousal, the findings provided support for H2. It is important to note that the difference in response times between the congruent and incongruent matches was slightly weaker for the valence dimension than for arousal, which could indicate a more clear-cut relationship between temperature and arousal, compared to valence. Despite these results, it cannot be discarded that the words hot and cold could have different semantic meanings besides temperature.

General discussion

In the present study, we aimed to uncover how people associate a range of adjectives spanning the emotional circumplex model with different temperature concepts. To this end, we conducted two experiments. In Experiment 1, we evaluated the explicit associations between twelve different emotion adjectives, varying in valence and arousal, and five different temperature concepts on native speakers of four different languages (English, Spanish, Japanese, and Chinese). In Experiment 2, we evaluated native English speakers in terms of their implicit associations between temperature words (hot and cold) and emotion adjectives at the opposite ends of both the valence (Unhappy/Dissatisfied and Happy/Satisfied) and the arousal (Passive/Quiet and Active/Alert) dimensions.

Altogether, the results provided evidence for the existence of explicit and implicit associations between emotions adjectives and temperature concepts. The results of Experiment 1 showed that, regardless of language, the peak of the association ratings moved counterclockwise in the canonical circumplex model of core affect from the lower left side (third quadrant) to the upper left side (second quadrant) as temperature increased from 0°C to 40°C. The results of the IATs in Experiment 2 revealed that participants had faster response times when the word hot was independently matched with the positive-valence and the high-arousal emotion words, than when these emotion words were matched with the word cold. Furthermore, as evidenced by the magnitude of the D values, the associations in the arousal dimension were stronger than in the valence dimension, potentially due to a more linear relationship between temperature and arousal, compared to valance. Therefore, consistent with Experiment 1, the results of Experiment 2 revealed that participants implicitly associated the word cold with the low arousal emotion and the word hot with the high arousal emotion. While some studies have hinted at the existence of temperature-emotion associations, to the best of our knowledge, this is the first study to uncover associations between them explicitly and implicitly and explore their similarity across languages.

Our results may be interpreted from the theory of grounded cognition [51, 53]. It is possible that the associations uncovered here arise from the multimodal representations encoded in the brain incorporating the temperature (body or ambient) experienced during specific emotional states repeated. For instance, the robust associations of 20°C with positive valence, low arousal emotions can be a product of the physical comfort this temperature generates for most people. It is also possible that the associations between emotions and temperature arose because there is causal relationship between them, whether it is in the case where emotions trigger physiological responses that affect bodily temperature [92], or in the case where ambient temperatures trigger affective states [17].

The results of Experiment 1 showed that there was a positive relationship between temperature concepts and the arousal dimension of the emotions. In line with our hypotheses, the results also revealed an inverted U-shaped relationship between temperature concepts and valence since the extreme temperature concepts, both cold and hot, were associated with negatively valanced emotions, whereas the milder ambient temperature was associated with positive valanced emotions. A possibility is that valence is related to embodied process of comfort as warmer temperatures are comfortable but extreme temperatures at both ends can generate discomfort [47]. These results are consistent with Wilkowski et al. [93] as the authors suggested people from different cultures use metaphorical expressions of hot and negative emotions (e.g., anger). These results also are also in line with Baylis et al. [62], who found that expressions of positive emotions in social media were the highest at 20°C and decreased beyond 30°C, at which point negative emotions also increased. It is worth noting that the present study did not control for whether participants interpreted the temperature concepts presented as coming from the environment or from a specific object, despite the visual representations used. Hence the temperature range considered comfortable might differ. The results of Experiment 2 were partially consistent with studies that have implied that warmer temperatures are positively valanced [17, 59, 60]. It is important to note that only two temperature words were used. Experiment 2 also revealed that the association between temperature and arousal was more robust than that between temperature and valence, potentially because associations with valence at higher temperatures is less clear as hotter temperatures can be evaluated positively or negatively, as Experiment 1 showed.

Furthermore, people may associate high arousal emotions, whether they are positively or negatively valanced, with higher temperatures because body temperature increases when they experience those emotions. Some studies that have shown that the temperature of peripheral body regions decreases during negative-valanced, high-arousal emotional states [31, 67, 94, 95]. Nevertheless, other studies have indicated that body temperature changes which are triggered by emotions generally accompany arousal, but are independent of the valence of the emotions [92, 96], which seems to be consistent with the associations of the higher temperature concepts in Experiment 1 and the smaller difference across dimensions of Experiment 2. Examining the inverse relationship between temperature and emotions, in which certain temperatures trigger specific emotional states, the associations can come from high ambient temperatures or activities that increase body temperature and hence arousal. For example, physical exercise increases body temperature and at the same time may increase excitement and energy levels. Similarly, it is possible that the associations between positive emotions with low levels of arousal and ambient temperatures arise because at this temperature, people are at their homeostatic optimum [1, 12, 30] and therefore feel calm, secure, or happy.

The results of Experiment 1 showed that the associations across the four languages exhibited a high degree of similarity and followed the same overall direction towards the two dimensions of the emotions. These findings are consistent with other studies that have found large similarities in associations between emotions and colors [49, 82, 97, 98] and emotions and brightness [99] across languages. The large similarity in temperature-emotion associations can be the result of highly comparable concepts linked to emotions across languages, which can potentially be captured by broad categories. As Ogarkova [37] suggested, emotional categories in most languages have similar hierarchical structures and the variance of emotion lexicons can be explained by a few relevant dimensions. Another potential explanation of these results is that the subjective experience of emotions did not differ significantly across speakers of the various languages. It is possible that the emotion-temperature associations are fundamentally driven by core affect, which according to the constructionist theory of emotion, is parsed into specific emotion categories [24, 100]. As Sievers et al. [101] suggested, there is a high degree of similarity in how people understand expressions of emotional arousal since they are signaled with a multisensory code based on variations in magnitude. Our findings agree with Jackson et al. [27] in that they seem to reflect the existence of a common semantic framework of emotions across language based on valence and arousal, which are linked to neurophysiological systems that keep homeostasis, although there exists cultural differences.

Despite the high degree of similarity in the emotion-temperature associations across languages, small differences were present. These differences may arise because of linguistic discrepancies and what the various emotions mean in across languages, as well as countries [27]. As Lindquist [36] suggested, languages encode emotions differently, and emotional perception is culturally relative. Additionally, these differences may be caused by environmental factors and the degree of exposure native speakers of a given language that predominantly live-in specific countries have with different temperature ranges. For example, Jonauskaite et al. [49] found that the association between yellow and the concept of joy varied depending on overall exposure to sunshine. Temperature may affect the expression of affect, as well as the subjective experience of similarly intense affective stimuli [12].

Regarding the lower temperature associations for high-arousal emotions in Chinese-speaking participants, it is possible that these differences are the result of a restrained view of the experience and reporting of intense emotions [102]. Intriguingly, there was a slightly higher correlation in the associations between Chinese- and Spanish-speaking participants compared to that between Chinese- and Japanese-speaking participants, as based on geographical and linguistic distance, the latter should be higher [103]. It is possible that this was caused by a greater international cultural exposure from both language groups. However, further research is needed to strip out the effect behind these differences.

Limitations and future directions

One of the main limitations of the present work relates to the set of emotions used. While we focused on emotions that derived from the valence and arousal dimensions, the pool of emotions that can be studied is virtually endless, and other emotions that could have associations with temperature were not included. For instance, romantic or sensual emotions were not analyzed. Future studies may focus on associations with a much more precise set of emotions that have greater relevance for specific fields or applications. That said, the emotion adjectives [70] have been validated across cultures in 23 consumer studies (each with 104–270 participants) involving New Zealand and Chinese consumers. The adjectives were also validated with different types of stimuli (i.e., text, images, aromas, and taste). The emotion circumplex covers a wide range of relevant emotions while remaining parsimonious and is applicable to extensive classes of stimuli. Another aspect to consider when applying these temperature-emotion associations in real world scenarios, is that both temperature and emotions can be product- or context-specific. For instance, while companies may want to generate associations between refreshing beverages and positive emotions, using warm temperatures associations would not be ideal.

Another limitation comes from the method in which the temperatures were presented (visual representations in Experiment 1 and temperature words in Experiment 2). Since no actual temperatures were used, it is not possible to rule out potential semantic effects. People could have also interpreted emotion or temperature words differently, thus introducing some variability. In Experiment 1, people from different countries may not be equally used to certain temperatures. in Experiment 2, people could have had considered diverse temperature ranges for the words hot and cold. Nevertheless, the results provide considerable confidence since the experiment captured relative differences given its within-subjects design. The five temperatures and their visual representations (along with the specific values in°C and°F) in Experiment 1 were chosen as way to cover a broad range of the ambient temperature spectrum, reduce potential language biases, and increase familiarity with temperature measurements. However, it is not certain that participants thought about ambient temperature with these representations. Future studies could expand the range of temperatures and represent them in different ways so that the meaning of temperature is less ambiguous. Moreover, exploring potential differences in the associations between emotions and environmental and object-based temperatures could generate interesting insights. For instance, similar versions of IATs could be designed using pictures of objects or scenes evoking different temperatures combined with facial expressions, such as emojis. Another limitation, especially in the IATs, comes from the possibility that, when evaluating the emotion-temperature associations explicitly or pressing a key in the IAT, participants may not have read the entirety of the pairs of emotion words but instead relied only on the first word. That being said, the use of these emotion adjectives has been extensively validated in multiple studies [7072].

In recent years, the interest in crossmodal correspondences has seen a rapid growth from academics and practitioners. Research on these correspondences has found a myriad of associations between different modalities (see [104]), and temperature-based correspondences has recently regained the interest of researchers relates to temperature [105, 106]. Spence [107] has recently reviewed the literature on temperature-related crossmodal correspondences. The present study provides valuable insights to advance the study of crossmodal correspondences since the explicit and implicit associations found here may help deepen the understanding of temperature-based crossmodal correspondences mediated by emotions and the role language might play in them. More specifically, these results can guide future studies on the mechanisms behind temperature-based crossmodal correspondences.

To conclude, our findings provide evidence of the existence of consistent associations between emotions and temperature concepts at the explicit level across languages. The findings also provide evidence that some explicit associations also translate to the implicit level. The present study also adds to the literature on emotions and their associations with abstract concepts, and to research on the bidirectionally causal embodied processes between emotions and temperature. Furthermore, the present article contributes to the discussion of how conceptual metaphors can help people understand abstract concepts by interpreting them in terms of concrete experiences, and how using these metaphors can change both how people view the world and their subsequent behavior.

Supporting information

S1 File

(PDF)

Data Availability

All data and scripts associated with the manuscript are available in OSF. DOI: 10.17605/OSF.IO/TCBG5 URL: https://osf.io/tcbg5/.

Funding Statement

This study was partially supported by a Carlsberg Foundation Young Researcher Fellowship (CF19-0587) awarded to QJW. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1. Bruno P, Melnyk V, Völckner F. Temperature and emotions: Effects of physical temperature on responses to emotional advertising. International Journal of Research in Marketing. 2017;34(1):302–320. doi: 10.1016/j.ijresmar.2016.08.005 [DOI] [Google Scholar]
  • 2. Cavanaugh LA, Macinnis DJ, Weiss AM. Perceptual dimensions differentiate emotions. Cognition and Emotion. 2016;30(8):1430–1445. doi: 10.1080/02699931.2015.1070119 [DOI] [PubMed] [Google Scholar]
  • 3. Fetterman AK, Wilkowski BM, Robinson MD. On feeling warm and being warm: Daily perceptions of physical warmth fluctuate with interpersonal warmth. Social Psychological and Personality Science. 2018;9(5):560–567. doi: 10.1177/1948550617712032 [DOI] [Google Scholar]
  • 4. Huang X, Zhang M, Hui MK, Wyer RS. Warmth and conformity: The effects of ambient temperature on product preferences and financial decisions. Journal of Consumer Psychology. 2014;24(2):241–250. doi: 10.1016/j.jcps.2013.09.009 [DOI] [Google Scholar]
  • 5. Waggoner JE. Temperature-based metonymies for emotions in children and adults. Psychological Reports. 2010;106(1):233–245. doi: 10.2466/PR0.106.1.233-245 [DOI] [PubMed] [Google Scholar]
  • 6. Pham MT, Geuens M, De Pelsmacker P. The influence of ad-evoked feelings on brand evaluations: Empirical generalizations from consumer responses to more than 1000 TV commercials. International Journal of Research in Marketing. 2013;30(4):383–394. doi: 10.1016/j.ijresmar.2013.04.004 [DOI] [Google Scholar]
  • 7. Aaker DA, Stayman DM, Hagerty MR. Warmth in advertising: Measurement, impact, and sequence effects. Journal of Consumer Research. 1986;12(4):365–381. doi: 10.1086/208524 [DOI] [Google Scholar]
  • 8. IJzerman H, Semin GR. The thermometer of social relations: Mapping social proximity on temperature. Psychological Science. 2009;20(10):1214–1220. doi: 10.1111/j.1467-9280.2009.02434.x [DOI] [PubMed] [Google Scholar]
  • 9. Noelke C, McGovern M, Corsi DJ, Jimenez MP, Stern A, Wing IS, et al. Increasing ambient temperature reduces emotional well-being. Environmental Research. 2016;151:124–129. doi: 10.1016/j.envres.2016.06.045 [DOI] [PubMed] [Google Scholar]
  • 10. Van de Vliert E, Huang X, Parker PM. Do colder and hotter climates make richer societies more, but poorer societies less, happy and altruistic? Journal of Environmental Psychology. 2004;24(1):17–30. doi: 10.1016/S0272-4944(03)00021-5 [DOI] [Google Scholar]
  • 11. Keller MC, Fredrickson BL, Ybarra O, Cote S, Johnson K, Mikels J, et al. A warm heart and a clear head: The contingent effects of weather on mood and cognition. Psychological Science. 2005;16(9):724–731. doi: 10.1111/j.1467-9280.2005.01602.x [DOI] [PubMed] [Google Scholar]
  • 12. Parker PM, Tavassoli NT. Homeostasis and consumer behavior across cultures. International Journal of Research in Marketing. 2000;17(1):33–53. doi: 10.1016/S0167-8116(00)00006-9 [DOI] [Google Scholar]
  • 13. Anderson CA, Anderson KB, Dorr N, DeNeve, Kristina M Flanagan M. Temperature and aggression. In: Zanna MP, editor. Advances in experimental social psychology, Vol. 32. Academic Press; 2000. p. 63–133. [Google Scholar]
  • 14. Younan D, Li L, Tuvblad C, Wu J, Lurmann F, Franklin M, et al. Long-term ambient temperature and externalizing behaviors in adolescents. American Journal of Epidemiology. 2018;187(9):1931–1941. doi: 10.1093/aje/kwy104 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Stevens HR, Graham PL, Beggs PJ, Hanigan IC. In cold weather we bark, but in hot weather we bite: Patterns in social media anger, aggressive Behavior, and temperature. Environment and Behavior. 2020; p. 1–19. doi: 10.1177/0013916520937455 [DOI] [Google Scholar]
  • 16. Lee WK, Sohn SY. A large-scale data-based investigation on the relationship between bad weather and taxi tipping. Journal of Environmental Psychology. 2020;70:101458. doi: 10.1016/j.jenvp.2020.101458 [DOI] [Google Scholar]
  • 17. Zwebner Y, Lee L, Goldenberg J. The temperature premium: Warm temperatures increase product valuation. Journal of Consumer Psychology. 2014;24(2):251–259. doi: 10.1016/j.jcps.2013.11.003 [DOI] [Google Scholar]
  • 18. Motoki K, Saito T, Nouchi R, Kawashima R, Sugiura M. Light colors and comfortable warmth: Crossmodal correspondences between thermal sensations and color lightness influence consumer behavior. Food Quality and Preference. 2019;72:45–55. doi: 10.1016/j.foodqual.2018.09.004 [DOI] [Google Scholar]
  • 19. Wang H, Liu L. Experimental investigation about effect of emotion state on people’s thermal comfort. Energy and Buildings. 2020;211:109789. doi: 10.1016/j.enbuild.2020.109789 [DOI] [Google Scholar]
  • 20. Bergman P, Ho HN, Koizumi A, Tajadura-Jiménez A, Kitagawa N. The pleasant heat? Evidence for thermal-emotional implicit associations occurring with semantic and physical thermal stimulation. Cognitive Neuroscience. 2015;6(1):24–30. doi: 10.1080/17588928.2014.988132 [DOI] [PubMed] [Google Scholar]
  • 21. Lakoff G, Johnson M. Metaphors we live by. Chicago: University of Chicago Press; 1980. [Google Scholar]
  • 22. Kövecses Z. A brief outline of “standard” conceptual metaphor theory and some outstanding issues. In: Extended conceptual metaphor theory. Cambridge: Cambridge University Press; 2020. p. 1–21. [Google Scholar]
  • 23. Marks LE. On perceptual metaphors. Metaphor and Symbol. 1996;11(1):39–66. doi: 10.1207/s15327868ms1101_3 [DOI] [Google Scholar]
  • 24. Barrett LF. Solving the emotion paradox: Categorization and the experience of emotion. Personality and Social Psychology Review. 2006;10(1):20–46. doi: 10.1207/s15327957pspr1001_2 [DOI] [PubMed] [Google Scholar]
  • 25. Barrett LF. How emotions are made: The secret life of the brain. New York, NY: Houghton-Mifflin-Harcourt; 2017. [Google Scholar]
  • 26. Barsalou L. Situated simulation in the human conceptual system. Language and Cognitive Processes. 2003;18(5-6):513–562. doi: 10.1080/01690960344000026 [DOI] [Google Scholar]
  • 27. Jackson JC, Watts J, Henry TR, List JM, Forkel R, Mucha PJ, et al. Emotion semantics show both cultural variation and universal structure. Science. 2019;366(6472):1517–1522. doi: 10.1126/science.aaw8160 [DOI] [PubMed] [Google Scholar]
  • 28. Lindquist KA, Wager TD, Kober H, Bliss-Moreau E, Barrett LF. The brain basis of emotion: A meta-analytic review. Behavioral and Brain Sciences. 2012;35(3):121–143. doi: 10.1017/S0140525X11000446 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Fugate JMB, Franco CL. What color is your anger? Assessing color-emotion pairings in English speakers. Frontiers in Psychology. 2019;10:206. doi: 10.3389/fpsyg.2019.00206 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Zhou X, Wildschut T, Sedikides C, Chen X, Vingerhoets AJJM. Heartwarming memories: Nostalgia maintains physiological comfort. Emotion. 2012;12(4):678–684. doi: 10.1037/a0027236 [DOI] [PubMed] [Google Scholar]
  • 31. Ioannou S, Morris PH, Baker M, Reddy V, Gallese V. Seeing a blush on the visible and invisible spectrum: A functional thermal infrared imaging study. Frontiers in Human Neuroscience. 2017;11:525. doi: 10.3389/fnhum.2017.00525 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Levenson RW. The intrapersonal functions of emotion. Cognition & Emotion. 1999;13(5):481–504. doi: 10.1080/026999399379159 [DOI] [Google Scholar]
  • 33. Shadmehr R. Motor learning: A cortical system for adaptive motor control. Current Biology. 2018;28(14):R793–R795. doi: 10.1016/j.cub.2018.05.071 [DOI] [PubMed] [Google Scholar]
  • 34. Mesquita B, Frijda NH. Cultural variations in emotions: A review. Psychological Bulletin. 1992;112(2):179–204. doi: 10.1037/0033-2909.112.2.179 [DOI] [PubMed] [Google Scholar]
  • 35. Perlovsky LI. Physics of the mind. Frontiers in Systems Neuroscience. 2016;10:84. doi: 10.3389/fnsys.2016.00084 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Lindquist KA. The role of language in emotion: Existing evidence and future directions. Current Opinion in Psychology. 2017;17:135–139. doi: 10.1016/j.copsyc.2017.07.006 [DOI] [PubMed] [Google Scholar]
  • 37. Ogarkova A. Folk emotion concepts: Lexicalization of emotional experiences across languages and cultures. In: Fontaine JJR, Scherer KR, Soriano Salinas C, editors. Components of emotional meaning: A sourcebook. Oxford: Oxford University Press; 2013. p. 46–62. [Google Scholar]
  • 38. Buchanan TW, Lutz K, Mirzazade S, Specht K, Shah NJ, Zilles K, et al. Recognition of emotional prosody and verbal components of spoken language: An fMRI study. Cognitive Brain Research. 2000;9(3):227–238. doi: 10.1016/S0926-6410(99)00060-9 [DOI] [PubMed] [Google Scholar]
  • 39.Perlovsky LI. Integrated emotions, cognition, and language. In: The 2006 IEEE International Joint Conference on Neural Network Proceedings. Vancouver, BC: IEEE; 2006. p. 1570–1575.
  • 40. Whorf BL. The relation of habitual thought and behavior to language. In: Coupland N, Jaworski A, editors. Socioloinguistics. Modern Linguistics Series. London: Palgrave; 1997. p. 35–58. [Google Scholar]
  • 41. Levenson RW. Basic emotion questions. Emotion Review. 2011;3(4):379–386. doi: 10.1177/1754073911410743 [DOI] [Google Scholar]
  • 42. Tsai JL, Knutson B, Fung HH. Cultural variation in affect valuation. Journal of Personality and Social Psychology. 2006;90(2):288–307. doi: 10.1037/0022-3514.90.2.288 [DOI] [PubMed] [Google Scholar]
  • 43. Bosacki SL, Moore C. Preschoolers’ understanding of simple and complex emotions: Links with gender and language. Sex Roles. 2004;50(9/10):659–675. doi: 10.1023/B:SERS.0000027568.26966.27 [DOI] [Google Scholar]
  • 44. Gergen KJ. Social construction in context. London: Sage; 2001. [Google Scholar]
  • 45. Kitayama S, Markus HR, Matsumoto H. Culture, self, and emotion: A cultural perspective on “self-conscious” emotions. In: Tangney JP, Fischer KW, editors. Self-conscious emotions: The psychology of shame, guilt, embarrassment, and pride. Guilford Press; 1995. p. 439–464. [Google Scholar]
  • 46. Guéguen N. Weather and smiling contagion: A quasi experiment with the smiling sunshine. Journal of Nonverbal Behavior. 2013;37:51–55. doi: 10.1007/s10919-012-0140-y [DOI] [Google Scholar]
  • 47. Fischer R, Van De Vliert E. Does climate undermine subjective well-being? A 58-nation study. Personality and Social Psychology Bulletin. 2011;37(8):1031–1041. doi: 10.1177/0146167211407075 [DOI] [PubMed] [Google Scholar]
  • 48. Howe PD, Boudet H, Leiserowitz A, Maibach EW. Mapping the shadow of experience of extreme weather events. Climatic Change. 2014;127(2):381–389. doi: 10.1007/s10584-014-1253-6 [DOI] [Google Scholar]
  • 49. Jonauskaite D, Abdel-Khalek AM, Abu-Akel A, Al-Rasheed AS, Antonietti JP, Ásgeirsson ÁG, et al. The sun is no fun without rain: Physical environments affect how we feel about yellow across 55 countries. Journal of Environmental Psychology. 2019;66:101350. doi: 10.1016/j.jenvp.2019.101350 [DOI] [Google Scholar]
  • 50. Knez I, Thorsson S. Thermal, emotional and perceptual evaluations of a park: Cross-cultural and environmental attitude comparisons. Building and Environment. 2008;43(9):1483–1490. doi: 10.1016/j.buildenv.2007.08.002 [DOI] [Google Scholar]
  • 51. Barsalou LW. Grounded cognition. Annual Review of Psychology. 2008;59(1):617–645. doi: 10.1146/annurev.psych.59.103006.093639 [DOI] [PubMed] [Google Scholar]
  • 52. Russell JA. A circumplex model of affect. Journal of Personality and Social Psychology. 1980;39(6):1161–1178. doi: 10.1037/h0077714 [DOI] [Google Scholar]
  • 53. Barsalou LW. Grounded cognition: Past, present, and future. Topics in Cognitive Science. 2010;2(4):716–724. doi: 10.1111/j.1756-8765.2010.01115.x [DOI] [PubMed] [Google Scholar]
  • 54. Decety J, Grèzes J. The power of simulation: Imagining one’s own and other’s behavior. Brain Research. 2006;1079(1):4–14. doi: 10.1016/j.brainres.2005.12.115 [DOI] [PubMed] [Google Scholar]
  • 55. Russell JA. Core affect and the psychological construction of emotion. Psychological Review. 2003;110(1):145–172. doi: 10.1037/0033-295X.110.1.145 [DOI] [PubMed] [Google Scholar]
  • 56. Russell JA. Cross-cultural similarities and differences in affective processing and expression. In: Jeon M, editor. Emotions and affect in human factors and human-computer interaction. San Diego: Academic Press; 2017. p. 123–141. [Google Scholar]
  • 57. Wilson-Mendenhall CD, Barrett LF, Barsalou LW. Neural evidence that human emotions share core affective properties. Psychological Science. 2013;24(6):947–956. doi: 10.1177/0956797612464242 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58. Balters S, Steinert M. Capturing emotion reactivity through physiology measurement as a foundation for affective engineering in engineering design science and engineering practices. Journal of Intelligent Manufacturing. 2017;28(7):1585–1607. doi: 10.1007/s10845-015-1145-2 [DOI] [Google Scholar]
  • 59. Pramudya RC, Seo HS. Influences of product temperature on emotional responses to, and sensory attributes of, coffee and green tea beverages. Frontiers in Psychology. 2018;8:2264. doi: 10.3389/fpsyg.2017.02264 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60. Stokes CN, O’Sullivan MG, Kerry JP. Assessment of black coffee temperature profiles consumed from paper-based cups and effect on affective and descriptive product sensory attributes. International Journal of Food Science and Technology. 2016;51(9):2041–2048. doi: 10.1111/ijfs.13176 [DOI] [Google Scholar]
  • 61. Vanden P, Maclachlan DL, Maclachlan DL. Process tracing of emotional responses to TV ads: Revisiting the warmth monitor. Journal of Consumer Research. 1994;20(4):586–600. doi: 10.1086/209372 [DOI] [Google Scholar]
  • 62. Baylis P, Obradovich N, Kryvasheyeu Y, Chen H, Coviello L, Moro E, et al. Weather impacts expressed sentiment. PLOS ONE. 2018;13(4):1–11. doi: 10.1371/journal.pone.0195750 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63. Anderson CA, Deuser WE, DeNeve KM. Hot temperatures, hostile affect, hostile cognition, and arousal: Tests of a general model of affective aggression. Personality and Social Psychology Bulletin. 1995;21(5):434–448. doi: 10.1177/0146167295215002 [DOI] [Google Scholar]
  • 64. Baron RA. Aggression as a function of ambient temperature and prior anger arousal. Journal of Personality and Social Psychology. 1972;21(2):183–189. doi: 10.1037/h0032892 [DOI] [PubMed] [Google Scholar]
  • 65. Baron RA, Bell PA. Aggression and heat: The influence of ambient temperature, negative affect, and a cooling drink on physical aggression. Journal of Personality and Social Psychology. 1976;33(3):245–255. doi: 10.1037/0022-3514.33.3.245 [DOI] [PubMed] [Google Scholar]
  • 66. Salazar-López E, Domínguez E, Juárez Ramos V, de la Fuente J, Meins A, Iborra O, et al. The mental and subjective skin: Emotion, empathy, feelings and thermography. Consciousness and Cognition. 2015;34:149–162. doi: 10.1016/j.concog.2015.04.003 [DOI] [PubMed] [Google Scholar]
  • 67. Levenson RW. Blood, sweat, and fears. Annals of the New York Academy of Sciences. 2003;1000(1):348–366. doi: 10.1196/annals.1280.016 [DOI] [PubMed] [Google Scholar]
  • 68. Hahn AC, Whitehead RD, Albrecht M, Lefevre CE, Perrett DI. Hot or not? Thermal reactions to social contact. Biology Letters. 2012;8(5):864–867. doi: 10.1098/rsbl.2012.0338 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69. Pavlidis I, Levine JA. Thermal image analysis for polygraph testing. IEEE Engineering in Medicine and Biology Magazine. 2002;21(6):56–64. doi: 10.1109/MEMB.2002.1175139 [DOI] [PubMed] [Google Scholar]
  • 70. Jaeger SR, Roigard CM, Jin D, Xia YX, Zhong F, Hedderley DI. A single-response emotion word questionnaire for measuring product-related emotional associations inspired by a circumplex model of core affect: Method characterisation with an applied focus. Food Quality and Preference. 2020;83:103805. doi: 10.1016/j.foodqual.2019.103805 [DOI] [Google Scholar]
  • 71. Jaeger SR, Roigard CM, Chheang SL. The valence × arousal circumplex-inspired emotion questionnaire (CEQ): Effect of response format and question layout. Food Quality and Preference. 2021;90:104172. doi: 10.1016/j.foodqual.2020.104172 [DOI] [Google Scholar]
  • 72. Jaeger SR, Xia YX, Le Blond M, Beresford MK, Hedderley DI, Cardello AV. Supplementing hedonic and sensory consumer research on beer with cognitive and emotional measures, and additional insights via consumer segmentation. Food Quality and Preference. 2019;73:117–134. doi: 10.1016/j.foodqual.2018.11.015 [DOI] [Google Scholar]
  • 73. Bradley M, Lang PJ. Mesuring emotion: The self-assessment semantic manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry. 1994;25(1):49–59. doi: 10.1016/0005-7916(94)90063-9 [DOI] [PubMed] [Google Scholar]
  • 74.International Organization for Standardization. Geometrical product specifications (GPS)—Standard reference temperature for the specification of geometrical and dimensional properties (ISO Standard No. 1:2016); 2016. Available from: https://www.iso.org/standard/67630.html.
  • 75. Noguchi K, Gel YR, Brunner E, Konietschke F. nparLD: An R software package for the nonparametric analysis of longitudinal data in factorial experiments. Journal of Statistical Software. 2012;50(12):1–23. doi: 10.18637/jss.v050.i1225317082 [DOI] [Google Scholar]
  • 76. Erceg-Hurn DM, Mirosevich VM. Modern robust statistical methods: An easy way to maximize the accuracy and power of your research. American Psychologist. 2008;63(7):591–601. doi: 10.1037/0003-066X.63.7.591 [DOI] [PubMed] [Google Scholar]
  • 77. Zimmerman DW. Statistical significance levels of nonparametric tests biased by heterogeneous variances of treatment groups. Journal of General Psychology. 2000;127(4):354–364. doi: 10.1080/00221300009598589 [DOI] [PubMed] [Google Scholar]
  • 78. Bathke AC, Schabenberger O, Tobias RD, Madden LV. Greenhouse-Geisser adjustment and the ANOVA-type statistic: Cousins or twins? The American Statistician. 2009;63(3):239–246. doi: 10.1198/tast.2009.08187 [DOI] [Google Scholar]
  • 79. Bates D, Mächler M, Bolker BM, Walker SC. Fitting linear mixed-effects models using lme4. Journal of Statistical Software. 2015;67(1):1–48. doi: 10.18637/jss.v067.i01 [DOI] [Google Scholar]
  • 80. Kuznetsova A. lmerTest package: Tests in linear mixed effects models. Journal of Statistical Software. 2017;82(13):1–26. doi: 10.18637/jss.v082.i13 [DOI] [Google Scholar]
  • 81. Halekoh U, Højsgaard S. A Kenward-Roger Approximation and parametric bootstrap methods for tests in linear mixed models—The R package pbkrtest. Journal of Statistical Software. 2014;59(9):1–32. doi: 10.18637/jss.v059.i0926917999 [DOI] [Google Scholar]
  • 82. Jonauskaite D, Abu-Akel A, Dael N, Oberfeld D, Abdel-Khalek AM, Al-Rasheed AS, et al. Universal patterns in color-emotion associations are further shaped by linguistic and geographic proximity. Psychological Science. 2020; p. 1–16. doi: 10.1177/0956797620948810 [DOI] [PubMed] [Google Scholar]
  • 83. Crisinel AS, Spence C. A sweet sound? Food names reveal implicit associations between taste and pitch. Perception. 2010;39(3):417–425. doi: 10.1068/p6574 [DOI] [PubMed] [Google Scholar]
  • 84. Chen N, Tanaka K, Watanabe K. Color-shape associations revealed with Implicit Association Tests. PLOS ONE. 2015;10(1):1–15. doi: 10.1371/journal.pone.0116954 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85. Greenwald AG, Nosek BA, Banaji MR. Understanding and using the Implicit Association Test: I. An improved scoring algorithm. Journal of Personality and Social Psychology. 2003;85(2):197–216. doi: 10.1037/0022-3514.85.2.197 [DOI] [PubMed] [Google Scholar]
  • 86. Anwyl-irvine A, Dalmaijer ES, Hodges N, Evershed JK. Realistic precision and accuracy of online experiment platforms, web browsers, and devices. Behavior Research Methods. 2020. doi: 10.3758/s13428-020-01501-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87. Bridges D, Pitiot A, Macaskill MR, Peirce JW. The timing mega-study: Comparing a range of experiment generators, both lab-based and online. PeerJ. 2020;8:e9414. doi: 10.7717/peerj.9414 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88. Woods AT, Velasco C, Levitan CA, Wan X, Spence C. Conducting perception research over the internet: A tutorial review. PeerJ. 2015;3:e1058. doi: 10.7717/peerj.1058 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.Torchiano M. effsize: Efficient effect size computation. R package version 0.8.0; 2020. Available from: https://cran.r-project.org/package = effsize.
  • 90. Cliff N. Answering ordinal questions with ordinal data using ordinal statistics. Multivariate Behavioral Research. 1996;31(3):331–350. doi: 10.1207/s15327906mbr3103_4 [DOI] [PubMed] [Google Scholar]
  • 91. Richetin J, Costantini G, Perugini M, Schönbrodt F. Should we stop looking for a better scoring algorithm for handling implicit association test data? Test of the role of errors, extreme latencies treatment, scoring formula, and practice trials on reliability and validity. PLOS ONE. 2015;10(6):1–23. doi: 10.1371/journal.pone.0129601 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 92. Ermatinger FA, Brügger RK, Burkart JM. The use of infrared thermography to investigate emotions in common marmosets. Physiology & Behavior. 2019;211:112672. doi: 10.1016/j.physbeh.2019.112672 [DOI] [PubMed] [Google Scholar]
  • 93. Wilkowski BM, Meier BP, Robinson MD, Carter MS, Feltman R. “Hot-headed” is more than an expression: The embodied representation of anger in terms of heat. Emotion. 2009;9(4):464–477. doi: 10.1037/a0015764 [DOI] [PubMed] [Google Scholar]
  • 94. Kistler A, Mariauzouls C, Berlepsch KV. Fingertip temperature as an indicator for sympathetic responses. International Journal of Psychophysiology. 1998;29(1):35–41. doi: 10.1016/S0167-8760(97)00087-1 [DOI] [PubMed] [Google Scholar]
  • 95. Or CKL, Duffy VG. Development of a facial skin temperature-based methodology for non-intrusive mental workload measurement. Occupational Ergonomics. 2007;7(2):83–94. [Google Scholar]
  • 96. Kosonogov V, De Zorzi L, Honoré J, Martínez-Velázquez ES, Nandrino JL, Martinez-Selva JM, et al. Facial thermal variations: A new marker of emotional arousal. PLOS ONE. 2017;12(9):e0183592. doi: 10.1371/journal.pone.0183592 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97. Adams FM, Osgood CE. A cross-cultural study of the affective meanings of color. Journal of Cross-Cultural Psychology. 1973;4(2):135–156. doi: 10.1177/002202217300400201 [DOI] [Google Scholar]
  • 98. Ou LC, Yuan Y, Sato T, Lee WY, Szabó F, Sueeprasan S, et al. Universal models of colour emotion and colour harmony. Color Research and Application. 2018;43(5):736–748. doi: 10.1002/col.22243 [DOI] [Google Scholar]
  • 99. Specker E, Leder H, Rosenberg R, Hegelmaier LM, Brinkmann H, Mikuni J, et al. The universal and automatic association between brightness and positivity. Acta Psychologica. 2018;186:47–53. doi: 10.1016/j.actpsy.2018.04.007 [DOI] [PubMed] [Google Scholar]
  • 100. Lindquist KA. Emotions emerge from more basic psychological ingredients: A modern psychological constructionist model. Emotion Review. 2013;5(4):356–368. doi: 10.1177/1754073913489750 [DOI] [Google Scholar]
  • 101. Sievers B, Lee C, Haslett W, Wheatley T. A multi-sensory code for emotional arousal. Proceedings of the Royal Society B: Biological Sciences. 2019;286 (1906). doi: 10.1098/rspb.2019.0513 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 102. Soto JA, Levenson RW, Ebling R. Cultures of moderation and expression: Emotional experience, behavior, and physiology in Chinese Americans and Mexican Americans. Emotion. 2005;5(2):154–165. doi: 10.1037/1528-3542.5.2.154 [DOI] [PubMed] [Google Scholar]
  • 103. Jäger G. Global-scale phylogenetic linguistic inference from lexical resources. Scientific Data. 2018;5:180189. doi: 10.1038/sdata.2018.189 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 104. Spence C. Crossmodal correspondences: A tutorial review. Attention, Perception, and Psychophysics. 2011;73(4):971–995. doi: 10.3758/s13414-010-0073-7 [DOI] [PubMed] [Google Scholar]
  • 105. Velasco C, Jones R, King S, Spence C. The sound of temperature: What information do pouring sounds convey concerning the temperature of a beverage. Journal of Sensory Studies. 2013;28(5):335–345. doi: 10.1111/joss.12052 [DOI] [Google Scholar]
  • 106. Wang QJ, Spence C. The role of pitch and tempo in sound-temperature crossmodal correspondences. Multisensory Research. 2017;30(3-5):307–320. doi: 10.1163/22134808-00002564 [DOI] [PubMed] [Google Scholar]
  • 107. Spence C. Temperature-based crossmodal correspondences: Causes and consequences. Multisensory Research. 2020;33(6):1–38. doi: 10.1163/22134808-20191494 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Hedwig Eisenbarth

26 Mar 2021

PONE-D-20-33913

The temperature of emotions

PLOS ONE

Dear Dr. Barbosa Escobar,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

I was fortunate to review reviews from two researchers in the field who had helpful suggestions and comments for your manuscript, which should guide your revision, which we are looking forward to. 

Please submit your revised manuscript by May 10 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Hedwig Eisenbarth

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for including your ethics statement: 

"The present work only involved online questionnaires and online implicit association tests. The study complies with the policies and requirements stated by the Aarhus University Research Ethics Committee."

a. Please amend your current ethics statement to confirm that your named institutional review board or ethics committee specifically approved this study.

b. Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”).

For additional information about PLOS ONE ethical requirements for human subjects research, please refer to http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research.

3. Please provide additional details regarding participant consent.

In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed).

If your study included minors, state whether you obtained consent from parents or guardians.

If the need for consent was waived by the ethics committee, please include this information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors report on 2 studies investigating implicit and explicit associations between temperatures and emotion adjectives. The authors find that cold temperatures are associated with low arousal negative emotions and hot temperatures are associated with high arousal positive emotions (though slightly also with high arousal negative emotions in Study 1). Results are largely consistent across first languages.

These are interesting studies in fairly well-powered samples that advance our understanding of emotion-temperature associations. Overall I think this paper makes a nice next step in the literature. That said, I have some concerns about the analytic approaches and the way the results are integrated with prior literature. I outline these below.

Major concerns

- Background literature that is closely related to the current study is not clearly described. The reader should get a few more details on citations 9-16, the Bergman et al. citation [58], and Bruno et al. [1] (i.e., what do you mean by “emotionally warm.”). Because the methods and directions of the results of these papers are not very clearly described, the reader is left unsure of what exactly the prior literature tells us and what is novel about the current study. I came to understand this in time in the paper, but it should be described more clearly earlier on in the introduction.

- I found the paper’s current reviews of the embodied cognition and evolutionary psych literatures either incomplete or confusing. There’s much more work than just Inagaki’s research on embodied processes, and the evolutionary psych paragraph just references a MRI study that I don’t think actually supports the authors’ argument… I actually feel like much of this paper’s results could more elegantly and succinctly summarized by just grounding it in the constructionist theory of emotion (see reviews by Barrett, 2017, 2006, as well as relevant papers by Lindquist, Satpute, etc.). This framework suggests that emotion concepts are used to parse core affect into specific emotion types, and it makes sense that temperature would feed into emotion concepts. Sievers et al. also have a recent paper in PNAS that could help with this multimodal representation of affect/emotion.

- At times the authors make claims like “emotions have meanings and are experienced differently based on the concepts with which they are associated” and “there is a high degree of universality in the experience of emotions,” but these claims are a huge topic of debate. The first is a tenet of constructionist theory and the second is a claim of the basic emotion theory. I’d either remove or phrase claims like these more speculatively. It also seems unclear what the authors’ stance is when these opposing claims are both held in one paper.

- One methodological concern is that recruiting through professional networks could introduce bias? Was this controlled for? What were the Ns for different recruitment types?

- Similarly, is there any assurance that different language groups are not confounded by other variables? The age differences are pronounced. Could you test for significant differences across these? Do results vary when this is controlled for?

- I found it odd that the study design involved presenting PAIRS of emotion words. How do we know that (some) readers aren’t just reading the leftmost word (esp in study 2 when speed is critical)? This is a methodological detail that should be highlighted earlier on for readers and noted as a limitation. I think it makes interpretation less clear cut..

- I’m not sure I follow the authors’ PCA analysis. Specifically, I think it’s odd to add in valence/arousal values, especially when these values are essentially made up by the authors. Are there any normative data that they could use instead? Or instead, I would just encourage the authors to run the PCA on the temperature analyses and then show that the two axes essentially line up with valence and arousal. Right now, they make interpretations of how “valence was positively related to ambient temperature (20 °C)” and that “valence was related to ambient or comfortable temperature concepts and arousal was related to higher temperatures,” but I don’t think these interpretations are really logical conclusions from PCA… The authors essentially just made up the valence/arousal values, and factors are only associated with certain variables after controlling for other factors… I like the idea of applying PCA, but I don’t think the way they’re executing/interpreting it is very strong.

- In fact, my interpretation of the Fig 4 plot is that there is nice evidence that different temperatures are essentially associated with different areas of the circumplex (the “peak” of the wave of emotion associations moves from far right to the middle then to the left of each plot as temperature increases, suggesting that people are essentially moving counterclockwise through the circumplex starting in the low left and ending in the upper middle as temp increases). Is there some way to rethink the analytic plan so that temperature is treated as a continuous variable, rather than a series of independent measures? I can’t think of a way right now, but perhaps consulting with a statistician could reveal some kind of interesting multidimensional scaling approach?

- I also feel like greater statistical expertise might be needed to think through the language analysis… Right now, it seems like the authors correlate matrices that are just average ratings across all speakers of each language… This sucks out all variance within each language, a suboptimal approach. Is there some way to do a nested analysis? Perhaps not, but thinking this through would be helpful.

- I’m glad the authors point out the important limitation that people may have thought of “hot” and “cold” as referring to affective states, not temperatures. Perhaps a future direction would be to use images or phrases associated with hot things in the IAT (e.g., press left if you see a picture of a warm scene/activity or a picture of a positive facial expression. Press right if you see a picture of a cold scene/activity or a negative facial expression).

Smaller concerns

- I’m not sure about the phrase “temperature concepts.” Do humans really have a specific concept around “20 degrees Celsius?”

- I found myself tripping up with interpretation phrases like “participants associated the emotions Enthusiastic/Inspired and Passive/Quiet with 20°C.” It seems like the authors are basing these on the ANOVA results showing that average ratings for the 20°C question are higher for these emotions than others. But just because these ratings are higher for these emotions than others doesn’t really mean that they “significantly associate” these concepts… I feel like two adjustments are needed here: 1) when talking about average ratings in the task just refer to them as “average ratings were higher for X emotion than Y emotion” rather than saying that there were “significant associations” and 2) I might stick to just talking about how temperatures showed “peaks” around certain parts of the circumplex rather than overinterpreting which emotions were higher than all the others.

- In abstract, please specify the Ns of study and clarify which language is studied in Study 2

- In intro, maybe use the phrase “chilled with fear” instead of “cold fear”? I don’t know if I’ve ever heard the second in common parlance.

- How exactly does “this set of emotion words mitigate the risk of vague emotions and poor usability?”

- Could Fig 2 include the average ratings in each cell of the table?

- I think the phrase “on the other hand” is misused in the paper. It is used as a phrase for “additionally” when I think it usually implies “for an opposing perspective.”

- I couldn’t follow the authors’ evolutionary argument about blushing. Why is greater heat loss in these areas adaptive? How this gets at the conceptual overlap between temperature and emotion that the authors are studying?

Reviewer #2: Dear Mr. Escobar,

I have had the opportunity to review the authors’ submission, “Temperature of Emotions”. This paper investigates whether temperatures are systematically and specifically associated with emotions. The authors conduct two studies to assess this relationship: In study 1, individuals in four cultures, evaluated 12 emotion terms (sampled from around the circumplex) on five temperatures (ranging every 10 degrees C from 0 to 40). In study 2, an adapted version of the IAT was used to see whether (participants in English) showed implicit biases to happy (+ valence)/active (high arousal) and warm pairings, and unhappy (- valence)/passive (low arousal) and cold pairings.

Overall, this paper is extremely well-written, with a solid introduction and review of the extant literature, as well as sound in design and analyses. The results are straight-forward, aligned with the authors’ hypotheses, and the implications for importance are well-stated. I was also impressed by the detail to design (counterbalancing in both studies, use of the SAM in study 1, and the statistical presentation (CIs, comparison of effects sizes). Figures were nicely displayed and all statistics conformed to the latest recommended APA standards and were thoughtfully-conducted.

The only criticism I have is one already noted by the authors. That is, the collection of reaction time on individual devices, which vary in speed, etc. Although the study is within-subjects (helping to reduce differences among platforms/computer speeds), I still find it concerning to rely on differences of < 200 ms as statistically different when reported from uncontrolled/standardized devices. There is not much to be done, at this point, but perhaps a replication in the lab is possible in the near future (I am assuming in person data collection was limited as a result of the COVID pandemic).

I find the overall subject to be of interest and timely, and of appropriate content for this journal. It not usual that I have few to no concerns of criticisms before publication. As it stands, I only have a few clarifying points.

Minor Criticisms:

1. It would be interesting to know in Study 1 the location (country) from which participants originated or currently-lived. This might help disentangle cultural from linguistic effects. Relatedly, in Study 2, it would be nice to know whether English-speaking participants (all living in the UK) were familiar with another language.

2. I am not sure how ATR statistics (used through R) are similar/different to the Wilcoxon non-parametric signed-based statistics. It would be helpful to make a comparison to these more “common” statistics. There seems to be some debate as to whether homogeneity of variances is required for the Wilcoxon (which you say you do not have).

3. Although the results for Study 1 are clear and presented both across languages/cultures and for each separately, I would like to see some discussion (even if speculative) as to why Chinese and Spanish showed higher correlation than presumably between Chinese and Japanese (because it is not listed as higher or lower). To that end, it would also be interesting to expound on why there are specific some cultural/linguistic differences (albeit minimal to overwhelming consistent pattern across languages).

4. I would appreciate a further discussion of the improved scoring methods of the d statistic of Greenwald and colleagues. I do not follow the use of replacing the error trials with the mean RT + 2 SDs.

Overall, I believe that the research is potentially interesting and worthy of publication.

Thank you for the time to review this paper.

Kind Regards,

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Jennifer M B Fugate

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Jun 3;16(6):e0252408. doi: 10.1371/journal.pone.0252408.r002

Author response to Decision Letter 0


22 Apr 2021

Dear Dr. Eisenbarth,

We thank you for your time and the oppotunity to revise and improve our manuscript. Attached, you will find the response to reviewers and the manuscript with and without track changes in PDF format, as well as their LaTeX source files.

Best wishes,

Francisco Barbosa Escobar, on behalf of all authors.

Attachment

Submitted filename: Response to Reviewers.pdf

Decision Letter 1

Hedwig Eisenbarth

7 May 2021

PONE-D-20-33913R1

The temperature of emotions

PLOS ONE

Dear Dr. Barbosa Escobar,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Thank you for submitting your revised version, it addresses the points of the reviewer very well. Both reviewers just had some minor revision suggestions, which should be easy to address so I invite you to make those revisions.

Please submit your revised manuscript by Jun 21 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Hedwig Eisenbarth

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

Thank you for submitting your revised version, it addresses the points of the reviewer very well. Both reviewers just had some minor revision suggestions, which should be easy to address so I invite you to make those revisions.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have done a great job incorporating edits and the manuscript is much improved. I just have a few small points on the revision that I think will improve interpretability.

- PCA results are interesting. Dim 1 seems to be arousal and Dim 2 is valence. This is opposite most findings (Dim1 = valence, Dim 2 = arousal), but it sometimes happens depending on the stimuli included. But I think it needs to be narrated for readers a bit. Perhaps labeling the axes, adding notes in the main text, and even labeling the quadrants would be helpful. I also don’t think you need to interpret 20 degrees “aligning” w the vertical axis and 30 degrees “aligning” w horizontal axis (alignments are weak and not quite sure how to interpret them…). Finally, the rotation is described as counterclockwise around the circumplex, but doesn’t increasing temp move clockwise on the PCA projection? In the discussion I agree that it moves counterclockwise in a “canonical” circumplex, but the differences between what is found canonically and what is presented in the figure are never clarified for readers.

- The LMM analysis is v important and interesting. I think the results could be more fully discussed. In particular, there are some interesting differences between languages that are not explored at all. There’s a few sentences about it in the general discussion, but talking through a few of the findings in the results of Study 1 seems merited.

Reviewer #2: Dear Dr. Escobar,

Thank you for your revision on the ms: “The temperature of emotions”. I found that it addressed my initial concerns and those brought up by the other reviewers. I found myself actually agreeing with many of the initial points of the other reviewers, despite my very positive initial review. To that end, you have not only acknowledged and sufficiently addressed my concerns, but you have also addressed their concerns (to my satisfaction, although of course they may disagree).

The one point that I did not mention initially, and would like to strongly recommend you elaborate upon even a bit more, is the theoretical grounding of Psychological Constructionism. In fact, I have published on this work extensively, and have a color-emotion paper that uses the Theory of Constructed Emotions (Barrett, 2006, 2019) to explicitly test whether colors and emotions pairings are both specific and consistent (as that theory would expect). I believe that you would find that paper informative and perhaps some of the language within the rationale might even help you frame your comment to reviewer 1, comment 2.

Beyond that, I am happy and satisfied with the revisions. I will recommend to the editor that your submission be published.

Kind Regards,

Jennifer Fugate

________

References:

Fugate, J. M. B., & Franco, C. L. (2019). What color is your anger? Assessing color-emotion pairings in English speakers. Frontiers in psychology, 10, 206.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Jennifer M.B. Fugate

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Jun 3;16(6):e0252408. doi: 10.1371/journal.pone.0252408.r004

Author response to Decision Letter 1


11 May 2021

Dear Dr. Eisenbarth,

We are grateful for your time and the opportunity to revise and improve our manuscript.

Attached, you will find the response to reviewers and the manuscript with and without

track changes in PDF format, as well as their LaTeX source files.

Best wishes,

Francisco Barbosa Escobar, on behalf of all authors.

Attachment

Submitted filename: The temperature of emotions_response to reviewers.pdf

Decision Letter 2

Hedwig Eisenbarth

17 May 2021

The temperature of emotions

PONE-D-20-33913R2

Dear Dr. Barbosa Escobar,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Hedwig Eisenbarth

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have addressed all my concerns and have produced a nice contribution to the field. Congrats!

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Acceptance letter

Hedwig Eisenbarth

24 May 2021

PONE-D-20-33913R2

The temperature of emotions

Dear Dr. Barbosa Escobar:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Hedwig Eisenbarth

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.pdf

    Attachment

    Submitted filename: The temperature of emotions_response to reviewers.pdf

    Data Availability Statement

    All data and scripts associated with the manuscript are available in OSF. DOI: 10.17605/OSF.IO/TCBG5 URL: https://osf.io/tcbg5/.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES