Abstract
The COVID-19 pandemic has altered our routines, our conversations, the specific social contexts in which we hear or use certain words, and potentially, the representation of the words related to the disease and its consequences. Here we investigated whether the effects of the pandemic have changed the representation of the affective features of COVID-19-related words. To this aim, we collected new ratings of valence (from unpleasant to pleasant) and arousal (from calm to activated) dimensions for COVID-19-related words (e.g., hospital) and COVID-19-unrelated words (e.g., whale). Subsequently, we compared these scores with those from databases that reported ratings for the same pool of words before the pandemic. Our results showed significant changes in arousal for COVID-19-related words but not unrelated words, thus revealing that the pandemic social context modified their affective representation. These findings support the flexibility of emotional representations and the malleability and dynamicity of the mental lexicon as a function of contextual factors.
Keywords: Emotional words, COVID-19, Semantic representation, Lexical processing, Arousal
1. Introduction
Social context, defined as the specific environment that shapes directly or indirectly our day-to-day experiences, affects behavior and emotions. Critically, the relationship between the individuals and the social framework is dynamic, as the emotional processes experimented by individuals are an active function of social events (Jakobs et al., 1996). Historically, emotions have been understood as intraindividual phenomena shaped by elements such as individual subjectivity, cognitive appraisals, and specific bodily changes (Fischer et al., 2003). However, at present, social context, referring to both a concrete social event and the persons' reactions to a particular event, has been claimed to influence emotional processing, thus suggesting its major role in the triggering and modulation of emotions (van Kleef et al., 2016).
Regarding social context, at the beginning of the second decade of the 21st century, the more pressing social framework has been the COVID-19 pandemic. This disease has provoked a radical change in the daily life of all people in the entire world. In this line, an increasingly larger number of recent studies have highlighted the existence of psychological (e.g., Xiong et al., 2020) and emotional consequences of the COVID-19 on worldwide society (Canet-Juric et al., 2020; Steinert, 2020; Stieger et al., 2021).
Of particular interest to the present study, the measures taken by governments to contain disease transmission, including quarantine, social isolation, social distancing, as well as the prohibition of many regular activities (e.g., being separated from the loved ones, loss of freedom, and the fear of infection) have caused a general decline in overall mood and dominance of negative feelings (e.g., see Gismero-González et al., 2020; Pérez-Fuentes et al., 2020). Furthermore, the pandemic has triggered a deterioration of the mental well-being of individuals, as shown when comparing emotions before and at the time of the pandemic through different psychological and emotional online surveys (e.g., see Rothe et al., 2021). In the same vein, there has been a decrease in different emotional states, like worry, fear, boredom, and anger/annoyance during the COVID-19 pandemic over time (Sadiković et al., 2020). Similarly, other investigations (e.g., Canet-Juric et al., 2020) have shown that as negative emotions (such as depression) tended to increase slightly, levels of anxiety and affect (positive and negative) tended to decrease during the COVID-19 pandemic.
Since the particular social context that constitutes the COVID-19 pandemic influences how we think and feel, it could also affect how we interact and communicate with each other (Calbi et al., 2021). Regarding communication, it has been claimed that a primary function of words consists of shaping the way we interact with the physical and social environment around us (Borghi et al., 2018). More precisely, words are physical tools within our social niche, as they dynamically interact with social context.
The reason why words constitute a relevant social tool is that they are a way to physically embody (both phonetically and graphically) of our thoughts and feelings, as they serve us to encode and decode people's ideas, general knowledge, intentions, and senses (Dove, 2014). Hence, the mental representation of words crucially includes their emotional features (Citron, 2012; Hinojosa et al., 2009; Kuperman et al., 2014), based on dimensional approaches to emotion (Russell, 2003) like valence (from pleasant to unpleasant) and arousal (from calming to exciting). Both dimensions tend to be associated by a U-Shaped quadratic relationship: words with positive and negative valence tend to be more arousing than neutral ones (Gobin et al., 2017; Hinojosa et al., 2020).Regarding the dynamic interaction between social context, emotions, and communication (van Kleef et al., 2016), it is feasible to consider whether social context (in this case, the pandemic) can influence or change the emotional features of words (that is, valence and arousal). Indeed, several recent studies have analyzed this relationship between emotional communication and the present social framework through press headlines (Aslam et al., 2020), digital systems, and social media statements (Steinert, 2020). In the first case, the headlines (Aslam et al., 2020) were classified into positive, negative, and neutral sentiments after calculating unbounded text polarity at the sentence level score and incorporating the valence shifters. Aslam et al. (2020) showed that the news headlines yielded high emotional scores with a negative polarity. More precisely, around 52 % of the news headlines evoked negative feelings, and only 30 % evoked positive sentiments, while 18 % were neutral. This research revealed that news headlines had an impact in individuals' affective experience, which might had implications for the representation of the emotional features (either valence, arousal or both) of COVID-related concepts. When analyzing social media statements, Steinert (2020) found similar evidence and suggested that it was the result of a change in persons' value structure due to the pandemic, where emotions are predominantly negative, thus resulting in a generally negative emotional climate.
Importantly, few studies have analyzed whether the specific social context created by the pandemic has changed the evaluation of the emotional features of words per se, that is, taking as the object of study words and not sentences. Keep in mind that words constitute the main and more essential pieces of communication (i.e., they are like cells for biologists). In this regard, a recent study that studied implicit COVID-19 behaviors using affective priming techniques showed that, although individuals consciously rated COVID-related words as unpleasant, no affective priming effect was observed with these lexical units (Moro & Steeves, 2021). This effect could be explained in terms of lack of changes in the representation of the emotional features of the unpleasant COVID-related meanings despite the explicit rating of these words as unpleasant, thus showing on the one hand a differential processing and evaluation of words that allude to emotional aspects of the pandemic, and a potentially unaltered implicit representation, on the other hand.
In this line, the main aim of the present study consists of analyzing whether a particular social context, the COVID-19 pandemic, has modulated the mental representation of emotional COVID-19-related words. For this purpose, we collected new ratings of valence and arousal dimensions for a large set of COVID-19-related words (e.g., hospital, hug, kiss, subway), and COVID-19-unrelated words (e.g., anger, humor, neckline). Subsequently, we compared these scores with those from databases that reported ratings for the same pool of words before the pandemic (Stadthagen-Gonzalez et al., 2017).
Despite the absence of specific knowledge about the pandemic as a social framework that may modulate the affective mental representation of lexical units, we should take into consideration recent investigations (e.g., Lusnig et al., 2021) that revealed the fundamental importance of external context in the alteration of the affective-emotional processing of words. In this line, a recent study on meditation has shown that after a meditation process of seven weeks, the two meditation groups (mindfulness and loving-kindness) rated the valence of nouns as more neutral than the control group, pointing to a general regulation in the processing of emotional lexical units. In addition, in the loving-kindness group, positive words were rated as more positive than in the control group, suggesting an intensification of positive feelings. Moreover, other studies have also shown the contribution of similar meditation practices to the regulation of emotions, not only in general aspects (Brefczynski-Lewis et al., 2007; Desbordes et al., 2012), but also in the neutralization of valence ratings of emotional words (Lusnig et al., 2020), pointing to the noticeable malleability of the lexicon due to external factors. With these findings in mind, in the present study we aimed at investigating whether an external generalized social, emotional and medical situation such as the COVID-19 pandemic could also modulate the processing of emotional lexical items. Considering that the representation of the affective features of words involves the combination of mainly verbal information, affective experience and motor components associated to emotions (Hinojosa et al., 2020), we hypothesized that the affective experience related to the COVID-19 pandemic may have altered the emotional representation of the notions depicted by COVID-related words.
In sum, in the present study we investigated whether the effects of the pandemic have changed the representation of the affective features of recurrent COVID-19-related words. To this end, we obtained valence and arousal ratings for COVID-19-related and unrelated matched words and contrasted them taking the ratings obtained before the pandemic into account. Considering the idiographic malleability of the cognitive organization of affect, we tentatively hypothesized that the pandemic context would modify the affective representation and evaluation of emotional words, and consequently predicted changes in the ratings for COVID-19-related words, but not for COVID-19-unrelated words. This outcome would support the idea that the emotional dimensions of words constitute a function of social factors, and speak for the flexibility of emotional representations and the malleability and dynamicity of the lexicon. The current study was carried out in Spain during the COVID-19 pandemic, a country in which the pandemic situation yielded the imposition of a long national lockdown between March 2020 and June 2020, which occurred before this research was conducted. The impact of the COVID-19 pandemic in this country has been disproportionately high as compared to other neighboring countries; thus, one would expect that the effects derived from the pandemic could have extended to different domains.
2. Methodology
2.1. Participants
A total of 263 voluntary participants, all adult native Spanish speakers, took part in our study. To decide sample size, we assumed a Cohen's f of 0.25 (i.e., a medium-sized effect), an alpha of 0.05, and a statistical power of 0.95 in a two-tailed repeated-measure test with GPower (Faul et al., 2009), for which N was 210. We collected data from more participants because we assumed that a small proportion of participants would not fully complete the survey. We only accepted responses from those 210 who completed the survey (169 women, 80.5 %; mean age = 24.32 [SD = 7.79]). Their mean perceived socioeconomic status was 6.19 (measured on a scale from 1 to 10). Regarding their education level, 103 participants had completed high school, 55 had completed a master's degree, 45 had completed a bachelor's degree, three had completed a Ph.D., and four had completed professional training. Participants were recruited from participant databases of Universidad Nebrija, Universidad Complutense de Madrid, and Universitat de València. To motivate their participation, they were entered in a drawing to win one of ten 25 € Amazon-vouchers after completing the study. The study was approved by the Ethics Committee of Nebrija University in February 2021 and participants filled an informed consent before starting.
2.2. Materials
The experimental material was extracted from Stadthagen-Gonzalez et al. (2017) database. This database was created with responses from participants that were of similar characteristics to the ones tested in the current study: undergraduate Spanish native speakers that rated valence (350 participants: 80 % female; mean age: 22.3), and arousal (395 participants: 82.7 % female; mean age: 22.5).
390 words were chosen. Of these, 150 words whose emotional and semantic features were COVID-19-related. These words were semantically and emotionally most closely related to the symptoms of the pandemic, the hygiene and distance from family and friends to avoid contagion or the rules imposed by the authorities (e.g., abrazo [hug in Spanish], hospital [hospital]). Another set of 150 COVID-19-unrelated words was also selected (e.g., elogio [compliment], infarto [heart attack]). Finally, 90 not emotionally loaded words were included as fillers in order to create a distraction from the critical items (e.g., poesía [poetry], jersey [pullover]). The COVID-19-unrelated words were selected controlling for a similar rating of valence and arousal than the COVID-19-related words (±0.5 punctuation). COVID-19-related words were selected to cover the whole valence and arousal spectra (see Appendix A), and the distribution of positive/negative and arousive/non-arousive COVID-19-related and unrelated words was similar. To verify that there were no differences between COVID-19-related and unrelated words in the pre-pandemic database (Stadthagen-Gonzalez et al., 2017), we computed a paired t-test comparing these values. Results showed there were virtually no differences between the two levels of the COVID-19 Relatedness condition (related vs. unrelated) for both arousal (t(149) = 0.024, p = .981) and valence (t(149) = −0.325, p = .746).
In order to minimize the experiment duration for participants and to avoid cross-dimensional contamination in the ratings (i.e., scores in valence do not bias ratings in arousal), the total list of 390 words (COVID-19-related, COVID-19-unrelated, and Fillers) was divided into two different lists (195 words within each one: 75 COVID-19-related, 75 COVID-19-unrelated, and 45 fillers), to create the two questionnaires for the participants to evaluate Valence and Arousal. Words were presented randomized within each list. In this line, the 4 lists (the two of Valence and the two of Arousal) were considered as 4 different experiments. They were randomized, so each participant entered to only one of them randomly. The experiments were created using the digital tool LimeSurvey and they were displayed on the subjects' personal computer.
2.3. Procedure
The experiment was conducted online. The link to the survey was sent to the participants via an e-mail invitation. After reading the instructions and filling the consent form, participants completed a sociodemographic questionnaire, which contained questions regarding their native language (which was restricted to Spanish), their vision quality, and their demographic information (i.e., age, gender, education level and socioeconomic level). Then, participants were asked to assess either the Arousal or the Valence of each item on a 9-point Likert-like scale ranging from 1 (calming, for the Arousal task; unpleasant for the Valence task) to 9 (activating for the Arousal task, pleasant for the Valence task). In both cases, intermediate ratings (i.e., 5) would indicate neutral arousal or valence. Participants were asked to rate each item based on their first impression without spending much time to decide. Participants took around 15 min to complete the survey.
3. Results
A total of 263 participants initiated the survey but 56 of them did not complete it (21.29 % of the total), making a final pool of 207 participants. Additionally, we removed from the analysis the data from participants who 1) indicated they had vision problems (not corrected), 2) indicated they did not read or understand the instructions, and 3) took the survey in <7.5 min (11 participants; 5.24 % of the total). In sum, 199 participants composed the final pool of analysis. Table 1 shows the mean ratings per COVID-19 Relatedness condition for each measure and time point, and Fig. 1 shows the distributions of the ratings and the relationship between the two dependent measures per condition and time point.
Table 1.
Descriptive statistics of the valence and arousal ratings split by moment (before or during the COVID-19 pandemic) and type of word (COVID-19-related and -unrelated).
| COVID-19 relatedness | Valence |
Arousal |
|||
|---|---|---|---|---|---|
| Pre-COVID-19 | COVID-19 | Pre-COVID-19 | COVID-19 | ||
| Mean | Related | 4.41 | 4.22 | 6.10 | 5.70 |
| Unrelated | 4.50 | 4.24 | 6.10 | 5.55 | |
| Median | Related | 3.50 | 3.46 | 6.35 | 6.03 |
| Unrelated | 3.71 | 3.70 | 6.43 | 5.76 | |
| Standard deviation | Related | 2.25 | 2.34 | 1.29 | 1.54 |
| Unrelated | 2.20 | 2.12 | 1.23 | 1.51 | |
| Minimum | Related | 1.15 | 1.27 | 2.50 | 2.30 |
| Unrelated | 1.30 | 1.24 | 2.85 | 2.06 | |
| Maximum | Related | 8.60 | 8.43 | 8.25 | 7.89 |
| Unrelated | 8.60 | 8.35 | 8.23 | 8.10 | |
Fig. 1.
Distributions of the ratings for valence (panel A) and arousal (panel B), together with the relationship between the two variables (panel C) before the COVID-19 pandemic (pre-COVID-19, top charts), and during it (COVID-19, bottom charts) for COVID-19-related and -unrelated words (in light and dark grey, respectively).
We carried out two linear regression analyses (one for Valence and another one for Arousal) and a series of ANCOVAs in R (R Core Team, 2020) to examine whether the factor COVID-19 Relatedness influenced the valence and arousal scores given by the participants.
3.1. Valence
The ratings in valence given during the COVID-19 pandemic were included as the dependent variable, COVID-19 Relatedness (related, unrelated) was included as a factor, and the pre-pandemic valence ratings were added as a covariate. The interaction between the Relatedness and Pre-pandemic valence was also included to examine the potential differences as a function of the valence (see Fig. 1 for evidence of the binomial distribution of valence ratings). The resulting regression model was significant (adjusted R2 = 0.957, F(3,296) = 2214, p < .001). As expected, we found a main effect of pre-pandemic ratings (t = 60.35, p < .001) as well as a main effect of COVID-19 Relatedness (t = 2.05, p = .042). The interaction between the two variables was also significant (t = −2.88, p = .004). That is, the relationship between pre- and post-COVID-19 was different for COVID-19 related words and COVID-19 unrelated words. Specifically, this interaction revealed that, for positive words, COVID-19-related words were considered more positive than COVID-19-unrelated words; in contrast, for negative words, the valence ratings did not change as a function of COVID-19 Relatedness (see Fig. 2 ).
Fig. 2.
Panel A) valence. The left chart shows valence ratings post-COVID-19 as a function of ratings pre-COVID-19 as continuous variables separated by COVID-19 relatedness. The middle and right charts show the mean valence rating per type of valence as a function of a categorical classification. Panel B) arousal. The left chart shows arousal ratings post-COVID-19 as a function of ratings pre-COVID-19 as continuous variables separated by COVID-19 relatedness. The middle and left charts show the mean arousal rating by COVID-19 relatedness and time point (pre- and post-COVID-19, respectively). All error bars depict ± 2 standard errors.
To further examine these results, the above analysis was complemented with an ANCOVA that included a categorical classification of the words' valence (i.e., positive, neutral, negative), based on the pre-COVID-19 valence scores (positive = values equal or above M + 0.5 SD [5.57], neutral = values within M ± 0.5 SD [5.57 and 3.35], and negative = values equal or below M-0.5 SD [3.35]). This classification resulted in 55 COVID-19-related high-valence words, 55 COVID-19-unrelated high-valence words, 24 COVID-19-related neutral words, 27 COVID-19-unrelated neutral words, 71 COVID-19-related low-valence words and 68 COVID-19-unrelated low-valence words. Not surprisingly, the continuous pre-pandemic scores showed a significant effect (F(1,293) = 549.84, p < .001, η2 partial = 0.652), indicating that post-pandemic ratings were lower than pre-pandemic ratings (see Fig. 2). The categorical classification of valence was not significant (F(2,293) = 1.36, p = .26, η2 partial = 0.009), nor was the effect of COVID-19 Relatedness (F(1,293) = 1.30, p = .26, η2 = 0.004). More importantly, the interaction between Type of valence and COVID-19 Relatedness was significant (F(2,293) = 7.40, p < .001, η2 = 0.048). Post hoc pairwise tests with Tukey's correction showed that COVID-19-related positive words (namely, highly valenced items) were rated as more positive than the COVID-19-unrelated positive words (t(293) = 3.63, p < .001), while this was not the case for negative and neutral words (all t-values < 1.7; see Fig. 2).
3.2. Arousal
The analyses were parallel to those with valence. The resulting model was significant (adjusted R2 = 0.842, F(2,297) = 799, p < .001). The arousal ratings given before the pandemic were significant predictors of the pandemic ratings in arousal (t = 39.93, p < .001). The COVID-19 Relatedness factor also resulted significant (t = −2.04, p = .042), showing that COVID-19-related words received higher arousal scores than COVID-19-unrelated words (see Fig. 2). Given the distribution of the arousal scores and considering that the addition of the interaction term did not explain additional variance (F(1,296) = 0.645, p = .422), it was not included in the final model.
To further explore these relationships, we also conducted an ANCOVA for arousal ratings, including a categorical classification of pre-pandemic arousal ratings using the same division technique as for valence ratings (i.e., high = values equal or above M + 0.5 SD [6.73], neutral = values within M ± 0.5 SD [6.73 and 5.47], and negative = values equal or below M-0.5 SD [5.47] – note that items were selected to be arousing. The classification resulted in 58 COVID-19-related high-arousal words, 56 COVID-19-unrelated high-arousal words, 48 COVID-19-related neutral words, 49 COVID-19-unrelated neutral words, 44 COVID-19-related low-arousal words and 45 COVID-19-unrelated low-arousal words. The ANCOVA on the arousal ratings also showed a significant effect of COVID-19 Relatedness (F(1,295) = 4.04, p = .045, η2 partial = 0.014), indicating that words related to the COVID-19 pandemic were rated higher than words unrelated to the pandemic (see Fig. 2). As expected, the continuous co-variate of the pre-pandemic scores showed a significant effect (F(1,295) = 205.22, p < .001, η2 partial = 0.410), indicating that the post-pandemic ratings were lower than the pre-pandemic ratings (see Fig. 2). The categorical classification of arousal was not significant (F(2,295) = 0.593, p = .55, η2 partial = 0.004). Given there is no interaction nor effect of the categorical variable of arousal ratings, and because of the continuous nature of this variable, we did not perform further analysis based on the categorical classification of the items.
4. Discussion
Social context, understood as the environmental conditions that shape the individuals' day-to-day experiences, influences behavior, thoughts, and emotions. Therefore, the relationship between external framework, emotions, and communication is assumed to be continuously dynamic, since they are constantly influencing each other over time (Jakobs et al., 1996; van Kleef et al., 2016). In this line, as the main pieces of human communication, words can shift their affective representations due to changes in the external context (Lusnig et al., 2021). In recent days, the most relevant global social context has been the COVID-19 pandemic. The consequences of the pandemic (e.g., self-isolation, distancing from loved ones, etc.) have resulted in a psychological and emotional weakening of people around the world (Pérez-Fuentes et al., 2020; Rothe et al., 2021; Steinert, 2020; Stieger et al., 2021).
The present study analyzed whether the COVID-19 pandemic as a specific social context changed the emotional evaluation of COVID-19-related words (hospital, hug, pandemic, subway). To this aim, we collected new ratings of valence and arousal for COVID-19-related and unrelated sets of words to compare those values with those for the same pool of words but extracted from a pre-COVID database (Stadthagen-Gonzalez et al., 2017). On the one hand, valence ratings in the present database were not different between words that were related to COVID-19 and those that were not related. Curiously enough, a significant difference in post-COVID-19 valence values was shown for high-valence COVID-19-related words (positive words), which resulted in higher valence ratings than the corresponding COVID-19-unrelated control words. While the origin of this effect is unclear, we tentatively suggest that it could be partially due to a boosting effect derived from the nostalgia due to the absence, loss, or difficulty of accessing the realities depicted by these concepts (e.g., kiss, hug). In addition, this effect may also explain the apparently counterintuitive effect of the lack of differences in neutral and negative words. We interpret these findings as showing that the changes in the processing and possibly in the representation of the positive words could be due to a nostalgia boosting effect, which would also explain why the notions designated by neutral and negative words showed the same values as in the pre-pandemic period, revealing no alteration (e.g., medication, wash, deceased, fear, depression).
Apart from that, and more importantly, these findings revealed an effect of COVID-19 relatedness in the evaluation of arousal: COVID-19-related words were rated higher in arousal than COVID-19-unrelated words during the pandemic—critically, these words showed similar ratings in pre-pandemic databases—. This dissociation favors the idea that the COVID-19 pandemic could have changed the representation of the affective features of words, as it can be observed a general decrease of arousal values regarding the pre-pandemic ratings, suggesting certain degree of pandemic fatigue (see Rudroff et al., 2020). This pandemic fatigue effect could be influenced by the general deterioration of people's mental well-being and lowering of general mood (Gismero-González et al., 2020; Pérez-Fuentes et al., 2020; Rothe et al., 2021), as the emotional representation of concepts is partially related to human beings' own affective experience (Hinojosa et al., 2020).
We acknowledge, however, that a limitation of the present study is that different participants completed the pre- and post-pandemic data collections, and that the potential contribution of additional factors cannot be dismissed. Nonetheless, the critical differential effect between the arousal ratings for COVID-19-related and unrelated terms can hardly be explained by between-subject differences among the samples. Moreover, the number of words that were shown to participants was large, as well as their representativeness of a wide range of semantic contexts, which can reduce the impact that individual variables may have. In addition, participants' sociodemographic information from pre- and post-pandemic data collections are very similar in terms of age and gender (see Method section), making them comparable.
Considering that emotional experience is one of the main factors that can alter the affective representations of concepts depicted by words (Hinojosa et al., 2020), and in light of the current results, we believe that the pandemic and its consequences as a relevant social context could have changed the emotional representations of COVID-related notions. However, the reversibility of these changes remains an open question. We tentatively suggest that the representation of emotional features is dynamic, so that new affective experiences linked to these COVID-related concepts may progressively modify their semantic representations reverting them to their pre-pandemic baselines. Of note, a recent study has revealed a dissociation between the explicit assessment of word emotional features and the implicit representation of these properties (Moro & Steeves, 2021). Thus, although participants in their study rated as unpleasant different COVID-related words, no affective priming effect (a marker of implicit attitudes) was observed for this type of words, revealing a lack of interiorization of COVID-related notions. Nonetheless, future studies should expand the present research by using longitudinal approaches that will draw conclusions about the evolution of the affective representations of COVID-related words in the human mind over time. Moreover, the role of individual variables that can also modulate the affective evaluation of words should be considered, such as age (Fairfield et al., 2017), health condition (Tárrega et al., 2021) and cognitive resources (Gasper & Hackenbracht, 2015).
In summary, this study is pioneering in demonstrating how the COVID-19 pandemic, understood as a specific social context, has changed the emotional evaluation of words. Individuals consistently report higher arousal levels for COVID-19-related words, suggesting that the COVID-19 lexicon results in higher levels of activation than COVID-19-unrelated words. Besides, positive COVID-19-related words showed higher valence ratings (namely, were rated as more positive) than positive COVID-19-unrelated words, suggesting a nostalgia boosting effect. These findings favor the idea that the emotional dimensions of words are markedly influenced by social factors, thus revealing the dynamicity of the emotional lexicon resulting from an idiographic plasticity of the cognitive organization of affect.
Declaration of competing interest
The authors of the article entitled “Social context effects on emotional language: The influence of the COVID-19 pandemic on the emotional evaluation of words” hereby declare that this study has been conducted in the full absence of conflicts of interest.
Acknowledgments
This research has been partially funded by grants PID2021-125842NB-I00 and PID2021-126884NB-I00 from the Spanish Government, ISERI from the BBVA Foundation, and H2019/HUM-5705 from the Comunidad de Madrid.
Appendix A.
| COVID-19-related | Valence | Arousal | COVID-19-unrelated | Valence | Arousal |
|---|---|---|---|---|---|
| abrazo (hug) | 8.5 | 4 | delicia (delight) | 8.2 | 4.35 |
| abuelo (grandpa) | 8.5 | 4.4 | dulce (sweet) | 8.25 | 4.6 |
| aburrimiento (boredom) | 2.7 | 3.8 | insignificante (insignificant) | 3.15 | 4.3 |
| acompañar (accompany) | 7.05 | 4.2 | voluntaria (voluntary) | 6.9 | 4.45 |
| adversidad (adversity) | 2.85 | 6.55 | asustadizo (scary) | 3.15 | 6.7 |
| aerolínea (airline) | 5.8 | 5.9 | alabanza (praise) | 6.1 | 5.95 |
| afecto (affection) | 7.9 | 4.65 | jamón (ham) | 7.6 | 4.7 |
| aglomeración (agglomeration) | 4.05 | 6.3 | alucinación (hallucination) | 4.25 | 6.6 |
| agobiado (overwhelmed) | 1.88 | 7.8 | atracador (robber) | 2 | 7.75 |
| agonía (agony) | 2.3 | 7.75 | tiroteo (shooting) | 2.2 | 7.75 |
| agotamiento (exhaustion) | 2.95 | 4.2 | arzobispado (archbishopric) | 3.2 | 4.32 |
| aislamiento (isolation) | 3.05 | 6.15 | sacerdotal (priestly) | 3.5 | 4.3 |
| alegría (joy) | 8.35 | 6.75 | genial (genius) | 8.05 | 6.65 |
| alimentación (feeding) | 7.4 | 4.8 | intelectual (intellectual) | 7.65 | 5 |
| alivio (relief) | 8 | 2.95 | jardín (garden) | 7.85 | 3 |
| ambulancia (ambulance) | 3.3 | 6.98 | inadmisible (unacceptable) | 3.5 | 6.7 |
| amenaza (threat) | 2.68 | 7.77 | maníaco (maniac) | 2.38 | 7.43 |
| angustia (anguish) | 1.95 | 7.25 | hambruna (famine) | 1.95 | 7.35 |
| ansiedad (anxiety) | 2.1 | 7.7 | fracasar (fail) | 2.3 | 7.25 |
| antídoto (antidote) | 6.5 | 5.5 | empezar (start) | 6.55 | 5.8 |
| aplaudir (clap) | 7.3 | 7 | exótico (exotic) | 7.3 | 7.1 |
| apoyo (support) | 7.75 | 3.95 | bonito (nice) | 7.7 | 4 |
| ataúd (coffin) | 1.46 | 7.33 | sexo (sex) | 7.7 | 7.43 |
| aterrador (frightening) | 2.8 | 7.65 | explosión (explosion) | 3.1 | 7.55 |
| avión (plane) | 6.53 | 6.4 | escote (neckline) | 6.25 | 6.3 |
| balcón (balcony) | 6.9 | 5 | collar (necklace) | 6.8 | 5.05 |
| bar (bar) | 6.55 | 5.98 | oso (bear) | 6.65 | 5.85 |
| beso (kiss) | 8.2 | 6.88 | gozar (enjoy) | 8.25 | 6.7 |
| cadáver (corpse) | 1.73 | 7.9 | machista (macho) | 1.8 | 7.85 |
| caos (chaos) | 3.13 | 7.75 | furia (fury) | 3.15 | 8.05 |
| catástrofe (catastrophe) | 1.5 | 7.7 | desnutrición (malnutrition) | 2 | 7.85 |
| cerrado (closed) | 3.45 | 5.3 | omisión (omission) | 3.2 | 5.35 |
| cerveza (beer) | 7 | 6 | infinito (infinity) | 7.15 | 5.95 |
| chino (Chinese) | 5.35 | 4.35 | avena (oatmeal) | 5.3 | 4.3 |
| colegio (school) | 6.45 | 4.5 | ballena (whale) | 6.4 | 4.6 |
| confinamiento (confinement) | 3 | 6 | degeneración (degeneration) | 2.65 | 6.05 |
| contagio (contagion) | 1.95 | 6.95 | avaricia (greed) | 2.15 | 6.95 |
| convivencia (cohabitation) | 6.9 | 5.05 | beneficiado (beneficiary) | 6.9 | 5.2 |
| crisis (crisis) | 2.23 | 7.18 | verdugo (executioner) | 2.5 | 7 |
| cuarentena (quarantine) | 2.8 | 6.95 | manicomio (madhouse) | 2.65 | 6.95 |
| culpable (guilty) | 2.85 | 7.25 | dinamita (dynamite) | 2.8 | 7.3 |
| dañino (harmful) | 2.25 | 6.95 | enfado (anger) | 2.3 | 6.83 |
| depresión (depression) | 1.5 | 6.28 | homicidio (homicide) | 2 | 6.6 |
| desconfianza (distrust) | 2.9 | 7.3 | persecución (persecution) | 3 | 7.45 |
| desesperación (despair) | 2.45 | 6.6 | impertinente (impertinent) | 2.4 | 7 |
| desgracia (misfortune) | 2.55 | 7.05 | adulterio (adultery) | 2.5 | 7.05 |
| despedida (farewell) | 1.9 | 6.95 | defraudar (disappoint) | 2 | 6.75 |
| difunto (deceased) | 1.65 | 6.75 | fracaso (failure) | 1.95 | 6.8 |
| distanciamiento (distancing) | 2.85 | 5.6 | incomprensible (incomprehensible) | 2.65 | 6 |
| dolor (grief) | 2.15 | 8.25 | odiar (hate) | 2.08 | 7.95 |
| domicilio (domicile) | 6.3 | 3.6 | catacumbas (catacombs) | 3.71 | 6.45 |
| egoísmo (selfishness) | 2.05 | 6.85 | fraude (fraud) | 2.1 | 6.75 |
| empatía (empathy) | 7.55 | 5.45 | avanzar (advance) | 7.65 | 5.6 |
| empobrecimiento (impoverishment) | 1.45 | 6.35 | discriminación (discrimination) | 1.9 | 6.5 |
| encierro (confinement) | 2.85 | 6.5 | calumnia (slander) | 2.7 | 6.7 |
| enfermedad (illness) | 1.75 | 7.58 | bombardeo (bombing) | 1.75 | 7.3 |
| enfermera (nurse) | 5.6 | 5.38 | anticipo (advance) | 5.55 | 5.4 |
| enfermo (sick) | 2.6 | 6.78 | derrama (spill) | 2.6 | 6.6 |
| entierro (burial) | 1.15 | 7.35 | masacre (massacre) | 1.3 | 6.9 |
| epidemia (epidemic) | 1.55 | 7.6 | mentiroso (liar) | 2 | 7.35 |
| erradicar (eradicate) | 4.95 | 5.8 | conducta (behavior) | 5.1 | 5.55 |
| escuela (school) | 6.65 | 4.85 | cocinero (cook) | 6.55 | 5.05 |
| estrés (stress) | 2.33 | 7.78 | infarto (heart attack) | 1.4 | 7.35 |
| fallecimiento (death) | 1.65 | 7.2 | endeudamiento (indebtedness) | 2 | 7.6 |
| familia (family) | 7.88 | 4.25 | elegante (elegant) | 7.45 | 4.5 |
| farmacia (pharmacy) | 5.2 | 4.45 | círculo (circle) | 5.33 | 4.53 |
| fármaco (drug) | 4.2 | 5.6 | clerical (clerical) | 4.44 | 4.44 |
| fiebre (fever) | 2.6 | 6.15 | retraso (delay) | 2.75 | 6.2 |
| fiesta (party) | 7.83 | 7.35 | éxito (success) | 8.18 | 7.1 |
| funeral (funeral) | 1.52 | 6.5 | hipoteca (mortgage) | 1.95 | 6.7 |
| futuro (future) | 6.35 | 6.35 | móvil (mobile) | 6.45 | 6.75 |
| gobierno (government) | 2.9 | 5.75 | desmayo (fainting) | 2.85 | 5.8 |
| gripe (flu) | 2.25 | 6.8 | hundir (sink) | 2.6 | 6.8 |
| guante (glove) | 4.95 | 4.6 | besugo (bream) | 5 | 4.6 |
| hacinamiento (overcrowding) | 3.36 | 6.25 | improcedente (inappropriate) | 3.4 | 6.16 |
| héroe (hero) | 7.4 | 6.2 | juego (game) | 7.45 | 6.35 |
| higiene (hygiene) | 7 | 3.9 | librería (bookstore) | 7 | 3.95 |
| higiénico (hygienic) | 6.7 | 3.5 | angelical (angelic) | 6.7 | 3.35 |
| hospital (hospital) | 3.45 | 6.83 | fantasma (ghost) | 3.75 | 6.9 |
| hotel (hotel) | 7.08 | 4.05 | fresa (strawberry) | 7.05 | 4.35 |
| impotencia (impotence) | 2.8 | 6.95 | dominante (dominant) | 2.8 | 6.85 |
| incertidumbre (uncertainty) | 3.55 | 7.2 | contrarreloj (time trial) | 3.6 | 7.2 |
| incontrolable (uncontrollable) | 3.2 | 7.45 | psiquiátrico (psychiatric) | 3.35 | 7.4 |
| incurable (incurable) | 1.65 | 7.7 | puñalada (stab) | 1.65 | 7.9 |
| ineficaz (ineffective) | 2.8 | 5.7 | estiércol (manure) | 3 | 5.78 |
| inmunidad (immunity) | 6.75 | 4.75 | afirmación (statement) | 6.75 | 4.8 |
| inyectar (inject) | 3.05 | 6.7 | portazo (slam) | 3.05 | 7 |
| irresponsabilidad (irresponsibility) | 3 | 6.5 | desestabilización (destabilization) | 3.3 | 6.55 |
| jabón (soap) | 5.8 | 3.6 | bambú (bamboo) | 5.7 | 4 |
| juventud (youth) | 8 | 5.23 | encantar (love) | 8.05 | 5.45 |
| lavar (wash) | 5.85 | 4.05 | hilo (thread) | 5.75 | 4 |
| libertad (freedom) | 8.6 | 4.68 | simpatía (sympathy) | 8.6 | 4.75 |
| limpieza (cleanliness) | 5.85 | 3.75 | codorniz (quail) | 5.85 | 4 |
| medicamento (medicine) | 4.25 | 5.5 | antagonismo (antagonism) | 4.5 | 5.58 |
| médico (doctor) | 6 | 5.8 | elevar (elevate) | 6 | 5.4 |
| mejoría (improvement) | 7.55 | 4.95 | gustoso (glad) | 7.4 | 5 |
| metro (subway) | 5.3 | 5.45 | brujo (wizard) | 5.3 | 5.4 |
| miedo (fear) | 2 | 8 | bomba (bomb) | 1.75 | 8.23 |
| morir (die) | 1.7 | 7.35 | enojar (anger) | 2.2 | 7.4 |
| muerte (death) | 1.45 | 7.93 | paliza (beating) | 1.65 | 7.9 |
| multa (fine) | 2.1 | 7.3 | balazo (bullet) | 2 | 7.5 |
| multitud (crowd) | 4.45 | 6.2 | borrasca (squall) | 4.25 | 6 |
| navidad (christmas) | 7.55 | 5.95 | elogio (praise) | 7.65 | 5.8 |
| neumonía (pneumonia) | 2.16 | 7.35 | anorexia (anorexia) | 2.3 | 7.05 |
| niño (child) | 7.58 | 5 | ágil (agile) | 7.4 | 4.85 |
| normalización (standardization) | 6.1 | 4.3 | democrático (democratic) | 6.4 | 4.35 |
| nostalgia (nostalgia) | 4.9 | 4.8 | estatura (height) | 5 | 4.8 |
| obediencia (obedience) | 4.5 | 5.65 | carburante (fuel) | 4.6 | 5.65 |
| obsesión (obsession) | 2.68 | 7.15 | ruidoso (noisy) | 2.8 | 7.15 |
| ocio (leisure) | 7.45 | 6.25 | jugar (play) | 7.8 | 6.15 |
| paciencia (patience) | 6.3 | 3.5 | almendro (almond tree) | 6.45 | 3.55 |
| pandemia (pandemic) | 2.21 | 7 | enemistad (enmity) | 2.15 | 7.1 |
| paseo (walk) | 7.3 | 2.5 | monte (mount) | 7.45 | 2.85 |
| patógeno (pathogen) | 3.35 | 6.58 | lumbago (lumbago) | 3.3 | 6.35 |
| peligro (danger) | 2.93 | 8 | gritar (shout) | 3.2 | 7.7 |
| pérdida (loss) | 2.3 | 7.3 | venganza (revenge) | 2.5 | 7.55 |
| pesadilla (nightmare) | 1.8 | 7.6 | terrorismo (terrorism) | 1.6 | 7.55 |
| peste (plague) | 2.32 | 6.65 | peor (worst) | 2.25 | 6.7 |
| plaga (plague) | 2.3 | 7 | mafia (mafia) | 2.2 | 6.95 |
| política (policy) | 3.55 | 6.65 | demandar (sue) | 3.55 | 6.55 |
| preocupación (concern) | 2.35 | 7.3 | esquizofrenia (schizophrenia) | 2.3 | 7.4 |
| prohibición (ban) | 2.65 | 6.7 | profanación (profanation) | 2.65 | 6.74 |
| prudencia (prudence) | 6.4 | 3.7 | inocente (innocent) | 6.6 | 3.75 |
| psicológico (psychological) | 7.2 | 6.55 | submarinismo (diving) | 7.1 | 6.35 |
| quirófano (operating room) | 2.7 | 8.2 | explosivo (explosive) | 2.75 | 7.7 |
| reencuentro (reencounter) | 7.45 | 6.5 | apareamiento (mating) | 7 | 6.5 |
| resfriado (cold) | 2.95 | 5.95 | presidio (prison) | 3 | 5.94 |
| restricción (restriction) | 2.95 | 6.35 | conveniencia (convenience) | 3.05 | 6.4 |
| reunión (meeting) | 5.05 | 5.5 | comino (cumin) | 5 | 5.53 |
| riesgo (risk) | 4.6 | 7.1 | fiera (beast) | 4.55 | 7.2 |
| salud (health) | 8.13 | 4.8 | guapa (pretty) | 7.83 | 5.25 |
| sanidad (healthcare) | 6.3 | 5 | fabricar (manufacture) | 6 | 5 |
| síntoma (symptom) | 3.1 | 6.55 | someter (subdue) | 3 | 6.45 |
| suicidio (suicide) | 1.23 | 7.88 | maltrato (abuse) | 1.65 | 7.45 |
| supermercado (supermarket) | 5.6 | 4.15 | autenticación (authentication) | 5.8 | 4.41 |
| supervivencia (survival) | 6.5 | 6.8 | presentimiento (premonition) | 6.4 | 6.75 |
| temor (fear) | 2.65 | 7.58 | sumiso (submissive) | 2.75 | 4.4 |
| terraza (terrace) | 6.7 | 4.9 | bilingüe (bilingual) | 6.7 | 4.9 |
| terror (terror) | 2.35 | 7.95 | furioso (furious) | 2.55 | 7.8 |
| tos (cough) | 2.95 | 6.8 | rock (rock) | 6.65 | 6.6 |
| transmisión (transmission) | 5 | 5.95 | culminación (culmination) | 5 | 5.85 |
| tratamiento (treatment) | 4.6 | 5.45 | entredicho (interdict) | 4.7 | 5.47 |
| turismo (tourism) | 6.6 | 5.75 | propina (tip) | 6.7 | 5.6 |
| vacuna (vaccine) | 5.05 | 5.55 | rotonda (traffic circle) | 5 | 5.65 |
| vecino (neighbor) | 5.4 | 5.5 | payaso (clown) | 5.55 | 5.5 |
| ventilación (ventilation) | 6.3 | 4.9 | elasticidad (elasticity) | 6.3 | 4.85 |
| viaje (travel) | 8.35 | 6.75 | humor (humor) | 7.93 | 6.75 |
| vida (life) | 8.25 | 6.6 | placer (pleasure) | 8.18 | 6.55 |
| viral (viral) | 3.89 | 6.42 | exigir (demand) | 3.7 | 6.55 |
| vulnerable (vulnerable) | 2.8 | 6 | retrasado (delayed) | 2.83 | 6 |
References
- Aslam F., Awan T.M., Syed J.H., Kashif A., Parveen M. Sentiments and emotions evoked by news headlines of coronavirus disease (COVID-19) outbreak. Humanities and Social Sciences Communications. 2020;7(1):1–9. doi: 10.1057/s41599-020-0523-3. [DOI] [Google Scholar]
- Borghi A.M., Barca L., Binkofski F., Castelfranchi C., Pezzulo G., Tummolini L. Words as social tools: Language, sociality and inner grounding in abstract concepts. Physics of Life Reviews. 2018;29:120–153. doi: 10.1016/j.plrev.2018.12.001. [DOI] [PubMed] [Google Scholar]
- Brefczynski-Lewis J.A., Lutz A., Schaefer H.S., Levinson D.B., Davidson R.J. Neural correlates of attentional expertise in long-term meditation practitioners. Proceedings of the National Academy of Sciences of the United States of America. 2007;104(27):11483–11488. doi: 10.1073/pnas.0606552104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Calbi M., Langiulli N., Ferroni F., Montalti M., Kolesnikov A., Gallese V., Umiltà M.A. The consequences of COVID-19 on social interactions: An online study on face covering. Scientific Reports. 2021;11(1):2601. doi: 10.1038/s41598-021-81780-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Canet-Juric L., Andrés M.L., del Valle M., López-Morales H., Poó F., Galli J.I., Yerro M., Urquijo S. A longitudinal study on the emotional impact cause by the COVID-19 pandemic quarantine on general population. Frontiers in Psychology. 2020;11:2431. doi: 10.3389/fpsyg.2020.565688. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Citron F.M.M. Neural correlates of written emotion word processing: A review of recent electrophysiological and hemodynamic neuroimaging studies. Brain and Language. 2012;122(3):211–226. doi: 10.1016/j.bandl.2011.12.007. [DOI] [PubMed] [Google Scholar]
- Desbordes G., Negi L.T., Pace T.W.W., Alan Wallace B., Raison C.L., Schwartz E.L. Effects of mindful-attention and compassion meditation training on amygdala response to emotional stimuli in an ordinary, nonmeditative state. Frontiers in Human Neuroscience. 2012;6:292. doi: 10.3389/fnhum.2012.00292. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dove G. Thinking in words: Language as an embodied medium of thought. Topics in Cognitive Science. 2014;6(3):371–389. doi: 10.1111/tops.12102. [DOI] [PubMed] [Google Scholar]
- Fairfield B., Ambrosini E., Mammarella N., Montefinese M. Affective norms for italian words in older adults: Age differences in ratings of valence, arousal and dominance. PloS one. 2017;12(1) doi: 10.1371/journal.pone.0169472. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Faul F., Erdfelder E., Buchner A., Lang A.-G. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods. 2009;41:1149–1160. doi: 10.3758/BRM.41.4.1149. [DOI] [PubMed] [Google Scholar]
- Fischer A.H., Manstead A.S.R., Zaalberg R. Social influences on the emotion process. European Review of Social Psychology. 2003;14(1):171–201. doi: 10.1080/10463280340000054. [DOI] [Google Scholar]
- Gasper K., Hackenbracht J. Too busy to feel neutral: Reducing cognitive resources attenuates neutral affective states. Motivation and Emotion. 2015;39(3):458–466. doi: 10.1007/s11031-014-9457-7. [DOI] [Google Scholar]
- Gismero-González E., Bermejo-Toro L., Cagigal V., Roldán A., Martínez-Beltrán M.J., Halty L. Emotional impact of COVID-19 lockdown among the Spanish population. Frontiers in Psychology. 2020;11 doi: 10.3389/fpsyg.2020.616978. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gobin P., Camblats A.M., Faurous W., Mathey S. Une base de l’émotionalité (valence, arousal, catégories) de 1286 mots français selon l’âge (EMA) European Review of Applied Psychology. 2017;67(1):25–42. doi: 10.1016/j.erap.2016.12.001. [DOI] [Google Scholar]
- Hinojosa J.A., Carretié L., Méndez-Bértolo C., Míguez A., Pozo M.A. Arousal contributions to affective priming: Electrophysiological correlates. Emotion. 2009;9(2):164–171. doi: 10.1037/a0014680. [DOI] [PubMed] [Google Scholar]
- Hinojosa J.A., Moreno E.M., Ferré P. Affective neurolinguistics: Towards a framework for reconciling language and emotion. Language, Cognition and Neuroscience. 2020;35(7):813–839. doi: 10.1080/23273798.2019.1620957. [DOI] [Google Scholar]
- Jakobs E., Manstead A.S.R., Fischer A.H. Social context and the experience of emotion. Journal of Nonverbal Behavior. 1996;20(2):123–142. doi: 10.1007/bf02253073. [DOI] [Google Scholar]
- Kuperman V., Estes Z., Brysbaert M., Warriner A.B. Emotion and language: Valence and arousal affect word recognition. Journal of Experimental Psychology: General. 2014;143(3):1065–1081. doi: 10.1037/a0035669. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lusnig L., Radach R., Mueller C.J., Hofmann M.J. Zen meditation neutralizes emotional evaluation, but not implicit affective processing of words. PLoS ONE. 2020;15(2) doi: 10.1371/journal.pone.0229310. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lusnig L., Radach R., Hofmann M.J. Meditation affects word recognition of meditation novices. Psychological Research. 2021 doi: 10.1007/s00426-021-01522-5. Advance online publication. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moro S.S., Steeves J.K. Lack of affective priming indicates attitude-behaviour discrepancy for COVID-19 affiliated words. Scientific Reports. 2021;11(1):1–9. doi: 10.1038/s41598-021-01210-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pérez-Fuentes M.d.C., Molero Jurado M.d.M., Martos Martínez Á., Gázquez Linares J.J. Threat of COVID-19 and emotional state during quarantine: Positive and negative affect as mediators in a cross-sectional study of the Spanish population. PLoS ONE. 2020;15(6) doi: 10.1371/journal.pone.0235305. [DOI] [PMC free article] [PubMed] [Google Scholar]
- R Core Team . R Foundation for Statistical Computing; Vienna, Austria: 2020. R: A language and environment for statistical computing.https://www.R-project.org/ [Google Scholar]
- Rothe J., Buse J., Uhlmann A., Bluschke A., Roessner V. Changes in emotions and worries during the Covid-19 pandemic: An online-survey with children and adults with and without mental health conditions. Child and Adolescent Psychiatry and Mental Health. 2021;15(1):11. doi: 10.1186/s13034-021-00363-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rudroff T., Fietsam A.C., Deters J.R., Bryant A.D., Kamholz J. Post-COVID-19 fatigue: Potential contributing factors. Brain Sciences. 2020;10(12):1012. doi: 10.3390/brainsci10121012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Russell J.A. Core affect and the psychological construction of emotion. Psychological Review. 2003;110(1):145–172. doi: 10.1037/0033-295X.110.1.145. [DOI] [PubMed] [Google Scholar]
- Sadiković S., Branovački B., Oljača M., Mitrović D., Pajić D., Smederevac S. Daily monitoring of emotional responses to the coronavirus pandemic in Serbia: A citizen science approach. Frontiers in Psychology. 2020;11:2133. doi: 10.3389/fpsyg.2020.02133. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stadthagen-Gonzalez H., Imbault C., Pérez Sánchez M.A., Brysbaert M. Emotional norms for spanish words 1 norms of valence and arousal for 14,031 spanish words. Behavior Research Methods. 2017;49(1):111–123. doi: 10.3758/s13428-015-0700-2. [DOI] [PubMed] [Google Scholar]
- Steinert S. Corona and value change. The role of social media and emotional contagion. Ethics and Information Technology. 2020:1–10. doi: 10.1007/s10676-020-09545-z. Advance online publication. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stieger S., Lewetz D., Swami V. Emotional well-being under conditions of lockdown: an experience sampling study in austria during the COVID-19 pandemic. Journal of Happiness Studies. 2021:1–18. doi: 10.1007/s10902-020-00337-2. Advance online publication. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tárrega J., Perea M., Rojo-Bofill L.M., Moreno-Giménez A., Almansa-Tomás B., Vento M., García-Blanco A. Do children with overweight respond faster to food-related words? Appetite. 2021;161 doi: 10.1016/j.appet.2021.105134. [DOI] [PubMed] [Google Scholar]
- van Kleef G.A., Cheshin A., Fischer A.H., Schneider I.K. Editorial: The social nature of emotions. Frontiers in Psychology. 2016;7:896. doi: 10.3389/fpsyg.2016.00896. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xiong J., Lipsitz O., Nasri F., Lui L.M.W., Gill H., Phan L., Chen-Li D., Iacobucci M., Ho R., Majeed A., McIntyre R.S. Impact of COVID-19 pandemic on mental health in the general population: A systematic review. Journal of Affective Disorders. 2020;277:55–64. doi: 10.1016/j.jad.2020.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]


