Skip to main content
PMC home page
Springer Nature - PMC COVID-19 Collection logoLink to Springer Nature - PMC COVID-19 Collection
. 2022 Jan 19:1–18. Online ahead of print. doi: 10.1007/s12144-021-02563-0

Cross-cultural validation of the new version of the Coronavirus Anxiety Scale in twelve Latin American countries

Tomás Caycho-Rodríguez 1,✉, Pablo D Valencia 2, Lindsey W Vilca 3, Carlos Carbajal-León 1, Andrea Vivanco-Vidal 4, Daniela Saroli-Araníbar 4, Mario Reyes-Bossio 4, Michel White 5, Claudio Rojas-Jara 6, Roberto Polanco-Carrasco 7, Miguel Gallegos 6,8,9, Mauricio Cervigni 10,11, Pablo Martino 11, Diego Alejandro Palacios 12, Rodrigo Moreta-Herrera 13, Antonio Samaniego-Pinho 14, Marlon Elías Lobos-Rivera 15, Andrés Buschiazzo Figares 16, Diana Ximena Puerta-Cortés 17, Ibraín Enrique Corrales-Reyes 18, Raymundo Calderón 19, Bismarck Pinto Tapia 20, Ilka Franco Ferrari 8, Carmen Flores-Mendoza 21
PMCID: PMC8765828  PMID: 35068911

Abstract

The Coronavirus Anxiety Scale (CAS) was recently developed to assess dysfunctional anxiety related to COVID-19. Although different studies reported that the CAS is psychometrically sound, it is unclear whether it is invariant across countries. Therefore, the present study aimed to examine the measurement invariance of the CAS in twelve Latin American countries (Argentina, Bolivia, Chile, Colombia, Cuba, Ecuador, El Salvador, Guatemala, Mexico, Paraguay, Peru, and Uruguay). A total of 5196 people participated, with a mean age of 34.06 (SD = 26.54). Multigroup confirmatory factor analysis (CFA) was used to examine the measurement invariance of the CAS across countries and gender. Additionally, the graded response model (GRM) was used to provide a global representation of the representativeness of the scale with respect to the COVID-19 dysfunctional anxiety construct. The unidimensional structure of the five-item CAS was not confirmed in all countries. Therefore, it was suggested that a four-item model of the CAS (CAS-4) provides a better fit across the twelve countries and reliable scores. Multigroup CFA showed that the CAS-4 exhibits scalar invariance across all twelve countries and all genders. In addition, the CAS-4 items are more informative at average and high levels of COVID-19 dysfunctional anxiety than at lower levels. According to the results, the CAS-4 is an instrument with strong cross-cultural validity and is suitable for cross-cultural comparisons of COVID-19 dysfunctional anxiety symptoms in the general population of the twelve Latin American countries evaluated.

Supplementary Information

The online version contains supplementary material available at 10.1007/s12144-021-02563-0.

Keywords: Anxiety, COVID-19, Latin America, Cross-cultural, Validity

Introduction

In Latin America, the first diagnosed case of COVID-19 was reported on February 25, 2020 in Brazil (Rodriguez-Morales et al., 2020). A few weeks later, every Latin American country closed their borders and established measures to stop the spread of the disease within their territories. However, according to the Coronavirus Resource Center (2021) as of April 26, 2021, a total of 28,146,902 diagnosed cases of COVID-19 were reported in Latin America, with Brazil being the most affected country by this pandemic in the region, followed by Argentina and Mexico. Similarly, most deaths from COVID-19 in Latin America occurred in Brazil, followed by Mexico. Pandemic preparedness varies within the region and different countries are particularly vulnerable to the disease due to limited resources in their health systems, a higher prevalence of chronic diseases, late responses by populist governments, as well as high rates of poverty and inequality (Burki, 2020; Pablos-Méndez et al., 2020). These factors affect the transmission dynamics and impact of COVID-19 in Latin America, which also has implications for the dynamics of the pandemic globally (Miller et al., 2020).

In addition to the social, economic and physical health consequences, COVID-19 has become a pandemic that has significantly impacted the mental health and well-being of the population worldwide (Hossain et al., 2020). Different studies have reported the presence of high rates of anxiety symptoms, depression, post-traumatic stress disorder, psychological distress, suicidal behaviors and ideations, and sleep problems, among others (Leaune et al., 2020; Salari et al., 2020; Vindegaard & Benros, 2020). In Latin America, a recent study, which evaluated the psychological impact of the COVID-19 pandemic in 58 countries, reported an increase in anxiety and depression symptoms in 20 countries in South, North and Central America (Alzueta et al., 2021). Taken together, the above information highlights the need to pay more attention to the development of public policies to support mental health.

Regarding anxiety during the COVID-19 pandemic, the prevalence worldwide varies between 6.33% to 50.9% (Pappa et al., 2020; Wu et al., 2020; Xiong et al., 2020), being higher in women than men (Moghanibashi-Mansourieh, 2020); while in Latin America, the prevalence varies between 5.6% to 81.9% (Alzueta et al., 2021; Goularte et al., 2021; Krüger-Malpartida et al., 2020; Orellana & Orellana, 2020; Paz et al., 2020). However, many of the previous studies have used instruments that assess general anxiety, such as the GAD-7, Spielberger State-Trait Anxiety Inventory and the DASS-21. Using these types of instruments may generate under- or overestimated results, as they do not aim to identify specific anxiety symptoms associated with COVID-19 (Ransing et al., 2020). Seeking to overcome this limitation, instruments have recently been developed to identify anxiety symptoms related to COVID-19, such as the Coronavirus Anxiety Scale (CAS, Lee, 2020). The CAS is one of the most widely used measures in different research studies worldwide (Reis et al., 2020). Recent studies, using CAS, have indicated that the prevalence of anxiety related to COVID-19 varies between 4.9% and 28.7% in different populations (Caycho-Rodríguez, 2021; Lee et al., 2020a; Lee et al., 2020b).

In addition to the CAS, other measures of COVID-19 anxiety have been developed, such as The COVID-19 anxiety syndrome scale (C-19ASS, Nikčević & Spada, 2020), COVID-19-Anxiety Questionnaire (C-19-A, Petzold et al., 2020) and two scales named the COVID-19 Anxiety Scale, one developed in India (Chandu et al., 2020) and another developed in Brazil (Silva et al., 2020). Unlike the CAS, which has 5 items, the other measures have 7 items, as is the case for the COVID-19 Anxiety Scale, 9 items (C-19ASS) and 10 items (C-19-A). Although these are all relatively short measures, having a measure with a small number of items saves assessment time and associated costs (Kemper et al., 2019), improves participation rates (Edwards et al., 2004), and decreases fatigue and other negative reactions that could generate lower data quality (Credé et al., 2012). Despite the presence of criticisms related to the psychometric quality of short measures (Credé et al., 2012; Smith et al., 2000), for some years now, the development and use of short measures to assess psychological variables in clinical and non-clinical contexts has been popularized and generalized (Kruyen et al., 2013).

Furthermore, the CAS measures a set of physiological symptoms of anxiety related to COVID-19 (Lee, 2020); while the other instruments measure the presence of perseverative and avoidance thoughts (Nikčević & Spada, 2020), fear of social interaction and anxiety about illness (Chandu et al., 2020), symptoms related to Generalized Anxiety Disorder such as restlessness or nervousness, tiredness, difficulty concentrating, irritability, muscle tension, sleep disturbance and decreased ability to participate in social activities (Silva et al., 2020), as well as thoughts, feelings and behaviors related to COVID-19 anxiety (Petzold et al., 2020). On the other hand, while the CAS measures COVID-19 anxiety in general contexts, other measures, such as the Pandemic (COVID-19) Anxiety Travel Scale (PATS; Zenker et al., 2021), measure anxiety about specific events such as travel during the pandemic.

The CAS assesses symptoms of dysfunctional anxiety related to COVID-19, also called coronaphobia. Coronaphobia generates increased worry, stress, depression, suicidal ideation, generalized anxiety, safety-seeking behaviors, and impaired daily functioning (Arora et al., 2020; Chakraborty & Chatterjee, 2020; Lee et al., 2020b; Lee et al., 2020c). The CAS was originally developed and validated in English (Lee, 2020); however, psychometric properties of versions of the CAS have been studied in Turkish (Evren et al., 2020), Bangla (Ahmed et al., 2020), Korean (Choi et al., 2020), Polish (Skalski et al., 2021), Spanish (Caycho-Rodríguez et al., 2021b) and Portuguese spoken in Brazil (Padovan-Neto et al., 2021) and in Portugal (Magano et al., 2021). Different psychometric studies have indicated that the CAS is comprised of a single factor and provides highly reliable scores, with alpha coefficient values ranging from 0.80 to 0.93 and omega coefficient values between 0.80 and 0.88 (Ahmed et al., 2020; Caycho-Rodríguez et al., 2021a, 2021b; Evren et al., 2020; Magano et al., 2021; Lee, 2020, Lee et al., 2020b; Lee et al., 2020c; Padovan-Neto et al., 2021). However, some studies have suggested the presence of correlations between the errors of items 1 and 4 (Magano et al., 2021), as well as between items 2 and 3 (Padovan-Neto et al., 2021), which could mask a misspecified model, due to the adulterated increase in the fit indices (Dominguez-Lara, 2019); while another study carried out in Mexico suggests a four-item model, without the inclusion of item number four (Carrillo-Valdez, 2020). Additionally, it has also been suggested that the unifactorial structure of the CAS is invariant between groups of different sexes and ages (Ahmed et al., 2020¸ Caycho-Rodríguez et al., 2021a, 2021b; Lee, 2020). In addition, a recent study based on Item Response Theory suggests that each item in the CAS, especially items 3, 4 and 5, are able to more accurately assess moderate and high levels of dysfunctional anxiety related to COVID-19 (Caycho-Rodríguez et al., 2021b).

Despite these important psychometric findings, as far as is known from the scientific literature, there is no evidence to support the psychometric equivalence of the CAS between different countries. If an instrument was developed in one cultural context and is used in a different one, comparability of measures cannot be assumed between these different cultural groups, because psychological constructs are going to be highly dependent on the cultural context in which the measurement instruments are used (Li et al., 2012). For example, previous studies have indicated different prevalence rates of anxiety symptoms in countries in the Americas, Europe, Africa and Asia during the pandemic (Alzueta et al., 2021) and differences in levels of fear of COVID-19 in Latin American countries (Caycho-Rodriguez, et al. 2021a). However, these differences in prevalence rates may not necessarily be a product of cross-cultural differences (Scholten et al., 2017). While there are symptoms that appear in a specific cultural context and others that appear across cultures (Weiss & Somma, 2007), the presence of methodological problems may generate biased conclusions about cross-cultural differences (Bowden & Fox-Rushby, 2003; van de Vijver & Tanzer, 2004). It is often assumed that an instrument translated from one language to another assesses the construct in the same way in different cultures (Byrne, 2016). However, a major challenge in cross-cultural research in psychology is to understand that cultural comparisons are not free of bias if there is no evidence that, across cultural contexts, measures operate in the same way; however, not all researchers are aware of this problem and its practical implications (Fischer & Karl, 2019). Therefore, if one wishes to use the CAS to estimate and compare the prevalence of dysfunctional anxiety in different countries, it is important to demonstrate the measurement invariance (MI) of the instrument.

Demonstrating MI is a prerequisite for valid cross-cultural comparisons; however, this type of study still receives little attention despite increased interest in cross-cultural research (Boer et al., 2018). MI is a procedure that seeks to demonstrate the extent to which self-report items express the same meaning, and whether responses to them load on the same factors, across languages or other groups (e.g., gender and age) where they are applied (Vandenberg & Lance, 2000). Therefore, the absence of MI may generate biased conclusions about possible cross-cultural differences (Spector et al., 2015). In this sense, MI assesses equivalence as an inherent property of a measurement instrument (Davidov et al., 2014). Generally, there are three basic levels of MI: configural invariance, which seeks to determine whether the factor structure of a scale is similar between the different groups compared without imposing equality restrictions on the model parameters; metric invariance, which assesses whether the factor loading of the items are also similar between groups, which would allow for comparing variances and correlations between variables between groups; and scalar invariance, which assesses whether the factor loadings and intercepts of the items are equal between groups, which would allow for comparison of latent means, factor variances and covariances between groups (Meredith, 1993). If MI reports items that are not invariant at the metric or scalar level, it cannot be concluded that the items of the instrument, in this case the CAS, measure the same construct equally across different groups. The absence of MI may result from differences in the construct measured, called construct bias, methodological problems such as familiarity with the item format (measurement bias) or item content difficulties, or item bias, leading to cross-cultural differences in interpretation (Byrne, 2016; van de Vijver & Tanzer, 2004).

Although MI has been a suggested procedure within cross-cultural studies for several decades (Vandenberg & Lance, 2000), instruments assessing mental health symptoms with evidence of cross-cultural MI are scarce (Scholten et al., 2017). An example of this, within the context of the COVID-19 pandemic, is the Fear of COVID-19 Scale whose cross-cultural MI was assessed in seven Latin American countries (Caycho-Rodríguez et al., 2021a) and eleven countries in Asia, the Americas, Europe and Oceania (Lin et al., 2021). Based on the limited information to date, it is not possible to draw a general conclusion on the MI of the CAS across countries. Therefore, in this study we examined the MI of the CAS in 12 Latin American countries. The factor structure of the CAS was explored in depth, comparing one-factor models with five and four items. Due to previous findings reporting the presence of a unifactorial structure (Ahmed et al., 2020; Caycho-Rodríguez et al., 2021a, 2021b; Evren et al., 2020; Magano et al., 2021; Lee, 2020; Lee et al., 2020b; Lee et al., 2020c; Padovan-Neto et al., 2021) and the cultural uniqueness of the participating countries’ samples (Hofstede, 2001), the presence of at least partial invariance was expected. Furthermore, previous psychometric results of the CAS were conducted with procedures based on Classical Test Theory (CTT), and only one previous study conducted in Peru combined the use of CTT and Item Response Theory (IRT) models (Caycho-Rodríguez et al., 2021b). In this sense, this study also evaluated the characteristics and performances of the CAS items based on the Item Response Theory (IRT) model. IRT provides information on item difficulty and discrimination, independent of the sample (Crocker & Algina, 1986), thus identifying items that contribute most to measurement accuracy (Cooper & Petrides, 2010). In recent years, the use of IRT models has been recommended to improve measurement in psychiatry (Adler & Brodin, 2011). Findings based on the CTT model would facilitate corroborating previous psychometric evidence of the CAS; whereas findings based on IRT would provide a better understanding of its psychometric properties.

Once the MI of the CAS measurement between countries was tested, we proceeded to evaluate the MI of the CAS between groups of different sexes. Based on previous results, the MI of the CAS between male and female groups was expected (Ahmed et al., 2020¸ Caycho-Rodríguez et al., 2021b; Lee, 2020). Additionally, CAS scores were compared between different countries and sexes. Due to cultural differences and the different actions and policies carried out by Latin American governments, differences in COVID-19 anxiety levels would be expected in the countries assessed (Lin et al., 2021). Additionally, women were expected to present higher CAS scores than men, due to the higher probability of presenting anxiety symptoms during the COVID-19 pandemic (Moghanibashi-Mansourieh, 2020; Pappa et al., 2020).

The assessment of the MI of the CAS is especially important, as cultural differences could affect how individuals understand the self-report items designed to assess dysfunctional anxiety related to COVID-19. In addition, it is hoped that the assessment of CAS MI in 12 Latin American countries will contribute to the cross-cultural applicability of the instrument and expand the still small number of instruments available for cross-cultural comparisons of mental health symptoms during this COVID-19 pandemic, and other future pandemics.

Method

Participants

A total of 5196 people from 12 Latin American countries (Argentina, Bolivia, Chile, Colombia, Cuba, Ecuador, El Salvador, Guatemala, Mexico, Paraguay, Peru and Uruguay) participated, selected by non-probabilistic convenience sampling. To participate in the study, individuals had to be of legal age in each country and have given informed consent. The minimum number of participants in each country was calculated using Soper software (Soper, 2021), taking into account the number of observed variables (5 items) and latent variables (1 variable) of the model to be evaluated, the anticipated effect size (λ = 0.3), the probability (α = 0.05) and the statistical power (1 - β = 0.95) with a result of 100 participants per country. Each of the 12 countries in the study had more than this minimum number of participants.

The average number of participants within each country was 433 people and ranged from 253 (Bolivia) to Paraguay (880). Of the total number of participants, 3677 were female, 1509 were male, 9 were transgender, and 1 person did not state their gender, with an average age of 34.06 (SD = 26.54), while 3450 reported not having had COVID-19. Country-specific demographic information is shown in Table 1.

Table 1.

Demographic information of the participants in each country

Argentina
(n = 325)		 Bolivia
(n = 253)		 Chile
(n = 526)		 Colombia
(n = 373)		 Cuba
(n = 317)		 Ecuador
(n = 451)		 El Salvador
(n = 700)		 Guatemala
(n = 325)		 Mexico
(n = 303)		 Paraguay
(n = 880)		 Peru
(n = 360)		 Uruguay
(n = 383)
Gender (%)
Female 249 (76.6) 177 (70.0) 400 (76.0) 272 (72.9) 199 (62.8) 314 (69.6) 438 (62.6) 211 (64.9) 203 (67.0) 665 (75.6) 246 (68.3) 303 (79.1)
Male 76 (23.4) 75 (29.6) 124 (23.6) 101 (27.1) 118 (37.2) 137 (30.4) 260 (37.1) 114 (35.1) 98 (32.3) 212 (24.1) 114 (31.7) 80 (20.9)
Transgender 0 (0.0) 1 (0.4) 1 (0.2) 0 (0.0) 0 (0.0) 0 (0.0) 2 (0.3) 0 (0.0) 2 (0.7) 3 (0.3) 0 (0.0) 0 (0.0)
Age (M ± SD) 44.01 ± 16.22 39.25 ± 14.44 36.34 ± 12.03 30.49 ± 13.11 25.07 ± 7.33 29.06 ± 10.60 29.40 ± 8.95 41.56 ± 12.19 33.46 ± 13.74 31.51 ± 10.92 31.80 ± 10.97 38.96 ± 14.29
Marital status (%)
Single 144 (44.3) 125 (49.4) 259 (49.2) 268 (71.9) 205 (64.7) 309 (68.5) 508 (72.6) 127 (39.1) 170 (56.1) 579 (65.8) 231 (64.2) 171 (44.7)
Married 95 (29.2) 82 (32.4) 142 (27) 59 (15.8) 48 (15.1) 92 (20.4) 127 (18.1) 146 (44.9) 96 (31.7) 202 (23) 69 (19.2) 87 (22.7)
Divorced 30 (9.2) 31 (12.3) 41 (7.8) 13 (3.5) 13 (4.1) 32 (7.1) 11 (1.6) 26 (8) 18 (5.9) 25 (2.8) 17 (4.7) 43 (11.2)
Cohabiting 41 (12.6) 10 (4) 80 (15.2) 28 (7.5) 50 (15.8) 14 (3.1) 52 (7.4) 20 (6.2) 14 (4.6) 68 (7.7) 41 (11.4) 75 (19.6)
Widowed 15 (4.6) 5 (2) 4 (0.8) 5 (1.3) 1 (0.3) 4 (0.9) 2 (0.3) 6 (1.9) 5 (1.7) 6 (0.7) 2 (0.6) 7 (1.8)
Educational level (%)
Complete technical studies 32 (9.9) 15 (5.9) 43 (8.2) 36 (9.7) 10 (3.2) 11 (2.4) 31 (4.4) 18 (5.5) 42 (13.9) 20 (2.3) 21 (5.8) 38 (9.9)
Incomplete technical studies 4 (1.2) 0 (0.0 8 (1.5) 7 (1.9) 1 (0.3) 4 (0.9) 8 (1.1) 6 (1.9) 4 (1.3) 2 (0.2) 7 (1.9) 1 (0.3)
Complete primary school 3 (0.9) 1 (0.4) 1 (0.2) 1 (0.3) 0 (0.0 1 (0.2) 11 (1.6) 1 (0.3) 0 (0.0) 4 (0.5) 0 (0.0) 1 (0.3)
Incomplete primary school 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 13 (1.9) 0 (0.0) 0 (0.0) 0 (0.0) 1 (0.3) 0 (0.0)
Complete secondary school 31 (9.5) 7 (2.8) 21 (4) 64 (17.2) 5 (1.6) 72 (16) 106 (15.1) 21 (6.5) 20 (6.6) 76 (8.6) 14 (3.9) 36 (9.4)
Incomplete secondary school 5 (1.5) 5 (2) 3 (0.6) 8 (2.1) 3 (1) 5 (1.1) 48 (6.9) 10 (3.1) 1 (0.3) 17 (1.9) 4 (1.1) 24 (6.3)
Complete university degree 166 (51.1) 165 (65.2) 344 (65.4) 139 (37.3) 148 (46.7) 228 (50.6) 203 (29) 202 (62.2) 152 (50.2) 466 (53) 208 (57.8) 170 (44.4)
Incomplete university degree 84 (25.9) 60 (23.7) 106 (20.2) 118 (31.6) 150 (47.3) 130 (28.8) 280 (40) 67 (20.6) 84 (27.7) 295 (33.5) 105 (29.2) 113 (29.5)
Job type (%)
Permanent 207 (63.7) 107 (42.3) 301 (57.2) 119 (31.9) 227 (71.6) 170 (37.7) 371 (53) 224 (68.9) 143 (47.2) 489 (55.6) 150 (41.7) 268 (70)
Temporary 41 (12.6) 59 (23.3) 77 (14.6) 66 (17.7) 14 (4.4) 70 (15.5) 87 (12.4) 45 (13.9) 57 (18.8) 150 (17.1) 77 (21.4) 24 (6.3)
Unemployed 77 (23.7) 87 (34.4) 148 (28.1) 188 (50.4) 76 (24) 211 (46.8) 242 (34.6) 56 (17.2) 103 (34) 241 (27.4) 133 (36.9) 91 (23.8)
Had COVID-19 (%)
Yes 50 (15.4) 74 (29.3) 30 (5.7) 69 (18.5) 5 (1.6) 73 (16.2) 113 (16.1) 28 (8.6) 47 (15.5) 132 (15) 74 (20.6) 10 (2.6)
No 216 (66.5) 137 (54.2) 438 (83.3) 211 (56.6) 275 (86.8) 286 (63.4) 349 (49.9) 257 (79.1) 198 (65.4) 558 (63.4) 205 (56.9) 320 (83.6)
Maybe yes 19 (5.9) 28 (11.1) 15 (2.9) 54 (14.5) 9 (2.8) 52 (11.5) 178 (25.4) 24 (7.4) 27 (8.9) 94 (10.7) 53 (14.7) 5 (1.3)
Maybe no 40 (12.3) 14 (5.5) 43 (8.2) 39 (10.5) 28 (8.8) 40 (8.9) 60 (8.6) 16 (4.9) 31 (10.2) 96 (10.9) 28 (7.8) 48 (12.5)
Open in a new tab

Instrument

Demographic Information

An ad hoc questionnaire was developed to collect demographic information from the participants regarding their age, sex, marital status, educational level, type of work and COVID-19 diagnosis.

COVID-19 Anxiety

We used the Coronavirus Anxiety Scale (CAS, Lee, 2020), which is a self-report instrument that measures the frequency with which a person experiences dysfunctional anxiety related to COVID-19. The validated Spanish version of the CAS was used in this study (Caycho-Rodríguez et al., 2021b). The CAS is comprised of five items that have five response options from 0 (not at all) to 4 (almost every day in the last 2 weeks). The sum of the scores for each item generates a total score ranging from 0 to 20, where a higher score indicates greater dysfunctional anxiety related to COVID-19. Likewise, a cutoff score ≥ 9 (90% sensitivity and 85% specificity) allows for categorizing between people with and without dysfunctional anxiety related to COVID-19.

Procedure

This article uses data from the International Collaborative Study on the Mental Health Effects of the COVID-19 Pandemic in 13 Latin American countries. Data were collected simultaneously in all countries between February and March 2021. Most of the participating countries were from South America (Argentina, Bolivia, Chile, Colombia, Paraguay, Uruguay and Peru), with only a few from Central and North America (Cuba, Ecuador, El Salvador, Guatemala and Mexico). The data collection procedure was the same in all twelve countries. Thus, the invitation to participants was made through social networks (Facebook, Twitter, and Instagram) and email. The invitation had a link attached containing a questionnaire using the Google Forms platform, where the objective of the study, the informed consent and contact information in case there were any doubts in the research process were noted in an introductory section. In addition, the confidentiality of the data was guaranteed and the freedom to withdraw from the study at any time was assured. The questionnaire took between 15 and 20 min to complete. The project was approved by the Ethics Committee of the Universidad Privada del Norte in Peru (FCS_CEI/547–10-21).

Data Analysis

First, we examined the descriptive statistics at the item level. Specifically, we calculated the mean, standard deviation, skewness and kurtosis of each item for each country separately. Next, a series of single-group confirmatory factor analyses (CFAs) were conducted. The initial 5-item unidimensional model was conveniently found to have acceptable model fit for most countries. This was evaluated using approximate fit indices: the comparative fit index (CFI > .95), the Tucker-Lewis index (TLI > .90), the root-mean-square error of approximation (RMSEA< .08), and the standardized root-mean-squared residual (SRMR < .08) (Hu & Bentler, 1999). The specific CFI, TLI, and RMSEA values reported in this study were robust versions of these indices, since a robust maximum likelihood (MLR) estimator was also used (Brosseau-Liard et al., 2012; Brosseau-Liard & Savalei, 2014). Although a nonlinear estimator (e.g., WLSMV) is usually preferred for analyzing ordinal scale variables (Brown, 2015; Li, 2016), in the present study the MLR estimator was chosen for two reasons: 1) simulation studies have shown that, when there are five or more response options, both types of estimators provide very similar results (Rhemtulla et al., 2012); and 2) also through simulations, it has been observed that the WLSMV estimator presents limitations when the objective is to perform invariance analysis, since, this method tends to present higher rates of type I and II errors and prevents the possibility of using pragmatic criteria (e.g. ΔCFI) to evaluate the lack of invariance (Sass et al., 2014). Thus, because this study analyzed a scale whose items had 5 response options, and furthermore our main objective was to examine measurement invariance, it was decided to use the MLR estimator for the CFAs.

After an acceptable baseline model was selected, measurement invariance was analyzed regarding country and gender. Since the groups were very unbalanced, a special sub-sampling approach was followed (Yoon & Lai, 2018). This procedure consists of sampling an equal number of individuals from the smallest group in the other groups and performing the invariance analysis on these groups of equal size. This process is repeated a large number of times (in the present study, 100) and, finally, the values obtained in all replications are averaged (for a detailed description, see Yoon & Lai, 2018). Lack of invariance was judged based on two pragmatic criteria: |ΔCFI| > .01 and |ΔRMSEA| > .015 (in the direction of worse fit), but the more conservative Δχ2 is also reported (Chen, 2007; Cheung & Rensvold, 2002). First, configural invariance was examined with a multigroup confirmatory factor analysis in which no equality restrictions were set between groups (Brown, 2015; Dimitrov, 2010). Then, taking the configural model as a baseline, metric and scalar invariance were examined by imposing increasing restrictions (equal loadings and equal intercepts, respectively) on a baseline configural model. Structural invariance was also examined by restricting the latent means to be equal across groups (Dimitrov, 2010).

In order to examine group differences in a convenient way, composite scores were created by averaging the indicators of the final model. Due to the large sample size, effect sizes were preferred over inferential tests to judge the magnitude of the differences. We chose to examine standardized mean differences as a descriptive approach to differences between groups, instead of resorting to inferential tests such as t-tests. This methodological decision follows a long tradition that questions the use of statistical significance as the main tool for decision making (Cohen, 1994). Also, we decided to work with composite scores (i.e., observable variables), rather than at the level of latent variables, because the latter would imply taking one reference group against which all other groups would be compared (Sass, 2011). Since it is not plausible to take a single country as the reference group, and yet it was of interest to examine the differences between all possible pairs of countries, we chose to make comparisons using the composite measures. Specifically, Hedges’s g was used, aided by the visual inspection of the boxplots.

Internal consistency reliability was also examined. While Cronbach’s alpha was estimated, it has been shown that this coefficient may be limited in some situations (Dunn et al., 2014). Thus, the omega coefficient was also calculated.

Finally, in order to analyze the CAS’s psychometric functioning more thoroughly, a graded response model (GRM) was fitted to the data (Samejima, 2016). This model estimates one discrimination parameter (a), as well as k-1 difficulty parameters (b), per indicator, where k is the number of response options (in this case, 5). The a parameters indicate the extent to which the item correctly distinguishes between people with lower or higher levels of the construct. The higher the discrimination parameter of an item, the clearer the relationship between a person’s level in the measured attribute (θ) and his or her response to that item (Hambleton et al., 2010). On the other hand, the b parameters indicate at what level of the latent variable (θ) individuals will have a probability of .50 of responding to some response option higher than that indicated by the parameter. Information functions can also be obtained from the estimated coefficients, and they can be plotted to provide a global representation of the measure’s representativeness with respect to the construct of interest (Edelen & Reeve, 2007). Indeed, information can be understood in a similar way to the traditional concept of reliability, so the information curves allow us to observe at which levels of the construct (θ) the test presents higher psychometric quality (Furr, 2018).

All analyses were performed with the R program (version 4.0.3). CFA and reliability estimates were performed with the lavaan (version 0.6–8; Rosseel, 2012) and semTools (0.5–3; Jorgensen et al., 2020) packages, respectively. The graded response model was performed with the mirt package (version 1.33.2; Chalmers, 2012).

Results

Item-Level Descriptive Statistics

Table 2 presents the descriptive statistics of each item separately. It can be seen that all the items were positively skewed and had large standard deviations (compared to their means). Notably, items 4 and 5 (both related to stomach discomfort) were severely skewed and kurtotic in all countries. They were also the items that had the lowest standard deviations, indicating limited variability.

Table 2.

Item-level descriptive statistics of the coronavirus anxiety scale

Country Statistics Item 1 Item 2 Item 3 Item 4 Item 5
Argentina (n = 325) M 0.60 0.54 0.54 0.21 0.29
SD 0.98 0.93 0.93 0.60 0.69
g1 1.80 1.94 1.81 3.49 2.96
g2 2.83 3.40 2.80 13.89 9.65
Bolivia (n = 253) M 0.97 0.97 0.99 0.64 0.68
SD 1.08 1.12 1.12 0.96 0.98
g1 1.13 1.06 1.04 1.61 1.47
g2 0.70 0.30 0.27 2.19 1.61
Chile (n = 526) M 0.69 0.90 0.76 0.44 0.59
SD 1.00 1.12 1.00 0.79 0.93
g1 1.48 1.11 1.36 1.98 1.72
g2 1.58 0.35 1.33 3.86 2.51
Colombia (n = 373) M 0.69 0.69 0.76 0.48 0.47
SD 1.02 1.09 1.10 0.95 0.94
g1 1.41 1.61 1.37 2.16 2.05
g2 1.12 1.71 0.94 4.08 3.49
Cuba (n = 317) M 0.66 0.58 0.76 0.23 0.31
SD 1.05 0.95 1.07 0.63 0.71
g1 1.67 1.73 1.53 3.37 2.59
g2 2.14 2.58 1.72 12.61 6.58
Ecuador (n = 451) M 0.91 0.93 0.98 0.68 0.74
SD 1.13 1.16 1.15 1.08 1.09
g1 1.19 1.11 1.00 1.69 1.49
g2 0.57 0.23 0.02 2.12 1.42
El Salvador (n = 700) M 0.92 0.98 1.08 0.76 0.71
SD 1.13 1.24 1.25 1.16 1.09
g1 1.14 1.09 1.00 1.50 1.53
g2 0.42 0.08 −0.06 1.27 1.44
Guatemala (n = 325) M 0.84 0.79 0.95 0.57 0.61
SD 1.12 1.08 1.17 1.00 1.03
g1 1.18 1.21 1.04 1.88 1.62
g2 0.36 0.47 0.00 2.90 1.59
Mexico (n = 303) M 0.70 0.79 0.74 0.47 0.50
SD 1.02 1.13 1.02 0.89 0.89
g1 1.44 1.37 1.43 1.99 1.90
g2 1.45 0.95 1.43 3.40 3.13
Paraguay (n = 880) M 0.76 0.63 0.75 0.40 0.43
SD 1.04 1.02 1.06 0.81 0.82
g1 1.48 1.67 1.50 2.33 2.18
g2 1.69 2.07 1.60 5.33 4.70
Peru (n = 360) M 0.99 0.87 0.91 0.68 0.66
SD 1.11 1.06 1.08 1.02 0.99
g1 1.09 1.17 1.13 1.58 1.63
g2 0.47 0.66 0.44 1.83 2.16
Uruguay (n = 383) M 0.48 0.37 0.40 0.19 0.22
SD 0.87 0.82 0.77 0.65 0.66
g1 2.17 2.61 2.22 4.08 3.69
g2 4.71 6.74 5.32 17.84 14.92
Open in a new tab

M = Mean; SD=Standard Deviation; g1 = Skewness; g2 = Kurtosis

Single-Group Confirmatory Factor Analysis

A strictly unidimensional model was tested with CFA. The fit of this model was acceptable for some countries but rather bad for others, especially Bolivia, Cuba, Guatemala, and Uruguay (Table 3). Thus, modification indices were examined and it was evident that the residuals of items 4 and 5 were not independent. As a result, two new models were tested—one removing item 5 (Model 2) and the other removing item 4 (Model 3). As can be seen in Table 3, Model 2 had excellent fit in all countries, except for Uruguay, which had nonetheless acceptable fit according to most indices. On the other hand, Model 3 had sub-optimal fit in some countries, especially Mexico and Uruguay. Therefore, we selected Model 2 as the baseline for the following analyses.

Table 3.

Single-group confirmatory factor analyses of the coronavirus anxiety scale

Model Country χ2 df p CFI TLI RMSEA SRMR
1 Argentina 14.91 5 .011 .97 .94 .12 .04
Bolivia 28.49 5 <.001 .94 .89 .17 .04
Chile 24.12 5 <.001 .97 .94 .12 .03
Colombia 28.21 5 <.001 .96 .93 .15 .03
Cuba 78.69 5 <.001 .86 .72 .23 .07
Ecuador 11.70 5 .039 .99 .98 .08 .02
El Salvador 27.47 5 <.001 .98 .96 .11 .02
Guatemala 37.90 5 <.001 .94 .89 .19 .04
Mexico 14.14 5 .015 .97 .95 .11 .03
Paraguay 30.47 5 <.001 .98 .95 .12 .03
Peru 17.08 5 .004 .98 .96 .11 .03
Uruguay 33.06 5 <.001 .91 .82 .22 .05
2 Argentina 2.22 2 .329 1.00 1.00 .02 .01
Bolivia 0.07 2 .967 1.00 1.02 .00 .00
Chile 2.90 2 .235 1.00 .99 .04 .02
Colombia 4.36 2 .113 .99 .98 .08 .02
Cuba 0.16 2 .923 1.00 1.04 .00 .01
Ecuador 0.87 2 .649 1.00 1.01 .00 .01
El Salvador 0.40 2 .819 1.00 1.00 .00 .00
Guatemala 0.41 2 .813 1.00 1.01 .00 .01
Mexico 2.10 2 .350 1.00 1.00 .02 .02
Paraguay 2.48 2 .290 1.00 1.00 .02 .01
Peru 4.53 2 .104 .99 .98 .08 .02
Uruguay 7.05 2 .029 .99 .96 .11 .03
3 Argentina 0.04 2 .981 1.00 1.03 .00 .00
Bolivia 7.09 2 .029 .98 .95 .11 .03
Chile 2.86 2 .239 1.00 .99 .04 .02
Colombia 1.89 2 .389 1.00 1.00 .00 .01
Cuba 1.22 2 .545 1.00 1.02 .00 .02
Ecuador 0.16 2 .924 1.00 1.02 .00 .00
El Salvador 1.69 2 .430 1.00 1.00 .00 .01
Guatemala 2.89 2 .236 1.00 .99 .05 .01
Mexico 10.24 2 .006 .97 .91 .15 .04
Paraguay 0.81 2 .666 1.00 1.00 .00 .00
Peru 4.66 2 .097 .99 .98 .09 .02
Uruguay 18.88 2 <.001 .97 .90 .18 .03
Open in a new tab

The estimator was robust maximum likelihood (RML). CFI = comparative fit index; RMSEA = root-mean-square error of approximation; SRMR = standardized root-mean-square residual; CI = confidence intervals. In Model 1, a strictly unidimensional model with all 5 original items was tested. Model 2 removed item 5 from the model. Finally, Model 3 included item 5 but deleted item 4

Internal Consistency Reliability

The results from the CFAs reported in Table 3 were used to estimate reliability of the CAS-4 in each country. The standardized factor loadings, as well as coefficients alpha and omega, are presented in Table 4. The scale had good internal consistency reliability in all countries (ɑ ≥ .78, ω ≥ .80).

Table 4.

Factor loadings and internal consistency reliability of the coronavirus anxiety scale

Country Items ɑ ω
1 2 3 4
Argentina .68 .85 .83 .65 .83 .85
Bolivia .63 .81 .82 .77 .84 .84
Chile .67 .81 .84 .70 .84 .85
Colombia .72 .87 .82 .84 .88 .89
Cuba .67 .78 .75 .57 .78 .80
Ecuador .73 .85 .87 .81 .89 .89
El Salvador .77 .86 .84 .81 .89 .89
Guatemala .73 .84 .86 .77 .88 .88
Mexico .71 .81 .81 .73 .85 .85
Paraguay .76 .85 .83 .73 .87 .87
Peru .76 .77 .88 .77 .87 .87
Uruguay .71 .81 .87 .71 .85 .86
Open in a new tab

Completely standardized factor loadings are presented. The estimator of the confirmatory factor analysis was maximum likelihood

Measurement Invariance and Mean Comparison by Country

Next, MI by country was examined. The ΔCFI criterion (but not the ΔRMSEA and the Δχ2) suggested that metric and scalar invariance were met (Table 5). This allowed us to test whether means were equal across groups. As shown in Table 5, model fit did get significantly worse when latent means were constrained to be equal (|ΔCFI| > .01).

Table 5.

Measurement and structural invariance of the coronavirus anxiety scale

Grouping variable Model χ2 df CFI RMSEA Δχ2 Δdf ΔCFI ΔRMSEA
Country Configural 27.67 24 1.00 .03
Metric 96.78*** 57 .99 .07 69.36*** 33 −.01 .04
Scalar 178.29*** 90 .98 .08 96.33*** 33 −.01 .01
Equal means 275.11*** 101 .95 .10 106.59*** 11 −.02 .02
Gender Configural 3.63 4 1.00 .01
Metric 12.24 7 1.00 .03 9.30* 3 0 .02
Scalar 23.47** 10 1.00 .04 15.27** 3 0 .01
Equal means 45.31*** 11 .99 .06 35.60*** 1 −.01 .02
Open in a new tab

Yoon and Lai’s (2018) subsampling approach with 100 replications was followed. CFI = comparative fit index; RMSEA = root-mean-square error of approximation

* p < .05 **p < .01 ***p < .001

To examine mean differences, composite variables were created by averaging the 4 final items of the CAS (CAS-4). To ease interpretation, Fig. 1 presents a graphical representation of the CAS scores by country. Most differences were either negligible or small, but some of them were of moderate size. Specifically, Argentina had lower scores than Bolivia (g = 0.52) and El Salvador (g = 0.52). Similarly, Uruguay presented clearly lower scores than Bolivia (g = 0.69), Ecuador (g = 0.62), El Salvador (g = 0.66), Guatemala (g = 0.53), and Peru (g = 0.63).

Fig. 1.

Fig. 1

Open in a new tab

Boxplots Comparing Scores of the Coronavirus Anxiety Scale by Country

Measurement Invariance and Mean Comparison by Gender

MI by gender was also examined. For this analysis, only two genders (female and male) were included due to sample size limitations. According to the ΔCFI criterion, scalar invariance was found (Table 5). Also, model fit did not worsen to a large degree when latent means were constrained to be equal. This was confirmed by the fact that the mean difference of the composite score between males and females was small (d = 0.21).

Graded Response Model

A graded response model was fitted to the data. As presented in Table 6, item 3 was the most discriminative. While the four proposed items reasonably covered part of the construct’s spectrum, it is also clear that the items are more difficult at high levels of the latent variable (i.e. it is more probable to choose lower options than it is to choose the highest ones, even if the respondent’s level of anxiety is not particularly low).

Table 6.

Parameters of the graded response models (grm) of the coronavirus anxiety scale

Item a b1 b2 b3 b4
1. I felt dizzy, lightheaded, or faint when I read or listened to news about the coronavirus 2.31 0.15 1.01 1.75 2.34
2. I had trouble falling or staying asleep because I was thinking about the coronavirus 3.32 0.22 0.89 1.51 2.08
3. I felt paralyzed or frozen when I thought about or was exposed to information about the coronavirus 3.46 0.09 0.88 1.48 2.04
4. I lost interest in eating when I thought about or was exposed to information about the coronavirus 3.02 0.63 1.32 1.87 2.35
Open in a new tab

Figure 2 presents the item information curves for each GRM. This confirms what was previously observed when examining item difficulties: it seems that the CAS-4 is more informative at average-to-high levels of the construct than it is at lower levels.

Fig. 2.

Fig. 2

Open in a new tab

Item Information Curves of the Coronavirus Anxiety Scale. Note. On the x-axis, the latent variable (θ) level is represented in terms of standard deviations from the zero mean value

Discussion

The results of the confirmatory factor analysis (CFA) indicated that the original single factor model of the CAS showed an acceptable fit for some countries, but poor fit for others (such as Bolivia, Cuba, Guatemala and Uruguay). Therefore, we can say that the original CAS model was not replicated in these countries. In response to this finding, the modification indices were evaluated, where it was identified that the residuals of items 4 and 5 were not independent. The presence of a dependence of residuals in factor models has been previously reviewed in the specialized literature (Dominguez-Lara, 2019) and seems to suggest similarity in item content, task demands, measurement errors, and response style (Brown, 2015). Likewise, this may be generated by factors beyond the construct to be assessed, such as irrelevant content factors, item phrasing and/or item closeness in the assessment protocol (Dominguez-Lara & Merino-Soto, 2017). Indeed, both item 4 (“I lost interest in eating when I thought about or was exposed to information about the coronavirus”) and item 5 (“I felt nausea or stomach problems when I thought about or was exposed to information about the coronavirus”) refer to appetite and nausea problems as a consequence of exposure to information about COVID-19. Bodily sensations, such as those mentioned in items 4 and 5, as well as interpretation can be influenced by different events, such as information coming from the media (Jungmann & Witthöft, 2020). Also, during a virus outbreak, bodily sensations are more likely to be intensified in accordance with this context (Blakey & Abramowitz, 2017). In this regard, items 4 and 5 could be revised, modified, or deleted in future versions of the CAS.

As a result, two new models were proposed: Model 2, where item 5 was eliminated, and Model 3, where item 4 was eliminated. Model 3 did not show an optimal fit in some countries, such as Mexico and Uruguay; while model 2 had an excellent fit in all countries, except Uruguay (which had an acceptable fit in most of the fit indices). For this reason, it is suggested that model 2 (CAS-4) is the best fit for the Latin American countries evaluated. Another study has also indicated that the Spanish version of the five-item CAS does not show adequate performance, suggesting that a four-item model (with the absence of item 4) presents a better fit (Carrillo-Valdez, 2020). A model with correlated errors of items 4 and 5 was not evaluated because it may produce an over- or underestimation of reliability due to the presence of variance not associated with the construct and generate a bias in the interpretation of measurement precision (Yang & Green, 2010). On the other hand, the results on the reliability of the CAS-4 were excellent in all countries, with alpha and omega coefficient values above .80. This is in agreement with what was reported in the other four-item version of the CAS (Carrillo-Valdez, 2020), as well as in the findings of the original version in different contexts (Ahmed et al., 2020; Caycho-Rodríguez et al., 2021a, 2021b; Evren et al., 2020; Magano et al., 2021; Lee, 2020; Lee et al., 2020b; Lee et al., 2020c; Padovan-Neto et al., 2021).

Furthermore, the evaluation of the factor structure of the CAS-4 by multigroup analysis supported configural invariance; therefore, dysfunctional anxiety related to COVID-19, as described and evaluated in this research study, has a uniform meaning in the twelve countries evaluated. However, this level of invariance does not allow us to guarantee the comparability of CAS-4 scores. The findings on metric invariance suggest that all items can be interpreted and answered in a similar way; therefore, a change in dysfunctional anxiety related to COVID-19 causes the same change in CAS-4 scores in the twelve countries evaluated. Finally, scalar invariance would indicate that the relationship between observed and latent CAS-4 score is invariant across countries. The findings provide additional information on the CAS-4, given that its equivalence between different countries had not been evaluated previously, not even in its original five-item version. Thus, it is possible to argue that the possible comparisons between the countries evaluated are valid, since the CAS-4 scores have the same meaning among individuals in the twelve countries.

The presence of scalar equivalence is a necessary condition for comparing CAS-4 means across countries (Steenkamp & Baumgartner, 1998). Thus, when comparing dysfunctional anxiety related to COVID-19 among the twelve Latin American countries included, it was found that most of the differences were insignificant or small; however, Uruguay presented the lowest mean score, while Peru is one of the countries with the highest presence of dysfunctional anxiety symptoms related to COVID-19. In the case of Uruguay, the low presence of COVID-19 related dysfunctional anxiety symptoms is likely associated with the government’s successful handling of the pandemic. Also, having a relatively small population (approximately 3.5 million inhabitants) facilitated the control of disease transmission, making Uruguay one of the countries with the lowest rate of COVID-19 diagnoses and deaths (Taylor, 2020). In the case of Peru, the findings can be explained by the fact that, at the time of data collection for this study, the country was in one of the most difficult moments of the so-called “second wave” of the pandemic, which could have generated greater fear and anxiety about the disease. The number of infections tripled in the month of February 2021, going from 1688 cases per day in the last week of December 2020 to 5668; in addition, the number of deaths increased from 51 per day during the last week of December 2020 to 180 in the first weeks of February 2021; while in hospitals, the number of people hospitalized for COVID-19 went from 3900 in mid-December to 11,715 in February 2021. This is supported by results from previous studies in Latin America where they indicate that an increase in COVID-19 severity is associated with a dramatic increase in fear and anxiety levels (Feter et al., 2021). Added to this, the limited resources available to the Peruvian health system, late responses from the government (Herrera-Añazco et al., 2021) and scandals about the misuse of vaccines (Chauvin, 2021) generated greater uncertainty and distrust among the people.

Differences in average scores of dysfunctional anxiety related to COVID-19 may be explained by cultural differences and available information about the consequences of COVID-19 in each country (Bäuerle et al., 2020). In addition, people may experience different feelings and perceptions due to the different impacts of COVID-19 in their countries. For example, at the time the study data were collected, some countries, such as Argentina and El Salvador, were in a progressive reopening of their economic activities, causing an increase in the rate of contagion. In Chile, the study was conducted during an explosive increase in the number of new infections, due to the end of the summer period and the false perception of security in the population as a result of the successful start of the vaccination campaign. This led to the tightening of existing sanitary measures that left 96% of the Chilean population in social isolation, while there was a strong recession and an unemployment rate that reached 10.4%. Cuba was in a phase of resurgence (second wave) characterized by the high number of people infected with the virus, much higher than in the first stage of the disease. Colombia was going through the end of their second wave of infection, which resulted in a decrease in the number of infections and deaths, as well as the economic reopening in most sectors and the gradual and progressive return to on-site classes in private schools and universities, under the alternation modality.

Additionally, scalar invariance of the CAS-4 according to gender was reported, which supports results previously found in other countries with the original five-item version of the CAS (Ahmed et al., 2020¸ Caycho-Rodríguez et al., 2021b; Lee, 2020). Therefore, it is possible to state that men and women from the twelve countries understand the dysfunctional anxiety related toCOVID-19 construct in the same way. This finding indicates that the CAS-4 can be reliably used to assess and compare dysfunctional anxiety related to COVID-19 in men and women in the countries involved. The comparison of dysfunctional anxiety related to COVID-19 indicated a small difference between both sexes with a higher level found in females. This result is expected according to previous literature (Ahmed et al., 2020¸ Caycho-Rodríguez et al., 2021b; Evren et al., 2020), where women have even come to present anxiety levels three times higher than men during the current pandemic (Wang et al., 2021). This could be because men and women respond differently to stressors during the pandemic, which may cause women to misinterpret their own feelings and be more vulnerable to experience other negative emotions such as depression (Nakhostin-Ansari et al., 2020; Özdin & Bayrak Özdin, 2020). In addition to gender differences in susceptibility to elevated levels of anxiety, it has been suggested that other consequences of the pandemic, such as financial problems, increased child care and schooling, care for sick family members, and decreased job opportunities, may be more detrimental to women than to men (Wenham et al., 2020).

The IRT-based results allow us to evaluate the performance of the CAS-4 items. Thus, it is suggested that item 3 (“I felt paralyzed or frozen when I was thinking about or exposed to information about the coronavirus”) has the best discrimination capacity, which would indicate that this item can distinguish more clearly between individuals with different levels of dysfunctional anxiety related to COVID-19. This result agrees with what was reported in the Peruvian validation where, based on IRT, it was indicated that item 3 was one of those that allowed for a better and more accurate assessment of those individuals with moderate and high levels of dysfunctional anxiety related to COVID-19 (Caycho-Rodríguez et al., 2021b). Previously, it has been shown that each of the CAS items represent physiological symptoms related to clinical symptoms of anxiety and fear (Lee, 2020). However, individuals’ responses to item 3 would provide more information about dysfunctional anxiety related to COVID-19, because motor immobility (expressed in item 3) is an involuntary fear response (Marx et al., 2008) that is typically expressed in people who have gone through traumatic situations, such as the COVID-19 pandemic (Lee, 2020). Thus, people with dysfunctional anxiety related to COVID-19 will respond higher to this item compared to those who do not present this condition. The other items also present similar discrimination parameters; moreover, the difficulty required to respond to each of the four items is always ascending, which is to be expected in measures of psychological distress. Therefore, a higher presence of the latent trait (in this case, dysfunctional anxiety related to COVID-19) is necessary to respond with the higher response options. In addition, the item information curves, along with the finding that, on average, expressions of COVID-19 anxiety were at the lower end of the continuum, suggest that CAS-4 items are most informative at average or high levels of COVID-19-related dysfunctional anxiety.

Although the findings of this study are important, and the CAS-4 showed acceptable psychometric properties in all countries, the study inevitably had some limitations. First, the participating countries were not systematically selected, as their inclusion was the product of a negotiation about potential author interest in participating and their ability to meet the study requirements. In addition, the study included more countries from South America and only four countries from North and Central America. Therefore, the results may not be generalizable to countries not included in the study. Thus, future research should replicate the study and include samples from more countries in North and Central America. Second, the participants were selected by convenience sampling, which did not allow us to have a fully representative sample of the general population of each of the twelve countries. Likewise, only people with Internet access in all countries could be surveyed, which could generate the presence of a sampling bias. In addition, although the data collection process was the same in all countries, the distribution of demographic data was different. This could be corrected by using appropriate sampling (Pierce et al., 2020). All of the above would limit the generalizability of the findings to the general population of the countries. Third, the number of participants varied across countries, which could further limit the generalizability of the findings. While there is evidence that different sample sizes could bias the results obtained using multigroup factor analyses (Brown, 2015), the recommended subsampling approach (Yoon & Lai, 2018), as used in this study, attempted to mitigate this problem. We did not assess the effect of the form of administration, which can potentially interact with cultural effects in each of the countries, generating a systematic effect of the data collection method. In this regard, future research should use different forms of survey administration (e.g., pencil and paper, and online) to reliably separate the effect of administration (Żemojtel-Piotrowska et al., 2018). Additionally, it should also be noted that, in the invariance analysis, invariance was met for the pragmatic ΔCFI criterion, but not for the ΔRMSEA criterion. Although it has been argued that the RMSEA may be biased in very small models such as ours (Kenny et al., 2015), and that the ΔCFI criterion turns out to be more robust in deciding about the lack of invariance (Cheung & Rensvold, 2002), this limitation should not be ignored. Evidence of convergent and discriminant validity with other CAS-4 constructs was not assessed. Finally, although a Spanish version of the CAS was used, the translation of which followed the technical procedures suggested in the scientific literature (Caycho-Rodríguez, 2021b), a specific linguistic analysis of the items in each of the countries was not carried out. In this sense, it would be important to take into account sociolinguistic variation during the processes of future CAS adaptations, regardless of whether the countries speak the same language, to ensure the fidelity of the interpretations obtained (Peterson et al., 2017). Thus, despite the value of obtaining pan-dialectal versions, additional linguistic adaptations are necessary for certain cultural contexts (Squires et al., 2013).

Conclusions

Despite these limitations, the findings provide evidence that the CAS-4 is a valid measure of dysfunctional anxiety related to COVID-19 in the general population of 12 different Latin American countries. Similarly, the CAS-4 was shown to be invariant between groups of men and women. In addition, it has been shown that it can be useful to meaningfully compare scores between countries and genders. From IRT, it was shown that the CAS-4 allows for a better identification of people with average to high levels of dysfunctional anxiety related to COVID-19. Additionally, including a large number of Latin American countries in the study and assessing MI probably provides more generalizable results than previous studies. Thus, greater variability and sensitivity to cultural influences of the CAS-4 items could be detected. Finally, the finding of invariance of the CAS-4 instrument across countries is important for conducting cross-cultural assessments (Milfont & Fischer, 2010). As mentioned, without evidence of invariance it cannot be assumed that the results of cross-cultural comparisons will be valid (Chen, 2008). It is hoped that the findings presented here will motivate and guide future studies to ensure measurement invariance of the CAS-4 before comparing dysfunctional anxiety related to COVID-19 across different cultures or countries.

Supplementary Information

ESM 1 (188.8KB, csv)

(CSV 188 kb)

Data Availability

The datasets generated during and/or analyzed during the current study are available at the following link: https://mfr.osf.io/render?url=https%3A%2F%2Fosf.io%2F8jtw5%2Fdownload

The syntaxes of the underlying findings are available at the following link: https://mfr.osf.io/render?url=https%3A%2F%2Fosf.io%2Fh5ugs%2Fdownload

Declaration

Competing Interest

None

Footnotes

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  1. Adler M, Brodin U. An IRT validation of the affective self rating scale. Nordic Journal of Psychiatry. 2011;65(6):396–402. doi: 10.3109/08039488.2011.577187. [DOI] [PubMed] [Google Scholar]
  2. Ahmed, O., Faisal, R. A., Sharker, T., Lee, S. A., & Jobe, M. C. (2020). Adaptation of the Bangla version of the COVID-19 anxiety scale. International Journal of Mental Health and Addiction, 1-12. 10.1007/s11469-020-00357-2. [DOI] [PMC free article] [PubMed]
  3. Alzueta E, Perrin P, Baker FC, Caffarra S, Ramos-Usuga D, Yuksel D, Arango-Lasprilla JC. How the COVID-19 pandemic has changed our lives: A study of psychological correlates across 59 countries. Journal of Clinical Psychology. 2021;77(3):556–570. doi: 10.1002/jclp.23082. [DOI] [PubMed] [Google Scholar]
  4. Arora A, Jha AK, Alat P, Das SS. Understanding coronaphobia. Asian Journal of Psychiatry. 2020;54:102384. doi: 10.1016/j.ajp.2020.102384. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Bäuerle A, Teufel M, Musche V, Weismüller B, Kohler H, Hetkamp M, et al. Increased generalized anxiety, depression and distress during the COVID-19 pandemic: A cross-sectional study in Germany. Journal of Public Health. 2020;42(4):672–678. doi: 10.1093/pubmed/fdaa106. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Blakey SM, Abramowitz JS. Psychological predictors of health anxiety in response to the Zika virus. Journal of Clinical Psychology in Medical Settings. 2017;24(3):270–278. doi: 10.1007/s10880-017-9514-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Boer D, Hanke K, He J. On detecting systematic measurement error in cross-cultural research: A review and critical reflection on equivalence and invariance tests. Journal of Cross-Cultural Psychology. 2018;49(5):713–734. doi: 10.1177/0022022117749042. [DOI] [Google Scholar]
  8. Bowden A, Fox-Rushby JA. A systematic and critical review of the process of translation and adaptation of generic health-related quality of life measures in Africa, Asia, Eastern Europe, the Middle East, South America. Social Science & Medicine. 2003;57(7):1289–1306. doi: 10.1016/S0277-9536(02)00503-8. [DOI] [PubMed] [Google Scholar]
  9. Brosseau-Liard PE, Savalei V. Adjusting incremental fit indices for nonnormality. Multivariate Behavioral Research. 2014;49(5):460–470. doi: 10.1080/00273171.2014.933697. [DOI] [PubMed] [Google Scholar]
  10. Brosseau-Liard PE, Savalei V, Li L. An investigation of the sample performance of two nonnormality corrections for RMSEA. Multivariate Behavioral Research. 2012;47(6):904–930. doi: 10.1080/00273171.2012.715252. [DOI] [PubMed] [Google Scholar]
  11. Brown TA. Confirmatory factor analysis for applied research. Guilford Publications; 2015. [Google Scholar]
  12. Burki T. COVID-19 in Latin America. The Lancet Infectious Diseases. 2020;20(5):547–548. doi: 10.1016/S1473-3099(20)30303-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Byrne BM. Using multitrait-multimethod analyses in testing for evidence of construct validity. In: Schweizer K, DiStefano C, editors. Principles and methods of test construction: Standards and recent advancements. Hogrefe; 2016. pp. 247–271. [Google Scholar]
  14. Carrillo-Valdez L. Psychometric properties of the Coronavirus Anxiety Scale in Mexican adult population Propiedades psicométricas de la Escala de Ansiedad por Coronavirus en población adulta mexicana. Ciencia y Humanismo en la Salud. 2020;7(3):45–60. [Google Scholar]
  15. Caycho-Rodríguez, T. (2021). Evaluación de la coronafobia en población adulta mayor durante la pandemia de la COVID-19. Revista Española de Geriatría y Gerontología.10.1016/j.regg.2021.02.006 [DOI] [PMC free article] [PubMed]
  16. Caycho-Rodríguez, T., Valencia, P. D., Vilca, L. W., Cervigni, M., Gallegos, M., Martino, P., et al. (2021a). Cross-cultural measurement invariance of the fear of COVID-19 scale in seven Latin American countries. Death Studies, 1–15. 10.1080/07481187.2021.1879318 [DOI] [PubMed]
  17. Caycho-Rodríguez, T., Vilca, L. W., Carbajal-León, C., White, M., Vivanco-Vidal, A., Saroli-Araníbar, D., et al. (2021b). Coronavirus Anxiety Scale: New psychometric evidence for the Spanish version based on CFA and IRT models in a Peruvian sample. Death Studies, 1–10. 10.1080/07481187.2020.1865480 [DOI] [PubMed]
  18. Chakraborty K, Chatterjee M. Psychological impact of COVID-19 pandemic on general population in West Bengal: A cross-sectional study. Indian Journal of Psychiatry. 2020;62(3):266–272. doi: 10.4103/psychiatry.IndianJPsychiatry_276_20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Chalmers, R. P. (2012). Mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. 10.18637/jss.v048.i06.
  20. Chandu VC, Pachava S, Vadapalli V, Marella Y. Development and initial validation of the COVID-19 anxiety scale. Indian Journal of Public Health. 2020;64(6):201–204. doi: 10.4103/ijph.IJPH_492_20. [DOI] [PubMed] [Google Scholar]
  21. Chauvin L. Peruvian COVID-19 vaccine scandal spreads. The Lancet. 2021;397(10276):783. doi: 10.1016/S0140-6736(21)00508-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling. 2007;14(3):464–504. doi: 10.1080/10705510701301834. [DOI] [Google Scholar]
  23. Chen FF. What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. Journal of Personality and Social Psychology. 2008;95(5):1005–1018. doi: 10.1037/a0013193. [DOI] [PubMed] [Google Scholar]
  24. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling. 2002;9(2):233–255. doi: 10.1207/S15328007SEM0902_5. [DOI] [Google Scholar]
  25. Choi, E., Lee, J., & Lee, S. A. (2020). Validation of the Korean version of the obsession with COVID-19 scale and the coronavirus anxiety scale. Death Studies, 1–7. 10.1080/07481187.2020.1833383 [DOI] [PubMed]
  26. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49(12), 997–1003. doi: 10.1037/0003-066X.49.12.997.
  27. Cooper A, Petrides KV. A psychometric analysis of the trait emotional intelligence questionnaire–short form (TEIQue–SF) using item response theory. Journal of Personality Assessment. 2010;92(5):449–457. doi: 10.1080/00223891.2010.497426. [DOI] [PubMed] [Google Scholar]
  28. Coronavirus Resource Center (2021). COVID-19 Dashboard by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University (JHU). https://coronavirus.jhu.edu/map.html
  29. Credé M, Harms P, Niehorster S, Gaye-Valentine A. An evaluation of the consequences of using short measures of the big five personality traits. Journal of Personality and Social Psychology. 2012;102(4):874–888. doi: 10.1037/a0027403. [DOI] [PubMed] [Google Scholar]
  30. Crocker L, Algina J. Introduction to classical and modern test theory. Holt, Rinehart and Winston; 1986. [Google Scholar]
  31. Davidov E, Meuleman B, Cieciuch J, Schmidt P, Billiet J. Measurement equivalence in cross-national research. Annual Review of Sociology. 2014;40:55–75. doi: 10.1146/annurev-soc-071913-043137. [DOI] [Google Scholar]
  32. Dimitrov DM. Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development. 2010;43(2):121–149. doi: 10.1177/0748175610373459. [DOI] [Google Scholar]
  33. Dominguez-Lara, S. (2019). Correlación entre residuales en análisis factorial confirmatorio: una breve guía para su uso e interpretación. Interacciones, 5(3), e207. 10.24016/2019.v5n3.207.
  34. Dominguez-Lara SA, Merino-Soto C. Una modificación del coeficiente alfa de Cronbach por errores correlacionados. Revista Médica de Chile. 2017;145(2):270–271. doi: 10.4067/S0034-98872017000200018. [DOI] [PubMed] [Google Scholar]
  35. Dunn TJ, Baguley T, Brunsden V. From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology. 2014;105(3):399–412. doi: 10.1111/bjop.12046. [DOI] [PubMed] [Google Scholar]
  36. Edelen MO, Reeve BB. Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research. 2007;16(1):5–18. doi: 10.1007/s11136-007-9198-0. [DOI] [PubMed] [Google Scholar]
  37. Edwards P, Roberts I, Sandercock P, Frost C. Follow-up by mail in clinical trials: Does questionnaire length matter? Controlled Clinical Trials. 2004;25(1):31–52. doi: 10.1016/j.cct.2003.08.013. [DOI] [PubMed] [Google Scholar]
  38. Evren, C., Evren, B., Dalbudak, E., Topcu, M., & Kutlu, N. (2020). Measuring anxiety related to COVID-19: A Turkish validation study of the coronavirus anxiety scale. Death Studies, 1-7. 10.1080/07481187.2020.1774969. [DOI] [PubMed]
  39. Feter N, Caputo EL, Doring IR, Leite JS, Cassuriaga J, Reichert FF, et al. Sharp increase in depression and anxiety among Brazilian adults during the COVID-19 pandemic: Findings from the PAMPA cohort. Public Health. 2021;190:101–107. doi: 10.1016/j.puhe.2020.11.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Fischer R, Karl JA. A primer to (cross-cultural) multi-group invariance testing possibilities in R. Frontiers in Psychology. 2019;10:1507. doi: 10.3389/fpsyg.2019.01507. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Furr, R. M. (2018). Psychometrics. An introduction (3rd ed.). SAGE.
  42. Goularte JF, Serafim SD, Colombo R, Hogg B, Caldieraro MA, Rosa AR. COVID-19 and mental health in Brazil: Psychiatric symptoms in the general population. Journal of Psychiatric Research. 2021;132:32–37. doi: 10.1016/j.jpsychires.2020.09.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Hambleton, R. K., van der Linden, W. J., & Wells, C. S. (2010). IRT models for the analysis of polytomously scored data: Brief and selected history of model building advances. In M. L. Nering & R. Ostini (Eds.), Handbook of polytomous item response theory models (pp. 21–42). Routledge/Taylor & Francis Group.
  44. Herrera-Añazco, P., Uyen-Cateriano, A., Mezones-Holguin, E., Taype-Rondan, A., Mayta-Tristan, P., Malaga, G., & Hernandez, A. V. (2021). Some lessons that Peru did not learn before the second wave of COVID-19. The International Journal of Health Planning and Management.10.1002/hpm.3135 [DOI] [PMC free article] [PubMed]
  45. Hofstede G. Culture's recent consequences: Using dimension scores in theory and research. International Journal of Cross Cultural Management. 2001;1(1):11–17. doi: 10.1177/147059580111002. [DOI] [Google Scholar]
  46. Hossain, M. M., Tasnim, S., Sultana, A., Faizah, F., Mazumder, H., Zou, L., ... & Ma, P. (2020). Epidemiology of mental health problems in COVID-19: a review. F1000Research, 9, 636. 10.12688/f1000research.24457.1 [DOI] [PMC free article] [PubMed]
  47. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. 1999;6(1):1–55. doi: 10.1080/10705519909540118. [DOI] [Google Scholar]
  48. Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2020). semTools: Useful tools for structural equation modeling (0.5-3).https://cran.r-project.org/package=semTools
  49. Jungmann SM, Witthöft M. Health anxiety, cyberchondria, and coping in the current COVID-19 pandemic: Which factors are related to coronavirus anxiety? Journal of Anxiety Disorders. 2020;73:102239. doi: 10.1016/j.janxdis.2020.102239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Kemper CJ, Trapp S, Kathmann N, Samuel DB, Ziegler M. Short versus long scales in clinical assessment: Exploring the trade-off between resources saved and psychometric quality lost using two measures of obsessive–compulsive symptoms. Assessment. 2019;26(5):767–782. doi: 10.1177/1073191118810057. [DOI] [PubMed] [Google Scholar]
  51. Kenny DA, Kaniskan B, McCoach DB. The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research. 2015;44(3):486–507. doi: 10.1177/0049124114543236. [DOI] [Google Scholar]
  52. Krüger-Malpartida H, Pedraz-Petrozzi B, Arevalo-Flores M, Samalvides-Cuba F, Anculle-Arauco V, Dancuart-Mendoza M. Effects on mental health after the COVID-19 lockdown period: Results from a population survey study in Lima, Peru. Clinical Medicine Insights: Psychiatry. 2020;11:1–9. doi: 10.1177/1179557320980423. [DOI] [Google Scholar]
  53. Kruyen PM, Emons WH, Sijtsma K. On the shortcomings of shortened tests: A literature review. International Journal of Testing. 2013;13(3):223–248. doi: 10.1080/15305058.2012.703734. [DOI] [Google Scholar]
  54. Leaune E, Samuel M, Oh H, Poulet E, Brunelin J. Suicidal behaviors and ideation during emerging viral disease outbreaks before the COVID-19 pandemic: A systematic rapid review. Preventive Medicine. 2020;141:106264. doi: 10.1016/j.ypmed.2020.106264. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Lee SA. Coronavirus anxiety scale: A brief mental health screener for COVID-19 related anxiety. Death Studies. 2020;44(7):393–401. doi: 10.1080/07481187.2020.1748481. [DOI] [PubMed] [Google Scholar]
  56. Lee, S. A., Jobe, M. C., & Mathis, A. A. (2020a). Mental health characteristics associated with dysfunctional coronavirus anxiety. Psychological Medicine, 1-2. 10.1017/S003329172000121X. [DOI] [PMC free article] [PubMed]
  57. Lee SA, Jobe MC, Mathis AA, Gibbons JA. Incremental validity of coronaphobia: Coronavirus anxiety explains depression, generalized anxiety, and death anxiety. Journal of Anxiety Disorders. 2020;74:102268. doi: 10.1016/j.janxdis.2020.102268. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Lee SA, Mathis AA, Jobe MC, Pappalardo EA. Clinically significant fear and anxiety of COVID-19: A psychometric examination of the coronavirus anxiety scale. Psychiatry Research. 2020;290:113112. doi: 10.1016/j.psychres.2020.113112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Li C-H. Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods. 2016;48(3):936–949. doi: 10.3758/s13428-015-0619-7. [DOI] [PubMed] [Google Scholar]
  60. Li T, Saklofske DH, Bowden SC, Yan G, Fung TS. The measurement invariance of the Wong and law emotional intelligence scale (WLEIS) across three Chinese university student groups from Canada and China. Journal of Psychoeducational Assessment. 2012;30(4):439–452. doi: 10.1177/0734282912449449. [DOI] [Google Scholar]
  61. Lin, C. Y., Hou, W. L., Mamun, M. A., Aparecido da Silva, J., Broche-Pérez, Y., Ullah, I., et al. (2021). Fear of COVID-19 scale (FCV-19S) across countries: Measurement invariance issues. Nursing Open.10.1002/nop2.855 [DOI] [PMC free article] [PubMed]
  62. Magano J, Vidal DG, Dinis MAP, Leite Â. Validation and psychometric properties of the Portuguese version of the coronavirus anxiety scale (CAS) and fear of COVID-19 scale (FCV-19S) and associations with travel, tourism and hospitality. International Journal of Environmental Research and Public Health. 2021;18(2):427. doi: 10.3390/ijerph18020427. [DOI] [PMC free article] [PubMed] [Google Scholar]
  63. Meredith W. Measurement invariance, factor analysis and factorial invariance. Psychometrika. 1993;58(4):525–543. doi: 10.1007/BF02294825. [DOI] [Google Scholar]
  64. Milfont, T. L., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111-130. 10.21500/20112084.857.
  65. Miller MJ, Loaiza JR, Takyar A, Gilman RH. COVID-19 in Latin America: Novel transmission dynamics for a global pandemic? PLoS Neglected Tropical Diseases. 2020;14(5):e0008265. doi: 10.1371/journal.pntd.0008265. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Moghanibashi-Mansourieh A. Assessing the anxiety level of Iranian general population during COVID-19 outbreak. Asian Journal of Psychiatry. 2020;51:102076. doi: 10.1016/j.ajp.2020.102076. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. Nakhostin-Ansari, A., Sherafati, A., Aghajani, F., Khonji, M. S., Aghajani, R., & Shahmansouri, N. (2020). Depression and anxiety among Iranian medical students during COVID-19 pandemic. Iranian Journal of Psychiatry, 15(3), 228-235. 10.18502/ijps.v15i3.3815. [DOI] [PMC free article] [PubMed]
  68. Nikčević AV, Spada MM. The COVID-19 anxiety syndrome scale: Development and psychometric properties. Psychiatry Research. 2020;292:113322. doi: 10.1016/j.psychres.2020.113322. [DOI] [PMC free article] [PubMed] [Google Scholar]
  69. Orellana CI, Orellana LM. Predictores de síntomas emocionales durante la cuarentena domiciliar por pandemia de COVID-19 en El Salvador. Actualidades en Psicología. 2020;34(128):103–120. doi: 10.15517/ap.v34i128.41431. [DOI] [Google Scholar]
  70. Özdin S, Bayrak Özdin Ş. Levels and predictors of anxiety, depression and health anxiety during COVID-19 pandemic in Turkish society: The importance of gender. International Journal of Social Psychiatry. 2020;66(5):504–511. doi: 10.1177/0020764020927051. [DOI] [PMC free article] [PubMed] [Google Scholar]
  71. Pablos-Méndez A, Vega J, Aranguren FP, Tabish H, Raviglione MC. Covid-19 in Latin America. BMJ. 2020;370:m2939. doi: 10.1136/bmj.m2939. [DOI] [PubMed] [Google Scholar]
  72. Padovan-Neto, F. E., Lee, S. A., Guimarães, R. P., Godoy, L. D., Costa, H. B., Zerbini, F. L. S., & Fukusima, S. S. (2021). Brazilian adaptation of the coronavirus anxiety Scale: A Psychometric Investigation of a Measure of Coronaphobia. OMEGA-Journal of Death and Dying, 10.1177/0030222821991325. [DOI] [PMC free article] [PubMed]
  73. Pappa S, Ntella V, Giannakas T, Giannakoulis VG, Papoutsi E, Katsaounou P. Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: A systematic review and meta-analysis. Brain, Behavior, and Immunity. 2020;88:901–907. doi: 10.1016/j.bbi.2020.05.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  74. Paz, C., Mascialino, G., Adana-Díaz, L., Rodríguez-Lorenzana, A., Simbaña-Rivera, K., Gómez-Barreno, L., et al. (2020). Anxiety and depression in patients with confirmed and suspected COVID-19 in Ecuador. Psychiatry and Clinical Neurosciences.10.1111/pcn.13106 [DOI] [PMC free article] [PubMed]
  75. Peterson CH, Peterson NA, Powell KG. Cognitive interviewing for item development: Validity evidence based on content and response processes. Measurement and Evaluation in Counseling and Development. 2017;50(4):217–223. doi: 10.1080/07481756.2017.1339564. [DOI] [Google Scholar]
  76. Petzold MB, Bendau A, Plag J, Pyrkosch L, Maricic LM, Rogoll J, Ströhle A. Development of the COVID-19-anxiety questionnaire and first psychometric testing. Bjpsych Open. 2020;6(5):e91. doi: 10.1192/bjo.2020.82. [DOI] [PMC free article] [PubMed] [Google Scholar]
  77. Pierce M, McManus S, Jessop C, John A, Hotopf M, Ford T, et al. Says who? The significance of sampling in mental health surveys during COVID-19. The Lancet Psychiatry. 2020;7(7):567–568. doi: 10.1016/S2215-0366(20)30237-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  78. Ransing R, Ramalho R, Orsolini L, Adiukwu F, Gonzalez-Diaz JM, Larnaout A, et al. Can COVID-19 related mental health issues be measured? Assessment options for mental health professionals. Brain, Behavior, and Immunity. 2020;88:32–34. doi: 10.1016/j.bbi.2020.05.049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  79. Reis, L. M., Pereira, C. J., de Assis Freire, S. E., & de Medeiros, É. D. (2020). Medidas desenvolvidas para avaliar os impactos psicológicos da pandemia de COVID-19: uma revisão sistemática da literatura. Salud & Sociedad, 11, e4565-e4565. 10.22199/issn.0718-7475-2020-0006.
  80. Rodriguez-Morales AJ, Gallego V, Escalera-Antezana JP, Méndez CA, Zambrano LI, Franco-Paredes C, et al. COVID-19 in Latin America: The implications of the first confirmed case in Brazil. Travel Medicine and Infectious Disease. 2020;35:101613. doi: 10.1016/j.tmaid.2020.101613. [DOI] [PMC free article] [PubMed] [Google Scholar]
  81. Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. 10.18637/jss.v048.i02.
  82. Salari N, Hosseinian-Far A, Jalali R, Vaisi-Raygani A, Rasoulpoor S, Mohammadi M, et al. Prevalence of stress, anxiety, depression among the general population during the COVID-19 pandemic: A systematic review and meta-analysis. Globalization and Health. 2020;16(1):1–11. doi: 10.1186/s12992-020-00589-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  83. Samejima, F. (2016). Graded response models. In W. J. van der Linden (Ed.), Handbook of item response theory (pp. 123–136). Chapman and Hall/CRC. doi: 10.1201/9781315374512-16.
  84. Sass DA. Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. Journal of Psychoeducational Assessment. 2011;29(4):347–363. doi: 10.1177/0734282911406661. [DOI] [Google Scholar]
  85. Scholten S, Velten J, Bieda A, Zhang XC, Margraf J. Testing measurement invariance of the depression, anxiety, and stress scales (DASS-21) across four countries. Psychological Assessment. 2017;29(11):1376–1390. doi: 10.1037/pas0000440. [DOI] [PubMed] [Google Scholar]
  86. Silva, W. A. D., de Sampaio Brito, T. R., & Pereira, C. R. (2020). COVID-19 anxiety scale (CAS): Development and psychometric properties. Current Psychology, 1–10. 10.1007/s12144-020-01195-0 [DOI] [PMC free article] [PubMed]
  87. Skalski, S., Uram, P., Dobrakowski, P., & Kwiatkowska, A. (2021). The link between ego-resiliency, social support, SARS-CoV-2 anxiety and trauma effects. Polish adaptation of the coronavirus anxiety scale. Personality and Individual Differences, 171, 110540. 10.1016/j.paid.2020.110540. [DOI] [PMC free article] [PubMed]
  88. Smith GT, McCarthy DM, Anderson KG. On the sins of short-form development. Psychological Assessment. 2000;12(1):102–111. doi: 10.1037/1040-3590.12.1.102. [DOI] [PubMed] [Google Scholar]
  89. Soper, D.S. (2021). A-priori sample size calculator for Structural Equation Models [Software]. Retrieved from http://www.danielsoper.com/statcalc.
  90. Spector PE, Liu C, Sanchez JI. Methodological and substantive issues in conducting multinational and cross-cultural research. In: Morgeson FP, Aguinis H, Ashford SJ, editors. Annual review of organizational psychology and organizational behavior. Palo Alto; 2015. pp. 101–131. [Google Scholar]
  91. Squires JE, Hayduk L, Hutchinson AM, Cranley LA, Gierl M, Cummings GG, et al. A protocol for advanced psychometric assessment of surveys. Nursing Research and Practice. 2013;2013:1–8. doi: 10.1155/2013/156782. [DOI] [PMC free article] [PubMed] [Google Scholar]
  92. Steenkamp JBE, Baumgartner H. Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research. 1998;25(1):78–90. doi: 10.1086/209528. [DOI] [Google Scholar]
  93. Van de Vijver F, Tanzer NK. Bias and equivalence in cross-cultural assessment: An overview. European Review of Applied Psychology. 2004;54(2):119–135. doi: 10.1016/j.erap.2003.12.004. [DOI] [Google Scholar]
  94. Vandenberg RJ, Lance CE. A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods. 2000;3(1):4–70. doi: 10.1177/109442810031002. [DOI] [Google Scholar]
  95. Vindegaard N, Benros ME. COVID-19 pandemic and mental health consequences: Systematic review of the current evidence. Brain, Behavior, and Immunity. 2020;89:531–542. doi: 10.1016/j.bbi.2020.05.048. [DOI] [PMC free article] [PubMed] [Google Scholar]
  96. Wang Y, Di Y, Ye J, Wei W. Study on the public psychological states and its related factors during the outbreak of coronavirus disease 2019 (COVID-19) in some regions of China. Psychology, Health & Medicine. 2021;26(1):13–22. doi: 10.1080/13548506.2020.1746817. [DOI] [PubMed] [Google Scholar]
  97. Weiss, M. G., & Somma, D. (2007). Explanatory models in psychiatry. In D. Bhugra & K. Bhui (Eds.), Textbook of cultural psychiatry (pp.127–140). : Cambridge University Press. 10.1017/CBO9780511543609.012
  98. Wenham C, Smith J, Morgan R. COVID-19: The gendered impacts of the outbreak. The Lancet. 2020;395(10227):846–848. doi: 10.1016/S0140-6736(20)30526-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  99. Wu T, Jia X, Shi H, Niu J, Yin X, Xie J, Wang X. Prevalence of mental health problems during the COVID-19 pandemic: A systematic review and meta-analysis. Journal of Affective Disorders. 2020;281:91–98. doi: 10.1016/j.jad.2020.11.117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  100. Xiong J, Lipsitz O, Nasri F, Lui LM, Gill H, Phan L, et al. Impact of COVID-19 pandemic on mental health in the general population: A systematic review. Journal of Affective Disorders. 2020;277:55–64. doi: 10.1016/j.jad.2020.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  101. Yang Y, Green SB. A note on structural equation modeling estimates of reliability. Structural Equation Modeling. 2010;17(1):66–81. doi: 10.1080/10705510903438963. [DOI] [Google Scholar]
  102. Yoon M, Lai MHC. Testing factorial invariance with unbalanced samples. Structural Equation Modeling. 2018;25(2):201–213. doi: 10.1080/10705511.2017.1387859. [DOI] [Google Scholar]
  103. Żemojtel-Piotrowska M, Piotrowski JP, Osin EN, Cieciuch J, Adams BG, Ardi R, et al. The mental health continuum-short form: The structure and application for cross-cultural studies–a 38 nation study. Journal of Clinical Psychology. 2018;74(6):1034–1052. doi: 10.1002/jclp.22570. [DOI] [PubMed] [Google Scholar]
  104. Zenker S, Braun E, Gyimóthy S. Too afraid to travel? Development of a pandemic (COVID-19) anxiety travel scale (PATS) Tourism Management. 2021;84:104286. doi: 10.1016/j.tourman.2021.104286. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

ESM 1 (188.8KB, csv)

(CSV 188 kb)

Data Availability Statement

The datasets generated during and/or analyzed during the current study are available at the following link: https://mfr.osf.io/render?url=https%3A%2F%2Fosf.io%2F8jtw5%2Fdownload

The syntaxes of the underlying findings are available at the following link: https://mfr.osf.io/render?url=https%3A%2F%2Fosf.io%2Fh5ugs%2Fdownload

Articles from Current Psychology (New Brunswick, N.j.) are provided here courtesy of Nature Publishing Group

RESOURCES