Abstract
The mental health impact of the COVID-19 pandemic has been significant, with many regions across the globe reporting significant increases in anxiety, depression, trauma, and insomnia. This study aims to validate a potential cognitive model of maintenance factors of COVID-19 related distress by examining psychological predictors of distress, and their goodness-of-fit as a coherent model. Participants from the general population (n = 555) were recruited using a cross-sectional on-line survey design, assessing Demographic factors, Anxiety, Depression, Loneliness, COVID-19 related distress, Trauma Cognitions related to COVID-19, Rumination, Safety Behaviours, Personality Factors, and Mental Effort related to COVID-19. A series of stepwise linear regressions found that components of the model were significant and accounted for a large percentage of variance when examining Covid-19 related distress (R2 = 0.447 Covid Stress Scale), Anxiety (R2 = 0.536 DASS-Anxiety Subscale) and Depression (R2 = 0.596 Depression DASS-subscale). In a confirmatory factor analysis, Loneliness, Post-Traumatic Cognitions about Self, Post-Traumatic Cognitions about the World, Emotional Stability, and Mental Effort related to COVID-19 loaded onto a single factor. The final model showed adequate fit (CFI = 0.990, TLI = 0.983, RMSEA = 0.053 (0.027–0.080), GFI = 0.986, SRMR = 0.0216, χ2 = 23.087, p = .006). The results highlight the importance of cognitive factors, such as post-traumatic cognitions, rumination, and mental effort in maintaining COVID-19 related distress.
Keywords: COVID-19, Cognitive Behavioural Therapy, CBT, Predictive model, Confirmatory factor analysis
1. Introduction
The COVID-19 pandemic has led to close to four million deaths (World Health Organization, 2021). In addition, the virus has had a profound social and economic impact worldwide, leading to increased unemployment rates, racial discrimination, socioeconomic disparities, and mental health disorders (Kola et al., 2021; Wu et al., 2021).
The mental health impact of the COVID-19 pandemic has been significant, with many regions across the globe reporting significant increases in anxiety, depression, distress and insomnia (Salari et al., 2020; Wu et al., 2021). The restrictions associated with the COVID-19 pandemic, particularly mandatory lockdowns, have been linked to increased loneliness, isolation, post-traumatic stress and depression, with prolonged lockdown duration being associated with higher levels of distress (Brooks et al., 2020; Gong, Cui, Xue, Lu, & Liu, 2021).
Meta-analyses of risk factors for COVID-19 related distress have reported a range of demographic factors: female gender, younger age (21–40), higher level of education, having a close relative or friend who has COVID-19, pre-existing mental and physical health conditions, low socioeconomic status and risk of infection with COVID-19 (Santabárbara et al., 2021; Wang, Kala, & Jafar, 2020; Wu et al., 2021). Studies carried out on samples from the UK and Ireland reported similar risk factors (Hyland et al., 2020; Shevlin et al., 2020). In addition, repeated close exposure to the virus, such as working in a healthcare setting or having been placed under medical quarantine, has been linked to more severe increases in symptoms of COVID-19 related distress (First, Shin, Ranjit, & Houston, 2020; Gong et al., 2021). A recent study by Faustino, Vasco, Delgado, Farinha-Fernandes, and Guerreiro (2022) highlighted the negative effect that early maladaptive schemas could have on mental health within the context of COVID-19. The study found maladaptive schemas such as mistrustfulness and vulnerability to harm were strongly associated with increased levels of COVID-19 related anxiety and distress.
Typically, cognitive models of distress have highlighted that a person's beliefs and related behaviours can create and maintain a sense of threat that maintains a person's anxiety at times of relative safety (e.g. Beck & Haigh, 2014; Salkovskis, 1996), a key question remains whether the existing evidence-base of psychological treatments applies in a situation of unique, realistic, and ongoing health, economic, and social threat. Cognitive models have addressed various factors that contribute to the maintenance of distress. These factors include selective attention, misappraisal of physical symptoms, avoidance behaviours, over-overestimation of the possible risk of infection or death, body scanning, and hyper-vigilance (e.g. Asmundson & Taylor, 2020; Ehlers & Clark, 2000; Rachman, 2012; Salkovskis & Warwick, 2001). A recent study by Mohammadkhani, Akbari, Shahbahrami, Seydavi, and Kolubinski (2022) examined the role of Cognitive Attentional Syndrome in relation to COVID-19, which highlighted that dysfunctional beliefs and ruminations about the pandemic were significant predictors of COVID-19 related anxiety. Furthermore, increases in attentional control were linked to lower levels of rumination and, in turn, lower levels of COVID-19 related distress (Guo, Yang, Elhai, & McKay, 2021). This highlights the role that rumination and selective attention play in the formation and maintenance of COVID-19 related distress. These recent studies highlight that traditional cognitive factors are potentially useful and appropriate targets for treatment in the unique context of the COVID-19 pandemic.
A second question raised by the pandemic is how best to conceptualise the psychological impact on the general population. Studies have argued for the appropriateness of understanding the population-level impact through the conceptualisations of health anxiety, depression, OCD, and trauma (Asmundson & Taylor, 2020; Dennis, Radnitz, & Wheaton, 2021; Karatzias et al., 2020). Recent research has argued that a broader trauma-based conceptualisation of the pandemic (rather than specifically PTSD) could be applicable (Shevlin, Hyland, & Karatzias, 2020; Yuan et al., 2021).
This study examines potential maintenance factors of COVID-19 related distress in a sample from the general population. The proposed model is a conceptualisation; the model proposes the following potential maintenance factors as predictors of COVID-19 related distress: Negative Emotion (Anxiety, Depression, Loneliness), Physical Anxiety Symptoms, Post-Traumatic Cognitions related to COVID-19, Safety Behaviours, Rumination and Mental Effort related to COVID-19.
This paper utilises a general population sample. Similar research has previously used samples with diagnosed mental health difficulties (Calkins, Berman, & Wilhelm, 2013; Hofmann, 2007). However, given the universal nature of the impact of the COVID-19 pandemic, the widespread psychological impact within the general population (Kola et al., 2021; Wu et al., 2021) and the multiple psychological disorders related to the COVID-19 pandemic (Salari et al., 2020; Wu et al., 2021), it seemed particularly important to validate a model within a sample of the general population rather than a clinical subgroup.
These proposed maintenance factors of the Cognitive Model of COVID-19 related distress (Aswad & Gaynor, 2021) are drawn from general cognitive therapy literature (David, Cristea, & Hofmann, 2018) through the author's clinical contact with individuals experiencing COVID-related distress in the early months of the pandemic, and specific data emerging from research on the psychological impact of the COVID-19 pandemic. Specifically, typical negative emotions associated with living through the pandemic have been identified as anxiety, including physical anxiety sensations, depression and loneliness (Ettman et al., 2020; Groarke et al., 2020). Traumatic and peri-traumatic responses have been common population-wide reactions (Forte, Favieri, Tambelli, & Casagrande, 2020; Liu, Zhang, Wong, Hyun, & Hahm, 2020; Silver, 2020). Likewise, rumination has been identified as a common psychological response to the pandemic (Satici, Saricali, Satici, & Griffiths, 2020; Zhou, MacGeorge, & Myrick, 2020). Intrusive rumination has previously been found to mediate the relationship between traumatic experiences and PTSD (Wozniak, Caudle, Harding, Vieselmeyer, & Mezulis, 2019). Of particular interest but also particularly difficult to measure during heightened governmental safety measures is the role of safety behaviours in maintaining distress during COVID-19 (Knowles & Olatunji, 2021; Schimmenti, Billieux, & Starcevic, 2020). Although not usually discussed in cognitive models, mental effort and cognitive load be related to anxiety (Calvo & Eysenck, 1992). Mental effort is particularly relevant to the COVID-19 pandemic as the constant influx of new information and exposure to media created a condition of high cognitive load and increased feelings of worry and fear about COVID-19 (Sasaki, Kuroda, Tsuno, & Kawakami, 2020). People's intrinsic cognitive load has increased due to the constantly changing environment, new restrictions and high levels of information related to COVID-19 (Rathore & Farooq, 2020). Similarly, although not typically included in a cognitive model, it was noticeable that many of the negative emotional impacts of COVID-19 have been moderated by personality factors, in particular, Emotional Stability (Asselmann, Borghans, Montizaan, & Seegers, 2020; Gubler, Makowski, Troche, & Schlegel, 2021) and thus personality factors have been added to the proposed model. The proposed conceptualisation model is in line with classic cognitive models of distress but also grounded in the emerging science of psychological responses to COVID-19.
This study aims to examine potential cognitive predictor variables of COVID-19 related distress and their validity as a single model with strong goodness-of-fit.
2. Method
2.1. Design
A cross-sectional quantitative survey was carried out to measure potential maintenance factors of COVID-19 related distress in a convenience sample of the general population recruited via social media.
2.2. Participants
An a priori power analysis was conducted using G*Power version 3.1.9.7 (Faul, Erdfelder, Lang, & Buchner, 2007) for sample size estimation. The estimated effect size for this study was 0.3, which is considered a small effect size under Cohen's (1988) criteria. With a significance criterion of α = 0.05, power = 0.95, and df = 9, the minimum sample size needed with this effect size is N = 263 for confirmatory factor analysis.
Participants were recruited using convenience sampling via social media platforms (N = 555). The survey was advertised through major social media platforms. To participate in the survey, participants were required to be over the age of 18 and had to be able to understand and complete the survey in English. Responses were collected using Qualtrics. Participants were not compensated for participating. Demographic-related data were collected, including gender, age, nationality, employment status, living environment, number of children in the household, number of adults in the household, whether the respondent had an underlying health condition, whether the respondent had a household member with a health condition, loss of income, whether a person had experienced a COVID-19 infection, whether the respondent had been a close contact of a person with COVID-19 (Table 1 ), the respondent's self-perceived risk from COVID-19.
Table 1.
Demographic breakdown of a cross-sectional survey sample of the general population.
Variable | Group | N (%) |
---|---|---|
Gender | Male | 118 (21.2 %) |
Female | 433 (78 %) | |
Prefer not to say | 2 (0.4 %) | |
Self-identify | 2 (0.4 %) | |
Age | 18–24 | 185 (33.3 %) |
25–34 | 62 (11.2 %) | |
35–44 | 119 (21.4 %) | |
45–54 | 70 (12.6 %) | |
55–64 | 68 (12.3 %) | |
64+ | 51 (9.2 %) | |
Nationality | Ireland | 432 (77.8 %) |
Europe | 96 (17.3 %) | |
Other | 27 (4.9 %) | |
Underlying health condition | Yes | 124 (22.3 %) |
No | 431 (77.7 %) | |
Household health condition | Yes | 192 (34.6 %) |
No | 363 (65.4 %) | |
Had Covid | Symptoms + no test | 29 (5.2 %) |
Positive test | 15 (2.7 %) | |
Negative test | 156 (28.1 %) | |
No symptoms | 355 (64 %) | |
Close contact had Covid | Symptoms + no test | 22 (4 %) |
Positive test | 271 (48.8 %) | |
Negative test | 243 (43.8 %) | |
No symptoms | 19 (3.4 %) | |
Living environment | Renting | 126 (22.7 %) |
Owning | 260 (46.8 %) | |
With family | 169 (30.5 %) | |
Employment status | Student | 122 (22 %) |
Unemployed | 17 (3.1 %) | |
Unemployed (Covid) | 32 (5.8 %) | |
Retired/pensioner | 61 (11 %) | |
PT worker | 71 (12.8 %) | |
FT worker | 205 (36.9 %) | |
PT (Covid) | 9 (1.6 %) | |
Care for family/home | 38 (6.8 %) | |
Loss of income | Lost income (Covid) | 177 (31.9 %) |
No loss of income | 340 (61.3 %) | |
Don't know | 38 (6.8 %) | |
No of adults per household | Live alone | 87 (15.7 %) |
1 adult | 214 (38.6 %) | |
2 adults | 105 (18.9 %) | |
3 adults | 95 (17.1 %) | |
4+ adults | 54 (9.7 %) | |
No children per household | No child | 352 (63.4 %) |
1 child | 87 (15.7 %) | |
2 children | 78(14.1 %) | |
3 children | 28 (5 %) | |
4+ children | 10 (9.7 %) |
The following measures were used. An adapted version of the COVID-19 Stress Scale (CSS; Taylor et al., 2020) was used to measure levels of COVID-19 related stress. The Covid Stress Scale included a total of 24 items across three of the five original subscales of the CSS: (1) danger and contamination fears, (2) compulsive checking and reassurance seeking, and (3) traumatic stress symptoms about COVID-19. The subscales measuring xenophobia and socioeconomic consequences were not included. Participants were asked to what extent they felt worries related to COVID-19 over the last six months on a scale of 1 (Not at all) to 5 (Extremely). The internal reliability of the CSS was high (α = 0.929). There are no clinical cut-off scores for the CSS.
The Depression and Anxiety Stress Scales were used to measure Depression, Anxiety and Stress (DASS-21, Lovibond & Lovibond, 1995). The DASS scale total contains 21 total items across the three subscales. Participants were asked to evaluate a series of statements on a scale of 1 (Did not apply to me at all or Never) to 3 (Applied to me very much or most of the time). Depression subscale scores are categorised as Normal 0–4, Mild 5–6, Moderate 7–10, and Severe 11–13. Anxiety subscales scores are categorised as Normal 0–3, Mild 4–5, Moderate 6–7, Severe 8–9, and Extreme 10+. The DASS-21 showed high internal reliability (α = 0.952) across all three subscales (Depression (α = 0.914), anxiety (α = 0.880) and Stress (α = 0.896)).
The UCLA Loneliness Scale (UCLA, Russell, Peplau, & Cutrona, 1980) was used to measure loneliness. The UCLA contained a total of 8 items which were assessed on a 4 Point Likert scale ranging from 1 to 4. Higher scores on the UCLA indicated higher levels of negative constructs of loneliness. The Internal reliability of the UCLA was measured as high (α = 0.886).
An adapted version of the Post Traumatic Cognitions Inventory (PTCI; Foa, Ehlers, Clark, Tolin, & Orsillo, 1999) was used to measure post-traumatic thinking concerning the COVID-19 pandemic. The PTCI included a total of 28 items across 2 subscales: Negative Cognitions about self (21 items) and Negative Cognitions about the World (7 items). Participants were asked to evaluate a series of statements on a scale of 1 (Totally disagree) to 7 (Totally Agree). The Self-Blame subscale was excluded due to the universal nature of the pandemic. The participants were instructed to use their experience of the pandemic as the reference experience. Higher scores on the PTCI indicated higher levels of post-traumatic thinking regarding the COVID-19 pandemic. The PTCI, as measure of cognition, does not have clinical cut-offs. However, the original validation paper described successfully differentiating between three groups: non-trauma (mdn = 45.5; SD = 34.76), trauma without PTSD (mdn = 49.0; SD = 23.52), and trauma with PTSD (mdn = 133.0; SD = 44.17), based on the Total and subscale scores. The internal reliability of the adapted version of the PTCI was measured as high (α = 0.964) and across both subscales (Self (α = 0.963) and World (α = 0.894)).
Safety Behaviours were measured by an adapted version of the Safety Behaviours Scale (Freeman, Garety, & Kuipers, 2001). However, the Safety Behaviour Scale was excluded from the final analysis due to poor internal reliability and a low response rate (α = 0.568).
The Ruminative Response Scale (RRS, Treynor, Gonzalez, & Nolen-Hoeksema, 2003) was used to measure rumination. The RRS was measured on a 4-point Likert scale ranging from 1 (Never) to 4 (Always) to measure the frequency of ruminating thoughts or behaviours. The Internal Reliability of the RRS was measured as high (α = 0.890).
This study used an adapted version of the Rating Scale of Mental Effort (RSME; Zijlstra & Doorn, 1985) to measure Mental effort related to COVID-19. Participants were asked how much mental effort thinking about COVID-19 costs them daily. A slider ranging from 0 (absolutely no effort) to 100 (extreme effort) was used to record participant responses. Higher scores on this scale indicated higher levels of Mental Effort related to COVID-19. The reliability of the original scale showed a strong correlation between test and retest scores (r = 0.96).
The Ten-Item Personality Inventory (TIPI, Gosling, Rentfrow, & Swann, 2003) was used to measure personality dimensions as described in the 5 Factor Model of Personality. There were 10 items distributed evenly across the 5 subscales: Agreeableness, Extraversion, Openness to Experiences, Emotional Stability and Conscientiousness. Each item consisted of either two desirable or undesirable descriptions of a trait. Participants were asked to rank on a scale of 1 (strongly disagree) to 7 (strongly agree) how much they believed each pair of descriptions applied to themselves. The internal reliability of the subscales of the TIPI ranged from low to high: Agreeableness (α = 0.374), Extraversion (α = 0.681), Openness to Experiences (α = 0.522), Emotional Stability (α = 0.738) and Conscientiousness (α = 0.480).
2.3. Procedure
Data were collected from December 2020 to February 2021. This was the longest “lockdown” period in the Republic of Ireland, where a large percentage of the sample was drawn. Convenience sampling was used to recruit participants across various social media platforms such as Facebook, Instagram, and Twitter. Participants were given an informed consent sheet describing the nature and content of the survey and were asked to confirm that they were 18 years or older to continue with the survey. Participants were then asked to complete a series of demographic-related questions before completing the subsequent scales. After completing the scale portion of the survey, participants were given a debrief sheet that included links to relevant support services.
2.4. Data analysis
Data analyses were carried out using IBM SPSS version 26. Missing data analyses were carried out to remove incomplete responses under a 75 % completion cut-off point; Reliability and normality analyses were carried out. Log10 transformations were carried out on any skewed data. Demographic variables were recoded into dummy variables to allow for further analyses. Independent t-tests were carried out to assess demographic variables and COVID-19 related distress. Stepwise linear regressions examined demographic and psychological predictors of COVID-19 related distress. A confirmatory factor analysis was carried out using IBM AMOS to examine the factor loading of the primary variables to emerge from the regression analyses.
2.5. Ethics
Ethics approval was granted by Human Research Ethics Committee University College Dublin Research Ethics Committee (HS-20-55-Gaynor).
3. Results
3.1. Preliminary results
Four hundred eighty-eight participants were removed from the dataset as they failed to provide consent or complete 1–2 % of the total survey, below the agreed threshold of 75 % completion. The remaining sample included 555 participants. Forced response was used on all scales. Closing the survey before completion was deemed a withdrawal from the study, resulting in a nearly complete data set for the remaining participants.
The UCLA Loneliness Scale was recoded to range from 1 (Never) to 4 (Often) to reflect the original scale design. Reliability analyses were conducted to assess the internal reliability of the CSS, DASS, UCLA, PTCI, Safety Behaviours, RRS and TIPI, and all relevant subscales. All scales bar the Safety Behaviour Scale and two subscales of the TIPI showed high reliability above 0.68; The Safety Behaviours Scale was excluded from further analysis. The TIPI was retained due to the adequate reliability of the other subscales (see Supplementary Table 1).
Normality tests were carried out across all scales. Normality was assessed based on fitting a skewness (−1/+1) and kurtosis (−3/+3) range and scores on the Kolmogorov-Smirnoff test of normality in line with standard approaches (Durbin, 1970; Tabachnick & Fidell, 2019). Based on these tests, log10 transformations were carried out on all scales and subscales bar the RSME, the Stress subscale of the DASS, the Extraversion subscale of the TIPI, the agreeableness subscale of the TIPI, the emotional stability subscale of the TIPI and the negative cognitions about the world subscale of the PTCI. Post log10 transformation, only the CSS successfully passed the Kolmogorov Smirnoff test (Kolmogorov Smirnoff = 0.031, df = 555, p = .200). For all other scales, normality was met based on the acceptable range for skewness and kurtosis (see Supplementary Table 2).
3.2. Demographics
All demographic variables were recoded into binary variables. A series of independent t-tests were conducted to compare levels of COVID-19 related distress as measured by the CSS. The results of these independent t-tests highlighted that female gender, younger age (under 35), living with family, change in employment, having children, loss of income, having been infected with COVID-19, having an underlying health condition, and living with a person with an underlying health condition showed higher levels of COVID-19 related distress. Following a Bonferroni correction, only female gender, change in employment status and living with a person with an underlying health condition showed significantly higher levels of COVID-19 related distress. There were no differences in nationality, number of adults in the house and close contact with an infected person (please see Table 2 ).
Table 2.
t-Test's examining COVID-related stress by demographic variable.
Variable | Group | N | M | SD | t | p | d |
---|---|---|---|---|---|---|---|
Gender | Female | 433 | 54.1917 | 15.67 | 4.552 | .000*** | 0.44 |
Other | 122 | 47.5164 | 14.64 | ||||
Age | Under 35 | 247 | 55.0850 | 17.34 | 2.757 | .084 | 0.27 |
35+ | 308 | 50.8312 | 13.95 | ||||
Nationality | Ireland | 432 | 53.2454 | 15.89 | 1.477 | 1 | 0.15 |
Other | 123 | 50.8943 | 14.83 | ||||
Living environment | Rent/own | 386 | 51.4326 | 14.45 | 2.512 | 1 | 0.26 |
Live with family | 169 | 55.6746 | 17.88 | ||||
Employment status | Employment change | 41 | 61.9268 | 17.13 | 3.794 | .000*** | 0.61 |
No change | 514 | 51.9903 | 15.34 | ||||
Adult house | Alone | 87 | 50.7241 | 14.80 | 1.1368 | 1 | 0.15 |
With others | 468 | 53.0962 | 15.83 | ||||
Kids house | No kids | 352 | 51.6960 | 15.24 | 1.985 | .576 | 0.18 |
Kids | 203 | 54.5074 | 16.30 | ||||
Income loss | Loss | 177 | 55.3277 | 16.88 | 2.546 | .132 | 0.003 |
No loss | 378 | 51.5053 | 14.95 | ||||
Infected | Had Covid | 44 | 57.0909 | 13.97 | 2.108 | .0420 | 0.32 |
No Covid | 511 | 52.3483 | 15.77 | ||||
Close infection | Close contact | 293 | 53.5427 | 16.28 | 1.189 | 1 | 0.05 |
No close contact | 262 | 51.8092 | 51.81 | ||||
Health | Health condition | 124 | 55.8629 | 17.33 | 2.405 | .192 | 0.25 |
No condition | 431 | 51.8213 | 15.07 | ||||
House health | Health condition | 192 | 56.3281 | 17.37 | 3.674 | .000*** | 0.35 |
No condition | 363 | 50.8182 | 14.38 |
d = Cohen's d; statistical significance: ***p < .001, all p-values are Bonferroni corrected.
Levels of Traumatic Cognitions measured by the PTCI were assessed based on the group means listed by Foa et al. (1999). Forty-seven per cent of participants displayed traumatic cognitions associated with a trauma diagnosis on the PTCI World subscale. Furthermore, 55.8 % of participants scored within the trauma category on the PTCI Self subscale. This highlights that significant levels of trauma can be found within the sample based on the cut-offs described in Foa et al. (1999).
Anxiety and depression were assessed based on the clinical cut-off points described for the DASS-21 (Lovibond & Lovibond, 1995). Forty-seven per cent of the sample were not depressed, 13.6 % reported mild levels, 16.8 % moderate levels, 9.2 % severe levels, and 13.2 % extreme levels. Sixty-two per cent of the sample did not report significant anxiety; 12.5 % reported mild levels; 7.4 % moderate levels; 5.7 % severe levels; and 12 % extreme levels.
3.3. Stepwise linear regression
Prior to further analysis, assumptions of linearity, normality, independence of observations and homoscedasticity were checked using scatterplots and histograms. Due to possible multicollinearity, the stress subscale of the DASS was removed from the analysis. Three stepwise regressions were carried out with the following dependent variables: Covid Stress (CSS), Anxiety (DASS-subscale) and Depression (DASS-subscale). All demographic variables and the following scales were included in each regression: UCLA, PTCI Self, PTCI World, RRS, RSME and all subscales of the TIPI (Table 3 ).
Table 3.
Stepwise regressions examining different aspects of distress: Covid Stress (CSS), Anxiety (DASS-subscale) and Depression (DASS-subscale).
Model/step | Independent variable | F change | Df | p | Adjusted R2 | Β | p |
---|---|---|---|---|---|---|---|
Dependent: Covid Stress (CSS) | |||||||
1 | RSME | 286.688 | 553 | .000*** | 0.340 | 0.453 | .000*** |
2 | PTCI World | 78.564 | 552 | .000*** | 0.421 | 0.326 | .000*** |
3 | Emotional Stability (TIPI) | 14.268 | 551 | .000*** | 0.435 | −0.188 | .000*** |
4 | PTCI Self | 10.562 | 550 | .001** | 0.445 | −0.158 | .001** |
5 | Health Condition in the Household | 3.865 | 549 | .050 | 0.447 | 0.063 | .050 |
Dependent: Depression (DASS) | |||||||
1 | PTCI Self | 636.656 | 553 | .000*** | 0.534 | 0.482 | .000*** |
2 | RRS | 46.268 | 552 | .000*** | 0.570 | 0.217 | .000*** |
3 | UCLA | 14.845 | 551 | .000*** | 0.580 | 0.143 | .000*** |
4 | Conscientiousness (TIPI) | 9.737 | 550 | .002** | 0.587 | 0.098 | .001** |
5 | RSME | 8.900 | 549 | .003** | 0.592 | 0.103 | .001** |
6 | PTCI World | 5.929 | 548 | .015* | 0.596 | −0.089 | .015* |
Dependent: Anxiety (DASS) | |||||||
1 | PTCI Self | 413.930 | 553 | .000*** | 0.427 | 0.339 | .000*** |
2 | Emotional Stability (TIPI) | 46.878 | 552 | .000*** | 0.471 | −0.185 | .000*** |
3 | RRS | 26.838 | 551 | .000*** | 0.495 | 0.165 | .000*** |
4 | RSME | 20.615 | 550 | .000*** | 0.512 | 0.151 | .000*** |
5 | Living Environment | 13.122 | 549 | .000*** | 0.522 | 0.119 | .000*** |
6 | Underlying Health Condition | 7.206 | 548 | .007** | 0.528 | 0.081 | .006* |
7 | Openness (TIPI) | 6.312 | 547 | .012* | 0.532 | −0.074 | .012* |
8 | Number of Children | 4.888 | 546 | .027* | 0.536 | 0.064 | .027* |
Statistical significance: *p < .05, **p < .005, ***p < .001.
The results showed that when the dependent variable was defined as Covid Stress (CSS), the significant predictors were: Negative Cognitions about the World (PTCI), Negative Cognitions about Self (PTCI), Mental Effort related to COVID-19 (RSME) and Emotional Stability (TIPI) (F (5,549) = 90.738, p < .000, R2 = 0.447).
When the dependent variable was defined as Depression (DASS subscale), the significant predictors were Loneliness (UCLA), Negative Cognitions about the World (PTCI), Negative Cognitions about Self (PTCI), Rumination (RRS), Mental effort related to COVID-19 (RSME) and Conscientiousness (TIPI) (F (6,548) = 137.283, p < .000, R2 = 0.596).
When the dependent variable was defined as anxiety (DASS subscale), the significant predictors were: Negative Cognitions about Self (PTCI), Rumination (RRS), Mental Effort related to COVID-19 (RSME), Emotional Stability (TIPI), Openness (TIPI), Living Environment, Underlying Health Condition, and Number of Children (F (8,546) = 80.890, p < .000, R2 = 0.536).
3.4. Confirmatory factor analysis
For this paper, a single-factor confirmatory factor analysis was conducted (see Fig. 2). The following variables loaded onto a single factor: Loneliness (UCLA), Negative Cognitions about the World (PTCI), Negative Cognitions about Self (PTCI), Rumination (RRS), Mental Effort related to COVID-19 (RSME) and Emotional Stability (TIPI). Assumptions of multivariate normality were assessed based on kurtosis values (kurtosis = −0.290), and an absolute cut-off point of 5 was used; as such, this model satisfies the assumption of multivariate normality. The univariate normality of all scales was assessed prior to this analysis (see preliminary results section). Mahalanobis distance was used to screen for outliers; no potential outlier was identified in the search when a criterion of p < .001 was applied. The DASS subscales of Anxiety and Depression were not included in the final model due to possible misspecification with the post-traumatic cognitions inventory subscales (1.96 cut-off criteria).
Fig. 2.
Factor structure and standardised factor loadings.
Overall, the model showed a good fit to the data (see Table 4 ) based on the full range of model fit indices, including CFI, TLI, RMSEA, GFI and SRMR. All factor loadings were above 0.5 and showed significance at an alpha level of p < .001. Negative Cognitions about Self showed the highest factor loading (0.90). The lowest loading was Mental Effort (RSME) (0.53) (see Fig. 2). The model showed poor fit on the χ2; however, the overall model fit was assessed based on the fit indices below as the χ2 can be highly influenced by sample size (Alavi et al., 2020) (see Table 4).
Table 4.
Model fit indices of a confirmatory factor analysis examining predictors of COVID-19 related distress.
Model | χ 2 | df | p | CFI | TLI | RMSEA (95 % CI) | GFI | SRMR |
---|---|---|---|---|---|---|---|---|
Single factor | 23.087 | 9 | .006 | 0.990 | 0.983 | 0.053(0.027–0.080) | 0.986 | 0.0216 |
4. Discussion
This study aimed to examine potential cognitive maintenance factors of COVID-19 and their coherence as a single model. The cognitive behavioural model of COVID-19 related distress (Fig. 1 ) proposed by Aswad and Gaynor (2021) included Negative Emotions (Loneliness), Physical Anxiety Symptoms, Post-traumatic Cognitions related to COVID-19, Safety Behaviours, Rumination and Mental Effort related to COVID-19. Three regression analyses measuring distress across the domains of anxiety, depression and COVID stress were carried out. The regression analyses produced significant models accounting for large percentages of variance, indicating that Emotions (Loneliness), Trauma Cognitions related to COVID-19 (World and Self Subscales), Rumination, Mental Effort related to COVID-19, Personality Factors (Emotional Stability) and demographic factors (Living Environment, Underlying Health Condition and Number of Children) were significant predictors of a variety of measured forms of distress.
Fig. 1.
A proposed cognitive behavioural model of COVID-19 related distress (Aswad, Gaynor, in preparation).
Note: Variables identified by square boxes represent causal factors as identified through meta-analyses. Variable identified by ovals represent maintenance factors, tested in this paper.
A confirmatory factor analysis was carried out, showing that Loneliness (UCLA), Trauma Cognitions related to COVID-19 (PTCI World and Self subscales), Rumination, Mental Effort related to COVID-19 and Emotional Stability (TIPI) successfully mapped onto a single factor (see Fig. 2 ). This highlights the importance of cognitive factors in the maintenance of COVID-19 related distress. These findings mirror the findings of Mohammadkhani et al. (2022), highlighting that dysfunctional beliefs and ruminations about the pandemic were significant predictors of COVID-19 related anxiety. Research carried out by Faustino et al. (2022) further highlighted the role of negative cognitions as predictors of COVID-19 related distress. Furthermore, decreases in attentional control were linked to higher levels of rumination and, in turn, higher levels of COVID-19 related distress (Guo et al., 2021). This highlights the role that rumination and selective attention play in the formation and maintenance of COVID-19 related distress.
In comparison, demographic factors, which in previous studies such as Salari et al. (2020) and Shevlin, McBride, et al. (2020) were strong predictors of COVID-related distress, were excluded by the regression analyses when psychological factors were included in the models. It is interesting to note that demographic factors were the only significant predictors of anxiety, particularly the presence of an underlying health condition, living environment and the number of children. All three domains were predicted by personality factors such as Emotional Stability and Conscientiousness. Therefore, it can be suggested that while such demographic variables are related to increased anxiety levels, models also need to include intrapersonal psychological factors in predicting COVID-related distress.
This paper aimed to address a secondary hypothesis highlighting that Post-Traumatic Cognitions related to COVID-19 were a maintenance factor of COVID-related distress. Horesh and Brown (2020) and others (Kira et al., 2020) have argued that responses to the pandemic mirror symptoms of collective trauma, including hyper-vigilance, avoidance behaviours, negative cognitions, negative effect changes, fear of death or illness and fear of the future. While there has been some argument about whether a traditional categorisation of PTSD is applicable in the context of COVID-19 (van Overmeire, 2020), Shevlin, Hyland, & Karatzias (2020) have argued that the COVID-19 pandemic meets the criteria for a traumatic event and that a Type III trauma conceptualisation of the pandemic is the most applicable understanding. This study's results support this conceptualisation that living through a pandemic is for the general population experiencing a continuous, collective trauma, similar to living through a period of terrorism or an apartheid regime. Preliminary results carried out as part of this study indicated that based on cut-off points described in Foa et al. (1999), 47.9 % of the sample fell into the trauma category based on scores on the negative cognitions about the world subscale of the PTCI.
Furthermore, 55.8 % of participants fell into the trauma category based on scores on the negative cognitions about the self subscale. This highlights significant levels of continuous traumatic cognitions present within the sample. This further supports the secondary hypothesis that traumatic cognitions associated with COVID-19 represent an important maintenance factor of covid distress.
The results of the regression analyses have highlighted those post-traumatic cognitions related to COVID-19 were common in this general population sample and were significant predictors of all three measured domains of distress. Both domains of the Post-Traumatic Cognitions Inventory successfully and strongly mapped onto the factor of COVID-19 related distress.
Notably, the t-test and the regression analysis highlighted that neither contact with the virus nor close contact with an infected person were significant predictors of COVID-related distress. This is in line with previous research on collective trauma, such as the events of 9/11, where those experiencing trauma symptoms following the incident did not have any direct contact with or experience the event (Marshall et al., 2007). This is of particular interest as studies on previous pandemics such as SARS primarily examined continuous trauma-related cognitions in those who had close contacts with the virus, such as frontline workers and those who contracted SARS (Hong et al., 2009). The cognitive nature of the identified maintaining factors reinforces the importance of meaning-making rather than direct exposure to maintaining distress. As such, the role of frequent news broadcasts with updates on the virus and government safety guidelines may heavily influence beliefs about the threat even in populations that were not directly exposed, as proximity and intensity of the threat were highlighted daily (Xiong et al., 2020).
There were a variety of limitations regarding this study. The results of this study were based on data obtained at a single time point; in the context of COVID-19, this marks a significant limitation as findings obtained in one stage of the pandemic may be different from later stages. Therefore, it is important to note that other factors that may mitigate COVID-19 distress, such as vaccine availability and increased freedom of movement, were not assessed as part of this study. As this model is a conceptualisation of a cognitive maintenance model of Covid-19 related distress, it is important to note that the data were collected at a single time point. A longitudinal study would be required to validate the proposed model further.
This study's results also reflect the cultural context in which they were obtained, particularly relevant in a global pandemic with a wide range of different governmental responses. The data used in this study was obtained using convenience sampling, which may limit the findings' generalisability. The final sample predominantly reflected a European cultural context, with a relatively large portion self-identifying as female. Many of the short forms of the measures were used to create a survey manageable in an appropriate timeframe. This highlights the need to replicate the study with larger, more representative samples using more in-depth assessments of various factors.
Furthermore, due to the low reliability and low rate of responses to the Safety Behaviours Questionnaire, the behavioural element commonly cited as a maintaining factor of distress was excluded from all analyses. Safety Behaviours form an important aspect of COVID-19 distress. However, due to the complexity of the pandemic, many outside factors, such as government mandates, may significantly affect the domain of what can be considered abnormal avoidant behaviour. Further research should consider the impact of behavioural variables such as safety behaviours to increase the model's accuracy.
The model proposed in this study addresses a crucial service applicability issue, as previous research has heavily investigated the causal factor of distress. However, there needs to be more focus on maintenance factors. This model highlights that a cognitive behavioural approach toward treating these maintenance factors is an appropriate intervention, especially focusing on trauma-related cognitions. A CBT-based intervention has been developed and tested based on this model. The paper outlining this intervention is currently in preprint (Aswad & Gaynor, 2021). This intervention focused on addressing the core factors described in the current model. A self-help manual based on the examined factors was also distributed at the time of writing (Gaynor, 2021). Future research should utilise the model outlined in this study as a framework for a CBT-based treatment.
In conclusion, the results emphasise that a cognitive model, including domains such as Loneliness, Post-Traumatic Cognitions related to COVID-19, Rumination, Mental Effort related to COVID-19 and Emotional Stability, may be an accurate representation of the psychological maintenance factors of COVID-19 related distress. The final model illustrates the vital role those post-traumatic cognitions related to COVID-19 play in the maintenance of distress in the context of the COVID-19 pandemic and suggests that a conceptualisation of continuous, collective trauma may be applicable within this context. The final model highlights the role that cognition-based factors play in maintaining distress.
Ethics approval
The questionnaire and methodology used in this study was approved by the Human Research Ethics Committee of University College Dublin (HS-20-55-Gaynor).
Consent to participate
Informed Consent was obtained from all individual participants in this study. No information that could be used to identify a participant was used in this study.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
The authors have no competing interests to declare that are relevant to the content of this article.
Declaration of competing interest
The authors have no conflict of interest.
Footnotes
Supplementary data to this article can be found online at https://doi.org/10.1016/j.actpsy.2023.103861.
Appendix A. Supplementary data
Supplementary Tables Reliability Analysis and Descriptive Stastistics
Data availability
The datasets generated or analysed during this study are available from the corresponding author on reasonable request.
References
- Alavi M., Visentin D.C., Thapa D.K., Hunt G.E., Watson R., Cleary M. Chi-square for model fit in confirmatory factor analysis. Journal of Advanced Nursing. 2020;76:2209–2211. doi: 10.1111/jan.14399. September 1. [DOI] [PubMed] [Google Scholar]
- Asmundson G.J.G., Taylor S. How health anxiety influences responses to viral outbreaks like COVID-19: What all decision-makers, health authorities, and health care professionals need to know. Journal of Anxiety Disorders. 2020;71 doi: 10.1016/j.janxdis.2020.102211. April 1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Asselmann E., Borghans L., Montizaan R., Seegers P. The role of personality in the thoughts, feelings, and behaviors of students in Germany during the first weeks of the COVID-19 pandemic. PLOS ONE. 2020;15(11) doi: 10.1371/JOURNAL.PONE.0242904. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aswad E., Gaynor K. 2021. Development and Initial Feasibility of an Online Cognitive Behavioral Group Intervention for COVID-19 Related Distress. December 13, Preprint. [DOI] [Google Scholar]
- Beck A.T., Haigh E.A.P. Advances in cognitive theory and therapy: The generic cognitive model. Annual Review of Clinical Psychology. 2014;10:1–24. doi: 10.1146/annurev-clinpsy-032813-153734. [DOI] [PubMed] [Google Scholar]
- Brooks S.K., Webster R.K., Smith L.E., Woodland L., Wessely S., Greenberg N., Rubin G.J. The psychological impact of quarantine and how to reduce it: Rapid review of the evidence. The Lancet. 2020;395:912–920. doi: 10.1016/S0140-6736(20)30460-8. March 14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Calkins A.W., Berman N.C., Wilhelm S. Recent advances in research on cognition and emotion in OCD: A review. Current Psychiatry Reports. 2013;15(5) doi: 10.1007/s11920-013-0357-4. [DOI] [PubMed] [Google Scholar]
- Calvo M.G., Eysenck M.W. Anxiety and performance: The processing efficiency theory. Cognition and Emotion. 1992;6(6):409–434. doi: 10.1080/02699939208409696. [DOI] [Google Scholar]
- Cohen J. Routledge Academic; New York, NY: 1988. Statistical power analysis for the behavioral sciences. [Google Scholar]
- David D., Cristea I., Hofmann S.G. Why cognitive behavioral therapy is the current gold standard of psychotherapy. FrontiersPsychiatry. 2018;9(JAN) doi: 10.3389/FPSYT.2018.00004/FULL. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dennis D., Radnitz C., Wheaton M.G. A perfect Storm? Health anxiety, contamination fears, and COVID-19: Lessons learned from past pandemics and current challenges. International Journal of Cognitive Therapy. 2021 doi: 10.1007/s41811-021-00109-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Durbin J. Robustness of the kolmogorov-smirnov test. Journal of the Royal Statistical Society. Series B (Methodological) 1970;32(1):143–162. [Google Scholar]
- Ehlers A., Clark D.M. A cognitive model of post-traumatic stress disorder : Theory and therapy. Behaviour Research and Therapy. 2000;38:319–345. doi: 10.1016/s0005-7967(99)00123-0. [DOI] [PubMed] [Google Scholar]
- Ettman C.K., Abdalla S.M., Cohen G.H., Sampson L., Vivier P.M., Galea S. Prevalence of depression symptoms in US adults before and during the COVID-19 pandemic. JAMA Network Open. 2020;3(9) doi: 10.1001/JAMANETWORKOPEN.2020.19686. e2019686–e2019686. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Faul F., Erdfelder E., Lang A.G., Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. BehaviorResearch Methods. 2007;39(2):175–191. doi: 10.3758/BF03193146/METRICS. [DOI] [PubMed] [Google Scholar]
- Faustino B., Vasco A.B., Delgado J., Farinha-Fernandes A., Guerreiro J.C. 2022. Early maladaptive schemas and COVID-19 anxiety: The mediational role of mistrustfulness and vulnerability to harm and illness. [DOI] [PMC free article] [PubMed] [Google Scholar]
- First J.M., Shin H., Ranjit Y.S., Houston J.B. COVID-19 stress and depression: Examining social media, traditional media, and interpersonal communication. Journal of Loss and Trauma. 2020 doi: 10.1080/15325024.2020.1835386. [DOI] [Google Scholar]
- Foa E.B., Ehlers A., Clark D.M., Tolin D.F., Orsillo S.M. Psychological Assessment. Vol. 11. Janoff-Bulman; 1999. The Post-traumatic Cognitions Inventory (PTCI): development and validation. [Google Scholar]
- Forte G., Favieri F., Tambelli R., Casagrande M. COVID-19 pandemic in the Italian population: Validation of a post-traumatic stress disorder questionnaire and prevalence of PTSD symptomatology. International Journal of Environmental Research and Public Health. 2020;17(11):1–16. doi: 10.3390/IJERPH17114151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Freeman D., Garety P.A., Kuipers E. Persecutory delusions: Developing the understanding of belief maintenance and emotional distress. Psychological Medicine. 2001;31(7):1293–1306. doi: 10.1017/S003329170100455X. [DOI] [PubMed] [Google Scholar]
- Gaynor K. 2021. Coping During Covid-19 Workbook. [DOI] [Google Scholar]
- Gong J., Cui X., Xue Z., Lu J., Liu J. Mental health status and isolation/quarantine during the COVID-19 outbreak: A large-sample-size study of the chinese population. Psychiatry and Clinical Neurosciences. 2021;75:180–181. doi: 10.1111/pcn.13213. May 1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gosling S.D., Rentfrow P.J., Swann W.B. A very brief measure of the big-five personality domains. Journal of Research in Personality. 2003;37(6):504–528. doi: 10.1016/S0092-6566(03)00046-1. [DOI] [Google Scholar]
- Guo Y., Yang H., Elhai J., McKay D. Anxiety regarding COVID-19 is related to attentional control: The mediating role of anxiety sensitivity. Frontiers inPsychiatry. 2021;12:1370. doi: 10.3389/FPSYT.2021.713279/BIBTEX. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Groarke J.M., Berry E., Graham-Wisener L., McKenna-Plumley P.E., McGlinchey E., Armour C. Loneliness in the UK during the COVID-19 pandemic: Cross-sectional results from the COVID-19 psychological wellbeing study. PLOS ONE. 2020;15(9) doi: 10.1371/JOURNAL.PONE.0239698. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gubler D.A., Makowski L.M., Troche S.J., Schlegel K. Loneliness and well-being during the Covid-19 pandemic: Associations with personality and emotion regulation. Journal of Happiness Studies. 2021;22(5):1. doi: 10.1007/S10902-020-00326-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hofmann S.G. Cognitive factors that maintain social anxiety disorder: A comprehensive model and its treatment implications. Cognitive Behaviour Therapy. 2007;36(4):193. doi: 10.1080/16506070701421313. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hong X., Currier G.W., Zhao X., Jiang Y., Zhou W., Wei J. Post-traumatic stress disorder in convalescent severe acute respiratory syndrome patients: A 4-year follow-up study. General Hospital Psychiatry. 2009;31(6):546–554. doi: 10.1016/j.genhosppsych.2009.06.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Horesh D., Brown A.D. Covid-19 response: Traumatic stress in the age of Covid-19: A call to close critical gaps and adapt to new realities. Psychological Trauma: Theory, Research, Practice, and Policy. 2020;12(4):331–335. doi: 10.1037/TRA0000592. [DOI] [PubMed] [Google Scholar]
- Hyland P., Shevlin M., McBride O., Murphy J., Karatzias T., Bentall R.P., Vallières F.… Anxiety and depression in the Republic of Ireland during the COVID-19 pandemic. Acta Psychiatrica Scandinavica. 2020;142(3):249–256. doi: 10.1111/acps.13219. [DOI] [PubMed] [Google Scholar]
- Karatzias T., Shevlin M., Murphy J., McBride O., Ben-Ezra M., Bentall R.P., Hyland P.… Post-traumatic stress symptoms and associated comorbidity during the COVID-19 pandemic in Ireland: A population-based study. Journal of Traumatic Stress. 2020;33(4):365–370. doi: 10.1002/jts.22565. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kira I.A., Shuwiekh H.A.M., Rice K.G., Ashby J.S., Elwakeel S.A., Sous M.S.F., Alhuwailah A., Baali S.B.A., Azdaou C., Oliemat E.M., Jamil H.J. Measuring COVID-19 as traumatic stress: Initial psychometrics and validation. Journal of Loss and Trauma. 2020:1–18. doi: 10.1080/15325024.2020.1790160. [DOI] [Google Scholar]
- Knowles K.A., Olatunji B.O. Anxiety and safety behavior usage during the COVID-19 pandemic: The prospective role of contamination fear. Journal of Anxiety Disorders. 2021;77 doi: 10.1016/J.JANXDIS.2020.102323. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kola L., Kohrt B.A., Hanlon C., Naslund J.A., Sikander S., Balaji M., Patel V.… June 1). COVID-19 mental health impact and responses in low-income and middle-income countries: Reimagining global mental health. The Lancet Psychiatry. 2021;8:535–550. doi: 10.1016/S2215-0366(21)00025-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liu C.H., Zhang E., Wong G.T.F., Hyun S., Hahm H.“.C.”. Factors associated with depression, anxiety, and PTSD symptomatology during the COVID-19 pandemic: clinical implications for US young adult mental health. Psychiatry Research. 2020;290 doi: 10.1016/J.PSYCHRES.2020.113172. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lovibond S.H., Lovibond P.F. Psychology Foundation of Australia. 2nd ed. Vol. 56. 1995. Manual for the Depression Anxiety Stress Scales.https://www.worldcat.org/title/manual-for-the-depression-anxiety-stress-scales/oclc/222009504 Retrieved from. [Google Scholar]
- Marshall R.D., Bryant R.A., Amsel L., Suh E.J., Cook J.M., Neria Y. The psychology of ongoing threat: Relative risk appraisal, the September 11 attacks, and terrorism-related fears. American Psychologist. 2007;62(4):304–316. doi: 10.1037/0003-066X.62.4.304. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mohammadkhani S., Akbari M., Shahbahrami M., Seydavi M., Kolubinski D.C. Metacognitions about health in relation to coronavirus anxiety: the mediating role of cognitive attentional syndrome and distress tolerance. Journal of Rational-Emotive and Cognitive-Behavior Therapy : RET. 2022 doi: 10.1007/S10942-022-00467-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rachman S. Health anxiety disorders: A cognitive construal. Behaviour Research and Therapy. 2012;50(7–8):502–512. doi: 10.1016/j.brat.2012.05.001. [DOI] [PubMed] [Google Scholar]
- Rathore F.A., Farooq F. Information overload and infodemic in the COVID-19 pandemic. Journal of the Pakistan Medical Association. 2020;70(5):S162–S165. doi: 10.5455/JPMA.38. [DOI] [PubMed] [Google Scholar]
- Russell D., Peplau L.A., Cutrona C.E. The revised UCLA loneliness scale: Concurrent and discriminant validity evidence. Journal of Personality and Social Psychology. 1980;39(3):472–480. doi: 10.1037/0022-3514.39.3.472. [DOI] [PubMed] [Google Scholar]
- Salari N., Hosseinian-Far A., Jalali R., Vaisi-Raygani A., Rasoulpoor S., Mohammadi M., Khaledi-Paveh B.… Prevalence of stress, anxiety, depression among the general population during the COVID-19 pandemic: A systematic review and meta-analysis. Globalisation and Health. 2020;16 doi: 10.1186/s12992-020-00589-w. July 6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Salkovskis P.M. The cognitive approach to anxiety: threat beliefs, safety-seeking behavior, and the special case of health anxiety and obsessions. Frontiers of Cognitive Therapy. 1996:48–74. https://psycnet.apa.org/record/1996-98507-003 Retrieved from. [Google Scholar]
- Salkovskis P., Warwick H.M.C. Making sense of hypochondriasis: A cognitive theory of health anxiety. Health Anxiety. 2001:46–64. https://researchportal.bath.ac.uk/en/publications/making-sense-of-hypochondriasis-a-cognitive-theory-of-health-anxi Retrieved from. [Google Scholar]
- Santabárbara J., Lasheras I., Lipnicki D.M., Bueno-Notivol J., Pérez-Moreno M., López-Antón R., Gracia-García P.… Prevalence of anxiety in the COVID-19 pandemic: An updated meta-analysis of community-based studies. Progress in Neuro-Psychopharmacology and Biological Psychiatry. 2021;109 doi: 10.1016/j.pnpbp.2020.110207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sasaki N., Kuroda R., Tsuno K., Kawakami N. Exposure to media and fear and worry about COVID-19. Psychiatry and Clinical Neurosciences. 2020;74(9):501–502. doi: 10.1111/PCN.13095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Satici B., Saricali M., Satici S.A., Griffiths M.D. Intolerance of uncertainty and mental wellbeing: Serial mediation by rumination and fear of COVID-19. International Journal of Mental Health and Addiction. 2020 doi: 10.1007/S11469-020-00305-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schimmenti A., Billieux J., Starcevic V. The four horsemen of fear: An integrated model of understanding fear experiences during the COVID-19 pandemic. Clinical Neuropsychiatry. 2020;17(2):41–45. doi: 10.36131/CN20200202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shevlin M., Hyland P., Karatzias T. Is posttraumatic stress disorder meaningful in the context of the COVID-19 pandemic? A response to Van Overmeire’s commentary on Karatzias et al. (2020) Journal of Traumatic Stress. 2020;33(5):866–868. doi: 10.1002/jts.22592. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shevlin M., McBride O., Murphy J., Miller J.G., Hartman T.K., Levita L., Bentall R.P.… Anxiety, depression, traumatic stress and COVID-19-related anxiety in the UK general population during the COVID-19 pandemic. BJPsych Open. 2020;6(6) doi: 10.1192/bjo.2020.109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Silver R.C. Surviving the trauma of COVID-19. Science. 2020;369(6499):11. doi: 10.1126/SCIENCE.ABD5396. [DOI] [PubMed] [Google Scholar]
- Tabachnick B.G., Fidell L.S. Vol. 5. Pearson Education; 2019. Using multivariate statistics title: Using multivariate statistics. [Google Scholar]
- Taylor S., Landry C.A., Paluszek M.M., Fergus T.A., McKay D., Asmundson G.J.G. Development and initial validation of the COVID stress scales. Journal of Anxiety Disorders. 2020;72 doi: 10.1016/j.janxdis.2020.102232. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Treynor W., Gonzalez R., Nolen-Hoeksema S. Rumination reconsidered: A psychometric analysis. Cognitive Therapy and Research. 2003;27(3) doi: 10.1023/A:1023910315561. [DOI] [Google Scholar]
- van Overmeire R. The methodological problem of identifying criterion a traumatic events during the COVID-19 era: A commentary on Karatzias et al. (2020) Journal of Traumatic Stress. 2020;33(5):864–865. doi: 10.1002/jts.22594. John Wiley and Sons Inc. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang Y., Kala M.P., Jafar T.H. Factors associated with psychological distress during the coronavirus disease 2019 (COVID- 19) pandemic on the predominantly general population: A systematic review and meta-analysis. PLoS ONE. 2020;15 doi: 10.1371/journal.pone.0244630. December 1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wozniak J.D.S., Caudle H.E., Harding K., Vieselmeyer J., Mezulis A.H. The effect of trauma proximity and ruminative response styles on posttraumatic stress and posttraumatic growth following a university shooting. Psychological Trauma: Theory, Research, Practice, and Policy. 2019;12(3) doi: 10.1037/tra0000505. [DOI] [PubMed] [Google Scholar]
- World Health Organization . Weekly operational update on COVID-19. January. Health Organization (WHO); 2021. pp. 1–10.https://www.who.int/publications/m/item/weekly-update-on-covid-19---16-october-2020 [Google Scholar]
- Wu T., Jia X., Shi H., Niu J., Yin X., Xie J., Wang X. Prevalence of mental health problems during the COVID-19 pandemic: A systematic review and meta-analysis. Journal of Affective Disorders. 2021;281(August 2020):91–98. doi: 10.1016/j.jad.2020.11.117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xiong J., Lipsitz O., Nasri F., Lui L.M.W., Gill H., Phan L., McIntyre R.S.… Impact of COVID-19 pandemic on mental health in the general population: A systematic review. Journal of Affective Disorders. 2020;277(July):55–64. doi: 10.1016/j.jad.2020.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yuan K., Gong Y.M., Liu L., Sun Y.K., Tian S.S., Wang Y.J., Lu L.… Prevalence of post-traumatic stress disorder after infectious disease pandemics in the twenty-first century, including COVID-19: A meta-analysis and systematic review. Molecular Psychiatry. 2021 doi: 10.1038/s41380-021-01036-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhou Y., MacGeorge E.L., Myrick J.G. Mental health and its predictors during the early months of the COVID-19 pandemic experience in the United States. International Journal of Environmental Research and Public Health. 2020;17(17):1–19. doi: 10.3390/IJERPH17176315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zijlstra F.R.H., Doorn L. November. Delft University of Technology, Department of Philosophy and Social Sciences; Delft, The Netherlands: 1985. The construction of a scale to measure subjective effort. Retrieved from. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplementary Tables Reliability Analysis and Descriptive Stastistics
Data Availability Statement
The datasets generated or analysed during this study are available from the corresponding author on reasonable request.