Abstract
Background
The demand for care during the COVID-19 pandemic has affected the mental health of healthcare workers (HCWs), thus increasing the need for psychosocial support services. Internet-based interventions have previously been found to reduce occupational stress. The study aims to test the effects of an Internet-based stress recovery intervention—FOREST—among HCWs.
Methods
A randomized controlled trial (RCT) parallel group design with three measurement points will be conducted to assess the efficacy of an Internet-based stress recovery intervention FOREST for nurses. The FOREST intervention is a 6-week Internet-based CBT and mindfulness-based program which comprises of six modules: (1) Introduction, (2) Detachment (relaxation and sleep), (3) Distancing, (4) Mastery (challenge), (5) Control, and (6) Keeping the change alive. We will compare the intervention against a waiting list group at pre-test, post-test, and follow-up. Stress recovery, PTSD, complex PTSD, moral injury, the level of stress, depression, anxiety, and psychological well-being will be measured.
Discussion
The study will contribute to the development of mental healthcare programs for the HCWs. Based on the outcomes of the study, the FOREST intervention can be further developed or offered to healthcare staff as a tool to cope with occupational stress.
Trial registration
ClinicalTrials.gov NCT04817995. Registered on 30 March 2021
Keywords: Internet-based intervention, Stress recovery, PTSD, Moral injury, Healthcare staff
Background
The coronavirus disease 2019 (COVID-19) pandemic has been an enormous challenge for healthcare worldwide, thus putting the mental health of healthcare workers at risk. The increased demand for care during the COVID-19 pandemic has significantly affected healthcare workers’ (HCWs) levels of stress [1, 2], depression [3, 4], and burnout [5–7] and posttraumatic stress disorder [8]. These mental health challenges might be also associated with an experience of moral injury which refers to psychological distress caused by particular actions or absence of them thus violating a person’s moral beliefs [9, 10]. Moral injury is not a mental disorder but it may be related to a negative self-concept and intense negative emotional reactions [10]. Nurses, in particular, are exposed to high psychological distress because they play a crucial role in managing the pandemic-related healthcare crisis [5]. As studies suggest, in the context of the COVID-19 pandemic, nurses may experience emotional exhaustion, depersonalization, and reduced personal accomplishment [6] among other mental health issues.
Despite the obvious increase in demand for psychosocial support during the pandemic, access to tailored psychological services focused on reducing occupational stress in nurses and other medical personnel is limited. Additionally, healthcare workers’ unwillingness to seek psychological help also contributes to this [11]. Furthermore, public health measures and the closure of healthcare services during the pandemic restrict access to traditional mental health services. Internet-based interventions have been found to be effective for a range of mental health conditions [12], including life-stressor-related adjustment disorders [13] as well as burnout among HCWs [14]. Moreover, especially during the COVID-19 pandemic, online therapies are particularly relevant for HCWs because of their flexibility, access to a large-scale number of medical staff, and the possibility to provide psychosocial care for HCWs from isolated regions [15].
The current study aims to test the efficacy of stress recovery intervention FOREST among HCWs, in particular, nurses with high levels of stress in the context of the COVID-19 pandemic. The FOREST intervention was developed based on the theoretical framework of stress recovery [16] which emphasizes the importance of stress self-awareness, life-work balance, and self-care. The program was specifically developed to address the needs of HCWs amid the COVID-19 pandemic and was designed as a CBT and mindfulness-based Internet-delivered intervention to reduce barriers to accessing the intervention.
The primary objective of the trial is:
To evaluate the efficacy of the Internet-based for stress recovery (FOREST) intervention in improving stress recovery among nurses in comparison to a waiting list control group in the context of the COVID-19 pandemic
The secondary objectives are:
-
2.
To assess the effect of the FOREST intervention on posttraumatic stress disorder (PTSD) as well as complex posttraumatic stress disorder (CPTSD) symptoms
-
3.
To investigate the effect of the FOREST intervention on moral injury
-
4.
To evaluate the effect of the FOREST program on the perceived level of stress
-
5.
To assess the effect of the FOREST program on depression and anxiety
-
6.
To evaluate the effect of the FOREST program on psychological well-being
Methods
Study design and setting
A randomized controlled trial (RCT) parallel groups waiting list design with three measurement points will be used to assess the efficacy of an Internet-based stress recovery intervention FOREST for HCWs, i.e., nurses (superiority trial). We aim to recruit 600 participants in Lithuania and, based on previous e-health studies [17], we expect a dropout of 30%. This will generate sufficient statistical power to detect differences between the groups on the primary outcome measure of stress recovery given a significance level of .05 and a power of 80% [18]. Participants will be randomly allocated to the intervention or a waiting list control group with an allocation ratio of 1:1. Participants allocated to the intervention condition will receive the intervention immediately after randomization, and participants in the waiting list condition will be offered the same intervention 6 months later. The intervention will last for 6 weeks. The pre-test, the post-test, and the 3-month follow-up will be carried out at the same time in both study groups. We will compare stress recovery, PTSD and CPTSD symptoms, moral injury, perceived stress, anxiety, depression, and psychological well-being in nurses who participate in the FOREST intervention vs. those on the waiting list. All study measures will be self-reported and administrated via a secure web application [19]. All participants included in the study will get personalized login data on the first day of using the program. Once participants of the study create a secure password, they will be able to log into the platform where they will have access to the content of the intervention, as well as communication with a psychologist. All the content on the platform is private and protected by end-to-end encryption and participants use secure login for each connection to the platform.
This study protocol is following the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 Checklist [20]. The information regarding enrolment, intervention, and assessments in the trial are presented in Table 1. In addition, the details of the rationale of the study are shown in the flowchart (Fig. 1). The ethics approval for the trial was obtained from the Institutional Psychological Research Ethics Committee of Vilnius University (2021-03-22/61). All study participants will be also asked to give a written consent online in order to participate in the study.
Table 1.
Enrolment | Allocation | Post-allocation | Close-out | ||||
---|---|---|---|---|---|---|---|
Timepoint | t1 | t2 | t3 | t4 | t5 | ||
Enrolment | |||||||
Informed consent | X | ||||||
Assessment | X | ||||||
Eligibility screen | X | ||||||
Randomization | X | ||||||
Final allocation | X | ||||||
Interventions | |||||||
Intervention group | X | X | |||||
Waiting list control group | X | X | |||||
Assessments | |||||||
Recovery experiences | X | X | X | X | X | ||
PTSD and CPTSD | X | X | X | X | X | ||
Moral injury | X | X | X | X | X | ||
Stress | X | X | X | X | X | ||
Depression | X | X | X | X | X | ||
Anxiety | X | X | X | X | X | ||
Psychological well-being | X | X | X | X | X | ||
Post-assessment interviews | X |
Participants and inclusion/exclusion criteria
The study will enroll self-referred participants after dissemination of invitations to professional HCWs’ social networks (e.g., social networks of nurses in different regions of Lithuania), healthcare institutions (e.g., primary healthcare centers, hospitals), and press release to national media. The healthcare institutions and administrative staff of HCWs’ social networks will be asked to share the invitation with nurses. No monetary compensation will be offered for the dissemination of study advertisements. Licensed nurses working in the healthcare system throughout the country will be enrolled in the study. To be eligible to participate in the study, applicants must provide written informed consent online, are required to complete a baseline assessment prior to randomization, and meet all of the following criteria: to be at least 18 years old, to comprehend Lithuanian to the degree that one understands the content and instructions of the study, and to have a computer, tablet, smartphone, or similar device with access to the Internet. Applicants meeting any of the following criteria will be excluded from participation in this study: acute psychiatric crisis, high suicide risk, alcohol/drug addiction, and interpersonal violence. For the secondary eligibility check, before the randomization, all the participants will be contacted by phone call for a brief interview to clarify their eligibility for the study.
Randomization
Randomization will be conducted by the researcher not associated with the study team using the random number calculation procedure using www.random.org. In the randomization process, eligible participants’ IDs will be used to allocate HCWs to the intervention or the waiting list groups. All study participants will be informed whether they are allocated to the intervention or the control group after completing the study measures at the baseline measurement point. Furthermore, participants allocated to the waiting list will be asked to fill in the measures at the same measurement points as the intervention group and will be invited to participate in the FOREST intervention after that.
Intervention condition
The FOREST intervention is a modification of the intervention for distressed employees which has been adjusted to the specific needs of the HCWs, i.e., nurses, meaning that the current intervention is more focused on the specific HCWs’ profession-related stressors and mental health issues. The intervention is developed as a guided program with active individualized messaging-based feedback from psychologists following the completed tasks of the intervention as well as psychologist’s support on-demand as a response to the written messages initiated by the intervention participants [21]. In addition, all intervention participants will be contacted by a phone call in the middle of the intervention (after 3 weeks) and at the end of the intervention (after 6 weeks) by their psychologist for a brief interview regarding the usage of the program. The FOREST will be delivered through a secure online platform [19], which has been used in various previous studies and has been translated into Lithuanian.
The content of the FOREST intervention has been developed by the team of clinical psychologists and it is based on cognitive behavior therapy (CBT) principles and mindfulness. The FOREST intervention comprises six modules (the interface of the FOREST is presented in Fig. 2): (1) Introduction, (2) Detachment (relaxation and sleep), (3) Distancing, (4) Mastery (challenge), (5) Control, and (6) Keeping the change alive. The content of the FOREST intervention is presented in Table 2. Each of the six intervention modules consists of psychoeducation (written texts as well as video recordings), two or three exercises for a participant, and a reminder of the opportunity to contact the therapist. Also, tasks for participants will be provided in several formats, namely, listening for audio records, or in the form of written responses to module-related questions. All the audio records will be available for download. Moreover, study participants will be able to choose the intensity of the program according to their personal needs but will be encouraged to complete the exercises to reach the best results on weekly basis. Access to a new module will be provided every week on the same weekday over the 6 weeks. Once accessible, modules will remain available throughout the intervention.
Table 2.
Module | Aim and content of the module | Module exercises |
---|---|---|
1. Introduction |
Introduction to the intervention (aims, benefits, instructions of usage) Psychoeducation about stress and burnout, its benefits and harms Brief psychoeducation about stress recovery: detachment (relaxation and sleep), distancing, mastery (challenge), control |
1. Selecting stressors from the list and naming three most prominent work- and personal life-related stressors 2. Selecting burnout symptoms from the list 3. Short breathing exercise (an audio record) |
2. Detachment (relaxation and sleep) |
Psychoeducation about body relaxation and its benefits Psychoeducation about sleep, its benefits, and harms of prolonged sleep difficulties |
4. Body relaxation (an audio record), evaluation of stress before and after the exercise, naming associations that emerged during relaxation 5. Sleeping relaxation (an audio record) |
3. Distancing |
Psychoeducation about distancing (both physically and mentally) and its benefits in dealing with work and personal life challenges Psychoeducation about intrusive thoughts |
6. Naming three activities that help to keep the distance from work 7. Awareness of thoughts (an audio record) and naming emotions briefly after it 8. Mindful walking (an audio record) |
4. Mastery (challenge) |
Psychoeducation about mastery in day-to-day activities and its benefits Psychoeducation about physical exercise, its benefits, and relations to stress recovery |
9. Selecting activities from the list (both active and less active) or filling in one’s own 10. Short pause (an audio record) 11. Short body stretching (video record) |
5. Control |
Psychoeducation about control over one’s life and its benefits Psychoeducation about the importance of self-care and control over one’s working day structure and its benefits |
12. Naming unnecessary and bothering activities, changing them to pleasant and relaxing activities 13. Reflecting on daily goals (an audio record) |
6. Keeping the change alive |
Summarizing the program and main aspects of the provided information Encouraging to further practice the intervention exercises after completion of the intervention |
14. Brief relaxation exercise (an audio record) |
Five clinical psychologists and five master students in the clinical psychology program will be involved as psychologists in the FOREST intervention. They will all receive special training according to the guidelines specifically developed for the study. Weekly supervision meetings will be scheduled, and supervision will also be provided on request. The role of each psychologist will be to give feedback to study participants regarding the use of the intervention and their psychological well-being or answer their other questions. Psychologists’ feedback will be largely structured and standardized; nevertheless, personalized responses will be encouraged to correspond to the particular case. Study participants and psychologists will communicate within a secure platform [19]. Psychologists will be asked to provide feedback to participants’ comments in 24 h.
Psychologists will respond to signs of deterioration of mental health noticed from the communication with the intervention participant, e.g., suicide threat, by referring to other mental health services. Study participants in need will be provided with the information regarding the mental health services in the community.
Data management
Outcome data will be collected at the three time points using the secure online platform [19]. In addition, data on the usability of the program, such as number of logins, completed exercises, or texts to a psychologist, will be collected within the same platform. All participants will be given an anonymous identifying number. Access to data will be restricted to researchers directly involved in the study only and via a secure login with two-step authentication. All data collected will be stored and managed according to current national regulations of personal data management. All participants will be informed that the data provided will be treated confidentially and will be made aware that in published reports it will not be possible to identify any individual or attribute any information to them.
The collected data will be exported and inputted into SPSS files for analyses and saved on secure university storage. The data file with personal information will be accessible for the researchers directly involved in the study only. Access to the data file with an anonymous identifying number may be provided for the senior and/or junior data analyst as well as made publicly available as a part of the open research data policy required by the journal as a condition for publication of research outputs.
Dropout or premature termination from the study at any point after randomization will be recorded. Participants will be able to choose to withdraw from the study at any point and may ask that previously collected data not be used. Unless a participant has withdrawn consent to participation, repeated attempts will be made to contact participants who will not complete the outcome assessments. All participants will be asked to complete the study measures at each point of measurement, regardless of protocol adherence or any previously uncompleted measures.
Primary outcome
Stress recovery
The Recovery Experiences Questionnaire (REQ) [22] will be used to evaluate the changes in self-reported recovery of stress in HCWs. All 16 items of the REQ are ranked on a 5-point Likert scale ranging from 1 (= totally disagree) to 5 (= totally agree). The scores of the total REQ scale range from 16 to 80. A higher score indicates a more pronounced recovery of stress. Good psychometric properties have been reported previously for the total REQ (Cronbach α = 0.92) as well as for subscales, i.e., psychological detachment (Cronbach α = 0.88), relaxation (Cronbach α = 0.86), mastery (Cronbach α = 0.84), and control (Cronbach α = 0.89) [23].
Secondary outcomes
Posttraumatic stress disorder
The International Trauma Questionnaire (ITQ) [24, 25] will be used to measure self-reported symptoms of posttraumatic stress disorder (PTSD) and complex posttraumatic stress disorder (CPTSD). The ITQ is a widely used measure for ICD-11 PTSD and CPTSD. All 18 ITQ items are evaluated on a 5-point Likert scale ranging from 0 (= not at all) to 4 (= extremely). The scores of the total PTSD and DSO range from 0 to 24. A higher score indicates more severe symptoms of PTSD or CPTSD. Additionally, we will apply a diagnostic algorithm for the diagnosis of PTSD and CPTSD based on the clinical significance of the symptoms and functional impairment [24]. Good psychometric properties were reported for both PTSD as well as DSO subscales (Cronbach α ≥ 0.79) [24].
Moral injury
The Moral Injury Outcome Scale (MIOS) [26] will be used to measure self-reported rates of moral injury. The MIOS is comprised of 14 items. All the MIOS items are ranked on a 5-point Likert scale ranging from 0 (= strongly disagree) to 4 (= strongly agree). The scores of the total MIOS range from 0 to 56. A higher score indicates a more pronounced moral injury. The MIOS is a state-of-the-art measurement instrument for moral injury and ongoing studies are currently being implemented regarding the investigation of the psychometric properties of the MIOS in HCWs.
Stress
The Perceived Stress Scale (PSS-4) [27] will be used to assess the level of perceived stress. The PSS-4 is a brief scale comprising of 4 items ranked on a 5-point Likert scale ranging from 0 (= never) to 4 (= very often). The scores of the total PSS-4 range from 0 to 16. A higher score indicates more pronounced perceived stress. Good psychometric properties were reported previously for the PSS-4 (Cronbach α = 0.75) [28].
Depression and anxiety
The Patient Health Questionnaire-4 (PHQ-4) [29] will be used to measure depression and anxiety symptoms. The PHQ-4 is a self-reported scale comprising of 4 items. All the items are ranked on a 4-point Likert scale ranging from 0 (= not at all) to 3 (= nearly every day). The scores of the total PHQ-4 vary from 0 to 12. A higher score indicates more pronounced depression and anxiety symptoms. Good psychometric properties were reported previously for the total scale (Cronbach α = 0.86) in the sample of HCWs [30].
Psychological well-being
The World Health Organization Well-being Index (WHO-5) [31] will be used to measure psychological well-being. The WHO-5 index is a self-report scale comprising of 5 items. All the items are ranked on a 6-point Likert scale ranging from 0 (= at no time) to 5 (= all the time). The scores of the total WHO-5 vary from 0 to 25. A higher score indicates higher psychological well-being. Good psychometric properties were found in a previous study of the Lithuanian version of WHO-5 (Cronbach α = 0.92) in the sample of HCWs [1].
Other measures
Study participants will be asked to evaluate the usability of the FOREST intervention by ranking how useful (1 = not useful at all to 5 = very useful), satisfactory (1 = I did not like it at all to 5 = I liked it a lot), and easy to use (1 = it was not easy at all to 5 = it was very easy) the intervention has been. They will also be asked to report their subjective impression regarding the improvement of mental well-being (1 = worsened a lot to 5 = improved a lot), general understanding of oneself, and one’s well-being (1 = not at all to 5 = definitely improved) and recommending the program to others (1 = not at all to 5 = definitely would recommend).
Statistical analyses
As the study aims to capture the possible change in primary and secondary outcomes in the intervention group, in comparison to the control group, a series of mixed multivariate repeated-measures ANOVAs with time (pre-test, post-test, and follow-up) as a within-subject factor and group (intervention vs. control) as a between-subject factor will be performed. Continuous data aggregation will be used; the change from baseline of the outcome measures sum scores will be recorded. Additionally, we will calculate both within- and between-group effect sizes. The between-group effect sizes will be calculated by using the mean difference from pre-test to post-test (for the short-term effect) and from pre-test to follow-up (for the long-term effect) in the intervention and control groups and the standard deviations of each group at the pre-test [32]. The within-group effect sizes will be calculated by using the means in each group at pre- and post-test/follow-up and standard deviations at each measurement point. The magnitude of the effect expressed in d will be interpreted as follows: 0.50 = medium effect and ≥ 0.80 = large effect [18]. The data will be analyzed by using the intention-to-treat principle [33]. The missingness of the data will be treated by using the multiple imputation method [34].
Discussion
This study will be among the first which will evaluate the effects of the Internet-based psychosocial intervention on stress levels and mental health of nurses in the context of the COVID-19 pandemic. Work overloads and long working hours contribute to high levels of stress in nurses [3] and new solutions are needed for psychosocial care. Nurses are particularly burdened and are at risk for burnout [5]; thus, the study is targeted to nurses.
The current intervention is developed to address the needs of the HCWs by using digital technologies which increases the usability of the program by providing flexibility while accessing the intervention. Access to intervention via their digital device reduces barriers of help-seeking, as participants of the trial can access the program with high flexibility without the need for appointments with mental health professionals which is particularly important for healthcare staff who often have long working hours and busy schedules. Media resources developed for this intervention, such as audio and video recordings, will make the intervention usable and attractive for the users.
The current study will contribute to the development of mental healthcare programs for HCWs. Based on the outcomes of the study, the FOREST intervention can be further developed or offered to the healthcare staff as a tool to cope with work-related stress and increase well-being if outcomes will show positive effects of the intervention on the study participants. Specifically, the study will fill the gap in the scientific knowledge regarding the short- and long-term effects of Internet-based stress recovery intervention on the mental health of HCWs. Additionally, the study will provide evidence of the impact of Internet-based stress recovery intervention on a moral injury which is an especially relevant experience for HCWs [10].
The study contains several potential risks. The target group of the study has high working loads during the COVID-19 pandemic, thus, leading to potential issues in terms of the study participants’ recruitment, data collection, and adherence. Data collection and compliance with study procedure risks will be managed via communication with a psychologist on the platform, periodic reminders to enter the new intervention session, and phone calls aimed to receive feedback about the study.
Trial status
Recruitment of participants began 01/04/2021 and will continue to 30/06/2021.
Acknowledgements
Not applicable.
Abbreviations
- CPTSD
Complex posttraumatic stress disorder
- COVID-19
The coronavirus disease 2019
- HCW
Healthcare worker
- MIOS
Moral Injury Outcome Scale
- PHQ-4
Patient Health Questionnaire
- PSS-4
Perceived Stress Scale
- PTSD
Posttraumatic stress disorder
- REQ
Recovery Experiences Questionnaire
- RCT
Randomized controlled trial
- WHO-5
World Health Organization Well-being Index
Authors’ contributions
EK principal investigator; LJ first draft of the manuscript; GA supervision; AD, EK, LJ, and ITK content of the intervention; AD and ITK design of the intervention; EK, GA, and IJ critical review of the manuscript; GA provides access to an online platform for intervention; GA supervision; AD, LJ, and ITK investigation, data collection, and data analysis; AD and IJ recruitment of participants. All authors commented upon and approved the final manuscript.
Funding
The trial is funded by the European Regional Development Fund according to the supported activity “Research Projects Implemented by World-class Researcher Groups” under Measure No. 01.2.2-LMT-K-718 (Project No. 01.2.2-LMT-K-718-03-0072).
Availability of data and materials
The data file will not be publicly available. An anonymous copy of the data file of this study will be available from the corresponding author upon reasonable request.
Declarations
Ethics approval and consent to participate
The study was approved on 22 March 2021 by the Psychological Research Ethics Committee in Lithuania (document number 2021-03-22/61). All participants will be asked to provide a written informed consent online in order to participate in the study. The trial was registered on 26 March 2021 via www.clinicaltrials.gov.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Norkiene I, et al. ‘Should I stay, or should I go?’ Psychological distress predicts career change ideation among intensive care staff in Lithuania and the UK amid COVID-19 pandemic. Int J Environ Res Public Health. 2021;18(5):2660. doi: 10.3390/ijerph18052660. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Liao C, Guo L, Zhang C, Zhang M, Jiang W, Zhong Y, Lin Q, Liu Y. Emergency stress management among nurses: a lesson from the COVID-19 outbreak in China–a cross-sectional study. J Clin Nurs. 2021;30(3–4):433–442. doi: 10.1111/jocn.15553. [DOI] [PubMed] [Google Scholar]
- 3.Pappa S, Ntella V, Giannakas T, Giannakoulis VG, Papoutsi E, Katsaounou P. Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: a systematic review and meta-analysis. Brain Behav Immun. 2020;88:901–907. doi: 10.1016/j.bbi.2020.05.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Chew NWS, Lee GKH, Tan BYQ, Jing M, Goh Y, Ngiam NJH, Yeo LLL, Ahmad A, Ahmed Khan F, Napolean Shanmugam G, Sharma AK, Komalkumar RN, Meenakshi PV, Shah K, Patel B, Chan BPL, Sunny S, Chandra B, Ong JJY, Paliwal PR, Wong LYH, Sagayanathan R, Chen JT, Ying Ng AY, Teoh HL, Tsivgoulis G, Ho CS, Ho RC, Sharma VK. A multinational, multicentre study on the psychological outcomes and associated physical symptoms amongst healthcare workers during COVID-19 outbreak. Brain Behav Immun. 2020;88:559–565. doi: 10.1016/j.bbi.2020.04.049. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Manzano García G, Ayala Calvo JC. The threat of COVID-19 and its influence on nursing staff burnout. J Adv Nurs. 2021;77(2):832–844. doi: 10.1111/jan.14642. [DOI] [PubMed] [Google Scholar]
- 6.Chen R, Sun C, Chen JJ, Jen HJ, Kang XL, Kao CC, Chou KR. A large-scale survey on trauma, burnout, and posttraumatic growth among nurses during the COVID-19 pandemic. Int J Ment Health Nurs. 2021;30(1):102–116. doi: 10.1111/inm.12796. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Ruiz-Fernández MD, Ramos-Pichardo JD, Ibáñez-Masero O, Cabrera-Troya J, Carmona-Rega MI, Ortega-Galán ÁM. Compassion fatigue, burnout, compassion satisfaction and perceived stress in healthcare professionals during the COVID-19 health crisis in Spain. J Clin Nurs. 2020;29(21–22):4321–4330. doi: 10.1111/jocn.15469. [DOI] [PubMed] [Google Scholar]
- 8.Allan SM, et al. The prevalence of common and stress-related mental health disorders in healthcare workers based in pandemic-affected hospitals: a rapid systematic review and meta-analysis. Eur J Psychotraumatol. 2020;11(1):1810903. doi: 10.1080/20008198.2020.1810903. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Litz BT, Stein N, Delaney E, Lebowitz L, Nash WP, Silva C, Maguen S. Moral injury and moral repair in war veterans: a preliminary model and intervention strategy. Clin Psychol Rev. 2009;29(8):695–706. doi: 10.1016/j.cpr.2009.07.003. [DOI] [PubMed] [Google Scholar]
- 10.Williamson V, Murphy D, Greenberg N. COVID-19 and experiences of moral injury in front-line key workers. Occup Med (Chic. Ill). 2020;70(5):317–319. doi: 10.1093/occmed/kqaa052. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Medscape UK doctors’ burnout & lifestyle survey 2020. https://www.medscape.com/slideshow/uk-doctors-burnout-2020-6013312?src=mkm_ret_201107_mscpmrk_uk_burnout_2020_int&uac=52399ST&impID=2660722&faf=1 (accessed 04 Dec 2020).
- 12.Niles AN, Axelsson E, Andersson E, Hedman-Lagerlöf E, Carlbring P, Andersson G, Johansson R, Widén S, Driessen J, Santoft F, Ljótsson B. Internet-based cognitive behavior therapy for depression, social anxiety disorder, and panic disorder: effectiveness and predictors of response in a teaching clinic. Behav Res Ther. 2021;136:103767. doi: 10.1016/j.brat.2020.103767. [DOI] [PubMed] [Google Scholar]
- 13.Skruibis P, Eimontas J, Dovydaitiene M, Mazulyte E, Zelviene P, Kazlauskas E. Internet-based modular program BADI for adjustment disorder: protocol of a randomized controlled trial. BMC Psychiatry. 2016;16(1):264. doi: 10.1186/s12888-016-0980-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Smoktunowicz E, Lesnierowska M, Carlbring P, Andersson G, Cieslak R. Resource-based internet intervention (Med-Stress) to improve well-being among medical professionals: randomized controlled trial. J Med Internet Res. 2021;23(1):e21445. doi: 10.2196/21445. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Wind TR, Rijkeboer M, Andersson G, Riper H. The COVID-19 pandemic: the ‘black swan’ for mental health care and a turning point for e-health. Internet Interv. 2020;20:100317. doi: 10.1016/j.invent.2020.100317. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Robert Persson Asplund FC, Christensson H, Videsäter E, Annakarin Häggman BL, Carlbring P, Andersson G. Learning how to recover from stress: results from an internet-based pilot randomized controlled trial. 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res. 2009;11(2):e13. doi: 10.2196/jmir.1194. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Cohen J. Statistical Power Analysis for the Behavioral Sciences. New York: Lawrence Erlbaum Associates; 1988. [Google Scholar]
- 19.Vlaescu G, Alasjö A, Miloff A, Carlbring P, Andersson G. Features and functionality of the Iterapi platform for internet-based psychological treatment. Internet Interv. 2016;6:107–114. doi: 10.1016/j.invent.2016.09.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Chan A-W, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346(15):e7586. doi: 10.1136/bmj.e7586. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Dahlin M, Carlbring P, Håkansson A, Andersson G. Internet-based self-help using automatic messages and support on demand for generalized anxiety disorder: an open pilot study. Digit Psychiatry. 2020;3(1):12–19. doi: 10.1080/2575517X.2020.1822730. [DOI] [Google Scholar]
- 22.Sonnentag S, Fritz C. The Recovery Experience Questionnaire: development and validation of a measure for assessing recuperation and unwinding from work. J Occup Health Psychol. 2007;12(3):204–221. doi: 10.1037/1076-8998.12.3.204. [DOI] [PubMed] [Google Scholar]
- 23.Almén N, Lundberg H, Sundin Ö, Jansson B. The reliability and factorial validity of the Swedish version of the Recovery Experience Questionnaire. Nord Psychol. 2018;70(4):324–333. doi: 10.1080/19012276.2018.1443280. [DOI] [Google Scholar]
- 24.Cloitre M, Shevlin M, Brewin CR, Bisson JI, Roberts NP, Maercker A, Karatzias T, Hyland P. The International Trauma Questionnaire: development of a self-report measure of ICD-11 PTSD and complex PTSD. Acta Psychiatr Scand. 2018;138(6):536–546. doi: 10.1111/acps.12956. [DOI] [PubMed] [Google Scholar]
- 25.Redican E, Nolan E, Hyland P, Cloitre M, McBride O, Karatzias T, Murphy J, Shevlin M. A systematic literature review of factor analytic and mixture models of ICD-11 PTSD and CPTSD using the International Trauma Questionnaire. J Anxiety Disord. 2021;79:102381. doi: 10.1016/j.janxdis.2021.102381. [DOI] [PubMed] [Google Scholar]
- 26.Litz C, B.T. Phelps A, Frankfurt S, Murphy D, Nazarov A, Houle S, Levi-Belz Y, Zerach G, Dell L, Hosseiny F, the members of the M. I. O. S . (MIOS) “The Moral Injury Outcome Scale,”. 2020. [Google Scholar]
- 27.Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385. doi: 10.2307/2136404. [DOI] [PubMed] [Google Scholar]
- 28.Ingram PB, Clarke E, Lichtenberg JW. Confirmatory factor analysis of the Perceived Stress Scale-4 in a community sample. Stress Heal. 2016;32(2):173–176. doi: 10.1002/smi.2592. [DOI] [PubMed] [Google Scholar]
- 29.Kroenke K, Spitzer RL, Williams JBW, Löwe B. An ultra-brief screening scale for anxiety and depression: the PHQ–4. Psychosomatics. 2009;50(6):613–621. doi: 10.1016/S0033-3182(09)70864-3. [DOI] [PubMed] [Google Scholar]
- 30.Tam CC, Sun S, Yang X, Li X, Zhou Y, Shen Z. Psychological distress among HIV healthcare providers during the COVID-19 pandemic in China: mediating roles of institutional support and resilience. AIDS Behav. 2021;25(1):9–17. doi: 10.1007/s10461-020-03068-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Bech P. Measuring the dimensions of psychological general well-being by the WHO-5. QoL Newsl. 2004;32:15–6.
- 32.Morris SB. Estimating effect sizes from pretest-posttest-control group designs. Organ Res Methods. 2008;11(2):364–386. doi: 10.1177/1094428106291059. [DOI] [Google Scholar]
- 33.McCoy CE. Understanding the intention-to-treat principle in randomized controlled trials. West J Emerg Med. 2017;18(6):1075–1078. doi: 10.5811/westjem.2017.8.35985. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Blankers M, Koeter MWJ, Schippers GM. Missing data approaches in eHealth research: simulation study and a tutorial for nonmathematically inclined researchers. J Med Internet Res. 2010;12(5):e1448. doi: 10.2196/jmir.1448. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data file will not be publicly available. An anonymous copy of the data file of this study will be available from the corresponding author upon reasonable request.