Abstract
The purpose of this study was to evaluate the prevalence of depression, anxiety, distress, and insomnia and related factors in healthcare workers during the COVID-19 pandemic in Turkey. We applied the study survey online to HCWs during the pandemic in Turkey between 23 April and 23 May 2020. We used the sociodemographic data form, Patient Health Questionnaire-9, General Anxiety Disorder-7, Insomnia Severity Index, and Impact of Event Scale-Revised. Six hundred twenty (66.0%) of the 939 HCWs taking part in the study were female, 580 (61.8%) were physicians, 569 (60.6%) were working on the front line. Seven hundred twenty-nine (77.6%) participants exhibited depression, 565 (60.2%) anxiety, 473 (50.4%) insomnia, and 717 (76.4%) distress symptoms. Depression, anxiety, insomnia, and distress symptoms were significantly greater among females, individuals with a history of psychiatric illness, and individuals receiving psychiatric support during the COVID-19 pandemic. HCWs serving in Turkey during the COVID-19 pandemic experienced high levels of depression, anxiety, insomnia, and distress symptoms. Female gender, being a nurse, working on the front line, history of psychiatric illness, and being tested for COVID-19 were identified as risk factors for mental health problems.
Keywords: Depression, Anxiety, Psychological distress, Sleep, Healthcare workers, COVID-19
Introduction
Following its first emergence in December 2019 in Wuhan, 2019 novel coronavirus (2019-nCoV) spread rapidly across the world [1]. The disease caused by 2019-nCoV was given the name coronavirus disease 2019 (COVID-19) by the World Health Organization (WHO). A pandemic was subsequently declared by the WHO on 11 Mart 2020. The first case in Turkey was reported by the Ministry of Health on that same date [2]. While decreases in the numbers of deaths and positive cases have gradually been seen in some countries, the pandemic is still maintaining momentum in specific regions of the world.
Healthcare workers (HCWs) have provided a very wide spectrum of services throughout the COVID-19 pandemic in Turkey. They have worked in pandemic clinics, wards, operating rooms, and intensive care units, non-pandemic clinics, wards, operating rooms, and intensive care units, in emergency departments, ambulances, family health centers, pharmacies, and filiation teams. The Turkish Ministry of Health announced that 7428 HCWs had been infected as of 29 April 2020, representing 6.5% of all cases [3]. On April 16, 2020, the Italian National Institute of Health reported that 16,991 HCWs had been infected, representing 10.7% of all cases [4]. High rates of infection among HCWs and reports of deaths among colleagues have an adverse mental impact on HCWs.
The rapid transmission and mortality of COVID-19 result in both the emergence of new mental health problems and the exacerbation of pre-existing ones [5]. Death reports arriving from various countries, death count rising by the day, loss of loved ones, fear of transmitting the disease to loved ones, living apart from one’s family to avoid infecting them, deaths among colleagues, working for extended periods with protective equipment, and stigmatization are all potential triggers of psychological problems [6–10]. Improved technology has differentiated the COVID-19 pandemic from other pandemics [11–14]. Widespread global connections and broad media coverage lead to secondary pandemic disaster reactions (infodemics). Much incorrect information was disseminated rapidly through the media as COVID-19 disease spread and case numbers increased. Repeated exposure to such reports causes increased psychological distress [15]. High levels of coverage of COVID-19 in the media have been linked to depression and anxiety [16]. Very high numbers of online searches have been shown to have been performed about these psychological problems [17]. In addition to the acute effect of all these factors, there will also be long-term consequences. Numerous studies have reported increased psychological problems during and after the earlier SARS, H1N1, and Ebola epidemics [18–28]. The purpose of the present study was to evaluate the prevalence of depression, anxiety, distress, and insomnia and related factors in healthcare workers during the COVID-19 pandemic in Turkey.
Material and Methods
Study Setting and Population
We delivered the online questionnaire created through Google Forms to participants via e-mail, WhatsApp, and Facebook groups. In the first part of the questionnaire, there was a text giving information about the study. Before partaking in the online questionnaire, participants were required to give informed consent for participation and collection and analysis of their data by ticking the “Yes, I agree and hereby give my informed consent” box, and not the “No thanks, I do not give my consent” box on the online form.
The sample size was calculated using the formula N = (Zα)2 P (1−P) /d2. The sample size was calculated at 600, with Zα = 1.96 for a 95% confidence interval and a predicted acceptable margin of error of d = 0.04, at a rate 50% of that in previous similar studies of HCWs and the COVID-19 pandemic from China [29, 30]. Nine hundred fifty-one individuals participated online, although 12 individuals who were not HCWs or not served during the study period were excluded. Nine hundred thirty-nine individuals were thus finally enrolled. The study was performed between 23 April and 23 May 2020. Approval was granted by the Ondokuz Mayıs University Clinical Research Ethical Committee (IRB No. OMUKAEK 2020-228) and by the Turkish Health Ministry Health Services General Directorate Scientific Research Platform.
The Questionnaire
The questionnaire applied contained questions concerning age (18–25/26–30/31–40/41 or above), sex (male/female), marital status (married/unmarried), nature of the place of work (urban/rural), occupation (physician/nurse/other), involvement in the diagnosis, treatment, and care of COVID-19 patients in the pandemic (front line/the second line), time in the profession (< 10 years/10 years or more), presence of chronic disease (yes/no), history of psychiatric illness (yes/no), receipt of psychiatric support during the pandemic (yes/no), being tested for COVID-19 (yes/no), and receipt of COVID-19 treatment (yes/no). The following sections consisted of the Patient Health Questionnaire-9, General Anxiety Disorder-7, Insomnia Severity Index, and Impact of Event Scale-Revised inventories.
Tools
Patient Health Questionnaire-9 (PHQ-9) is a nine-item self-report scale designed to screen for depression. PHQ-9 investigates how frequently patients were troubled by problems in the previous two weeks. Items are rated on a 4-point Likert-type scale, ranging from 0 (not at all) to 3 (nearly every day). Total scores range between 0 and 27. Total scores of 0–4 were regarded as “minimal or none,” 5–9 as “mild,” 10–14 as “moderate,” 15–19 as “moderately severe,” and 20–27 as “severe”. The recognized cut-off value is 10 [31, 32].
General Anxiety Disorder-7 (GAD-7) is a seven-item self-report questionnaire designed to screen for anxiety. GAD-7 investigates how frequently participants have been disturbed by problems in the preceding two weeks. Items are rated on a 4-point Likert-type scale, ranging from 0 (not at all) to 3 (nearly every day). Total scores range between 0 and 21. Total scores of 0–4 were regarded as “not at all,” 5–9 as “mildly,” 10–14 as “moderately,” and 15 as “severely” [33, 34].
The Insomnia Severity Index (ISI) is a seven-item self-report questionnaire evaluating the nature, severity, and impact of insomnia. The ISI investigates participants’ difficulty in falling asleep, difficulty in remaining asleep, very early waking, the satisfaction derived from the sleep pattern, impairments emerging in day to day functioning, awareness of sleep-related impairments, and stress levels caused by sleep problems in the previous one month. Items are rated on a 5-point Likert-type scale, ranging from 0 (no problem) to 4 (very severe problem). Total scores range between 0 and 28. Total scores of 0–7 indicate “absence of insomnia,” 8–14 “sub-threshold insomnia,” 15–21 “moderate insomnia,” and 22–28 “severe insomnia”. A cut-off value of 10 was adopted [35–37].
The Impact of Event Scale-Revised (IES-R) is a 22-item self-report questionnaire evaluating post-traumatic stress. The IES-R investigates how frequently subjects have been troubled by problems in the previous seven days. Items are rated on a 5-point Likert-type scale, ranging from 0 (not at all) to 4 (extremely). Total scores range between 0 and 88. Total scores of 0–8 were regarded as “normal,” 9–25 as “mild” 26–43 as “moderate,” and 44–88 as “severe”. A cut-off value of 24 was adopted [38, 39].
Statistical Analysis
IBM SPSS Statistics Version 25.0 was used for all statistical analyses and calculations. Categorical data were expressed as number and percentage and were compared using the chi-square test. Normal distribution of data was assessed using the Kolmogorov–Smirnov test and normality plots. Non-normally distributed data were expressed as median values with interquartile ranges (IQRs). Non-normally distributed data were compared between two groups using the Mann–Whitney U test, and between more than two groups using the Kruskal–Wallis test. The forward method was employed in binary logistic regression analysis to identify potential risk factors for depression, anxiety, insomnia, and distress. Relationships between risk factors and results were expressed as Odds Ratio (OR) and 95% Confidence Interval (CI). p values < 0.05 were regarded as statistically significant.
Results
Participants’ Demographic Characteristics
Six hundred twenty (66.0%) of the 939 HCWs taking part in this study were female, 339 (36.1%) were aged 26–30, 617 (65.7%) were married, 580 (61.8%) were physicians, 820 (87.3%) were working in an urban area, and 529 (56.3%) had been working for less than 10 years. The analysis showed that 143 (15.2%) HCWs had a chronic disease identified as a risk for COVID-19, 123 (13.1%) had a history of psychiatric illness, and 96 (10.2%) reported receiving psychiatric support during the COVID-19 pandemic. Also, 569 (60.6%) participants reported working in the diagnosis, treatment, or care of COVID-19 patients. Two hundred forty-one (25.7%) had been tested for COVID-19, and 29 (3.1%) had contracted COVID-19 disease (Table 1).
Table 1.
Healthcare workers’ demographic characteristics
Variables | Number | Percentages |
---|---|---|
Sex | ||
Female | 620 | 66.0 |
Male | 319 | 34.0 |
Age (years) | ||
18–25 year | 108 | 11.5 |
26–30 year | 339 | 36.1 |
31–40 year | 276 | 29.4 |
> 40 years | 216 | 23.0 |
Marital status | ||
Married | 617 | 65.7 |
Unmarried | 322 | 34.3 |
Occupation | ||
Physician | 580 | 61.8 |
Nurse | 254 | 27.1 |
Other | 105 | 11.2 |
Urban | 820 | 87.3 |
Rural | 119 | 12.7 |
Working experience | ||
< 10 years | 529 | 56.3 |
≥ 10 years | 410 | 43.7 |
Presence of chronic disease identified as a risk for COVID-19 | ||
Yes | 143 | 15.2 |
No | 796 | 84.8 |
History of psychiatric illness | ||
Yes | 123 | 13.1 |
No | 816 | 86.9 |
Needed psychiatric support in the COVID-19 pandemic | ||
Yes | 96 | 10.2 |
No | 843 | 89.8 |
Working position | ||
Front line | 569 | 60.6 |
Second line | 370 | 39.4 |
Taking the COVID-19 test | ||
Yes | 241 | 25.7 |
No | 698 | 74.3 |
Becoming a COVID-19 patient | ||
Yes | 29 | 3.1 |
No | 910 | 96.9 |
Total | 939 | 100.0 |
Prevalence of Depression, Anxiety, Insomnia, and Distress Symptoms
Seven hundred twenty-nine (77.6%) exhibited symptoms of depression, 565 (60.2%) anxiety symptoms, 473 (50.4%) insomnia symptoms, and 717 (76.4%) distress symptoms. Depression, anxiety, insomnia, and distress symptoms were higher in females than in males. Insomnia and distress symptoms were significantly higher in nurses than among physicians and other participants, while no difference was observed in terms of depression or anxiety symptoms. Depressive symptoms were significantly more prevalent among front line workers than second-line workers, but no difference was determined in terms of anxiety, insomnia, or distress. Significantly more depression, anxiety, insomnia, and distress symptoms were observed in participants with a history of psychiatric illness and receiving psychiatric support during the COVID-19 pandemic (Table 2).
Table 2.
Comparison of depression, anxiety, insomnia, and distress scales by categories
Categories | Total n (%) |
Sex n (%) | Occupation n (%) | Working position n (%) | Psychiatric illness n (%) | Psychiatric support n (%) | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Female | Male | Doctor | Nurse | Others | Front line | Second line | Yes | No | Yes | No | |||
PHQ-9 | Normal | 210(22.4) | 104 (16.8) | 106(33.2) | 137(23.6) | 53(20.9) | 20(19.0) | 112(19.7) | 98(26.5) | 18(14.6) | 192(23.5) | 3(3.1) | 207(24.6) |
Mild | 376(40.0) | 242 (39.0) | 134(42.0) | 236(40.7) | 94(37.0) | 46(43.8) | 219(38.5) | 157(42.4) | 39(31.7) | 337(41.3) | 20(20.8) | 356(42.2) | |
Moderate | 205(21.8) | 160 (25.8) | 45(14.1) | 120(20.7) | 62(24.4) | 23(21.9) | 146(25.7) | 59(15.9) | 31(25.2) | 174(21.3) | 27(28.1) | 178(21.1) | |
Moderately severe | 90(9.6) | 67 (10.8) | 23(7.2) | 56(9.7) | 24(9.4) | 10(9.5) | 54(9.5) | 36(9.7) | 21(17.1) | 69(8.5) | 19(19.8) | 71(8.4) | |
Severe | 58(6.2) | 47 (7.6) | 11(3.4) | 31(5.3) | 21(8.3) | 6(5.7) | 38(6.7) | 20(5.4) | 14(11.4) | 44(5.4) | 27(28.1) | 31(3.7) | |
p-value | < 0.001 | 0.669 | 0.003 | < 0.001 | < 0.001 | ||||||||
GAD-7 | Normal | 374(39.8) | 209 (33.7) | 165(51.7) | 245(42.2) | 85(33.5) | 44(41.9) | 214(37.6) | 160(43.2) | 30(24.4) | 344(42.2) | 6(6.3) | 368(43.7) |
Mild | 387(41.2) | 268 (43.2) | 119(37.3) | 227(39.1) | 114(44.9) | 46(43.8) | 251(44.1) | 136(36.8) | 49(39.8) | 338(41.4) | 38(39.6) | 349(41.4) | |
Moderate | 106(11.3) | 80 (12.9) | 26(8.2) | 69(11.9) | 31(12.2) | 6(5.7) | 60(10.5) | 46(12.4) | 25(20.3) | 81(9.9) | 2(25.0)4 | 82(9.7) | |
Severe | 72(7.7) | 63 (10.2) | 9(2.8) | 39(6.7) | 24(9.4) | 9(8.6) | 44(7.7) | 28(7.6) | 19(15.4) | 53(6.5) | 28(29.2) | 44(5.2) | |
p-value | < 0.001 | 0.114 | 0.142 | < 0.001 | < 0.001 | ||||||||
ISI | Normal | 466(49.6) | 282 (45.5) | 184(57.7) | 324(55.9) | 100(39.4) | 42(40.0) | 266(46.7) | 200(54.1) | 41(33.3) | 425(52.1) | 11(11.5) | 455(54.0) |
Sub-threshold | 335(35.7) | 233 (37.6) | 102(32.0) | 188(32.4) | 103(40.6) | 44(41.9) | 219(38.5) | 116(31.4) | 58(47.2) | 277(33.9) | 48(50.0) | 287(34.0) | |
Moderate | 117(12.5) | 89 (14.4) | 28(8.8) | 59(10.2) | 42(16.5) | 16(15.2) | 72(12.7) | 45(12.2) | 18(14.6) | 99(12.1) | 29(30.2) | 88(10.4) | |
Severe | 21(2.2) | 16 (2.6) | 5(1.6) | 9(1.6) | 9(3.5) | 3(2.9) | 12(2.1) | 9(2.4) | 6(4.9) | 15(1.8) | 8(8.3) | 13(1.5) | |
p-value | 0.002 | < 0.001 | 0.124 | < 0.001 | < 0.001 | ||||||||
IES-R | Normal | 222(23.6) | 107 (17.3) | 115(36.1) | 144(24.8) | 48(18.9) | 30(28.6) | 126(22.1) | 96(25.9) | 13(10.6) | 209(25.6) | 4(4.2) | 218(25.9) |
Mild | 416(44.3) | 286 (46.1) | 130(40.8) | 277(47.8) | 109(42.9) | 30(28.6) | 257(45.2) | 159(43.0) | 55(44.7) | 361(44.2) | 27(28.1) | 389(46.1) | |
Moderate | 171(18.2) | 119 (19.2) | 52(16.3) | 99(17.1) | 45(17.7) | 27(25.7) | 113(19.9) | 58(15.7) | 30(24.4) | 141(17.3) | 30(31.3) | 141(16.7) | |
Severe | 130(13.8) | 108 (17.4) | 22(6.9) | 60(10.3) | 52(20.5) | 18(17.1) | 73(12.8) | 57(15.4) | 25(20.3) | 105(12.9) | 35(36.5) | 95(11.3) | |
p-value | < 0.001 | < 0.001 | 0.184 | 0.001 | < 0.001 |
PHQ-9 9-item patient health questionnaire, GAD-7 7-item generalized anxiety disorder, ISI 7-item insomnia severity index, IES-R 22-item impact of event scale-revised
Depression, Anxiety, Insomnia and Distress Symptom Scores
All scores were significantly higher in females than in males. Depression and anxiety scores were higher in the 26–30 age groups than in other age groups. Only depression scores were significantly higher among workers in rural areas compared to those in urban areas. Depression and anxiety scores in participants working for 10 years or more were significantly higher than those working for less than 10 years. Nurses had higher insomnia and distress scores than the other two groups. All scores were significantly higher among participants with a history of psychiatric illness and requiring psychiatric support during the COVID-19 pandemic. All scores were higher in front line workers, but depression and insomnia scores were significantly higher. All scores were also higher among participants who had been tested for COVID-19, compared to those who had not. Depression and distress scores were significantly higher among patients who had not contracted COVID-19 disease (Table 3).
Table 3.
Comparison of depression, anxiety, insomnia, and distress scales by scores
PHQ-9 Mdn [IQR] | p | GAD-7 Mdn [IQR] | p | ISI Mdn [IQR] | p | IES-R Mdn [IQR] | p | |
---|---|---|---|---|---|---|---|---|
Total | 8.0[5.0–12.0] | 6.0[3.0–8.0] | 8.0[3.0–12.0] | 18.0[9.0–32.0] | ||||
Sex | ||||||||
Female | 9.0[6.0–13.0] | < 0.001 | 6.0[4.0–9.0] | < 0.001 | 8.0[4.0–13.0] | < 0.001 | 21.0[12.0–34.5] | < 0.001 |
Male | 6.0[4.0–9.0] | 4.0[2.0–7.0] | 6.0[2.0–10.0] | 14.0[5.0–24.0] | ||||
Age (years) | ||||||||
18–25 | 9.0[5.0–12.5] | < 0.001 | 5.0[2.0–9.0] | 0.004 | 8.0[4.0–11.0] | 0.489 | 16.0[6.5–29.5] | 0.119 |
26–30 | 9.0[6.0–13.0] | 6.0[3.0–9.0] | 8.0[4.0–12.0] | 20.0[11.0–32.0] | ||||
31–40 | 8.0[5.0–12.0] | 5.0[3.0–8.0] | 8.0[3.0–13.0] | 19.0[9.0–34.0] | ||||
> 40 | 6.5[4.0–9.0] | 5.0[2.0–7.0] | 7.0[3.5–10.0] | 18.0[8.0–29.0] | ||||
Marital status | ||||||||
Married | 8.0[5.0–12.0] | 0.024 | 5.0[3.0–8.0] | 0.262 | 8.0[3.0–12.0] | 0.999 | 19.0[9.0–33.0] | 0.573 |
Unmarried | 9.0[5.0–13.0] | 6.0[3.0–9.0] | 7.0[3.0–12.0] | 17.0[9.0–29.0] | ||||
Urban | 8.0[5.0–12.0] | 0.198 | 5.0[3.0–8.0] | 0.014 | 7.0[3.0–12.0] | 0.382 | 18.0[9.0–31.5] | 0.225 |
Rural | 9.0[6.0–12.0] | 7.0[4.0–9.0] | 8.0[4.0–13.0] | 22.0[11.0–33.0] | ||||
Length of time (years) | ||||||||
< 10 | 8.0[5.0–13.0] | 0.002 | 6.0[3.0–9.0] | 0.017 | 7.0[4.0–11.0] | 0.891 | 19.0[10.0–31.0] | 0.620 |
≥ 10 | 8.0[4.0–11.0] | 5.0[2.0–8.0] | 8.0[3.0–12.0] | 18.0[9.0–32.0] | ||||
Occupation | ||||||||
Physician | 8.0[5.0–12.0] | 0.104 | 5.0[3.0–8.0] | 0.033 | 7.0[3.0–11.0] | < 0.001 | 17.0[9.0–27.0] | < 0.001 |
Nurse | 9.0[5.0–12.0] | 6.0[4.0–9.0] | 9.0[5.0–13.0] | 21.0[12.0–37.0] | ||||
Other | 8.0[5.0–13.0] | 5.0[2.0–8.0] | 8.0[4.0–13.0] | 23.0[7.0–35.0] | ||||
Chronic disease | ||||||||
Yes | 8.0[5.0–13.0] | 0.669 | 5.0[3.0–9.0] | 0.589 | 8.0[4.0–12.0] | 0.525 | 21.0[12.0–35.0] | 0.021 |
No | 8.0[5.0–12.0] | 6.0[3.0–8.0] | 7.5[3.0–12.0] | 18.0[9.0–30.0] | ||||
Psychiatric illness | ||||||||
Yes | 10.0[6.0–16.0] | < 0.001 | 7.0[5.0–12.0] | < 0.001 | 10.0[6.0–14.0] | < 0.001 | 23.0[13.0–37.0] | < 0.001 |
No | 8.0[5.0–12.0] | 5.0[2.0–8.0] | 7.0[3.0–11.0] | 17.5[8.0–30.0] | ||||
Psychiatric support | ||||||||
Yes | 14.0[10.0–20.5] | < 0.001 | 10.5[7.0–15.0] | < 0.001 | 13.5[10.0–18.0] | < 0.001 | 35.5[22.5–50.0] | < 0.001 |
No | 8.0[5.0–11.0] | 5.0[2.0–7.0] | 7.0[3.0–11.0] | 17.0[8.0–28.0] | ||||
Working position | ||||||||
Front line | 8.0[5.0–12.0] | 0.004 | 6.0[3.0–8.0] | 0.068 | 8.0[4.0–12.0] | 0.016 | 19.0[10.0–32.0] | 0.208 |
Second line | 8.0[4.0–11.0] | 5.0[2.0–8.0] | 7.0[3.0–11.0] | 17.0[8.0–30.0] | ||||
COVID-19 test performed | ||||||||
Yes | 9.0[5.0–14.0] | 0.041 | 6.0[4.0–9.0] | 0.009 | 8.0[4.0–13.0] | 0.005 | 22.0[11.0–37.0] | 0.002 |
No | 8.0[5.0–12.0] | 5.0[3.0–8.0] | 7.0[3.0–11.0] | 18.0[8.0–29.0] | ||||
COVID-19 disease | ||||||||
Yes | 8.0[5.0–12.0] | 0.020 | 6.0[3.0–8.0] | 0.109 | 7.0[3.0–12.0] | 0.055 | 18.0[9.0–31.0] | 0.025 |
No | 10.0[7.0–16.0) | 7.0[4.0–11.0] | 10.0[6.0–14.0] | 22.0[16.0–43.0] |
PHQ-9 9-item patient health questionnaire, GAD-7 7-item generalized anxiety disorder, ISI 7-item insomnia severity index, IES-R 22-item impact of event scale–revised, Mdn Median, IQR interquartile range
Risk Factors for Depression, Anxiety, Insomnia, and Distress
Female gender and history of psychiatric illness emerged as risk factors for depression, anxiety, insomnia, and distress symptoms. Having been tested for COVID-19 was a risk factor for insomnia and distress symptoms. Significant causal relationships were determined between depression and age and working on the front line, between anxiety and working in a rural area, and between insomnia and distress and occupation (Table 4).
Table 4.
Risk factors for depression, anxiety, insomnia, and distress
Predictors | OR | 95% CI for OR | p | ||
---|---|---|---|---|---|
Lower | Upper | ||||
Depression | Age | 0.97 | 0.96 | 0.99 | 0.010 |
Sexa | 2.21 | 1.62 | 3.01 | < 0.001 | |
A history of psychiatric illnessb | 1.90 | 1.28 | 2.82 | 0.001 | |
Working positionc | 1.55 | 1.16 | 2.07 | 0.003 | |
Anxiety | Sexa | 1.98 | 1.43 | 2.75 | < 0.001 |
0.50 | 0.33 | 0.75 | 0.001 | ||
A history of psychiatric illnessb | 2.43 | 1.64 | 3.61 | < 0.001 | |
Taking the COVID-19 teste | 1.49 | 1.08 | 2.07 | 0.015 | |
Insomnia | Sexa | 1.48 | 1.09 | 2.01 | 0.012 |
Occupation: Others | < 0.001 | ||||
Physician | 0.56 | 0.36 | 0.86 | 0.010 | |
Nurse | 1.13 | 0.70 | 1.83 | 0.592 | |
A history of psychiatric illnessb | 2.37 | 1.59 | 3.53 | < 0.001 | |
Taking the COVID-19 teste | 1.45 | 1.06 | 1.97 | 0.018 | |
Distress | Sexa | 1.77 | 1.30 | 2.42 | < 0.001 |
Occupation: Others | 0.001 | ||||
Physician | 0.45 | 0.29 | 0.69 | < 0.001 | |
Nurse | 0.63 | 0.39 | 1.01 | 0.059 | |
A history of psychiatric illnessb | 1.85 | 1.25 | 2.75 | 0.002 | |
Taking the COVID-19 teste | 1.46 | 1.07 | 1.99 | 0.015 |
aSex [Male = References],
bA history of psychiatric illness [No = References],
cWorking position [Second line = References],
dPlace of residence [Rural = Reference],
eTaking the COVID-19 test [No = Reference]
Discussions
This is the first study to evaluate the prevalence of depression, anxiety, distress, and insomnia and related factors in healthcare workers during the COVID-19 pandemic in Turkey. The prevalence of depression, anxiety, insomnia, and distress symptoms among the HCWs in the study were 77.6%, 60.2%, 50.4%, and 76.4%, respectively. The prevalence of depression, anxiety, insomnia, and distress in this research were high than those in other studies. Lai et al. reported prevalence of 50.4% (PHQ-9 ≥ 5) for depression, 44.6% (GAD-7 ≥ 5) for anxiety, 34.0% (ISI ≥ 8) for insomnia, and 71.5% (IES-R ≥ 9) for distress, while Zhang et al. reported prevalence of 50.7% (PHQ-9 ≥ 5), 44.7% (GAD-7 ≥ 5), 36.1%(ISI ≥ 8), and 73.4%(IES-R ≥ 9), respectively. Tian et al. reported prevalence of depression, anxiety, insomnia, and perceived stress of 45.6% (PHQ-9 ≥ 5), 20.7%(GAD-7 ≥ 5), 27.0%(ISI ≥ 8), and 60.8% (Perceived Stress Scale (PSS-10) ≥ 15), respectively, and Rossi et al. reported prevalence of 24.7%(PHQ-9 ≥ 15), 8.3%(GAD-7 ≥ 15), 21.9%(ISI ≥ 22), and 49.4% (Global Psycho Trauma Scale—post-traumatic stress disorder subscale GPS-PTSD ≥ 3), respectively. In their study of female HCWs, Li et al. reported a prevalence of 14.2% (PHQ-9 ≥ 10) for depression, 25.2% (GAD-7 ≥ 8) for anxiety, and 31.6% (IES-R > 33) for distress [29, 30, 40–42]. Very different values have been reported by several other studies [9, 43–46]. The use of different evaluation tools and methodologies in studies, and the use of different classifications even if the same scale was employed, leads to very different figures being reported for the prevalence of mental diseases [6]. In general terms, however, it appears that HCWs are experiencing widespread mental health problems during the COVID-19 pandemic. HCWs appear to have major needs for psychiatric support, both during and after the pandemic. The high incidence of mental health problems observed in the present study shows that HCWs in Turkey need psychiatric support now and in the future.
Greater depression, anxiety, insomnia, and distress symptoms were observed in this study in females, individuals with a history of psychiatric illness, and those requiring psychiatric support. Zhang et al. identified living in a rural area for HCWs, being at risk of contact with COVID-19 patients in hospitals, and having a disease as risk factors for insomnia and anxiety in HCWs. Female gender and having a disease emerged as risk factors for depression [43]. Lai et al. reported more severe depression, anxiety, insomnia, and distress symptoms among nurses, female, and front-line workers [29]. In Zhang et al.’s, the risk of insomnia increased as education level decreased among health personnel study. Being a physician was identified as a protective factor against insomnia. The authors attributed this to nurses’ workloads and night shifts, and to their being more in contact with risky patients than doctors [30]. Except for a few studies, nurses are generally reported to be at greater risk of psychological distress than physicians. In Liu et al.’s study, health worker anxiety did not increase in line with age, sex, education, marital status, location, or psychological counseling requirements [47]. Studies performed in the three years following the SARS outbreak in 2003 reported higher levels of burnout, psychological distress, post-traumatic stress disorder, and fear of potential infectious diseases in the future among HCWs. Adverse psychological impacts among HCWs were also reported following the Ebola epidemic due to the traumatic course of the infection, fear of death, and witnessing the deaths of others. The presence of a system that prevents moribund patients from bidding farewell to families and loved ones may cause feelings of guilt among HCWs. There are no normal routines for notifying deaths, and the news may have to be imparted over the phone or by video talk. HCWs witness patients dying alone, and then have to notify this traumatic state of affairs to families. This can lead to excessive stress and burnout among HCWs [19, 22, 25, 48, 49]. These difficulties have been shown to have a clear impact on the quality of sleep and to create an effect resembling post-traumatic stress disorder (PTSD) [44]. Individuals with PTSD are at greater risk of suicidal ideation, attempted suicide, and successful suicide. It should be remembered that HCWs are already in a risky profession. PTSD needs to be carefully considered in the subsequent period and requires a particular evaluation as a risk for suicide [50]. In the present study, being tested for COVID was associated with anxiety, insomnia, and distress. In Rossi et al.’s study, the death of a colleague was associated with PTSD, depression, and insomnia symptoms. Hospitalization of a colleague was associated with PTSD and a high level of perceived stress. A colleague being quarantined has been linked to PTSD, depressive symptoms, and high perceived stress [41]. In the present study, working for less than 10 years was associated with depression and anxiety. In Li et al.’s study, working for > 10 years, medical history including chronic non-infectious diseases and psychiatric illness history, and having ≥ 2 children were identified as joint risk factors for acute stress, while exercising was identified as a common protective factor against depression, anxiety, and acute stress symptoms in females [42]. Chew et al.’s study showed a significant association between the prevalence of physical symptoms among HCWs during the COVID-19 and psychological outcomes [46].
High levels of depression, anxiety, insomnia, and distress symptoms emerged as psychological difficulties experienced by HCWs in the present study. Despite these high rates of symptoms, only one in ten HCWs had received any psychiatric support. The Turkish Health Ministry has set up psychiatric support units and helplines for the COVID-19 pandemic in all the provinces of the country. At the same time, a Mental Health Support System (RUHSAD) application capable of use with smartphones has also been developed [51]. Several associations and institutions have also established helplines. Tele-psychiatric applications and local psychiatric support measures established by hospitals have also been introduced in several countries [52, 53]. In the present study, however, although HCWs experienced various psychiatric symptoms, they generally had not applied to receive such support. Institutions are needed that can evaluate psychiatric support requirements among HCWs.
Limitations
This study has some limitations. First, depression, anxiety, insomnia, and distress were evaluated by only online questionnaires, not with a psychiatric interview. Second, as we could not meet face to face with HCWs, detailed information about psychiatric illness history could not be obtained. Third, this article is a cross-sectional study. Longitudinal research is needed for the prevalence of these mental states in the COVID-19 pandemic process. Fourth, no information could be obtained about the type of psychiatric support received by HCWs. Although the study with the largest sample of studies in Turkey, particularly to work done in China in part is smaller than the number of samples. Further studies are warranted to address this issue.
Conclusions
HCWs in Turkey serving during the COVID-19 pandemic experience high levels of depression, anxiety, insomnia, and distress symptoms. Female gender, history of psychiatric illness, working as a nurse, working on the front line, and being tested for COVID-19 were identified as important risk factors for various mental health problems. HCWs require psychiatric support at which monitoring and control can be performed during and after the pandemic.
Compliance with Ethical Standards
Conflict of interest
The authors declare that they have no conflicting and competing interests.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Mustafa Kürşat Şahin, Email: m.kursatsahin@yahoo.com.
Servet Aker, Email: servetaker@gmail.com.
Gülay Şahin, Email: gulay.sahin@yahoo.com.
Aytül Karabekiroğlu, Email: aytul.karabekiroglu@omu.edu.tr.
References
- 1.World Health Organization. Novel Coronavirus (2019-nCoV) Situation Report -1. 2020.
- 2.World Health Organization. Coronavirus disease 2019 (COVID-19) Situation Report, 52. 2020.
- 3.Bayar GKH, Zontur EC. Turkey currently passing over peak of pandemic. Ankara: Anadolu Agency; 2020. [Google Scholar]
- 4.Lapolla P, Mingoli A, Lee R. Deaths from COVID-19 in healthcare workers in Italy-What can we learn? Infection Control and Hospital Epidemiology. 2020 doi: 10.1017/ice.2020.241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Hao F, Tan W, Jiang L, Zhang L, Zhao X, Zou Y, et al. Do psychiatric patients experience more psychiatric symptoms during COVID-19 pandemic and lockdown? A case-control study with service and research implications for immunopsychiatry. Brain, Behavior, and Immunity. 2020 doi: 10.1016/j.bbi.2020.04.069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Pappa S, Ntella V, Giannakas T, Giannakoulis VG, Papoutsi E, Katsaounou P. Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: A systematic review and meta-analysis. Brain, Behavior, and Immunity. 2020 doi: 10.1016/j.bbi.2020.05.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Kisely S, Warren N, McMahon L, Dalais C, Henry I, Siskind D. Occurrence, prevention, and management of the psychological effects of emerging virus outbreaks on healthcare workers: Rapid review and meta-analysis. BMJ. 2020;369:m1642. doi: 10.1136/bmj.m1642. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Ornell F, Halpern SC, Kessler FHP, Narvaez JCM. The impact of the COVID-19 pandemic on the mental health of healthcare professionals. Cad Saude Publica. 2020;36(4):e00063520. doi: 10.1590/0102-311X00063520. [DOI] [PubMed] [Google Scholar]
- 9.Zhou Y, Zhou Y, Song Y, Ren L, Ng CH, Xiang YT, et al. Tackling the mental health burden of frontline healthcare staff in the COVID-19 pandemic: China's experiences. Psychological Medicine. 2020 doi: 10.1017/S0033291720001622. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Pfefferbaum B, North CS. Mental health and the covid-19 pandemic. New England Journal of Medicine. 2020 doi: 10.1056/NEJMp2008017. [DOI] [PubMed] [Google Scholar]
- 11.Strzelecki A. The second worldwide wave of interest in coronavirus since the COVID-19 outbreaks in South Korea, Italy and Iran: A Google Trends study. Brain, Behavior, and Immunity. 2020 doi: 10.1016/j.bbi.2020.04.042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Springer S, Menzel LM, Zieger M. Google trends reveals: Focus of interest in the population is on treatment options rather than theories about COVID-19 animal origin. Brain, Behavior, and Immunity. 2020 doi: 10.1016/j.bbi.2020.05.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Lin YH, Liu CH, Chiu YC. Google searches for the keywords of "wash hands" predict the speed of national spread of COVID-19 outbreak among 21 countries. Brain, Behavior, and Immunity. 2020 doi: 10.1016/j.bbi.2020.04.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Springer S, Menzel LM, Zieger M. Google trends provides a tool to monitor population concerns and information needs during COVID-19 pandemic. Brain, Behavior, and Immunity. 2020 doi: 10.1016/j.bbi.2020.04.073. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Garfin DR, Silver RC, Holman EA. The novel coronavirus (COVID-2019) outbreak: Amplification of public health consequences by media exposure. Health Psychology. 2020;39(5):355–357. doi: 10.1037/hea0000875. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Yao H. The more exposure to media information about COVID-19, the more distressed you will feel. Brain, Behavior, and Immunity. 2020 doi: 10.1016/j.bbi.2020.05.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Misiak B, Szczesniak D, Koczanowicz L, Rymaszewska J. The COVID-19 outbreak and google searches: Is it really the time to worry about global mental health? Brain, Behavior, and Immunity. 2020 doi: 10.1016/j.bbi.2020.04.083. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Ji D, Ji YJ, Duan XZ, Li WG, Sun ZQ, Song XA, et al. Prevalence of psychological symptoms among Ebola survivors and healthcare workers during the 2014–2015 Ebola outbreak in Sierra Leone: A cross-sectional study. Oncotarget. 2017;8(8):12784–12791. doi: 10.18632/oncotarget.14498. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Van Bortel T, Basnayake A, Wurie F, Jambai M, Koroma AS, Muana AT, et al. Psychosocial effects of an Ebola outbreak at individual, community and international levels. Bulletin of the World Health Organization. 2016;94(3):210–214. doi: 10.2471/BLT.15.158543. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Lehmann M, Bruenahl CA, Lowe B, Addo MM, Schmiedel S, Lohse AW, et al. Ebola and psychological stress of health care professionals. Emerging Infectious Diseases. 2015;21(5):913–914. doi: 10.3201/eid2105.141988. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Matsuishi K, Kawazoe A, Imai H, Ito A, Mouri K, Kitamura N, et al. Psychological impact of the pandemic (H1N1) 2009 on general hospital workers in Kobe. Psychiatry and Clinical Neurosciences. 2012;66(4):353–360. doi: 10.1111/j.1440-1819.2012.02336.x. [DOI] [PubMed] [Google Scholar]
- 22.Liu X, Kakade M, Fuller CJ, Fan B, Fang Y, Kong J, et al. Depression after exposure to stressful events: Lessons learned from the severe acute respiratory syndrome epidemic. Comprehensive Psychiatry. 2012;53(1):15–23. doi: 10.1016/j.comppsych.2011.02.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Goulia P, Mantas C, Dimitroula D, Mantis D, Hyphantis T. General hospital staff worries, perceived sufficiency of information and associated psychological distress during the A/H1N1 influenza pandemic. BMC Infectious Diseases. 2010;10:322. doi: 10.1186/1471-2334-10-322. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Su TP, Lien TC, Yang CY, Su YL, Wang JH, Tsai SL, et al. Prevalence of psychiatric morbidity and psychological adaptation of the nurses in a structured SARS caring unit during outbreak: A prospective and periodic assessment study in Taiwan. Journal of Psychiatric Research. 2007;41(1–2):119–130. doi: 10.1016/j.jpsychires.2005.12.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Maunder RG, Lancee WJ, Balderson KE, Bennett JP, Borgundvaag B, Evans S, et al. Long-term psychological and occupational effects of providing hospital healthcare during SARS outbreak. Emerging Infectious Diseases. 2006;12(12):1924–1932. doi: 10.3201/eid1212.060584. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Chen CS, Wu HY, Yang P, Yen CF. Psychological distress of nurses in Taiwan who worked during the outbreak of SARS. Psychiatric Services (Washington, D. C.) 2005;56(1):76–79. doi: 10.1176/appi.ps.56.1.76. [DOI] [PubMed] [Google Scholar]
- 27.Tam CW, Pang EP, Lam LC, Chiu HF. Severe acute respiratory syndrome (SARS) in Hong Kong in 2003: Stress and psychological impact among frontline healthcare workers. Psychological Medicine. 2004;34(7):1197–1204. doi: 10.1017/s0033291704002247. [DOI] [PubMed] [Google Scholar]
- 28.Chua SE, Cheung V, Cheung C, McAlonan GM, Wong JW, Cheung EP, et al. Psychological effects of the SARS outbreak in Hong Kong on high-risk health care workers. Canadian Journal of Psychiatry. 2004;49(6):391–393. doi: 10.1177/070674370404900609. [DOI] [PubMed] [Google Scholar]
- 29.Lai J, Ma S, Wang Y, Cai Z, Hu J, Wei N, et al. Factors associated with mental health outcomes among health care workers exposed to coronavirus disease 2019. JAMA Network Open Journal. 2020;3(3):e203976. doi: 10.1001/jamanetworkopen.2020.3976. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Zhang C, Yang L, Liu S, Ma S, Wang Y, Cai Z, et al. Survey of insomnia and related social psychological factors among medical staff involved in the 2019 novel coronavirus disease outbreak. Frontiers in Psychiatry. 2020;11:306. doi: 10.3389/fpsyt.2020.00306. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Kroenke K, Spitzer RL, Williams JB. The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine. 2001;16(9):606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Sari YE, Kokoglu B, Balcioglu H, Bilge U, Colak E, Unluoglu I. Turkish reliability of the patient health questionnaire-9. Biomed Res-India. 2016;27:S460–S462. [Google Scholar]
- 33.Spitzer RL, Kroenke K, Williams JB, Lowe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Archives of Internal Medicine. 2006;166(10):1092–1097. doi: 10.1001/archinte.166.10.1092. [DOI] [PubMed] [Google Scholar]
- 34.Konkan R, Şenormanci Ö, Güçlü O, Aydin E, Sungur Z, Yaygın M. Anksiyete Bozukluğu-7 (YAB-7) Testi Türkçe Uyarlaması Geçerlik ve Güvenirliği. Nöro Psikiyatri Arşivi. 2013;50(1):53–58. doi: 10.4274/npa.y6308. [DOI] [Google Scholar]
- 35.Bastien CH, Vallieres A, Morin CM. Validation of the insomnia severity index as an outcome measure for insomnia research. Sleep Medicine. 2001;2(4):297–307. doi: 10.1016/s1389-9457(00)00065-4. [DOI] [PubMed] [Google Scholar]
- 36.Boysan M, Gulec M, Besiroglu L, Kalafat T. Psychometric properties of the insomnia severity index in Turkish sample. Anadolu Psikiyatr De. 2010;11(3):248–252. [Google Scholar]
- 37.Morin CM, Belleville G, Belanger L, Ivers H. The insomnia severity index: Psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep. 2011;34(5):601–608. doi: 10.1093/sleep/34.5.601. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Weiss D, Marmar C, Wilson J, Keane T. The impact of event scale-revised. In: Wilson J, Keane T, editors. Assessing psychological trauma and PTSD: A practitioner’s handbook. New York: Guilford Press; 1997. pp. 399–411. [Google Scholar]
- 39.Çorapçıoğlu A, Yargıç İ, Geyran P, Kocabaşoğlu N. Validity and reliability of Turkish version of "impact of event scale-revised" (IES-R) Yeni Symposium. 2006;44(1):14–22. [Google Scholar]
- 40.Tian T, Meng F, Pan W, Zhang S, Cheung T, Ng CH, et al. Mental health burden of frontline health professionals in screening and caring the imported COVID-19 patients in China during the pandemic. Psychological Medicine. 2020 doi: 10.1017/S0033291720002093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Rossi R, Socci V, Pacitti F, Di Lorenzo G, Di Marco A, Siracusano A, et al. Mental health outcomes among frontline and second-line health care workers during the coronavirus disease 2019 (COVID-19) pandemic in Italy. JAMA Network Open Journal. 2020;3(5):e2010185. doi: 10.1001/jamanetworkopen.2020.10185. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Li G, Miao J, Wang H, Xu S, Sun W, Fan Y, et al. Psychological impact on women health workers involved in COVID-19 outbreak in Wuhan: A cross-sectional study. Journal of Neurology, Neurosurgery and Psychiatry. 2020 doi: 10.1136/jnnp-2020-323134. [DOI] [PubMed] [Google Scholar]
- 43.Zhang WR, Wang K, Yin L, Zhao WF, Xue Q, Peng M, et al. Mental health and psychosocial problems of medical health workers during the COVID-19 epidemic in China. Psychotherapy and Psychosomotics. 2020 doi: 10.1159/000507639. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Yin Q, Sun Z, Liu T, Ni X, Deng X, Jia Y, et al. Posttraumatic stress symptoms of health care workers during the corona virus disease 2019. Clinical Psychology and Psychotherapy. 2020;27(3):384–395. doi: 10.1002/cpp.2477. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Kang L, Ma S, Chen M, Yang J, Wang Y, Li R, et al. Impact on mental health and perceptions of psychological care among medical and nursing staff in Wuhan during the 2019 novel coronavirus disease outbreak: A cross-sectional study. Brain Behaviour and Immunology. 2020 doi: 10.1016/j.bbi.2020.03.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Chew NWS, Lee GKH, Tan BYQ, Jing M, Goh Y, Ngiam NJH, et al. A multinational, multicentre study on the psychological outcomes and associated physical symptoms amongst healthcare workers during COVID-19 outbreak. Brain, Behavior, and Immunity. 2020 doi: 10.1016/j.bbi.2020.04.049. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Liu CY, Yang YZ, Zhang XM, Xu X, Dou QL, Zhang WW, et al. The prevalence and influencing factors in anxiety in medical workers fighting COVID-19 in China: A cross-sectional survey. Epidemiology and Infection. 2020;148:e98. doi: 10.1017/S0950268820001107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Zaka A, Shamloo SE, Fiorente P, Tafuri A. COVID-19 pandemic as a watershed moment: A call for systematic psychological health care for frontline medical staff. Journal of Health Psychology. 2020;25(7):883–887. doi: 10.1177/1359105320925148. [DOI] [PubMed] [Google Scholar]
- 49.Walton M, Murray E, Christian MD. Mental health care for medical staff and affiliated healthcare workers during the COVID-19 pandemic. European Heart Journal: Acute Cardiovascular Care. 2020;9(3):241–247. doi: 10.1177/2048872620922795. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Dutheil F, Mondillon L, Navel V. PTSD as the second tsunami of the SARS-Cov-2 pandemic. Psychological Medicine. 2020 doi: 10.1017/S0033291720001336. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Yener D. Sağlık Bakanlığından sağlık personeline 'mobil' psikolojik destek. Anadolu Ajansı. Ankara: Anadolu Ajansı; 2020. [Google Scholar]
- 52.Pereira-Sanchez V, Adiukwu F, El Hayek S, Bytyci DG, Gonzalez-Diaz JM, Kundadak GK, et al. COVID-19 effect on mental health: Patients and workforce. Lancet Psychiatry. 2020;7(6):e29–e30. doi: 10.1016/S2215-0366(20)30153-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Kang L, Li Y, Hu S, Chen M, Yang C, Yang BX, et al. The mental health of medical workers in Wuhan, China dealing with the 2019 novel coronavirus. Lancet Psychiatry. 2020;7(3):e14. doi: 10.1016/S2215-0366(20)30047-X. [DOI] [PMC free article] [PubMed] [Google Scholar]