Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Aug 11;16(8):e0255774. doi: 10.1371/journal.pone.0255774

Psychological distress and health-related quality of life in patients after hospitalization during the COVID-19 pandemic: A single-center, observational study

Johan Hendrik Vlake 1,2,*, Sanne Wesselius 1, Michel Egide van Genderen 1,2, Jasper van Bommel 2, Bianca Boxma-de Klerk 3, Evert-Jan Wils 1
Editor: Peter G van der Velden4
PMCID: PMC8357130  PMID: 34379644

Abstract

Introduction

Illnesses requiring hospitalization are known to negatively impact psychological well-being and health-related quality of life (HRQoL) after discharge. The impact of hospitalization during the Severe Acute Respiratory Syndrome Corona Virus 2 (SARS-CoV-2) pandemic on psychological well-being and health-related quality of life is expected to be higher due to the exceptional circumstances within and outside the hospital during the pandemic surge. The objective of this study was to quantify psychological distress up to three months after discharge in patients hospitalized during the first coronavirus disease 2019 (COVID-19) pandemic wave. We also aimed to determine HRQoL, to explore predictors for psychological distress and HRQoL, and to examine whether psychological distress was higher in COVID-19 confirmed patients, and in those treated in Intensive Care Units (ICUs).

Methods

In this single-center, observational cohort study, adult patients hospitalized with symptoms suggestive of COVID-19 between March 16 and April 28, 2020, were enrolled. Patients were stratified in analyses based on SARS-CoV-2 PCR results and the necessity for ICU treatment. The primary outcome was psychological distress, expressed as symptoms of post-traumatic stress disorder (PTSD), anxiety, and depression, up to three months post-discharge. Health-related quality of life (HRQoL) was the secondary outcome. Exploratory outcomes comprised predictors for psychological distress and HRQoL.

Results

294 of 622 eligible patients participated in this study (median age 64 years, 36% female). 16% and 13% of these patients reported probable PTSD, 29% and 20% probable anxiety, and 32% and 24% probabledepression at one and three months after hospital discharge, respectively. ICU patients reported less frequently probable depression, but no differences were found in PTSD, anxiety, or overall HRQoL. COVID-19 patients had a worse physical quality of life one month after discharge, and ICU patients reported a better mental quality of life three months after discharge. PTSD severity was predicted by time after discharge and being Caucasian. Severity of anxiety was predicted by time after discharge and being Caucasian. Depression severity was predicted by time after discharge and educational level.

Conclusion

COVID-19 suspected patients hospitalized during the pandemic frequently suffer from psychological distress and poor health-related quality of life after hospital discharge. Non-COVID-19 and non-ICU patients appear to be at least as affected as COVID-19 and ICU patients, underscoring that (post-)hospital pandemic care should not predominantly focus on COVID-19 infected patients.

Introduction

During the first coronavirus disease 2019 (COVID-19) peak in the Netherlands between March and May 2020, extensive measures were taken to reduce the spread of the virus and to safeguard medical care; in general, it was advised to work from home, minimize social contacts, keep distance in public places, and to remain in self-quarantine when experiencing symptoms suggestive of COVID-19 [1]. Upon hospital admission, patients suspected of COVID-19 were strictly isolated, visitation was restricted, and contact with healthcare workers was limited. Moreover, COVID-19 and its consequences were a frequent subject in the media, and patients were as such constantly reminded of the possible severity of the disease.

Illnesses requiring hospitalization, particularly those requiring intensive care unit (ICU) treatment, are known to negatively impact post-discharge psychological well-being; symptoms of depression and anxiety occur in up to 67% of hospitalized patients and symptoms of post-traumatic stress disorder (PTSD) in up to 45% [215]. This post-hospitalization psychological distress negatively impacts the health-related quality of life (HRQoL) [7,11,12,14]. Both demographic characteristics, such as female gender, lower educational level, unemployment and non-western ethnicity, and treatment-related characteristics, such as duration of admission and severity of the disease, are known to be negatively associated with psychological well-being of patients [2,8,1619].

The uncertainties and measures surrounding the pandemic raised concerns of increased psychological distress in non-hospitalized citizens [20]. Since measures taken in hospital were more drastic, concerns of the mental well-being of hospitalized patients were even higher [21,22]. Data from the previous SARS and MERS epidemics support this concern and early studies suggest that up to 50% of COVID-19 patients suffer from psychological distress up to two months after hospital discharge [2328]. More recently, Taquet et al. estimated that the risk for psychiatric sequelae is higher in COVID-19 patients and in those admitted to ICU using electronic health records data. Complementary observational studies are needed to add direction as to whether these risks may be attributed to COVID-19 or hospitalization during a pandemic, and corroborate on the different risks between specific subsets of patients, such as non-COVID-19 and ICU patients [29].

In this study, we first aimed to quantify psychological distress up to three months post-discharge in patients hospitalized during the first pandemic peak with symptoms suggestive of COVID-19. Additionally, we assessed their HRQoL, explored predictors for psychological distress and HRQoL, and examined whether psychological distress was more prevalent or more severe in COVID-19 confirmed patients, or in those treated in ICU.

Materials and methods

Ethics approval

The study protocol was approved by the Institutional Review board of the Franciscus Gasthuis & Vlietland and deemed not to fall under the Medical Research Involving Human Subjects Act (WMO) (S1. Registered study protocol). The need for written informed consent was waived. Patients in our hospital are actively informed about the use of their anonymous data in research activities and can object against the use their data. No data were used of patients who objected against this use. The study was registered at TrialRegister.nl (registration number: NL8882; S1 File. Study protocol). The reporting of this study follows the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guideline (S2 File. STROBE Checklist) [30].

Study design and setting

This single-center, observational cohort study was conducted in the Franciscus Gasthuis & Vlietland hospital in Rotterdam, the Netherlands, from March 16 to September 14, 2020. This period coincided with the first COVID-19 peak in the Netherlands. During this period, several protective measures were taken in the hospital, such as the prohibition of visiting hospitalized patients and strict isolation of suspected patients until COVID-19 was ruled out.

Participants

Eligible patients were aged ≥18 years and hospitalized between March 16 and April 28, 2020, with symptoms suggestive of COVID-19, defined as the presence of respiratory symptoms (dyspnea, coughing, sore throat, rhinorrhea, saturation <94% or respiratory rate >24/minute) and/or gastro-intestinal symptoms (diarrhea or vomiting) with a duration ≥24 hours, and who survived until one month after hospital discharge. Patients who were unable to understand the Dutch language or did neither have a formal home address nor e-mail address were excluded.

Procedures

Patients were approached one month post-discharge by sending an information letter and the first questionnaires. Patients were asked to either send back the questionnaires filled out to participate, or to return the questionnaire blank to decline participation. Patients who did not return the questionnaires were contacted twice by telephone as a reminder. A second set of questionnaires was sent three months post-discharge to participating patients, to patients who did not return the first set of questionnaires and could not be reached by telephone, and to patients who had consented to participate in the second questionnaire by phone. The last patient was discharged June 14, 2020, and follow-up lasted until three months after (September 14, 2020). Convenient sampling was used. All patients admitted between March 16 and April 28, 2020, and who responded to one of the two follow-up assessments were included.

We randomly approached non-responders (who did not respond at both time-points) four months after hospital discharge, i.e., one month after sending the last questionnaire, and asked them to fill out a single set of questionnaires to analyze non-responder’s bias.

Measures

All data were gathered using the International Severe Acute Respiratory and emergency Infection Consortium (ISARIC, Oxford, United Kingdom) and Franciscus Corona Registry in Castor Electronic Data Capture (Castor EDC, Amsterdam, the Netherlands). The ISARIC database in an international initiative to collect baseline demographics and treatment-related characteristics of all patients admitted to the hospital with respiratory symptoms during the SARS-CoV-2 pandemic. The Franciscus Corona Registry is a local addition to the ISARIC database, in which variables that were not collected in the ISARIC database, but were required for the current trial, were collected. All data was collected by members of the study team (JV and SW).

Baseline demographics and treatment-related characteristics

The following baseline demographics were retrieved from electronic healthcare records: age (years), ethnicity (Caucasian, black, Surinamese/Hindustan, Arab (not specified), Turkish, Moroccan, others, or unknown), sex at birth (male or female), body mass index (kg/m2), comorbidities (yes/no: hypertension, chronic cardiac disease, chronic pulmonary disease, asthma, tuberculosis, chronic kidney disease, mild liver disease, moderate liver disease, chronic neurological disease, dementia, chronic hematologic disease, diabetes type I or II, rheumatologic disorder, malignant neoplasm; total number of comorbidities), smoking status (yes, never smoked, former smoker, unknown). Patients were asked about their educational level (i.e., elementary school, high school, intermediate vocational education, higher professional education, university education) and employment characteristics (employed before hospitalization yes/no, weekly work hours before admission, weekly work hours after discharge, healthcare worker yes/no). Additionally, we asked patients about their mental history, i.e., whether they had encountered psychological impairments in the past 5 years and whether they were treated for these impairments by a psychologist, psychiatrist or had received medication. Patients were free to decide whether or not to answer the questions regarding their mental history.

The following treatment-related characteristics were retrieved from electronic healthcare records: cause of admission, treatment restrictions at the day of hospital admission, last registered treatment restriction before discharge, hospital length of stay, ICU admission (yes/no, length of stay), SOFA score at admission, P/F ratio at admission, S/F ratio at admission, oxygen therapy (yes/no, duration), non-invasive ventilation (yes/no, duration), invasive ventilation (yes/no, duration), prone positioning (yes/no, duration), tracheostomy (yes/no) and survival during follow-up.

Primary outcome: Psychological distress

The primary outcome was the prevalence and severity of probable PTSD, depression, and anxiety, assessed using validated Dutch translations of the Impact of Event Scale–Revised (IES-R) and the Hospital Anxiety and Depression Scale (HADS) at one and three months post-discharge.

The IES-R is a 22-item questionnaire that quantifies the subjective distress a person is experience after a traumatic event [31]. The IES-R yields a sum score, ranging from 0–88 (higher scores indicating more severe symptoms), and subscale scores can be calculated for symptoms of intrusion, avoidance, and hyperarousal. The IES-R sum score was considered as the severity of PTSD, and an IES-R sum score above 24 was defined as probable PTSD [32].

The HADS is commonly used to determine the levels of anxiety and depression that a person is experiencing [33]. The HADS is a 14-item scale that generates ordinal data. Seven of the items relate to anxiety and seven relate to depression. The HADS yields a depression and anxiety sum score, ranging from 0 to 21, with higher scores indicating more severe symptoms. The HADS anxiety and depression score will be considered as the severity of anxiety- and depression-related symptoms, respectively. A HADS depression or anxiety score above 8 was defined as probable depression or probable anxiety, respectively [33,34].

Secondary outcome: Health-related quality of life

The secondary outcome was HRQoL. HRQoL was assessed using validated Dutch translations of the EuroQoL 5-dimensions-5-levels (EQ-5D) and the RAND-36 questionnaires at one and three months post-discharge.

The EQ-5D measures the HRQoL in five dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression), by which the weight of a health state can be computed into an EQ-5D Time Trade Off (TTO) score. This score ranges from– 0.446 (worst quality of life) to 1.000 (best quality of life) and will be considered as the overall HRQoL. Additionally, patients score their current subjective perceived health state on a visual analogue scale (EQ-5D VAS), ranging from 0 (worst health imaginable) to 100 (best health imaginable) [35,36]. Based on the distribution of age in our cohort, the mean TTO score of the Dutch general population is 0.852 [36]. A TTO score below 0.852 is considered poor, and a TTO score above 0.852 good.

The RAND-36 is a 36-item, self-reported survey of HRQoL, and consists nine scales scores, which are the weighted sums of the questions in their section [37]. Each scale is directly transformed to a scale ranging from 0 (worse score) to 100 (best score) on the assumption that each question carries an equal weight. The nine scores are: physical functioning, social functioning, physical role limitations, emotional role limitations, mental health, vitality, pain, general health, and health change. Based on these scores, a mental and physical component score (MSC-36, PCS-36) can be computed for which the mean in the general population will be 50 with a standard deviation (SD) of 10. The MCS-36 score will be considered as the mental HRQoL and the PCS-36 will be considered as the physical HRQoL. A MCS-36 or PCS-36 score below 50 is considered low, and a MCS or PCS score above 50 is considered good [38].

Exploratory outcomes

We additionally explored predictors for the severity and prevalence of psychological distress and the HRQoL. These predictors were chosen based on previous literature, and included: age, gender, ethnicity, educational level, duration of admission, ICU admission, COVID-19 diagnosis and work before admission, and severity of disease in terms of SOFA score at the first day of COVID-19 suspicion (day of enrolment) [2,8,1619]. Literature supporting these predictors is depicted in S1 Table in the Supporting Information.

Statistical analysis

Continuous variables are presented as mean, including its standard deviation (SD), if normally distributed, and as median, including its 95% range, if not normally distributed. Categorical variables are presented as absolute and relative frequency. Continuous outcomes include the IES-R sum score, the HADS depression score, the HADS anxiety score, the EQ-5D TTO score, the EQ-5D VAS score, the RAND-36 subscales, the MCS-36, and the PCS-36. The IES-R sum score, HADS anxiety score, and HADS depression score were considered as the severity of PTSD-, depression-, and anxiety-related symptoms, respectively. Categorical outcomes include the prevalence of probable PTSD, probable anxiety, and probable depression. Prevalence of probable PTSD was defined as the proportion patients with an IES-R sum score ≥24 and the prevalence of probable anxiety and depression as the proportion of patients with a HADS anxiety or depression score ≥8, respectively [3234]. Psychological distress and HRQoL were assessed one month and three months after hospital discharge to 1) compare results with other research concerning psychological outcomes after hospitalization due to COVID-19 or similar coronaviruses; studies up till now mainly reported data of the first month after discharge [25] and 2) to evaluate the course of psychological symptoms and HRQoL in time after discharge. The internal reliability of all questionnaires used (IES-R, HADS, EQ-5D and RAND-36) were analyzed using Cronbach’s alpha and all showed a high internal reliability (S2 Table).

Patients were stratified based on SARS-CoV-2 PCR outcome, i.e., COVID-19 vs. non-COVID-19, and COVID-19 patients on the necessity for ICU admission, i.e., COVID-19 ICU patients vs. COVID-19 non-ICU patients. Differences between stratifications at baseline were analyzed using a Mann-Whitney U test for continuous variables and using a Fisher’s exact test for categorical variables. Differences in outcome measures between stratifications were analyzed using simple linear or logistic regression models, to adjust for at baseline differing characteristics, for continuous and categorical outcomes, respectively. We therefore first performed a simple univariate linear (for continuous outcomes) or logistic (for categorical outcomes) regression analyses, in which all at baseline differing characteristics were analyzed one-by-one. Variables that were associated with the outcome, i.e., a p-value ≤0.10, were added as independent variables to the simple multivariate regression models and were as such adjusted for.

To identify possible predictors for the severity and prevalence of psychological distress and the overall, mental, and physical HRQoL, we first conducted univariate mixed effects regression analysis: a linear model for continuous outcomes and a logistic model for categorical outcomes. We used mixed effects regression models to adjust for intergroup (i.e., time) and intragroup differences (i.e., cohort and variables of interest). In these, the possible predictive variable served as independent variable one-by-one and the outcome of interest at both follow-up time points served as dependent variables. Secondly, all variables which showed a p-value ≤0.10 in the univariate mixed effects regression model were added to the multivariate mixed effects regression model to determine which variables significantly predicted the outcome. We report the coefficient [95% CI], which implies the estimated mean difference, for linear models, and odds ratios (ORs), including its 95% CI, for logistic models.

Baseline characteristics of all non-responders were compared with those of responders using a Mann-Whitney U test for continuous variables and using a Fisher’s exact test for categorical variables. Psychological outcomes of randomly selected non-responders (who did not respond at both time-points) were compared with those of responders, and psychological outcomes of full responders were compared with those of partial responders (i.e., patients who only responded at one or three months), using simple linear or logistic regression models for continuous and categorical variables, respectively. In these, we adjusted for variables that were expected to confound the outcome and differed at baseline between stratifications as described above.

Missing values were not replaced. All analyses were performed using SPSS (Version 27.0) and R for Statistics (R Foundation for Statistical Computing, Vienna, Austria, 2015). A p-value <0.05 was considered statistically significant.

Results

From March 16 to April 28, 2020, 622 out of 796 patients were admitted with symptoms suggestive of COVID-19 and at least survived up to one month after hospital discharge, of whom 294 patients participated (47%); 252 at one month and 212 at three months post-discharge (Fig 1). The response rates per follow-up time point and per questionnaire are depicted in S3 Table. The last patient was discharged June 14, 2020, and follow-up lasted until three months after (September 14, 2020). Non-participating patients either declined participation (n = 261) or did not respond to the questionnaires or to the reminding phone calls (non-responders; n = 67). Responders were less frequently of female gender, had fewer comorbidities, were more frequently smoker, and were more frequently SARS-CoV-2 positive than non-responders (S4 Table). Full responders were more frequently Caucasian, and less frequently Turkish or Moroccan, had more frequently asthma, more frequently had completed university education, were more frequently diagnosed with COVID-19, and were more likely to decease than those who only responded at one month. Also, they were less frequently Turkish and were more likely to never have smoked than those who only responded at three months (S5 Table). No major differences in psychological outcomes and HRQoL were observed between full responders and partial responders, i.e., participants who only completed one follow-up assessment, besides full responders reporting less severe symptoms of anxiety and a higher overall HRQoL than those who only responded at 1 month (S6 Table). In addition, no differences were observed for the presence or severity of PTSD-, anxiety-, and depression-related symptomatology between responders and 12 randomly selected non-responders (S7 Table).

Fig 1. Flow chart of the recruitment, inclusion, and follow-up of study participants.

Fig 1

Participants

Table 1 depicts the most relevant baseline demographics and treatment-related characteristics; a full overview of all collected demographics and characteristics can be found in S8 Table. The median age was 64 years (95% range 33–88), 106 (36%) were female, and a history of mental illness was reported by 27 of 201 patients (13%), who were willing to share this information. The median hospital length of stay (LOS) was 4 days (1–52) and 42 patients (14%) required ICU admission (median ICU LOS; 16 days [95% range 0–52]). Overall, 146 patients (50%) were SARS-CoV-2 positive. Non-COVID-19 patients were predominantly diagnosed with other pulmonary or cardiac illnesses (S8 Table). COVID-19 patients were younger, had fewer comorbidities, more frequently worked prior to hospitalization, had a longer hospital and ICU-LOS, were more frequently admitted to the ICU, had a higher SOFA score and lower P/F ratio at admission, more frequently received oxygen therapy and invasive ventilation for a longer duration, were more frequently mechanically ventilated in prone position, and more frequently received a tracheotomy than non-COVID-19 patients (Table 1). Within COVID-19 patients, those who were admitted to the ICU had a longer hospital LOS, a higher SOFA score and lower P/F ratio at admission, received oxygen therapy more frequently, and more frequently received a tracheostomy (Table 1).

Table 1. Baseline demographics and treatment-related characteristics of study participants.

Overall cohort COVID-19 cohort
Overall COVID-19 non-COVID-19 p-value ICU non-ICU p-value
Sample size 294 146 148 40 106
Age, years 64 (33–88) 61 (35–85) 69 (31–89) <0.001 62 (36–74) 60 (33–86) 0.37
Ethnicity
    Caucasian 207 (70%) 92 (63%) 115 (78%) <0.01 22 (55%) 70 (66%) 0.25
    Black 10 (3%) 8 (5%) 2 (1%) 0.06 3 (8%) 5 (5%) 0.68
    Surinamese /Hindustan 22 (7%) 15 (10%) 7 (5%) 0.08 7 (18%) 8 (8%) 0.12
    Arab, not specified 13 (4%) 6 (4%) 7 (5%) 1.00 1 (3%) 5 (5%) 1.00
    Turkish 8 (3%) 5 (3%) 3 (2%) 0.50 0 (0%) 5 (5%) 0.32
    Moroccan 10 (3%) 8 (5%) 2 (1%) 0.06 4 (10%) 4 (4%) 0.22
    Others 8 (3%) 5 (3%) 3 (2%) 0.50 1 (3%) 4 (4%) 1.00
    Unknown 16 (5%) 7 (5) 9 (6%) 0.80 2 (5%) 5 (5%) 1.00
Sex at birth, Female 106 (36%) 52 (36%) 54 (36%) 0.90 13 (33%) 39 (37%) 0.70
Body Mass Index (BMI) * 27.4 (19.3–43.2) 28.0 (20.4–41.8) 26.5 (18.9–43.1) 0.30 28.5 (22.7–41.9) 27.9 (19.7–39.5) 0.35
Total number of comorbidities 1 (0–4) 1 (0–3) 2 (0–4) <0.001 1 (0–3) 1 (0–3) 0.16
Psychiatric problems in past 5 years ** 27 (13%) 12 (11%) 15 (16%) 0.41 3 (12%) 9 (11%) 1.00
Educational level ***
    Elementary school 46 (18%) 21 (17%) 25 (19%) 0.75 4 (14%) 17 (18%) 0.78
    High school 49 (20%) 17 (14%) 43 (25%) 0.04 6 (21%) 11 (12%) 0.24
    Intermediate vocational education 89 (40%) 44 (36%) 45 (35%) 0.89 10 (34%) 54 (37%) 1.00
    Bachelor’s degree 40 (16%) 20 (17%) 20 (16%) 0.86 4 (14%) 16 (17%) 0.78
    Master’s degree 26 (10%) 19 (16%) 7 (5%) 0.01 5 (17%) 14 (15%) 0.78
Working/employed before admission 92 (37%) 59 (49%) 33 (26%) <0.001 12 (41%) 47 (51%) 0.40
Healthcare worker 18 (8%) 13 (11%) 5 (4%) 0.08 3 (10%) 10 (11%) 1.00
Cause of admission
    COVID-19 146 (50%) 146 (100%) 0 (0%) N/A 40 (100%) 106 (100%) N/A
    Other 148 (50%) (0%) 148 (50%) N/A (0%) (0%) N/A
Hospital length of stay, days 4 (1–52) 5 (1–60) 4 (1–23) <0.001 28 (9–69) 4 (1–18) <0.001
Admitted to the ICU 42 (14%) 40 (27%) 2 (1%) <0.001 40 (100%) 0 (0%) N/A
ICU length of stay, days 16 (0–52) 16 (0–52) 1 (1–2) 0.01 16 (0–52) N/A N/A
SOFA score **** 2 (0–6) 2 (0–6) 2 (0–6) 0.04 3 (1–8) 2 (0–5) <0.001
Received oxygen therapy 222 (76%) 135 (92%) 87 (59%) <0.001 40 (100%) 95 (90%) 0.04
Received non-invasive ventilation (NIV) 13 (4%) 9 (6%) 4 (3%) 0.17 5 (13%) 4 (4%) 0.06
Received invasive ventilation 42 (14%) 40 (27%) 2 (1%) <0.001 40 (100%) 0 (0%) N/A
Ventilated in prone position 16 (5%) 16 (11%) 0 (0%) <0.001 16 (40%) N/A N/A
Received a tracheostomy 14 (5%) 14 (10%) 0 (0%) <0.001 14 (35%) 0 (0%) <0.001
Died during follow-up 4 (1%) 0 (0%) 4 (3%) 0.12 0 (0%) 0 (0%) 1.00

Data are shown as n (%) and median (95% range). Patients were stratified based on SARS-CoV2 PCR; COVID-19 and a non-COVID-19. COVID-19 patients were stratified based on necessity for intensive care treatment; COVID-19 ICU and COVID-19 non-ICU. Abbreviations: ICU, Intensive care unit; SOFA, Sequential Organ Failure Assessment; P/F ratio, ratio between arterial partial pressure (PaO2) to fractional inspired oxygen (FiO2); S/F ratio, ratio between peripheral oxygen saturation (SaO2) and FiO2. P-values were calculated using a Mann Whitney-U Test for continuous variables and using a Fisher’s Exact test for categorical variables.

* BMI of 116 patients was not available.

** Results regarding psychological history are derived from the questionnaire 3 months after discharge. The proportions shown are calculated over a population of 212 patients.

*** Results regarding educational level are derived from the questionnaires 1 month after discharge. The proportions shown are calculated over a population of 252 patients.

**** Scored the day of first SARS-CoV-2 suspicion. Non-invasive ventilation was defined as use of CPAP or BIPAP; Use of high flow nasal cannula was not included.

Post-traumatic stress, anxiety and depression

Table 2 depicts the descriptive statistics of psychological outcomes, and the comparisons between COVID-19 and non-COVID-19 patients, and between COVID-19 ICU and non-ICU admitted patients.

Table 2. Psychological outcomes throughout follow-up.

Overall cohort COVID-19 cohort
Overall COVID-19 non-COVID-19 β / OR (95% CI) p-value ICU non-ICU β / OR (95% CI) p-value
1 month n = 252 123 129 N/A N/A 30 93 N/A N/A
3 months n = 212 116 96 N/A N/A 33 83 N/A N/A
PTSD
Severity, median (95% range)
1 month 9 (0–48) 9 (0–47) 8 (0–48) -0.8 (-4.2–2.7) 0.671 7 (1–51) 10 (0–46) 0.9 (-5.0–6.7) 0.7710
3 months 7 (0–44) 7 (0–44) 6 (0–38) -1.0 (-4.1–2.2) 0.552 8 (0–30) 7 (0–45) 0.9 (-4.2–6.0) 0.7310
    β, time (95% CI) -2.8 (-3.1- -0.4) -0.9 (-2.8–0.9) -2.8 (-4.8- -0.8) N/A N/A -2.3 (-4.6–0.1) -0.6 (-2.9–1.8) N/A N/A
    p-value (Time) 0.01 0.32 <0.001 N/A N/A 0.08 0.64 N/A N/A
Prevalence, n (%)
1 month 39 (16%) 20 (17%) 19 (16%) 1.0 (0.5–2.2) 0.952 5 (17%) 15 (17%) 1.1 (0.3–3.2) 0.9210
3 months 28 (13%) 17 (15%) 11 (12%) 0.8 (0.3–2.5) 0.713 6 (18%) 11 (13%) 0.7 (0.2–2.0) 0.5010
    OR, time (95% CI) 0.1 (0.0–1.1) 0.3 (0.0–3.0) 0.0 (0.0–4.4) N/A N/A 0.0 (0.0–0.2) 0.4 (0.0–5.0) N/A N/A
p-value (Time) 0.06 0.29 0.15 N/A N/A 0.02 0.47 N/A N/A
Anxiety
Severity, median (95% range)
1 month 4 (0–17) 4 (0–15) 5 (0–17) 1.0 (-0.1–2.2) 0.084 3 (0–15) 4 (0–15) 0.8 (-1.3–3.0) 0.4511
3 months 4 (0–15) 3 (0–15) 4 (0–14) 0.2 (-1.1–1.5) 0.733 3 (0–15) 4 (0–15) 0.4 (-1.3–2.2) 0.6410
    β, time (95% CI) -0.6 (-1.1- -0.1) -0.4 (-1.1–0.2) -0.8 (-1.5- -0.1) N/A N/A -0.4 (-1.8–1.0) -0.4 (-1.1–0.3) N/A N/A
    p-value (Time) 0.01 0.19 0.02 N/A N/A 0.61 0.22 N/A N/A
Prevalence, n (%)
1 month 72 (29%) 30 (25%) 42 (33%) 1.3 (0.6–2.4) 0.505 5 (17%) 25 (27%) 2.4 (0.7–8.0) 0.1511
3 months 42 (20%) 20 (17%) 22 (24%) 1.4 (0.6–3.4) 0.423 5 (15%) 15 (18%) 0.8 (0.3–2.4) 0.6910
    OR,time (95% CI) 0.2 (0.1–0.7) 0.2 (0.0–1.1) 0.2 (0.0–1.3) N/A N/A 0.2 (0.0–10.7) 0.6 (0.3–1.2) N/A N/A
    p-value (Time) 0.01 0.06 0.09 N/A N/A 0.46 0.16 N/A N/A
Depression
Severity, median (95% range)
1 month 5 (0–16) 3 (0–16) 6 (0–17) 0.9 (-0.4–2.1) 0.176 4 (0–14) 3 (0–16) 0.8 (-1.2–2.8) 0.4410
3 months 4 (0–16) 3 (0–13) 4 (0–17) -0.4 (-1.8–1.0) 0.547 3 (0–12) 3 (0–13) 1.1 (-0.5–2.8) 0.1910
    β, time (95% CI) -0.6 (-1.1- -0.1) -0.3 (-0.9–0.3) -0.9 (-1.7- -0.2) N/A N/A -0.4 (-1.1–0.3) -0.2 (-1.0–0.6) N/A N/A
    p-value (Time) 0.02 0.35 0.02 N/A N/A 0.27 0.57 N/A N/A
Prevalence, n (%)
1 month 79 (32%) 32 (26%) 47 (37%) 1.2 (0.7–2.2) 0.558 3 (10%) 29 (32%) 4.2 (1.2–15.0) 0.0310
3 months 50 (24%) 25 (22%) 25 (27%) 0.6 (0.2–1.3) 0.189 2 (6%) 23 (28%) 6.0 (1.3–27.3) 0.0210
    OR,time (95% CI) 0.6 (0.3–1.0) 0.4 (0.1–1.8) 0.5 (0.2–1.1) N/A N/A 0.6 (0.1–3.7) 0.8 (0.4–1.6) N/A N/A
    p-value (Time) 0.06 0.23 0.10 N/A N/A 0.57 0.58 N/A N/A

Descriptive statistics of the psychological distress outcomes, stratified by COVID-19 diagnosis and ICU admission. Severity of PTSD, anxiety, and depression were expressed as the IES-R, HADS anxiety, and HADS depression sum scores, respectively. Prevalence of probable PTSD, anxiety, and depression was defined as the proportion of patients scoring above the cut-off. Abbreviations: CI, confidence interval; COVID-19, coronavirus disease 2019; ICU, intensive care unit; OR, odds ratio; PTSD, post-traumatic stress disorder. Differences over time were calculated using mixed effects linear (for continuous outcomes) and logistic (for categorical outcomes) regression models, with time as independent variable. Differences between stratifications were analyzed using simple linear (for continuous outcomes) and logistic (for categorical outcomes) regression models.

1 Adjusted for ethnicity and educational level

2 adjusted for ethnicity

3 Adjusted for ethnicity and employment status before hospitalization

4 adjusted for ethnicity, educational level, and SOFA score during admission

5 adjusted for ethnicity, educational level, ICU admission, and SOFA score during admission

6 adjusted for ethnicity, educational level, and ICU admission

7 adjusted for age, ethnicity, educational level, and employment status before hospitalization

8 adjusted for ethnicity, ICU admission, and employment status before hospitalization

9 adjusted for age, educational level, ICU admission, and employment status before hospitalization

10 not adjusted

11 adjusted for SOFA score during admission.

One month after hospital discharge, the median PTSD score was 9 (IES-R sum score, 95% range 0–48) and 16% of patients (39/237) reported probable PTSD. At three months, the PTSD score was decreased to 7 (0–44, p = 0.01), but the proportion of patients with probable PTSD was similar (28/209 [13%], p = 0.06). At both follow-up time-points, there were no differences in the severity of PTSD symptoms or the proportion of patients with probable PTSD between the COVID-19 and non-COVID-19 patients, nor between ICU and non-ICU patients.

One month after hospital discharge, 29% of patients (72/248) reported probable anxiety and the median anxiety score was 4 (HADS anxiety score, 95% range 0–17), which improved at three months after discharge to 20% of patients (42/208, p = 0.01) reporting probable anxiety and a median anxiety score of 4 (0–15, p = 0.01). At neither one of the follow-up time-points, differences were found in the severity of anxiety-related symptoms or the proportion of patients with probable anxiety between COVID-19 and non-COVID-19 patients or between COVID-19 ICU and non-ICU patients.

The median depression score was 5 (95% range 0–16) and 32% of patients (79/248) reported probable depression at one month post-discharge. While the severity of depression-related symptoms improved at three months to a median of 4 (95% range 0–16, p = 0.02), there was no difference between the proportion of patients reporting probable depression. No differences were found in the severity of depression between COVID-19 and non-COVID-19 patients, nor between COVID-19 ICU and non-ICU patients. Although no differences were observed in the proportion of patients reporting probable depression between COVID-19 and non-COVID-19 patients, within the COVID-19 cohort, ICU patients less frequently reported probable depression (1 month, OR 4.2 [95% CI 1.2–15.0], p = 0.03; 3 months, OR 6.0 [95% CI 1.3–27.3], p = 0.02; Table 2).

Health-related quality of life

Table 3 depicts the descriptive statistics of HRQoL outcomes, and the comparisons between COVID-19 and non-COVID-19 patients and between COVID-19 ICU and non-ICU patients.

Table 3. Health-related quality of life throughout follow-up.

Overall cohort COVID-19 cohort
Overall COVID-19 non-COVID-19 β/OR (95% CI) p-value ICU non-ICU β/OR (95% CI) p-value
1 month n = 252 123 129 N/A N/A 30 93 N/A N/A
3 months n = 212 116 96 N/A N/A 33 83 N/A N/A
Overall HRQoL, median (95% range)
1 month 0.7 (-0.1–1.0) 0.8 (0.0–1.0) 0.7 (-0.2–1.0) -0.1 (-0.1–0.01) 0.101 0.7 (0.0–1.0) 0.8 (0.0–1.0) 0.03 (-0.1–0.2) 0.522
3 months 0.8 (0.1–1.0) 0.8 (0.1–1.0) 0.7 (0.0–1.0) 0.0 (-0.1–0.04) 0.371 0.8 (0.1–1.0) 0.8 (0.1–1.0) 0.04 (-0.1–0.1) 0.322
    β, time (95% CI) 0.0 (0.0–0.1) 0.0 (0.0–0.1) 0.0 (0.0–0.1) N/A N/A 0.0 (-0.1–0.1) 0.05 (0.0–0.1) N/A N/A
    p-value (Time) 0.01 0.07 0.11 N/A N/A 0.98 0.04 N/A N/A
Perceived Health State, median (95% range)
1 month 65 (10–95) 70 (25–95) 60 (10–90) -5.1 (-10.8–0.6) 0.083 68 (9–95) 70 (30–99) 6.1 (-2.0–14.1) 0.142
3 months 73 (9–95) 75 (18–95) 70 (8–95) -2.8 (-3.9–9.5) 0.414 70 (8–96)) 75 (20–95) 4.4 (-4.1–12.9) 0.312
    β, time (95% CI) 4.2 (1.1–7.4) 3.4 (-0.2–7.1) 5.0 (-0.4–10.4) N/A N/A 4.1 (-4.1–12.3) 3.2 (-0.8–7.3) N/A N/A
    p-value (Time) 0.01 0.07 0.07 N/A N/A 0.33 0.13 N/A N/A
Mental HRQoL, median (95% range)
1 month 39 (15–63) 40 (14–62) 39 (16–63) 2.7 (-0.8–6.1) 0.135 46 (17–62) 39 (13–60) -5.1 (-10.8–0.5) 0.082
3 months 48 (19–64) 49 (21–64) 47 (19–64) 2.6 (-1.6–6.7) 0.236 53 (29–64) 48 (19–62) -7.6 (-14 - -1.8) 0.017
    β, time (95% CI) 6.0 (4.3–7.7) 7.2 (4.8–9.7) 4.6 (2.2–7.0) N/A N/A 7.5 (3.5–11.5) 7.1 (4.1–10.1) N/A N/A
    p-value (Time) <0.001 <0.001 <0.001 N/A N/A 0.001 <0.001 N/A N/A
Physical HRQoL, median (95% range)
1 month 37 (18–56) 39 (22–56) 35 (15–56) -3.3 (-6.1- -0.5) 0.028 38 (23–57) 39 (22–56) -4.1 (-10.3–2.0) 0.1810
3 months 39 (17–59) 41 (22–58) 37 (16–59) -2.2 (-6.0–1.6) 0.269 40 (19–58) 42 (22–59) 1.2 (-3.5–5.9) 0.632
    OR,time (95% CI) 1.7 (0.5–3.0) 2.4 (0.6–4.1) 0.8 (-0.8–2.4) N/A N/A 3.0 (-0.7–6.7) 2.2 (0.2–4.2) N/A N/A
    p-value (Time) <0.01 0.01 0.35 N/A N/A 0.12 0.03 N/A N/A

Descriptive statistics of the HRQoL outcomes, stratified by COVID-19 diagnosis and ICU admission. Differences over time were calculated using mixed effects linear (for continuous outcomes) and logistic (for categorical outcomes) regression models, with time as independent variable. Abbreviations: CI, confidence interval; COVID-19, coronavirus disease 2019; EQ-5D, European quality of life 5 dimensions questionnaire; HRQoL, health-related quality of life; ICU, intensive care unit; MCS-36, mental component score of the RAND-36; OR, odds ratio; PCS-36, physical component score of the RAND-36; TTO, time trade-off; VAS, visual analogue scale. Differences between stratifications were analyzed using simple linear (for continuous outcomes) and logistic (for categorical outcomes) regression models.

1 Adjusted for age, ethnicity, educational level, and employment status before hospitalization

2 not adjusted

3 adjusted for age, ethnicity and employment status before hospitalization

4 adjusted for ethnicity and employment status before hospitalization

5 adjusted for ethnicity and educational level

6 adjusted for ethnicity, ICU admission, employment status before hospitalization and SOFA score during admission

7 adjusted SOFA score during admission

8 adjusted for age, ethnicity, hospital length of stay, and employment status before hospitalization

9 adjusted for age, educational level, and employment status before hospitalization

10 not hospital length of stay.

The median overall HRQoL score was 0.74 (EQ5D TTO score, 95% range -0.08–1.00) and the self-reported health was 65 (EQ5D VAS score, 10–95) at one month post-discharge. Both improved three months after discharge (EQ5D TTO: estimated mean difference over time = 0.04 [95% CI 0.01–0.07], p = 0.01; EQ5D VAS: estimated mean difference over time = 4.19 [95% CI 1.03–7.35], p = 0.01). There were no differences in HRQoL or the self-reported health between COVID-19 and non-COVID-19 patients or between COVID-19 ICU and non-ICU patients.

The median mental quality of life was 39 (median MSC-36, 96% range 15–63) at one month after hospital discharge and improved to 48 (19–64, p<0.001) at three months post-discharge. The median physical quality of life was 37 (median PCS-36, 18–56) and improved to 39 (17–59, p<0.01). COVID-19 patients reported a better physical quality of life at 1 month (estimated mean difference -3.3 [95% CI -6.1 - -0.5, p = 0.02; Table 3), but not at three months, and no differences in mental quality of life were observed. COVID-19 ICU patients had a better mental quality of life at 3 months (estimated mean difference -7.6 [95% CI -13.5 - -1.8], p = 0.01; Table 3), but not at 1 month, and no differences were observed in the physical quality of life within the COVID-19 cohort between ICU and non-ICU patients.

Predictors of psychological distress and quality of life

Tables 4 and S9 depict the results of the exploration of predictors for the severity and prevalence of probable PTSD, anxiety, and depression. Time after discharge (p = 0.01), not being Caucasian (p<0.01) and having completed higher professional education were associated with the severity of PTSD in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these, time after discharge (estimated mean difference (β) = 1.8 [95% CI -3.2 - -0.4], p = 0.01) negatively and not being Caucasian (β = 5.2 [95% CI 1.8–8.6], p = 0.003; Table 4), positively predicted the severity of PTSD. None of the predictors were significantly associated with the prevalence of probable PTSD (S9 Table).

Table 4. Predictors for the severity of PTSD, anxiety, and depression.

Severity of PTSD Severity of anxiety Severity of depression
Univariate Multivariate Univariate Multivariate Univariate Multivariate
Beta (95% CI) P Beta P Beta P Beta P Beta P Beta P
Time (3 months) -1.8 (-3.1 - -0.4) 0.01 -1.8 (-3.2 - -0.4) 0.01 -0.6 (-1.1 - -0.2) 0.01 -0.6 (-1.1 - -0.1) 0.02 -0.6 (-1.1 - -0.1) 0.01 -0.6 (-1.1 - -0.1) 0.03
Age, years -0.1 (-0.2–0.04) 0.29 0.0 (-0.1–0.01) 0.10 0.0 (-0.01–0.1) 0.90
Gender, (female) 2.3 (-0.8–5.3) 0.14 1.4 (0.3–2.5) 0.01 1.1 (-0.1–2.2) 0.06 1.3 (0.2–2.3) 0.02 0.7 (-0.4–1.9) 0.21
Ethnicity (Non-Caucasian) 6.2 (3.1–9.3) <0.01 5.2 (1.8–8.6) <0.01 1.8 (0.6–2.9) <0.01 1.9 (0.6–3.1) <0.01 1.1 (0.0–2.3) 0.06 1.1 (-0.1–2.3) 0.08
Educational level
(High school) 2.8 (-2.3–7.9) 0.28 3.5 (-1.4–8.5) 0.16 0.4 (-1.4–2.2) 0.67 0.3 (-1.5–2.1) 0.74 0.2 (-1.5–2.0) 0.80 0.2 (-1.5–2.0) 0.81
(Vocational) 1.0 (-3.4–5.5) 0.65 2.3 (-2.1–6.7) 0.30 0.1 (-1.5–1.7) 0.86 0.8 (-0.8–2.4) 0.34 -0.4 (-1.9–1.2) 0.66 0.2 (-1.4–1.9) 0.76
(Higher professional) -4.7 (-9.9–0.5) 0.08 -3.3 (-8.5–1.9) 0.22 -2.7 (-4.6 - -0.7) 0.01 -1.8 (-3.8–0.1) 0.06 -2.6 (-4.5 - -0.8) <0.01 -1.9 (-3.8–0.0) 0.05
(University) -4.4 (-10.3–1.4) 0.14 -3.0 (-8.7–2.8) 0.31 -1.7 (-3.8–0.5) 0.13 -0.8 (-2.9–1.4) 0.49 -2.7 (-4.1 - -0.7) 0.01 -1.8 (-3.9–0.3) 0.09
Employed (Yes) -2.2 (-5.4–1.0) 0.18 -1.1 (-2.2–0.1) 0.08 -0.7 (-1.9–0.5) 0.28 -1.4 (-2.5 - -0.3) 0.02 -0.9 (-2.1–0.3) 0.14
Healthcare worker (Yes) 4.9 (-1.2–10.9) 0.12 -0.2 (-2.4–2.0) 0.88 0.3 (-1.9–2.5) 0.81
Hospital LOS, days 0.1 (-0.04–0.2) 0.22 -0.01 (-0.1–0.0) 0.48 0.0 (-0.1–0.03) 0.63
Mechanical ventilation (Yes) 1.4 (-3.0–5.7) 0.54 -0.4 (-2.0–1.2) 0.61 -1.0 (-2.6–0.6) 0.21
SOFA admission score 0.0 (-0.1–0.1) 0.99 -0.2 (-0.5–0.1) 0.25 -0.1 (-0.5–0.2) 0.37
COVID-19 (Yes) 0.9 (-2.0–3.8) 0.52 -1.0 (-2.1–0.0) 0.06 -0.9 (-2.0–0.2) 0.12 -1.2 (-2.2 - -0.1) 0.03 -0.4 (-1.6–0.8) 0.48
ICU admission (Yes) 0.7 (-3.4–4.8) 0.74 -0.7 (-2.2–0.7) 0.33 -1.4 (-2.9–0.1) 0.07 -1.6 (-3.3–0.1) 0.07

Univariate analysis was performed using mixed effects linear regression models, with the variable of interest as independent variable, and a random intercept for each participant. Each variable with a p-value <0.10 in the univariate mixed model was implemented as independent variable in the multivariate mixed model. Variables with a p-value <0.05 in the multivariate mixed model were identified as independent predictors.

Time after discharge (p = 0.01), female gender (p = 0.01), having completed higher professional education (p = 0.01), employment status before hospitalization (p = 0.08), and COVID-19 diagnosis (p = 0.06) were associated with the severity of anxiety in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these, time after discharge (β = -0.6 [95% CI -1.1 - -0.1], p = 0.02) negatively and not being Caucasian (1.9 [95% CI 0.6–3.1], p = 0.01) positively predicted the severity of anxiety (Table 4). None of the predictors were significantly associated with the prevalence of probable anxiety (S9 Table).

Time after discharge (p = 0.01), female gender (p = 0.02), not being Caucasian (p = 0.06), having completed higher professional (p<0.01) or university education (p = 0.01), employment status before hospitalization (p = 0.02), COVID-19 diagnosis (p = 0.03) and ICU admission (p = 0.07) were associated with the severity of depression in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these, time after discharge positively (β = -0.6 [95% CI -1.1 - -0.1], p = 0.03) and completed higher professional education (β = -1.9 [-3.8–0.0], p = 0.049) negatively predicted the severity of depression (Table 4). None of the predictors were significantly associated with the prevalence of probable depression (S9 Table).

Table 5 depict the results of the exploration of predictors for the overall, mental, and physical HRQoL. Time after discharge (p = 0.01), age (p<0.01), female gender (p<0.01), having completed higher professional (p<0.01) or university education (p<0.01) and COVID-19 diagnosis (p<0.01) were associated with overall HRQoL in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these, having completed university education (β = 0.11 [95% CI 0.002–0.21], p = 0.046) and being employed (β = 0.12 [95% CI 0.06–0.19], p<0.01) positively, and having more severe symptoms of anxiety (β = -0.03 [95% CI -0.04 - -0.02], p<0.001) or depression at 1 month (β = -0.01 [95% CI -0.02 - -0.001], p = 0.04; Table 5) negatively predicted the overall HRQoL. The exploration of predictors of the perceived health state is depicted in S9 Table.

Table 5. Predictors for the overall HRQol, the mental quality of life, and the physical quality of life.

Overall HRQoL Mental HRQoL Physical HRQoL
Univariate Multivariate Univariate Multivariate Univariate Multivariate
Beta (95% CI) P Beta P Beta P Beta P Beta P Beta P
Time (3 months) 0.03 (0.01–0.07) 0.01 0.03 (-0.003–0.06 0.08 6.1 (4.3–7.8) <0.01 5.6 (3.9–7.4) <0.01 1.8 (0.6–3.0) <0.01 1.6 (0.3–2.8) 0.02
Age, years -0.00 (-0.01–0.00) <0.01 -0.001 (-0.003–0.002) 0.58 0.1 (-0.1–0.2) 0.31 -0.2 (-0.3 - -0.1) <0.01 -0.1 (-0.2–0.02) 0.11
Gender (female) -0.11 (-0.18 - - 0.04) <0.01 -0.03 (-0.08–0.03) 0.35 -4.1 (-7.1 - -1.1) <0.01 -1.9 (-4.3–0.5) 0.13 -4.5 (-7.1 - -1.9) <0.01 -4.1 (-6.6 - -1.6) <0.01
Ethnicity (Non-Caucasian) -0.01 (-0.06–0.08) 0.70 -3.2 (-6.4–0.0) 0.05 0.03 (-2.6–2.7) 0.98 2.0 (-0.7–4.8) 0.15
Educational level
(High school) 0.00 (-0.11–0.12) 0.94 0.03 (-0.05–0.12) 0.49 -0.1 (-5.2–5.0) 0.96 1.2 (-2.6–5.1) 0.53 -2.9 (-7.1–1.4) 0.20
(Vocational) 0.07 (-0.03–0.17) 0.16 0.01 (-0.07–0.09) 0.81 -1.1 (-5.5–3.4) 0.65 -1.5 (-4.9–2.0) 0.40 -1.0 (-4.7–2.8) 0.60
(Higher professional) 0.20 (0.08–0.32) <0.01 0.05 (-0.05–0.15) 0.33 4.1 (-1.2–9.4) 0.13 -0.4 (-4.4–3.6) 0.84 3.0 (-1.4–7.4) 0.19
(University) 0.23 (0.14–0.41) <0.01 0.11 (0.002–0.21) 0.05 6.5 (0.6–12.3) 0.03 2.1 (-2.2–6.4) 0.34 3.8 (-1.1–8.8) 0.13
Employed (Yes) 0.17 (0.10–0.25) <0.01 0.12 (0.06–0.19) <0.01 1.5 (-1.7–4.7) 0.35 4.6 (2.0–7.2) <0.01 1.9 (-0.9–4.7) 0.19
Healthcare worker (Yes) 0.11 (-0.03–0.25) 0.15 -3.5 (-9.8–2.8) 0.28 -1.6 (-7.0–3.8) 0.56
Hospital LOS, days 0.00 (0.00–0.00) 0.59 0.1 (-0.1–0.2) 0.33 -0.1 (-0.2–0.01) 0.07 -0.2 (-0.3 - -0.1) <0.01
Mechanical ventilation (Yes) 0.02 (-0.08–0.13) 0.67 5.0 (0.6–9.4) 0.03 -0.04 (-7.9–7.9) 0.99 -0.3 (-4.1–3.6) 0.90
SOFA admission score 0.00 (-0.02–0.02) 0.72 0.5 (-0.4–1.3) 0.31 -0.3 (-1.0–0.5) 0.44
COVID-19 (Yes) 0.11 (0.04–0.18) <0.01 0.03 (-0.03–0.08) 0.38 0.3 (-2.6–3.2) 0.84 3.7 (1.2–6.2) <0.01 2.9 (0.3–5.5) 0.03
ICU admission (Yes) 0.04 (-0.05–0.14) 0.43 5.3 (1.2–9.4) 0.01 0.9 (-6.5–8.3) 0.81 0.7 (-2.9–4.2) 0.71
PTSD severity at 1 month -0.097 (-0.010 - -0.005) <0.01 0.002 (-0.001–0.004) 0.22 -0.5 (-0.6 - -0.4) <0.01 -0.1 (-0.2–0.04) 0.20 -0.2 (-0.3 - -0.1) <0.01 0.0 (-0.1–0.1 0.93
Anxiety severity at 1 month -0.04 (-0.04 - -0.03) <0.01 -0.03 (-0.04 - -0.02) <0.01 -1.8 (-2.1 - -1.6) <0.01 -0.8 (-1.2 - -0.3) <0.01 -0.8 (-1.0 - -0.5) <0.01 -0.2 (-0.7–0.2) 0.37
Depression severity at 1 month -0.04 (-0.04 - -0.03) <0.01 -0.01 (-0.02 - -0.001) 0.04 -1.8 (-2.1 - -1.6) <0.01 -1.0 (-1.4 - -0.6) <0.01 -0.9 (-1.2 - -0.6) <0.01 -0.6 (-1.0 - -0.2) <0.01

Univariate analysis was performed using mixed effects linear regression models, with the variable of interest as independent variable, and a random intercept for each participant. Each variable with a p-value <0.10 in the univariate mixed model was implemented as independent variable in the multivariate mixed model. Variables with a p-value <0.05 in the multivariate mixed model were identified as independent predictors.

Time after discharge (p<0.01), female gender (p<0.01), being not Caucasian (p = 0.05), having completed university education (p = 0.03), being mechanically ventilated (p = 0.03), ICU admission (p = 0.01) and having more severe symptoms of PTSD (p<0.01), anxiety (p<0.01) and depression (p<0.01) were associated with mental HRQoL in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these, time after discharge (β = 5.6 [95% CI 3.9–7.4], p<0.01) positively, and having more severe symptoms of anxiety (β = -0.8 [95% CI -1.2 - -0.3], p<0.01) or depression (β = -1.0 [95% CI -1.4 - -0.6], p<0.01) at 1 month negatively predicted the mental HRQoL.

Lastly, time after discharge (p<0.01), age (p<0.01), female gender (p<0.01), employment status before hospitalization (p<0.01), hospital LOS (p = 0.07), COVID-19 diagnosis (p<0.01) and having more severe symptoms of PTSD (p<0.01), anxiety (p<0.01) and depression (p<0.01) were associated with physical HRQoL in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these, time after discharge (β = 1.6 [95% CI 0.3–2.8], p = 0.02) and COVID-19 diagnosis (β = 2.9 [95% CI 0.3–5.5], p = 0.03] positively, and female gender (β = -4.1 [95% CI -6.6 - -1.6], p<0.01), hospital LOS (β = -0.2 [95% CI -0.3 - -0.1], p<0.01) and having more severe symptoms of depression (β = -0.6 [95% CI -1.0 - -0.2], p<0.01) at 1 month negatively predicted the physical HRQoL.

Discussion

In this observational study, assessing psychological distress and HRQoL in patients hospitalized during the COVID-19 pandemic, we observed that a substantial proportion of patients reported psychological distress, but no differences were observed in its severity and prevalence between patients with or without COVID-19. COVID-19 ICU patients suffered less from depression than their non-ICU counterparts. Post-discharge HRQoL was poor in all patients but improved during follow-up.

The proportion of patients with psychological distress as found in our study at one month post-discharge is comparable with proportions observed in recent studies, but data on psychological recovery beyond two months remains scarce [23,24,39]. Early psychological evaluation is disputable as for example PTSD can only be diagnosed as PTSD at one month after the traumatic event, and some level of depression and/or anxiety is not considered pathological in the first weeks post-discharge and may subside with time [40]. To distinguish between psychological impairments and a normal distress response to hospitalization, follow-up beyond one month is mandatory. Although the number of patients with psychological symptoms in our study decreased over time, we observed that psychological distress at three months remains substantial, more reliable illustrating the true post-discharge burden of hospitalization during the pandemic. Furthermore, extended follow-up up beyond 3 months will enable further confirmation of this burden and its trajectory over time.

The observed prevalence of psychological distress in our cohort appears to be higher than in the general population during non-pandemic circumstances, and was similar to people suffering from PTSD-related symptoms after a traumatic event, such as theft, burglary, accidents and death of a significant other [41]. The underlying cause of psychological distress in our population is most likely multifactorial and may include policies surrounding the pandemic containment, experiencing traumatic events, such as hospitalization and isolation, and the primary illness causing hospitalization. During previous coronavirus epidemics and in the wake of the COVID-19 pandemic, general population’s mental health appeared to be reduced [25,42,43]. In-hospital universal isolation measures, such as implemented during a pandemic, have also shown to increase the risk for anxiety and depression [44]. Approximately 12% of general hospitalized patients suffer from depression, a percentage that like most stress-related psychological disorders is expected to decline over time [7,9]. Moreover, post-discharge depression, anxiety, and PTSD are more prevalent in hospitalized patients with a specific history of traumatizing events, such as cardiac arrest or unintentional injury [2,4,5,8]. Severe illnesses, such as sepsis, septic shock, and acute respiratory distress syndrome, increase the risk of psychological disorders [10,45]. COVID-19 itself may also be a contributing factor. Already early during the pandemic, concerns were raised that especially COVID-19 patients were at substantial risk for psychological morbidity based on previous experiences with similar coronavirus epidemics and possible neurotropic effects of SARS-CoV-2 [25,46]. In a recent large retrospective study, COVID-19 was indeed associated with a higher risk of psychiatric outcomes as compared to influenza and respiratory tract infections [29]. In our cohort however, psychological distress was largely similar between non-COVID-19 patients with respiratory symptoms and COVID-19 patients, and we did not observe COVID-19 positivity to be a predictor for severity of PTSD, anxiety, or depression. As such, our data collectively suggest that COVID-19 on its own has no major influence on psychological outcome. The contradictory findings of the Taquet and our study will largely be explained by the difference in study design (retrospective cohort vs. prospective observational cohort), the different outcome measures used (ICD-based diagnoses vs. questionnaire-based outcome) and comparing the covid-19 cohort with other control populations (influenza and respiratory tract infection vs. patient with symptoms suggestive of COVID-19 but COVID-19 PCR negatives). Several considerations regarding the interpretation of our findings should however be taken into account. First, non-COVID-19 patients suffered from more comorbidities and were older, indicative of a worse pre-existent health status. In our cohort, psychological status and HRQoL prior to hospitalization were not available and thus we cannot formally rule out that pre-existing psychological well-being was poorer, predisposing for impaired psychological recovery [47]. Moreover, a poorer pre-hospitalization health may also explain the lower HRQoL post-discharge in non-COVID-19 patients. Secondly, national and regional initiatives resulted in extensive aftercare programs for COVID-19 patients, including psychological assessment, and referral to a psychologist when necessary [48,49]. Although data on the effectiveness of such post-COVID programs are lacking, similar programs were scarcely available for non-COVID-19 patients and only started 6 weeks post-discharge, so we cannot exclude some underestimation of the psychological burden in our COVID-19 population at three months.

Irrespective of the role of SARS-CoV-2 in the development of psychological distress, our data argue against an almost exclusive focus on COVID-19 patients for in-hospital and post-hospital care to improve recovery. A more appropriate strategy could be to aim at those at highest risk. Previous studies pinpointed ICU patients as those at high risk for psychological sequelae [10,45,50]. Although ICU admission was not predictive for severity of psychological distress, several other predictors identified in our cohort, i.e., ethnicity and educational level, are consistent with previously described risk factors for post-ICU psychological trauma [51]. Of note, the proportion of post-ICU patients suffering from psychological morbidity in our study was considerably lower than previously reported in both general as COVID-19 ICU survivors [12,15,21,45,5255]. Depression was even less prevalent in ICU COVID-19 patients compared to their non-ICU counterparts. We can only speculate on possible explanations as literature on psychological recovery of COVID-19 ICU patients is currently scarce. A possible explanation may be that most ICU patients required deep sedation to facilitate lung protective ventilation [56]. As a result, patients may have experienced fewer anxious or delusional memories and were less aware of the severity of their illness, which are important contributors for psychological impairments following ICU discharge [57]. In contrast to ICU patients, non-ICU patients were fully awake during their hospital stay, and aware of the severity of their illness, potentially causing higher stress levels [57]. Also, ICU patients were, in general more frequently male and younger than ICU patients in a non-COVID-19 setting, and most often had no history of mental illness, possibly making them less susceptible for developing psychologic distress [51,58,59].

Limitations

Several limitations of our study should be acknowledged. First, the high incidence of psychological symptomatology and the poor HRQoL post-discharge may be either attributed to factors related to hospitalization or to baseline psychological imbalances, as psychological status and HRQoL of participants prior to hospitalization was not available. However, only a few reported a history of mental illness, suggesting that hospitalization rather than pre-existing psychological distress relates to post-discharge symptomatology. To overcome this issue, we believe that future studies on psychological and HRQoL recovery should strive for a best effort to obtain a pre-exposure evaluation [60]. Second, the single-center design limits its external validity. In-hospital measures taken to minimize further spread of the virus and treatment protocols were however comparable to those in hospitals in the Netherlands and other high-income countries [49]. Additionally, demographic and treatment-related characteristics of our COVID-19 patients are in line with previously described COVID-19 cohorts [61]. Third, although the overall sample size was substantial, our study was only sufficiently powered to detect major differences between patient subpopulations, limiting elaborate assessment of predictors for psychological distress. Ongoing larger follow-up studies of specific populations are warranted to extend these exploratory observations. Fourth, we assessed psychological well-being and HRQoL using self-report questionnaires. Although commonly used and extensively validated, formal assessment of psychologic disorders requires consultation with a psychologist or psychiatrist, and usage of self-reports may result in an overestimation of psychologic distress. Lastly, the number of non-responders in our study was relatively high, a problem common in the field of longitudinal follow-up research [62]. Baseline characteristics of responders were however comparable to non-responders, and in a sample of non-responders’ psychological distress was roughly similar to responders. Collectively, our cohort was comparable with the overall population at baseline and for psychological outcomes. Baseline characteristics (demographic and treatment-related factors) were similar for non-responders, responders, and a sample of non-responders willing to respond once. In addition, psychological outcomes and HRQoL were comparable between responders and the sample of non-responders willing to respond, and between full and partial responders.

Conclusions

In conclusion, more than one-third of patients admitted during the COVID-19 pandemic suffers from PTSD, anxiety, depression, or a combination, and a poor HRQoL. Physicians should be aware of the psychological consequences of hospitalization during a pandemic, and that psychological distress not only occurs in those affected by COVID-19 or those requiring ICU treatment. Appropriate psychological support and aftercare may be equally important to improve quality of life for those not affected by COVID-19. Future care should be well-balanced between patient groups and preferentially aimed at those at highest risk. Ongoing and future studies can hopefully more robustly define modifiable predictors of poor psychological recovery and its more elaborate risk stratification, to align and improve subsequent targeted implementation of in-hospital and aftercare initiatives.

Supporting information

S1 Table. Possible predictors for psychological distress.

(DOCX)

S2 Table. Reliability of the impact of event scale-revised, the hospital anxiety and depression scale, the short-form 36, and the EQ-5D in the entire population and stratifications.

(DOCX)

S3 Table. Overall response rate and response rates for the individual questionnaires at both follow-up time-points.

(DOCX)

S4 Table. Non-responders’ analysis based on baseline demographics and treatment-related characteristics.

(DOCX)

S5 Table. Comparison of baseline demographics and treatment-related characteristics between full responders and participants who only responded at 1 of 3 months after discharge.

(DOCX)

S6 Table. Comparison psychological and HRQoL outcomes between full responders and participants who only responded at 1 of 3 months after discharge.

(DOCX)

S7 Table. Non-responders’ analysis based on psychological outcomes and health-related quality of life.

(DOCX)

S8 Table. Baseline demographics and treatment-related characteristics of study participants.

(DOCX)

S9 Table. Analysis of predictors for the development of probable PTSD, anxiety, and depression, and the self-perceived health state.

(DOCX)

S1 File. Registered study protocol.

(DOCX)

S2 File. Strobe 2017 statement–checklist of items that should be included in reports of cohort studies.

(DOCX)

S3 File. Raw data file.

(XLSX)

Acknowledgments

We thank the participants in this trial. We also thank the medical interns recruited by the Franciscus Academy for their contributions in the data collection of the Franciscus Corona Registry Database.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.Hoekman LM, Smits MMV, Koolman X. The Dutch COVID-19 approach: Regional differences in a small country. Health Policy Technol 2020;9(4):613–622. doi: 10.1016/j.hlpt.2020.08.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Buckland SA, Pozehl B, Yates B. Depressive symptoms in women with Coronary Heart Disease: A systematic review of the longitudinal literature. J Cardiovasc Nurs 2019;34(1):52–59. doi: 10.1097/JCN.0000000000000533 [DOI] [PubMed] [Google Scholar]
  • 3.Huffman JC, Celano CM, Beach SR, et al. Depression and cardiac disease: epidemiology, mechanisms, and diagnosis. Cardiovascular psychiatry and neurology 2013;2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Kendrick D, Dhiman P, Kellezi B, et al. Psychological morbidity and return to work after injury: multicentre cohort study. British journal of general practice 2017;67(661):e555–e564. doi: 10.3399/bjgp17X691673 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Molina CSP, Berry S, Nielsen A, et al. PTSD in civilian populations after hospitalization following traumatic injury: A comprehensive review. The American Journal of Surgery 2018;216(4):745–753. doi: 10.1016/j.amjsurg.2018.07.035 [DOI] [PubMed] [Google Scholar]
  • 6.Sheldrick R, Tarrier N, Berry E, et al. Post‐traumatic stress disorder and illness perceptions over time following myocardial infarction and subarachnoid haemorrhage. British journal of health psychology 2006;11(3):387–400. doi: 10.1348/135910705X71434 [DOI] [PubMed] [Google Scholar]
  • 7.van Seben R, Covinsky KE, Reichardt LA, et al. Insight Into the Posthospital Syndrome: A 3-Month Longitudinal Follow up on Geriatric Syndromes and Their Association With Functional Decline, Readmission, and Mortality. The Journals of Gerontology: Series A 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Visser E, Gosens T, Den Oudsten BL, et al. The course, prediction, and treatment of acute and posttraumatic stress in trauma patients: a systematic review. Journal of Trauma and Acute Care Surgery 2017;82(6):1158–1183. [DOI] [PubMed] [Google Scholar]
  • 9.Walker J, Burke K, Wanat M, et al. The prevalence of depression in general hospital inpatients: a systematic review and meta-analysis of interview-based studies. Psychological medicine 2018;48(14). doi: 10.1017/S0033291718000624 [DOI] [PubMed] [Google Scholar]
  • 10.Davydow DS, Desai SV, Needham DM, et al. Psychiatric morbidity in survivors of the acute respiratory distress syndrome: a systematic review. Psychosomatic medicine 2008;70(4):512–519. doi: 10.1097/PSY.0b013e31816aa0dd [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Gerth AMJ, Hatch RA, Young JD, et al. Changes in health‐related quality of life after discharge from an intensive care unit: a systematic review. Anaesthesia 2019;74(1):100–108. doi: 10.1111/anae.14444 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Nikayin S, Rabiee A, Hashem MD, et al. Anxiety symptoms in survivors of critical illness: a systematic review and meta-analysis. General hospital psychiatry 2016;43:23–29. doi: 10.1016/j.genhosppsych.2016.08.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Rabiee A, Nikayin S, Hashem MD, et al. Depressive symptoms after critical illness: a systematic review and meta-analysis. Critical care medicine 2016;44(9):1744–1753. doi: 10.1097/CCM.0000000000001811 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Oeyen SG, Vandijck DM, Benoit DD, et al. Quality of life after intensive care: a systematic review of the literature. Critical care medicine 2010;38(12):2386–2400. doi: 10.1097/CCM.0b013e3181f3dec5 [DOI] [PubMed] [Google Scholar]
  • 15.Righy C, Rosa RG, da Silva RTA, et al. Prevalence of post-traumatic stress disorder symptoms in adult critical care survivors: a systematic review and meta-analysis. Critical Care 2019;23(1):213. doi: 10.1186/s13054-019-2489-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Rabiee A, Nikayin S, Hashem MD, et al. Depressive Symptoms After Critical Illness: A Systematic Review and Meta-Analysis. Crit Care Med 2016;44(9):1744–1753. doi: 10.1097/CCM.0000000000001811 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Davydow DS, Katon WJ, Zatzick DF. Psychiatric morbidity and functional impairments in survivors of burns, traumatic injuries, and ICU stays for other critical illnesses: a review of the literature. Int Rev Psychiatry 2009;21(6):531–538. doi: 10.3109/09540260903343877 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.de Vries GJ, Olff M. The lifetime prevalence of traumatic events and posttraumatic stress disorder in the Netherlands. Journal of Traumatic Stress: Official Publication of The International Society for Traumatic Stress Studies 2009;22(4):259–267. doi: 10.1002/jts.20429 [DOI] [PubMed] [Google Scholar]
  • 19.de Graaf MA, Antoni ML, Ter Kuile MM, et al. Short-term outpatient follow-up of COVID-19 patients: A multidisciplinary approach. EClinicalMedicine 2021;32:100731. doi: 10.1016/j.eclinm.2021.100731 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Biehl M, Sese D. Post-intensive care syndrome and COVID-19—Implications post pandemic. Cleve Clin J Med 2020. doi: 10.3949/ccjm.87a.ccc055 [DOI] [PubMed] [Google Scholar]
  • 21.Rajkumar RP. COVID-19 and mental health: A review of the existing literature. Asian J Psychiatr 2020;52:102066. doi: 10.1016/j.ajp.2020.102066 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Jeong H, Yim HW, Song Y-J, et al. Mental health status of people isolated due to Middle East Respiratory Syndrome. Epidemiology and health 2016;38. doi: 10.4178/epih.e2016048 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Cai X, Hu X, Ekumi IO, et al. Psychological distress and its correlates among COVID-19 survivors during early convalescence across age groups. The American Journal of Geriatric Psychiatry 2020;28(10):1030–1039. doi: 10.1016/j.jagp.2020.07.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Mazza MG, De Lorenzo R, Conte C, et al. Anxiety and depression in COVID-19 survivors: Role of inflammatory and clinical predictors. Brain Behav Immun 2020;89:594–600. doi: 10.1016/j.bbi.2020.07.037 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Rogers JP, Chesney E, Oliver D, et al. Psychiatric and neuropsychiatric presentations associated with severe coronavirus infections: a systematic review and meta-analysis with comparison to the COVID-19 pandemic. The Lancet Psychiatry 2020. doi: 10.1016/S2215-0366(20)30203-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Mendez R, Balanza-Martinez V, Luperdi SC, et al. Short-term neuropsychiatric outcomes and quality of life in COVID-19 survivors. J Intern Med 2021. doi: 10.1111/joim.13262 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Raman B, Cassar MP, Tunnicliffe EM, et al. Medium-term effects of SARS-CoV-2 infection on multiple vital organs, exercise capacity, cognition, quality of life and mental health, post-hospital discharge. EClinicalMedicine 2021;31:100683. doi: 10.1016/j.eclinm.2020.100683 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Ismael F, Bizario JCS, Battagin T, et al. Post-infection depressive, anxiety and post-traumatic stress symptoms: A prospective cohort study in patients with mild COVID-19. Prog Neuropsychopharmacol Biol Psychiatry 2021;111:110341. doi: 10.1016/j.pnpbp.2021.110341 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Taquet M, Luciano S, Geddes JR, et al. Bidirectional associations between COVID-19 and psychiatric disorder: retrospective cohort studies of 62 354 COVID-19 cases in the USA. The Lancet Psychiatry 2021;8(2):130–140. doi: 10.1016/S2215-0366(20)30462-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Von Elm E, Altman DG, Egger M, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Ann Intern Med 2007;147(8):573–577. doi: 10.7326/0003-4819-147-8-200710160-00010 [DOI] [PubMed] [Google Scholar]
  • 31.Weiss DS. The impact of event scale: revised. In: Cross-cultural assessment of psychological trauma and PTSD: Springer; 2007. p. 219–238. [Google Scholar]
  • 32.Creamer M, Bell R, Failla S. Psychometric properties of the impact of event scale—revised. Behav Res Ther 2003;41(12):1489–1496. doi: 10.1016/j.brat.2003.07.010 [DOI] [PubMed] [Google Scholar]
  • 33.Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand 1983;67(6):361–370. doi: 10.1111/j.1600-0447.1983.tb09716.x [DOI] [PubMed] [Google Scholar]
  • 34.Bjelland I, Dahl AA, Haug TT, et al. The validity of the Hospital Anxiety and Depression Scale: an updated literature review. J Psychosom Res 2002;52(2):69–77. doi: 10.1016/s0022-3999(01)00296-3 [DOI] [PubMed] [Google Scholar]
  • 35.Herdman M, Gudex C, Lloyd A, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res 2011;20(10):1727–1736. doi: 10.1007/s11136-011-9903-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Versteegh MM, Vermeulen KM, Evers SMAA, et al. Dutch tariff for the five-level version of EQ-5D. Value Health 2016;19(4):343–352. doi: 10.1016/j.jval.2016.01.003 [DOI] [PubMed] [Google Scholar]
  • 37.Hays RD, Sherbourne CD, Mazel RM. The rand 36‐item health survey 1.0. Health Econ 1993;2(3):217–227. doi: 10.1002/hec.4730020305 [DOI] [PubMed] [Google Scholar]
  • 38.Ware JE, Kosinski M, Keller S. SF-36 physical and mental health summary scales: a user’s manual: Health Assessment Lab.; 1994. [Google Scholar]
  • 39.Wang C, Pan R, Wan X, et al. Immediate psychological responses and associated factors during the initial stage of the 2019 coronavirus disease (COVID-19) epidemic among the general population in China. International journal of environmental research and public health 2020;17(5):1729. doi: 10.3390/ijerph17051729 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.American Psychiatric A. Diagnostic and statistical manual of mental disorders (DSM-5®): American Psychiatric Pub; 2013. [Google Scholar]
  • 41.van der Velden PG, Komproe I, Contino C, et al. Which groups affected by Potentially Traumatic Events (PTEs) are most at risk for a lack of social support? A prospective population-based study on the 12-month prevalence of PTEs and risk factors for a lack of post-event social support. PLoS One 2020;15(5):e0232477. doi: 10.1371/journal.pone.0232477 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Krishnamoorthy Y, Nagarajan R, Saya GK, et al. Prevalence of psychological morbidities among general population, healthcare workers and COVID-19 patients amidst the COVID-19 pandemic: A systematic review and meta-analysis. Psychiatry Res 2020;293:113382. doi: 10.1016/j.psychres.2020.113382 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.van der Velden PG, Slachtofferhulp CCF, Das M, et al. Anxiety and depression symptoms, and lack of emotional support among the general population before and during the COVID-19 pandemic. A prospective national study on prevalence and risk factors. J Affect Disord 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Purssell E, Gould D, Chudleigh J. Impact of isolation on hospitalised patients who are infectious: systematic review with meta-analysis. BMJ open 2020;10(2). doi: 10.1136/bmjopen-2019-030371 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Bienvenu OJ, Friedman LA, Colantuoni E, et al. Psychiatric symptoms after acute respiratory distress syndrome: a 5-year longitudinal study. Intensive Care Med 2018;44(1):38–47. doi: 10.1007/s00134-017-5009-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Varatharaj A, Thomas N, Ellul MA, et al. Neurological and neuropsychiatric complications of COVID-19 in 153 patients: a UK-wide surveillance study. The Lancet Psychiatry 2020;7(10):875–882. doi: 10.1016/S2215-0366(20)30287-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Zhang J, Yang Z, Wang X, et al. The relationship between resilience, anxiety and depression among patients with mild symptoms of COVID‐19 in China: A cross‐sectional study. J Clin Nurs 2020;29(21–22):4020–4029. doi: 10.1111/jocn.15425 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Dutch Society of Intensive Care (NVIC). Current guidelines considering COVID-19. 2020 [cited 2020 August 18].
  • 49.Reijers MHR, Maas-van Weert KCM, Hoefman E, et al. Guidelines for post-COVID ICU care. 2020. [cited 2020 September 8]. [Google Scholar]
  • 50.Needham DM, Davidson J, Cohen H, et al. Improving long-term outcomes after discharge from intensive care unit: report from a stakeholders’ conference. Critical care medicine 2012;40(2):502–509. doi: 10.1097/CCM.0b013e318232da75 [DOI] [PubMed] [Google Scholar]
  • 51.Lee M, Kang J, Jeong YJ. Risk factors for post-intensive care syndrome: A systematic review and meta-analysis. Aust Crit Care 2019. doi: 10.1016/j.aucc.2019.10.004 [DOI] [PubMed] [Google Scholar]
  • 52.Hatch R, Young D, Barber V, et al. Anxiety, Depression and Post Traumatic Stress Disorder after critical illness: a UK-wide prospective cohort study. Crit Care 2018;22(1):310. doi: 10.1186/s13054-018-2223-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Janiri D, Carfi A, Kotzalidis GD, et al. Posttraumatic Stress Disorder in Patients After Severe COVID-19 Infection. JAMA Psychiatry 2021;78(5):567–569. doi: 10.1001/jamapsychiatry.2021.0109 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Monti G, Leggieri C, Fominskiy E, et al. Two-months quality of life of COVID-19 invasively ventilated survivors; an Italian single-center study. Acta Anaesthesiol Scand 2021. doi: 10.1111/aas.13812 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Mongodi S, Salve G, Tavazzi G, et al. High prevalence of acute stress disorder and persisting symptoms in ICU survivors after COVID-19. Intensive Care Med 2021;47(5):616–618. doi: 10.1007/s00134-021-06349-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Botta M, Tsonas AM, Pillay J, et al. Ventilation management and clinical outcomes in invasively ventilated patients with COVID-19 (PRoVENT-COVID): a national, multicentre, observational cohort study. Lancet Respir Med 2021;9(2):139–148. doi: 10.1016/S2213-2600(20)30459-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Granja C, Gomes E, Amaro A, et al. Understanding posttraumatic stress disorder-related symptoms after critical care: the early illness amnesia hypothesis. Critical care medicine 2008;36(10):2801–2809. doi: 10.1097/CCM.0b013e318186a3e7 [DOI] [PubMed] [Google Scholar]
  • 58.Wade D, Hardy R, Howell D, et al. Identifying clinical and acute psychological risk factors for PTSD after critical care: a systematic review. Minerva Anestesiol 2013;79(8):944–963. [PubMed] [Google Scholar]
  • 59.Wade DM, Howell DC, Weinman JA, et al. Investigating risk factors for psychological morbidity three months after intensive care: a prospective cohort study. Crit Care 2012;16(5):R192. doi: 10.1186/cc11677 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Geense WW, van den Boogaard M, Peters MAA, et al. Physical, Mental, and Cognitive Health Status of ICU Survivors Before ICU Admission: A Cohort Study. Critical care medicine 2020;48(9):1271. doi: 10.1097/CCM.0000000000004443 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Guan W-j, Ni Z-y, Hu Y, et al. Clinical characteristics of coronavirus disease 2019 in China. New England journal of medicine 2020;382(18):1708–1720. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Morton LM, Cahill J, Hartge P. Reporting participation in epidemiologic studies: a survey of practice. American journal of epidemiology 2006;163(3):197–203. doi: 10.1093/aje/kwj036 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Peter G van der Velden

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

27 Jan 2021

PONE-D-20-38679

Psychological distress and health-related quality of life in patients after hospitalization during the COVID-19 pandemic: a single-centre, observational study.

PLOS ONE

Dear Dr. Vlake,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

I have read your interesting manuscript with pleasure and received the comments of three independent reviewers. The critical, detailed, very clear and helpful comments of the reviewers are included in this letter. I fully agree and share their comments and will try not repeat them in my comments below.

  • My general impression is that you have so many study variables you all want to use (among a relatively small group), that the condensed format you have chosen to report your findings in, hinders (among other things) the readability of your manuscript. I would like to suggest to rethink your analyses: your main aim seems to be the assessment of the course of PTSD, anxiety and depression symptom, and quality of life among different patient groups over two waves. One major problem you face is the non-response at T1 or T2 which hinders clarity about your study sample (and N). Using mixed effects models could be a way to solve this problem (or using multiple imputation). Of course, you can enter relevant covariates in your analyses. Perhaps covid and non-covid groups could be merged to limit the number of groups/comparisons (with IC as dummy variable). Your second aim seems to be the assessment of predictors of your dependent variables. As also mentioned by the reviewers, this element in your manuscript lacks clarity and focus. It seems more data driven than anything else (see long list of correlations). I would like to suggest to limit the number of predictors, and use current knowledge on predictors or PTSD, etc to choose a limit number of relevant predictors. There are several reviews and meta-analyses available that are very helpful in this perspective.  

  • Your very short introduction section lacks a proper overview of what is known about the effect is illness/ hospitalization on mental health (including PTSD), and introduction of study variables. This must be added to be able to understand your analyses.

  • According to your manuscript, 623 patients were eligible and 171 participated in both surveys. The non-response should be included in the text before the results section. In general, the manuscript lacks a clear overview in the text and figures about the number of respondents the analyses and figures refer to. This need to be solved.  

  • You compared subgroups of patients (see also figures) while at the same time you showed that these subgroups differed at baseline. In your analyses you did not control for these differences which is not allowed. Your figures in figure 3 in which you compare groups must therefore be omitted. The added value of your figures was unclear to me.

  • The outcome measures need to be clarified much more in detail (including adding cronbachs alphas for all assessments at the two waves). You did not examine mental disorders using the IESR and HADS. Please define high scores as probable PTSD etc. and avoid the use of the term disorder in this perspective.

  •  You used the Bonferroni correction without explaining why. Without a proper explanation I urge you to drop this often misused correction method. Please consult papers on this issue or Lakens´ blog. He wrote an interesting piece about this correction. http://daniellakens.blogspot.com/2016/02/why-you-dont-need-to-adjust-you-alpha.html

  •  Because of all the serious issues raised by the reviewers and my ow comments that need to be addressed first, it is not useful to comment of the discussion section at this stage.

Please submit your revised manuscript by Mar 13 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover ltter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Peter G. van der Velden, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

3. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please delete it from any other section.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The article present san interesting piece of research of psychological reactions and symptoms of hospitalized patients with COVID symptoms. The literature review is clear, and the authors present the methods in an adequate way. However, there are two main issue with the paper that I think might be considered by the authors regard to description of what they are studying and the report of results. The authors declare that they are presenting data for psychological disorders, and not what they are presenting is symptoms reported by patients, more information is needed to arrive to diagnosis, so I suggest changing that presentation of the results.

Moreover, I think the methods section can include more information and justification of the decisions made. It is important that the authors declare why they choose one and three months as appropriate time points to collect the data. In the statistical analysis description, authors must include a justification of why to choose variables with correlations with a p-value below 0.10 to be included in a multivariate linear regression model. Moreover, it is important to justify why they used a multivariate linear regression for this purpose, the other analysis suggest that the data do not follow a parametric distribution.

In the results section, the confusion in the section "Predictors of psychological outcomes and quality of life" remains as a result of the lack of the explanation in the statistical analysis section. If the authors maintain the idea to include de multivariate linear regression, I suggest first to declare, in the paper, which variables will be included in the model, and then to present the results of the significance of the model and betas, SE and p values for all the variables.

Also, in the results section, in line 125 the authors indicate that 24 of the 201patients reported a history of mental illness. Please clarify why only there is information about this issue of 201 patients of the 282 patients that participate. If they rest of participants did not respond to that question, please state that in the article.

Reviewer #2: Review:

This study concerns a very interesting topic, which has not yet received much attention in research yet. There are, however, some major points I feel should be addressed to make it ready for publication.

Major points:

1. The introduction is very brief, and fails to adequately emphasize the relevance of the study: what does it add to what is known, why is it important to study this.

2. More importantly, no explanation is given for assumed relationships. Please provide theoretical framework for the described relationships. For instance: why do medical problems that require hospitalization lead to psychological problems? What reasons do you have to believe the relationship is causal? The most striking example of this is the hypothesis formulated on page 3. Absolutely no theoretical (nor empirical) foundation for this is given. Why do you expect this? What is the mechanism behind this?

3. The article generally seems to lack focus. Please explain in your introduction why the (primary and secondary) outcomes are important to study during the COVID pandemic. Do you expect this to defer from regular outcomes (outside pandemics) and for all patients admitted with covid-like symptoms or just for the confirmed covid cases? Why? Elaborate. HRQOL and work-resumption suddenly appear when you describe the aims of the study but not before (work-resumption is also completely ignored in the abstract). Why study these?

4. The study has no pre-exposure measurement. The degree to which participants suffered from some degree of psychological problems before hospitalization As a result whether psychological symptoms are caused by hospitalization during the covid-19 pandemic is unknown. There are even studies that suggest that having pre-existing psychological disorders can be a risk factor for contracting COVID-19 (see https://www.thelancet.com/journals/lanpsy/article/PIIS2215-0366(20)30462-4/fulltext#:~:text=A%20meta%2Danalysis%20of%20pooled,%2C%20poor%20memory%2C%20and%20insomnia).

5. No proper distinction is made between posttraumatic stress SYMPTOMS and posttraumatic stress DISORDER. The IES-r is not able to make a diagnosis. It is therefore common practice to speak of (high levels of) PTSS, or probable PTSD. Furthermore, if you really wanted to examine predictors of PTSD, not PTSS a linear regression is not the correct analysis, after all, one either has PTSD or not.

6. Relate outcome levels to outcome levels outside pandemic conditions in previous studies. Can we conclude that there is a problem specific to pandemics?

7. Educational level is added to the regression models as a linear variable instead of dummy variables. This is a categorical variable with unequal distances between categories. The resulting coefficient is therefore meaningless.

8. The description of the measured used in the study is not sufficient. Please add range of scales and reliability statistics within your sample. Also elaborate on operationalization of other variables such as demographics. For instance, how is ethnicity operationalized? If more than two categories are used in the regression (such as native and non-native) see my previous comment as well.

9. No distinction is made in the regression analyses between the subgroups. Theoretically it would be interesting to distinguish the COVID and non-COVID patients. Ideally this would be done using a multilevel model to determine the impact of group membership on the influence of predictors, but the samples are probable too small for this.

10. I think the statement on p16 that “Collectively, this suggest that participating patients are grossly representative for the total cohort” is too bold. Your response rate is quite low, and examining patient records do not inform you how they would have scored on the outcome measures. A nice idea to ask a small sample of non-responders to respond anyway, but self-selection here is of course also a factor. You could consider comparing outcomes between the full responders (T1 and T2) and those that responded at T1 only.

Minor points:

1. I prefer a table where all primary and secondary outcomes can be seen, instead of a series of boxplots (which seem rather archaic). Having to look up a long list of supplementary tables is not helping your readers understand your work. especially as the tables put in the supplementary section are core study results. Readers are now forced to resort to the long summary of the results in the text, which do not give all information. I propose to put them into the article, and to merge them, and move the box-and-whisker plots to the supplementary section for the fans. This also means shortening the results section as not all results in the table then need to be described in text.

2. The Venn-diagrams look nice, but also add little. Please put these in the supplementary section as well.

3. There is no table for your regression analyses, not even in the supplements! Please add these (to the article, not the supplementary section).

4. Please check for spelling and grammar errors such as “Predictors off psychological outcomes” on page 12. Or also see comment 10 these suggest/this suggests.

5. When describing outcomes (especially when tables are not included) please add direction of association. E.g.: does having had a job before hospitalization lead to higher or lower psych symptoms?

6. Page 3: “the pandemic peak”. Is no longer applicable as there are 2 peaks at this point in time.

7. Provide a benchmark for HRQOL. You state it is low, but what are reference levels for for instance the general population?

Reviewer #3: The study topic “Psychological distress and health-related quality of life in patients after hospitalization during the COVID-19 pandemic: a single-centre, observational study” is relevant and interesting in this era of COVID-19 but is not clearly reported. I thank the authors for this good research, however many things need to be worked on to reach a level of publication

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes: Desire Aime Nshimirimana

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: Review Plosone januari 2021.docx

Attachment

Submitted filename: Comments to authors.docx

PLoS One. 2021 Aug 11;16(8):e0255774. doi: 10.1371/journal.pone.0255774.r002

Author response to Decision Letter 0


24 Mar 2021

Response to the handling editor:

Dear Dr. Vlake,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

I have read your interesting manuscript with pleasure and received the comments of three independent reviewers. The critical, detailed, very clear and helpful comments of the reviewers are included in this letter. I fully agree and share their comments and will try not repeat them in my comments below.

RESPONSE:

Dear Dr. Peter G. van der Velden,

We really appreciate that you are handling our manuscript, and that you are willing to give us the opportunity to thoroughly revise our manuscript. The suggestions, concerns, and comments raised gave us the opportunity to further improve our manuscript, and we have made point-by-point responses to all comments below.

For the referral to certain pages or lines within the manuscript; all referrals are based on the submitted marked-up manuscript, in which the changes made during the revision are highlighted.

1) My general impression is that you have so many study variables you all want to use (among a relatively small group), that the condensed format you have chosen to report your findings in, hinders (among other things) the readability of your manuscript. I would like to suggest to rethink your analyses: your main aim seems to be the assessment of the course of PTSD, anxiety and depression symptom, and quality of life among different patient groups over two waves. One major problem you face is the non-response at T1 or T2 which hinders clarity about your study sample (and N). Using mixed effects models could be a way to solve this problem (or using multiple imputation). Of course, you can enter relevant covariates in your analyses. Perhaps covid and non-covid groups could be merged to limit the number of groups/comparisons (with IC as dummy variable). Your second aim seems to be the assessment of predictors of your dependent variables. As also mentioned by the reviewers, this element in your manuscript lacks clarity and focus. It seems more data driven than anything else (see long list of correlations). I would like to suggest to limit the number of predictors, and use current knowledge on predictors or PTSD, etc to choose a limit number of relevant predictors. There are several reviews and meta-analyses available that are very helpful in this perspective.

RESPONSE:

We understand the comment raised, and in hindsight agree that we shared a too large amount of information within the paper, and that this hindered the readability of the manuscript. The main aim of the study was indeed to assess the course of psychological sequelae (symptoms of PTSD, anxiety, and depression) and quality of life in time after hospital discharge in patients included during the first COVID-19 pandemic wave. To address this comment, we have made the following changes:

1) We adjusted figure 1 to make it more insightful how inclusion was performed.

2) As suggested by the editor, we have re-analyzed the entire results section using regression models, adjusting for baseline differences. In order to determine possible predictors, we have used linear and logistic mixed models.

We therefore added:

“Differences in outcome measures between stratifications were analyzed using linear or logistic regression models for continuous and categorical outcomes, respectively, adjusting for baseline differences between groups, in which the ‘stratification’ and at baseline differing characteristics served as independent variables.” (Methods, page 9, lines 172-174).

“To identify possible predictors for psychological symptomatology or quality of life, we first conducted a univariate linear or logistic mixed model with possible predictors as independent variables (S1. Table). Variables with a p-value ≤0.10 were added in the multivariate linear or logistic mixed model to determine predictors.” (Methods, page 9, lines 180-182)

“Psychological outcomes of randomly selected non-responders were compared with those of responders using a linear or logistic regression model, adjusting for baseline differences between groups, in which the ‘stratification’ and at baseline differing characteristics served as independent variables.” (Methods, page 9, lines 184-186)

Additionally, we changed the Results section within the Abstract section accordingly:

“282 of 623 eligible patients participated in this study (median age 64 years, 36% female). 16% and 12% of these patients reported clinically relevant symptoms of PTSD, 29% and 20% clinically relevant symptoms of anxiety, and 32% and 25% clinically relevant symptoms of depression after one and three months, respectively. ICU patients reported less probable depression, but no differences were found in PTSD, anxiety, or overall HRQoL. COVID-19 patients had a worse physical and mental quality of life one month after discharge, and ICU patients reported a better physical quality of life three months after discharge. PTSD severity was predicted by time after discharge and not being Caucasian. Severity of anxiety was predicted by time after discharge, age, educational level, employment status, COVID-19 diagnosis, and not being Caucasian. Depression severity was predicted by time after discharge and educational level. 49% and 76% of previously working patients had resumed work, and patients worked a median of 30 hours less at both follow-up time-points. COVID-19 patients more frequently experienced a financial decline. ” (Abstract, page 2-3, lines 40-49)

3) We limited the number of variables included for the prediction model, and these variables were selected based on existing literature on risk factors for developing psychological sequelae after hospitalization. We therefore added the following sentences into the methods section:

“These predictors were chosen based on previous literature, and included age, gender, ethnicity, educational level, duration of admission, ICU admission, COVID-19 diagnosis and work before admission, and severity of disease in terms of SOFA score at the first day of COVID-19 suspicion (day of enrolment). Literature supporting these predictors is depicted in S1. Table in the Supporting Information.” (Methods, page 8, lines 158-162)

2) Your very short introduction section lacks a proper overview of what is known about the effect is illness/ hospitalization on mental health (including PTSD), and introduction of study variables. This must be added to be able to understand your analyses.

RESPONSE:

We agree with the editor that the introduction sections in its present state is limited, and therefore added information about the effect of illness/hospitalization on mental health and the rationale for using certain variables as predictors for psychological distress and quality of life.

Concordantly, we added the following:

“Symptoms of the infectious disease caused by the SARS-CoV-2 virus, coronavirus disease-19 (COVID-19), vary from mild respiratory and gastro-intestinal symptoms to severe acute respiratory failure, requiring respiratory support in an Intensive Care Unit (ICU) (2-4).” (Introduction, page 4, lines 64-66)

“…; symptoms of depression and anxiety occur in 12-67% of hospitalized patients; symptoms of post-traumatic stress disorder (PTSD) in 19%-45% (8-15). Survivors of ICU treatment are known to be at risk for psychological impairments including symptoms of depression, anxiety and PTSD. These symptoms occur in up to 20%-67% of ICU survivors (16-21). Post-hospitalization psychological impairments negatively impact on the ability to return to work and the health-related quality of life (HRQoL) (13, 17, 18, 20).” (Introduction, page 4, lines 77-81)

“The risk of psychological impairments is expected to be even higher in patients hospitalized during the COIVD-19 pandemic due to the exceptional circumstances and uncertainties (22, 23).“ (Introduction, page 4, lines 82-83)

3) According to your manuscript, 623 patients were eligible and 171 participated in both surveys. The non-response should be included in the text before the results section. In general, the manuscript lacks a clear overview in the text and figures about the number of respondents the analyses and figures refer to. This need to be solved.

RESPONSE:

We agree that the manuscript in its present state lacks this clear overview. We therefore rewrote the results section, expanded the introduction, and changes the figures and tables in the text, and removed several tables from the supplementary materials to overcome this issue.

With regard to the inclusion rate; we adjusted figure 1 to make it more insightful. We also replaced the paragraph on this matter prior to the ‘Participants’ section within the Results section. In addition, we addressed the non-inclusion rate by adding the following sentence to the result section:

“Non-participating patient either declined participation (n=262) or did not respond to the questionnaires or to the reminding phone calls (n=79).” (Results, page 10, lines 195-197)

4) You compared subgroups of patients (see also figures) while at the same time you showed that these subgroups differed at baseline. In your analyses you did not control for these differences which is not allowed. Your figures in figure 3 in which you compare groups must therefore be omitted. The added value of your figures was unclear to me.

RESPONSE:

We agree with the editor’s comment that we should control for baseline differences. In line with the response to the editor’s previous comments, we changed the analysis within the results section, and used regression and mixed models instead of non-controlling tests (i.e., Wilcoxon or t-test or T-test).

With regard to the Figure 3 and Figure 4, in line with the comment raised by the editor, we have omitted these figures, and prioritized tables instead.

5) The outcome measures need to be clarified much more in detail (including adding cronbachs alphas for all assessments at the two waves). You did not examine mental disorders using the IESR and HADS. Please define high scores as probable PTSD etc. and avoid the use of the term disorder in this perspective.

RESPONSE:

We agree with the editor that the description of the used questionnaires was limited, and, in accordance with the raised concern, we described the outcome measures in more detail.

Therefore we added the following sentences:

“The IES-R is a validated 22-item questionnaire that quantifies the subjective distress a person is experience after a traumatic event (32). The IES-R yields a total score, ranging from 0-88 (higher scores indicating more severe symptoms), and subscale scores can be calculated for symptoms of intrusion, avoidance and hyperarousal.” (Methods, page 7, lines 132-135)

“The HADS is commonly used to determine the levels of anxiety and depression that a person is experiencing (34). The HADS is 14-item scale that generated ordinal data. Seven of the items relate to anxiety and seven relate to depression. The HADS yields a depression and anxiety sum score, ranging from 0 to 21 with higher scores indicating more severe symptoms.” (Methods, page 7, lines 135-138)

“The EQ-5D measures the HRQoL on five dimensions (mobility, self-care, usual activities, pain/discomfort and anxiety/depression), by which the weight of a health state can be computed into an EQ-5D Time Trade Off (TTO) score. This score ranges from – 0.446 (worst quality of life) to 1.000 (best quality of life). Additionally, patients score their current subjective health state on a visual analogue scale (the EQ-VAS), ranging from 0 (worst health imaginable) to 100 (best health imaginable) (36, 37).” (Methods, page 7-8, lines 141-145)

“The RAND-36 is a 36-item, self-reported survey of HRQoL, and consists nine scales scores, which are the weighted sums of the questions in their section (38). Each scale is directly transformed to a scale ranging from 0 (worse score) to 100 (best score) on the assumption that each question carries an equal weight. The nine scores are; …” (Methods, page 8, lines 148-150)

“Resumption to work and financial decline due to the hospitalization were was additionally assessed using self-composed questionnaires.” (Methods, page 8, lines 154-155)

The editor also rightly point out that we did not determine the presence of psychiatric disorders, but rather the presence of symptomatology, and thus the probability of the disorders. We therefore removed ‘disorders’ from the manuscript, and used probable PTSD, anxiety, and depression instead.

6) You used the Bonferroni correction without explaining why. Without a proper explanation I urge you to drop this often misused correction method. Please consult papers on this issue or Lakens´ blog. He wrote an interesting piece about this correction. http://daniellakens.blogspot.com/2016/02/why-you-dont-need-to-adjust-you-alpha.html

RESPONSE:

We agree with the editor that the use of the Bonferroni correction was lacking. As we changed our analysis by using regression and mixed models, we did no longer need correction and therefore deleted the following from the manuscript:

“We corrected for multiple testing by using a Bonferroni correction.”

7) Because of all the serious issues raised by the reviewers and my ow comments that need to be addressed first, it is not useful to comment of the discussion section at this stage.

RESPONSE:

We understand the editor that reviewing the discussion at this stage was not useful. Of note, we revised our discussion based on the revisions, and hope that our revisions are sufficient to review our discussion section.

8) Please submit your revised manuscript by Mar 13 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

RESPONSE:

We have submitted the revised manuscript prior to the assigned deadline.

Please include the following items when submitting your revised manuscript:

9) A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

RESPONSE:

The current document responds to the points raised by the academic editor and reviewers.

10) A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

RESPONSE:

We submitted a marked-up copy of the manuscript highlighting all chances made to the manuscript.

11) An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

RESPONSE:

We have submitted a clean version of the manuscript, without tracked changes, to the revised submission of the manuscript

Response to the Reviewer's Responses to Questions

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Partly

RESPONSE:

We have changed the introduction, methods, and results according to the comments raised by the reviewers, and hope this has resulted in the manuscript being technically sound, and to more clearly illustrate the data supporting the conclusions.

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes

RESPONSE:

We have changed the analysis methods by using regression and mixed models. We thereby hope that the statistical analysis has been performed appropriately and rigorously.

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: No

RESPONSE:

We have submitted the de-identified data as supporting information, and thereby made all data underlying the findings in the manuscript fully available.

We added the following to the Data Sharing Statement in the Declarations:

“The datasets used and/or analyzed during the current study are included in the supporting information files.“ (Page 27, line 485)

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No

RESPONSE:

We have copy-edited the entire manuscript to ensure it is presented in an intelligible fashion and written in Standard English.

Response to Comments raised by Reviewer #1:

The article present san interesting piece of research of psychological reactions and symptoms of hospitalized patients with COVID symptoms. The literature review is clear, and the authors present the methods in an adequate way.

1. However, there are two main issue with the paper that I think might be considered by the authors regard to description of what they are studying and the report of results. The authors declare that they are presenting data for psychological disorders, and not what they are presenting is symptoms reported by patients, more information is needed to arrive to diagnosis, so I suggest changing that presentation of the results.

RESPONSE:

We thank you for reviewing our manuscript, and for your useful comments. We agree that we should not have used the term ‘disorder’, a similar concern was raised by the academic editor (comment 5). We therefore discarded ‘disorder’ from the manuscript and changed it with probable PTSD, anxiety, or depression.

2. Moreover, I think the methods section can include more information and justification of the decisions made. It is important that the authors declare why they choose one and three months as appropriate time points to collect the data.

RESPONSE:

We agree with the reviewer that the methods section should have included more information. A similar comment was raised by the academic editor (comment 5).

With regard to the chosen time-points to collect the data, we added the following to the manuscript:

“Psychological outcomes were assessed one month and three months after hospital discharge to 1) compare results with other research concerning psychological outcomes after hospital admission due to COVID-19 or similar coronaviruses; studies up till now mainly reported data of the first month after discharge (27) and 2) to evaluate the course of psychological symptoms and HRQoL in time after discharge.“ (Methods, page 8, lines 163-167)

3. In the statistical analysis description, authors must include a justification of why to choose variables with correlations with a p-value below 0.10 to be included in a multivariate linear regression model.

RESPONSE:

First, based on the comment raised by the academic editor (comment 1), we have changed our analysis using mixed models for the identification of possible predictors. Therefore, we have analyzed all possible predictors using a univariate mixed model and used the variables with a p-value ≤0.10 for the full (multivariate) mixed model. Thereby, we have discarded the use of correlations from original manuscript.

Within prediction models, there are several manners to select variables, of which one it to perform univariate analyses on each variables and include those with a small (≤0.10) p-value into multivariate (mixed) models.

Concordantly, we added the following:

“Differences in outcome measures between stratifications were analyzed using linear or logistic regression models for continuous and categorical outcomes, respectively, adjusting for baseline differences between groups, in which the ‘stratification’ and at baseline differing characteristics served as independent variables.” (Methods, page 9, lines 172-174)

“To identify possible predictors for psychological symptomatology or quality of life, we first conducted a univariate linear or logistic mixed model with possible predictors as independent variables (S1. Table). Variables with a p-value ≤0.10 were added in the multivariate linear or logistic mixed model to determine predictors.” (Methods, page 9, lines 180-182)

4. Moreover, it is important to justify why they used a multivariate linear regression for this purpose, the other analysis suggest that the data do not follow a parametric distribution.

RESPONSE:

We agree with the reviewer that using a multivariate linear regression model was a suboptimal choice. We have changed the analysis within the manuscript, and now used mixed models instead, of which the assumptions rely less on the distribution of the variables within the model. For the changes we made to the statistical analysis, see our response to your previous comment.

5. In the results section, the confusion in the section "Predictors of psychological outcomes and quality of life" remains as a result of the lack of the explanation in the statistical analysis section. If the authors maintain the idea to include de multivariate linear regression, I suggest first to declare, in the paper, which variables will be included in the model, and then to present the results of the significance of the model and betas, SE and p values for all the variables.

RESPONSE:

We agree with the reviewer that we did not explain our choice of variable, nor the analysis of predictors, well enough. A similar comment was raised by the academic editor (comment 1).

With regard to the choice of predictive variables, we have added the following sentences into the manuscript:

“These predictors were chosen based on previous literature, and included age, gender, ethnicity, educational level, duration of admission, ICU admission, COVID-19 diagnosis and work before admission, and severity of disease in terms of SOFA score at the first day of COVID-19 suspicion (day of enrolment). Literature supporting these predictors is depicted in S1. Table in the Supporting Information.” (Methods, page 8, lines 158-162).

In addition, in the results section, we have added the betas, SE, and p-values of all significant variables used in the models, and added tables depicting the outcomes of the univariate and multivariate mixed models, including betas and p-values, to predict the severity of psychological symptoms and HRQoL in table 4 and 5 in the manuscript, and the tables concerning the predictors of the prevalence of psychological symptoms in table S3.

6. Also, in the results section, in line 125 the authors indicate that 24 of the 201patients reported a history of mental illness. Please clarify why only there is information about this issue of 201 patients of the 282 patients that participate. If they rest of participants did not respond to that question, please state that in the article.

RESPONSE:

We agree with the reviewer that this is not well described in the manuscript. Patients were indeed asked about their mental history and could self-determine whether they wanted to share this history with us.

Therefore, we added the following sentence into the manuscript:

“Patients were asked for their psychiatric history and could choose whether or not to answer.” (Methods, page 8, line 155-156).

“…, who were willing to share this information.” (Results, page 10, line 204).

Response to Comments raised by Reviewer #2:

This study concerns a very interesting topic, which has not yet received much attention in research yet. There are, however, some major points I feel should be addressed to make it ready for publication.

Major points:

1. The introduction is very brief, and fails to adequately emphasize the relevance of the study: what does it add to what is known, why is it important to study this.

RESPONSE:

We agree with the reviewer that the introduction was to brief, and a similar concern was raised by the academic editor (comment 2). We therefore expanded the introduction, as further described in our response to comment 2 of the academic editor.

2. More importantly, no explanation is given for assumed relationships. Please provide theoretical framework for the described relationships. For instance: why do medical problems that require hospitalization lead to psychological problems? What reasons do you have to believe the relationship is causal? The most striking example of this is the hypothesis formulated on page 3. Absolutely no theoretical (nor empirical) foundation for this is given. Why do you expect this? What is the mechanism behind this?

RESPONSE:

We agree with the reviewer that more information should be added to the manuscript on the rationale and choices made within our study.

To the introduction, we added the following:

“…; symptoms of depression and anxiety occur in 12-67% of hospitalized patients; symptoms of post-traumatic stress disorder (PTSD) in 19%-45% (8-15). Survivors of ICU treatment are known to be at risk for psychological impairments including symptoms of depression, anxiety and PTSD. These symptoms occur in up to 20%-67% of ICU survivors (16-21). Post-hospitalization psychological impairments negatively impact on the ability to return to work and the health-related quality of life (HRQoL) (13, 17, 18, 20).” (Introduction, page 4, lines 77-81)

“The risk of psychological impairments is expected to be even higher in patients hospitalized during the COIVD-19 pandemic due to the exceptional circumstances and uncertainties (22, 23).“ (Introduction, page 4, lines 82-83)

Additionally, we added the following to the methods:

“These predictors were chosen based on previous literature, and included age, gender, ethnicity, educational level, duration of admission, ICU admission, COVID-19 diagnosis and work before admission, and severity of disease in terms of SOFA score at the first day of COVID-19 suspicion (day of enrolment). Literature supporting these predictors is depicted in S1. Table in the Supporting Information.” (Methods, page 8, lines 158-162).

3. The article generally seems to lack focus. Please explain in your introduction why the (primary and secondary) outcomes are important to study during the COVID pandemic. Do you expect this to defer from regular outcomes (outside pandemics) and for all patients admitted with covid-like symptoms or just for the confirmed covid cases? Why? Elaborate. HRQOL and work-resumption suddenly appear when you describe the aims of the study but not before (work-resumption is also completely ignored in the abstract). Why study these?

RESPONSE:

We thank the reviewer for this comment. First, we added the following to the introduction to emphasize that we hypothesize that patients, as in our cohort, have an increased risk of developing psychological symptomatology:

“…; symptoms of depression and anxiety occur in 12-67% of hospitalized patients; symptoms of post-traumatic stress disorder (PTSD) in 19%-45% (8-15). Survivors of ICU treatment are known to be at risk for psychological impairments including symptoms of depression, anxiety and PTSD. These symptoms occur in up to 20%-67% of ICU survivors (16-21). ” (Introduction, page 4, lines 77-81)

“The risk of psychological impairments is expected to be even higher in patients hospitalized during the COIVD-19 pandemic due to the exceptional circumstances and uncertainties (22, 23).“ (Introduction, page 4, lines 81-82)

In addition, we have added the following to explain why we also study HRQoL and work resumption:

“Post-hospitalization psychological impairments negatively impact on the ability to return to work and the health-related quality of life (HRQoL) (13, 17, 18, 20).” (Introduction, page 4, lines 80-81)

We added the following to the abstract, as this point was indeed missing in the abstract of our original manuscript:

“Illnesses requiring hospitalization are known to negatively impact psychological well-being and health-related quality of life (HRQoL) after discharge.” (Abstract, page 2, lines 24-25)

“…. is expected to be higher due to the exceptional circumstances within and outside the hospital during the pandemic surge ” (Abstract, page 2, lines 26-27)

“We also aimed to determine HRQoL and work resumption, to explore predictors for psychological distress and HRQoL, and to examine whether psychological distress was higher in COVID-19 confirmed patients, and in those treated in ICUs.“ (Abstract, page 2, lines 29-31)

“Health-related quality of life (HRQoL) and work resumption were secondary outcomes. Predictors for psychological distress and HRQoL were explorative outcomes.” (Abstract, page 2, lines 36-37)

“PTSD severity was predicted by time after discharge and not being Caucasian. Severity of anxiety was predicted by time after discharge, age, educational level, employment status, COVID-19 diagnosis, and not being Caucasian. Depression severity was predicted by time after discharge and educational level. 49% and 76% of previously working patients had resumed work, and patients worked a median of 30 hours less at both follow-up time-points. COVID-19 patients more frequently experienced a financial decline.“ (Abstract, page 2, lines 45-49)

4. The study has no pre-exposure measurement. The degree to which participants suffered from some degree of psychological problems before hospitalization As a result whether psychological symptoms are caused by hospitalization during the covid-19 pandemic is unknown. There are even studies that suggest that having pre-existing psychological disorders can be a risk factor for contracting COVID-19 (see https://www.thelancet.com/journals/lanpsy/article/PIIS2215-0366(20)30462-4/fulltext#:~:text=A%20meta%2Danalysis%20of%20pooled,%2C%20poor%20memory%2C%20and%20insomnia).

RESPONSE:

We agree with the reviewer that the lack of a pre-exposure measure is missing. A pre-exposure measure was unfortunately not attainable giving the study circumstances. However, as recently discussed by Geense et al., pre-exposure in unplanned admitted patients (all of the included patients in our cohort), depends on retrospective recollection of psychological functioning and HRQoL. Moreover, pre-exposure PTSD scoring is meaningless, as PTSD is inherently related to the traumatizing event under study. Notwithstanding its shortcomings, we strongly agree with the reviewer that future studies on psychological and HRQoL recovery should strive for pre-exposure measure.

We addressed this comment in the discussion section:

“First, non-COVID-19 patients suffered from more comorbidities and were older, indicative of a worse pre-existent health status, but baseline psychological status and HRQoL of our cohort were unfortunately not available. We thus cannot formally rule out that the pre-existing psychological well-being was poorer and resilience lower, predisposing for impaired psychological recovery (47).” (Discussion, page 24, lines 410-413)

Additionally, we added the following to the discussion section to emphasize this limitation;

“First, the high incidence of psychological symptomatology and the poor HRQoL post-discharge may be either attributed to factors related to hospitalization or to baseline psychological imbalances. Baseline psychological status and HRQoL in our cohort was not available, but only a few patients in our cohort reported a history of mental illness, suggesting that hospitalization rather than pre-existing psychological distress relates to post-discharge symptomatology. To overcome this issue, we believe that future studies on psychological and HRQoL recovery should strive for a best effort to obtain a pre-exposure evaluation (53).” (Discussion, page 25, lines 439-445)

5. No proper distinction is made between posttraumatic stress SYMPTOMS and posttraumatic stress DISORDER. The IES-r is not able to make a diagnosis. It is therefore common practice to speak of (high levels of) PTSS, or probable PTSD. Furthermore, if you really wanted to examine predictors of PTSD, not PTSS a linear regression is not the correct analysis, after all, one either has PTSD or not.

RESPONSE:

We fully agree with the reviewer, and similar concerns were raised by the academic editor and reviewer 2. We have therefore discarded ‘disorder’ from the manuscript, and used probable PTSD, anxiety, and depression.

6. Relate outcome levels to outcome levels outside pandemic conditions in previous studies. Can we conclude that there is a problem specific to pandemics?

RESPONSE:

We thank the reviewer for this comment but feel that we have addressed these points in the discussion section.

To summarize these points: In the second paragraph (line 384-393), we compare our results with other studies concerning psychological outcomes during the COVID-19 pandemic.; In the third paragraph (line 394-420), we compare our results with the results from other studies investigating the psychological response to hospitalization in several settings, including those during the MERS and SARS outbreaks.

7. Educational level is added to the regression models as a linear variable instead of dummy variables. This is a categorical variable with unequal distances between categories. The resulting coefficient is therefore meaningless.

RESPONSE:

We agree with the reviewer and have revised the following to improve this:

1) We added information about the rationale for the possible predictors in the methods section.

2) We used mixed models instead of linear regression models to identify predictors for psychological distress and HRQoL.

3) We added the results from the univariate analysis of all possible predictors, and the full model, in the supplementary information, including betas and p-values.

With regard to the education level variable: we used a dummy instead, and a beta of each category within the variable is presented in the tables.

8. The description of the measured used in the study is not sufficient. Please add range of scales and reliability statistics within your sample. Also elaborate on operationalization of other variables such as demographics. For instance, how is ethnicity operationalized? If more than two categories are used in the regression (such as native and non-native) see my previous comment as well.

RESPONSE:

We agree with the reviewer that the description of the questionnaires used in this study was limited. We therefore expanded the description of the questionnaires, including the ranges. The reliability of the validated questionnaires used, have been extensively reported previously and we refer to these papers in the method section.

With regard to the demographics, we extracted this information from the electronic patient records and used variable definitions as used for the ISARIC eCRF, as outlined in method section. For table 1, we have used the ethnicity as documented in the electronic patient record, and categorized ethnicity into ‘Caucasian’, ‘Negroid’, ‘Surinamese/Hindustan’, ‘Arab, not specified’, ‘Turkish’, ‘Moroccan’, ‘Other’, and ‘Unknown’. For analyses, we categorized these into ‘Caucasian’ and ‘non-Caucasian’.

9. No distinction is made in the regression analyses between the subgroups. Theoretically it would be interesting to distinguish the COVID and non-COVID patients. Ideally this would be done using a multilevel model to determine the impact of group membership on the influence of predictors, but the samples are probable too small for this.

RESPONSE:

We have revised our analysis and used mixed models. We have added ‘COVID-19’ and ‘ICU Admission’ as predictors, and only added these to the full model if the univariate analysis had a p-value below 0.10. As such, the predictive value, if present, can be extracted from the multivariate mixed models presented in the supporting information.

10. I think the statement on p16 that “Collectively, this suggest that participating patients are grossly representative for the total cohort” is too bold. Your response rate is quite low and examining patient records do not inform you how they would have scored on the outcome measures. A nice idea to ask a small sample of non-responders to respond anyway, but self-selection here is of course also a factor. You could consider comparing outcomes between the full responders (T1 and T2) and those that responded at T1 only.

RESPONSE:

We value the suggested outcomes comparison between full responders and those responded at T1 or T2 only as added analysis to address the non-responders’ issue. The results of that comparison is added as Table S8. In summary, the outcomes of full responders versus responders of one time-point only are similar, both for the one- and three-months’ time-point. Moreover, baseline demographic and treatment-related characteristics of these groups were also largely comparable (see Table S7).

We added the following:

“In addition, both baseline demographics and treatment-related characteristics were similar for full responders and those who responded at one month or three months only (S7 Table). No major differences in psychological outcomes and HRQoL were observed between full responders and single time-point responders (S8 table).” (Results, page 22, lines 373-376).

Notwithstanding, we agree with the reviewer that the sentence remains too bold, and we rewrote the sentence;

“…, and in a sample of non-responders’ psychological distress was roughly similar to responders. Collectively, our cohort appears grossly comparable with the overall population at baseline and for psychological outcomes. Baseline characteristics (demographic and treatment-related factors) were similar for non-responders, responders, and a sample of non-responders willing to respond once. In addition, psychological outcomes and HRQoL were comparable for responders and the sample of non-responders willing to respond, and for responders at both time-points as compared to responders at 1 time-point only.” (Discussion, page 25, lines 454-459).

Minor points:

1. I prefer a table where all primary and secondary outcomes can be seen, instead of a series of boxplots (which seem rather archaic). Having to look up a long list of supplementary tables is not helping your readers understand your work. especially as the tables put in the supplementary section are core study results. Readers are now forced to resort to the long summary of the results in the text, which do not give all information. I propose to put them into the article, and to merge them, and move the box-and-whisker plots to the supplementary section for the fans. This also means shortening the results section as not all results in the table then need to be described in text.

RESPONSE:

We fully agree with the reviewer’s point and have discarded the boxplots, and instead used tables to present our primary and secondary outcomes. We have focused the results section by shortening it, only described relevant outcomes, and referred to the tables for less relevant outcomes.

2. The Venn-diagrams look nice, but also add little. Please put these in the supplementary section as well.

RESPONSE:

We agree and discarded the Venn-diagrams, because in our new analysis and results section, we do not look into the co-presence of probable PTSD, anxiety, and depression.

3. There is no table for your regression analyses, not even in the supplements! Please add these (to the article, not the supplementary section).

RESPONSE:

We have added the tables of the mixed model analysis to identify predictors for both the severity of psychological distress (Table 4) and HRQoL (Table 5) to the manuscript, and added the tables with the results of the mixed models for the prediction of the prevalence of probable PTSD, anxiety, and depression to the supplements (S3. Table).

4. Please check for spelling and grammar errors such as “Predictors off psychological outcomes” on page 12. Or also see comment 10 these suggest/this suggests.

RESPONSE:

We apologize for this untidiness and copy-edited the entire manuscript.

5. When describing outcomes (especially when tables are not included) please add direction of association. E.g.: does having had a job before hospitalization lead to higher or lower psych symptoms?

RESPONSE:

We apologize for this untidiness and agree that this limits the comprehensibility or our results. We therefore added for each predictor whether it increased or reduced the outcome and added the direction by adding the betas.

6. Page 3: “the pandemic peak”. Is no longer applicable as there are 2 peaks at this point in time.

RESPONSE:

We agree and added ‘first’ to the sentence.

7. Provide a benchmark for HRQOL. You state it is low, but what are reference levels for for instance the general population?

RESPONSE:

We agree that this information was missing, and added the following to the results:

“Based on the distribution of age in our cohort, the mean TTO score of the Dutch general population is 0.852 (37). A TTO score below 0.852 is considered poor, and a TTO score above 0.852 good.” (Methods, page 8, lines 145-147)

“Based on these scores, a mental and physical component score (MSC, PCS) can be computed for which the mean in the general population will be 50. A MCS or PCS score below 50 is considered low, and a MCS or PCS score above 50 is considered good (39).” (Methods, page 8, lines 152-154)

Response to Comments raised by Reviewer #3:

Reviewer #3: The study topic “Psychological distress and health-related quality of life in patients after hospitalization during the COVID-19 pandemic: a single-centre, observational study” is relevant and interesting in this era of COVID-19 but is not clearly reported. I thank the authors for this good research, however many things need to be worked on to reach a level of publication

Comments to the authors;

“Psychological distress and health-related quality of life in patients after hospitalization during the COVID-19 pandemic: a single-centre, observational study”

The study topic is relevant and interesting but is not clearly reported.

Introduction

1. The introduction is too shallow. On top of what is written, the methods of psychological distress measurements used in this study need to be briefly described (i.e PTSD, depression, and anxiety measures using the Impact of Event Scale – Revised (IES-R) and the Hospital Anxiety and Depression Scale (HADS)). Briefly discuss as well how to measure health related quality of life using EQ-5D and RAND-36. This brief description should be done in a very concise and understandable manner.

RESPONSE:

Similar comments were raised by the academic editor and the other reviewers.

In short, we have expanded the introduction, and added more background information. We have described the questionnaire used in this study, including the cut-off values and ranges, more thoroughly in the methods section.

In the Introduction, we added the following:

“Symptoms of the infectious disease caused by the SARS-CoV-2 virus, coronavirus disease-19 (COVID-19), vary from mild respiratory and gastro-intestinal symptoms to severe acute respiratory failure, requiring respiratory support in an Intensive Care Unit (ICU) (2-4).“ (Introduction, page 4 lines 64-66)

“; symptoms of depression and anxiety occur in 12-67% of hospitalized patients; symptoms of post-traumatic stress disorder (PTSD) in 19%-45% (8-15). Survivors of ICU treatment are known to be at risk for psychological impairments including symptoms of depression, anxiety and PTSD. These symptoms occur in up to 20%-67% of ICU survivors (16-21). Post-hospitalization psychological impairments negatively impact on the ability to return to work and the health-related quality of life (HRQoL) (13, 17, 18, 20). ” (Introduction, page 4, lines 77-81)

“The risk of psychological impairments is expected to be even higher in patients hospitalized during the COIVD-19 pandemic due to the exceptional circumstances and uncertainties (22, 23).“ (Introduction, page 4, lines 82-83)

In the Methods, we added the following:

“The IES-R is a validated 22-item questionnaire that quantifies the subjective distress a person is experience after a traumatic event (32). The IES-R yields a total score, ranging from 0-88 (higher scores indicating more severe symptoms), and subscale scores can be calculated for symptoms of intrusion, avoidance and hyperarousal.” (Methods, page 7, lines 132-135)

“The HADS is commonly used to determine the levels of anxiety and depression that a person is experiencing (34). The HADS is 14-item scale that generated ordinal data. Seven of the items relate to anxiety and seven relate to depression. The HADS yields a depression and anxiety sum score, ranging from 0 to 21 with higher scores indicating more severe symptoms.” (Methods, page 7, lines 135-138)

“The EQ-5D measures the HRQoL on five dimensions (mobility, self-care, usual activities, pain/discomfort and anxiety/depression), by which the weight of a health state can be computed into an EQ-5D Time Trade Off (TTO) score. This score ranges from – 0.446 (worst quality of life) to 1.000 (best quality of life). Additionally, patients score their current subjective health state on a visual analogue scale (the EQ-VAS), ranging from 0 (worst health imaginable) to 100 (best health imaginable) (36, 37). Based on the distribution of age in our cohort, the mean TTO score of the Dutch general population is 0.852 (37). A TTO score below 0.852 is considered poor, and a TTO score above 0.852 good.” (Methods, page 7, lines 141-147)

“The RAND-36 is a 36-item, self-reported survey of HRQoL, and consists nine scales scores, which are the weighted sums of the questions in their section (38). Each scale is directly transformed to a scale ranging from 0 (worse score) to 100 (best score) on the assumption that each question carries an equal weight. The nine scores are; physical functioning, social functioning, physical role limitations, emotional role limitations, mental health, vitality, pain, general health, and health change. Based on these scores, a mental and physical component score (MSC, PCS) can be computed for which the mean in the general population will be 50. A MCS or PCS score below 50 is considered low, and a MCS or PCS score above 50 is considered good (39). Resumption to work and financial decline due to the hospitalization were was additionally assessed using self-composed questionnaires. Patients were asked for their psychiatric history and could choose whether or not to answer. Baseline characteristics were extracted from electronic patients’ records.” (Methods, page 8, lines 148-157)

2. The problem statement of this study is not clearly stated: i.e “ Data from the previous SARS and MERS epidemics support this concern and more recent studies suggest that up to 50% of COVID-19 patients suffers from psychological distress up to one month after hospital discharge”. Looking at the results of this study (i.e of one of the results; “patients admitted for other illnesses more suffered psychologically than COVID-19” patients) , I was expecting to read a statement contradicting this to support your study results.

RESPONSE:

We agree that more elaboration is needed, and added the following sentence in the introduction section:

“However, it is unknown whether this psychological response is attributed to COVID-19 or hospitalization during a pandemic, and whether the psychological response differs between specific subsets of patients, such as non-COVID-19 and ICU patients.” (Introduction, page 4-5, lines 85-87)

We thereby question whether the high incidence of psychological distress during the previous SARS and MERS epidemics, and the incidence of psychological distress in COVID-19 patients is attributed to COVID-19, or to the pandemic circumstances.

3. The title, the aim of the study and results do not link well. Authors also say “Additionally, we tested the hypothesis that the psychological distress was higher in COVID-19 confirmed patients, and in those treated in ICUs”. Where is this hypothesis? Why the authors talk about an hypothesis which is not stated in the study?

RESPONSE:

We agree that a rationale for this hypothesis was lacking. With the revised introduction, we hope that it has become clearer why we conducted the study. We also described the aim of the study more clearly:

"In this study, we therefore aimed to quantify the psychological distress, i.e., symptoms of PTSD, anxiety, and depression, up to three months post-discharge in patients hospitalized during the first pandemic peak with symptoms suggestive of COVID-19, to determine their HRQoL and work resumption, and to explore predictors for psychological distress and HRQoL. Additionally, we tested the hypothesis that examined whether psychological distress was more prevalent or more severe in COVID-19 confirmed patients, and in those treated in ICUs.” (Introduction, page 5, lines 88-92)

Materials and methods

1. “Study design and setting”; when I read this heading, I expect to get information on study design and setting only. More information given here is about ethical consideration. For “study setting”, one should expect to read more of the description of the location, department, environment, infrastructure, etc… of the study place. The authors can either name this heading “study design and ethical consideration” or modify the content to suite the heading, and shift the content to an ethical heading. NB: Please read more on study setting.

RESPONSE:

We thank the reviewer for this useful comment. Accordingly, we have added additional information on the setting of the study:

“This period coincided with the first COVID-19 peak. During this period, several protective measures were taken in the hospital, such as the prohibition of visiting hospitalized patients and strict isolation of suspected patients until COVID-19 was ruled out.” (Methods, page 6, lines 104-106).

Additionally, we added an ‘Ethics approval”:

“Ethics approval

The study protocol was approved by the Institutional Review board of the Franciscus Gasthuis & Vlietland and deemed not to fall under the Medical Research Involving Human Subjects Act (WMO) (S1. Registered study protocol). The need for written informed consent was waived. Patients in our hospital are actively informed about the use of their anonymous data in research activities and can object against the use their data. No data were used of patients who objected against this use. The study was registered at TrialRegister.nl (registration numbeResponse: NL8882). The reporting of this study follows the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guideline (S2. STROBE Checklist) (31).“ (Methods, page 6, lines 94-101)

2.“participants”; in this section, the inclusion and exclusion criteria are not clear. “the presence of respiratory symptoms (e.g., dyspnoea, coughing, sore throat, rhinorrhoea, saturation 24/minute) and/or gastro-intestinal symptoms (e.g., diarrhoea or vomiting) with a duration ≥24 hours”. The study inclusion and exclusion should be clear. The authors should not give examples of symptoms but should clearly state which symptoms constituted inclusion criteria and which constitute exclusion criteria. I suggest a heading “Inclusion and exclusion criteria” or Eligibility criteria.

RESPONSE:

We agree with the reviewer, and more clearly stated the inclusion- and exclusion criteria in the manuscript. It now reads as follows:

“Eligible patients were aged ≥18 years and hospitalized between March 16 and April 28, 2020, with symptoms suggestive of COVID-19, defined as the presence of respiratory symptoms (dyspnea, coughing, sore throat, rhinorrhoea, saturation <94% or respiratory rate >24/minute) and/or gastro-intestinal symptoms (diarrhea or vomiting) with a duration ≥24 hours, who survived until one month after hospital discharge. Patients who were unable to understand the Dutch language or did neither have a formal home address nor e-mail address were excluded.” (Methods, page 6, lines 111-116)

3. “Procedures”; With this heading two important considerations come up: (1) Data collection tools/instruments; after reading this study, 4 questionnaires and one data collection tool are supposed to be used yet none is described in this section. Please discuss briefly these tools;” (Impact 93 of Event Scale – Revised (IES-R), the Hospital Anxiety and Depression Scale (HADS), EQ-5D, RAND 36 and demographic data collection tool”

RESPONSE:

In accordance with the academic editor’s and the previous reviewers’ comments, we have added a more detailed description of the questionnaires and how we obtained baseline demographics and treatment-related characteristics.

Authors say “Patients who were unable to understand the Dutch language or did neither have a formal home address nor e-mail address were excluded”. The dutch language is another issue on data collection tool used to collect data. It should come clearly what was the language of the questionnaires. “did the authors used a standard questionnaire in Dutch”? If yes, clarify how this was translated. If the original questionnaire was in English, clarify how it was translated in Dutch then back in English for data entry.

RESPONSE:

We agree with the reviewer that this should be stated within the manuscript, and therefore added:

“We used validated Dutch translations of the IES-R, HADS, RAND-36, and EQ-5D.” (Methods, page 8, lines 166-167)

(2) Sampling procedure; it is not clear how the sampling procedure was done. Random sampling? Convenient sampling?.....The author needs to explain how the sampling procedure was done and clarify the sample size as well.

RESPONSE:

As stated in the “Participants” and “Procedures” sections of the Methods section, we invited all patients admitted with symptoms suggestive of COVID-19 to participate in the study and included patients who responded to these questionnaires. As such, convenient sampling was used. We added the following sentence into the method section:

“Convenient sampling was used. All patients admitted between March 16 and April 28, 2020, and who responded to one of the two follow-up assessments were included” (Methods, page 7, lines 125-126)

(3) It is also not clear who collected the data. Were authors collected data themselves? or trained research assistants to collect data.

RESPONSE:

All data was collected by two researched from the study team (Johan H. Vlake and Sanne Wesselius). We added the following to the methods:

“All data was collected by members of the study team (JV and SW).” (Methods, page 8, line 167)

4.”Outcomes”; In this section, it is expected to explain how authors have reached the mentioned outcomes. I.e for EQ-5D questionnaire, the author must clarify which published algorithm used to allow a CROSSWALK to measure utility. “ The questionnaire should score using a published algorithm based on community survey in the country or neighboring country using standard Gamble, Time trade off or visual analogue scale(VAS)”.

RESPONSE:

We agree with the reviewer that the explanation given in the methods section regarding the outcomes measures was limited, and therefore we elaborated the description of how the sum scores, VAS score, TTO score, and summary scores were computed. In addition, we referred to the appropriate literature supporting these methods.

5.”Statistical analysis”; The analysis of this study is well done but poorly reported. i.e firstly, the author reported “ correlations between psychological outcomes and baseline/treatment characteristics were analyzed using a Spearman’s rho”. The authors should report the correlation coefficients. Secondly, the authors said “Possible predictors for psychological outcomes were analyzed using a multivariate linear regression model. Correlations with a p-value below 0.10 were included in a multivariate linear regression model to identify the predictor”. Please review this statement if this is what you wanted to say and rectify.

RESPONSE:

We agree with the reviewer that the statistical analysis was not properly described. We revised our analysis plan and rewrote this section accordingly. We used mixed models instead of general regression models and reported al betas and p-values for the univariate and multivariate mixed models in the supplementary information.

Concordantly, we added the following:

“Differences in outcome measures between stratifications were analyzed using linear or logistic regression models for continuous and categorical outcomes, respectively, adjusting for baseline differences between groups, in which the ‘stratification’ and at baseline differing characteristics served as independent variables.” (Methods, page 9, lines 172-174).

“To identify possible predictors for psychological symptomatology or quality of life, we first conducted a univariate linear or logistic mixed model with possible predictors as independent variables (S1. Table). Variables with a p-value ≤0.10 were added in the multivariate linear or logistic mixed model to determine predictors.” (Methods, page 9, lines 180-182)

Results

1.In the participants section, the results are not clearly explained. It is hard to understand this paragraph; “A total 123 of 282 individuals participated (45%; Fig 1); 252 at one month (40%) and 201 of 365 (55%) at three months post discharge. Non-participating patients either declined participation (n=262) or did not respond (n=79)”. It is also difficult to understand the response rate of the 4 questionnaires distributed twice (at 1 month and 3 months). Please restructure this section by shading more light to this section.

RESPONSE:

We restructured this section to make this more comprehensible:

“From March 16 to April 28, 2020, 623 patients were admitted with symptoms suggestive of COVID-19, of whom 282 patients participated (45%); 252 at one month and 201 at three months post-discharge (Fig 1). The last patient was discharged June 14, 2021, and follow-up lasted until three months after (September 14, 2020). Non-participating patient either declined participation (n=262) or did not respond to the questionnaires or to the reminding phone calls (n=79).“ (Results, page 10, lines 194-198)

In addition, we changed figure 1 to make it more comprehensible.

2. It is also not clear when the data collection was done. Please clarify these i.e; in the Study design section; the authors say “This single-centre, observational cohort study was conducted in the Franciscus Gasthuis & Vlietland hospital in Rotterdam, the Netherlands, from March 16 to September 14, 2020”. And in Participants section; the authors say “Eligible patients were aged ≥18 years and hospitalized between March 16 and April 28, 2020”. And in results section, the authors say as well “From March 16 to April 28, 2020, 623 eligible patients were admitted with symptoms suggestive of COVID-19”.

RESPONSE:

We understand the confusion with how we described this. Patients were included if they were admitted to the hospital between March 16, 2020, and April 28, 2020. Since the follow-up ran to three months after hospital discharge, the entire study period lasted from March 16, 2020, till three months after the hospital discharge of the last included patients, which was on June 14, 2020, and thus follow-up of the last participant ran until September 14, 2020.

To make this more understandable, we added the following sentences:

“The last patient was discharged June 14, 2020, and follow-up lasted until three months after (September 14, 2020).” (Methods, page 7, lines 124-125)

“The last patient was discharged June 14, 2021, and follow-up lasted until three months after (September 14, 2020).” (Results, page 10, lines 195-196)

3. My Suggestion on how the results should be presented in results section

a. Introduce the results section and present demographic characteristics in a table, comment your results from the table

RESPONSE:

We have restructured the results, and start with the inclusion and responses of participants, followed by a section regarding demographics, in which we primarily comment on the results of Table 1, which comprise the baseline demographics and treatment-related characteristics of our cohort.

b. Present psychological distress results in a table or a clear figure, then comment the table or figure in an understandable manner. Show and comment on any P-value

RESPONSE:

We discarded the boxplots, and present our psychological outcomes in tables only. In the results section, we focused on the most relevant data, discarded the less relevant and refer to tables for more extensive data insight.

c. Present the health related quality of life in a table or a figure, comment the results. Show and comments P-values if any

RESPONSE:

We have discarded the boxplots of the HRQoL and replaced them by tables. In the revised text, we focused on commenting on results which we found most relevant and referred to the tables for other study results.

d. Present the predictors of psychological outcomes and quality of life in a table showing the regression results and P-values, correlation coefficients and comment the table.

RESPONSE:

We have added tables regarding the predictors of the severity of psychological outcomes and predictors or HRQoL in table 4 and table 5, including betas and P-values, and only described variables that significantly predicted outcomes. The predictors for the prevalence of probable PTSD, anxiety, and depression are depicted in Table S3 in the supplementary information.

Discussion and references; I cannot comment on discussion and references for now, if results are not presented in an understandable manner

RESPONSE:

We understand that the reviewer could not comment on the discussion at this stage. We have revised the discussion based on the revisions in the introduction, methods, and result section, and invite the reviewer to comment on the discussion section.

Attachment

Submitted filename: Response to the reviewers.docx

Decision Letter 1

Peter G van der Velden

9 May 2021

PONE-D-20-38679R1

Psychological distress and health-related quality of life in patients after hospitalization during the COVID-19 pandemic: a single-center, observational study.

PLOS ONE

Dear Dr. Vlake,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

PONE-D-20-38679R1 review

I have read your revised manuscript with pleasure and noticed that your manuscript improved a lot. You are one important step further. There are several things that must be addressed now before I can make a final decision. You therefore have to address the helpful comments of reviewer 3 (see below) and my specific comments below. As you will see, must comments concern clarifications, corrections and suggestion to omit certain sections. The requested revision is somewhere between a minor and major revision (PLOS ONE does not have that option). My comments are:  

  1. Please update your literature, in intro as well as in discussion, with the very recent study by Taquet et al., 2021 (https://doi.org/10.1016/S2215-0366(21)00084-5)

  2. You examined several predictors of mental health problems and quality of life. In the introduction section explain much more in detail which predictors you want to examine and why you specifically want to examine these predictors. You can use the content of Table S1 for this purpose and omit this tables from the supp. materials. Explain too for which variables you control for when comparing groups in mental health problems and quality of life (medical conditions etc.).

  3. You examined patients from one hospital. Did you control for the possibility that patients can be identified based on the content of the Tables? If yes, add if and how the anonymity was ensured.

  4. Add Cronbach’s alphas for all scales for COVID and non-COVID patients (IES-R, etc.)

  5. Please replace the subheading Outcomes with Measures. Table 1 contains many variables that were not described in the measures section. Add them in the measures section. It may help the reader if you add sub-subheadings to the measures section (Psychological distress, Quality of life, Cause of admission, etc). In the measures section all study variables must be mentioned/explained/clarified. For instance table 2 shows that you assesses several categories psychiatric history (psychologist, etc), but this was not clarified in the text. Check all variables.

  6. Are there no cut-offs available for the HRQoL scales?

  7. Line 155. Table 1 suggest that the ICU-nonICU comparisons were conducted among the COVID patients only (39+105=144). If this is correct, please clarify this better in this line (see also below).

  8. Line 161. Please explain better the dependent variables in your analyses because there are several ways to examine potential predictors. I would like to suggest that you perform a multiple regression analyses with your distress and QOL variables at T2 as dependent variables (instead of the current analyses), and your proposed potential predictors as predictors including the corresponding distress/QOL variable at baseline. In this way you have also solved the problem that some variables were assessed at T2 (containing info over the period between T1 and T2). In addition, it offers the reader more info over the extent your variables predict distress/QOL.

  9. Line 162. What do you mean with logistic mixed model?: mixed effects logistic regression analyses?. What do you mean with “univariate linear”, correlations? (where multivariate linear = multiple regression analyses?)”. Please explain better what type of analyses you used for differences between groups and differences over time, and for predictors.

  10. Line 166. It is unclear what you meant with “Psychological outcomes of randomly selected non-responders were compared with those of responders using a linear or logistic regression model, adjusting for baseline differences between groups, in which the ‘stratification’ and at baseline differing characteristics served as independent variables”. Please clarify this better and especially “randomly selected non-responders”.  You have two type of non-response: those not participating at all (N=341) and those participating at baseline but not at follow-up. Please clarify this better in the text with results of the analyses. Move the non-response section directly above the first results section.

  11. Line 169. “All data were gathered using the International Severe Acute Respiratory and emergency Infection Consortium (ISARIC, Oxford, United Kingdom) and Franciscus Corona Registry in Castor Electronic Data Capture (Castor EDC, Amsterdam, the Netherlands).” I do not see the relationship with statistical analyses and don’t understand what you want to say here (should it be moved to the measures section in which you describe which variables were extracted from both?).

  12. Line 187. The scores and percentages in Table 1 seem an selection of Table S2. It was not clear to me how this selection was motivated. I expect that you help the reader by explaining this selection (something like “…..In table 1 the main characteristic of the study samples is presented and for a full overview of the characteristic we refer to S2 table”.

  13. Line 190. Median scores were not introduced in the stat. analyses section. The relevance of the median scores in Table 2 and 3 was totally unclear to me. What is the relevance? I would like to suggest that you conduct mixed models / ANCOVA to examine differences in sum scores of the used scales (with M and SD in tables).

  14. Line 221. You have good reasons to refer to supp. materials because no significant associations were found. However you can inform the reader about this (similar at other places) in a more gentle way (for instance:  “”Analyses showed that none of the assessed predictors were significantly associated with probable PTSD, probable anxiety, and probable  depression (for the results we therefore refer to ……)”.

  15. Line 221. “natural decline” what do you mean with natural? It is a decline, and we do not know from your data that it is natural.

  16. Table 1. Please insert zero’s (N and %) instead of blanks because blanks may suggest that a variable was not assessed among a subgroup.

  17. Table 2. The total numbers at T1 and T2 in this table do not match figure 1. Check or explain differences (or add info in figure).

  18. In table 1 the ICU and nonICU numbers at baseline are 39 and 105. However in Table 2 at base line they are 32 and 216 (!). This is very confusing. Please correct and revise. (In Table 3 numbers are missing).

  19. For the analyses of the differences between the subgroups, you controlled for differences at baseline. Please clarify how many control variables were entered in each analyses (present also event-per-variable ratio) so readers can see that your analyses are justified (EVP higher than 10 as a rule of thumb).

  20. Line 246. Work resumption. Again, this topic was hardly introduced in the intro (what dod we know from the literature about work resumption after  hospitalization). Perhaps it is an idea to omit this topic from your manuscript.

  21. Table 4. This table suggest that IES-R and HADS scores at T1 were not predictive. Is this correct? (this is a very remarkable outcome).

  22. Discussion. To help the reader please use more subheadings in your discussion section.

  23. Line 268. See comment 1. I believe some rewriting is needed because of this study by Taquet et al. 2021.

  24. Line 285. Ref. 41 is about life time prevalence (and retrospective!) and should not be used in this way.  The prevalence do not seem very high compared to victims of f.i. accidents, medical errors, and (sexual) violence (see van der velden et al. 2020. https://doi.org/10.1371/journal.pone.0232477)

  25. Line 331. “Baseline psychological status and HRQoL in our cohort was not available”. You mean before infection/hospitalization? (you used the word baseline to describe T1).

  26. Line 350-353. Should “Physicians should be aware of the psychological consequences of hospitalization during a pandemic but not only in those affected by COVID-19 or requiring ICU treatment” be “However, Physicians should be aware of the psychological consequences of hospitalization during a pandemic but not only in those affected by COVID-19 or requiring ICU treatment”.

  27. Upload all supplementary materials as separate files.

Please submit your revised manuscript by Jun 23 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Peter G. van der Velden, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: (No Response)

Reviewer #3: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #3: No

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: The authors have sufficiently addressed my previous concerns.

Congratulations on the interesting paper.

Reviewer #3: Second review: Psychological distress and health-related quality of life in patients after hospitalization during the COVID-19 pandemic: a single-center, observational study

I want to thank the authors for the good job done, especially on methodology. There is a significant improvement on the quality of the manuscript. However, some work need to be done to allow the paper to be published

Introduction

1. This section was reviewed partially. “This paper’s aim is to quantify psychological distress and to determine their HRQoL”. The introduction needs a section to briefly discuss few different methods to assess mental health and HRQoL. This section will help non expert readers to understand and also give a good flavor to the reader

Methodology

Authors have made significant progress in term of reporting methodology. However, data analysis part is not well reported;

it is not clear in the analysis which method used at each level, for example;

2. Line 172; “Differences in outcome measures between stratifications were analyzed using linear or logistic regression”. Clarify where you used linear and where you used logistic regression and clarify the logistic model used (i.e function or Equation). For logistic regression (binary outcomes), I was expecting to read the results with Odds ratios and confidence intervals. Please explain this!

3. Line 185-186 “Psychological outcomes of randomly selected non-responders were compared with those of responders using a linear or logistic regression model”. It is not clear where applied linear regression, where applied multiple and where applied logistic regression. Please clarify these by showing which statistical model used (i.e function or equation).

4. Please discuss with your analyst if there is a possibility of using “ Time to event outcomes regression” (cox proportional hazards model) and calculate hazard ratios for ICU versus non-ICU and COVID-19 versus non COVID-19 in the development or reduction of psychological distress from the time of discharge to one month time follow up!

Health related quality of life;

5. Clarify how you calculated utility scores and health states, then how did you do the crosswalk for the health states?

6. Explain how you calculated the mean utility scores

7. Explain how you estimated QALYS lost due to psychological distress

Results

All relevant or significant results (i. e significant P-values) in the tables in this section must be briefly commented below each table.

8. For example, “Table1: Baseline demographics and treatment-related characteristics of study population”. Where are comments of this table?

9. Table2 “Psychological outcomes throughout follow-up” is confusing because it is not commented. I don’t see the relevance of this table. And if am not wrong, no significant results are reported in this table. And then, the bottom of this table reads logistic regression. With logistic regression results, one would expect to be reported Odds ratios (ORs) and confidence intervals. I suggest you remove this table because the results are confusing and are not explained therefore it does not add value unless if it is clearly commented.

10. Table3, 4 and 5 are relevant but are not commented. Please comment important or significant results in these tables

Discussion

I am still not able to comment on discussion; results need to be worked on before reviewing the discussion part.

11. Intext citations and references don’t follow PLOS ONE guidelines. Please check on PLOS ONE referencing guidelines

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: Yes: Mark Bosmans

Reviewer #3: Yes: Desire Aime Nshimirimana

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PONE-D-20-38679R1.docx

PLoS One. 2021 Aug 11;16(8):e0255774. doi: 10.1371/journal.pone.0255774.r004

Author response to Decision Letter 1


22 Jun 2021

Response to the handling editor:

Dear Dr. Vlake,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

I have read your revised manuscript with pleasure and noticed that your manuscript improved a lot. You are one important step further. There are several things that must be addressed now before I can make a final decision. You therefore have to address the helpful comments of reviewer 3 (see below) and my specific comments below. As you will see, must comments concern clarifications, corrections and suggestion to omit certain sections. The requested revision is somewhere between a minor and major revision (PLOS ONE does not have that option).

Response:

Dear Peter van der Velden,

We really appreciate that you are currently handling our manuscript and that you have given us the opportunity to thoroughly revise our manuscript.

The suggestions, concerns, and comments raised by you and reviewer 3 did further improve our manuscript and we have made point-by-point responses to your and the reviewer’s comments below.

For the referral to certain pages or lines within the manuscript; all referrals are based on the submitted marked-up manuscript, in which the changes made during the revision are highlighted.

My comments are:

1. Please update your literature, in intro as well as in discussion, with the very recent study by Taquet et al., 2021 (https://doi.org/10.1016/S2215-0366(21)00084-5)

RESPONSE:

We agree with the editor that an update of published articles is in place for both the introduction and discussion sections. We therefore updated the introduction and discussion, as suggested by the editor.

We added the following text into the introduction and discussion section:

“The uncertainties and measures surrounding the pandemic raised concerns of increased psychological distress in non-hospitalized citizens (20). Since measures taken in hospital were more drastic, concerns of the mental well-being of hospitalized patients were even higher (21, 22). Data from the previous SARS and MERS epidemics support this concern and early studies suggest that up to 50% of COVID-19 patients suffer from psychological distress up to two months after hospital discharge (23-28). More recently, Taquet et al. estimated that the risk for psychiatric sequelae is higher in COVID-19 patients and in those admitted to ICU using electronic health records data. Complementary observational studies are needed to add direction as to whether these risks may be attributed to COVID-19 or hospitalization during a pandemic, and corroborate on the different risks between specific subsets of patients, such as non-COVID-19 and ICU patients (29).” (Introduction, page 3, lines 63-71)

“In a recent large retrospective study, COVID-19 was indeed associated with a higher risk of psychiatric outcomes as compared to influenza and respiratory tract infections (29). In our cohort however, psychological distress was largely similar between non-COVID-19 patients with respiratory symptoms and COVID-19 patients, and we did not observe COVID-19 positivity to be a predictor for severity of PTSD, anxiety, or depression. As such, our data collectively suggest that COVID-19 on its own has no major influence on psychological outcome. The contradictory findings of the Taquet and our study will largely be explained by the difference in study design (retrospective cohort vs. prospective observational cohort), the different outcome measures used (ICD-based diagnoses vs. questionnaire-based outcome) and comparing the covid-19 cohort with other control populations (influenza and respiratory tract infection vs. patient with symptoms suggestive of COVID-19 but COVID-19 PCR negatives).“ (Discussion, page 25, lines 369-378)

2. You examined several predictors of mental health problems and quality of life. In the introduction section explain much more in detail which predictors you want to examine and why you specifically want to examine these predictors. You can use the content of Table S1 for this purpose and omit this tables from the supp. materials. Explain too for which variables you control for when comparing groups in mental health problems and quality of life (medical conditions etc.).

RESPONSE:

We agree with the editor, and added the following to the introduction concerning the predictors examined:

“Illnesses requiring hospitalization, particularly those requiring intensive care unit (ICU) treatment, are known to negatively impact post-discharge psychological well-being; symptoms of depression and anxiety occur in up to 67% of hospitalized patients and symptoms of post-traumatic stress disorder (PTSD) in up to 45% (2-15). This post-hospitalization psychological distress negatively impacts the health-related quality of life (HRQoL) (7, 11, 12, 14). Both demographic characteristics, such as female gender, lower educational level, unemployment and non-western ethnicity, and treatment-related characteristics, such as duration of admission and severity of the disease, are known to be negatively associated with psychological well-being of patients (2, 8, 16-19).

The uncertainties and measures surrounding the pandemic raised concerns of increased psychological distress in non-hospitalized citizens (20). Since measures taken in hospital were more drastic, concerns of the mental well-being of hospitalized patients were even higher (21, 22). Data from the previous SARS and MERS epidemics support this concern and early studies suggest that up to 50% of COVID-19 patients suffer from psychological distress up to two months after hospital discharge (23-28). More recently, Taquet et al. estimated that the risk for psychiatric sequelae is higher in COVID-19 patients and in those admitted to ICU using electronic health records data. Complementary observational studies are needed to add direction as to whether these risks may be attributed to COVID-19 or hospitalization during a pandemic, and corroborate on the different risks between specific subsets of patients, such as non-COVID-19 and ICU patients (29).” (Introduction, page 3, lines 56-71)

We however believe that Table S1 has added value for the reader who is interested in an overview of the literature supporting our choice of predictors, and we therefore would like to suggest to keep Table S1 as part of the Supplements.

With regard to the controlling variables in the comparison between COVID-19 and non-COVID-19 patients, and the comparison between COVID-19 ICU and COVID-19 non-ICU patients; firstly, we better described this in the Statistical analysis section of the methods:

“Differences in outcome measures between stratifications were analyzed using simple linear or logistic regression models, to adjust for at baseline differing characteristics, for continuous and categorical outcomes, respectively. We therefore first performed a simple univariate linear (for continuous outcomes) or logistic (for categorical outcomes) regression analyses, in which all at baseline differing characteristics were analyzed one-by-one. Variables that were associated with the outcome, i.e., a p-value ≤0.10, were added as independent variables to the simple multivariate regression models and were as such adjusted for.“ (Methods, Statistical analysis, page 9, lines 195-200)

Additionally, we described for which variables we adjusted in the legends of the Tables.

3. You examined patients from one hospital. Did you control for the possibility that patients can be identified based on the content of the Tables? If yes, add if and how the anonymity was ensured.

RESPONSE:

We understand the concerns of the editor. We have re-checked whether the content of our tables could lead to the identification of individual patients in our study and omitted categorical variables from the supplementary dataset that were only present in one patients of a stratifications and could as such lead to the identification of an individual patient. These included ethnicity, psychiatric history outcomes, treatment code before discharge, and presence of several comorbidities.

For other tables; we only present the median values or regression outcomes of the entire population and stratifications. In none of the stratifications, nor in the entire cohort, probable PTSD, anxiety, or depression was reported by only 1 patient. As such, patients cannot be identified based on these tables.

4. Add Cronbach’s alphas for all scales for COVID and non-COVID patients (IES-R, etc.)

RESPONSE:

We agree, and added the following for the Statistical analysis section of the methods:

“The internal reliability of all questionnaires used (IES-R, HADS, EQ-5D and RAND-36) were analyzed using Cronbach’s alpha and all showed a high internal reliability (Table S2).” (Methods, Statistical analysis, page 9, line 190-191)

Additionally, we added a table depicting the Cronbach’s alphas to the supplements:

5. Please replace the subheading Outcomes with Measures. Table 1 contains many variables that were not described in the measures section. Add them in the measures section. It may help the reader if you add sub-subheadings to the measures section (Psychological distress, Quality of life, Cause of admission, etc). In the measures section all study variables must be mentioned/explained/clarified. For instance table 2 shows that you assesses several categories psychiatric history (psychologist, etc), but this was not clarified in the text. Check all variables.

RESPONSE:

We apologize for the untidiness. We have now described all outcomes that were collected during the study, replaced the subheading Outcomes with Measures, and added subheadings to the section.

The section now reads:

“Measures

All data were gathered using the International Severe Acute Respiratory and emergency Infection Consortium (ISARIC, Oxford, United Kingdom) and Franciscus Corona Registry in Castor Electronic Data Capture (Castor EDC, Amsterdam, the Netherlands). The ISARIC database in an international initiative to collect baseline demographics and treatment-related characteristics of all patients admitted to the hospital with respiratory symptoms during the SARS-CoV-2 pandemic. The Franciscus Corona Registry is a local addition to the ISARIC database, in which variables that were not collected in the ISARIC database, but were required for the current trial, were collected. All data was collected by members of the study team (JV and SW).

Baseline demographics and treatment-related characteristics

The following baseline demographics were retrieved from electronic healthcare records: age (years), ethnicity (Caucasian, black, Surinamese/Hindustan, Arab (not specified), Turkish, Moroccan, others, or unknown), sex at birth (male or female), body mass index (kg / m2), comorbidities (yes/no: hypertension, chronic cardiac disease, chronic pulmonary disease, asthma, tuberculosis, chronic kidney disease, mild liver disease, moderate liver disease, chronic neurological disease, dementia, chronic hematologic disease, diabetes type I or II, rheumatologic disorder, malignant neoplasm; total number of comorbidities), smoking status (yes, never smoked, former smoker, unknown). Patients were asked about their educational level (i.e., elementary school, high school, intermediate vocational education, higher professional education, university education) and employment characteristics (employed before hospitalization yes/no, weekly work hours before admission, weekly work hours after discharge, healthcare worker yes/no). Additionally, we asked patients about their mental history, i.e., whether they had encountered psychological impairments in the past 5 years and whether they were treated for these impairments by a psychologist, psychiatrist or had received medication. Patients were free to decide whether or not to answer the questions regarding their mental history.

The following treatment-related characteristics were retrieved from electronic healthcare records: cause of admission, treatment restrictions at the day of hospital admission, last registered treatment restriction before discharge, hospital length of stay, ICU admission (yes/no, length of stay), SOFA score at admission, P/F ratio at admission, S/F ratio at admission, oxygen therapy (yes/no, duration), non-invasive ventilation (yes/no, duration), invasive ventilation (yes/no, duration), prone positioning (yes/no, duration), tracheostomy (yes/no) and survival during follow-up.

Primary outcome: Psychological distress

The primary outcome was the prevalence and severity of probable PTSD, depression, and anxiety, assessed using validated Dutch translations of the Impact of Event Scale – Revised (IES-R) and the Hospital Anxiety and Depression Scale (HADS) at one and three months post-discharge.

The IES-R is a 22-item questionnaire that quantifies the subjective distress a person is experience after a traumatic event (31). The IES-R yields a sum score, ranging from 0-88 (higher scores indicating more severe symptoms), and subscale scores can be calculated for symptoms of intrusion, avoidance, and hyperarousal. The IES-R sum score was considered as the severity of PTSD, and an IES-R sum score above 24 was defined as probable PTSD (32).

The HADS is commonly used to determine the levels of anxiety and depression that a person is experiencing (33). The HADS is a 14-item scale that generates ordinal data. Seven of the items relate to anxiety and seven relate to depression. The HADS yields a depression and anxiety sum score, ranging from 0 to 21, with higher scores indicating more severe symptoms. The HADS anxiety and depression score will be considered as the severity of anxiety- and depression-related symptoms, respectively. A HADS depression or anxiety score above 8 was defined as probable depression or probable anxiety, respectively (33, 34).

Secondary outcome: Health-related quality of life

The secondary outcome was HRQoL. HRQoL was assessed using validated Dutch translations of the EuroQoL 5-dimensions-5-levels (EQ-5D) and the RAND-36 questionnaires at one and three months post-discharge.

The EQ-5D measures the HRQoL on five dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression), by which the weight of a health state can be computed into an EQ-5D Time Trade Off (TTO) score. This score ranges from – 0.446 (worst quality of life) to 1.000 (best quality of life) and will be considered as the overall HRQoL. Additionally, patients score their current subjective perceived health state on a visual analogue scale (EQ-5D VAS), ranging from 0 (worst health imaginable) to 100 (best health imaginable) (35, 36). Based on the distribution of age in our cohort, the mean TTO score of the Dutch general population is 0.852 (36). A TTO score below 0.852 is considered poor, and a TTO score above 0.852 good.

The RAND-36 is a 36-item, self-reported survey of HRQoL, and consists nine scales scores, which are the weighted sums of the questions in their section (37). Each scale is directly transformed to a scale ranging from 0 (worse score) to 100 (best score) on the assumption that each question carries an equal weight. The nine scores are: physical functioning, social functioning, physical role limitations, emotional role limitations, mental health, vitality, pain, general health, and health change. Based on these scores, a mental and physical component score (MSC-36, PCS-36) can be computed for which the mean in the general population will be 50 with a standard deviation (SD) of 10. The MCS-36 score will be considered as the mental HRQoL and the PCS-36 will be considered as the physical HRQoL. A MCS-36 or PCS-36 score below 50 is considered low, and a MCS or PCS score above 50 is considered good (38).

Exploratory outcomes

We additionally explored predictors for the severity and prevalence of psychological distress and the HRQoL. These predictors were chosen based on previous literature, and included: age, gender, ethnicity, educational level, duration of admission, ICU admission, COVID-19 diagnosis and work before admission, and severity of disease in terms of SOFA score at the first day of COVID-19 suspicion (day of enrolment) (2, 8, 16-19). Literature supporting these predictors is depicted in Table S1 in the Supporting Information.” (Methods, Measures, page 6-8, lines 109-176)

6. Are there no cut-offs available for the HRQoL scales?

RESPONSE:

The editor is right that there are no cut-offs available for the HRQoL scales. As the EQ-5D and RAND-36 are used to quantify HRQoL, rather than measure the presence of a disease, there are no pre-specified cut-off values available. Therefore, we used the mean values of the MCS-36, PCS-36, and RAND-36 subscales of the general Dutch population, retrieved from validation studies, as reference.

7. Line 155. Table 1 suggest that the ICU-nonICU comparisons were conducted among the COVID patients only (39+105=144). If this is correct, please clarify this better in this line (see also below).

RESPONSE:

The editor is right that we compared outcomes of COVID ICU and COVID-19 ICU survivors. To explain: only 2 patients were admitted to the ICU with another cause than COVID-19. As such, we decided to analyze differences between ICU and non-ICU patients only within the COVID-19 cohort.

To clarify this matter, we described this in the first rows of Table 1.

8. Line 161. Please explain better the dependent variables in your analyses because there are several ways to examine potential predictors. I would like to suggest that you perform a multiple regression analyses with your distress and QOL variables at T2 as dependent variables (instead of the current analyses), and your proposed potential predictors as predictors including the corresponding distress/QOL variable at baseline. In this way you have also solved the problem that some variables were assessed at T2 (containing info over the period between T1 and T2). In addition, it offers the reader more info over the extent your variables predict distress/QOL.

RESPONSE:

We thank the editor for this comment, and in hindsight understand that we did not explain thoroughly enough how we conducted our analysis.

First, we want to stress that the T1 measurement was not a baseline measurement, but the first follow-up assessment at one month post-hospital discharge. As such, using the psychological distress and QoL outcomes at T1 as independent variables in our regression models will firstly disable us to draw any conclusions about the course of psychological distress, i.e., whether psychological distress improved or worsened during follow-up, and secondly will possibly disable us to find relevant risk factors, as these are expected to be correlated to the outcomes at T1 and therefore are likely to lose significance in the model.

Also, with regard to the concerns about the missing data; in our analysis, we used mixed effects linear regression models. These account for both inter-group differences, such as the stratifications and at baseline differing variables between stratifications, and intra-group differences, such as time after discharge. Using mixed effects linear regression models, slopes are computed for each individual patient, and the coefficient computed takes into account all of these slopes, and all data provided. As such, the model uses all data available instead of only participants who filled out both follow-up assessments, and thereby adjusts for missing values. Hence, we believe that the current analysis is more robust than the suggested analysis of the editor.

To clarify, we added the following to the Statistical analysis section of the Methods:

“To identify possible predictors for the severity and prevalence of psychological distress and the overall, mental, and physical HRQoL, we first conducted univariate mixed effects regression analysis: a linear model for continuous outcomes and a logistic model for categorical outcomes. We used mixed effects regression models to adjust for intergroup (i.e., time) and intragroup differences (i.e., cohort and variables of interest). In these, the possible predictive variable served as independent variable one-by-one and the outcome of interest at both follow-up time points served as dependent variables. Secondly, all variables which showed a p-value ≤0.10 in the univariate mixed effects regression model were added to the multivariate mixed effects regression model to determine which variables significantly predicted the outcome. We report the coefficient [95% CI], which implies the estimated mean difference, for linear models, and odds ratios (ORs), including its 95% CI, for logistic models.” (Methods, Statistical Analysis, page 9-10, lines 201-209)

9. Line 162. What do you mean with logistic mixed model?: mixed effects logistic regression analyses?. What do you mean with “univariate linear”, correlations? (where multivariate linear = multiple regression analyses?)”. Please explain better what type of analyses you used for differences between groups and differences over time, and for predictors.

RESPONSE:

We apologize for the unclarity, and partially answered these questions in your previous comment. In the univariate mixed effect linear/logistic regression model, we assessed whether any association was observed between the possible predictor and the outcome of interest. Thereafter, all variables that showed a high correlation, i.e., a p-value ≤0.10, were added to the multivariate mixed effects regression model. Variables that showed a significant contribution to the multivariate mixed effects regression model were considered as independent predictors.

10. Line 166. It is unclear what you meant with “Psychological outcomes of randomly selected non-responders were compared with those of responders using a linear or logistic regression model, adjusting for baseline differences between groups, in which the ‘stratification’ and at baseline differing characteristics served as independent variables”. Please clarify this better and especially “randomly selected non-responders”. You have two type of non-response: those not participating at all (N=341) and those participating at baseline but not at follow-up. Please clarify this better in the text with results of the analyses. Move the non-response section directly above the first results section.

RESPONSE:

We thank the editor for this comment, as we realize we did not explain clearly enough how we assessed the non-responders bias.

To clarify, to analyze non-responders bias, we asked non-responders, i.e., patients who had expressed a wish not to take part of this study or who had not returned any of the questionnaire, to fill out a single set of questionnaires approximately 1 month after the last questionnaire was sent. A total of 12 non-responders agreed, and the outcomes of these 12 non-responders were compared with the outcomes of ‘true’ responders to determine whether there were (substantial) differences in outcomes.

We agree that we did not formulate with clear enough, and changed this accordingly:

“We randomly approached non-responders (who did not respond at both time-points) four months after hospital discharge, i.e., one month after sending the last questionnaire, and asked them to fill out a single set of questionnaires to analyze non-responder’s bias.” (Methods, Procedures, page 6, lines 106-108)

“Baseline characteristics of all non-responders were compared with those of responders using a Mann-Whitney U test for continuous variables and using a Fisher’s exact test for categorical variables. Psychological outcomes of randomly selected non-responders (who did not respond at both time-points) were compared with those of responders, and psychological outcomes of full responders were compared with those of partial responders (i.e., patients who only responded at one or three months), using simple linear or logistic regression models for continuous and categorical variables, respectively. In these, we adjusted for variables that were expected to confound the outcome and differed at baseline between stratifications as described above.” (Statistical analysis, methods, page 10, lines 210-216)

Additionally, we moved the ‘Non-responder’s analysis’ section to the beginning of the result section.

11. Line 169. “All data were gathered using the International Severe Acute Respiratory and emergency Infection Consortium (ISARIC, Oxford, United Kingdom) and Franciscus Corona Registry in Castor Electronic Data Capture (Castor EDC, Amsterdam, the Netherlands).” I do not see the relationship with statistical analyses and don’t understand what you want to say here (should it be moved to the measures section in which you describe which variables were extracted from both?).

RESPONSE:

We agree and changed accordingly, and moved this to the measures section:

“All data were gathered using the International Severe Acute Respiratory and emergency Infection Consortium (ISARIC, Oxford, United Kingdom) and Franciscus Corona Registry in Castor Electronic Data Capture (Castor EDC, Amsterdam, the Netherlands). The ISARIC database in an international initiative to collect baseline demographics and treatment-related characteristics of all patients admitted to the hospital with respiratory symptoms during the SARS-CoV-2 pandemic. The Franciscus Corona Registry is a local addition to the ISARIC database, in which variables that were not collected in the ISARIC database, but were required for the current trial, were collected.” (Methods, Measures, page 6, lines 110-115)

12. Line 187. The scores and percentages in Table 1 seem an selection of Table S2. It was not clear to me how this selection was motivated. I expect that you help the reader by explaining this selection (something like “…..In table 1 the main characteristic of the study samples is presented and for a full overview of the characteristic we refer to S2 table”.

RESPONSE:

The editor is right that Table 1 is a selection of Table S2, and changed accordingly:

“Table 1 depicts the most relevant baseline demographics and treatment-related characteristics; a full overview of all collected demographics and characteristics can be found in Table S8.“ (Results, Participants, page 11, line 238-239)

13. Line 190. Median scores were not introduced in the stat. analyses section. The relevance of the median scores in Table 2 and 3 was totally unclear to me. What is the relevance? I would like to suggest that you conduct mixed models / ANCOVA to examine differences in sum scores of the used scales (with M and SD in tables).

RESPONSE:

We apologize for this untidiness, and now described in the Statistical analysis section how variables will be presented:

“Continuous variables are presented as mean, including its standard deviation (SD), if normally distributed, and as median, including its 95% range, if not normally distributed. Categorical variables are presented as absolute and relative frequency.” (Methods, Statistical analysis, page 9, lines 178-180)

With regard to Table 2 and 3; we regret that the relevance of these tables was unclear, and a similar comment was raised by reviewer 3. Table 2 and 3 depicts our primary and secondary outcome measures; Table 2 represents the severity and prevalence of psychological distress, as measured at both follow-up moments. The P-values provided regarding the comparison between stratifications are calculated using simple linear and logistic regression models, which is largely comparable with an ANCOVA, to adjust for at baseline differing variables. The P-values regarding the change over time were calculated using mixed effects linear and logistic regression models. To clarify, we added the coefficients of the regression models to the Tables.

As the outcome variables presented in these tables were not normally distributed, we report medians rather than means. We can however still use regression models as long as the residuals of the model are normally distributed, and no other assumptions are violated.

To clarify this, we revised the legend of Table 2:

“Descriptive statistics of the psychological distress outcomes, stratified by COVID-19 diagnosis and ICU admission. Severity of PTSD, anxiety, and depression were expressed as the IES-R, HADS anxiety, and HADS depression sum scores, respectively. Prevalence of probable PTSD, anxiety, and depression was defined as the proportion of patients scoring above the cut-off. Abbreviations: CI, confidence interval; COVID-19, coronavirus disease 2019; ICU, intensive care unit; OR, odds ratio; PTSD, post-traumatic stress disorder. Differences over time were calculated using mixed effects linear (for continuous outcomes) and logistic (for categorical outcomes) regression models, with time as independent variable. Differences between stratifications were analyzed using simple linear (for continuous outcomes) and logistic (for categorical outcomes) regression models.“ (Results, Table 2, page 16, line 272)

And changed the legend of Table 3 accordingly:

“Descriptive statistics of the HRQoL outcomes, stratified by COVID-19 diagnosis and ICU admission. Differences over time were calculated using mixed effects linear (for continuous outcomes) and logistic (for categorical outcomes) regression models, with time as independent variable. Abbreviations: CI, confidence interval; COVID-19, coronavirus disease 2019; EQ-5D, European quality of life 5 dimensions questionnaire; HRQoL, health-related quality of life; ICU, intensive care unit; MCS-36, mental component score of the RAND-36; OR, odds ratio; PCS-36, physical component score of the RAND-36; TTO, time trade-off; VAS, visual analogue scale. Differences between stratifications were analyzed using simple linear (for continuous outcomes) and logistic (for categorical outcomes) regression models.” (Results, Table 3, page 18, line 299)

14. Line 221. You have good reasons to refer to supp. materials because no significant associations were found. However you can inform the reader about this (similar at other places) in a more gentle way (for instance: “”Analyses showed that none of the assessed predictors were significantly associated with probable PTSD, probable anxiety, and probable depression (for the results we therefore refer to ……)”.

RESPONSE: We agree and changed accordingly:

“Table 4 and S9 depict the results of the exploration of predictors for the severity and prevalence of probable PTSD, anxiety and depression. ” (Results, Predictors of psychological outcomes and quality of life, page 17, line 292-293)

“None of the predictors were significantly associated with the prevalence of probable PTSD (Table S9).” (Results, Predictors of psychological outcomes and quality of life, page 17, lines 297-298)

“None of the predictors were significantly associated with the prevalence of probable anxiety (Table S9).” (Results, Predictors of psychological outcomes and quality of life, page 19, line 304-305)

“None of the predictors were significantly associated with the prevalence of probable depression (Table S9).“ (Results, Predictors of psychological outcomes and quality of life, page 19, lines 311-312)

15. Line 221. “natural decline” what do you mean with natural? It is a decline, and we do not know from your data that it is natural.

RESPONSE:

We agree and omitted natural throughout the manuscript.

16. Table 1. Please insert zero’s (N and %) instead of blanks because blanks may suggest that a variable was not assessed among a subgroup.

RESPONSE:

We changed Table 1 accordingly.

17. Table 2. The total numbers at T1 and T2 in this table do not match figure 1. Check or explain differences (or add info in figure).

RESPONSE:

We apologize for the untidiness and checked all numbers. The numbers now all match with those in Figure 1.

18. In table 1 the ICU and nonICU numbers at baseline are 39 and 105. However in Table 2 at base line they are 32 and 216 (!). This is very confusing. Please correct and revise. (In Table 3 numbers are missing).

RESPONSE:

We apologize for the untidiness and corrected the number.

19. For the analyses of the differences between the subgroups, you controlled for differences at baseline. Please clarify how many control variables were entered in each analyses (present also event-per-variable ratio) so readers can see that your analyses are justified (EVP higher than 10 as a rule of thumb).

RESPONSE:

We understand the concerns of the reviewer. In hindsight, we realize that we have indeed adjusted for too many characteristics. We therefore now first analyzed the association between at baseline differing characteristics using simple univariate linear (for continuous outcomes) or logistic (for categorical outcomes) regression models. In these, the outcome variable served as dependent variable, and the at baseline differing characteristics one-by-one as independent variables. All at baseline differing characteristics which showed a high association, i.e., a p-value ≤0.10, were used in simple multivariate linear (for continuous outcomes) or logistic (for categorical outcomes) regression models, to compare outcomes between stratifications, while adjusting for at baseline differing characteristics which could confound the outcome.

Using this method, the number of variables for which was controlled did not violate the event-per-variable ratio.

We described this in the statistical analysis section of the methods:

“Differences in outcome measures between stratifications were analyzed using simple linear or logistic regression models, to adjust for at baseline differing characteristics, for continuous and categorical outcomes, respectively. We therefore first performed a simple univariate linear (for continuous outcomes) or logistic (for categorical outcomes) regression analyses, in which all at baseline differing characteristics were analyzed one-by-one. Variables that were associated with the outcome, i.e., a p-value ≤0.10, were added as independent variables to the simple multivariate regression models and were as such adjusted for.” (Methods, statistical analysis, page 9, lines 195-200)

20. Line 246. Work resumption. Again, this topic was hardly introduced in the intro (what dod we know from the literature about work resumption after hospitalization). Perhaps it is an idea to omit this topic from your manuscript.

RESPONSE:

We agree with the editor and omitted this topic from the manuscript.

21. Table 4. This table suggest that IES-R and HADS scores at T1 were not predictive. Is this correct? (this is a very remarkable outcome).

RESPONSE:

The outcomes of the IES-R and HADS, both at 1 month (T1) and 3 months (T2) were both added as dependent variables, we therefore added time as independent variable. Table 4 depicts the outcomes of the mixed-effects linear regression model, in which the IES-R sum score, HADS anxiety score, and HADS depression score at both follow-up time-points served as dependent variables (using a longfile), while time and at baseline differing variables (see our answer to your previous comment) served as independent variables. As such, no conclusions can be drawn about a possible predictive nature of psychological outcomes at T1 from Table 4, as we did not examine this.

22. Discussion. To help the reader please use more subheadings in your discussion section.

RESPONSE:

We agree with the editor and added the subheadings “Limitations” and “Conclusions” to our discussion section.

Although we fully agree with the editor that subheadings in a discussion may be of help to guide the reader through the discussion, in this discussion we feel that adding additional subheadings feels rather artificial and rather distracts than helps the reader.

23. Line 268. See comment 1. I believe some rewriting is needed because of this study by Taquet et al. 2021.

RESPONSE:

We agree and added the following:

“In a recent large retrospective study, COVID-19 was indeed associated with a higher risk of psychiatric outcomes as compared to influenza and respiratory tract infections (29). In our cohort however, psychological distress was largely similar between non-COVID-19 patients with respiratory symptoms and COVID-19 patients, and we did not observe COVID-19 positivity to be a predictor for severity of PTSD, anxiety, or depression. As such, our data collectively suggest that COVID-19 on its own has no major influence on psychological outcome. The contradictory findings of the Taquet and our study will largely be explained by the difference in study design (retrospective cohort vs. prospective observational cohort), the different outcome measures used (ICD-based diagnoses vs. questionnaire-based outcome) and comparing the covid-19 cohort with other control populations (influenza and respiratory tract infection vs. patient with symptoms suggestive of COVID-19 but COVID-19 PCR negatives).” (Discussion, page 25, lines 369-378)

24. Line 285. Ref. 41 is about life time prevalence (and retrospective!) and should not be used in this way. The prevalence do not seem very high compared to victims of f.i. accidents, medical errors, and (sexual) violence (see van der velden et al. 2020. https://doi.org/10.1371/journal.pone.0232477)

RESPONSE:

We apologize for the untidiness, and changed accordingly:

“The observed prevalence of psychological distress in our cohort appears to be higher than in the general population during non-pandemic circumstances, and was similar to people suffering from PTSD-related symptoms after a traumatic event, such as theft, burglary, accidents and death of a significant other (41).” (Discussion, page 24, lines 354-356)

25. Line 331. “Baseline psychological status and HRQoL in our cohort was not available”. You mean before infection/hospitalization? (you used the word baseline to describe T1).

RESPONSE:

We agree and changed accordingly. This sentence now reads:

“In our cohort, psychological status and HRQoL prior to hospitalization were not available and thus we cannot formally rule out that pre-existing psychological well-being was poorer, predisposing for impaired psychological recovery (47).” (Discussion, page 25, lines 380-382)

“First, the high incidence of psychological symptomatology and the poor HRQoL post-discharge may be either attributed to factors related to hospitalization or to baseline psychological imbalances, as psychological status and HRQoL of participants prior to hospitalization was not available.” (Discussion, page 26, lines 407-410)

We however want to stress that T1 is not described as baseline, as T1 refers to the first follow-up time-point, which was one month after discharge from the hospital.

26. Line 350-353. Should “Physicians should be aware of the psychological consequences of hospitalization during a pandemic but not only in those affected by COVID-19 or requiring ICU treatment” be “However, Physicians should be aware of the psychological consequences of hospitalization during a pandemic but not only in those affected by COVID-19 or requiring ICU treatment”.

RESPONSE:

We agree and changed accordingly.

27. Upload all supplementary materials as separate files.

RESPONSE:

We have uploaded all supplementary materials as separate files as requested by the editor.

Response to Reviewer #3:

Second review: Psychological distress and health-related quality of life in patients after hospitalization during the COVID-19 pandemic: a single-center, observational study

I want to thank the authors for the good job done, especially on methodology. There is a significant improvement on the quality of the manuscript. However, some work need to be done to allow the paper to be published

Introduction

1. This section was reviewed partially. “This paper’s aim is to quantify psychological distress and to determine their HRQoL ”. The introduction needs a section to briefly discuss few different methods to assess mental health and HRQoL. This section will help non expert readers to understand and also give a good flavor to the reader

RESPONSE:

First, we thank the reviewer for his useful comments and suggestions.

With regard to the suggestion to briefly discuss few different methods to assess mental health and HRQoL, we believe that elaborating more on this matter will limit the focus and conciseness of the introduction, and does, in our opinion, not add value to the introduction.

We however understand that the choices made regarding the assessment of psychological distress and HRQoL remains a matter of debate, and therefore discussed this, although briefly in the discussion section:

“Fourth, we assessed psychological well-being and HRQoL using self-report questionnaires. Although commonly used and extensively validated, formal assessment of psychologic disorders requires consultation with a psychologist or psychiatrist, and usage of self-reports may result in an overestimation of psychologic distress.” (Discussion, page 26, lines 420-422)

Methodology

Authors have made significant progress in term of reporting methodology. However, data analysis part is not well reported;

it is not clear in the analysis which method used at each level, for example;

2. Line 172; “Differences in outcome measures between stratifications were analyzed using linear or logistic regression”. Clarify where you used linear and where you used logistic regression and clarify the logistic model used (i.e function or Equation). For logistic regression (binary outcomes), I was expecting to read the results with Odds ratios and confidence intervals. Please explain this!

RESPONSE:

First, we apologize for the unclarity. A similar comment was raised by the academic editor. To clarify; we used simple linear regression models to compare continuous outcomes between stratifications, and simple logistic regression models to compare dichotomous/categorical variables. Mixed effects linear regression models were used to analyze the course of psychological symptomatology, in means of the IES-R sum score, HADS anxiety score, and HADS depression score, and the course of HRQoL, in means of mental quality of life (MCS-36), physical quality of life (PCS-36), and overall HRQoL (EQ-5D TTO score), and we used mixed effect logistic regression models to analyze the course of the prevalence of probable PTSD, anxiety, and depression, as defined as patients scoring above the described cut-off value. Furthermore, for the identification of risk factors for psychological distress and HRQoL, we used mixed effects linear (for continuous outcomes) or logistic (for categorical outcomes) regression models.

We changed the description of this in the Statistical analysis section of the Methods:

“Differences in outcome measures between stratifications were analyzed using simple linear or logistic regression models, to adjust for at baseline differing characteristics, for continuous and categorical outcomes, respectively. We therefore first performed a simple univariate linear (for continuous outcomes) or logistic (for categorical outcomes) regression analyses, in which all at baseline differing characteristics were analyzed one-by-one. Variables that were associated with the outcome, i.e., a p-value ≤0.10, were added as independent variables to the simple multivariate regression models and were as such adjusted for.

To identify possible predictors for the severity and prevalence of psychological distress and the overall, mental, and physical HRQoL, we first conducted univariate mixed effects regression analysis: a linear model for continuous outcomes and a logistic model for categorical outcomes. We used mixed effects regression models to adjust for intergroup (i.e., time) and intragroup differences (i.e., cohort and variables of interest). In these, the possible predictive variable served as independent variable one-by-one and the outcome of interest at both follow-up time points served as dependent variables. Secondly, all variables which showed a p-value ≤0.10 in the univariate mixed effects regression model were added to the multivariate mixed effects regression model to determine which variables significantly predicted the outcome.” (Methods, Statistical analysis, page 9-10, lines 195-208)

Also, the reviewer rightfully points out that it was inappropriate to report the raw coefficients of the logistic regression models. We have changes these to OR’s and the corresponding confidence intervals:

“We report the coefficient [95% CI], which implies the estimated mean difference, for linear models, and odds ratios (ORs), including its 95% CI, for logistic models.” (Methods, Statistical analysis, page 10, lines 208-209)

3. Line 185-186 “Psychological outcomes of randomly selected non-responders were compared with those of responders using a linear or logistic regression model”. It is not clear where applied linear regression, where applied multiple and where applied logistic regression. Please clarify these by showing which statistical model used (i.e function or equation).

RESPONSE:

We apologize for the untidiness, and are convinced that we now better described how non-responders were analyzed:

“Baseline characteristics of all non-responders were compared with those of responders using a Mann-Whitney U test for continuous variables and using a Fisher’s exact test for categorical variables. Psychological outcomes of randomly selected non-responders (who did not respond at both time-points) were compared with those of responders, and psychological outcomes of full responders were compared with those of partial responders (i.e., patients who only responded at one or three months), using simple linear or logistic regression models for continuous and categorical variables, respectively. In these, we adjusted for variables that were expected to confound the outcome and differed at baseline between stratifications as described above.” (Methods, Statistical analysis, page 10, lines 210-216)

4. Please discuss with your analyst if there is a possibility of using “ Time to event outcomes regression” (cox proportional hazards model) and calculate hazard ratios for ICU versus non-ICU and COVID-19 versus non COVID-19 in the development or reduction of psychological distress from the time of discharge to one month time follow up!

RESPONSE:

We appreciate the suggestion of the reviewer and discussed this matter with our statistician (B. Boxma-de Klerk). Unfortunately, such an analysis requires us to know at what time point exactly someone started suffering from psychological distress, rather than if a patient reported psychological distress at a certain follow-up assessment. In our study, we only assessed psychological distress at two time-points: one month and three months after discharge. For patients who already reported psychological distress at one point, or for those who did not reported psychological distress at one month, but did at three months, we cannot know when during follow-up these symptoms first manifested. As such, it is not possible to use time to event outcomes regression.

Health related quality of life;

5. Clarify how you calculated utility scores and health states, then how did you do the crosswalk for the health states?

R:ESPONSE

The time trade off (TTO) score of the EQ-5D is computed by giving a weight for eight possible answers for each item. These weights are subtracted from the maximum; which is 1. So, every patients starts with a EQ-5D TTO score of 1.00. For each answer given on one of the five domains, a certain weight is subtracted. For instance, for the mobility domains, no subtraction is conducted when a patients has no problems walking, 0.035 is subtracted when a patient has slight problems walking, 0.057 is subtracted when a patient has moderate problems with walking, 0.166 is subtracted when a patients has severe problems with walking, and 0.203 is subtracted when a patients is unable to walk. Every answer possibility has other weights, and an additional weight is subtracted when a patient reports the worse score on all five domains. These weights are country-specific, and published within the validation study of the EQ-5D in the Dutch population.

The computation of the EQ-5D utility/TTO score is described in the paper of Herdman et al. (2011) and Versteegh et al. (2016), to which we refer when we first mention the EQ-5D .

With regard to the MCS-36 and PCS-36; the calculations for these summary scales are extensively described in the paper of Ware et al. (1994). In summary; first all subscales are calculated, and subsequently these are normalized against the general population, so that the mean is 50 and the standard deviation is 10 in the general population. The mean of the subscales in its section represent the mental and physical component score.

As the EQ-5D and RAND-36 are the most commonly used instrument to determine a person’s quality of life, and the exact calculations of the health states/summary scales does not fall under the scope of the present study, we do not further elaborate on this within the manuscript.

6. Explain how you calculated the mean utility scores

RESPONSE:

We have explained the calculations behind the utility scores in the response to your previous comment.

7. Explain how you estimated QALYS lost due to psychological distress

RESPONSE:

We do not fully comprehend the reviewer’s comment, as we do not estimate and discuss any loss of QALYs due to psychological distress in the manuscript under review.

Results

All relevant or significant results (i. e significant P-values) in the tables in this section must be briefly commented below each table.

RESPONSE:

We indeed did not comment on all significant p-values within the manuscript to maintain conciseness.

Based on the comment of the reviewer, we added the following to the manuscript to address all significant outcomes of Table 1:

“Table 1 depicts the most relevant baseline demographics and treatment-related characteristics; a full overview of all collected demographics and characteristics can be found in Table S8. The median age was 64 years (95% range 33-88), 106 (36%) were female, and a history of mental illness was reported by 27 of 201 patients (13%), who were willing to share this information. The median hospital length of stay (LOS) was 4 days (1-52) and 42 patients (14%) required ICU admission (median ICU LOS; 16 days [95% range 0-52]). Overall, 146 patients (50%) were SARS-CoV-2 positive. Non-COVID-19 patients were predominantly diagnosed with other pulmonary or cardiac illnesses (Table S8). COVID-19 patients were younger, had fewer comorbidities, more frequently worked prior to hospitalization, had a longer hospital and ICU LOS, were more frequently admitted to the ICU, had a higher SOFA score and lower P/F ratio on admission, more frequently received oxygen therapy and invasive ventilation for a longer duration, were more frequently mechanically ventilated in prone position and more frequently received a tracheotomy than non-COVID-19 patients (Table 1). Within COVID-19 patients, those who were admitted to the ICU had a longer hospital LOS, a higher SOFA score and lower P/F ratio, received oxygen therapy more frequently and more frequently received a tracheostomy (Table 1).” (Results, Participants, page 12-14, lines 238-251).

We had already commented on all significant results from Table 2 and 3.

Based on the comment of the reviewer, we added the following to the manuscript to address all significant outcomes of Table 4 and 5:

“Time after discharge (p=0.01), not being Caucasian (p<0.01) and having completed higher professional education were associated with the severity of PTSD in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these,…” (Results, Predictors of psychological distress and quality of life, page 17, lines 293-295)

“Time after discharge (p=0.01), female gender (p=0.01), having completed higher professional education (p=0.01), employment status before hospitalization (p=0.08), and COVID-19 diagnosis (p=0.06) were associated with the severity of anxiety in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these,…“ (Results, Predictors of psychological distress and quality of life, page 19, lines 300-303)

“Time after discharge (p=0.01), female gender (p=0.02), not being Caucasian (p=0.06), having completed higher professional (p<0.01) or university education (p=0.01), employment status before hospitalization (p=0.02), COVID-19 diagnosis (p=0.03) and ICU admission (p=0.07) were associated with the severity of depression in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these,…” (Results, Predictors of psychological distress and quality of life, page 19, lines 306-310)

“Time after discharge (p=0.01), age (p<0.01), female gender (p<0.01), having completed higher professional (p<0.01) or university education (p<0.01) and COVID-19 diagnosis (p<0.01) were associated with overall HRQoL in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these,…” (Results, Predictors of psychological distress and quality of life, page 19, lines 313-316)

“Time after discharge (p<0..01), female gender (p<0.01), being not Caucasian (p=0.05), having completed university education (p=0.03), being mechanically ventilated (p=0.03), ICU admission (p=0.01) and having more severe symptoms of PTSD (p<0.01), anxiety (p<0.01) and depression (p<0.01) were associated with mental HRQoL in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these,…” (Results, Predictors of psychological distress and quality of life, page 19, lines 321-325)

“Lastly, time after discharge (p<0.01), age (p<0.01), female gender (p<0.01), employment status before hospitalization (p<0.01), hospital LOS (p=0.07), COVID-19 diagnosis (p<0.01) and having more severe symptoms of PTSD (p<0.01), anxiety (p<0.01) and depression (p<0.01) were associated with physical HRQoL in the univariate mixed effects regression analyses and were included in the multivariate mixed effects regression analysis. Of these,… “ (Results, Predictors of psychological distress and quality of life, page 20, lines 328-331)

8. For example, “Table1: Baseline demographics and treatment-related characteristics of study population”. Where are comments of this table?

RESPONSE:

We have described all variables that were differing at baseline in the results section, as described in the answer to your previous comment.

9. Table2 “Psychological outcomes throughout follow-up” is confusing because it is not commented. I don’t see the relevance of this table. And if am not wrong, no significant results are reported in this table. And then, the bottom of this table reads logistic regression. With logistic regression results, one would expect to be reported Odds ratios (ORs) and confidence intervals. I suggest you remove this table because the results are confusing and are not explained therefore it does not add value unless if it is clearly commented.

RESPONSE:

We regret that the relevance of these tables was unclear, and a similar comment was raised by the academic editor. Table 2 and 3 depicts our primary and secondary outcome measures; Table 2 represents the severity and prevalence of psychological distress, as measured at both follow-up moments. The P-values provided regarding the comparison between stratifications are calculated using simple linear and logistic regression models, which is largely comparable with an ANCOVA, to adjust for at baseline differing variables, and the P-values regarding the change over time were calculated using mixed effects linear and logistic regression models.

To clarify this, we revised the legend of Table 2:

“Descriptive statistics of the psychological distress outcomes, stratified by COVID-19 diagnosis and ICU admission. Severity of PTSD, anxiety, and depression were expressed as the IES-R, HADS anxiety, and HADS depression sum scores, respectively. Prevalence of probable PTSD, anxiety, and depression was defined as the proportion of patients scoring above the cut-off. Abbreviations: CI, confidence interval; COVID-19, coronavirus disease 2019; ICU, intensive care unit; OR, odds ratio; PTSD, post-traumatic stress disorder. Differences over time were calculated using mixed effects linear (for continuous outcomes) and logistic (for categorical outcomes) regression models, with time as independent variable. Differences between stratifications were analyzed using simple linear (for continuous outcomes) and logistic (for categorical outcomes) regression models.“ (Results, Table 2, page 16, line 272)

And changed the legend of Table 3 accordingly:

“Descriptive statistics of the HRQoL outcomes, stratified by COVID-19 diagnosis and ICU admission. Differences over time were calculated using mixed effects linear (for continuous outcomes) and logistic (for categorical outcomes) regression models, with time as independent variable. Abbreviations: CI, confidence interval; COVID-19, coronavirus disease 2019; EQ-5D, European quality of life 5 dimensions questionnaire; HRQoL, health-related quality of life; ICU, intensive care unit; MCS-36, mental component score of the RAND-36; OR, odds ratio; PCS-36, physical component score of the RAND-36; TTO, time trade-off; VAS, visual analogue scale. Differences between stratifications were analyzed using simple linear (for continuous outcomes) and logistic (for categorical outcomes) regression models.” (Results, Table 3, page 18, line 299)

10. Table3, 4 and 5 are relevant but are not commented. Please comment important or significant results in these tables

RESPONSE:

We understand the confusion of the reviewer, as we indeed did not comment on the univariate analysis depicted in these tables. As described in your previous comment, we have now commented on all significant results in these tables.

Discussion

I am still not able to comment on discussion; results need to be worked on before reviewing the discussion part.

11. Intext citations and references don’t follow PLOS ONE guidelines. Please check on PLOS ONE referencing guidelines

RESPONSE:

We apologize for the untidiness, and fully copy-edited the references section so that all references follow the PLOS ONE guidelines.

Attachment

Submitted filename: Response to the reviewers.docx

Decision Letter 2

Peter G van der Velden

26 Jul 2021

Psychological distress and health-related quality of life in patients after hospitalization during the COVID-19 pandemic: a single-center, observational study.

PONE-D-20-38679R2

Dear Dr. Vlake,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards, en van harte gefeliciteerd,

Peter G. van der Velden, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: (No Response)

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: (No Response)

Reviewer #3: This paper has now reached to the publication level. I thank the authors for the job well done. Congratulations!

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: Yes: Mark Bosmans

Reviewer #3: Yes: Desire Aime Nshimirimana

Acceptance letter

Peter G van der Velden

30 Jul 2021

PONE-D-20-38679R2

Psychological distress and health-related quality of life in patients after hospitalization during the COVID-19 pandemic: a single-center, observational study.

Dear Dr. Vlake:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Peter G. van der Velden

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Possible predictors for psychological distress.

    (DOCX)

    S2 Table. Reliability of the impact of event scale-revised, the hospital anxiety and depression scale, the short-form 36, and the EQ-5D in the entire population and stratifications.

    (DOCX)

    S3 Table. Overall response rate and response rates for the individual questionnaires at both follow-up time-points.

    (DOCX)

    S4 Table. Non-responders’ analysis based on baseline demographics and treatment-related characteristics.

    (DOCX)

    S5 Table. Comparison of baseline demographics and treatment-related characteristics between full responders and participants who only responded at 1 of 3 months after discharge.

    (DOCX)

    S6 Table. Comparison psychological and HRQoL outcomes between full responders and participants who only responded at 1 of 3 months after discharge.

    (DOCX)

    S7 Table. Non-responders’ analysis based on psychological outcomes and health-related quality of life.

    (DOCX)

    S8 Table. Baseline demographics and treatment-related characteristics of study participants.

    (DOCX)

    S9 Table. Analysis of predictors for the development of probable PTSD, anxiety, and depression, and the self-perceived health state.

    (DOCX)

    S1 File. Registered study protocol.

    (DOCX)

    S2 File. Strobe 2017 statement–checklist of items that should be included in reports of cohort studies.

    (DOCX)

    S3 File. Raw data file.

    (XLSX)

    Attachment

    Submitted filename: Review Plosone januari 2021.docx

    Attachment

    Submitted filename: Comments to authors.docx

    Attachment

    Submitted filename: Response to the reviewers.docx

    Attachment

    Submitted filename: PONE-D-20-38679R1.docx

    Attachment

    Submitted filename: Response to the reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES