Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Aug 22;17(8):e0273041. doi: 10.1371/journal.pone.0273041

Comparison between the persistence of post COVID-19 symptoms on critical patients requiring invasive mechanical ventilation and non-critical patients

Irene Irisson-Mora 1,¤,*,#, Angélica M Salgado-Cordero 2,¤,#, Estefanía Reyes-Varón 2,¤,#, Daniela J Cataneo-Piña 3,¤,#, Mónica Fernández-Sánchez 4,¤,, Ivette Buendía-Roldán 5,¤,, Miguel A Salazar-Lezama 2,¤,‡,*; on behalf of the Occupational Health and Preventive Medicine Consortium
Editor: Shweta Rahul Yemul Golhar6
PMCID: PMC9394845  PMID: 35994441

Abstract

Background

During follow-up, patients severely affected by coronavirus disease 2019 (COVID-19) requiring invasive mechanical ventilation (IMV), show symptoms of Post-Intensive Care Syndrome (PICS) such as cognitive impairment, psychological disability, and neuromuscular deconditioning. In COVID-19 pandemic, it is a priority to develop multidisciplinary post-acute care services to address the long-term multisystemic impact of COVID-19.

Research question

Which are the most relevant multisystemic sequelae in severe post-COVID-19 patients?

Study design and methods

Observational chart review study that included adult patients discharged from a referral hospital for respiratory diseases in Mexico after recovering from severe COVID-19 disease from December 23, 2020, to April 24, 2021. Data were collected from 280 of 612 potentially eligible patients to evaluate persistent symptoms and compare sequelae in patients who required intubation, using a standardized questionnaire of symptoms, in addition to findings reported during the face-to-face health assessment. Univariable and multivariate analyses were performed for the association among the requirement of IMV and the long-term persistence of symptoms.

Results

280 patients were included. The median age was 55 (range, 19 to 86) years, and 152 (54.3%) were men. The mean length of hospital stay was 19 (SD, 14.1) days. During hospitalization 168 (60%) participants received IMV.

A large proportion of these patients reported fatigue (38.7%), paresthesia (35.1%), dyspnea (32.7%) and headache (28%); meanwhile only 3 (1.8%) of them were asymptomatic. Patients who required intubation were more likely to have neuropsychiatric (67.3% vs 55.4%; OR, 1.79 [95% CI, 1.08 to 2.97]) and musculoskeletal involvement (38.7% vs. 25.9%; OR, 1.92 [95% CI, 1.12 to 3.27]), adjusted for age,sex and hospitalization time.

Interpretation

The proportion of patients requiring intubation was 60%, reporting persistent symptoms in 98% of them. Neuropsychiatric and musculoskeletal symptoms were the most predominant symptoms in these patients, with a significant difference. Post-COVID-19 syndrome is a frequent problem in patients who required IVM. Physicians in ICU and in care of COVID-19 patients should be aware of this syndrome in order to avoid more complications.

Introduction

By the end of the first half of 2021, coronavirus disease 2019 (COVID-19) has affected more than 178 million people, resulting in almost 4 million deaths world wide [1]. The risk of severe disease [2] and the rate of invasive mechanical ventilation (IMV) reported in countries such as China and the United States goes from 29.1 [3] to 89.9% [4]. Despite high mortality in patients with severe disease, there is a large number of surviving patients who will have to cope with multisystemic sequelae [5, 6]. The lung damage, severe hypoxia, coagulation and inflammatory system abnormalities [7] can lead to cardiac, [8] neurological, [9] kidney and liver injuries [10]. Together, these multisystemic damage increases the odds of having multiple sequelae with variable duration.

As cases of severe COVID-19 survivors increase, also does the number of patients with persistent symptoms, although they have a negative polymerase chain reaction (PCR) test for SARS CoV-2; this syndrome has been called post-COVID-19 syndrome [11]. Some studies have explored these persistent symptoms; in a French longitudinal study, 68% of patients had persistent symptoms at six months of follow up, being fatigue and dyspnea the most frequently reported, in about one third of patients [1214], followed by pain and psychological distress [15, 16].

These studies clearly indicate that there is a broad extension of post-COVID-19 symptoms, which duration is variable. Most research has included ambulatory patients, with a small proportion of critically ill and mechanical ventilated patients. Our hospital, is a third level respiratory referral center, consequently, receiving the most complicated patients in the country; a multidisciplinary team evaluates all the patients that are discharged from hospitalization. In this single-center study, we assess the persistent symptoms in those patients with severe COVID-19, more specifically on those who needed IMV, so far lacking in the literature.

Study design and methods

This is an observational, transversal and descriptive study characterized by physical and electronic chart review of the post-COVID-19 cohort patients seen at the National Respiratory Diseases Institute in Mexico City. We included all patients discharged from the hospital with diagnosis of COVID-19 disease from December 23, 2020, to April 24, 2021, where most of the patients were admitted under criteria of severe infection with SARS CoV-2 as defined by the National Institutes of Health (SpO2 > 94%, ratio between arterial partial pressure of oxygen and fraction of inspired oxygen (PaO 2/FiO2) <300 mm Hg, respiratory rate >30 breaths/min [17].

Our Institute is a referral hospital and since patients come from all around the country and due mostly to economic issues, it is impossible for the majority of them to return to the hospital for a follow up check-up (post-COVID-19 follow up). Due to this limitation, all COVID-19 discharged patients undergo a telephone assessment up to 6 months after discharge where a systematic questionnaire of potentially persistent symptoms related to COVID-19 is carried out (providing informed verbal consent during this call). The questionnaire applied is a non-validated test, developed by attending physicians in charge of the post-COVID-19 clinic in our Institution. Patients with persistent symptoms or any complain are asked to come back to the hospital, where detailed physical exam and if necessarily other complementary examinations and tests are performed. All these data are collected in an electronic data system. The Institutional Ethics Committee approved this study (COD-C22-21).

All patients included in this study had been hospitalized with diagnosis of COVID-19 infection by positive polymerase chain reaction (PCR) test, from december 23, 2020, to april 24, 2021; time from discharged ranged between 2 weeks and 6 months. The cut off value for prolonged hospitalization was determined as hospital stay longer than 14 days. No COVID-19 virus variant was routinely performed during hospitalization and was not consider in this study.

Thus, 612 patients were potentially eligible, of which 16 died prior to possible follow-up, 32 did not answer the phone call, 22 were hospitalized due to another diagnosis, three required hospital re-admission, two were transferred to another unit where they continued their follow-up, 58 requested telemedicine follow-up due to the inability to attend the assessment in person, 4 voluntary discharges, 10 refused a follow-up visit, 14 did not attend the day of their scheduled follow-up appointment, 167 already had post-COVID-19 follow-up care at another clinic or institution, and finally four patients were excluded, since they had more than 24 weeks from their hospital discharge; so, 280 patients were included in this study as mentioned in Fig 1.

Fig 1. Flow diagram of the study design.

Fig 1

In this flow diagram, the quantity of patients who were assessed for eligibility and the exclusion criteria are exposed.

As mentioned previously, all discharged patients underwent a telephone assessment up to 6 months after discharge where a systematic questionnaire of potentially persistent symptoms related to COVID-19 was carried out, and if applicable they were asked to attend a medical evaluation at the Institute where a detailed physical examination and complementary examinations were performed (including lab tests and CT Torax scan if necessarily).

Chart review was performed, and we classified the persistent post-COVID-19 signs and symptoms in 8 different domains accordingly to the organ or system affected.: [1] Respiratory symptoms, including dyspnea, chest pain, cough, odynophagia, rhinorrhea, wheezing, abnormalities of the vocal cords (hoarseness, cord paralysis) and tracheal stenosis [2]. Cardiovascular symptoms such as clubbing, rhythm disorders (palpitations, tachycardia, and bradycardia), heart murmur, pericarditis, elevated blood pressure, lower limb edema and deep vein thrombosis [3]. General symptoms, like fever, dizziness, fatigue, asthenia, adynamia, sweating, itching, cold sensitivity, and tremors [4]. Musculoskeletal symptoms as well as lack of sensation, mobility limitations, arthralgias, tendon injuries, myalgias, paresthesia, neuralgia, muscular weakness, low back pain, and contractures [5], Dermatological symptoms, such as hair loss, skin rashes, and pressure ulcers [6]. Neurological and Neuropsychiatric symptoms, such as headache, sleep-wake disorders, cognitive impairments such as lack of concentration and memory loss, as well as anxiety and/or depression disorders [7], Gastrointestinal symptoms, including nausea, diarrhea, constipation, abdominal pain, and lack of appetite [8]. Audiologic symptoms, including tinnitus, earache, hearing loss, and vertigo. The impact of each domain on the daily function of the participants has been reported as present or absent.

All data from the physical and electronic charts were collected in an Excel page, which we imported for analysis into a statistical program IBM SPSS (Statistical Package for the Social Sciences) version 25.

Data were presented as measures of central tendency and dispersion. Qualitative variables were expressed as frequencies and percentages, while continuous variables are reported as means ± standard deviations (SD) or as medians with interquartile ranges (IQR), depending on their distribution.

An association analysis was performed to compare both groups (according to IMV requirements) using the Chi-squared test (X2), or Fisher’s exact test and Student’s T test for univariable analyses. Afterwards, multivariate logistic regression models were performed to yield adjusted odds ratio (AORs) with 95% confidence intervals (CI), to evaluate the association between variables that in the univariable analysis showed a statistically significant difference, considering significant P values under 0.05.

Results

From 280 patients included in the study, the median age was 55 (range, 19 to 86) years, of which 180 (64.3%) were under 60 years of age; 152 (54.3%) were males and 128 (45.7%) females. The average of hospital stay length and time since the onset of symptoms through follow-up period were 19 (± 14.1) days and 10 (± 3.73) weeks, respectively.

Upon admission, mean oxygen saturation (measured by pulse oximetry) was 73.45% ± 13.3% (range, 20 to 97%)

During hospitalization, two-third (168 of 280, 60%) required IMV for a mean time of 14.93 ± 8.74 days and 112 (40%) non required IMV; 31(11.1%) required tracheostomy, and 11 (3.9%) required gastrostomy. The most common comorbidities were obesity and overweigh (81.1%), hypertension (41.4%) and diabetes mellitus (29.3%); while only 35 (12.5%) were previously healthy. Demographic and IMV-related characteristics are shown in Table 1.

Table 1. Mechanical ventilation (univariable analyses).

Demographic and clinical features of a group of post COVID-19 patients associated to invasive.

Variable TotalN (%)a
N = 280
Invasive Mechanical Ventilation
N (%)
P value
Present
N = 168 (60)
Absent
N = 112 (40)
>60 years old 100 (35.7) 56 (33.3) 44 (39.3) 0.309
Male sex 152 (54.3) 101 (60.1) 51 (45.5) 0.016d
Comorbidities
    Hypertension 116 (41.4) 72 (42.9) 44 (39.3) 0.552
    Diabetes 82 (29.3) 49 (29.2) 33 (29.5) 0.957
    Obesity and/or Overweight 227 (81.1) 134 (79.8) 93(83.0) 0.493
    Dyslipidemia 17 (6.1) 10 (6) 7 (6.3) 0.919
    Hypothyroidism 16 (5.7) 5 (3) 11 (9.8) 0.016 d
    Heart disease 7 (2.5) 5 (3) 2 (1.8) 0.532
    History of lung disease 10 (3.6) 1 (0.6) 9 (8) 0.001b,d
    Previously healthy 35 (12.5) 19 (11.3) 16 (14.3) 0.461
Risk factors
    Smoking 110 (39.3) 69 (41.1) 41 (36.3) 0.454
    Biomass exposure 46 (16.4) 23 (13.7) 23 (20.5) 0.130
    Alcoholism 23 (8.2) 17 (10.1) 6 (5.4) 0.155
Clinical presentation
    ≥3 symptoms 184 (65.7) 114 (67.9) 70 (62.5) 0.355
    1–2 symptoms 90 (32.1) 51 (30.4) 39 (34.8) 0.433
    Asymptomatic 6 (2.1) 3 (1.8) 3 (2.7) 0.680
Sequelae
    Respiratory symptoms 182 (65) 103 (61.3) 79 (70.5) 0.103
    Cardiovascular symptoms 52 (18.6) 33 (19.6) 19 (17) 0.572
    General symptoms 152 (54.3) 90 (53.6) 62 (55.4) 0.769
    Musculoskeletal symptoms 94 (33.6) 65 (38.7) 29 (25.9) 0.026 b,d
    Dermatological symptoms 47 (16.8) 34 (20.2) 13 (11.6) 0.058
    Neurological and neuropsychiatric symptoms 175 (62.5) 113 (67.3) 62 (55.4) 0.044 b,d
    Gastrointestinal symptoms 38 (13.6) 27 (16.1) 11 (9.8) 0.135
    Audiologic symptoms 10 (3.6) 7 (4.2) 3 (2.7) 0.511

a Data are presented as N (%).

b Fisher Exact Test was used to report the p value, otherwise Chi squared test was performed.

c COVID-19 = Coronavirus disease 19.

d P values in bold have statistical significance.

At the time of evaluation, up to six months after discharged, only 3 of the 168 intubated patients (1.8%) were asymptomatic and 114 (67.9%) reported more than 3 persistent symptoms. Fatigue (41.4%) was the most common symptom, followed by headache (27.5%), paresthesias and neuralgia (26.1%); while, in the multisystemic evaluation, respiratory sequelae (65%, 182 of 280), followed by neurological and neuropsychiatric sequelae (62.5%, 175 of 280) were the most frequent symptoms (Table 2); describing dyspnea in 35.4% (99 of 280), chest pain in 21.1% (59 of 280), cough in 17.5% (49 of 280), sleep-wake disorders in 12.1% (34 of 280), as well as anxiety and depression disorder in 10.4% (29 of 280) and abnormalities of vocal cords in 9.6% (27 of 280) of the patients.

Table 2. Univariable analyses by gender, comorbidities and prolonged hospitalization time.

Gender
Variable Total N (%) Women Men P value
Comorbidities 245 (87.5) 118 (48.2) 127 (51.8) 0.031 d
Risk factors
    Smoking 110 (39.3) 37 (28.9) 73 (48.0) 0.001 d
    Biomass exposure 46 (16.4) 31 (24.2) 15 (9.9) 0.002 d
    Alcoholism 23 (8.2) 3 (2.3) 20 (13.2) 0.001 d
Prolonged hospitalization time 112 (40.0) 42 (32.8) 70 (46.1) 0.028 d
Sequelae
    Respiratory symptoms 182 (65.0) 92 (71.9) 90 (59.2) 0.032 d
    Dermatological symptoms 47 (16.8) 33 (25.8) 14 (9.2) <0.001 d
Comorbidities
Variable Total N (%) Comorbidities Previously healthy P value
Sequelae
    Respiratory symptoms 182 (65.0) 165 (67.3) 17 (48.6) 0.037 d
    Musculoskeletal symptoms 94 (33.6) 88 (35.9) 6 (17.1) 0.034 d
Prolonged hospital time
Variable Total N (%) Present Absent P value
Risk factors
    Smoking 110 (39.3) 55 (49.1) 55 (32.7) 0.009 d
    Biomass exposure 46 (16.4) 12 (10.7) 34 (20.2) 0.047 d

d P values in bold have statistical significance.

This was followed by general symptoms (54.3%, 152 of 280) and musculoskeletal sequelae (33.6%, 94 of 280); as prior mentioned fatigue, paresthesia/neuralgia in 26.1% (73 of 280), myalgia in 21.1% (59 of 280), joint pain in 11.8% (33 of 280), mobility limitations 8.6% (24 of 280), tremor in 7.9% (22 of 280), adynamia 7.1% (20 of 280), asthenia 6.4% (18 of 280) and muscular weakness in 5% (14 of 280) (Fig 2).

Fig 2. Post COVID -19 symptoms according to mechanical ventilation requirements.

Fig 2

A comparison of the persistence of symptoms in general, whether a patient required invasive mechanical ventilation or not are shown. In the bar graph patients on invasive mechanical ventilation are represented by the blue column and the non-intubated patients are illustrated by the grey column. * Represents the statistically significant outcomes, according to P values.

Some less frequently reported sequelae were cardiovascular (18.6%, 52 of 280), gastrointestinal 13.6% (38 of 280) and dermatological symptoms (16.8%, 47 of 280); such as rhythm disorders (10.7%, 30 of 280), lower limb edema (5.4%, 15 of 280), abdominal pain (2.5%, 7 of 280), constipation (2.1%, 6 of 280), hair loss (10.7%, 30 of 280) and pressure ulcers (5.7%, 16 of 280); and finally audiologic symptoms with only 3.6% in 10 of 280 patients, among them earache (2.1%, 6 of 280) and tinnitus (1.8%, 5 of 280).

Univariable analyses by gender

Men had a higher tendency to become intubated (60.1 vs 45.5%, P = 0.016), had a longer hospitalization time (46.1 vs 32.8%, P = 0.028), more risk factors including smoking (48 vs 28.9%, P = 0.001) and alcoholism (13.2 vs 2.3%, P = 0.001), as well as more comorbidities (51.8 vs 48.2%, P = 0.031). On the other hand, women had a higher biomass exposure (24.2 vs 9.9%, P = 0.002), and more respiratory (71.9 vs 59.2, P = 0.032) and dermatological symptoms (25.8 vs 9.2%, P = <0.001) compared to men.

Univariable analyses by comorbidities

Patients with any previously comorbidities reported more respiratory (67.3 vs 48.6%, P = 0.037) and musculoskeletal (35.9 vs 17.1%, P = 0.034) symptoms compared to previously healthy patients. There were no other significant differences between these two groups.

Univariable analyses by prolonged hospital time

Patients with longer hospital time had more tendency of smoking (49.1 vs32.7%, P = 0.009), and less history of biomass exposure (10.7 vs 20.2%, P = 0.047) compared to patients with shorter hospitalization time. There were no other significant differences between these two groups.

Univariable analyses by IVM

IVM patients had a longer hospitalization time compared with non-intubated patients (59.5 vs 10.7, P = <0.001) as well as more musculoskeletal symptoms (38.7 vs 25.9%, P = 0.026) and neurological-neuropsychiatric symptoms (67.3 vs 55.4%, P = 0.044). On the other hand, non-intubated patients had a higher history of lung disease (8 vs 0.6%, P = 0.001) as a well as more hypothyroidism history (9.8 vs 3%, P = 0.016) compared to IVM patients. There were no significant differences between intubated and non-intubated patients in terms of other comorbidities, biomass exposure or smoking.

Multivariable analyses for gender

In a multivariate logistic regression analysis, adjusted for age and prolonged hospitalization time, women were more likely to have dermatological symptoms (25.8% vs 9.2%; OR, 3.464; 95% CI, 1.635–7.336; P = <0.001), a higher biomass exposure (24.2% vs 9.9%; OR, 2.401; 95% CI, 1.143–5.045; P = 0.021) compared to men. On the other hand, men had higher smoking history (48% vs 28.9%; OR, 0.449; 95% CI, 0.257–0.784; P = 0.005), and higher alcoholism history (13.2% vs 2.3%; OR, 0.260; 95% CI, 0.070–0.964; P = 0.044) compared to women.

Univariable analyses by comorbidities

In a multivariate logistic regression analysis, adjusted for age, sex, and prolonged hospitalization time patients with previously comorbidities were more likely to have musculoskeletal symptoms (35.9% vs 17.1%; OR, 0.344; 95% CI, 0.133–0.884; P = 0.027), compared to previously healthy patients.

Multivariable analyses by prolonged hospital time

In a multivariate logistic regression analysis, adjusted for age, sex, and prolonged hospitalization time patients with longer hospital time had more smoking history (49.1% vs 32.7%; OR, 1.867; 95% CI, 1.125–3.099; P = 0.016) compared to patients with shorter hospitalization time.

Multivariable analyses for IVM

In a multivariate logistic regression analysis, adjusted for age, sex, and prolonged hospitalization time, patients in IVM were more likely to have neurological and neuropsychiatric involvement (67.3% vs 55.4%; OR, 1.936; 95% CI, 1.069–3.506; P = 0.029), as well as neuromuscular involvement (38.7% vs. 25.9%; OR, 1.946; 95% CI, 1.057–3.591; P = 0.032) compared to non-intubated patients (Fig 3 and Table 3).

Fig 3. Post COVID-19 sequelae for IMV and non-IMV patients.

Fig 3

A comparative bar graph of post-covid sequelae, according to the requirements of IMV is represented. In the bar graph patients on invasive mechanical ventilation are represented by the blue column and the non-intubated patients are illustrated by the grey column. * Represents the statistically significant outcomes, according to P values.

Table 3. Multivariate logistic regression analysis of gender, comorbidities, prolonged hospitalization time and invasive mechanical ventilation.

Gender
Variable Total N (%) OR CI P
Risk factors
Smoking 28.9 vs 48.0 0.449 0.257–0.784 0.005 d
Biomass exposure 24.2 vs 9.9 2.401 1.143–5.045 0.021 d
Alcoholism 2.3 vs 13.2 0.260 0.070–0.964 0.044 d
Sequelae
Dermatological symptoms 25.8 vs 9.2 3.464 1.635–7.336 <0.001d
Comorbidities
Sequelae
Musculoskeletal symptoms 35.9 vs 17.1 0.344 0.133–0.884 0.027 d
Prolonged hospital time
Risk factors
Smoking 49.1 vs 32.7 1.867 1.125–3.099 0.016 d
Invasive mechanical ventilation
Sequelae
Musculoskeletal symptoms 38.7 vs 25.9 1.946 1.057–3.591 0.032 d
Neurological and neuropsychiatric symptoms 67.3 vs 55.4 1.936 1.069–3.506 0.029 d

d P values in bold have statistical significance.

Discussion

Since the beginning of COVID-19, the number of patients with sequelae has increased, making it necessary to direct our attention and efforts to the recovery from these complications. In our study, we sought to identify the most prevalent symptoms of critically ill patients due to COVID-19, 60% of these patients required IMV over the course of the hospitalization, which relates to long-term complications in these specific group of patients.

Our results show that the most prevalent individual symptoms in overall population were fatigue and dyspnea, and grouped by systems, the respiratory system was the most affected, followed by neuropsychiatric symptoms. After analyzing the prevalence of symptoms depending on the mechanical ventilation status, patients who required IMV had more neurological disturbances, specifically neuropathic pain, and more neuropsychiatric symptoms, mainly anxiety, depression and sleeping disorders. A systematic literature review that included 79 studies, which aimed to describe the neurological manifestations of COVID-19, found a high prevalence of symptoms such as olfactory disfunction, ischemic stroke, headache, dizziness encephalitis, neuralgia, and ataxia among COVID-19 patients, but post COVID-19 neurological sequelae have not been previously evaluated [18].

During follow-up, our patients severely affected by COVID-19 who needed IMV showed symptoms of Post Intensive Care Syndrome (PICS) such as cognitive impairment, psychological disability, and neuromuscular deconditioning [19]. COVID-19 critical patients may be predisposed to have a greater prevalence of PICS because of longer periods of mechanical ventilation [20], sedation and the use of steroids and sedative meditation for their treatment [21]. Although PICS is known to be a common syndrome in patients that needed critical care, and there are a significant amount of patients that required these kind of care due to COVID-19, the prevalence of PICS and its definition in patients with COVID-19 is still not yet determined. Such is the case that in 2021 a call has been made to the World Health Organization (WHO) to develop International Classification of Disease Diagnostic Codes for PICS in the “Age of COVID-19” that incentive to care coordination in outpatient settings and to an effective post-acute treatment [22].

The current study found that the patients with pneumopathy had lower risk of IMV requirement than non-invasive ventilation patients, which is consistent with previous publications [23]. Which could be explained by three situations: the lack of recognition, a protective effect by immune response and finally a possible effect of the treatment of these diseases such as use of inhaled corticosteroids alone or in combination with bronchodilators shown on in vitro models [24], that have been able to suppress the replication of coronavirus and the production of cytokines.

The human coronavirus can enter to the central nervous system through the olfactory bulb and the brain receptors for angiotensin-converting enzyme 2 expressed over glial cells and neurons [25]. Findings of previous research over Severe Acute Respiratory Syndrome Coronavirus 1 (SARS-CoV-1) and Middle East Respiratory Syndrome Coronavirus (MERS-COV) show that these respiratory viruses cause severe brainstem damage, contributing to failure of the respiratory centers [26, 27]. Other mechanisms that contribute to the pathophysiology of post-acute COVID-19 include viral direct organ damage and inflammatory damage in response to the acute infection [28]. Although these changes have been observed in different organs and systems, in mechanically ventilated patients, we found a greater amount of neurological, muscular and psychiatric sequelae at long term.

In addition to viral direct damage, SARS-CoV-2 infection triggers an inflammatory storm, with a subsequent break of the blood-brain barrier, which contributes to the neuroinflammatory process [29]. SARS-CoV-2 also produces infectious toxic encephalopathy, which refers to a type of reversible brain dysfunction syndrome caused by systemic toxemia, metabolic disorder and hypoxia [30], leading to mental disorders and delirium [31]. The neuroinflammatory process and persistent hypoxia also damage the hippocampus and cortical areas, causing cognitive function and behavioral alterations [32].

Although the scope of our results is limited to a middle term, the neurological and cognitive impairments may extent to a longer period. This should be assumed according to the recent findings from the UK Biobank study, where COVID-19 patients had a significant loss of grey matter in the left parahypocampal gyrus, the left lateral orbitofrontal cortex and the left insula [33]. In addition to the gray matter decrease, COVID-19 critically ill patients also tend to have more incidence of microbleed at follow up [34], mainly found in the juxtacortical white matter, corpus callosum and internal capsule [35, 36]. The implications of these structural and vascular alterations must be considered at the long term follow up of these patients, therefore cognitive and neurological evaluation should be carried out periodically. Our center provides neurological assessment to identify cognitive impairment, peripheral and central nervous system disorders. According to the identified sequelae, patients are referred to physical and neuropsychological rehabilitation where they receive therapy for up to 6 months until sequelae have improved.

Several reports described a great burden of psychiatric symptoms such as insomnia [37], anxiety, post-traumatic stress symptoms [38] and mood disorders [39] in patients affected by COVID-19 on the acute phase. Chronic psychological distress and post-traumatic stress disorder can develop in patients who survive critical illness and have been reported as a complication of the infection by other coronaviruses such as MERS [40] and SARS [41]. In a systematic review and meta-analysis that included 72 studies that aimed to assess the psychiatric and neuropsychiatric presentation of MERS, SARS and COVID-19, they found that in the post-acute stage, the prevalence of post-traumatic stress disorder was 32.2%, that of depression was 14.9% and that of anxiety disorder was 14.8% [42], data that our study also reports. Beyond the brain damage that could be conferred by viral invasion or indirectly by immune response or medical therapy [43], the psychiatric long-term consequences may arrange from other sources such as social isolation, concerns about other family members infected, the impact of a potentially fatal illness along with physical and cognitive impairments which limit their ability to return to their usual activities [44].

We also found that patients who did not required mechanical ventilation had more sleep-wake disorders compared to intubated patients as mentioned in some publications [45], this has been related to the lack of contact with family and beloved ones in those patients who were aware of the COVID-19 critical situation [46, 47]. These patients underwent to a massive psychological stress, which increased pro-inflammatory markers, in particular protein C and IL-6, contributing to the increase of neuroinflammation [48], and therefore, increasing symptoms of depression associated with sleep disorders, especially insomnia. In our cohort, 10% of patients reported psychological distress, anxiety, depression, or sleep disorders. As part of a multidisciplinary management, our patients receive psychiatric and psychological assessment and treatment, which includes pharmacotherapy and cognitive-behavioral therapy sessions. These interventions provide a significant improvement in these symptoms and are fundamental for patient´s quality of life recovery.

Our study provides a framework to focus the attention on the main affected systems in severely affected COVID-19 patients, mainly on those who received IMV. Some suggested acute-phase interventions for neurological protection include tidal volume minimization in ventilation setting strategies to improve cerebral blood flow and lower cerebral vascular resistance along with less inflammation [49, 50]. The use of some sedative agents such as dexmedetomidine instead of benzodiazepines [51], less use of continuous deep sedation [52, 53], along with and a conservative fluid management [54] have also been proposed as useful interventions to maximize neurological function.Although these can be important neuroprotective strategies, the use of an interdisciplinary team, that endorses early rehabilitation may improve general outcomes in critically ill patients [55].

During follow-up, we also found an association between patients who were assisted with mechanical ventilation and post-intensive care syndrome, mainly with neuromuscular deconditioning, being these sequelae the second most statistically significant, such as paresthesia and neuropathies, and mobility limitations. Concerning to dermatological sequelae, pressure ulcers were significantly present in critical patients, which according to a previous publication from our institute [56], patients who underwent to mechanical ventilation had a considerable association with hospital stay length and obesity as a risk factor, the prevention is the best way to go through by mobilizing patients at least twice per shift and applying lubricants for skin care.

Physical rehabilitation in the intensive care unit (ICU) has been incorporated as a standard care procedure for the prevention of the post intensive care syndrome [57, 58]. Physical rehabilitation improves mobility and muscle strength [59], decreases hospital length of stay [60], reduces hospital readmission [61], and may promote neurogenesis [62], release of neurotrophic factors [63] and increase blood flow [64]. Research on the effectiveness of ICU physical rehabilitation mainly focuses on physical morbidities, and its effect on neurological and psychiatric sequelae on COVID-19 critical patients need to further be studied. Due to the nature of the disease, rehabilitation may not be seen as a priority. The need for personal protective equipment supplies and the risk of contagion may limit the possibility of providing physical therapy among critical patients. Nonetheless, since early and structured rehabilitation improves outcomes for patients requiring prolonged periods of mechanical ventilation [65], the implementation of structured rehabilitation programs which commence on early hospitalization and continue after discharge, is mandatory.

The main limitations of this study include its observational nature where symptoms were self-reported by patients without objective criteria for their determination, which could affect the reliability of symptom prevalence estimates. In addition, being a cross-sectional study, it has the limitation of not being able to discern a specific time line of the symptoms since only one time point was recorded, therefore the interpretation of these findings requires caution. More research is needed to understand the course of the post-COVID-19 syndrome, its underlying mechanisms, and possible rehabilitation programs and treatments that can be implemented.

Conclusion

In our hospital, where most of the patients were admitted with severe COVID-19 and a large number of them required IMV management, was observed that patients had a greater tendency to present neurological and neuropsychiatric sequelae, in contrast to non-intubated patients. For this reason, we suggest preventive measures such as neuroprotective therapies, early rehabilitation programs, implementation of telemedicine and internet-based mental health interventions, and a system that allows adequate communication between hospitalized patients and their families.

Our study provides a framework to focus the attention on the main affected systems in severely affected COVID-19 patients, mainly on those who receive IMV. We highly recommend the development of a multidisciplinary team specialized in COVID-19 care services in critically ill patients that endorses early rehabilitation programs which commence in hospitalization and continue after discharge, to adequately manage these symptoms and maximize their functional return to their quotidian activities.

Supporting information

S1 Appendix. Permissions.

Institutional ethics committee approval dictamen.

(PDF)

S2 Appendix. Systematized questionnaire of symptoms.

(PDF)

S1 File

(SAV)

Acknowledgments

We carried out this project in collaboration with Maribel Mateo Alonso, MD (Head, Outpatient Clinic, Instituto Nacional de Enfermedades Respiratorias, Ismael Cosio Villegas, México City, Mexico) for her invaluable help in coordinating the fieldwork. We are very grateful to Luis E. Morales Bartolo, MD; Nadia Díaz Vázquez, RN; Ana M. Vega-Martínez, RN; Fernando Sosa-Gómez, MD; Karen Jimarez Núñez, Medical practitioner and the rest of the members of Occupational Health and Preventive Medicine Consortium for their support during the study.

Occupational Health and Preventive Medicine Consortium:

Maribel Mateo-Alonso (Lead author for this group, email: mmateo_75@hotmail.com).

Luis E. Morales Bartolo.

Nadia Díaz-Vázquez.

Ana M. Vega-Martínez.

Fernando Sosa-Gómez.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

The authors received no specific funding for this work.

References

  • 1.Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis. 2019; 20(9): 533–534. doi: 10.1016/S1473-3099(20)30120-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Hu Y, Sun J, Dai Z, et al. Prevalence and severity of corona virus disease 2019 (COVID-19):A systematic review and meta-analysis. J Clin Virol. 2020; 127: 104371. doi: 10.1016/j.jcv.2020.104371 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Wang Y, Lu X, Li Y, et al. Clinical Course and Outcomes of 344 Intensive Care Patients 398 with COVID-19. Am J Respir Crit Care Med. 2020; 201(11): 1430–1434. doi: 10.1164/rccm.202003-0736LE [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Richardson S, Hirsch JS, Narasimhan M, et al. Presenting Characteristics, Comorbidities, and Outcomes among 5700 Patients Hospitalized with COVID-19 in the New York City Area. JAMA. 2020; 323(20): 2052–2059. doi: 10.1001/jama.2020.6775 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Lim ZJ, Subramaniam A, Reddy MP, et al. Case Fatality Rates for Patients with COVID-19 Requiring Invasive Mechanical Ventilation A Meta-analysis. Am J Respir Crit Care Med. 2021; 203(1): 54–66. doi: 10.1164/rccm.202006-2405OC [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Huang C, Huang L, Wang Y, et al. 6-month consequences of COVID-19 in patients discharged from hospital: a cohort study. Lancet. 2021; 397(10270): 220–232. doi: 10.1016/S0140-6736(20)32656-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Huang C, Wang Y, Li X, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020; 395(10223): 497–506. doi: 10.1016/S0140-6736(20)30183-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Shi S, Qin M, Shen B, et al. Association of Cardiac Injury with Mortality in Hospitalized Patients with COVID-19 in Wuhan, China. JAMA Cardiol. 2020; 5(7): 802–810. doi: 10.1001/jamacardio.2020.0950 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Carod-Artal FJ. Neurological complications of coronavirus and COVID-19. Rev Neurol. 2020; 70(9): 311–322. doi: 10.33588/rn.7009.2020179 . [DOI] [PubMed] [Google Scholar]
  • 10.Xu Z, Shi L, Wang Y, et al. Pathological findings of COVID-19 associated with acute respiratory distress syndrome. Lancet Respir Med. 2020; 8(4): 420–422. doi: 10.1016/S2213-2600(20)30076-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Pierce JD, Shen Q, Cintron SA, Hiebert JB. Post-COVID-19 Syndrome. Nurs Res. 2022. Mar-Apr 01;71(2):164–174. doi: 10.1097/NNR.0000000000000565 . [DOI] [PubMed] [Google Scholar]
  • 12.Ghosn J, Piroth L, Epaulard O, et al. Persistent COVID-19 symptoms are highly prevalent 6 months after hospitalization: results from a large prospective cohort. Clin Microbiol Infect. 2021; 27(7): 1041.e1–1041.e4. doi: 10.1016/j.cmi.2021.03.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Arnold D, Hamilton F, Milne A, et al. Patient outcomes after obilization on with COVID-19 and implications for follow-up; results from a prospective UK cohort. Thorax. 2021;76(4): 399–401. doi: 10.1136/thoraxjnl-2020-216086 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Garrigues E, Janvier P, Kherabi Y, et al. Post-discharge persistent symptoms and health-related quality of life after hospitalization for COVID-19. J Infect. 2020; 81(6): e4–e6. doi: 10.1016/j.jinf.2020.08.029 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Chopra V, Flanders SA, O’Malley M, Malani AN, Prescott HC. Sixty-Day Outcomes Among Patients Hospitalized with COVID-19. Ann Intern Med. 2021; 174(4): 576–578. doi: 10.7326/M20-5661 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Halpin SJ, McIvor C, Whyatt G, et al. Postdischarge symptoms and rehabilitation needs in survivors of COVID-19 infection: A cross-sectional evaluation. J Med Virol. 2021; 93(2): 1013–1022. doi: 10.1002/jmv.26368 . [DOI] [PubMed] [Google Scholar]
  • 17.COVID-19 Treatment Guidelines Panel. Coronavirus Disease 2019 (COVID-19) Treatment Guidelines. National Institutes of Health. Available at https://www.covid19treatmentguidelines.nih.gov/. [PubMed]
  • 18.Matias-Guiu JA, Clínico San Carlos H, Muñiz-Castrillo S, et al. The Neurologic Manifestations of Coronavirus Disease 2019 Pandemic: A Systemic Review. Front Neurol. 2020; 11: 498. doi: 10.3389/fneur.2020.00498 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Harvey MA, Davidson JE. Postintensive Care Syndrome: Right Care, Right Now…and Later. Crit Care Med. 2016; 44(2): 381–385. doi: 10.1097/CCM.0000000000001531 . [DOI] [PubMed] [Google Scholar]
  • 20.Grasselli G, Zangrillo A, Zanella A, et al. Baseline Characteristics and Outcomes of 1591 Patients Infected With SARS-CoV-2 Admitted to ICUs of the Lombardy Region, Italy. JAMA. 2020. Apr 28;323(16):1574–1581. doi: 10.1001/jama.2020.5394 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.RECOVERY Collaborative Group, Horby P, Lim WS, et al. Dexamethasone in Hospitalized Patients with Covid-19. N Engl J Med. 2021. Feb 25;384(8):693–704. doi: 10.1056/NEJMoa2021436 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Peach BC, Valenti M, Sole ML. A Call for the World Health Organization to Create International Classification of Disease Diagnostic Codes for Post-Intensive Care Syndrome in the Age of COVID-19. World Med Health Policy. 2021. Feb 22: doi: 10.1002/wmh3.401 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.García-Pachón E, et al. Asthma and COPD in Hospitalized COVID-19 Patients. Arch Bronconeumol. 2020; 56(9): 604–606. doi: 10.1016/j.arbres.2020.05.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Yamaya M, et al., Inhibitory effects of glycopyrronium, formoterol, and budesonide on coronavirus HcoV-229E replication and cytokine production by primary cultures of human nasal and tracheal epithelial cells. Respir Investig. 2020; 58(3): 155–168. doi: 10.1016/j.resinv.2019.12.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Bohmwald K, Gálvez NMS, Ríos M, et al. Neurologic Alterations Due to Respiratory Virus Infections. Front Cell Neurosci. 2018; 12: 386. doi: 10.3389/fncel.2018.00386 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Steardo L, Steardo L, Zorec R, Verkhratsky A. Neuroinfection may contribute to pathophysiology and clinical manifestations of COVID-19. Acta Physiol. 2020; 229(3): e13473. doi: 10.1111/apha.13473 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Lacovazzo C, Vargas M, Tedeschi E, de Simone A, Brunetti A, Servillo G. Diffuse functional brain disconnection syndrome in critically ill patients with COVID-19. J Infect Public Health. 2021; 14(7): 906–909. doi: 10.1016/j.jiph.2021.05.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Nalbandian A, Sehgal K, Gupta A, et al. Post-acute COVID-19 syndrome. Nat Med. 2021; 27(4): 601–615. doi: 10.1038/s41591-021-01283-z . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Sankowski R, Mader S, Valdés-Ferrer SI. Systemic inflammation and the brain: Novel roles of genetic, molecular, and environmental cues as drivers of neurodegeneration. Front Cell Neurosci. 2015; 9: 28. doi: 10.3389/fncel.2015.00028 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Young GB. Encephalopathy of infection and systemic inflammation. J Clin Neurophysiol. 2013. Oct;30(5):454–61. doi: 10.1097/WNP.0b013e3182a73d83 . [DOI] [PubMed] [Google Scholar]
  • 31.Mao L, Wang M, Chen S, et al. Neurological Manifestations of Hospitalized Patients with COVID-19 in Wuhan, China: a retrospective case series study. JAMA Neurol. 2020; 77(6): 683–690. doi: 10.1001/jamaneurol.2020.1127 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Sasannejad C, Ely EW, Lahiri S. Long-term cognitive impairment after acute respiratory distress syndrome: A review of clinical impact and pathophysiological mechanisms. Crit Care. 2019; 23(1): 352. doi: 10.1186/s13054-019-2626-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Douaud G, Lee S, Alfaro-Almagro F, et al. Brain imaging before and after COVID-19 in UK Biobank. medRxiv. 2021: 2021.06.11.21258690. doi: 10.1038/s41586-022-04569-5 [DOI] [Google Scholar]
  • 34.Toeback J, Depoortere SD, Vermassen J, Vereecke EL, van Driessche V, Hemelsoet DM. Microbleed patterns in critical illness and COVID-19. Clin Neurol Neurosurg. 2021; 203: 106594. doi: 10.1016/j.clineuro.2021.106594 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.De Stefano P, Nencha U, de Stefano L, Mégevand P, Seeck M. Focal EEG changes indicating critical illness associated cerebral microbleeds in a Covid-19 patient. Clin Neurophysiol Pract. 2020; 5: 125–129. doi: 10.1016/j.cnp.2020.05.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Kremer S, Lersy F, de Sèze J, et al. Brain MRI findings in severe COVID-19: A retrospective observational study. Adiology. 2020; 297(2): E242–E251. doi: 10.1148/radiol.2020202222 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Hao F, Tan W, Jiang L, et al. Do psychiatric patients experience more psychiatric symptoms during COVID-19 pandemic and lockdown? A case-control study with service and research implications for immunopsychiatry. Brain Behav Immun. 2020; 87: 100–106. doi: 10.1016/j.bbi.2020.04.069 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Bo HX, Li W, Yang Y, et al. Posttraumatic stress symptoms and attitude toward crisis mental health services among clinically stable patients with COVID-19 in China. Psychol Med. 2021; 51(6): 1052–1053. doi: 10.1017/S0033291720000999 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Yin R, Feng W, Wang T, et al. Concomitant neurological symptoms observed in a patient diagnosed with coronavirus disease 2019. J Med Virol. 2020; 92(10): 1782–1784. doi: 10.1002/jmv.25888 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Lee SH, Shin HS, Park HY, et al. Depression as a mediator of chronic fatigue and post-traumatic stress symptoms in middle east respiratory syndrome survivors. Psychiatry Investig. 2019; 16(1): 59–64. doi: 10.30773/pi.2018.10.22.3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Moldofsky H, Patcai J. Chronic widespread musculoskeletal pain, fatigue, depression and disordered sleep in chronic post-SARS syndrome; a case-controlled study. BMC Neurol. 2011; 11: 37. doi: 10.1186/1471-2377-11-37 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Mrcpsych R, Lewis G, London S, et al. Psychiatric and neuropsychiatric presentations associated with severe coronavirus infections: a systematic review and meta-analysis with comparison to the COVID-19 pandemic. Lancet Psychiatry. 2020; 7(7): 611–627. doi: 10.1016/S2215-0366(20)30203-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Wu Y, Xu X, Chen Z, et al. Nervous system involvement after infection with COVID-19 and other coronaviruses. Brain Behav Immun. 2020; 87: 18–22. doi: 10.1016/j.bbi.2020.03.031 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Bein T, Bienvenu OJ, Hopkins RO. Focus on long-term cognitive, psychological and physical impairments after critical illness. Intensive Care Med. 2019; 45(10): 1466–1468. doi: 10.1007/s00134-019-05718-7 . [DOI] [PubMed] [Google Scholar]
  • 45.Deng J, Zhou F, Hou W, et al. The prevalence of depression, anxiety, and sleep disturbances in COVID-19 patients: a meta-analysis. Ann N Y Acad Sci. 2021; 1486(1): 90–111. doi: 10.1111/nyas.14506 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Falvey JR, Cohen AB, O’Leary JR, et al. Association of Social Isolation With Disability Burden and 1-Year Mortality Among Older Adults With Critical Illness. JAMA Intern Med. 2021. Nov 1;181(11):1433–1439. doi: 10.1001/jamainternmed.2021.5022 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Wang Y, Shi L, Que J, et al. The impact of quarantine on mental health status among general population in China during the COVID-19 pandemic. Mol Psychiatry. 2021. Sep;26(9):4813–4822. doi: 10.1038/s41380-021-01019-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Irwin MR, Piber D. Insomnia and inflammation: a two hit model of depression risk and prevention. World Psychiatry. 2018. Oct;17(3):359–361. doi: 10.1002/wps.20556 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Mohammad NS, Nazli R, Zafar H, Fatima S. Effects of lipid based Multiple Micronutrients Supplement on the birth outcome of underweight pre-eclamptic women: A randomized clinical trial. Pak J Med Sci. 2022. Jan-Feb;38(1):219–226. doi: 10.12669/pjms.38.1.4396 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Acute Respiratory Distress Syndrome Network, Brower RG, Matthay MA, et al. Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. N Engl J Med. 2000. May 4;342(18):1301–8. doi: 10.1056/NEJM200005043421801 . [DOI] [PubMed] [Google Scholar]
  • 51.Shah FA, Girard TD, Yende S. Limiting sedation for patients with acute respiratory distress syndrome-time to wake up. Curr Opin Crit Care. 2017; 23(1): 45–51. doi: 10.1097/MCC.0000000000000382 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Strøm T, Toft P. Sedation and analgesia in mechanical ventilation. Semin Respir Crit Care Med. 2014. Aug;35(4):441–50. doi: 10.1055/s-0034-1382156 . [DOI] [PubMed] [Google Scholar]
  • 53.Shehabi Y, Bellomo R, Reade MC, et al. Early intensive care sedation predicts long-term mortality in ventilated critically ill patients. Am J Respir Crit Care Med. 2012. Oct 15;186(8):724–31. doi: 10.1164/rccm.201203-0522OC . [DOI] [PubMed] [Google Scholar]
  • 54.National Heart, Lung, and Blood Institute Acute Respiratory Distress Syndrome (ARDS) Clinical Trials Network, Wiedemann HP, Wheeler AP, Bernard GR, et al. Comparison of Two Fluid-Management Strategies in Acute Lung Injury. N Engl J Med. 2006. Jun 15;354(24):2564–75. doi: 10.1056/NEJMoa062200 . [DOI] [PubMed] [Google Scholar]
  • 55.Pun BT, Balas MC, Barnes-Daly MA, et al. Caring for Critically Ill Patients with the ABCDEF Bundle: Results of the ICU Liberation Collaborative in Over 15,000 Adults. Crit Care Med. 2019; 47(1): 3–14. doi: 10.1097/CCM.0000000000003482 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Bautista L, Esparza MM, Ortega J, Las úlceras por presión en pacientes sometidos a ventilación mecánica en la Unidad de Cuidados Intensivos e Intermedios del INER. Rev Inst Nal Enf Resp Mex. 2004; 17 (2): 91–99. [Google Scholar]
  • 57.Ely EW. The ABCDEF bundle: Science and philosophy of how ICU liberation serves patients and families. Crit Care Med. 2017; 45(2): 321–330. doi: 10.1097/CCM.0000000000002175 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Nishida O, Ogura H, Egi M, et al. The Japanese Clinical Practice Guidelines for Management of Sepsis and Septic Shock 2016 (J-SSCG 2016). Acute Med Surg. 2018; 5(1): 3–89. doi: 10.1002/ams2.322 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Tipping CJ, Harrold M, Holland A, et al. The effects of active obilization and rehabilitation in ICU on mortality and function: a systematic review. Intensive Care Med. 2017; 43(2): 171–183. doi: 10.1007/s00134-016-4612-0 . [DOI] [PubMed] [Google Scholar]
  • 60.Needham DM, Korupolu R, Zanni JM, et al. Early Physical Medicine and Rehabilitation for Patients With Acute Respiratory Failure: A Quality Improvement Project. Arch Phys Med Rehabil. 2010; 91(4): 536–542. doi: 10.1016/j.apmr.2010.01.002 . [DOI] [PubMed] [Google Scholar]
  • 61.Morris PE, Griffin L, Berry M, et al. Receiving early mobility during an intensive care unit admission is a predictor of improved outcomes in acute respiratory failure. Am J Med Sci. 2011; 341(5): 373–377. doi: 10.1097/MAJ.0b013e31820ab4f6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Chun XL, Jiang J, Qi GZ, et al. Voluntary exercise-induced neurogenesis in the postischemic dentate gyrus is associated with spatial memory recovery from stroke. J Neurosci Res. 2007; 85(8): 1637–1646. doi: 10.1002/jnr.21317 . [DOI] [PubMed] [Google Scholar]
  • 63.Ploughman M, Windle V, MacLellan CL, White N, Doré JJ, Corbett D. Brain-derived neurotrophic factor contributes to recovery of skilled reaching after focal ischemia in rats. Stroke. 2009; 40(4): 1490–1495. doi: 10.1161/STROKEAHA.108.531806 . [DOI] [PubMed] [Google Scholar]
  • 64.Bullitt E, Rahman FN, Smith JK, et al. The effect of exercise on the cerebral vasculature of healthy aged subjects as visualized by MR angiography. AJNR Am J Neuroradiol. 2009; 30(10): 1857–63. doi: 10.3174/ajnr.A1695 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Nydahl P, Sricharoenchai T, Chandra S, et al. Safety of Patient Mobilization and Rehabilitation in the IntensiveCare UnitSystematic Review with Meta-Analysis. Ann Am Thorac Soc. 2017; 14(5): 766–777. doi: 10.1513/AnnalsATS.201611-843SR . [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Shweta Rahul Yemul Golhar

17 Mar 2022

PONE-D-21-28914Comparison between the persistence of post COVID-19 symptoms on critical patients requiring invasive mechanical ventilation and non-critical patients.PLOS ONE

Dear Dr. Salazar-Lezama,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

 Long haul COVID is indeed of rising concern and a significant burden to the healthcare system in future. I commend the authors on researching on this important area of interest. Even thought the study does not add to the existing knowledge it helps to solidify previously proven factors of interest in long COVID. Having said that, there are several concerns that need addressing:

As reviewer 1 suggested, please clarify the documentation of the telephonic consent obtained and if the data was collected before the ethical committee approval. Some of the language need rephrasing to clarify the meaning like the O2 saturation at arrival. Indicate definitions for long COVID, severe infection, obesity, smoking and other conditions.

Please provide questionnaire as a part of the supplements.

Also clarify that the 2 groups are 1. Critical care pts requiring mechanical ventilation and if the other group was critical patients in ICU not requiring MV or were they pts admitted to hospital but not in ICU.

The most compelling question that cannot be answered by this study is the presence of symptoms of PICS and long COVID, the authors need to further highlight that this needs further research and is a limitation of this study. A better clarification as indicated by reviewer 3 of the timing of evaluation would be useful. Change in the analysis of available data to include time to event analysis and symptom free days would make the data more clinically useful.

The detailed review comments and questions raised and included for your reference and for your response.

Please submit your revised manuscript by May 01 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Shweta Rahul Yemul Golhar, MD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please include your full ethics statement in the ‘Methods’ section of your manuscript file. In your statement, please include the full name of the IRB or ethics committee who approved or waived your study, as well as whether or not you obtained informed written or verbal consent. If consent was waived for your study, please include this information in your statement as well.

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

4. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

5. One of the noted authors is a group or consortium “Occupational Health and Preventive Medicine Consortium”. In addition to naming the author group, please list the individual authors and affiliations within this group in the acknowledgments section of your manuscript. Please also indicate clearly a lead author for this group along with a contact email address.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors followed-up 280 patients that recovered from COVID19 during the period of December 23rd 2020 to April 24th 2021 and reported long-term symptoms associated with COVID19. While this study is important and I would encourage studies like this to be published to get more information on the long-term impact of COVID19 in human health; I would suggest a major revision for this study.

Firstly, I identified a major ethical issue. Study-participants did not sign a consent form even when they went to clinic for evaluation. The authors state that a verbal consent was obtained, but this cannot be verified. Also, data were collected before the authors got an approval from the ethics committee. Good Clinical Practice (GCP) dictates that the study protocol get approval by the institutional review board before any study data are collected or accessed. The researchers need to make sure that their study meets the international ethical standards.

Line 66-68: The percentages are misleading. They refer to certain areas and not the global levels. Needs to be corrected either have percentages that depict the global impact or focus on specific areas of the world.

Line 74: the authors refer to Long-Term COVID-19, please elaborate. Do you mean that these people had COVID-19 infection for long period of time or that the side effects after COVID-19 infection lasted for long time?

Line 93: Please elaborate on the criteria for severe infection. Since these may differ in different parts of the world this need to be defined.

Line 95: For the patients that had the PCR test do you have data on the corona virus strain? If yes it would be interesting to see if these long-term symptoms are associated with certain corona virus strain.

Line 110: Please provide the questionnaire that was used to these patients. Did this questionnaire got approval from the ethics committee before given to the study-participants?

Line 113: Please elaborate on the clinical examination. What did it include? What were the complementary examinations?

Line 116: What was the condition of these patients at baseline before COVID19? Are the symptoms described de novo for these patients?

Line 123: Musculoskeletal symptoms is this due to prolonged hospitalization? Not directly related to COVID19 infection.

Line 127: There is an increase of anxiety and depression cases in global level due to socioeconomical changes that happened during the pandemic. Not directly related to the infection.

Line 166: Oxygen saturation was ranging from 20 to 97%? It is not clear. Did you measure oxygen saturation to only 73.45% of the patients? I am not sure why oxygen saturation hasn’t been reported for all the patients.

Line 171: Only 12.5% of the patients were previously healthy. It would be interesting to see the comparison of the long-term symptoms of COVID19 infection to healthy patients versus the patients with preexisting conditions.

Line 174: I am not sure if this is indeed gender-related. This could be attributed to a high % of men with pre-existing conditions.

Line 193: Gender oriented analysis is needed. Did you see differences in these symptoms between men and women?

Intubated and non-intubated is not the only variable here. I am assuming that the patients that had to be intubated must have had pre-existing conditions, so the differences reported between the two groups could be expected.

What were the treatments these participants received during their hospitalization? Could some of the reported symptoms be attributed to the high-doses of steroid treatments? You could group your patients based on the treatment received and correlate the long-term symptoms after hospitalization.

The authors collected valuable data that could give us an insight on the long-term health impact of COVID19 infection, however its is important to take under consideration the multiple factors that could have contributed to the symptoms described.

Reviewer #2: Summary: Irisson-Mora et al. have conducted an interesting study comparing the long-term sequelae of COVID-19 between hospitalized patients who required mechanical ventilation and hospitalized patients that did not. The authors administered a survey to patients with confirmed COVID at 6 months after discharge that captured 8 domains of symptoms and compared the prevalence of symptoms between groups. They found that mechanically ventilated patients, unsurprisingly, had a very high prevalence of persistent symptoms at 6 months (98%), and had higher odds of developing neuropsychiatric and musculoskeletal symptoms that patients that were not mechanically ventilated. The strength of the study is that seems to be well designed with appropriate statistical analysis. The major limitation of the study is the lack of novelty of the results, which may be rectified by some discussion about how the findings in this cohort compare to what is expected in patients who suffer from post intensive care unit syndrome not due to COVID-19.

Major revisions:

1) While there is some novelty in these findings as the time frame is somewhat longer than other studies of the long-haul COVID and more focus on neuro-psychiatric symptoms, the main conclusions of the study are unsurprising, and many of them have been reported previously (PMID: 34308300, PMID: 34308300). A strength of this is that it increases confidence in the findings, but a major limitation is that it does not seem to add new knowledge to aid in prognosis and understanding the pathophysiology of this phenomenon. Including some discussion comparing how the findings of this cohort differ from what others have found may rectify this somewhat, but if there are no major differences in the findings of this cohort and previous studies, it is difficult to see how this contributes anything novel.

2) Additionally, it’s not clear how many of these persistent symptoms are related to the general phenomenon of post-intensive care unit syndrome (PICS), and how many of these symptoms are related specifically to SARS-CoV-2 infection. The authors acknowledge that many of their reported findings are consistent with the general phenomenon of PICS in lines 258-259, but do not expound on this further. Exploring the differences here would be interesting and increase the novelty of the findings, as differences could give some insight into how SARS-CoV-2 infection specifically impacts and modifies PICS.

3) There has been a lot of work into the development of appropriate survey instruments and outcome measures for the study of PICS (PMID: 34025756; PMID: 30600222; PMID: 30600222). While the domains and measures listed by the authors do seem reasonable, it would be helpful to know more detail about how this survey was developed and whether validated metrics and questionnaires were used, and if not, what validation process and testing went into the questionnaire design. Additionally, including the survey instrument with the questions listed in the supplement would be helpful.

Minor revisions:

1) A description of the criteria for pneumopathy (Lines 176 and 261, and Table 1) would be helpful. Are there formal criteria with pulmonary function testing or is this anyone with a history of lung disease?

2) In Figure 3 legend, specifying the methods used to determine significant differences would be helpful, are the p-values listed for single variable or multivariable analysis?

3) The language in the manuscript is clear but line 146 (“we dumped it into a database”) might benefit from different language that better describes the hard work and care that the authors put into the analysis.

Reviewer #3: This paper asks an important question related to COVID-19: Of the critically ill patients, how many have residual deficits between 2 weeks and 6 months after discharge, and do patients who had received invasive mechanical ventilation (IMV) have more significant residual deficits compared to those who did not receive mechanical ventilation? This is a prospective, single center observational study with what is likely an adequate sample size (although power calculations were not included). However, there are some concerns, especially related to analytical approach, that I would recommend addressing-

Major comments

- It is not clear from the manuscript the timing of reported symptoms (e.g. in page 16 you state "at of evaluation")- are they all present at 6 months? Were they reported at 2 weeks but dissipated by 6 months? Something in between? Assuming some patients reported symptoms at 3 weeks and other at 5 months and everything in between, this lack of temporal resolution leads to less specific findings, which end up being less clinically meaningful. As a physician, I would not know how to use these results to advise patients- will the symptoms that they have reported 2 weeks after discharge persist for much longer? If they don't have symptoms now, will they develop them later? I couldn't tell. Is there a difference in time course depending on what symptom was reported (eg do PTSD last longer than the paresthesias?). I would try to be more specific about time course.

- In addition, given the nature of the measured outcome, I would have used time to event analysis (eg time to symptom resolution) to compare those who received IMV vs. not. I would also include "symptom free days" for chosen symptoms in the analysis for an evaluation with less time and death related confounding. If this is done, please add a time to event graph to the figures as this would be more informative than binary bar graphs.

- If possible, please state whether there is a difference in baseline characteristics between patients excluded from the study vs. those who were included.

- In page 9, when there is a statement about whether IMV was affected by smoking and other co-morbities, please realize that there are several more nuanced analyses in the literature that report that smoking, age, obesity and other comorbidities indeed are associated with higher odds of intubation. These analyses included multivariable analysis while the statement made in this manuscript were evaluated by chi-square only. I would temper the statements re: conclusions from table 1 given the limited analysis provided here.

- There are some claims in the discussion that lack sufficient evidence from the results that I would therefore recommend rephrasing or removing. For example, in page 20, the statements made in lines 313-318 lack any evidence from the result section and lack any citations. I would remove this paragraph or at least significantly shorten it. Other paragraphs utilize several lines reviewing the literature without direct connection to the contents of the manuscript and should also be shortened or removed.

Minor comments

- There are several grammatical and lexicon mistakes that need to be corrected- a repeat issue is the use of "sequels" instead of the correct term, "sequelae". In page, 7, I would avoid the use of the colloquialism "dumped" into a scientific publication. Likewise, in page 20, the phrase "the hole COVID hospitalization picture" (lines 314-315) has a typo and is not specific enough for a scientific journal.

- Please add error bars to all bar graphs.

- Regarding symptoms reported, it would be useful to have a table (can be in supplemental materials) defining the symptoms reported- eg, pneumopathy, fatigue, sweat, diarrhea, constipation, cognitive impairments. Were these all subjectively reported or were there an objective measure for some of them? For neuropathic pain, was there a correlation with placement of A line or other procedures? was it generalized neuropathic pain?

-Likewise, please define risk factors such as smoking history (minimum packs a day? ever or never smoker?), biomass exposure, obesity, and past medical history (were they just extracted from the chart? reported by patients?).

- In line 326-327, usually "tidal volume minimization", which I assume to mean protective mechanical ventilation, will actually decrease oxygenation with the benefit of improved mortality. Decreasing tidal volume will prevent alveolar damage, protect barrier function and mitigate the local release of pro-inflammatory cytokines, but it usually does not improve oxygenation. Please rephrase.

- There is an important point in the discussion re: better outcomes in patients who receive physical therapy (PT). If available, it would be very insightful to report how many patients received PT in the ICU. A comparison in outcomes between those receiving PT v not would be very interesting. A statement comparing the percentage of patients with COVID who received PT vs. historical numbers pre pandemic would be enough to highlight the issues re:access to standard ICU care in this population.

- In the conclusion, or maybe in the discussion, one could also mention the likely importance of lighter sedation goals to outcomes, and cite the appropriate sources.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes: Ana Carolina Costa Monteiro

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PONE-D-21-28914_reviewer comments.pdf

Attachment

Submitted filename: PONE-D-21-28914_Review.docx

PLoS One. 2022 Aug 22;17(8):e0273041. doi: 10.1371/journal.pone.0273041.r002

Author response to Decision Letter 0


14 Jun 2022

Reviewer #1

1.-Firstly, I identified a major ethical issue. Study-participants did not sign a consent form even when they went to clinic for evaluation. The authors state that a verbal consent was obtained, but this cannot be verified. Also, data were collected before the authors got an approval from the ethics committee. Good Clinical Practice (GCP) dictates that the study protocol get approval by the institutional review board before any study data are collected or accessed. The researchers need to make sure that their study meets the international ethical standards.

A: We believe this is a misunderstanding.

All patients discharged from the hospital with COVID-19 diagnosis were followed up by a telephone call, that’s why we described a cohort study. Since patients come from all around the country and due mostly to economic issues, it is impossible for the majority of them to return to this hospital, so the post-COVID clinic calls patients in order to apply a questionary (developed by physicians in this area, not a validated test) to all of discharged ones. During this call, verbal consent is obtained, in order to apply this questionnaire, and if they had any persistent symptoms or associated pathology that requires follow up, they are asked to come back to the hospital, where physical exam and if required, other tests are performed. All data, are collected in the physical chart and electronic data system of our hospital.

Our study consisted in a chart and electronic review (descriptive, transversal and observational), with approval of the Institution Ethics committee (C22-21) before any data was collected. No consent form was required for this kind of study.

Changes have been made in the design and methods section in order to clarify this point.

2.-Line 66-68: The percentages are misleading. They refer to certain areas and not the global levels. Needs to be corrected either have percentages that depict the global impact or focus on specific areas of the world.

A: The risk of serious illness reported in countries such as China and the United States varies from 12.6 to 23.5%, and the rate of invasive mechanical ventilation (IMV) among these patients ranges 68 from 29.1 to 89.9%.

Changes have been made to the introduction section to clarify this point.

3.- Line 74: the authors refer to Long-Term COVID-19, please elaborate. Do you mean that these people had COVID-19 infection for long period of time or that the side effects after COVID-19 infection lasted for long time?

A: The term prolonged post-COVID-19 describes persistent symptoms following hospitalization from COVID-19 illness. All of our study patients already had a negative polymerase chain reaction (PCR) test for SARS COV2.

Changes have been made to the introduction section to clarify this point.

4.-Line 93: Please elaborate on the criteria for severe infection. Since these may differ in different parts of the world this need to be defined.

A: Criteria for severe disease were those defined by the WHO (SpO 2 <94%, ratio of arterial partial pressure of oxygen to fractional inspired oxygen (PaO 2 /FiO 2 ) <300 mmHg, respiratory rate >30 breaths/min or pulmonary infiltrates >50%).

Changes have been made in the design and methods section in order to clarify this point.

5.-Line 95: For the patients that had the PCR test do you have data on the corona virus strain? If yes it would be interesting to see if these long-term symptoms are associated with certain corona virus strain.

Please provide the questionnaire that was used to these patients. Did this questionnaire got approval from the ethics committee before given to the study-participants?

A: The determination of the COVID-19 variant which patients were positive to was not performed. Changes have been made in the design and methods section in order to clarify this point.

As mentioned before, the questionnaire used in these patients was the one used routinely within the Institute, which was also included in the protocol approved by the ethics committee.

The questionnaire was included in complements.

6.-Line 113: Please elaborate on the clinical examination. What did it include? What were the complementary examinations?

A: Patients who attended the medical appointment in person underwent to a complete physical examination with special attention to the symptoms reported by the patient. The complementary examinations included laboratory tests and chest tomography based on the clinical findings evidenced during the examination.

Changes have been made in the design and methods section in order to clarify this point.

7.-Line 116: What was the condition of these patients at baseline before COVID19? Are the symptoms described de novo for these patients?

A: Only new symptoms reported after the patient's discharge were taken into consideration and included in the study.

8.- Line 123: Musculoskeletal symptoms is this due to prolonged hospitalization? Not directly related to COVID19 infection.

A: When performing the univariate and multivariable analysis between musculoskeletal symptoms and prolonged hospitalization time no statistically significant association was demonstrated (P=0.796), so they were directly attributed to COVID-19 infection.

9.- Line 127: There is an increase of anxiety and depression cases in global level due to socioeconomical changes that happened during the pandemic. Not directly related to the infection.

A: It is indisputable that these symptoms can be a hard to tell apart if whether they can be caused directly by COVID-19 or by the pandemic socioeconomical factors directly. However, it is important to emphasize that in our study they were attributed to post-COVID-19 symptoms, as they were referred by patients as post-hospitalization symptoms, being consistent with the current concept of prolonged COVID-19, so it is appropriate to define them within the spectrum of symptoms related to COVID-19.

10.- Line 166: Oxygen saturation was ranging from 20 to 97%? It is not clear. Did you measure oxygen saturation to only 73.45% of the patients? I am not sure why oxygen saturation hasn’t been reported for all the patients.

A: The percentage of 73.45% refers to the mean oxygen saturation measured by pulse oximetry and not to the number of patients. Changes have been made in the results section to clarify this point.

11.- Line 171: Only 12.5% of the patients were previously healthy. It would be interesting to see the comparison of the long-term symptoms of COVID19 infection to healthy patients versus the patients with preexisting conditions.

A: When performing the univariable and multivariable analysis among healthy patients against patients with previously diagnosed comorbidities, it was concluded that patients with comorbidities reported more respiratory (P=0 .037) and musculoskeletal (P=0.034) symptoms. Changes have been made in the results section to clarify this point.

12.-Line 174: I am not sure if this is indeed gender-related. This could be attributed to a high % of men with pre-existing conditions.

A: Although men had a greater tendency to be intubated (P=0.016), longer hospitalization time (P=0.028) and more comorbidities (P=0.031), no statistically significant differences were found in relation to any pre-existing comorbidity.

Changes have been made in the results section to clarify this point.

13.-Line 193: Gender oriented analysis is needed. Did you see differences in these symptoms between men and women?

Intubated and non-intubated is not the only variable here. I am assuming that the patients that had to be intubated must have had pre-existing conditions, so the differences reported between the two groups could be expected.

What were the treatments these participants received during their hospitalization? Could some of the reported symptoms be attributed to the high-doses of steroid treatments? You could group your patients based on the treatment received and correlate the long-term symptoms after hospitalization.

A: When performing the univariate analysis by gender, it was found that women had a greater exposure to biomass (24.2 vs 9.9%, P=0.002), higher prevalence of respiratory symptoms (71.9 vs 59.2, P=0.032), and dermatological symptoms (25.8 vs 9.2%, P=0 .000) compared to men.

Changes have been made in the results section to clarify this point.

We do not have data regarding the treatment received during patients’ hospitalization and its relation with long-term symptoms after COVID-19 infection, therefore they were not included in this study, which represents a limitation of our study and their inclusion would represent the objective from another job.

Reviewer #2

Major revisions:

1.-While there is some novelty in these findings as the time frame is somewhat longer than other studies of the long-haul COVID and more focus on neuro-psychiatric symptoms, the main conclusions of the study are unsurprising, and many of them have been reported previously (PMID: 34308300, PMID: 34308300). A strength of this is that it increases confidence in the findings, but a major limitation is that it does not seem to add new knowledge to aid in prognosis and understanding the pathophysiology of this phenomenon. Including some discussion comparing how the findings of this cohort differ from what others have found may rectify this somewhat, but if there are no major differences in the findings of this cohort and previous studies, it is difficult to see how this contributes anything novel.

A: Thank you for your comment, as you have mentioned, there are other longer studies evaluating the prevalence of COVID-19. However, most of these include patients from community settings, with mild or moderate COVID. The novelty of our study is that, as a reference center, we have a significant number of critically ill patients, a population in which long-term sequelae have not been sufficiently explored.

2.- It’s not clear how many of these persistent symptoms are related to the general phenomenon of post-intensive care unit syndrome (PICS), and how many of these symptoms are related specifically to SARS-CoV-2 infection. The authors acknowledge that many of their reported findings are consistent with the general phenomenon of PICS in lines 258-259, but do not expound on this further. Exploring the differences here would be interesting and increase the novelty of the findings, as differences could give some insight into how SARS-CoV-2 infection specifically impacts and modifies PICS.

A: COVID-19 critical patients may be predisposed to have a greater prevalence of PICS because of longer periods of mechanical ventilation, sedation and the use of steroids and sedative meditation for their treatment. Although PICS is known to be a common syndrome in patients that needed critical care, and there are a significant number of patients that required this kind of care due to COVID, the prevalence of PICS and its definition in patients with COVID is still not yet determined. Such is the case that in 2021 a call has been made to the World Health Organization (WHO) to develop International Classification of Disease Diagnostic Codes for PICS in the “Age of COVID-19” that incentive to care coordination in outpatient settings and to an effective post-acute treatment.

In the discussion section we have expanded the explanation underlying the mechanisms that may predispose critically ill COVID-19 patients to the persistence of the symptoms we found.

3.- There has been a lot of work into the development of appropriate survey instruments and outcome measures for the study of PICS (PMID: 34025756; PMID: 30600222; PMID: 30600222). While the domains and measures listed by the authors do seem reasonable, it would be helpful to know more detail about how this survey was developed and whether validated metrics and questionnaires were used, and if not, what validation process and testing went into the questionnaire design. Additionally, including the survey instrument with the questions listed in the supplement would be helpful.

A: The questionnaire used in these patients is the one that has been taken out routinely within the Institute since the start of the pandemic, and is included in the protocol approved by the ethics committee for inclusion in this study, available in supplements.

The domains captured in this tool were categorized into the following 8 symptom classes, depending on the organ system affected: [1] Respiratory symptoms, including dyspnea, chest pain, cough, sore throat, rhinorrhea, wheezing, vocal cord abnormalities ( hoarseness, chordal paralysis) and tracheal stenosis. [2] Cardiovascular symptoms such as clubbing, rhythm disturbances (palpitations, tachycardia, and bradycardia), heart murmur, pericarditis, elevated blood pressure, extremity edema, and deep inferior vein thrombosis. [3] Systemic symptoms, such as fever, dizziness, fatigue, asthenia, adynamia, sweating, pruritus, sensitivity to cold, and tremors. [4]. Musculoskeletal symptoms, such as paresthesias, mobility limitations, arthralgias, tendon injuries, myalgias, paresthesia, neuralgia, muscle weakness, low back pain and contractures. [5] Dermatologic symptoms, including hair loss, skin rashes, and pressure ulcers. [6] Neurological and neuropsychiatric symptoms, such as headache, sleep and wake disorders, cognitive disturbances such as poor concentration and memory loss, as well as anxiety disorders and/or depression. [7] Gastrointestinal symptoms, including nausea, diarrhea, constipation, abdominal pain, and lack of appetite. [8] Audiological symptoms, including tinnitus, ear pain, hearing loss, and vertigo. The impact of each domain on the participants' daily function was reported as present or absent.

Minor revisions:

1.- A description of the criteria for pneumopathy (Lines 176 and 261, and Table 1) would be helpful. Are there formal criteria with pulmonary function testing or is this anyone with a history of lung disease?

A: Included comorbidities were those previously diseases documented in the chart and self-reported by patients; pneumopathy was defined as a history of asthma, chronic obstructive pulmonary disease (COPD) and pulmonary fibrosis.

2.- In Figure 3 legend, specifying the methods used to determine significant differences would be helpful, are the p-values listed for single variable or multivariable analysis?

A: A univariate association analysis was performed using the Chi-square test or Fisher's exact test considering significant P values those less than 0.05. comparing intubated and non-intubated patients.

Changes have been made in the Figure legend to clarify this point.

3.- The language in the manuscript is clear but line 146 (“we dumped it into a database”) might benefit from different language that better describes the hard work and care that the authors put into the analysis.

A: The word “we dumped” was changed to “were collected on an Excel page”.

Changes have been made in the design and methods section in order to clarify this point.

Reviewer #3

Major comments:

1.- It is not clear from the manuscript the timing of reported symptoms (e.g. in page 16 you state "at of evaluation")- are they all present at 6 months? Were they reported at 2 weeks but dissipated by 6 months? Something in between? Assuming some patients reported symptoms at 3 weeks and other at 5 months and everything in between, this lack of temporal resolution leads to less specific findings, which end up being less clinically meaningful. As a physician, I would not know how to use these results to advise patients- will the symptoms that they have reported 2 weeks after discharge persist for much longer? If they don't have symptoms now, will they develop them later? I couldn't tell. Is there a difference in time course depending on what symptom was reported (eg do PTSD last longer than the paresthesias?). I would try to be more specific about time course.

A: We carried out a transversal study including persistent symptoms in the period of time that they attended the first medical evaluation after hospital discharge and that were present up to six months after discharge, these symptoms were included within the definition Late sequelae of SARS CoV-2 infection by lasting more than 4 weeks after initial infection or diagnosis, being consistent with the concept of prolonged COVID.

2.- In addition, given the nature of the measured outcome, I would have used time to event analysis (eg time to symptom resolution) to compare those who received IMV vs. not. I would also include "symptom free days" for chosen symptoms in the analysis for an evaluation with less time and death related confounding. If this is done, please add a time to event graph to the figures as this would be more informative than binary bar graphs.

A: Being our study a transversal study, we are not measuring the time from the event to the resolution of the symptoms. It would be interesting to carry out another study looking for the differences between the patients. However, its inclusion would represent the object of another study.

3.- If possible, please state whether there is a difference in baseline characteristics between patients excluded from the study vs. those who were included.

A: For logistical reasons, baseline characteristics among patients excluded from the study were not included.

4.- In page 9, when there is a statement about whether IMV was affected by smoking and other co-morbities, please realize that there are several more nuanced analyses in the literature that report that smoking, age, obesity and other comorbidities indeed are associated with higher odds of intubation. These analyses included multivariable analysis while the statement made in this manuscript were evaluated by chi-square only. I would temper the statements re: conclusions from table 1 given the limited analysis provided here.

A: When performing the univariable and multivariable analysis regarding comorbidities (P=.467) and risk factors such as smoking (P=.454), biomass exposure (P=.130) and alcoholism (P=.155) comparing intubated patients with non-intubated patients, no statistical significance was found.

5.- There are some claims in the discussion that lack sufficient evidence from the results that I would therefore recommend rephrasing or removing. For example, in page 20, the statements made in lines 313-318 lack any evidence from the result section and lack any citations. I would remove this paragraph or at least significantly shorten it. Other paragraphs utilize several lines reviewing the literature without direct connection to the contents of the manuscript and should also be shortened or removed.

A: Thank you for your comments. Added quotes from statements in discussion and reworded paragraph have been made.

Minor comments:

1.- There are several grammatical and lexicon mistakes that need to be corrected- a repeat issue is the use of "sequels" instead of the correct term, "sequelae". In page, 7, I would avoid the use of the colloquialism "dumped" into a scientific publication. Likewise, in page 20, the phrase "the hole COVID hospitalization picture" (lines 314-315) has a typo and is not specific enough for a scientific journal.

A: The corresponding grammatical corrections were made, from “sequels” to “sequelae”.

The word "we dumped" was changed to “were collected on an Excel page".

2.- Please add error bars to all bar graphs.

A: We added error bars to all charts.

3.- Regarding symptoms reported, it would be useful to have a table (can be in supplemental materials) defining the symptoms reported- eg, pneumopathy, fatigue, sweat, diarrhea, constipation, cognitive impairments. Were these all subjectively reported or were there an objective measure for some of them? For neuropathic pain, was there a correlation with placement of A line or other procedures? was it generalized neuropathic pain?

A: All signs and symptoms included were reported subjectively by the patients, the only objective measure being the physical examination performed during the medical evaluation.

4. Likewise, please define risk factors such as smoking history (minimum packs a day? ever or never smoker?), biomass exposure, obesity, and past medical history (were they just extracted from the chart? reported by patients?).

A: Risk factors such as smoking, exposure to biomass and alcoholism were reported as recorded in the patient's file and reported as present or absent.

5. In line 326-327, usually "tidal volume minimization", which I assume to mean protective mechanical ventilation, will actually decrease oxygenation with the benefit of improved mortality. Decreasing tidal volume will prevent alveolar damage, protect barrier function and mitigate the local release of pro-inflammatory cytokines, but it usually does not improve oxygenation. Please rephrase.

A: Some suggested acute-phase interventions for neurological protection include tidal volume minimization in ventilation setting strategies to improve cerebral blood flow and lower cerebral vascular resistance along with less inflammation.

The statement about minimizing tidal volume as a maneuver to improve mortality has been rephrased in the discussion.

6.- There is an important point in the discussion re: better outcomes in patients who receive physical therapy (PT). If available, it would be very insightful to report how many patients received PT in the ICU. A comparison in outcomes between those receiving PT v not would be very interesting. A statement comparing the percentage of patients with COVID who received PT vs. historical numbers pre pandemic would be enough to highlight the issues re:access to standard ICU care in this population.

A: Although it would be very enriching to include variables on in-hospital management, including physiotherapy during hospitalization, this study did not include this information since its objective was to describe persistent symptoms after hospital discharge and not the effect of interventions during hospitalization.

7.- In the conclusion, or maybe in the discussion, one could also mention the likely importance of lighter sedation goals to outcomes, and cite the appropriate sources.

A: The use of some sedative agents such as dexmedetomidine instead of benzodiazepines, less use of continuous deep sedation, along with and a conservative fluid management have also been proposed as useful interventions to maximize neurological function.

In the discussion section we have expanded the explanation to clarify this point.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Shweta Rahul Yemul Golhar

1 Jul 2022

PONE-D-21-28914R1Comparison between the persistence of post COVID-19 symptoms on critical patients requiring invasive mechanical ventilation and non-critical patients.PLOS ONE

Dear Dr. Miguel Angel Salazar-Lezama,<table border="0" cellpadding="0" cellspacing="0" class="datatable3" style="border-collapse: collapse; width: 677px; line-height: 14px; caret-color: rgb(0, 0, 51); color: rgb(0, 0, 51); font-family: verdana, geneva, arial, helvetica, sans-serif; font-size: 11.199999809265137px;">     </table>

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The authors have addressed most of the concerns raised by myself and the reviewers. The aspect of limitations of the study as raised by the reviewers is vital to bring forth so the reader understands the shortcomings of the assessment, hence I would advise the authors to add these limitations as requested by reviewer 3.

Please submit your revised manuscript by Aug 15 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Shweta Rahul Yemul Golhar, MD

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

Reviewer #3: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: The authors seem to have addressed most of my concerns, and I appreciated them adding the survey instrument to the supplement. I believe that the analysis and study design are technically sound.

Reviewer #3: Thank you for all your thorough responses to the comments. I would encourage the authors to add a paragraph in the discussion covering the limitations that could not be addressed by this study- namely, inability to discern a specific time line of symptoms as there was only one time point recorded, the fact that all symptoms were patient reported and lacked objective criteria for determination, and that this was an observational study with inherent bias regarding how symptoms were reported.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Aug 22;17(8):e0273041. doi: 10.1371/journal.pone.0273041.r004

Author response to Decision Letter 1


21 Jul 2022

We welcome comments raised by reviewers. The limitations of this study have already been added in the discussion section and the list of references was checked.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Shweta Rahul Yemul Golhar

2 Aug 2022

Comparison between the persistence of post COVID-19 symptoms on critical patients requiring invasive mechanical ventilation and non-critical patients.

PONE-D-21-28914R2

Dear Dr. Miguel Ángel Salazar-Lezama,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Shweta Rahul Yemul Golhar, MD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

I congratulate the authors on researching the complicated and challenging topic of long COVID. The research on this topic adds to our ever increasing knowledge and provides information to be able to manage the immense burden projected for years to come for healthcare. As we define the condition better and try to differentiate other chronic conditions like PICS, the similarities and differences should get clearer, helping us provide more specific care and better outcomes.

Reviewers' comments:

Acceptance letter

Shweta Rahul Yemul Golhar

5 Aug 2022

PONE-D-21-28914R2

Comparison between the persistence of post COVID-19 symptoms on critical patients requiring invasive mechanical ventilation and non-critical patients.

Dear Dr. Salazar-Lezama:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Shweta Rahul Yemul Golhar

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Permissions.

    Institutional ethics committee approval dictamen.

    (PDF)

    S2 Appendix. Systematized questionnaire of symptoms.

    (PDF)

    S1 File

    (SAV)

    Attachment

    Submitted filename: PONE-D-21-28914_reviewer comments.pdf

    Attachment

    Submitted filename: PONE-D-21-28914_Review.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES