Skip to main content
PLOS One logoLink to PLOS One
. 2022 Nov 23;17(11):e0278057. doi: 10.1371/journal.pone.0278057

Post-acute sequelae of COVID-19 among hospitalized patients in Estonia: Nationwide matched cohort study

Anna Tisler 1,*, Oliver Stirrup 2, Heti Pisarev 1, Ruth Kalda 1, Tatjana Meister 1, Kadri Suija 1, Raivo Kolde 3, Marko Piirsoo 4, Anneli Uusküla 1
Editor: Aqeel M Alenazi5
PMCID: PMC9683565  PMID: 36417409

Abstract

Background

Post-acute COVID-19 sequelae refers to a variety of health complications involving different organ systems that have been described among individuals after acute phase of illness. Data from unselected population groups with long-time follow up is needed to comprehensively describe the full spectrum of post-acute COVID-19 complications.

Methods

In this retrospective nationwide cohort study, we used data obtained from electronic health record database. Our primary cohort were adults hospitalized with confirmed COVID-19 and matched (age, sex, Charlson Comorbidity Index) unaffected controls from general population. Individuals included from February 2020 until March 2021 were followed up for 12 months. We estimated risks of all-cause mortality, readmission and incidence of 16 clinical sequelae after acute COVID-19 phase. Using a frailty Cox model, we compared incidences of outcomes in two cohorts.

Results

The cohort comprised 3949 patients older than 18 years who were alive 30 days after COVID-19 hospital admission and 15511 controls. Among cases 40.3% developed at least one incident clinical sequelae after the acute phase of SARS-CoV-2 infection, which was two times higher than in general population group. We report substantially higher risk of all-cause mortality (adjusted hazard ratio (aHR) = 2.57 (95%CI 2.23–2.96) and hospital readmission aHR = 1.73 (95%CI 1.58–1.90) among hospitalized COVID-19 patients. We found that the risks for new clinical sequalae were significantly higher in COVID-19 patients than their controls, especially for dementia aHR = 4.50 (95% CI 2.35–8.64), chronic lower respiratory disease aHR = 4.39 (95% CI 3.09–6.22), liver disease aHR 4.20 (95% CI 2.01–8.77) and other (than ischemic) forms of heart diseases aHR = 3.39 (95%CI 2.58–4.44).

Conclusion

Our results provide evidence that the post-acute COVID-19 morbidity within the first year after COVID-19 hospitalization is substantial. Risks of all-cause mortality, hospitalisation and majority of clinical sequelae were significantly higher in hospitalized COVID-19 patients than in general population controls and warrant targeted prevention efforts.

Introduction

SARS-CoV-2 (the cause of COVID-19) leads to high levels of morbidity and mortality among unvaccinated individuals, and the virus created a novel public health emergency with substantial burden on healthcare systems [1]. Since emerging in 2020 the virus has caused more than 500 million COVID-19 cases and 6 million deaths globally with one third reported from Europe [2]. More severe cases of COVID-19 and higher mortality were reported among older individuals, male, obese and those with comorbidities [3]. There is an increasing body of evidence reporting that COVID-19 patients are at substantially higher risk of death and hospital readmission and also continue to suffer from complications including persistent severe symptoms and organ dysfunction.

Post-acute COVID-19 syndrome is characterized by persistent symptoms and/or delayed or long-term complications beyond 4 weeks after acute phase [4]. Acute COVID-19 can potentially lead to new clinical events or exacerbate pre-existing (chronic) conditions. A study on an adult population in UK documented that older individuals, those having pre-existing medical conditions, and those admitted to hospital because of acute COVID-19 were at greatest excess risk for clinical sequelae after the acute phase of SARS-CoV-2 within the subsequent 6-month period [5]. A systematic review has shown that 10.3% of COVID-19 survivors required hospital readmission within one-year post-discharge, and the one-year post-discharge all-cause mortality rate of COVID-19 patients was 7.9% [6]. Hospital readmissions are a concern for public health as they impose additional burden on the healthcare system and demand more resources.

A large study including 273,618 COVID-19 survivors reported that there is association between severity of COVID-19 and incidence of long-COVID consequences: patients with more severe illness (hospitalization, intensive care unit (ICU) admission) had significantly more long-term effect overall [7]. It is critical that we describe and assess the likelihood of post-acute COVID-19 sequelae; also quantify / compare the consequences of COVID-19 survivors to that in comparable (age, gender, comorbidities) profile control groups, that allow the inference of counterfactual outcomes in order to be able to provide appropriate care and tailor treatment for those complications that are most often seen among patients. To address this need and generate new knowledge in this important area, we aimed to investigate the post-acute COVID-19 sequelae among hospitalized COVID-19 individuals up to 12 months to determine the incidence of all-cause mortality, readmissions and characteristics of new onset diseases following severe COVID-19 in Estonia.

Materials and methods

Data source

The data for this nationwide retrospective study was obtained from the Estonian Health Insurance Fund (EHIF), Estonian Health Board (EHB) and Estonian Causes of Death Registry (ECDR). The EHIF, EHB and ECDR are all population-based and nation-wide health/administration organizations. Unique personal identification codes which are assigned to all Estonian residents at birth or at the time of immigration were used for data linkage. Confirmed COVID-19 cases were those based on real-time polymerase chain reaction (PCR) testing on nasopharyngeal specimens by an accredited molecular diagnostics laboratory using certified methods [8]. Data on the date of SARS-CoV-2 RNA test and results were obtained from EHB. Personal information on gender and date of birth and health care utilization with dates of service, diagnostic codes based on International Statistical Classification of Diseases and Related Health Problems 10th Revision (ICD-10), were obtained from EHIF. As of December 2021, the EHIF contained information on 1 265 601 individuals or 94% of the Estonian population with insurance coverage.

Population and setting

We included data on all people aged 18 and over who tested positive for SARS-CoV-2 during the first year of the COVID-19 epidemic (26 February 2020 to 28 February 2021) and were hospitalized during the acute phase of COVID-19. For the current study we refer to the date of the first positive SARS-CoV-2 test as the index date. Individuals with COVID-19 entered the cohort on the index date. In our study we focused on the pre-vaccination period of the pandemic, so we included individuals with the index dates before mass vaccination in February 2021. Participants with COVID-19 who were admitted to a hospital within 30 days after or 7 days before their positive SARS-CoV-2 test were considered as cases. Those cases who died during acute phase of disease meaning during 30 days of the hospitalization were excluded.

Using EHIF listing as a matching source up to four controls for each case were selected. Eligible for matching were those without evidence of SARS-CoV-2 infection at the index date of each case, were alive and without evidence of SARS-CoV-2 at and during 30 days of case hospitalization. Controls were matched to COVID-19 cases based on a combination of age, gender, Charlson Comorbidity Index score (CCI) and index date. Patients aged 18 and older were matched within 10 years and those aged 60 and older within 5 years from individual case. There was a random selection without replacement among eligible controls for each case done. Index date was divided on 3-month periods (until May 2020, June-August 2020, September-November 2020, December-February 2021). The CCI was calculated using medical claims one-year prior to index date containing 16 comorbidities and classified according to Charlson et al [9]. There was a random selection without replacement among eligible controls for each case. We followed all study subjects for up to 12 months starting from 30 days after discharge until the study end (November 15th, 2021), death, diagnosis of the relevant outcome in each analysis or SARS-CoV-2 positive test in control group.

Outcomes

We aimed to estimate the burden of post-acute COVID-19 sequalae in a cohort of hospitalized SARS-coV-2 positive patients in comparison to infection-free controls from general population. We also explored whether the severity of COVID-19 infection, as proxied by hospitalization and intensive care unit (ICU) admission, affects the risks. The main outcomes were all-cause mortality and all-cause hospital (re)admission. All-cause mortality was defined as death from all causes during study follow-up; all-cause hospital readmission was defined as hospital admission after discharge for COVID-19 for cases, which was compared to hospital admissions in controls. Secondary outcomes were new-onset (incident episodes) of selected clinical conditions identified based on primary ICD-10 codes a (respiratory diseases, heart diseases, stroke, neurological illness, diabetes, chronic kidney, liver disease or mental disorder) appearing at least once on the medical bill. Table including ICD-10 codes used to define an outcomes are presented in (S1 Table). Incident outcome refers to the occurrence of new case of any of the selected health conditions over a follow-up period for an individual who had not had this condition before (the index date) (recall period of 3 years). Intensive care episode during follow up was captured by admission to intensive care unit on medical bill (health insurance claim).

Covariates

Covariates for analyses included age, preexisting comorbidities, and indicators of pre-COVID-19 healthcare utilization, such as number of outpatient encounters and number of hospital admissions. Pre-COVID-19 comorbidities were captured using ICD-10 codes for the 3*365-day period prior to the index date for case patients and their matched controls from medical bills. Comorbidities were defined as primary or other diagnoses coded at the claim and/or diagnoses of any type on hospital or outpatient health care claims during the three years preceding the index. We applied a restriction to outpatient claims, such that a comorbid condition could be flagged during the preceding period only if it appeared two or more times at least 7 days apart [10]. In the final model we accounted for comorbidities with the prevalence higher than 5% (Table 1).

Table 1. Baseline descriptive characteristics of patients who were hospitalized with COVID-19 and matched general population controls during 2020–2021 in Estonia.

Characteristics COVID-19 hospitalized cases
n = 3949
Matched controls
n = 15 511
p value
Age, mean SD;y 65.4 (16.7) 64.9 (16.8) 0.04
Sex; n% female 2147 (54.3) 8413 (54.2) 0.9
Follow up days, mean (SD) 294.9 (73.6) 309.6 (46.6) <0.0001
Charlson comorbidity index
0
1–2 mild
3–4 moderate
5+ severe

2641(66.8)
1141(28.9)
148 (3.8)
19 (0.5)

10511 (67.8)
4424 (28.5)
527 (3.4)
49 (0.3)
0.25
Charlson comorbidity index, mean (SD) 0.5 (0.9) 0.5 (0.9)
Hospital admissions 0.7 (1.6) 0.3 (0.8) <0.0001
Outpatient encounters 10.6 (8.4) 7.5 (7.5) <0.0001
Pre-existing comorbidities; n (%)
Anxiety 306 (7.8) 985 (6.4) 0.002
Chronic kidney disease 250 (6.3) 620 (4.0) <0.0001
Chronic lower respiratory disease 592 (14.9) 1613 (10.4) <0.0001
Chronic liver disease 116 (2.9) 306 (1.9) <0.0001
Dementia 154 (3.9) 271 (2.7) <0.0001
Disorders involving immune mechanism 18 (0.5) 27 (0.2) 0.001
Disorder of lipoprotein 805 (20.4) 2727 (17.6) <0.0001
Diabetes mellitus
    Type 1 diabetes 64 (1.6) 170 (1.0) 0.007
    Type 2 diabetes 763 (19.3) 2344 (15.1) <0.0001
Gastritis and duodenitis 506 (12.8) 1456 (9.39) <0.0001
Guillain-Barré 2 (0.05) 6 (0.04) 0.74
Hypothyroidism 322 (8.2) 946 (6.1) <0.0001
Hypertension 2539 (64.3) 8062 (51.9) <0.0001
Insomnia 121 (3.1) 285 (1.8) <0.0001
Ischemic heart disease 638 (16.2) 1991 (12.8) <0.0001
Mood disorders 257 (6.5) 790 (5.1) <0.0001
Neoplasms 907 (22.9) 3091 (19.9) <0.0001
Obesity 495 (12.5) 1001 (6.5) <0.0001
Other forms of heart diseases 1100 (27.9) 3460 (22.3) <0.0001
Organ transplant 33 (0.8) 44 (0.3) <0.0001
Stroke 153 (3.9) 425 (2.7) <0.0001
Substance abuse 92 (2.3) 206 (1.3) <0.0001
Schizophrenia 85 (2.2) 142 (0.9) <0.0001
Multiple sclerosis 2 (0.005) 22 (0.1) 0.145

Statistical analysis

Distribution of baseline characteristics were compared between cases and controls; and by care type (general ward, ICU) of cases. Descriptive statistics were presented as absolute numbers with proportions or means and standard deviation (SD). The rates of the occurrence of all cause death, readmission, and health outcomes per 10 000 person years in cases and controls were calculated. We estimated 95% confidence intervals (CI) with a Poisson distribution. If the control participant tested positive for SARS-CoV-2 during follow-up they were censored at date of SARS-CoV-2 positive result. The risks of incident outcome were estimated from a Cox survival model. In the survival analysis case-control matching structure was accounted for by including a random effect for each case-controls set in a Cox frailty model. The final Cox survival model was adjusted for comorbidities with prevalence of ≥5%, age, healthcare utilization and previous hospitalization. We produced Kaplan-Meier curves to graphically display the estimates of the significant outcomes. Hazard ratios for each of the outcomes including incident diagnoses were estimated from cause-specific hazard models. All analyses and visualization were done using STATA 17 [11]. To assess heterogeneity related to the matching variables we conducted subgroup analyses stratified by sex and age group (under and over 60 years). This was a retrospective observational cohort study, using claims data. The study was approved by the Research Ethics Committee of the University of Tartu (351/M-8), and no additional requirements were needed regarding gathering informed consent of study participants due to retrospective design of the study.

Results

The primary cohort comprised 3949 adult patients who were alive 30 days after COVID-19-related hospital admission (24% of them needed ICU during hospitalisation) and 15511 matched individuals from the control cohort. In the final matching process 3760 (95%) cases were matched to 4, 110 to three, 45 to two and 51 to one control with the total of 19460 individuals included in the analysis (3949 cases and 15511 controls). 1183 individuals among the matched controls tested SARS-CoV-2 positive during follow-up period and were censored in survival analyses. The study population demographics and pre-existing health conditions characteristics are presented in Table 1. Both cohorts comprised slightly more women (54.3% cases and 54.2% controls) than men. The mean age of cases was 65.4 (SD 16.7) and in controls 64.9 (SD 16.8) years. The mean follow-up time until death or study end for cases was 294.9 (SD 73.6) and 309.6 (SD 46.6) days for controls. At baseline compared to general population cases were more likely to have a comorbid condition (most notably obesity, hypertension, heart, liver, kidney chronic diseases and psychiatric conditions). Among individuals hospitalized for COVID-19, there were more men among those requiring ICU admission (56.4%). The mean age of ICU patients was 66.7 (SD 14.2) years. In the whole cohort 23.9% of individuals had at least one of outcomes (death, (re)admission, any of the selected health conditions) assessed: 40.3% (95%CI 38.7–41.9) of the cases and 19.4% (95%CI 18.7–19.9) of controls.

All-cause mortality

During the follow-up period 399 (10%) cases and 561 (3.6%) control group subjects died (Table 2). All-cause mortality was over two times higher among cases with rate per 10 000 person-years of 1332.4 (95% CI 1207.8–1469.7) in comparison to the rate in controls of 467.7 (95%CI 430.6–508.1) (Table 2). Significantly increased risk was observed in cases compared to controls for all-cause mortality aHR 2.57 (95%CI 2.23–2.96) (Fig 1).

Table 2. Rates of incident outcomes (events per 10 000 person years) among patients who were hospitalized with COVID-19 and a matched general population control in Estonia 2020–2021.

Outcome Group Person time (x 10 000 person years) Number of events Rate (95%CI) per 10 000 person years
Death all cause Cases
Controls
0.29
1.19
399
561
1332.4 (1207.8–1469.7)
467.7 (430.6–508.1)
Readmission all cause Cases
controls
0.30
1.26
824
1686
3153.9 (2945.8–3376.8)
1482.5 (1413.4–1555.0)
Anxiety Cases
controls
0.27
1.11
54
118
197.7 (151.4–258.1)
105.5 (88.1–126.3)
Chronic lower respiratory disease Cases
controls
0.25
1.07
88
96
352.1 (285.7–433.9)
89.5 (73.3–109.3)
Chronic liver disease Cases
controls
0.29
1.18
25
29
86.4 (58.4–127.9)
24.7 (17.2–35.5)
Chronic kidney disease Cases
controls
0.28
1.15
13
18
46.1 (26.8–79.4)
15.6 (9.8–24.8)
Disorder of lipoprotein Cases
controls
0.24
0.98
40
116
168.9 (123.9–230.2)
117.9 (98.3–141.4)
Dementia Cases
controls
0.29
1.18
33
43
114.4 (81.3–160.8)
36.5 (27.1–49.2)
Gastritis and duodenitis Cases
controls
0.26
1.08
85
165
329.7 (266.6–407.8)
152.5 (130.9–177.6)
Hypertension Case
controls
0.10
0.57
111
251
1058.8 (879.1–1275.3)
438.7 (387.7–496.5)
Hypothyroidism Cases
Controls
0.27
1.13
15
32
54.7 (32.9–90.8)
28.4 (20.1–40.2)
Insomnia Cases
controls
0.29
1.18
25
42
86.3 (58.3–127.7)
35.7 (26.4–48.3)
Ischemic heart disease Cases
controls
0.25
1.04
107
146
431.6 (357.1–521.6)
139.9 (118.9–164.6)
Mood disorders Cases
controls
0.28
1.13
46
78
165.3 (123.8–220.7)
68.8 (55.1–85.8)
Other forms of heart disease Cases
controls
0.21
0.93
158
191
749.1 (640.9–875.5)
205.1 (177.9–236.3)
Stroke Cases
controls
0.29
1.16
50
108
174.9 (132.6–230.9)
92.8 (76.8–112.0)
Substance abuse Cases
controls
0.29
1.18
11
28
37.58 (20.81–67.86)
23.68 (16.35–34.29)
Type 2 diabetes Cases
controls
0.24
1.02
61
75
254.9 (198.4–327.7)
73.6 (58.7–92.3)

Fig 1. Adjusted HRs comparing COVID-19 hospitalised patients and controls for risk of post-acute COVID-19 sequalae in Estonia 2020–2021.

Fig 1

Circles represent the hazard ratio, and the horizontal bars extend from the lower limit to the upper limit of the 95% confidence interval. Abbreviations LRD lower respiratory diseases; HD heart diseases.

Among those required ICU admission 13.1% died during study period (risk of all-cause mortality compared to controls aHR = 3.38 95%CI (2.59–4.40)) (S3 Table).

All cause hospital (re)admission

Of 3949 cases over the study period 824 (20.9%) were readmitted for any reason. During the follow-up, hospital admission occurred at rate of 3153.9 (95% CI 2945.8–3376.8) for cases and 1482.5 (95% CI 1413.4–1555.0) per 10 000 person-years for controls. We report markedly increased risk of all cause readmission aHR 1.73 (95%CI 1.58–1.90) in cases compared to age, sex and CCI matched controls.

Cases of new selected clinical sequelae

The data on incident cases of clinical sequelae are provided in Table 2. The occurrence of newly diagnosed hypothyroidism (p = 0.13), disorder of lipoprotein (p = 0.06), and substance abuse (p = 0.42) did not differ between cases and controls. Higher risk for all other clinical sequelae was observed in COVID-19 hospitalized patients compared to the matched general population group.

After adjustment for age, healthcare utilization, previous hospitalization and 11 clinical sequelae cases had significantly increased risk for all outcomes except hypothyroidism, substance abuse and disorder of lipoprotein metabolism compared to matched general population group (Figs 1 and 2 and S2 Table).

Fig 2. Kaplan-Meier curves for the comparison of the significant outcomes during 12 months comparing hospitalized COVID-19 patients (red curves) and matched general population (blue curves).

Fig 2

Shaded zones indicate 95% CI.

The largest increases in risk were observed for dementia aHR = 4.50 (95% CI 2.35–8.64), chronic lower respiratory disease aHR = 4.39 (95% CI 3.09–6.22), liver disease aHR 4.20 (95% CI 2.01–8.77) and other (than ischemic) forms of heart diseases (ICD-10 I30-52) aHR = 3.39 (95%CI 2.58–4.44). Chronic kidney disease was not included in the final model due to a small number of cases.

Risks of outcomes across subgroups

To assess heterogeneity related to a matching variable we conducted subgroup analysis. Significantly increased risk was universal and was observed for the majority of adverse events across both age and gender groups. Biggest differences in hazard ratios were observed for all-cause mortality in individuals aged <60 years aHR 5.99 (95%CI 3.45–10.38) versus aged ≥60 years aHR 2.76 (95%CI 2.42–3.15) and readmission <60 years with aHR 2.72 (95% CI 2.27–3.27) versus aged ≥60 years aHR 2.0 (1.82–2.19). No substantial differences in aHRs for cases vs controls were observed between males and females across the outcomes analysed.

Discussion

We conducted a comprehensive study investigating long term health complications after an acute COVID-19 requiring hospitalization. We saw excess mortality, hospital readmission and substantial risk for the emergence of several chronic diseases among a whole country’s population of adults hospitalized for COVID-19 compared with age, gender and CCImatched general population. The impact of severe COVID-19 was further accentuated among those requiring ICU. One of the main strengths of our study stems from long follow-up after the initial COVID-19 episode [12].

All-cause mortality and re-admission

Rates for all cause readmission (21%) and death (10%) reported in our study are consistent with the Donelly et al. study from USA, which reported rates within 60 days of discharge of these outcomes prior to mass vaccination of 20% and 9% respectively among COVID-19 hospitalization survivors [13]. Patients hospitalised due to COVID-19 and surviving at least 30 days had more than 2.5-fold higher risk of all-cause mortality and almost double risk for subsequent hospitalization than controls from general population. Our findings of relative risks are consistent with study results from England showing that the overall risk of hospitalisation or death was higher in the COVID-19 group than general population controls [14].

The severity of COVID-19 had a clear effect on all-cause mortality, readmission and clinical conditions, risks were higher in those COVID-19 patients requiring ICU admission. The inclusion of COVID-19 patients requiring ICU in our analysis is important because the current literature is limited regarding long term complications in those patients.

We found that 40.3% of individuals hospitalized due to COVID-19 developed at least one new clinical condition with in one year after the acute phase of SARS-CoV-2 infection, and in comparison, to age/gender and CCI matched peers, this is at least doubling of the risk.

New clinical conditions after acute COVID-19

Individuals surviving after COVID-19 hospitalization are at increased risk for several new clinical conditions; especially for chronic lower respiratory disease, other forms of heart diseases (ICD-10 I30-52), dementia and chronic liver disease.

In our study the largest increase in risk of 4.5 times was observed for dementia. Adequate post-discharge care is vital for those vulnerable group. Two-fold higher risk for neuropsychiatric sequelae as mood disorder and anxiety in our study is in line with the results reported in previously mentioned studies investigating neurological and psychiatric outcomes in COVID-19 hospitalized individuals [15].

Increased risk for chronic lower respiratory diseases can be explained by the finding from China reporting restrictive pulmonary physiology in COVID-19 hospitalized patients [16]. A study from USA with shorter follow-up reported that 65% of severe cases survivors experience fibrotic changes after COVID-19 [17]. Incidence of pulmonary sequelae is the aftermath of both virus-dependent (invasion and alveolar damage by the virus) and virus-independent mechanisms that cause persistent lung damage [18].

Furthermore, we report risk for chronic liver disease was four times higher in hospitalized COVID-19 patients, which is supported by the results reported in the study from UK [19]. In our study the risk of incident type 2 diabetes among COVID-19 patients of being 3 times higher than in general population cohort which is similar to that reported previously [20]. Al-Aly et al reported elevated risk of other cardiovascular disorders compared to general population without evidence of COVID-19 [21].

Our results are in line with reported evidence of biological mechanisms associated with respiratory [22], cardiovascular [23], metabolic [24] and neuropsychiatric [15] post-acute COVID-19 sequelae. Mechanisms surrounding post-acute COVID-19 complications are not entirely clear, but direct effects including with long-term tissue damage or strong immune system reaction leading to autoimmunity or immune dysregulation [25]; direct viral effect (viral invasion affecting heart function [26]; along with indirect effects as loneliness, isolation, economic situation has been described [27,28].

It is important to put these findings into the context of long-term effects of other infectious (viral) diseases as COVID-19 has brought to attention previously understudied phenomenon of post-acute infection syndrome. Post-infectious sequelae have been documented following infection by other viral infections (Ebola, influenza, dengue) including coronaviruses. Studies conducted up to 15 years reported effects on respiratory system [29], mental health [30], lipid metabolism [31] after acute SARS. In the population-based study from England most risks were similar to those observed after influenza hospitalizations, but COVID-19 patients had higher risks of all-cause mortality, readmission due to the initial infection and dementia, highlighting the importance of post-discharge monitoring [14]. A study from China has shown that patients who survive influenza A (H7N9) virus infection are at risk of physical and psychological complications of lung injury and multi-organ dysfunction [32].

To inform prevention and treatment strategy persistent follow-up of survivors is necessary. More emphasis has to be put on those experiencing severe initial COVID-19, as study from Denmark found, that the risk of severe post-acute sequelae after SARS-CoV-2 infection without hospital admission is low [33].

Strengths and limitations

To our knowledge this is one of the largest cohort studies with the longest follow-up time assessing the post-acute COVID-19 consequences in adult COVID-19 hospitalised patients in Europe. We believe our findings are robust given the sample size, the age, sex and CCI matching and the completeness of the data. Using nationwide data and long term follow-up allowed us to obtain precise estimates of assessed outcomes.

However, the study does have some limitations. Due to the nature of study design, we lack important information on subjective symptoms and other self-reported health characteristics that can be obtained from COVID-19 survivors (fatigue, poor attention, altered sense of taste). Accordingly, we are potentially missing a subset of post-COVID-19 health problems. Outcomes were presented in broad categories and more specific and granular presentation would be of a future interest.

Furthermore, there could be a number of patients with unrecorded post-acute COVID-19 features due to health care service provision limitation making our incidence estimates lower. It is difficult to gauge the completeness of electronic health records, or to validate diagnoses, and these factors could influence incidence estimates with the risk of measurement bias. We hypothesise that these deficiencies would affect cases and controls similarly leading to non-differential misclassification. The hospital admission thresholds could be lower in post-COVID-19 individuals than in the general population, leading to an overestimation of the impact on health. Due to lockdowns and inadequate access to medical services, rates of diagnoses might have decreased in individuals without hospital admission, which could lead to an underestimation of associations. Also, there could be individuals among the matched general population cohort that were untested for COVID-19, leading to an underestimation of effects. Based on the nature of the study design we were unable to match for all potentially relevant factors [34], for example, we did not have data on sociodemographic factors. Moreover, we showed that COVID-19 hospitalized patients were more likely to have baseline comorbidities than the general population controls, reflecting known associations between comorbidities and risks of severe COVID-19 outcomes. We have accounted for this by matching our cohorts for age, sex, Charlson Comorbidity Index and adjusting the final Cox survival model for a rich set of covariates to remove confounding as imbalance existed after matching. The adjustment was made for preexisting comorbidities with a prevalence of ≥5%, health care utilization, and previous hospitalization. We do agree that the propensity score matching would be also another appropriate way to balance exposed groups on the confounding factors. In addition, we do not know which SARS-CoV-2 virus-type individuals were infected. Wild type was overwhelmingly prevalent in Estonia during the current study period [35] It has been reported that some SARS-CoV-2 variant types are overrepresented [36] in severe cases and could possibly modify the incidence of post-acute COVID-19 manifestations [37].

Regarding the true impact of SARS-CoV-2, in medical literature the term of post-intensive care syndrome (PICS) has been described [38]. PICS manifestation involves physical, mental and cognitive health impairments after ICU discharge, which are partially similar to post-acute COVID-19 sequelae. In this regard, more studies are required in order to separate the impact of PICS and a true effect of SARS-CoV-2 leading to the consequences after acute phase of COVID-19. Finally, observational epidemiological studies cannot identify mechanisms of effect and causality; complementary studies are needed.

It is important to note that the current study was conducted before mass vaccination was introduced. There are a limited number of studies looking at whether vaccination reduces the risk of post-acute COVID-19 clinical complications. In the large cohort study by Taquet et al. analysis showed that the risk of several important outcomes including diabetes, mood disorder, anxiety appear to be unaffected by vaccination suggesting that other biological mechanisms support those outcomes [39]. More nationwide studies with standardized design, longer follow-up time and involving vaccinated individuals are therefore needed.

Conclusion

In summary the present study shows that after the acute-phase of COVID-19 hospitalized patients are at significantly higher risk of death and readmission, as well as cardiovascular, respiratory and neuropsychiatric outcomes over the next 12 months. This information could help with service planning for those with post-acute COVID-19 sequelae. With more than 17 000 cases hospitalised due to COVID-19 in Estonia by May 2022, our results suggests that the burden of COVID-19 related comorbidity on healthcare system will be substantial. Our results highlight those needed hospitalisation during acute phase of COVID-19 are in need of post-discharge follow up and multi-disciplinary care. Further efforts are needed to describe full spectrum of post-acute COVID-19 sequelae and to investigate the impact of PICS and vaccination on long-term sequelae of SARS-CoV-2 infection.

Supporting information

S1 Table. Outcomes measured and definitions.

(RTF)

S2 Table. Hazard ratios (HR) for major incident post-acute COVID-19 sequelae in hospitalised patients and matched general population controls in Estonia 2020–2021.

(RTF)

S3 Table. Hazard ratios (HR) for major incident post-acute COVID-19 sequelae in patients admitted to intensive care unit and matched general population controls in Estonia 2020–2021.

(RTF)

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

Research was carried out with the support of Estonian Research Council. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Grants: PRG1197, PRG198.

References

  • 1.Hu B, Guo H, Zhou P, Shi ZL. Characteristics of SARS-CoV-2 and COVID-19. Nat Rev Microbiol. 2021;19(3):141–154. doi: 10.1038/s41579-020-00459-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Our World in Data (2020).’Coronavirus (COVID-19) cases’. Available at: https://ourworldindata.org/covid-cases (Accessed: 26 March 2022).
  • 3.Booth A, Reed AB, Ponzo S, Yassaee A, Aral M, Plans D. Population risk factors for severe disease and mortality in COVID-19: A global systematic review and meta-analysis. PLoS One. 2021;16(3):e0247461. doi: 10.1371/journal.pone.0247461 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Shah W, Hillman T, Playford ED, Hishmeh L. Managing the long term effects of covid-19: summary of NICE, SIGN, and RCGP rapid guideline. BMJ. 2021;372:n136. doi: 10.1136/bmj.n136 [DOI] [PubMed] [Google Scholar]
  • 5.Daugherty SE, Guo Y, Heath K, Dasmariñas MC, Jubilo KG, Samranvedhya J et al. Risk of clinical sequelae after the acute phase of SARS-CoV-2 infection: retrospective cohort study. BMJ. 2021;373:n1098. doi: 10.1136/bmj.n1098 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Ramzi ZS. Hospital readmissions and post-discharge all-cause mortality in COVID-19 recovered patients; A systematic review and meta-analysis. Am J Emerg Med. 2022;51:267–279. doi: 10.1016/j.ajem.2021.10.059 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Taquet M, Dercon Q, Luciano S, Geddes JR, Husain M, Harrison PJ. Incidence, co-occurrence, and evolution of long-COVID features: A 6-month retrospective cohort study of 273,618 survivors of COVID-19. PLoS Med. 2021;18(9):e1003773. doi: 10.1371/journal.pmed.1003773 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.WHO (2020). ‘Diagnostic testing for SARS-CoV-2. Interim Guidance’. Available at: https://www.who.int/publications/i/item/diagnostic-testing-for-sars-cov-2 (Accessed: 15 January 2022).
  • 9.Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–83. doi: 10.1016/0021-9681(87)90171-8 [DOI] [PubMed] [Google Scholar]
  • 10.Toson B, Harvey LA, Close JCT. The ICD-10 Charlson Comorbidity Index predicted mortality but not resource utilization following hip fracture. J Clin Epidemiol 68:44–51. doi: 10.1016/j.jclinepi.2014.09.017 [DOI] [PubMed] [Google Scholar]
  • 11.StataCorp (2021)., Stata Statistical Software: Release 17’. College Station, TX: StataCorp LLC. Available at: https://www.stat.ee/en (Accessed: 1 September 2020). [Google Scholar]
  • 12.Nasserie T, Hittle M, Goodman SN. Assessment of the Frequency and Variety of Persistent Symptoms Among Patients With COVID-19: A Systematic Review. JAMA Netw Open. 2021;4(5):e2111417. doi: 10.1001/jamanetworkopen.2021.11417 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Donnelly JP, Wang XQ, Iwashyna TJ, Prescott HC. Readmission and Death After Initial Hospital Discharge Among Patients With COVID-19 in a Large Multihospital System. JAMA. 2021;325(3):304–306. doi: 10.1001/jama.2020.21465 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Bhaskaran K, Rentsch CT, Hickman G, Hulme WJ, Schultze A, Curtis HJ, et al. Overall and cause-specific hospitalisation and death after COVID-19 hospitalisation in England: A cohort study using linked primary care, secondary care, and death registration data in the OpenSAFELY platform. PLoS Med. 2022;19(1):e1003871. doi: 10.1371/journal.pmed.1003871 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Taquet M, Geddes JR, Husain M, Luciano S, Harrison PJ. 6-month neurological and psychiatric outcomes in 236 379 survivors of COVID-19: a retrospective cohort study using electronic health records. Lancet Psychiatry. 2021;8(5):416–427. doi: 10.1016/S2215-0366(21)00084-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Huang C, Huang L, Wang Y, Li X, Ren L, Gu X, et al. 6-month consequences of COVID-19 in patients discharged from hospital: a cohort study. Lancet. 2021;397(10270):220–232. doi: 10.1016/S0140-6736(20)32656-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Shah AS, Wong AW, Hague CJ, Murphy DT, Johnston JC, Ryerson CJ et al. A prospective study of 12-week respiratory outcomes in COVID-19-related hospitalisations. Thorax. 2021;76(4):402–404. doi: 10.1136/thoraxjnl-2020-216308 [DOI] [PubMed] [Google Scholar]
  • 18.Borczuk AC, Salvatore SP, Seshan SV, Patel SS, Bussel JB, Mostyka M, et al. COVID-19 pulmonary pathology: a multi-institutional autopsy cohort from Italy and New York City. Mod Pathol. 2020. Nov;33(11):2156–2168. doi: 10.1038/s41379-020-00661-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Ayoubkhani D, Khunti K, Nafilyan V, Maddox T, Humberstone B, Diamond I et al. Post-covid syndrome in individuals admitted to hospital with covid-19: retrospective cohort study. BMJ. 2021;372:n693. doi: 10.1136/bmj.n693 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.The OpenSAFELY Collaborative, Tazare J, Walker AJ et al. Rates of serious clinical outcomes in survivors of hospitalisation with COVID-19 in England: a descriptive cohort study within the OpenSAFELY platform. Wellcome Open Res 2022, 7:142 10.12688/wellcomeopenres.17735.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Xie Y, Xu E, Bowe B, Al-Aly Z. Long-term cardiovascular outcomes of COVID-19. Nat Med. 2022;28(3):583–590. doi: 10.1038/s41591-022-01689-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Garrigues E, Janvier P, Kherabi Y, Le Bot A, Hamon A, Gouze H, et al. Post-discharge persistent symptoms and health-related quality of life after hospitalization for COVID-19. J Infect. 2020; 81(6):e4–e6. doi: 10.1016/j.jinf.2020.08.029 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Becker RC. Anticipating the long-term cardiovascular effects of COVID-19. J Thromb Thrombolysis. 2020;50(3):512–524. doi: 10.1007/s11239-020-02266-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Rubino F, Amiel SA, Zimmet P, Alberti G, Bornstein S, Eckel RH,et al. New-Onset Diabetes in Covid-19. N Engl J Med. 2020;383(8):789–790. doi: 10.1056/NEJMc2018688 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Yong SJ. Long COVID or post-COVID-19 syndrome: putative pathophysiology, risk factors, and treatments. Infect Dis (Lond). 2021;53(10):737–754. doi: 10.1080/23744235.2021.1924397 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Lindner D, Fitzek A, Bräuninger H, Aleshcheva G, Edler C, Meissner K, et al. Association of Cardiac Infection With SARS-CoV-2 in Confirmed COVID-19 Autopsy Cases. JAMA Cardiol. 2020;5(11):1281–1285. doi: 10.1001/jamacardio.2020.3551 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Figueroa JD, Brennan PM, Theodoratou E, Poon MTC, Purshouse K, Din FVN, et al. Distinguishing between direct and indirect consequences of covid-19. BMJ. 2020;369:m2377. doi: 10.1136/bmj.m2377 [DOI] [PubMed] [Google Scholar]
  • 28.Rogers JP, Chesney E, Oliver D, Pollak TA, McGuire P, Fusar-Poli P, et al. Psychiatric and neuropsychiatric presentations associated with severe coronavirus infections: a systematic review and meta-analysis with comparison to the COVID-19 pandemic. Lancet Psychiatry. 2020;7(7):611–627. doi: 10.1016/S2215-0366(20)30203-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Ngai JC, Ko FW, Ng SS, To KW, Tong M, Hui DS. The long-term impact of severe acute respiratory syndrome on pulmonary function, exercise capacity and health status. Respirology. 2010; 15(3):543–50. doi: 10.1111/j.1440-1843.2010.01720.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Moldofsky H, Patcai J. Chronic widespread musculoskeletal pain, fatigue, depression and disordered sleep in chronic post-SARS syndrome; a case-controlled study. BMC Neurol. 2011;11:37. doi: 10.1186/1471-2377-11-37 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Wu Q, Zhou L, Sun X, Yan Z, Hu C, Wu J, et al. Altered Lipid Metabolism in Recovered SARS Patients Twelve Years after Infection. Sci Rep. 2017;7(1):9110. doi: 10.1038/s41598-017-09536-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Chen J, Wu J, Hao S, Yang M, Lu X, Chen X, Li L. Long term outcomes in survivors of epidemic Influenza A (H7N9) virus infection. Sci Rep. 2017;7(1):17275. doi: 10.1038/s41598-017-17497-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Lund LC, Hallas J, Nielsen H, Koch A, Mogensen SH, Brun NC, et al. Post-acute effects of SARS-CoV-2 infection in individuals not requiring hospital admission: a Danish population-based cohort study. Lancet Infect Dis. 2021;21(10):1373–1382. doi: 10.1016/S1473-3099(21)00211-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Casey JA, Schwartz BS, Stewart WF, Adler NE. Using Electronic Health Records for Population Health Research: A Review of Methods and Applications. Annu Rev Public Health. 2016;37:61–81. doi: 10.1146/annurev-publhealth-032315-021353 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.COVID-19 data portal Estonia. (Cited 15 March 2022). Available from: https://covid19dataportal.ee/genomics_transcriptomics/.
  • 36.McEwen AE, Cohen S, Bryson-Cahn C, Liu C, Pergam SA, Lynch J,et al. Variants of Concern Are Overrepresented Among Postvaccination Breakthrough Infections of Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) in Washington State. Clin Infect Dis. 2022;74(6):1089–1092. doi: 10.1093/cid/ciab581 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Bergwerk M, Gonen T, Lustig Y, Amit S, Lipsitch M, Cohen C, et al. Covid-19 Breakthrough Infections in Vaccinated Health Care Workers. N Engl J Med. 2021;385(16):1474–1484. doi: 10.1056/NEJMoa2109072 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Bangash MN, Owen A, Alderman JE, Chotalia M, Patel JM, Parekh D. COVID-19 recovery: potential treatments for post-intensive care syndrome. Lancet Respir Med. 2020;8(11):1071–1073. doi: 10.1016/S2213-2600(20)30457-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Taquet M, Dercon Q, Harrison PJ. Six-month sequelae of post-vaccination SARS-CoV-2 infection: A retrospective cohort study of 10,024 breakthrough infections. Brain Behav Immun. 2022;103:154–162. doi: 10.1016/j.bbi.2022.04.013 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Aqeel M Alenazi

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

1 Aug 2022

PONE-D-22-19899Post-acute sequelae of COVID-19 among hospitalized patients in Estonia: nationwide matched cohort studyPLOS ONE

Dear Dr. tisler,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

In addition to the reviewers' comments and suggestions, more clarifications should be written regarding the methods and diagnostic codes (ICD-10) using 1 or 2 codes to confirm the diagnosis of diseases.

==============================

Please submit your revised manuscript by Sep 15 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Aqeel M Alenazi

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

3. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

Additional Editor Comments:

Reviewers indicated limitations in the selection of the cohorts and unbalanced diseases with some suggestions to improve such as propensity score matching. In addition, more clarifications should be written regarding the methods and diagnostic codes (ICD-10). For example, have you used one or 2 codes to confirm the diagnosis of diseases? This will improve the validity and accuracy of the results.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The paper submitted by Anna Tisler et al analyzes clinical outcomes of patients hospitalized and surviving after COVID-19 disease in a nationwide study (Estonia) during the pre-vaccine era. They used a matched control population by age, sex, and Charlson’s comorbidity index (CCI). This kind of studies are relevant for health systems to design policies of surveillance after patients are discharged. The main objectives and the methods employed are clearly described in the manuscript. However, I have some concerns to address to the authors:

1. Despite cases and controls were matched by age, sex and CCI, the prevalence of relevant comorbidities was higher in the cohort of patients with COVID-19 (e.g., arterial hypertension, neoplasms, type 2 diabetes, ischemic and non-ischemic heart disease, etc). I wonder whether it is possible to do another approach taking into consideration for matching conditions with a high prevalence (for example, > 5%) in both cohorts.

2. In table 2 it is presented the incidence of outcomes among COVID-19 and control patients. Two different measures are presented: person-time and rate (both by 10.000 person-years). Despite I cannot repeat your calculations, rate was higher in COVID-19 patients than in controls (for example, in the case of death from all cause the figures were 1332 and 467, respectively). Conversely, when the same results are presented as person time the figure is higher in controls (1.19 vs. 0.29 for all cause mortality). Can you explain me this discrepancy?

Reviewer #2: Authors wanted to examine post-acute sequelae of Covid-19 disease with a matched cohort study in Estonia. Data came from nationwide healthcare registry. Two patient groups were matched according to age, gender, and CCI score; Covid-19 and others. Although, these three features (age, gender and CCI score) were used for matching, it is obvious that Covid-19 patients had higher rate of pre-existing comorbidities than those of counter parts. So, it is expected that Covid-19 patients could have higher rates of hazard ratios or mortality, and results could be overestimated. Propensity score matching could be more appropriate to reduce these differences in the analysis. If it is not possible to do this test, this limitation should be added to the paper.

Other concern is that how does this paper give contribution to the literature, as nearly all the population was vaccinated in Europe. Also, we still don’t know whether vaccination changed long term disease effects. Or, how long time should these patients will be watched for sequelae? These are topics that should be discussed in the paper.

Other recommendations;

Line 135: “all-cause” rather than “all cause”.

Line 189: It is stated that “At baseline compared to general population cases were more likely to have a comorbid condition (most notably obesity …” Is there any information regarding obesity in the paper?

Discussion;

It was used that “age, gender and co-morbidities matched general population.” in a few sentences. Actually, it wasn’t a fully matched cohort. It can be used “CCI score” rather than “co-morbidities”.

Abstract;

The results may not provide “robust” estimates for post disease morbidity because the groups were not fully matched. This statement needs revision.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Francesc Moreso

Reviewer #2: Yes: Mehmet Ali Aslaner

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Nov 23;17(11):e0278057. doi: 10.1371/journal.pone.0278057.r002

Author response to Decision Letter 0


15 Sep 2022

RESPONSE TO REVIEWERS

General comment:

In addition to the reviewers' comments and suggestions, more clarifications should be written regarding the methods and diagnostic codes (ICD-10) using 1 or 2 codes to confirm the diagnosis of diseases.

Response: Thank you for the comment. We have edited Methods section to clarify the use of ICD-10 codes.

Reviewer #1:

1. Despite cases and controls were matched by age, sex and CCI, the prevalence of relevant comorbidities was higher in the cohort of patients with COVID-19 (e.g., arterial hypertension, neoplasms, type 2 diabetes, ischemic and non-ischemic heart disease, etc). I wonder whether it is possible to do another approach taking into consideration for matching conditions with a high prevalence (for example, > 5%) in both cohorts.

Response: Thank you for pointing that out.

In the addition to the matching for age, sex, Charlson Comorbidity Index the final Cox survival model was adjusted for comorbidities with prevalence of ≥5%, health care utilization and previous hospitalization that we believe removed confounding if imbalance existed after matching.

2. In table 2 it is presented the incidence of outcomes among COVID-19 and control patients. Two different measures are presented: person-time and rate (both by 10.000 person-years). Despite I cannot repeat your calculations, rate was higher in COVID-19 patients than in controls (for example, in the case of death from all cause the figures were 1332 and 467, respectively). Conversely, when the same results are presented as person time the figure is higher in controls (1.19 vs. 0.29 for all cause mortality). Can you explain me this discrepancy?

Response: Cases were matched to a random subset of individuals insured by the EHIF who at the date of the first positive SARS-CoV-2 test of the COVID-19 case were alive and had no evidence of COVID-19 using a case to control ratio of 1:4 and that is the reason for person time being 4 times higher for controls (controls 1.19 versus cases 0.29 x 10 000 person years).

Reviewer #2:

1. Authors wanted to examine post-acute sequelae of Covid-19 disease with a matched cohort study in Estonia. Data came from nationwide healthcare registry. Two patient groups were matched according to age, gender, and CCI score; Covid-19 and others. Although, these three features (age, gender and CCI score) were used for matching, it is obvious that Covid-19 patients had higher rate of pre-existing comorbidities than those of counter parts. So, it is expected that Covid-19 patients could have higher rates of hazard ratios or mortality, and results could be overestimated. Propensity score matching could be more appropriate to reduce these differences in the analysis. If it is not possible to do this test, this limitation should be added to the paper.

Thank you for your comment, we do agree that the propensity score matching would be also another appropriate way to balance exposed groups on the confounding factors, but we believe that matching for for age, sex, Charlson Comorbidity Index and adjusting final Cox survival model for comorbidities with prevalence of ≥5%, health care utilization and previous hospitalization has removed confounding as imbalance existed after matching.

2. Other concern is that how does this paper give contribution to the literature, as nearly all the population was vaccinated in Europe. Also, we still don’t know whether vaccination changed long term disease effects. Or, how long time should these patients will be watched for sequelae? These are topics that should be discussed in the paper.

Our findings are consistent with emerging evidence from early studies suggesting that a subset of people infected with SARS-CoV-2 can experience health problems several months after the acute phase of their infection; however, epidemiological characterisation of such sequelae has been limited. Only a few other studies to date have compared post-COVID risks with a control group in using nationwide data.

The present study helps to contextualise these observations by adding explicit comparison with risks experienced by the general population. In addition we believe that our results can be generalised to those countries with similar population structure with lower vaccination coverage.

We also believe that our results are relevant in terms of future and present pandemics as we note in the manuscript that the post-infectious sequelae have been documented following infection by other viral infections (Ebola, influenza, dengue) and only 63.2% of European population is fully vaccinated 1.

1 https://ourworldindata.org/covid-vaccinations?country=OWID_WRL

Ongoing monitoring will be important to investigate whether these patterns persist in the light of new variants and increasing levels of vaccination.

3. Line 135: “all-cause” rather than “all cause”

Response: corrected

4. Line 189: It is stated that “At baseline compared to general population cases were more likely to have a comorbid condition (most notably obesity …” Is there any information regarding obesity in the paper?

Response: Thank you for pointing that out. We have now included it in the Tabel 1, we double- checked and it was already included in the final model.

5. It was used that “age, gender and co-morbidities matched general population.” in a few sentences. Actually, it wasn’t a fully matched cohort. It can be used “CCI score” rather than “co-morbidities”

Response: corrected

6. The results may not provide “robust” estimates for post disease morbidity because the groups were not fully matched. This statement needs revision.

Response: The reviewed statement is now included.

Attachment

Submitted filename: Response to Reviewers.rtf

Decision Letter 1

Aqeel M Alenazi

18 Oct 2022

PONE-D-22-19899R1Post-acute sequelae of COVID-19 among hospitalized patients in Estonia: nationwide matched cohort studyPLOS ONE

Dear Dr. tisler,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please, revise your manuscript or provide explanation to the reviewer's comments

Please submit your revised manuscript by Dec 02 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Aqeel M Alenazi

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

Please, revise your manuscript or provide explanation to the reviewer's comments

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: (No Response)

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The limitation that both reviewers have raised about the matching procedure of both cohorts is not fully addressed. Is it possible to match both populations by the baseline comorbidities (for example by a propensity socre)?

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Francesc Moreso

Reviewer #2: Yes: Mehmet Ali Aslaner

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Nov 23;17(11):e0278057. doi: 10.1371/journal.pone.0278057.r004

Author response to Decision Letter 1


25 Oct 2022

RESPONSE TO REVIEWERS

Reviewer #1:

The limitation that both reviewers have raised about the matching procedure of both cohorts is not fully addressed. Is it possible to match both populations by the baseline comorbidities (for example by a propensity score)?

Response: We are sorry that the matching procedure was not presented clearly. In the analysis presented both populations are matched by the baseline comorbidities burden (Charlson Comorbidity Index).

In our analysis, we matched our cohorts for age, sex, and Charlson Comorbidity Index and adjusted the final Cox survival model for a rich set of covariates to remove confounding as imbalance existed after matching. Adjustment for preexisting comorbidities with a prevalence of ≥5%, health care utilization, and previous hospitalization was made. We believe that this was sufficient to balance the cohorts out. We do agree with the reviewer, that the propensity score matching would be also another appropriate way to balance exposed groups on the confounding factors.

We have addressed this comment by adding an explanation in the Discussion section on page 20 line 359.

Attachment

Submitted filename: Response to Reviewers2.docx

Decision Letter 2

Aqeel M Alenazi

9 Nov 2022

Post-acute sequelae of COVID-19 among hospitalized patients in Estonia: nationwide matched cohort study

PONE-D-22-19899R2

Dear Dr. tisler,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Aqeel M Alenazi

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

The authors addressed all comments from the reviewers.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: (No Response)

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have answer my concerns appropriately. I suggest to the Editor to ask for an statistician to evaluate whether the analysis done in the present paper are correct.

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Francesc Moreso

Reviewer #2: Yes: Mehmet Ali Aslaner

**********

Acceptance letter

Aqeel M Alenazi

14 Nov 2022

PONE-D-22-19899R2

Post-acute sequelae of COVID-19 among hospitalized patients in Estonia: nationwide matched cohort study

Dear Dr. Tisler:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Aqeel M Alenazi

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Outcomes measured and definitions.

    (RTF)

    S2 Table. Hazard ratios (HR) for major incident post-acute COVID-19 sequelae in hospitalised patients and matched general population controls in Estonia 2020–2021.

    (RTF)

    S3 Table. Hazard ratios (HR) for major incident post-acute COVID-19 sequelae in patients admitted to intensive care unit and matched general population controls in Estonia 2020–2021.

    (RTF)

    Attachment

    Submitted filename: Response to Reviewers.rtf

    Attachment

    Submitted filename: Response to Reviewers2.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES