Abstract
The coronavirus disease 2019 (COVID-19) is still in a global pandemic state. Some studies have reported that COVID-19 vaccines had a protective effect against long COVID. However, the conclusions of the studies on the effect of COVID-19 vaccines on long COVID were not consistent. This study aimed to systematically review relevant studies in the real world, and performed a meta-analysis to explore the relationship between vaccination and long COVID. We systematically searched PubMed, Embase, Web of science, and ScienceDirect from inception to 19 September 2022. The PICO (P: patients; I: intervention; C: comparison; O: outcome) was as follows: patients diagnosed with COVID-19 (P); vaccination with COVID-19 vaccines (I); the patients were divided into vaccinated and unvaccinated groups (C); the outcomes were the occurrence of long COVID, as well as the various symptoms of long COVID (O). A fixed-effect model and random-effects model were chosen based on the heterogeneity between studies in order to pool the effect value. The results showed that the vaccinated group had a 29% lower risk of developing long COVID compared with the unvaccinated group (RR = 0.71, 95% CI: 0.58–0.87, p < 0.01). Compared with patients who were not vaccinated, vaccination showed its protective effect in patients vaccinated with two doses (RR = 0.83, 95% CI: 0.74–0.94, p < 0.01), but not one dose (RR = 0.83, 95% CI: 0.65–1.07, p = 0.14). In addition, vaccination was effective against long COVD in patients either vaccinated before SARS-CoV-2 infection/COVID-19 (RR = 0.82, 95% CI: 0.74–0.91, p < 0.01) or vaccinated after SARS-CoV-2 infection/COVID-19 (RR = 0.83, 95% CI: 0.74–0.92, p < 0.01). For long COVID symptoms, vaccination reduced the risk of cognitive dysfunction/symptoms, kidney diseases/problems, myalgia, and sleeping disorders/problems sleeping. Our study shows that COVID-19 vaccines had an effect on reducing the risk of long COVID in patients vaccinated before or after SARS-CoV-2 infection/COVID-19. We suggest that the vaccination rate should be improved as soon as possible, especially for a complete vaccination course. There should be more studies to explore the basic mechanisms of the protective effect of COVID-19 vaccines on long COVID in the future.
Keywords: COVID-19 vaccine, long COVID, post COVID-19 condition, systematic review, meta-analysis
1. Introduction
The coronavirus disease 2019 (COVID-19) caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection is still in a global pandemic state. According to the World Health Organization (WHO), there have been 599 million confirmed cases of COVID-19 as of 31 August 2022 [1]. Although patients recover from acute symptoms of COVID-19, it is worrying that certain studies have pointed out that sequelae in some patients (adults and children) may last weeks or even months [2,3,4]. However, COVID-19 might have detrimental sequelae even after the post-acute phase, depicting a new pathological condition—“post-COVID-19 syndrome (PCS)” or “long COVID” [5]. Long COVID is also known as the post-COVID-19 condition, long-term symptoms following SARS-CoV-2 infection, post-acute COVID-19 syndrome, or post-acute sequelae of SARS-CoV-2 infection, etc. [6,7]. The clinical case definition of long COVID, published by the WHO, is that it occurs in individuals with a history of probable or confirmed SARS-CoV-2 infection, usually 3 months from the onset of COVID-19 with symptoms, and lasts for at least 2 months, and it cannot be explained by an alternative diagnosis [8]. Long COVID affects multiple organs, and common symptoms include tiredness/fatigue, dyspnea/difficulty breathing, cough, chest pain, diarrhea, headache, impaired balance and gait, insomnia, joint pain, myalgia and weakness, neurocognitive issues, palpitations, pins and needles, rash, and hair loss [9,10].
According to the WHO, a total 12 billion COVID-19 vaccines have been administered as of 23 August 2022 [1]. COVID-19 vaccines could prevent SARS-CoV-2 infection, symptomatic COVID-19, and severe COVID-19, although their effectiveness was found to decline as time went by [11]. COVID-19 vaccines also had a good effectiveness against COVID-19-related hospitalization, admission to the intensive care unit, and death in a real-world setting [12]. The protective effect of COVID-19 vaccines has also been observed among children [13]. However, it is not clear that whether COVID-19 vaccines can prevent long COVID [6]. A cohort study in healthcare personnel with confirmed COVID-19 showed that the prevalence of reporting one or more COVID-like symptom 6 weeks after the onset of illness in the vaccinated group was lower compared with the unvaccinated group [14]. Another study reported that the number of vaccine doses was associated with lower long COVID incidence among healthcare workers who had not required hospitalization [15]. However, one study indicated that the mean number of post-acute sequelae of COVID-19 (PASC) symptoms reported each month during the follow-up period and the odds of full recovery from PASC were comparable between vaccinated and unvaccinated groups [16].
As far as we know, at present, only one preprint [17] and one published article [18] have provided systematic reviews on this topic without a meta-analysis. Therefore, we conducted this systematic review with a meta-analysis to quantitatively explore the effect of COVID-19 vaccines on long COVID, and to provide scientific evidence and suggestions. The PICO (P: patients; I: intervention; C: comparison; O: outcome) was as follows: patients diagnosed as having COVID-19 (P); vaccination with COVID-19 vaccines (I); the patients were divided into vaccinated and unvaccinated groups (C); the outcomes were the occurrence of long COVID, as well as the various symptoms of long COVID (O).
2. Materials and Methods
2.1. Registration and Search Strategy
Our study was registered in Prospective Register of Systematic Reviews (PROSPERO, ID: CRD42022340472). The study process followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines strictly. We systematically searched PubMed, Embase, Web of science, and ScienceDirect from inception to 19 September 2022. One part of the search terms was “vaccine” and its synonyms, the other part of the search terms was “long COVID” and its synonyms. The two parts were logically connected by “AND”. The complete search strategy is shown in Table S1 of the Supplementary Materials. In addition, we checked the reference lists of relevant reviews for more studies.
2.2. Study Selection
In this study, no matter how the studies considered defined long COVID, they would be included if they met the inclusion criteria. The inclusion criteria were as follows: (1) studies in extracted data could be extracted on the number of long COVID patients for vaccinated and unvaccinated patients; (2) studies conducted on humans, not on animals or cells; and (3) cohort study design, case-control study, or cross-sectional study. The exclusion criteria were as follows: (1) being irrelevant to this study (animal experiments, basic medical research, using models to evaluate, or participants obviously were vaccinated after long COVID, etc.); (2) study design not needed (clinical trial, review, case series, case report, conference abstract, or comment); (3) data not available (data were unable to be extracted or unable to be used for quantitative synthesis); and (4) duplicate articles.
EndNote (version 20, Tomson ResearchSoft, Stanford, CA, USA) software was used to exclude duplicates and to manage the results obtained by the search. In order to obtain as much data as possible, during the screening by title and abstract, only studies that obviously met the exclusion criteria were excluded. The rest of the records were selected by reading the full texts. Then, the eligible articles that met the inclusion criteria were finally included. Study selection (as well as data extraction and quality assessment of the included studies below) was done independently by two researchers, and disagreements were resolved through discussion or through a decision by a third researcher.
2.3. Data Extraction
The following information and data of included studies were extracted: (1) basic information, namely first author, title, publication time, and study design; (2) characteristics of the population, namely nationality, age, sample size, and follow-up time; (3) information of vaccination, namely vaccination time, type of vaccine, and number of doses; and (4) information of outcomes, namely outcome, observation period, number of long COVID patients, and number of long COVID symptoms.
2.4. Quality Assessment of Included Studies
For cohort studies and case-control studies, the Newcastle Ottawa scale [19] (NOS) was used to evaluate the risk of bias. The results of NOS include a low risk of bias (7–9 scores), moderate risk of bias (4–7 scores), and high risk of bias (0–3 scores). For cross-sectional studies, the checklist recommended by Agency for Healthcare Research and Quality [20] (AHRQ) was used, and the results include low risk of bias (8–11 scores), moderate risk of bias (4–7 scores), and high risk of bias (0–3 scores).
2.5. Statistical Analysis
In this study, exposure was vaccination with COVID-19 vaccines. We divided the population into vaccinated and unvaccinated groups. Participants who received one or more doses of COVID-19 vaccines were considered to be in the vaccinated group. The outcomes were the occurrence of long COVID (having at least one symptom) and various symptoms of long COVID. The risk ratio (RR) was calculated to assess the risk of developing long COVID in the vaccinated group compared with the unvaccinated group. In addition, we performed a subgroup analysis by age (<60 or ≥60 years), number of vaccine doses (one dose or two doses), vaccination time (before SARS-CoV-2 infection/COVID-19 or after SARS-CoV-2 infection/COVID-19), and definition of long COVID (“presence of symptoms more than 4 weeks after SARS-CoV-2 infection/COVID-19 diagnosis” or “other definitions”). For the primary meta-analysis, a sensitivity analysis was performed to assess the robustness, and the Egger test was conducted to assess the publication bias.
We calculated I2 statistics to show the heterogeneity between studies. The model used to pool the effect value was chosen based on the heterogeneity. When I2 ≤ 50, this showed that the heterogeneity was low to moderate, and a fixed-effect model was used. When I2 > 50, this showed that the heterogeneity was moderate to high, and a random-effects model was used. Statistical analysis was done using Review manager (version 5.4.1, The Cochrane Collaboration, London, UK) and R (version 4.1.0, Robert Gentleman and Ross Ihaka, Auckland, New Zealand) software.
3. Results
3.1. Characteristics of Included Studies
The process of study selection is shown in Figure 1. By searching the databases and checking the reference lists, we obtained 4941 records. A total of 3076 records were screened by reading titles and abstracts after duplicates were removed by the software. Finally, 18 eligible studies were included for quantitative synthesis after reading the full texts of 145 articles. The main information and the data for the meta-analysis of the included studies are shown in Table 1 and Table S2 of the Supplementary Material, respectively. Among them, 15 articles were accepted or published [15,16,21,22,23,24,25,26,27,28,29,30,31,32,33] and 3 articles were preprints [7,34,35]. All of the studies were observational, including 12 cohort studies, 1 case-control study, and 5 cross-sectional studies. Most of the populations were from the USA, UK, and Spain. There were more than 100,000 participants from each of these three countries. Three studies conducted in India, Switzerland, and Saudi Arabia each had a sample size over 1000. The other sample sizes were below 1000. The populations were mainly vaccinated with mRNA vaccines. Part of the populations were vaccinated after they had had SARS-CoV-2 infection or COVID-19. The definition of long COVID varied between studies. Only one study followed the definition published by the WHO (details of definition could be seen in the introduction). Three studies followed the definition published by the National institute for Health and Care Excellence (NICE) (details of the definition can be seen in the footer of Table 1). The definitions of five studies were similar to the NICE definition, because they used “more than 4 weeks” as the cut-off value for the observation time of long COVID-19 symptoms. Eight studies followed other definitions and two studies had no clear definition. In terms of quality assessment, only four studies had moderate risk of bias, and the rest had a low risk of bias. Overall, the quality of the included studies was good. The details of the quality assessment are shown in Table S3 of the Supplementary Material.
Table 1.
Study ID | Study Design | Nationality of Population | Age (Mean ± SD or Range) (Years) | Vaccination Time | Type of Vaccine | Definition of Long COVID * | Sample Size for Meta-Analysis | Quality Assessment |
---|---|---|---|---|---|---|---|---|
Nehme 2022 [21] | Cross-sectional study | Switzerland | 43.5 ± 13.7 | After SARS-CoV-2 infection | mRNA-1273, BNT162b2 | Presence of fatigue, difficulty concentrating or memory loss, loss of or change in smell, loss of or change in taste, shortness of breath, and headache more than 6 months after an infection | 1596 | Low risk |
Ayoubkhani 2022 [7] | Cohort study | UK | 18–69 | Before SARS-CoV-2 infection | ChAdOx1 nCoV-19, BNT162b2, mRNA-1273 | Presence of symptoms more than 4 weeks after the first having COVID-19, that are not explained by something else | 6180 | Moderate risk |
Kuodi 2022 [32] | Cross-sectional study | Israel | ≥19 | Before and after SARS-CoV-2 infection | Mainly BNT162b2 | No clear definition | 951 | Low risk |
Alghamdi 2022 [22] | Cross-sectional study | Saudi Arabia | 12–70 | NA | ChAdOx1 nCoV-19, BNT162b2 | No clear definition | 2218 | Moderate risk |
Simon 2021 [34] | Cohort study | USA | NA | Before and after COVID-19 diagnosis | NA | Presence of one or more COVID-associated symptoms between 12 and 20 weeks after the initial COVID-19 diagnosis | 240,648 | Low risk |
Taquet 2022 [24] | Cohort study | USA | 57.0 ± 17.9 | Before SARS-CoV-2 infection | BNT162b2, mRNA-1273, Ad26.COV2.S, other COVID-19 vaccines | Presence of chest/throat pain, abnormal breathing, abdominal symptoms, fatigue/malaise, anxiety/depression, pain, headache, cognitive dysfunction, and myalgia between 90 and 120 days after COVID-19 diagnosis | 9953 | Low risk |
Otmani 2022 [23] | Case-control study | Morocco | NA | After contracting the COVID-19 infection | NA | Guideline published by the NICE | 118 | Low risk |
Azzolini 2022 [15] | Cohort study | Italy | 44.3 ± 10.7 (with long COVID); 41.2 ± 11.4 (without long COVID) | Before SARS-CoCV-2 infection | BNT162b2 | Prescence at least 1 SARS-CoV-2-related symptom with a duration of more than 4 weeks | 739 | Moderate risk |
Wynberg 2022 [16] | Cohort study | Netherlands | 53.5 (IQR: 41.0–64.0) | After SARS-CoV-2 infection | BNT162b2, mRNA-1273, ChAdOx1 nCoV-19, Ad26.COV2.S | Criteria published by the WHO | 315 | Low risk |
Al-Aly 2022 [33] | Cohort study | USA | 66.63 ± 13.84 | Before SARS-CoV-2 infection | BNT162b2, mRNA-1273, Ad26.COV2.S | The symptoms starting from 30 days after the first positive SARS-CoV-2 test | 147,414 | Low risk |
Fernández 2022 [25] | Cohort study | Spain | 41.0 ± 16.8 | Before or after COVID-19 diagnosis | BNT162b2, mRNA-1273, ChAdOx1 nCoV-19, Ad26.COV2.S | Prescence of symptoms that persisted for more than 3 weeks after the initial infection and cannot be explained by other causes | 110,726 | Low risk |
Messiah 2022 [26] | Cohort study | USA | 5–19 | NA | NA | Guideline published by the NICE | 1748 | Low risk |
Meza-Torres 2022 [27] | Cohort study | UK | 44.5 ± 21.77 | Before or after COVID-19 diagnosis | NA | Presence of fatigue, breathlessness, cognitive dysfunction, and a variety of other symptoms occurring more than 28 days after COVID-19 infection | 408,882 | Low risk |
Peghin 2022 [28] | Cohort study | Italy | ≥18 | After COVID-19 diagnosis | BNT162b2, mRNA-1273, ChAdOx1 nCoV-19, Ad26.COV2.S | Guideline published by the NICE | 479 | Low risk |
Pinato 2022 [29] | Cohort study | UK, Italy, Spain | ≥18 | Before SARS-CoV-2 infection | BNT162b2, mRNA-1273, ChAdOx1 nCoV-19, Ad26.COV2.S | Presence of long-term effects start at least 4 weeks after infection | 1228 | Low risk |
Zisis 2022 [30] | Cohort study | USA | ≥18 | After COVID-19 diagnosis | NA | Prescence of new, continuing, or recurrent symptoms that occur 4 or more weeks after the initial SARS-CoV-2 infection | 50,450 | Low risk |
Budhiraja 2022 [35] | Cross-sectional study | India | <18-≥75 | Before COVID-19 diagnosis | ChAdOx1nCoV-19, a whole-virion inactivated vero cell derived vaccine (available as Covaxin in India) | Presence of any symptoms after discharge from the hospital | 5529 | Low risk |
Hajjaji 2022 [31] | Cross-sectional study | France | ≥18 | NA | NA | Persistent symptoms of SARS-CoV-2 infection lasting more than 6 months | 168 | Moderate risk |
* Definition published by NICE: the term “long COVID” is commonly used to describe signs and symptoms that continue or develop after acute COVID-19. It includes both ongoing symptomatic COVID-19 (from 4 to 12 weeks) and post-COVID-19 syndrome (12 weeks or more) [36].
3.2. Primary Meta-Analysis and Sensitivity Analysis
The results of the primary meta-analysis are shown in Figure 2. There was high heterogeneity between studies. Fifteen studies with 185,689 participants in the vaccinated group and 759,987 participants in the unvaccinated group were pooled using a random-effects model. RR = 0.71 (95% CI: 0.58–0.87, p < 0.01) indicated that the vaccinated group had a lower risk of developing long COVID compared with the unvaccinated group. The funnel plot is shown in Figure 3. The result of the Egger test (t = −0.46, df = 13, p-value = 0.65) suggested no publication bias in the primary meta-analysis.
All of the participants in the two studies (Pinato 2022 [29] and Hajjaji 2022 [31]) were patients with cancer, and we excluded this study for the sensitivity analysis. The pooled RR = 0.71 (95%CI: 0.57–0.88, p < 0.01) with a high heterogeneity (I2 = 99%) was almost the same as the primary meta-analysis. We excluded preprints (Ayoubkhani 2022 [7], Simon 2021 [34], and Budhiraja 2022 [35]) for the sensitivity analysis. The pooled RR = 0.70 (95%CI: 0.58–0.89, p < 0.01) with a high heterogeneity (I2 = 96%) still indicated that COVID-19 vaccines had a protective effect on long COVID. In addition, regardless of which study was excluded separately, the difference in the incidence of long COVID between two groups still was statistically significant. The RR value ranged from 0.69 to 0.77. More details of the sensitivity analysis are shown in Table S4 of the Supplementary Material.
3.3. Subgroup Analysis
The results of the subgroup analysis are shown in Table 2. For the number of doses, the protective effect of vaccination on long COVID was only found in the population vaccinated with two doses. For age, a protective effect was not found in either subgroup. For vaccination time, vaccination reduced the risk of developing long COVID in both the “before SARS-CoV-2 infection/COVID-19” subgroup and “after SARS-CoV-2 infection/COVID-19” subgroup. For definition, the results of the meta-analysis were both statistically significant.
Table 2.
Subgroups | The Number of Studies | The Number of People | I2 (%) | RR (95% CI) | p Value of Meta-analysis |
---|---|---|---|---|---|
The number of vaccine doses | |||||
1 dose | 6 | 655,962 | 99 | 0.83 (0.65–1.07) | 0.14 |
2 doses | 7 | 420,402 | 90 | 0.83 (0.74–0.94) | <0.01 |
Age | |||||
<60 years | 3 | 12,415 | 89 | 0.76 (0.54–1.06) | 0.11 |
≥60 years | 2 | 9509 | 55 | 0.87 (0.60–1.24) | 0.43 |
Vaccination time | |||||
Before SARS-CoV-2 infection/COVID-19 | 6 | 180,996 | 97 | 0.82 (0.74–0.91) | <0.01 |
After SARS-CoV-2 infection/COVID-19 | 4 | 2508 | 24 | 0.83 (0.74–0.92) | <0.01 |
Definition of long COVID | |||||
Presence of symptoms more than 4 weeks after SARS-CoV-2 infection/COVID-19 diagnisis * | 7 | 419,374 | 87 | 0.68 (0.53–0.87) | <0.01 |
Other definitions | 8 | 526,302 | 99 | 0.75 (0.64–0.88) | <0.01 |
* This subgroup contained 3 studies that used the NICE definition.
3.4. Meta-Analysis for Long COVID Symptoms
The results of meta-analysis for long COVID symptoms are shown in Table 3. Compared with the unvaccinated group, the vaccinated group had a lower risk of cognitive dysfunction/symptoms, kidney diseases/problems, myalgia, and sleeping disorders/problems sleeping.
Table 3.
Long COVID Symptom | The Number of Studies | The number of People | I2 (%) | RR (95% CI) | p Value of Meta-Analysis |
---|---|---|---|---|---|
Anxiety and/or depression | 4 | 28,604 | 70 | 0.83 (0.67–1.03) | 0.08 |
Chest or throat pain | 3 | 26,386 | 0 | 1.01 (0.95–1.08) | 0.67 |
Cognitive dysfunction/symptoms | 2 | 22,124 | 8 | 0.89 (0.83–0.96) | <0.01 |
Fatigue | 6 | 225,478 | 97 | 0.77 (0.58–1.02) | 0.07 |
Hair loss | 2 | 6480 | 50 | 0.86 (0.62–1.19) | 0.37 |
Headache/migraine | 4 | 76,836 | 99 | 0.95 (0.50–1.79) | 0.87 |
Kidney diseases/problems | 2 | 148,365 | 0 | 0.68 (0.64–0.73) | <0.01 |
Loss of concentration | 2 | 6480 | 71 | 0.65 (0.35–1.19) | 0.16 |
Loss of smell | 3 | 8698 | 75 | 0.67 (0.36–1.26) | 0.21 |
Loss of taste | 3 | 8698 | 68 | 0.71 (0.48–1.07) | 0.10 |
Myalgia | 2 | 25,435 | 15 | 0.68 (0.62–0.74) | <0.01 |
Nausea and/or vomiting | 2 | 6480 | 87 | 0.80 (0.31–2.02) | 0.63 |
Respiratory symptoms/sequelae | 5 | 78,064 | 98 | 0.91 (0.60–1.40) | 0.68 |
Sleeping disorders/problem sleeping | 3 | 8698 | 25 | 0.74 (0.64–0.86) | <0.01 |
Weight loss | 2 | 6480 | 95 | 1.24 (0.22–7.05) | 0.81 |
4. Discussion
As far as we know, our study is the first systematic review with a meta-analysis to assess the effect of COVID-19 vaccines on long COVID. A total 18 articles were included. In the primary meta-analysis, vaccination showed the effect of reducing the risk of long COVID. Considering the high heterogeneity between studies, the primary meta-analysis could be unstable, so we performed a sensitivity analysis. Each time a study was excluded for pooled RR evaluation, the protective effect of the vaccine always existed, indicating that the primary meta-analysis was stable. Because there are not many studies examining this topic, we included preprints. However, the preprints have not been peer-reviewed. We performed a sensitivity analysis by excluding three preprints. The result still supported the protective effect of COVID-19 vaccines. In the subgroup analysis, the results showed that people who received one dose vaccine did not acquire protection against long COVID, while those who received two doses did. Based on the data and the results of this paper, we cannot know the exact reason. We consider that it may be related to the higher vaccine effectiveness against symptomatic COVID-19 in people who received two doses of the vaccine. Several previous studies have confirmed this higher effectiveness [37,38,39]. Based on this, we recommend that people vaccinated with only one dose of COVID-19 vaccines should receive a second dose as soon as possible. Our study also found that the significance of vaccination is not limited to preventing SARS-CoV-2 infection and COVID-19. Vaccination in people who already have been infected with SARS-CoV-2 or COVID-19 is still effective at preventing long COVID. Based on this, we recommend that patients with SARS-CoV-2 infection or COVID-19 could choose to be vaccinated in order to prevent long COVID. The definition of long COVID was different between the included studies. Among the various definitions, more studies used “more than 4 weeks” as the observation period of long COVID symptoms. We divided these studies into one subgroup, and the articles that used other definitions into another subgroup. The results showed that the vaccine had a protective effect against long COVID in both subgroups. However, we believe that the difference in definitions brought an objective problem to our study. In future studies, we recommend that researchers use the NICE or WHO definitions in order to better describe what the outcome (long COVID) is in their articles, especially for review articles.
In this study, the protective effect of COVID-19 vaccines on long COVID symptoms could only be found in cognitive dysfunction/symptoms, kidney diseases/problems, myalgia, and sleeping disorders/problems sleeping. The pooled effect values of the other symptoms were negative. We believe this may be related to the small number of included studies. For most symptoms, only two or three studies were included for calculating the RRs, and most of the data were from three articles (Budhiraja 2022 [35]; Kuodi 2022 [32]; Taquet 2022 [24]). Not only that, in the study by Taquet, the number of patients with outcomes was high. This weight was very high (even higher than 90%) when the effect values were calculated, which had an impact on the results. The same situation with the small number of included studies also occurred in the subgroup analysis according to age. More original studies are needed to assess the effect of COVID-19 vaccines on these symptoms. In fact, for all of the outcomes, more studies should be included to obtain more reliable results.
The results of some previous studies support our study. One study indicated that COVID-19 vaccination reduced the likelihood of developing long COVID symptoms 12 weeks after infection, and found a sustained improvement over time in people who received two doses of the vaccine [40]. A reduction in the prevalence of one or more of the post-SARS-CoV-2 symptoms (difficulty concentrating or memory loss, fatigue, headache, loss of change in smell, loss of or change in taste, and shortness of breath) was significantly associated with the use of COVID-19 vaccines [21]. In people with SARS-CoV-2 infection, patients who were vaccinated had a significantly lower risk of developing 24 sequelae compared with patients who were not vaccinated [33]. After patients with COVID-19 were discharged from the hospital, persistent symptoms had an impact on their health and reduced their quality of life [41]. In a survey of 2550 people, 32% of participants were unable to live alone without assistance 6 months after onset, and the work of 75% of participants was affected after an average of 7 months into long COVID [42]. A study from Indonesia found that full vaccination improved the health-related quality of life among patients with COVID-19 6 months after hospital discharge, and suggested that COVID-19 survivors be vaccinated [43].
The pathophysiology of long COVID and the mechanism of effect of COVID-19 vaccines on long COVID are not very clear. Varying extents of organ damage, persistence of chronic inflammation, and immune response/auto antibody generation may be the causes of long COVID [9]. In patients with long COVID, persistently elevated inflammatory makers could be observed [44]. A study reported that SARS-CoV-2 damages the neurons, directly or indirectly, involving the central nervous system and the peripheral nervous system, leading to neurological sequelae [45]. Moreover, a hypothesis of persistent and occult virus presence has been proposed after the identification of viral particles in organs after acute infection [46]. Vaccination may decrease the risk of long COVID by increasing antibody titers and potentially eliminating viral reservoirs [47]. This may explain the result (in our subgroup analysis) that vaccination after SARS-CoV-2 infection/COVID-19 is still useful for preventing long COVID. Another mechanism is that vaccines can reduce the severity of acute SARS-CoV-2 infection, thus leading to a lower risk of developing organ or systemic derangements [18]. Severe COVID-19 in the acute phase during hospitalization increased the risk of long COVID [48,49]. This may explain the result (in our subgroup analysis) that vaccination before SARS-CoV-2 infection/COVID-19 has a protective effect on long COVID.
We have four suggestions for future research. First, studies involving long COVID should state the definitions they use. We do not recommend that authors use their own definitions, because this will make it more difficult to summarize the evidence. It is better to use the definitions published by the NICE or WHO. Second, to strengthen the reliability of our results, more studies exploring the effect of vaccines on long COVID are needed in the future. In addition to whether long COVID has occurred, studies should focus on the development of long COVID symptoms. Third, it is important to explore how vaccines can prevent long COVID in basic research. Basic studies have a great reference value for examining the current doubts about mechanisms. Fourth, a large number of people have been vaccinated with inactivated vaccines, and there is an urgent need to assess the effect of inactivated vaccines on long COVID.
This study has two advantages. First, to the best of our knowledge, this is the first systematic review with a meta-analysis to quantifiably assess the effect of COVID-19 vaccines on long COVID. The protective effect of vaccination against long COVID has been found. This study provides evidence-based medical information on this topic. Second, the primary meta-analysis was statistically significant in the sensitivity analysis. The stability of the result was good. This study has four limitations. First, the heterogeneity of the studies was high, which had an impact on the reliability of the results. More studies are needed in the future to calculate the effect values. Second, the definitions of long COVID are different among the included studies (especially observation time), although the NICE and WHO have both defined long COVID. This problem has also been considered in other studies [50,51]. It may be a source of heterogeneity in our study. Third, the data on some long COVID symptoms were insufficient to perform meta-analyses. For long COVID symptoms with meta-analyses, there were few pooled studies. The concept of fatigue associated with this syndrome is often also underestimated. Fourth, most of the participants were vaccinated with mRNA, and data on inactivated vaccines were lacking.
5. Conclusions
COVID-19 vaccines were found to have an effect on reducing the risk of long COVID. The protective effect was found in participants vaccinated with two doses, but not one dose. Regardless of whether being vaccinated before or after SARS-CoV-2 infection/COVID, vaccination was effective against long COVID. We suggest that the vaccination rate should be improved as soon as possible, especially for a complete vaccination course. It is better to be vaccinated so as to reduce the risk of long COVID, regardless of whether or not a patient has been infected with SARS-CoV-2. There should be more studies done to explore the basic mechanism of the protective effect of COVID-19 vaccines on long COVID in the future.
Acknowledgments
Thanks to all of the authors for their contributions to this article.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph191912422/s1, Table S1: Search strategy. Table S2: Data from the meta-analysis. Table S3: Quality assessment of the studies. Table S4: Sensitivity analysis by excluding one study every time.
Author Contributions
M.L. conceived and designed the study. P.G. carried out the literature searches. P.G. and J.L. selected the studies, extracted the data, assessed the study quality, and wrote the manuscript. P.G. performed the statistical analyses. M.L., J.L. and P.G. revised the manuscript. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Data are available from the corresponding author upon request.
Conflicts of Interest
The authors declare no conflict of interest.
Funding Statement
This research was funded by the National Natural Science Foundation of China (grant numbers 71934002 and 72122001) the National Key Research and Development Project of China (grant numbers 2021ZD0114104, 2021ZD0114101, and 2021ZD0114105), National Statistical Science Research Project (grant numbers 2021LY038) and the Fundamental Research Funds for the Central Universities supported by Global Center for Infectious Disease and Policy Research & Global Health and Infectious Diseases Group, of Peking University (grant number 202204), National Science and Technology Project on Development Assistance for Technology, Developing China-ASEAN Public Health Research and Development Collaborating Center (grant number KY202101004).
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.WHO WHO Coronavirus (COVID-19) Dashboard. [(accessed on 1 September 2022)]. 31 August 2022. Available online: https://covid19.who.int.
- 2.Blomberg B., Mohn K.G.-I., Brokstad K.A., Zhou F., Linchausen D.W., Hansen B.-A., Lartey S., Onyango T.B., Kuwelker K., Sævik M., et al. Long COVID in a prospective cohort of home-isolated patients. Nat. Med. 2021;27:1607–1613. doi: 10.1038/s41591-021-01433-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Selvaskandan H., Nimmo A., Savino M., Afuwape S., Brand S., Graham-Brown M., Medcalf J., Cockwell P., Beckwith H. Burnout and long COVID among the UK nephrology workforce: Results from a national survey investigating the impact of COVID-19 on working lives. Clin. Kidney J. 2021;15:517–526. doi: 10.1093/ckj/sfab264. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Weldetsadik A.Y., Abayneh M., Abraha M., Betizazu S.S., Bekele D. Clinical Characteristics and Outcome of Pediatric COVID-19 Patients in Ethiopia During the Early COVID-19 Pandemic: A Prospective Cohort Study. Pediatr. Health Med. Ther. 2022;13:165–174. doi: 10.2147/PHMT.S359333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.De Sire A., Moggio L., Marotta N., Agostini F., Tasselli A., Ferrante V.D., Curci C., Calafiore D., Ferraro F., Bernetti A., et al. Impact of Rehabilitation on Fatigue in Post-COVID-19 Patients: A Systematic Review and Meta-Analysis. Appl. Sci. 2022;12:8593. doi: 10.3390/app12178593. [DOI] [Google Scholar]
- 6.WHO Coronavirus Disease (COVID-19): Post COVID-19 Condition. [(accessed on 1 September 2022)]. 16 December 2021. Available online: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/question-and-answers-hub/q-a-detail/coronavirus-disease-(covid-19)-post-covid-19-condition.
- 7.Ayoubkhani D., Bosworth M.L., King S., Pouwels K.B., Glickman M., Nafilyan V., Zaccardi F., Khunti K., Alwan N.A., Walker A.S. Risk of Long COVID in people infected with SARS-CoV-2 after two doses of a COVID-19 vaccine: Community-based, matched cohort study. medRxiv. 2022. preprints . [DOI] [PMC free article] [PubMed]
- 8.WHO A Clinical Case Definition of Post COVID-19 Condition by a Delphi Consensus, 6 October 2021. [(accessed on 1 September 2022)]. Available online: https://www.who.int/publications/i/item/WHO-2019-nCoV-Post_COVID-19_condition-Clinical_case_definition-2021.1. [DOI] [PMC free article] [PubMed]
- 9.Raveendran A.V., Jayadevan R., Sashidharan S. Long COVID: An overview. Diabetes Metab. Syndr. 2021;15:869–875. doi: 10.1016/j.dsx.2021.04.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Emecen A.N., Keskin S., Turunc O., Suner A.F., Siyve N., Sensoy E.B., Dinc F., Kilinc O., Oguz V.A., Bayrak S., et al. The presence of symptoms within 6 months after COVID-19: A single-center longitudinal study. Ir. J. Med. Sci. 2022 doi: 10.1007/s11845-022-03072-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Ssentongo P., Ssentongo A.E., Voleti N., Groff D., Sun A., Ba D.M., Nunez J., Parent L.J., Chinchilli V.M., Paules C.I. SARS-CoV-2 vaccine effectiveness against infection, symptomatic and severe COVID-19: A systematic review and meta-analysis. BMC Infect. Dis. 2022;22:439. doi: 10.1186/s12879-022-07418-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Zheng C., Shao W., Chen X., Zhang B., Wang G., Zhang W. Real-world effectiveness of COVID-19 vaccines: A literature review and meta-analysis. Int. J. Infect. Dis. 2021;114:252–260. doi: 10.1016/j.ijid.2021.11.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Gao P., Cai S., Liu Q., Du M., Liu J., Liu M. Effectiveness and Safety of SARS-CoV-2 Vaccines among Children and Adolescents: A Systematic Review and Meta-Analysis. Vaccines. 2022;10:421. doi: 10.3390/vaccines10030421. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Mohr N.M., Plumb I.D., Harland K.K., Pilishvili T., Flemming-Dutra K.E., Krishnadasan A., Hoth K.F., Saydah S.H., Mankoff Z., Haran J.P., et al. Presence of Symptoms 6 Weeks after COVID-19 among Vaccinated and Unvaccinated U.S. Healthcare Personnel. medRxiv. 2022. preprints . [DOI] [PMC free article] [PubMed]
- 15.Azzolini E., Levi R., Sarti R., Pozzi C., Mollura M., Mantovani A., Rescigno M. Association Between BNT162b2 Vaccination and Long COVID After Infections Not Requiring Hospitalization in Health Care Workers. JAMA. 2022;328:676–678. doi: 10.1001/jama.2022.11691. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Wynberg E., Han A.X., Boyd A., van Willigen H.D., Verveen A., Lebbink R., van der Straten K., Kootstra N., van Gils M.J., Russell C., et al. The effect of SARS-CoV-2 vaccination on post-acute sequelae of COVID-19 (PASC): A prospective cohort study. Vaccine. 2022;40:4424–4431. doi: 10.1016/j.vaccine.2022.05.090. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Byambasuren O., Stehlik P., Clark J., Alcorn K., Glasziou P. Impact of COVID-19 vaccination on long COVID: A systematic review and meta-analysis. medRxiv. 2022. preprints . [DOI] [PMC free article] [PubMed]
- 18.Notarte K.I., Catahay J.A., Velasco J.V., Pastrana A., Ver A.T., Pangilinan F.C., Peligro P.J., Casimiro M., Guerrero J.J., Gellaco M.M.L., et al. Impact of COVID-19 vaccination on the risk of developing long-COVID and on existing long-COVID symptoms: A systematic review. EClinicalMedicine. 2022;53:101624. doi: 10.1016/j.eclinm.2022.101624. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Wells G.A., Shea B., O’Connell D., Peterson J., Welch V., Losos M., Tugwell P. The Newcastle-Ottawa Scale (NOS) for Assessing the Quality of Nonrandomised Studies in Meta-Analyses. [(accessed on 30 June 2022)]. Available online: https://www.ohri.ca//programs/clinical_epidemiology/oxford.asp.
- 20.Rostom A., Dubé C., Cranney A., Saloojee N., Sy R., Mack D., Patel D., McNeal J., Moher D., Garrity C., et al. Celiac Disease. Rockville (MD): Agency for Healthcare Research and Quality (US); 2004 Sep. (Evidence Reports/Technology Assessments, No. 104.) Appendix D. Quality Assessment Forms. [(accessed on 24 May 2022)];2004 Available online: https://www.ncbi.nlm.nih.gov/books/NBK35156/
- 21.Nehme M., Braillard O., Salamun J., Jacquerioz F., Courvoisier D.S., Spechbach H., Guessous I. Symptoms After COVID-19 Vaccination in Patients with Post-Acute Sequelae of SARS-CoV-2. J. Gen. Intern. Med. 2022;37:1585–1588. doi: 10.1007/s11606-022-07443-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Alghamdi H.Y., Alrashed A.M., Jawhari A.M., Abdel-Moneim A.S. Neuropsychiatric symptoms in post-COVID-19 long haulers. Acta Neuropsychiatr. 2022. in press . [DOI] [PubMed]
- 23.El Otmani H., Nabili S., Berrada M., Bellakhdar S., El Moutawakil B., Abdoh Rafai M. Prevalence, characteristics and risk factors in a Moroccan cohort of Long-COVID-19. Neurol. Sci. 2022;43:5175–5180. doi: 10.1007/s10072-022-06138-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Taquet M., Dercon Q., Harrison P.J. Six-month sequelae of post-vaccination SARS-CoV-2 infection: A retrospective cohort study of 10,024 breakthrough infections. Brain Behav. Immun. 2022;103:154–162. doi: 10.1016/j.bbi.2022.04.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.De Arriba Fernández A., Alonso Bilbao J.L., Espiñeira Francés A., Cabeza Mora A., Gutiérrez Pérez Á., Díaz Barreiros M.Á., Serra Majem L. Assessment of SARS-CoV-2 Infection According to Previous Metabolic Status and Its Association with Mortality and Post-Acute COVID-19. Nutrients. 2022;14:2925. doi: 10.3390/nu14142925. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Messiah S.E., Hao T., DeSantis S.M., Swartz M.D., Talebi Y., Kohl H.W., III, Zhang S., Valerio-Shewmaker M., Yaseen A., Kelder S.H., et al. Comparison of Persistent Symptoms Following SARS-CoV-2 Infection by Antibody Status in Nonhospitalized Children and Adolescents. Pediatr. Infect. Dis. J. 2022. in press . [DOI] [PubMed]
- 27.Meza-Torres B., Delanerolle G., Okusi C., Mayer N., Anand S., McCartney J., Gatenby P., Glampson B., Chapman M., Curcin V., et al. Differences in clinical presentation with long COVID following community and hospital infection, and associations with all-cause mortality: English sentinel network database study (Preprint) JMIR Public Health Surveill. 2022;8:e37668. doi: 10.2196/37668. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Peghin M., De Martino M., Palese A., Gerussi V., Bontempo G., Graziano E., Visintini E., D’Elia D., Dellai F., Marrella F., et al. Post–COVID-19 syndrome and humoral response association after 1 year in vaccinated and unvaccinated patients. Clin. Microbiol. Infect. 2022;28:1140–1148. doi: 10.1016/j.cmi.2022.03.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Pinato D.J., Ferrante D., Aguilar-Company J., Bower M., Salazar R., Mirallas O., Sureda A., Bertuzzi A., Brunet J., Lambertini M., et al. Vaccination against SARS-CoV-2 protects from morbidity, mortality and sequelae from COVID19 in patients with cancer. Eur. J. Cancer. 2022;171:64–74. doi: 10.1016/j.ejca.2022.04.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Zisis S.N., Durieux J.C., Mouchati C., Perez J.A., McComsey G.A. The Protective Effect of Coronavirus Disease 2019 (COVID-19) Vaccination on Postacute Sequelae of COVID-19: A Multicenter Study From a Large National Health Research Network. Open Forum Infect. Dis. 2022;9:ofac228. doi: 10.1093/ofid/ofac228. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Hajjaji N., Lepoutre K., Lakhdar S., Bécourt S., Bellier C., Kaczmarek E., Broyelle A., Giscard S., Lartigau E. 16 Months Follow Up of Patients’ Behavior and Mild COVID-19 Patterns in a Large Cohort of Cancer Patients During the Pandemic. Front. Oncol. 2022;12:901426. doi: 10.3389/fonc.2022.901426. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Kuodi P., Gorelik Y., Zayyad H., Wertheim O., Wiegler K.B., Abu Jabal K., Dror A.A., Nazzal S., Glikman D., Edelstein M. Association between BNT162b2 vaccination and reported incidence of post-COVID-19 symptoms: Cross-sectional study 2020-21, Israel. npj Vaccines. 2022;7:101. doi: 10.1038/s41541-022-00526-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Al-Aly Z., Bowe B., Xie Y. Long COVID after breakthrough SARS-CoV-2 infection. Nat. Med. 2022;28:1461–1467. doi: 10.1038/s41591-022-01840-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Simon M.A., Luginbuhl R.D., Parker R. Reduced incidence of long-COVID symptoms related to administration of COVID-19 vaccines both before COVID-19 diagnosis and up to 12 weeks after. medRxiv. 2021 doi: 10.1101/2021.11.17.21263608. preprints . [DOI] [Google Scholar]
- 35.Budhiraja S., Indrayan A., Mahajan M. Effect of COVID-19 vaccine on long-COVID: A 2-year followup observational study from hospitals in north India. medRxiv. 2022. preprints . [DOI]
- 36.NICE COVID-19 Rapid Guideline: Managing the Long-Term Effects of COVID-19. [(accessed on 24 September 2022)]. 11 November 2021. Available online: https://www.nice.org.uk/guidance/ng188.
- 37.Liu Q., Qin C., Liu M., Liu J. Effectiveness and safety of SARS-CoV-2 vaccine in real-world studies: A systematic review and meta-analysis. Infect. Dis. Poverty. 2021;10:132. doi: 10.1186/s40249-021-00915-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Kow C.S., Hasan S.S. Real-world effectiveness of BNT162b2 mRNA vaccine: A meta-analysis of large observational studies. Inflammopharmacology. 2021;29:1075–1090. doi: 10.1007/s10787-021-00839-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Nasreen S., Chung H., He S., Brown K.A., Gubbay J.B., Buchan S.A., Fell D.B., Austin P.C., Schwartz K.L., Sundaram M.E., et al. Effectiveness of COVID-19 vaccines against symptomatic SARS-CoV-2 infection and severe outcomes with variants of concern in Ontario. Nat. Microbiol. 2022;7:379–385. doi: 10.1038/s41564-021-01053-0. [DOI] [PubMed] [Google Scholar]
- 40.Ayoubkhani D., Bermingham C., Pouwels K.B., Glickman M., Nafilyan V., Zaccardi F., Khunti K., Alwan N.A., Walker A.S. Trajectory of long COVID symptoms after COVID-19 vaccination: Community based cohort study. BMJ. 2022;377:e069676. doi: 10.1136/bmj-2021-069676. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Jacobs L.G., Paleoudis E.G., Bari D.L.-D., Nyirenda T., Friedman T., Gupta A., Rasouli L., Zetkulic M., Balani B., Ogedegbe C., et al. Persistence of symptoms and quality of life at 35 days after hospitalization for COVID-19 infection. PLoS ONE. 2020;15:e0243882. doi: 10.1371/journal.pone.0243882. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Ziauddeen N., Gurdasani D., O’Hara M.E., Hastie C., Roderick P., Yao G., Alwan N.A. Characteristics and impact of Long COVID: Findings from an online survey. PLoS ONE. 2022;17:e0264331. doi: 10.1371/journal.pone.0264331. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Suyanto S., Kandel S., Kemal R.A., Arfianti A. The Quality of Life of Coronavirus Disease Survivors Living in Rural and Urban Area of Riau Province, Indonesia. Infect. Dis. Rep. 2022;14:33–42. doi: 10.3390/idr14010005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Boaventura P., Macedo S., Ribeiro F., Jaconiano S., Soares P. Post-COVID-19 Condition: Where Are We Now? Life. 2022;12:517. doi: 10.3390/life12040517. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Wang F., Kream R.M., Stefano G.B. Long-Term Respiratory and Neurological Sequelae of COVID-19. Med. Sci. Monit. 2020;26:e928996. doi: 10.12659/MSM.928996. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Castanares-Zapatero D., Chalon P., Kohn L., Dauvrin M., Detollenaere J., de Noordhout C.M., Jong C.P.-D., Cleemput I., Heede K.V.D. Pathophysiology and mechanism of long COVID: A comprehensive review. Ann. Med. 2022;54:1473–1487. doi: 10.1080/07853890.2022.2076901. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Sivan M., Greenhalgh T., Milne R., Delaney B. Are vaccines a potential treatment for long covid? BMJ. 2022;377:o988. doi: 10.1136/bmj.o988. [DOI] [PubMed] [Google Scholar]
- 48.Maglietta G., Diodati F., Puntoni M., Lazzarelli S., Marcomini B., Patrizi L., Caminiti C. Prognostic Factors for Post-COVID-19 Syndrome: A Systematic Review and Meta-Analysis. J. Clin. Med. 2022;11:1541. doi: 10.3390/jcm11061541. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Yaksi N., Teker A.G., Imre A. Long COVID in Hospitalized COVID-19 Patients: A Retrospective Cohort Study. Iran. J. Public Health. 2022;51:88–95. doi: 10.18502/ijph.v51i1.8297. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Scherlinger M., Felten R., Gallais F., Nazon C., Chatelus E., Pijnenburg L., Mengin A., Gras A., Vidailhet P., Arnould-Michel R., et al. Refining “Long-COVID” by a Prospective Multimodal Evaluation of Patients with Long-Term Symptoms Attributed to SARS-CoV-2 Infection. Infect. Dis. Ther. 2021;10:1747–1763. doi: 10.1007/s40121-021-00484-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Venkatesan P. Do vaccines protect from long COVID? Lancet Respir. Med. 2022;10:E30. doi: 10.1016/S2213-2600(22)00020-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Data are available from the corresponding author upon request.