Vaccines to prevent COVID-19: A living systematic review with Trial Sequential Analysis and network meta-analysis of randomized clinical trials

Steven Kwasi Korang; Elena von Rohden; Areti Angeliki Veroniki; Giok Ong; Owen Ngalamika; Faiza Siddiqui; Sophie Juul; Emil Eik Nielsen; Joshua Buron Feinberg; Johanne Juul Petersen; Christian Legart; Afoke Kokogho; Mathias Maagaard; Sarah Klingenberg; Lehana Thabane; Ariel Bardach; Agustín Ciapponi; Allan Randrup Thomsen; Janus C Jakobsen; Christian Gluud

doi:10.1371/journal.pone.0260733

. 2022 Jan 21;17(1):e0260733. doi: 10.1371/journal.pone.0260733

Vaccines to prevent COVID-19: A living systematic review with Trial Sequential Analysis and network meta-analysis of randomized clinical trials

Steven Kwasi Korang ^1,^*, Elena von Rohden ¹, Areti Angeliki Veroniki ^2,³, Giok Ong ⁴, Owen Ngalamika ⁵, Faiza Siddiqui ¹, Sophie Juul ¹, Emil Eik Nielsen ¹, Joshua Buron Feinberg ¹, Johanne Juul Petersen ¹, Christian Legart ^1,⁶, Afoke Kokogho ⁷, Mathias Maagaard ^1,⁸, Sarah Klingenberg ^1,⁹, Lehana Thabane ¹⁰, Ariel Bardach ¹¹, Agustín Ciapponi ¹¹, Allan Randrup Thomsen ¹², Janus C Jakobsen ^1,^9,¹³, Christian Gluud ^1,^9,¹³

Editor: Stefanos Bonovas¹⁴

¹Copenhagen Trial Unit, Centre for Clinical Intervention Research, The Capital Region, Copenhagen University Hospital − Rigshospitalet, Copenhagen, Denmark

²Knowledge Translation Program, Li Ka Shing Knowledge Institute, St. Michael’s Hospital, Toronto, Ontario, Canada

³Department of Metabolism, Digestion and Reproduction & Department of Surgery and Cancer, Faculty of Medicine, Imperial College London, United Kingdom

⁴Systematic Review Initiative, NHS Blood and Transplant, John Radcliffe Hospital, Headley Way, Oxford, United Kingdom

⁵Dermatology & Venereology Division, University Teaching Hospital, University of Zambia School of Medicine, Lusaka, Zambia

⁶Center for Clinical Metabolic Research, Gentofte Hospital, University of Copenhagen, Hellerup, Denmark

⁷United States Army Medical Research Directorate West Africa, Henry M. Jackson Foundation Medical Research International (HJFMRI), Walter Reed Army Institute of Research, Abuja, Nigeria

⁸Centre for Anaesthesiological Research, Department of Anaesthesiology, Zealand University Hospital, The Zealand Region of Denmark, Køge, Denmark

⁹The Cochrane Hepato-Biliary Group, Copenhagen Trial Unit, Centre for Clinical Intervention Research, The Capital Region, Copenhagen University Hospital − Rigshospitalet, Copenhagen, Denmark

¹⁰Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada

¹¹Argentine Cochrane Center. Instituto de Efectividad Clínica y Sanitaria (IECS-CONICET), Buenos Aires, Argentina

¹²Department of Immunology and Microbiology, University of Copenhagen, Copenhagen, Denmark

¹³Department of Regional Health Research, The Faculty of Heath Sciences, University of Southern Denmark, Odense, Denmark

¹⁴Humanitas University, ITALY

Competing Interests: The authors have declared that no competing interests exist.

^✉

* E-mail: steven.korang@ctu.dk

Roles

Steven Kwasi Korang: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing

Elena von Rohden: Investigation, Project administration, Writing – original draft, Writing – review & editing

Areti Angeliki Veroniki: Formal analysis, Methodology, Software, Writing – review & editing

Giok Ong: Investigation, Writing – review & editing

Owen Ngalamika: Investigation, Writing – review & editing

Faiza Siddiqui: Investigation, Writing – review & editing

Sophie Juul: Investigation, Writing – review & editing

Emil Eik Nielsen: Investigation, Writing – review & editing

Joshua Buron Feinberg: Investigation, Writing – review & editing

Johanne Juul Petersen: Investigation, Writing – review & editing

Christian Legart: Investigation, Writing – review & editing

Afoke Kokogho: Writing – original draft, Writing – review & editing

Mathias Maagaard: Investigation, Writing – review & editing

Sarah Klingenberg: Investigation, Resources, Writing – review & editing

Lehana Thabane: Methodology, Writing – review & editing

Ariel Bardach: Investigation, Methodology, Writing – original draft, Writing – review & editing

Agustín Ciapponi: Investigation, Methodology, Writing – original draft, Writing – review & editing

Allan Randrup Thomsen: Methodology, Writing – original draft, Writing – review & editing

Janus C Jakobsen: Methodology, Writing – review & editing

Christian Gluud: Conceptualization, Formal analysis, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

Stefanos Bonovas: Editor

PMCID: PMC8782520 PMID: 35061702

Abstract

Background

COVID-19 is rapidly spreading causing extensive burdens across the world. Effective vaccines to prevent COVID-19 are urgently needed.

Methods and findings

Our objective was to assess the effectiveness and safety of COVID-19 vaccines through analyses of all currently available randomized clinical trials. We searched the databases CENTRAL, MEDLINE, Embase, and other sources from inception to June 17, 2021 for randomized clinical trials assessing vaccines for COVID-19. At least two independent reviewers screened studies, extracted data, and assessed risks of bias. We conducted meta-analyses, network meta-analyses, and Trial Sequential Analyses (TSA). Our primary outcomes included all-cause mortality, vaccine efficacy, and serious adverse events. We assessed the certainty of evidence with GRADE. We identified 46 trials; 35 trials randomizing 219 864 participants could be included in our analyses. Our meta-analyses showed that mRNA vaccines (efficacy, 95% [95% confidence interval (CI), 92% to 97%]; 71 514 participants; 3 trials; moderate certainty); inactivated vaccines (efficacy, 61% [95% CI, 52% to 68%]; 48 029 participants; 3 trials; moderate certainty); protein subunit vaccines (efficacy, 77% [95% CI, −5% to 95%]; 17 737 participants; 2 trials; low certainty); and viral vector vaccines (efficacy 68% [95% CI, 61% to 74%]; 71 401 participants; 5 trials; low certainty) prevented COVID-19. Viral vector vaccines decreased mortality (risk ratio, 0.25 [95% CI 0.09 to 0.67]; 67 563 participants; 3 trials, low certainty), but comparable data on inactivated, mRNA, and protein subunit vaccines were imprecise. None of the vaccines showed evidence of a difference on serious adverse events, but observational evidence suggested rare serious adverse events. All the vaccines increased the risk of non-serious adverse events.

Conclusions

The evidence suggests that all the included vaccines are effective in preventing COVID-19. The mRNA vaccines seem most effective in preventing COVID-19, but viral vector vaccines seem most effective in reducing mortality. Further trials and longer follow-up are necessary to provide better insight into the safety profile of these vaccines.

Introduction

COVID-19 is caused by Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-Cov-2) [1]. Since the observation of the first patients with COVID-19 in Wuhan in 2019, the disease quickly became a global pandemic [2]. As of September 6^th, 2021 more than 221 million individuals developed COVID-19 and 4.6 million died globally [2].

Currently, there are only a few interventions hat seem able to benefit the clinical course of COVID-19 [3]. Therefore, preventive measures are of vital importance to control COVID-19. The scientific, medical, and industrial communities have embarked on efforts to develop safe vaccines [4, 5]. At September 13^th, 2021 about 104 vaccines are being tested in humans, with 33 having reached phase III trials [6]. Of these, five vaccines were abandoned due to either lack of response or an undesirable adverse event (e.g., tested false positive for HIV), eight have been approved for full use, and eleven have been authorized for early or limited use [6]. With the rapid development, approval of vaccines for COVID-19, and the growing number of viral variants, there is a need for systematic reviews critically appraising the topic. We recently published the first version of our review as a preprint, showing effects of mRNA and viral vector vaccines [7].

The aim of this second version of our living systematic review is to assess the effectiveness and safety of COVID-19 vaccines through analyses of all currently available randomized clinical trials. We also narratively describe incidentally identified observational studies reporting harms that we encountered during our search for trials [8].

Methods

This systematic review with meta-analyses was conducted in accordance with the reporting guideline provided in the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement [9, 10]. This review was carried out following recommendations outlined in the Cochrane Handbook of Systematic Reviews of Interventions [11]. More details on our methods can be found in our published protocol [8, 12].

Search strategy and selection criteria

An experienced information specialist performed weekly literature searches. For details regarding databases, searches, and screening methods see our published protocol [8] or S1 File.

We searched for and included randomized clinical trials, irrespective of publication status, year, and language. We included trials with any participant irrespective of prior exposure, age, sex, comorbidities, immune status, and risk group [8].

We included any vaccine aiming to prevent COVID-19 irrespective of dose and duration of administration. We included randomized clinical trials with any control group, i.e. vaccine versus placebo, ‘active placebo’, no intervention, another vaccine aiming at preventing COVID-19, or any other ‘active’ comparator [8].

Data analysis

Two authors independently screened and extracted data. Our primary outcomes were all-cause mortality; vaccine efficacy defined by either preventing COVID-19 symptoms plus positive polymerase chain rection (PCR) test, preventing severe COVID-19 symptoms plus positive PCR test, or preventing positive PCR test only; and serious adverse events [10]. Our secondary outcomes were health-related quality of life and adverse events not considered serious [8]. We used the trial results reported at maximum follow-up for all outcomes. We used intention-to-treat data if provided by the trialists [8]. Several exploratory outcomes were pre-defined in our protocol and will be presented in a subsequent publication [8].

Risk of bias assessment

Our risk of bias assessment was based on the Cochrane risk of bias tool version 2 (RoB 2) [13].

Association measures

We calculated risk ratios (RRs) with 95% confidence interval (CI). In meta-analysis, we also calculated the Trial Sequential Analysis-adjusted CIs. We used forest plots to illustrate summary effect sizes of the comparative effectiveness among interventions.

Statistical synthesis

We undertook our analysis according to the Cochrane Handbook of Systematic Reviews of Interventions [11], Keus and colleagues [14], and our eight-step assessment [15]. We used Stata version 16.1 to analyse data using the metan command for meta-analysis and network suite of commands for network meta-analysis [16–18]. We assessed our intervention effects with both a random-effects (RE) meta-analysis (DerSimonian and Laird) [19] and a fixed-effect (FE) meta-analysis (Mantel-Haenszel) [20] for each preventive comparison. We reported the more conservative point estimate of the two [8, 15]. We assessed three primary outcomes and two secondary outcomes. We, therefore, considered a p value of 0.0167 or less as the threshold for statistical significance to adjust for multiplicity [8, 15].

We performed Trial Sequential Analysis on all outcomes, to calculate the diversity-adjusted required information size (DARIS) and the cumulative Z-curve’s breach of relevant trial sequential monitoring boundaries [21–23].

We performed a network meta-analysis as described in S1 File and our protocol [8].

We assessed heterogeneity through visual inspection of forest plots, using the I² statistic [11, 24, 25], and by estimating the between-study variance using the DerSimonian and Laird method [26, 27]. We investigated heterogeneity through subgroup analyses.

Additional analyses

We performed subgroup analysis assessing different types of vaccines; trials at low compared with at high risk of bias; and trials without against with vested interests. To assess the potential impact of missing data, we performed sensitivity analyses using ‘best-worst’ and ‘worst-best’ analysis [8, 15].

Summary of findings and assessment of certainty

We created summary of findings tables including each of the prespecified outcomes (all-cause mortality, vaccine efficacy, serious adverse events, health-related quality of life, and non-serious adverse events) (Tables 1–4). We used the five Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) considerations (bias risk of the trials, consistency of effect, imprecision, indirectness, and publication bias) and CINeMA to assess confidence in the meta-analysis and network meta-analysis findings, respectively [28–31]. We assessed imprecision using Trial Sequential Analysis [8, 32, 33].

Table 1. Summary of findings (inactivated vaccines).

Inactivated vaccines versus placebo
Population: General population Settings: Outpatient Intervention: Inactivated vaccine (BBIBP-CorV, CoronaVac, Covaxin, and Vero Cell) Comparison: Placebo
Outcomes	Illustrative comparative risks^* (95% CI)		Relative effect (95% CI)	No of participants (studies)	Quality of the evidence (GRADE)	Comments
	Assumed risk	Corresponding risk
	Control	Vaccine
All-cause mortality maximum follow-up	Study population		0.48 (0.12 to 1.97)	53 399	⊕⊝⊝⊝ Very low	Downgraded one level for serious risk of bias and two levels for very serious imprecision. DARIS: 1 350 077 (Pc 0.03%; RRR 20%; alpha 1.67%; beta 10%; diversity 0%)
	10 per 100,000	4 per 100,000 (1 to 20)
Vaccine efficacy Positive test plus symptoms maximum follow-up	Study population		61% (52 to 68%)	48 029 (3)	⊕⊕⊕⊝ Moderate	Downgraded one level for serious risk of bias DARIS: 69 896 (Pc 1.5%; RRR 50%; alpha 1.67%; beta 10%; diversity 84.92%)
	152 per 10,000	59 per 10,000 (49 to 73)
Serious adverse events maximum follow-up			0.84 (0.68 to 1.06)	53 839 (7)	⊕⊕⊝⊝ Low	Downgraded one level for serious risk of bias and one level for serious imprecision. DARIS: 373 676 (Pc 0.55%; RRR 20%; alpha 1.67%; beta 10%; diversity 41.4%)
	55 per 10,000	47 per 10,000 (38 to 59)
Health-related quality of life maximum follow-up			NA	NA	NA	No trials assessed health-related quality of life
	NA	NA
Non- serious adverse events maximum follow-up	5733 per 10,000	5848 per 10,000 (5274 to 6478)	1.02 (0.92 to 1.13)	54 239 (11)	⊕⊕⊕⊝ Moderate	Downgraded one level for serious risk of bias DARIS: 63 233 (Pc 57.3%; RRR 20%; alpha 1.67%; beta 10%; diversity 98.4%)

Open in a new tab

*The basis for the assumed risk (e.g., the median control group risk across studies) is provided in footnotes. The corresponding risk (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI).

CI: Confidence interval. Pc: Proportion in control group with outcome. RR: Risk ratio. DARIS: Diversity-adjusted required information size. NA: Not applicable. NR: Not reported.

GRADE Working Group grades of evidence.

High quality: Further research is very unlikely to change our confidence in the estimate of effect.

Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate.

Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate.

Very low quality: We are very uncertain about the estimate.

Table 4. Summary of findings (viral vector vaccines).

Viral vector vaccines versus control
Population: General population Settings: Outpatient Intervention: Viral vector vaccine (Ad26.COV2.S-Janssen, ChAdOx1 nCoV-19-Vaxzevria, and Gam-COVID-Vac-Sputnik-V) Comparison: Control (placebo or MenACWY)
Outcomes	Illustrative comparative risks^* (95% CI)		Relative effect (95% CI)	No of participants (studies)	Quality of the evidence (GRADE)	Comments
	Assumed risk	Corresponding risk
	Control	Vaccine
All-cause mortality maximum follow-up	Study population		0.25 (0.09 to 0.67)	67 563 (3)	⊕⊕⊝⊝ Low	Downgraded one level for serious risk of bias and one level for serious imprecision. DARIS: 1 092 776 (Pc 0.067%; RRR 20%; alpha 1.67%; beta 10%; diversity 0.0%)
	67 per 100,000	17 per 100,000 (6 to 45)
Vaccine efficacy Positive test plus symptoms maximum follow-up	Study population		69%, (44% to 83)	71 702 (5)	⊕⊕⊕⊝ Moderate	Downgraded one level for serious risk of bias DARIS: 122 459 (Pc 1.2%; RRR 50%; alpha 1.67%; beta 10%; diversity 88.35%)
	117 per 10,000	36 per 10,000 (20 to 51)
Serious adverse events maximum follow-up			0.82 (0.64 to 1.05)	68 640 (4)	⊕⊕⊝⊝ Low	Downgraded one level for serious risk of bias and one level for serious imprecision. DARIS: 319 505 (Pc 0.42%; RRR 20%; alpha 1.67%; beta 10%; diversity 41.4%)
	42 per 10,000	35 per 10,000 (27 to 44)
Health-related quality of life maximum follow-up			NR	NR	NA	No trials assessed health-related quality of life
	NR	NR
Non- serious adverse events maximum follow-up	1854 per 10,000	2243 per 10,000 (1854 to 2706)	1.21 (1.00 to 1.46)	8 909 (3)	⊕⊝⊝⊝ Very low	Downgraded one level for serious risk of bias and two levels for very serious imprecision DARIS: 32 620 (Pc 18.5%; RRR 20%; alpha 1.67%; beta 10%; diversity 83.3%)

Open in a new tab

CI: Confidence interval. Pc: Proportion in control group with outcome. RR: Risk ratio. DARIS: Diversity-adjusted required information size. NA: Not applicable. NR: Not reported.

GRADE Working Group grades of evidence.

High quality: Further research is very unlikely to change our confidence in the estimate of effect.

Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate.

Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate.

Very low quality: We are very uncertain about the estimate.

Table 2. Summary of findings (mRNA vaccines).

mRNA vaccines versus placebo
Population: General population Settings: Outpatient Intervention: mRNA vaccine (mRNA-1273-Spikevax and BNT162b2-Corminarty) Comparison: Placebo
Outcomes	Illustrative comparative risks^* (95% CI)		Relative effect (95% CI)	No of participants (studies)	Quality of the evidence (GRADE)	Comments
	Assumed risk	Corresponding risk
	Control	Vaccine
All-cause mortality maximum follow-up	Study population		0.63 (0.21 to 1.84)	75 926 (5)	⊕⊕⊝⊝ Low	Downgraded one level for serious risk of bias and one level for serious imprecision. DARIS: 8 409 034 (Pc 0.018%; RRR 20%; alpha 1.67%; beta 10%; diversity 0.0%)
	18 per 100,000	12 per 100,000 (4 to 33)
Vaccine efficacy Positive test plus symptoms maximum follow-up	Study population		95% (92 to 97%)	71 514 (3)	⊕⊕⊕⊝ Moderate	Downgraded one level for serious risk of bias. DARIS: 58 402 (Pc 1.1%; RRR 50%; alpha 1.67%; beta 10%; diversity 0.0%)
	109 per 10,000	5 per 10,000 (3 to 9)
Serious adverse events maximum follow-up			1.10 (0.91 to 1.33)	75 926 (5)	⊕⊕⊝⊝ Low	Downgraded one level for serious risk of bias and one level for serious imprecision. DARIS: 211 042 (Pc 0.53%; RRR 20%; alpha 1.67%; beta 10%; diversity 41.4%)
	53 per 10,000	58 per 10,000 (48 to 70)
Health-related quality of life maximum follow-up			NR	NR	NA	No trials assessed health-related quality of life
	NR	NR
Non- serious adverse events maximum follow-up	2634 per 10,000	4715 per 10,000 (3951 to 5584)	1.79 (1.50 to 2.12)	75 898 (5)	⊕⊕⊕⊝ Moderate	Downgraded one level for serious risk of bias. DARIS: 408 514 (Pc 26.3%; RRR 20%; alpha 1.67%; beta 10%; diversity 99.14%)

Open in a new tab

CI: Confidence interval. Pc: Proportion in control group with outcome. RR: Risk ratio. DARIS: Diversity-adjusted required information size. NA: Not applicable. NR: Not reported. GRADE Working Group grades of evidence.

High quality: Further research is very unlikely to change our confidence in the estimate of effect.

Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate.

Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate.

Very low quality: We are very uncertain about the estimate.

Table 3. Summary of findings (protein-subunit vaccines).

Protein-subunit vaccines versus placebo
Population: General population Settings: Outpatient Intervention: Protein-subunit (SCB-2019 and NVX-CoV2373-Novavax) Comparison: Placebo
Outcomes	Illustrative comparative risks^* (95% CI)		Relative effect (95% CI)	No of participants (studies)	Quality of the evidence (GRADE)	Comments
	Assumed risk	Corresponding risk
	Control	Vaccine
All-cause mortality maximum follow-up	Study population		0.46 (0.09 to 2.36)	15 634	⊕⊝⊝⊝ Very low	Downgraded one level for serious risk of bias and two levels for very serious imprecision. DARIS: 6 901 325 (Pc 0.013%; RRR 20%; alpha 1.67%; beta 10%; diversity 0.0%)
	13 per 100,000	6 per 100,000 (1 to 30)
Vaccine efficacy Positive test plus symptoms maximum follow-up	Study population		77% (-5 to 95%)	17 737 (2)	⊕⊕⊝⊝Low	Downgraded one level for serious risk of bias and one level for serious imprecision. DARIS: 154 351 (Pc 1.6%; RRR 20%; alpha 1.67%; beta 10%; diversity 93.2%)
	156 per 10,000	51 per 10,000 (8 to 164)
Serious adverse events maximum follow-up			1.01 (0.66 to 1.55)	16 389 (4)	⊕⊕⊝⊝ Low	Downgraded one level for serious risk of bias and one level for serious imprecision. DARIS: 241 981 (Pc 0.50%; RRR 20%; alpha 1.67%; beta 10%; diversity 41.4%)
	50 per 10,000	51 per 10,000 (33 to 78)
Health-related quality of life maximum follow-up			NA	NA	NA	No trials assessed health-related quality of life
	NA	NA
Non- serious adverse events maximum follow-up	1978 per 1,0000	3678 per 10,000 (2413 to 5613)	1.86 (1.22 to 2.84)	16 959 (8)	⊕⊕⊕⊝Moderate	Downgraded one level for serious risk of bias DARIS: 280 894 (Pc 19.8%; RRR 20%; alpha 1.67%; beta 10%; diversity 98.21%)

Open in a new tab

CI: Confidence interval. Pc: Proportion in control group with outcome. RR: Risk ratio. DARIS: Diversity-adjusted required information size. NA: Not applicable. NR: Not reported.

GRADE Working Group grades of evidence.

High quality: Further research is very unlikely to change our confidence in the estimate of effect.

Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate.

Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate.

Very low quality: We are very uncertain about the estimate.

Results

46 trials met our inclusion criteria [34–65], of which 35 trials [34, 36–42, 44–50, 53–59, 61–65] randomizing 219 864 participants provided data for our predefined meta-analyses. See PRISMA flowchart (Fig 1) for details regarding the literature search and the selection of trials.

In most of the trials reporting data for our meta-analysis, the included participants were adults. Two of the trials included children (<16 years) [55, 64], but none of the trials included pregnant women or immunocompromised participants (e.g. cancer; on cancer drugs; etc.). All included trials assessed a COVID-19 vaccine compared with placebo (n = 32) or a control vaccine not immunogenic towards COVID-19 (n = 3) [37, 45]. The included vaccines were based on mRNA [34, 41, 42, 66]; viral vectors [37, 39, 43, 45, 47, 50, 52, 67]; protein-subunit [38, 53]; or inactivated virus [47–49, 51] (Table 5). The median follow-up range of assessment varied from 35 to 92 days after randomization for all outcomes.

Table 5. Randomized clinical trials included in systematic review of vaccines against COVID-19.

Source–First author and year of publication	Trial registration	Trial phase	Vaccine name ¹	Developer/Investigator	Number randomized ²	Overall risk of bias 2
mRNA Vaccines
Baden et al, 2020	NCT04470427	3	mRNA-1274/ Spikevax	Moderna, Inc	30420	Some concerns
Walsh et al, 2020 18-55y 30μg	NCT04368728	1	BNT162b2/ Comirnaty	BioNTech SE, Pfizer Inc.	195	Some concerns
Walsh et al, 2020 65-85y 30μg						Some concerns
Mulligan et al, 2020	NCT04368728	1/2	BNT162b1		45	Some concerns
Polack et al, 2020	NCT04368728	3	BNT162b2/ Comirnaty		43548	Some concerns
Li et al, 2021	ChiCTR2000034825, NCT04523571	1	BNT162b1	BioNTech, Shanghai Fosun Pharmaceutical Development	144
Viral Vector Vaccines
Madhi et al, 2021	NCT04444674, PACTR202006922165132	1/2	ChAdOx1 nCoV-19/AZD 1222/Vaxzevria	University of Oxford, AstraZeneca	2026	Low risk of bias
Ramasamy et al, 2020	NCT04400838, ISRCTN15281137	2/3	ChAdOx1 nCoV-19/AZD 1222/Vaxzevria		560	Some concerns
Folegatti et al, 2020	NCT04324606	3	ChAdOx1 nCoV-19/AZD 1222/Vaxzevria		1067	Low risk of bias
Voysey et al, 2020 UK	NCT04400838, ISRCTN89951424	3	ChAdOx1 nCoV-19/AZD 1222/Vaxzevria		20675 (received all doses of intervention)	High risk of bias
Voysey et al, 2020 Brazil						High risk of bias
Logunov et al, 2021	NCT04530396	3	Gam-COVID-Vac/ Sputnik V	Gamaleya Research Institute of Epidemiology and Microbiology	21977	Some concerns
Stephenson et al, 2021	NCT04505722	1	Ad26.COV2.S/ Janssen COVID-19 Vaccine/JNJ-78436735/Ad26COVS1	Janssen Pharmaceuticals	25
Sadoff et al, 2020	NCT04436276	1/2	Ad26.COV2.S/ Janssen COVID-19 Vaccine/JNJ-78436735/Ad26COVS1		402	Low risk of bas
Sadoff et al, 2021	NCT04505722	3	Ad26.COV2.S/ Janssen COVID-19 Vaccine/JNJ-78436735/Ad26COVS1		43783	Some concerns
Cai Zhu et al, 2020	NCT04341389, NCT04341390	2	Ad5-nCOV/ Convidicea	CanSinoBIO	508	Some concerns
Protein Subunit Vaccines
Keech et al, 2020	NCT04368988	1/2	NVX-CoV2373	Novavax Inc.	125	Some concerns
Shinde et al, 2021	NCT04533399	1/2	NVX-CoV2373		4406	High risk of bias
Formica et al, 2021	NCT04368988	1/2	NVX-CoV2373		1288	Some concerns
Heath et al, 2021	NCT04583995	3	NVX-CoV2374		15187
Richmond et al, 2021 18-54y	NCT04405908	1	SCB-2019	Clover Biopharmaceuticals, Coalition for Epidemic Preparedness Innovations	151	Some concerns
Richmond et al, 2021 55-75y						Some concerns
Goepfert et al, 2021	NCT04537208	1/2	CoV2 preS dTM	Sanofi Pasteur, GlaxoSmithKline	441	Some concerns
Yang et al, 2021 phase 1	NCT04445194	1	ZF2001	Anhui Zhifei Longcom Biopharmaceutical Co., Ltd, Institute of Microbiology—Chinese Academy of Sciences	50	Some concerns
Yang et al, 2021 phase 2	NCT04466085	2			900	Some concerns
Ward et al, 2020	NCT04450004	1	CoVLP	Medicago Inc.	180
Gobeil et al, 2021	NCT04636697	2	CoVLP		588	Some concerns
Chappell et al, 2021	NCT04495933	1	SARS-CoV-2 sclamp vaccine	The University of Queensland, Syneos Health, CSIRO Manufacturing, Seqirus, Coalition for Epidemic Preparedness Innovations	120
Inactivated Virus Vaccines
Ella et al, 2021	NCT04471519	1	BBV152/Covaxin	Bharat Biotech	375	Some concerns
Wu et al 2021 phase 1	NCT04383574	1	CoronaVac	Sinovac Biotech	422	Low Risk of Bias
Wu et al, 2021 phase 2		2				Low Risk of Bias
Zhang et al, 2020	NCT04352608	1/2	CoronaVac		744	Some concerns
Han et al, 2021	NCT04551547	1/2	CoronaVac		72 phase 1 480 phase 2
Bueno et al, 2021	NCT04651790	3	CoronaVac		434	High risk of bias
Xia et al, 2020 phase 1	ChiCTR2000031809	1	BBIBP-CorV/ Vero cell	Bejing Institute of Biological Products/Sinopharm (CNBG)	320	Low Risk of Bias
Xia et al, 2020 phase 2		2				Low Risk of Bias
Pu et al, 2020	CTR20200943, NCT04412538	1	SARS-CoV-2 inactivated vaccine	Institute of Medical Biology, Chinese Academy of Medicine Science	192	High risk of bias
Che et al, 2020	NCT04412538	2	SARS-CoV-2 inactivated vaccine		750	Some concerns
Palacios et al, 2021	NCT04456595	3	CoronaVac	Fundação Butantan and São Paulo Research Foundation	12408	Low Risk of Bias
Pan et al, 2021	ChiCTR2000038804, ChiCTR2000039462	1/2	KCONVAC	Shenzhen Kangtai Biological Products Co. Ltd, Beijing Minhai Biotechnology	60 phase 1 500 phase 2	Some concerns
Al Kaabi et al, 2021	NCT04510207; ChiCTR2000034780	3	WIV04, HB02	Sinopharm China National Biotec Group Company Limited, Wuhan Institute of Biological Products Co. Ltd., the Beijing Institute of Biological Products Co. Ltd	40411	Low risk of bias

Open in a new tab

¹ If multiple names were used at different stages of development, all of them are listed.

² If not number randomized it is noted differently.

Ten trials were at overall low risk of bias [43, 47, 48, 67], seventeen trials were at overall some concerns [34, 36, 38, 39, 41, 42, 46, 51–53], and eight trials were at overall high risk of bias (S1 File) [37, 40, 45].

All-cause mortality

Inactivated vaccines

Six trials assessing inactivated vaccines reported on all-cause mortality. Meta-analysis (FE) showed that these vaccines versus controls may result in a large reduction of all-cause mortality, but the confidence interval was compatible with no effect (risk ratio (RR), 0.48 [95% CI 0.12 to 1.97]; p = 0.31; I² = 0.0%; 53 399 participants; very low certainty; Fig 2).

mRNA vaccines

Five trials assessing mRNA vaccines reported on all-cause mortality. Meta-analysis (RE) showed that these vaccines versus placebo may reduce all-cause mortality, but the confidence interval was compatible with no effect (RR, 0.63 [95% CI 0.21 to 1.84]; p = 0.39; I² = 0%; 75 926 participants; low certainty; Fig 2).

Protein-subunit vaccines

Four trials assessing protein-subunit vaccines reported on all-cause mortality. Meta-analysis (FE) showed that these vaccines versus controls may result in a reduction of all-cause mortality, but the confidence interval was compatible with no effect (RR, 0.46 [95% CI 0.09 to 2.36]; p = 0.35; I² = 0.0%; 15 634 participants; very low certainty; Fig 2).

Viral vector vaccines

Three trials assessing viral vector vaccines reported on all-cause mortality. Meta-analysis (FE) showed that these vaccines versus controls may result in a large reduction of all-cause mortality (RR, 0.25 [95% CI 0.09 to 0.67]; p = 0.01; I² = 0.0%; 67 563 participants; low certainty; Fig 2).

Trial sequential analysis and sensitivity analysis on mortality

Trial Sequential Analyses showed that we did not have enough information to confirm that any of the vaccines reduced mortality with 20% or more. The sensitivity analyses showed that incomplete outcome data bias had the potential to influence the results of all the vaccines (S1 File).

Network meta-analysis on mortality

Network meta-analysis on mortality included 7 trials randomizing 168 701 participants comparing placebo, inactivated, mRNA, protein-subunit, and viral vector vaccines. There was no evidence of violation of the transitivity assumption for age and sex (Table 5). The network plot showed a star network without closed loops (S1 File).

All the individual vaccines except NVX-CoV2373-Novavax and Gam-COVID-Vac-Sputnik-V may decrease mortality, but their confidence intervals were compatible with no effect: Ad26.COV2.S-Janssen (RR, 0.19 [95% CI, 0.01 to 6.65]), ChAdOx1 nCoV-19-Vaxzevria (RR, 0.21 [95% CI, 0.00 to 55.07]), BNT162b2-Corminarty (RR, 0.50 [95% CI 0.00 to 52.70]), CoronaVac (RR, 0.50 [95% CI 0.03 to 7.35]), mRNA-1273-Spikevax (RR, 0.67 [95% CI 0.01 to 37.52]), NVX-CoV2373-Novavax (RR, 1.00 [95% CI 0.00 to 218.18]), and Gam-COVID-Vac-Sputnik-V (RR, 0.99 [95% CI 0.08 to 244.08). CINeMA was very low for all comparisons (S1 File). The between-study variance could not be estimated due to the small number of trials per vaccine comparison.

Based on the surface under the cumulative ranking curves, the Ad26.COV2.S-Janssen vaccine had the greatest likelihood of being the most effective vaccine in reducing mortality (P-score, 68.6%) followed by ChAdOx1 nCoV-19-Vaxzevria (P-score, 60.9%), CoronaVac (P-score, 50.9%), mRNA-1273-Spikevax (P-score, 48.5%), BNT162b2-Corminarty (P-score, 48.2%), NVX-CoV2373-Novavax (P-score, 42.8%), Gam-COVID-Vac-Sputnik-V (P-score, 43.2%), and placebo (P-score, 37.1%) (Fig 3).

Analyses of all vaccines

When we analyzed all eighteen vaccines that reported on all-cause mortality, meta-analysis (RE) suggested that the vaccines versus placebo result in a large reduction of all-cause mortality (RR, 0.41 [95% CI 0.22 to 0.77]; p = 0.0049; I² = 0.0%; 212 482 participants; low certainty; S1 File). TSA, however, showed that we did not have enough data to confirm that the vaccines reduced mortality with 20% or more (S1 File).

Prevention of symptomatic COVID-19 participants with positive PCR test

Inactivated vaccines

Three trials assessing inactivated vaccines reported vaccine efficacy on symptomatic COVID-19 participants. Meta-analysis (FE) showed that inactivated vaccines versus placebo result in a large reduction of symptomatic COVID-19 participants (efficacy, 61% [95% CI 52% to 68%]; p<0.0001; I² = 80.5%; 48 029 participants; moderate certainty; Fig 4). Visual inspection of the forest plot and I² suggested evidence of substantial heterogeneity.

mRNA vaccines

Three trials assessing mRNA vaccines reported vaccine efficacy on symptomatic COVID-19 participants. Meta-analysis (RE) showed that mRNA vaccines versus placebo result in a large reduction of symptomatic COVID-19 participants (efficacy, 95% [95% CI 92% to 97%]; p<0.0001; I² = 0.0%; 71 514 participants; moderate certainty; Fig 4).

Protein-subunit vaccines

Two trials assessing protein-subunit vaccines reported vaccine efficacy on symptomatic COVID-19 participants. Meta-analysis (RE) showed that protein-subunit vaccines versus placebo may result in a large reduction of symptomatic COVID-19 participants, but the confidence interval was compatible with no effect (efficacy, 77% [95% CI −5% to 95%]; p = 0.06; I² = 92.6%; 17 737 participants; low certainty; Fig 4). Visual inspection of the forest plot and I² suggested substantial evidence of heterogeneity.

Viral vector vaccines

Five trials assessed viral vector reported vaccine efficacy on symptomatic COVID-19 participants. Meta-analysis (RE) showed that viral vector vaccines versus placebo likely result in a large reduction of symptomatic COVID-19 participants (efficacy, 69% [95% CI 44% to 83%]; p = 0.0001; I² = 85.7%; 70 865 participants; moderate certainty; Fig 4). Visual inspection of the forest plot, I², and estimation of between-study variance (τ² = 0.38) indicated substantial heterogeneity.

Subgroup analyses of the different vaccines (favoring the Gam-COVID-Vac-Sputnik-V vaccine) and regarding vested interests (favoring without vested interests) showed evidence of differences (p<0.05) (S1 File).

Network meta-analysis on prevention of symptomatic COVID-19 participants with positive PCR test

Network meta-analysis on vaccine efficacy included eleven trials randomizing 205 916 participants comparing placebo/control with inactivated, mRNA, protein-subunit, or viral vector vaccines. There was no evidence of violation of the transitivity assumption for age and sex (Table 5).

All vaccines were more effective than placebo. The two mRNA vaccines (mRNA-1273-Spikevax and BNT162b2-Corminarty) and the viral vector vaccine, Gam-COVID-Vac-Sputnik-V, were likely superior to the remaining vaccines. Three vaccines achieved a vaccine efficacy superior to the minimum clinical important effectiveness of 50% compared with placebo: BNT162b2-Corminarty (efficacy, 95% [95% CI 83% to 99%]), mRNA-1273-Spikevax (efficacy, 95% [95% CI 80% to 99%]), and Gam-COVID-Vac-Sputnik-V (efficacy, 90% [95% CI 63% to 97%]). Five vaccines did not achieve a vaccine efficacy which was significantly superior to 50%: NVX-CoV2373-Novavax (efficacy, 77% [95% CI 39% to 91%]), Vero Cell (efficacy, 75% [95% CI 38% to 90%]), Ad26.COV2.S-Janssen (efficacy, 66% [95% CI −17% to 90%]), CoronaVac (efficacy, 50% [95% CI −73% to 86%]), and ChAdOx1 nCoV-19-Vaxzevria (efficacy, 56% [95% CI 4% to 80%]). CINeMA was very low for all comparisons (S1 File).

Based on the surface under the cumulative ranking curves, the BNT162b2-Corminarty vaccine had the greatest likelihood of being the most effective vaccine in reducing symptomatic COVID-19 (P-score, 90.6%) (Fig 3). It was followed by mRNA-1273-Spikevax (P-score, 88.8%), Gam-COVID-Vac-Sputnik-V (P-score, 76.5%), NVX-CoV2373-Novavax (P-score, 50.7%), Vero Cell (P-score, 49.4%), Ad26.COV2.S-Janssen (P-score, 37.7%), ChAdOx1 nCoV-19-Vaxzevria (P-score, 28.5%), CoronaVac (P-score, 25.1%), and placebo (P-score, 2.7%).

Prevention of severe COVID-19 symptoms with positive PCR test or prevention of positive PCR test only

Vaccine efficacies on prevention of asymptomatic and severe disease are presented in the supplementary material (S1 File).

Serious adverse events

Inactivated vaccines. Seven trials assessing inactivated vaccines reported on serious adverse events. Meta-analysis (RE) showed that inactivated vaccines versus placebo may decrease serious adverse events slightly, but the confidence interval was also compatible with no effect (RR, 0.84 [95% CI 0.68 to 1.06]; p = 0.15; I² = 0.0%; 53 839 participants; low certainty; S1 File).

mRNA vaccines. Five trials assessing mRNA vaccines reported on serious adverse events. Meta-analysis (RE) showed that mRNA vaccines versus placebo may increase serious adverse events slightly, but the confidence interval was also compatible with no effect (RR, 1.10 [95% CI 0.91 to 1.33]; p = 0.31; I² = 0.0%; 75 926 participants; low certainty; S1 File).

Protein-subunit vaccines. Four trials assessing protein-subunit vaccines reported on serious adverse events. Meta-analysis (RE) showed that these vaccines versus placebo have little or no effect on serious adverse events (RR, 1.01 [95% CI 0.66 to 1.55]; p = 0.97; I² = 0.0%; 16 389 participants; low certainty; S1 File).

Viral vector vaccines. Four trials assessing viral vector reported on serious adverse events. Meta-analysis (FE) showed that viral vector vaccines versus control may decrease serious adverse events, but the confidence interval was also compatible with no effect (RR, 0.82 [95% CI 0.64 to 1.05]; p = 0.12; I² = 0.0%; 68 640 participants; low certainty; S1 File).

Health-related quality of life. None of the included trials assessed health-related quality of life.

Non-serious adverse events

Inactivated vaccines. Eleven trials assessing inactivated vaccines reported on adverse events considered non-serious. Meta-analysis (RE) showed that inactivated vaccines versus placebo have little or no effect on adverse events not considered serious (RR, 1.02 [95% CI 0.92 to 1.13]; p = 0.67; I² = 92.4%; 54 239 participants; moderate certainty; S1 File).

mRNA vaccines. Five trials assessing mRNA vaccines reported on adverse events considered non-serious. Meta-analysis (RE) showed that mRNA vaccines versus placebo likely result in a large increase of adverse events not considered serious (RR, 1.79 [95% CI 1.50 to 2.12]; p<0.0001; I² = 94.7%; 75 898 participants; moderate certainty; S1 File).

Protein-subunit vaccines. Seven trials assessing protein-subunit vaccines reported on adverse events considered non-serious. Meta-analysis (RE) showed that protein-subunit vaccines versus placebo result in a large increase of adverse events not considered serious (RR, 1.86 [95% CI 1.22 to 2.84]; p = 0.004; I² = 87.2%; 16 959 participants; moderate certainty; S1 File).

Viral vector vaccines. Three trials assessing viral vector vaccines reported on adverse events considered non-serious. Meta-analysis (RE) showed that viral vector vaccines versus control may increase of adverse events not considered serious, but the confidence interval was also compatible with no effect (RR, 1.21 [95% CI 1.00 to 1.85]; p = 0.05; I² = 80.9%; 8 909 participants; very low certainty; S1 File).

Discussion

The assessed vaccines (Ad26.COV2.S-Janssen, BNT162b2-Corminarty, ChAdOx1 nCoV-19-Vaxzevria, CoronaVac, Gam-COVID-Vac-Sputnik-V, mRNA-1273-Spikevax, NVX-CoV2373-Novavax, and Vero Cell) all seem to be effective in preventing symptomatic COVID-19. Network meta-analysis suggests that the mRNA vaccines (mRNA-1273-Spikevax and BNT162b2-Corminarty) and the viral vector vaccine, Gam-COVID-Vac-Sputnik-V, could be superior to the remaining vaccines in preventing symptomatic COVID-19.

Our pairwise meta-analysis showed that the viral vector vaccines decreased mortality. Network meta-analysis suggested that the viral vector vaccine Ad26.COV2.S-Janssen was most effective in reducing mortality. All COVID-19 vaccines were more likely to reduce mortality than placebo or control, but longer follow up and more participants are needed to confirm this with a higher degree of certainty.

All vaccines, except inactivated vaccines, increased the risk of having a non-serious adverse event. We found no difference on serious adverse events, for any of the included vaccines (Ad26.COV2.S-Janssen, BNT162b2-Corminarty, CoronaVac, Gam-COVID-Vac-Sputnik-V, mRNA-1273-Spikevax, NVX-CoV2373-Novavax, and Vero Cell), but our Trial Sequential Analyses indicated that we did not have enough data to reject any differences.

Our results should been seen together with observational evidence suggesting rare serious adverse events associated with the vaccines [68]. The results of our review is supported by the first nationwide observational studies showing high vaccine efficacy of BNT162b2-Corminarty and of BNT162b2-Corminarty and ChAdOx1 nCoV-19-Vaxzevria against COVID-19 hospital admissions [69, 70].

We included 35 trials randomizing a total of 219 864 participants that contributed to our analyses. Of these trials, ten were at overall low risk of bias, seventeen at overall some concerns, and eight trials at overall high risk of bias. The certainty of evidence according to GRADE ranged from very low to moderate for the pairwise meta-analyses and the CINeMA were very low for all our network meta-analyses.

Most trials compared vaccines versus placebo. A few trials compared the vaccine versus a control vaccine not active towards SARS-CoV2 (MenACWY) [37, 40, 45]. Only trials assessing inactivated, mRNA, protein-subunit, and recombinant viral vector vaccines contributed to the assessment of our primary outcomes.

We found very similar results for efficacy of vaccine prevention for the two mRNA-based vaccines. This is not surprising as the construction differs only in details of the formulation of nanoparticles used for protection of the mRNA. In contrast, marked heterogeneity was observed regarding the three adenovector-based vaccines. Again, this is perhaps not surprising as the adenoviral backbones are different: ChAdOx1 nCoV-19, Ad26, or Ad5. Preclinical studies in mice and non-human primates have pointed to significant variation in the capacity of different adenoviral backbones to induce adaptive immunity [71–73]. Another cause could be the fact that the vaccines were not compared head-to-head in the same populations under similar conditions.

The emergence of SARS-CoV-2 variants of concern like in the UK (alpha/B.1.1.7), South Africa (B.1.351/Beta), India (B.1617.1/Kappa and B.1.617.2/Delta), Brazil (B.1.1.284/Gamma), USA (B.1.427 and B.1.429 / Epsilon), and Peru (C.37/Lambda) draws attention to increased transmissibility, higher disease severity, and evasion of the immune system through mutations in the spike protein [74–77]. This should be taken into consideration when trying to compare vaccine efficacies derived from studies carried out at different time-points and/or locations. The efficacy of existing vaccines against emerging variants needs to be closely monitored and the adaptability of the vaccines to potential immunity evading mutations needs to be assessed.

The trials in our systematic review did not include pregnant participants. Pregnant women constitute a vulnerable group for COVID-19 [78, 79]. Systematic reviews of observational studies showed that compared to pregnant women without COVID-19, pregnant women with this infection may require more frequent admissions to intensive care units (odds ratio (OR), 1.62 [95% CI 1.33 to 1.96]) and invasive ventilation (OR,1.88 [95% CI 1.36 to 2.60]) [78, 79]. For these reasons, many countries like the USA [80–82] and Israel [83] are presently assessing vaccine effectiveness in pregnant women. The World Health Organization (WHO) recommended mRNA vaccines only to pregnant women at highest risk after consultation with their physician [84], and trials are ongoing [85, 86].

Our review has several strengths. Our methodology was described in detail in a protocol published before the literature searches were initiated [8]. We systematically assessed the risks of systematic errors through bias risk assessments, we conducted Trial Sequential Analyses to control random errors and guide our GRADE assessments of the domain ‘imprecision’, and we adjusted our thresholds for statistical significance to control the risks of random errors [15]. Our review is to our knowledge the first review to perform network meta-analysis comparing the different COVID-19 vaccines. It is also more updated than previous systematic reviews [7, 87, 88]. Our living systematic review will be continually updated to incorporate relevant new evidence as it becomes available [8, 89, 90].

Our review also has limitations. Most of the larger phase III trials presented only interim analyses. The follow-up ranged from only 35 to 92 days. A longer follow-up would most likely yield more events and lead to more robust conclusions. Moreover, the trials did not report vaccine efficacy similarly. They used different cut-offs, follow-up durations, and definitions of vaccine efficacy. Especially the efficacy of preventing severe COVID-19 was not equally reported for the different vaccines. Furthermore, most trials only reported efficacy in the group of participants followed more than two weeks after the last vaccination and only reported adverse events for a confined time. Accordingly, we may look at biased results. Moreover, reporting of adverse events was variably and insufficient in several trials.

The trials were conducted in different countries. The participants of the different trials could therefore have been exposed to different variants of SARS-CoV2. We were unable to fully extract comparable data from the ChAdOx1 nCoV-19-Vaxzevria trials due to the lack relevant data from the individual trials, as the trials reported their results in a meta-analysis [37, 45, 52, 91].

Conclusion

Our systematic review shows that the inactivated vaccines, mRNA vaccines, protein-subunit vaccines, and viral vector vaccines are effective in preventing infection with SARS-CoV2. Current evidence shows that mRNA vaccines seem most effective in preventing COVID-19, but viral vector vaccines seem most effective in reducing mortality. The inactivated vaccine (CoronaVac), mRNA vaccines (mRNA-1273-Spikevax and BNT162b2-Corminarty), protein-subunit vaccine (NVX-CoV2373-Novavax), and viral vector vaccines (Gam-COVID-Vac-Sputnik-V, ChAdOx1 nCoV-19-Vaxzevria, and Ad26.COV2.S- Janssen) do not seem to increase the risk of serious adverse events according to published randomized trials. Most of the vaccines increase the risk of adverse events not considered serious. Our results may help guide authorities when deciding what vaccines to incorporate into their vaccine programs weighing our results against the potential rare events seen in observational studies.

Supporting information

S1 File

(DOCX)

Click here for additional data file.^{(4.2MB, docx)}

S1 Checklist

(DOCX)

Click here for additional data file.^{(32.4KB, docx)}

Acknowledgments

The living systematic review was supported by The Copenhagen Trial Unit, Centre for Clinical Intervention Research, The Capital Region, Copenhagen University Hospital–Rigshospitalet, Copenhagen, Denmark.

Data Availability

All relevant data are within the manuscript and its Supporting information files.

Funding Statement

The Copenhagen Trial Unit provided support in the form of salaries for SKK, EvR, FS, SJ, EEN, JF, JJP, JCJ and CG. The specific roles of these authors are articulated in the ‘author contributions’ section.

References

1.Guan W-J, Ni Z-Y, Hu Y, Liang W-H, Ou C-Q, He J-X, et al. Clinical characteristics of Coronavirus Disease 2019 in China. N Engl J Med. 2020. 30;382(18):1708–20. doi: 10.1056/NEJMoa2002032 [DOI] [PMC free article] [PubMed] [Google Scholar]
2.WHO. Coronavirus disease (COVID-19) Weekly epidemiological update and weekly operational update [Internet]. 2021 [cited 2021 Aug 3]. https://reliefweb.int/report/world/weekly-operational-update-covid-19-26-july-2021
3.Juul S, Nielsen EE, Feinberg J, Siddiqui F, Jørgensen CK, Barot E, et al. Interventions for treatment of COVID-19: A living systematic review with meta-analyses and trial sequential analyses (The LIVING Project). PLoS Med. 2020. Sep;17(9):e1003293. doi: 10.1371/journal.pmed.1003293 [DOI] [PMC free article] [PubMed] [Google Scholar]
4.Deb B, Shah H, Goel S. Current global vaccine and drug efforts against COVID-19: Pros and cons of bypassing animal trials. J Biosci. 2020;45. doi: 10.1007/s12038-020-00053-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
5.Funk CD, Laferrière C, Ardakani A. A snapshot of the Global race for vaccines targeting SARS-CoV-2 and the COVID-19 pandemic. Front Pharmacol. 2020;11:937. doi: 10.3389/fphar.2020.00937 [DOI] [PMC free article] [PubMed] [Google Scholar]
6.Zimmer C, Corum J, Wee S-L. Coronavirus vaccine tracker. The New York Times [Internet]. [cited 2021 Feb 6]; https://www.nytimes.com/interactive/2020/science/coronavirus-vaccine-tracker.html
7.Korang SK, von Rohden E, Veroniki AA, Ong G, Ngalamika O, Siddiqui F, et al. Vaccines to Prevent COVID-19: A Living Systematic Review With Trial Sequential Analysis and Network Meta-Analysis of Randomised Controlled Trials [Internet]. Rochester, NY: Social Science Research Network; 2021 May [cited 2021 Jun 17]. Report No.: ID 3854588. https://papers.ssrn.com/abstract=3854588
8.Korang SK, Juul S, Nielsen EE, Feinberg J, Siddiqui F, Ong G, et al. Vaccines to prevent COVID-19: a protocol for a living systematic review with network meta-analysis including individual patient data (The LIVING VACCINE Project). Syst Rev. 2020. Nov 20;9(1):262. doi: 10.1186/s13643-020-01516-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
9.Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. PLOS Med. 2021. Mar 29;18(3):e1003583. doi: 10.1371/journal.pmed.1003583 [DOI] [PMC free article] [PubMed] [Google Scholar]
10.Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015. Jun 2;162(11):777–84. doi: 10.7326/M14-2385 [DOI] [PubMed] [Google Scholar]
11.Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al. Cochrane Handbook for Systematic Reviews of Interventions version 6.2. www.training.cochrane.org/handbook. 2021.
12.Korang SK, Juul S, Nielsen EE, Feinberg J, Siddiqui F, Klingenberg S, et al. Vaccines to prevent COVID-19: a protocol for a living systematic review with network meta-analysis including individual patient data (The LIVING VACCINE Project) PROSPERO 2020 CRD42020196492 [Internet]. [cited 2021 May 3]. https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=196492 [DOI] [PMC free article] [PubMed]
13.Higgins JPT, Li T, Sterne J. Revised Cochrane risk of bias tool for randomized trials (RoB 2)Additional considerations for crossover trials. 20201208RoB2guidancecrossovertrialpdf—Google Drev. 2020 Dec 8;
14.Keus F, Wetterslev J, Gluud C, van Laarhoven CJHM. Evidence at a glance: error matrix approach for overviewing available evidence. BMC Med Res Methodol. 2010. Oct 1;10:90. doi: 10.1186/1471-2288-10-90 [DOI] [PMC free article] [PubMed] [Google Scholar]
15.Jakobsen JC, Wetterslev J, Winkel P, Lange T, Gluud C. Thresholds for statistical and clinical significance in systematic reviews with meta-analytic methods. BMC Med Res Methodol. 2014. Nov 21;14:120. doi: 10.1186/1471-2288-14-120 [DOI] [PMC free article] [PubMed] [Google Scholar]
16.StataCorp. Stata Statistical Software: Release 16 2019 [College Station, TX: StataCorp LLC http://www.stata.com].
17.White I. Network meta-analysis. Stata J. 2015;15:951–85. [Google Scholar]
18.Bradburn M, Deeks J, Altman D. sbe24: metan–an alternative meta-analysis command. Stata Tech Bull. 1988;44(15). [Google Scholar]
19.DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177–88. doi: 10.1016/0197-2456(86)90046-2 [DOI] [PubMed] [Google Scholar]
20.DeMets DL. Methods for combining randomized clinical trials: strengths and limitations. Stat Med. 1987;6(3):341–50. doi: 10.1002/sim.4780060325 [DOI] [PubMed] [Google Scholar]
21.Thorlund K, Devereaux PJ, Wetterslev J, Guyatt G, Ioannidis JPA, Thabane L, et al. Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses? Int J Epidemiol. 2009. Feb;38(1):276–86. doi: 10.1093/ije/dyn179 [DOI] [PubMed] [Google Scholar]
22.Thorlund K, Engstrøm J, Wetterslev J, Brok J, Imberger G, Gluud C. User manual for Trial Sequential Analysis (TSA), 2011. ctu.dk/tsa/files/tsa_manual.pdf. 2015 Jan 7;
23.Imberger G, Thorlund K, Gluud C, Wetterslev J. False-positive findings in Cochrane meta-analyses with and without application of trial sequential analysis: an empirical review. BMJ Open. 2016. 12;6(8):e011890. doi: 10.1136/bmjopen-2016-011890 [DOI] [PMC free article] [PubMed] [Google Scholar]
24.Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002. Jun 15;21(11):1539–58. doi: 10.1002/sim.1186 [DOI] [PubMed] [Google Scholar]
25.Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–60. doi: 10.1136/bmj.327.7414.557 [DOI] [PMC free article] [PubMed] [Google Scholar]
26.Langan D, Higgins JPT, Jackson D, Bowden J, Veroniki AA, Kontopantelis E, et al. A comparison of heterogeneity variance estimators in simulated random-effects meta-analyses. Res Synth Methods. 2019. Mar;10(1):83–98. doi: 10.1002/jrsm.1316 [DOI] [PubMed] [Google Scholar]
27.Veroniki AA, Jackson D, Viechtbauer W, Bender R, Bowden J, Knapp G, et al. Methods to estimate the between-study variance and its uncertainty in meta-analysis. Res Synth Methods. 2016. Mar;7(1):55–79. doi: 10.1002/jrsm.1164 [DOI] [PMC free article] [PubMed] [Google Scholar]
28.Nikolakopoulou A, Higgins JPT, Papakonstantinou T, Chaimani A, Del Giovane C, Egger M, et al. CINeMA: An approach for assessing confidence in the results of a network meta-analysis. PLoS Med. 2020;17(4):e1003082. [DOI] [PMC free article] [PubMed] [Google Scholar]
29.Papakonstantinou T, Nikolakopoulou A, Higgins JPT, Egger M, Salanti G. CINeMA: Software for semiautomated assessment of the confidence in the results of network meta-analysis. Campbell Syst Rev. 2020;16(1):e1080. [DOI] [PMC free article] [PubMed] [Google Scholar]
30.CINeMA: Software for semiautomated assessment of the confidence in the results of network meta‐analysis—Papakonstantinou—2020—Campbell Systematic Reviews—Wiley Online Library [Internet]. [cited 2020 Nov 6]. https://onlinelibrary.wiley.com/doi/full/10.1002/cl2.1080 [DOI] [PMC free article] [PubMed]
31.Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008. Apr 26;336(7650):924–6. doi: 10.1136/bmj.39489.470347.AD [DOI] [PMC free article] [PubMed] [Google Scholar]
32.Brok J, Thorlund K, Gluud C, Wetterslev J. Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol. 2008. Aug;61(8):763–9. doi: 10.1016/j.jclinepi.2007.10.007 [DOI] [PubMed] [Google Scholar]
33.Brok J, Thorlund K, Wetterslev J, Gluud C. Apparently conclusive meta-analyses may be inconclusive—Trial sequential analysis adjustment of random error risk due to repetitive testing of accumulating data in apparently conclusive neonatal meta-analyses. Int J Epidemiol. 2009;38(1):287–98. doi: 10.1093/ije/dyn188 [DOI] [PubMed] [Google Scholar]
34.Baden LR, El Sahly HM, Essink B, Kotloff K, Frey S, Novak R, et al. Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine. N Engl J Med. 2021. Feb;384(5):403–16. doi: 10.1056/NEJMoa2035389 [DOI] [PMC free article] [PubMed] [Google Scholar]
35.Che Y, Liu X, Pu Y, Zhou M, Zhao Z, Jiang R, et al. Randomized, double-blinded and placebo-controlled phase II trial of an inactivated SARS-CoV-2 vaccine in healthy adults. Clin Infect Dis Off Publ Infect Dis Soc Am. 2020. Nov 9;ciaa1703. [Google Scholar]
36.Ella R, Vadrevu KM, Jogdand H, Prasad S, Reddy S, Sarangi V, et al. Safety and immunogenicity of an inactivated SARS-CoV-2 vaccine, BBV152: a double-blind, randomised, phase 1 trial. Lancet Infect Dis. 2021. Jan 21;21(5):637–64. doi: 10.1016/S1473-3099(20)30942-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
37.Folegatti PM, Ewer KJ, Aley PK, Angus B, Becker S, Belij-Rammerstorfer S, et al. Safety and immunogenicity of the ChAdOx1 nCoV-19 vaccine against SARS-CoV-2: a preliminary report of a phase 1/2, single-blind, randomised controlled trial. Lancet Lond Engl. 2020. 15;396(10249):467–78. [DOI] [PMC free article] [PubMed] [Google Scholar]
38.Keech C, Albert G, Cho I, Robertson A, Reed P, Neal S, et al. Phase 1–2 Trial of a SARS-CoV-2 recombinant spike protein nanoparticle vaccine. N Engl J Med. 2020. Dec 10;383(24):2320–32. doi: 10.1056/NEJMoa2026920 [DOI] [PMC free article] [PubMed] [Google Scholar]
39.Logunov DY, Dolzhikova IV, Shcheblyakov DV, Tukhvatulin AI, Zubkova OV, Dzharullaeva AS, et al. Safety and efficacy of an rAd26 and rAd5 vector-based heterologous prime-boost COVID-19 vaccine: an interim analysis of a randomised controlled phase 3 trial in Russia. The Lancet. 2021. Feb 2;397(10275):671–81. doi: 10.1016/S0140-6736(21)00234-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
40.Madhi SA, Baillie V, Cutland CL, Voysey M, Koen AL, Fairlie L, et al. Efficacy of the ChAdOx1 nCoV-19 Covid-19 vaccine against the B.1.351 variant. N Engl J Med. 2021. Mar 16;384(20):1885–98. doi: 10.1056/NEJMoa2102214 [DOI] [PMC free article] [PubMed] [Google Scholar]
41.Mulligan MJ, Lyke KE, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Phase I/II study of COVID-19 RNA vaccine BNT162b1 in adults. Nature. 2020. Aug 12;586(7830):589–93. doi: 10.1038/s41586-020-2639-4 [DOI] [PubMed] [Google Scholar]
42.Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine. N Engl J Med. 2020. Dec 31;383(27):2603–15. doi: 10.1056/NEJMoa2034577 [DOI] [PMC free article] [PubMed] [Google Scholar]
43.Sadoff J, Le Gars M, Shukarev G, Heerwegh D, Truyers C, de Groot AM, et al. Interim results of a phase 1–2a trial of Ad26.COV2.S Covid-19 vaccine. N Engl J Med. 2021. Jan 13;384(19):1824–35. doi: 10.1056/NEJMoa2034201 [DOI] [PMC free article] [PubMed] [Google Scholar]
44.Sadoff J, Gray G, Vandebosch A, Cárdenas V, Shukarev G, Grinsztejn B, et al. Safety and efficacy of single-dose Ad26.COV2.S vaccine against Covid-19. N Engl J Med [Internet]. 2021. Apr 21 [cited 2021 Apr 28]; 10.1056/NEJMoa2101544 doi: 10.1056/NEJMoa2101544 [DOI] [PMC free article] [PubMed] [Google Scholar]
45.Voysey M, Clemens SAC, Madhi SA, Weckx LY, Folegatti PM, Aley PK, et al. Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: an interim analysis of four randomised controlled trials in Brazil, South Africa, and the UK. The Lancet. 2020. Dec 8;397(10269):99–111. [DOI] [PMC free article] [PubMed] [Google Scholar]
46.Walsh EE, Frenck RW, Falsey AR, Kitchin N, Absalon J, Gurtman A, et al. Safety and immunogenicity of two RNA-based Covid-19 vaccine candidates. N Engl J Med. 2020. Dec 17;383(25):2439–50. doi: 10.1056/NEJMoa2027906 [DOI] [PMC free article] [PubMed] [Google Scholar]
47.Wu Z, Hu Y, Xu M, Chen Z, Yang W, Jiang Z, et al. Safety, tolerability, and immunogenicity of an inactivated SARS-CoV-2 vaccine (CoronaVac) in healthy adults aged 60 years and older: a randomised, double-blind, placebo-controlled, phase 1/2 clinical trial. Lancet Infect Dis. 2021. Feb 3;S1473-3099(20):30987–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
48.Xia S, Zhang Y, Wang Y, Wang H, Yang Y, Gao GF, et al. Safety and immunogenicity of an inactivated SARS-CoV-2 vaccine, BBIBP-CorV: a randomised, double-blind, placebo-controlled, phase 1/2 trial. Lancet Infect Dis. 2021. Jan;21(1):39–51. doi: 10.1016/S1473-3099(20)30831-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
49.Xia S, Duan K, Zhang Y, Zhao D, Zhang H, Xie Z, et al. Effect of an inactivated vaccine against SARS-CoV-2 on safety and immunogenicity outcomes: interim analysis of 2 randomized clinical trials. JAMA. 2020. Aug 13;324(10):951–60. doi: 10.1001/jama.2020.15543 [DOI] [PMC free article] [PubMed] [Google Scholar]
50.Zhu F-C, Guan X-H, Li Y-H, Huang J-Y, Jiang T, Hou L-H, et al. Immunogenicity and safety of a recombinant adenovirus type-5-vectored COVID-19 vaccine in healthy adults aged 18 years or older: a randomised, double-blind, placebo-controlled, phase 2 trial. Lancet Lond Engl. 2020. 15;396(10249):479–88. doi: 10.1016/S0140-6736(20)31605-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
51.Zhang Y-J, Zeng G, Pan H-X, Li C-G, Kan B, Hu Y-L, et al. Immunogenicity and safety of a SARS-CoV-2 inactivated vaccine in healthy adults aged 18–59 years: report of the randomized, double-blind, and placebo-controlled phase 2 clinical trial. medRxiv. 2020 Aug 10;2020.07.31.
52.Ramasamy MN, Minassian AM, Ewer KJ, Flaxman AL, Folegatti PM, Owens DR, et al. Safety and immunogenicity of ChAdOx1 nCoV-19 vaccine administered in a prime-boost regimen in young and old adults (COV002): a single-blind, randomised, controlled, phase 2/3 trial. The Lancet. 2020. Nov 18;396(10267):1979–93. [DOI] [PMC free article] [PubMed] [Google Scholar]
53.Richmond P, Hatchuel L, Dong M, Ma B, Hu B, Smolenov I, et al. Safety and immunogenicity of S-Trimer (SCB-2019), a protein subunit vaccine candidate for COVID-19 in healthy adults: a phase 1, randomised, double-blind, placebo-controlled trial. Lancet Lond Engl. 2021. Feb 20;397(10275):682–94. doi: 10.1016/S0140-6736(21)00241-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
54.Bueno SM, Abarca K, González PA, Gálvez NM, Soto JA, Duarte LF, et al. Interim report: Safety and immunogenicity of an inactivated vaccine against SARS-CoV-2 in healthy chilean adults in a phase 3 clinical trial. medRxiv. 2021 Apr 1;2021.03.31.21254494.
55.Han B, Song Y, Li C, Yang W, Ma Q, Jiang Z, et al. Safety, Tolerability and Immunogenicity of an Inactivated SARS-CoV-2 Vaccine (CoronaVac) in Healthy Children and Adolescents: A Randomised, Double-Blind, and Placebo-Controlled, Phase 1/2 Clinical Trial [Internet]. Rochester, NY: Social Science Research Network; 2021 Apr [cited 2021 May 28]. Report No.: ID 3820545. https://papers.ssrn.com/abstract=3820545
56.Heath PT, Galiza EP, Baxter DN, Boffito M, Browne D, Burns F, et al. Efficacy of the NVX-CoV2373 Covid-19 Vaccine Against the B.1.1.7 Variant. medRxiv. 2021 May 14;2021.05.13.21256639.
57.Palacios R, Batista AP, Albuquerque CSN, Patiño EG, Santos J do P, Tilli Reis Pessoa Conde M, et al. Efficacy and Safety of a COVID-19 Inactivated Vaccine in Healthcare Professionals in Brazil: The PROFISCOV Study [Internet]. Rochester, NY: Social Science Research Network; 2021 Apr [cited 2021 May 27]. Report No.: ID 3822780. https://papers.ssrn.com/abstract=3822780
58.Yang S, Li Y, Dai L, Wang J, He P, Li C, et al. Safety and immunogenicity of a recombinant tandem-repeat dimeric RBD-based protein subunit vaccine (ZF2001) against COVID-19 in adults: two randomised, double-blind, placebo-controlled, phase 1 and 2 trials. Lancet Infect Dis [Internet]. 2021. Mar 24 [cited 2021 May 27];0(0). Available from: https://www.thelancet.com/journals/laninf/article/PIIS1473-3099(21)00127-4/abstract doi: 10.1016/S1473-3099(21)00127-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
59.Formica N, Mallory R, Albert G, Robinson M, Plested JS, Cho I, et al. Evaluation of a SARS-CoV-2 Vaccine NVX-CoV2373 in Younger and Older Adults. medRxiv. 2021 Mar 1;2021.02.26.21252482. [DOI] [PMC free article] [PubMed]
60.Chappell KJ, Mordant FL, Li Z, Wijesundara DK, Ellenberg P, Lackenby JA, et al. Safety and immunogenicity of an MF59-adjuvanted spike glycoprotein-clamp vaccine for SARS-CoV-2: a randomised, double-blind, placebo-controlled, phase 1 trial. Lancet Infect Dis [Internet]. 2021. Apr 19 [cited 2021 May 20];0(0). Available from: https://www.thelancet.com/journals/laninf/article/PIIS1473-3099(21)00200-0/abstract doi: 10.1016/S1473-3099(21)00200-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
61.Pan H-X, Liu J-K, Huang B-Y, Li G-F, Chang X-Y, Liu Y-F, et al. Immunogenicity and safety of a severe acute respiratory syndrome coronavirus 2 inactivated vaccine in healthy adults: randomized, double-blind, and placebo-controlled phase 1 and phase 2 clinical trials. Chin Med J (Engl). 2021. Jun 5;134(11):1289–1298. [DOI] [PMC free article] [PubMed] [Google Scholar]
62.Al Kaabi N, Zhang Y, Xia S, Yang Y, Al Qahtani MM, Abdulrazzaq N, et al. Effect of 2 Inactivated SARS-CoV-2 Vaccines on Symptomatic COVID-19 Infection in Adults: A Randomized Clinical Trial. JAMA. 2021. May 26; doi: 10.1001/jama.2021.8565 [DOI] [PMC free article] [PubMed] [Google Scholar]
63.Gobeil P, Pillet S, Séguin A, Boulay I, Mahmood A, Vinh DC, et al. Interim Report of a Phase 2 Randomized Trial of a Plant-Produced Virus-Like Particle Vaccine for Covid-19 in Healthy Adults Aged 18–64 and Older Adults Aged 65 and Older. medRxiv. 2021 May 17;2021.05.14.21257248.
64.Frenck RW, Klein NP, Kitchin N, Gurtman A, Absalon J, Lockhart S, et al. Safety, Immunogenicity, and Efficacy of the BNT162b2 Covid-19 Vaccine in Adolescents. N Engl J Med. 2021. May 27; [DOI] [PMC free article] [PubMed] [Google Scholar]
65.Shinde V, Bhikha S, Hoosain Z, Archary M, Bhorat Q, Fairlie L, et al. Efficacy of the NVX-CoV2373 Covid-19 Vaccine Against the B.1.351 Variant. N Engl J Med. 2021. May 20;384(20):1899–909. doi: 10.1056/NEJMoa2103055 [DOI] [PMC free article] [PubMed] [Google Scholar]
66.Anderson EJ, Rouphael NG, Widge AT, Jackson LA, Roberts PC, Makhene M, et al. Safety and immunogenicity of SARS-CoV-2 mRNA-1273 vaccine in older adults. N Engl J Med. 2020. Dec 17;383(25):2427–38. doi: 10.1056/NEJMoa2028436 [DOI] [PMC free article] [PubMed] [Google Scholar]
67.Zhu F-C, Li Y-H, Guan X-H, Hou L-H, Wang W-J, Li J-X, et al. Safety, tolerability, and immunogenicity of a recombinant adenovirus type-5 vectored COVID-19 vaccine: a dose-escalation, open-label, non-randomised, first-in-human trial. The Lancet. 2020. Jun 13;395(10240):1845–54. [DOI] [PMC free article] [PubMed] [Google Scholar]
68.Greinacher A, Thiele T, Warkentin TE, Weisser K, Kyrle PA, Eichinger S. Thrombotic thrombocytopenia after ChAdOx1 nCov-19 vaccination. N Engl J Med [Internet]. 2021. Apr 9 [cited 2021 Apr 28];NEJMoa2104840. 10.1056/NEJMoa2104840 [DOI] [PMC free article] [PubMed] [Google Scholar]
69.Haas EJ, Angulo FJ, McLaughlin JM, Anis E, Singer SR, Khan F, et al. Impact and effectiveness of mRNA BNT162b2 vaccine against SARS-CoV-2 infections and COVID-19 cases, hospitalisations, and deaths following a nationwide vaccination campaign in Israel: an observational study using national surveillance data. The Lancet. 2021. May 5;397(10287):1819–29. [DOI] [PMC free article] [PubMed] [Google Scholar]
70.Vasileiou E, Simpson CR, Shi T, Kerr S, Agrawal U, Akbari A, et al. Interim findings from first-dose mass COVID-19 vaccination roll-out and COVID-19 hospital admissions in Scotland: a national prospective cohort study. The Lancet. 2021. May 1;397(10285):1646–57. doi: 10.1016/S0140-6736(21)00677-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
71.Quinn KM, Zak DE, Costa A, Yamamoto A, Kastenmuller K, Hill BJ, et al. Antigen expression determines adenoviral vaccine potency independent of IFN and STING signaling. J Clin Invest. 2015. Mar 2;125(3):1129–46. doi: 10.1172/JCI78280 [DOI] [PMC free article] [PubMed] [Google Scholar]
72.Steffensen MA, Holst PJ, Steengaard SS, Jensen BAH, Bartholdy C, Stryhn A, et al. Qualitative and quantitative analysis of adenovirus type 5 vector-induced memory CD8 T cells: not as bad as their reputation. J Virol. 2013. Jun;87(11):6283–95. doi: 10.1128/JVI.00465-13 [DOI] [PMC free article] [PubMed] [Google Scholar]
73.Teigler JE, Iampietro MJ, Barouch DH. Vaccination with adenovirus serotypes 35, 26, and 48 elicits higher levels of innate cytokine responses than adenovirus serotype 5 in rhesus monkeys. J Virol. 2012. Sep;86(18):9590–8. doi: 10.1128/JVI.00740-12 [DOI] [PMC free article] [PubMed] [Google Scholar]
74.Abdool Karim SS, de Oliveira T. New SARS-CoV-2 variants—clinical, public health, and vaccine implications. N Engl J Med. 2021. Mar 24;384(19):1866–8. doi: 10.1056/NEJMc2100362 [DOI] [PMC free article] [PubMed] [Google Scholar]
75.Kumar V, Singh J, Hasnain SE, Sundar D. Possible link between higher transmissibility of B.1.617 and B.1.1.7 variants of SARS-CoV-2 and increased structural stability of its spike protein and hACE2 affinity. bioRxiv. 2021 Apr 29;2021.04.29.441933. [DOI] [PMC free article] [PubMed]
76.Sanders RW, de Jong MD. Pandemic moves and countermoves: vaccines and viral variants. The Lancet. 2021. Apr 10;397(10282):1326–7. doi: 10.1016/S0140-6736(21)00730-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
77.Soh SM, Kim Y, Kim C, Jang US, Lee H-R. The rapid adaptation of SARS-CoV-2-rise of the variants: transmission and resistance. J Microbiol Seoul Korea. 2021. Sep;59(9):807–18. doi: 10.1007/s12275-021-1348-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
78.Allotey J, Stallings E, Bonet M, Yap M, Chatterjee S, Kew T, et al. Clinical manifestations, risk factors, and maternal and perinatal outcomes of coronavirus disease 2019 in pregnancy: living systematic review and meta-analysis. BMJ. 2020. Sep 1;370:m3320. doi: 10.1136/bmj.m3320 [DOI] [PMC free article] [PubMed] [Google Scholar]
79.Vergara-Merino L, Meza N, Couve-Pérez C, Carrasco C, Ortiz-Muñoz L, Madrid E, et al. Maternal and perinatal outcomes related to COVID-19 and pregnancy: An overview of systematic reviews. Acta Obstet Gynecol Scand. 2021. Feb 9; doi: 10.1111/aogs.14118 [DOI] [PMC free article] [PubMed] [Google Scholar]
80.Prevention, Children’s Hospital Medical Center C, Center BM. Observational Maternal COVID-19 Vaccination Study. https://ClinicalTrials.gov/show/NCT04826640; 2021.
81.COVID-19 vaccines international pregnancy exposure registry. https://ClinicalTrials.gov/show/NCT04705116; 2021. [DOI] [PMC free article] [PubMed]
82.Active pharmacovigilance study of adsorbed COVID-19 (Inactivated) vaccine. https://ClinicalTrials.gov/show/NCT04845048; 2021.
83.Rottenstreich A, Zarbiv G, Oiknine-Djian E, Zigron R, Wolf DG, Porat S. Efficient maternofetal transplacental transfer of anti- SARS-CoV-2 spike antibodies after antenatal SARS-CoV-2 BNT162b2 mRNA vaccination. Clin Infect Dis Off Publ Infect Dis Soc Am. 2021. Apr 3;ciab266. [DOI] [PMC free article] [PubMed] [Google Scholar]
84.WHO. Who can take the Pfizer-BioNTech COVID-19 vaccine? 2021. https://www.who.int/news-room/feature-stories/detail/who-can-take-the-pfizer-biontech-covid-19-vaccine (accessed April 15th 2021.
85.A study of Ad26.COV2.S in healthy pregnant participants (COVID-19). https://ClinicalTrials.gov/show/NCT04765384; 2021.
86.Study to evaluate the safety, tolerability, and immunogenicity of SARS CoV-2 RNA Vaccine Candidate (BNT162b2) against COVID-19 in healthy pregnant women 18 Years of age and older. https://ClinicalTrials.gov/show/NCT04754594; 2021.
87.Dong Y, Dai T, Wei Y, Zhang L, Zheng M, Zhou F. A systematic review of SARS-CoV-2 vaccine candidates. Signal Transduct Target Ther. 2020. Oct 13;5(1):1–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
88.Pormohammad A, Zarei M, Ghorbani S, Mohammadi M, Razizadeh MH, Turner DL, et al. Efficacy and Safety of COVID-19 Vaccines: A Systematic Review and Meta-Analysis of Randomized Clinical Trials. Vaccines. 2021. May;9(5):467. doi: 10.3390/vaccines9050467 [DOI] [PMC free article] [PubMed] [Google Scholar]
89.Elliott JH, Turner T, Clavisi O, Thomas J, Higgins JPT, Mavergames C, et al. Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap. PLoS Med. 2014. Feb;11(2):e1001603. doi: 10.1371/journal.pmed.1001603 [DOI] [PMC free article] [PubMed] [Google Scholar]
90.Elliott JH, Synnot A, Turner T, Simmonds M, Akl EA, McDonald S, et al. Living systematic review: 1. Introduction-the why, what, when, and how. J Clin Epidemiol. 2017. Nov;91:23–30. doi: 10.1016/j.jclinepi.2017.08.010 [DOI] [PubMed] [Google Scholar]
91.Barrett JR, Belij-Rammerstorfer S, Dold C, Ewer KJ, Folegatti PM, Gilbride C, et al. Phase 1/2 trial of SARS-CoV-2 vaccine ChAdOx1 nCoV-19 with a booster dose induces multifunctional antibody responses. Nat Med. 2020. Dec 17;1–10. [DOI] [PubMed] [Google Scholar]

PLoS One. doi: 10.1371/journal.pone.0260733.r001

Decision Letter 0

Stefanos Bonovas

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

16 Nov 2021

Vaccines to prevent COVID-19 a living systematic review with Trial Sequential Analysis and network meta-analysis of randomized clinical trials

PONE-D-21-31660

Dear Dr. Korang,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Stefanos Bonovas, M.D., M.Sc., Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a living systematic review and network meta-analysis focusing on the available vaccines to prevent COVID-19. In a moment where research is under the magnifying glass, this work becomes fundamental. Written effectively following the best methodology and highlighting important results, I thank and congratulate the authors for the continuous update of the evidence.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

PLoS One. doi: 10.1371/journal.pone.0260733.r002

Acceptance letter

Stefanos Bonovas

10 Dec 2021

PONE-D-21-31660

Vaccines to prevent COVID-19: a living systematic review with Trial Sequential Analysis and network meta-analysis of randomized clinical trials

Dear Dr. Korang:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Stefanos Bonovas

Academic Editor

PLOS ONE

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

S1 File

(DOCX)

Click here for additional data file.^{(4.2MB, docx)}

S1 Checklist

(DOCX)

Click here for additional data file.^{(32.4KB, docx)}

Data Availability Statement

All relevant data are within the manuscript and its Supporting information files.

[pone.0260733.ref001] 1.Guan W-J, Ni Z-Y, Hu Y, Liang W-H, Ou C-Q, He J-X, et al. Clinical characteristics of Coronavirus Disease 2019 in China. N Engl J Med. 2020. 30;382(18):1708–20. doi: 10.1056/NEJMoa2002032 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref002] 2.WHO. Coronavirus disease (COVID-19) Weekly epidemiological update and weekly operational update [Internet]. 2021 [cited 2021 Aug 3]. https://reliefweb.int/report/world/weekly-operational-update-covid-19-26-july-2021

[pone.0260733.ref003] 3.Juul S, Nielsen EE, Feinberg J, Siddiqui F, Jørgensen CK, Barot E, et al. Interventions for treatment of COVID-19: A living systematic review with meta-analyses and trial sequential analyses (The LIVING Project). PLoS Med. 2020. Sep;17(9):e1003293. doi: 10.1371/journal.pmed.1003293 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref004] 4.Deb B, Shah H, Goel S. Current global vaccine and drug efforts against COVID-19: Pros and cons of bypassing animal trials. J Biosci. 2020;45. doi: 10.1007/s12038-020-00053-2 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref005] 5.Funk CD, Laferrière C, Ardakani A. A snapshot of the Global race for vaccines targeting SARS-CoV-2 and the COVID-19 pandemic. Front Pharmacol. 2020;11:937. doi: 10.3389/fphar.2020.00937 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref006] 6.Zimmer C, Corum J, Wee S-L. Coronavirus vaccine tracker. The New York Times [Internet]. [cited 2021 Feb 6]; https://www.nytimes.com/interactive/2020/science/coronavirus-vaccine-tracker.html

[pone.0260733.ref007] 7.Korang SK, von Rohden E, Veroniki AA, Ong G, Ngalamika O, Siddiqui F, et al. Vaccines to Prevent COVID-19: A Living Systematic Review With Trial Sequential Analysis and Network Meta-Analysis of Randomised Controlled Trials [Internet]. Rochester, NY: Social Science Research Network; 2021 May [cited 2021 Jun 17]. Report No.: ID 3854588. https://papers.ssrn.com/abstract=3854588

[pone.0260733.ref008] 8.Korang SK, Juul S, Nielsen EE, Feinberg J, Siddiqui F, Ong G, et al. Vaccines to prevent COVID-19: a protocol for a living systematic review with network meta-analysis including individual patient data (The LIVING VACCINE Project). Syst Rev. 2020. Nov 20;9(1):262. doi: 10.1186/s13643-020-01516-1 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref009] 9.Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. PLOS Med. 2021. Mar 29;18(3):e1003583. doi: 10.1371/journal.pmed.1003583 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref010] 10.Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015. Jun 2;162(11):777–84. doi: 10.7326/M14-2385 [DOI] [PubMed] [Google Scholar]

[pone.0260733.ref011] 11.Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al. Cochrane Handbook for Systematic Reviews of Interventions version 6.2. www.training.cochrane.org/handbook. 2021.

[pone.0260733.ref012] 12.Korang SK, Juul S, Nielsen EE, Feinberg J, Siddiqui F, Klingenberg S, et al. Vaccines to prevent COVID-19: a protocol for a living systematic review with network meta-analysis including individual patient data (The LIVING VACCINE Project) PROSPERO 2020 CRD42020196492 [Internet]. [cited 2021 May 3]. https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=196492 [DOI] [PMC free article] [PubMed]

[pone.0260733.ref013] 13.Higgins JPT, Li T, Sterne J. Revised Cochrane risk of bias tool for randomized trials (RoB 2)Additional considerations for crossover trials. 20201208RoB2guidancecrossovertrialpdf—Google Drev. 2020 Dec 8;

[pone.0260733.ref014] 14.Keus F, Wetterslev J, Gluud C, van Laarhoven CJHM. Evidence at a glance: error matrix approach for overviewing available evidence. BMC Med Res Methodol. 2010. Oct 1;10:90. doi: 10.1186/1471-2288-10-90 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref015] 15.Jakobsen JC, Wetterslev J, Winkel P, Lange T, Gluud C. Thresholds for statistical and clinical significance in systematic reviews with meta-analytic methods. BMC Med Res Methodol. 2014. Nov 21;14:120. doi: 10.1186/1471-2288-14-120 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref016] 16.StataCorp. Stata Statistical Software: Release 16 2019 [College Station, TX: StataCorp LLC http://www.stata.com].

[pone.0260733.ref017] 17.White I. Network meta-analysis. Stata J. 2015;15:951–85. [Google Scholar]

[pone.0260733.ref018] 18.Bradburn M, Deeks J, Altman D. sbe24: metan–an alternative meta-analysis command. Stata Tech Bull. 1988;44(15). [Google Scholar]

[pone.0260733.ref019] 19.DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177–88. doi: 10.1016/0197-2456(86)90046-2 [DOI] [PubMed] [Google Scholar]

[pone.0260733.ref020] 20.DeMets DL. Methods for combining randomized clinical trials: strengths and limitations. Stat Med. 1987;6(3):341–50. doi: 10.1002/sim.4780060325 [DOI] [PubMed] [Google Scholar]

[pone.0260733.ref021] 21.Thorlund K, Devereaux PJ, Wetterslev J, Guyatt G, Ioannidis JPA, Thabane L, et al. Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses? Int J Epidemiol. 2009. Feb;38(1):276–86. doi: 10.1093/ije/dyn179 [DOI] [PubMed] [Google Scholar]

[pone.0260733.ref022] 22.Thorlund K, Engstrøm J, Wetterslev J, Brok J, Imberger G, Gluud C. User manual for Trial Sequential Analysis (TSA), 2011. ctu.dk/tsa/files/tsa_manual.pdf. 2015 Jan 7;

[pone.0260733.ref023] 23.Imberger G, Thorlund K, Gluud C, Wetterslev J. False-positive findings in Cochrane meta-analyses with and without application of trial sequential analysis: an empirical review. BMJ Open. 2016. 12;6(8):e011890. doi: 10.1136/bmjopen-2016-011890 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref024] 24.Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002. Jun 15;21(11):1539–58. doi: 10.1002/sim.1186 [DOI] [PubMed] [Google Scholar]

[pone.0260733.ref025] 25.Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–60. doi: 10.1136/bmj.327.7414.557 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref026] 26.Langan D, Higgins JPT, Jackson D, Bowden J, Veroniki AA, Kontopantelis E, et al. A comparison of heterogeneity variance estimators in simulated random-effects meta-analyses. Res Synth Methods. 2019. Mar;10(1):83–98. doi: 10.1002/jrsm.1316 [DOI] [PubMed] [Google Scholar]

[pone.0260733.ref027] 27.Veroniki AA, Jackson D, Viechtbauer W, Bender R, Bowden J, Knapp G, et al. Methods to estimate the between-study variance and its uncertainty in meta-analysis. Res Synth Methods. 2016. Mar;7(1):55–79. doi: 10.1002/jrsm.1164 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref028] 28.Nikolakopoulou A, Higgins JPT, Papakonstantinou T, Chaimani A, Del Giovane C, Egger M, et al. CINeMA: An approach for assessing confidence in the results of a network meta-analysis. PLoS Med. 2020;17(4):e1003082. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref029] 29.Papakonstantinou T, Nikolakopoulou A, Higgins JPT, Egger M, Salanti G. CINeMA: Software for semiautomated assessment of the confidence in the results of network meta-analysis. Campbell Syst Rev. 2020;16(1):e1080. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref030] 30.CINeMA: Software for semiautomated assessment of the confidence in the results of network meta‐analysis—Papakonstantinou—2020—Campbell Systematic Reviews—Wiley Online Library [Internet]. [cited 2020 Nov 6]. https://onlinelibrary.wiley.com/doi/full/10.1002/cl2.1080 [DOI] [PMC free article] [PubMed]

[pone.0260733.ref031] 31.Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008. Apr 26;336(7650):924–6. doi: 10.1136/bmj.39489.470347.AD [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref032] 32.Brok J, Thorlund K, Gluud C, Wetterslev J. Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol. 2008. Aug;61(8):763–9. doi: 10.1016/j.jclinepi.2007.10.007 [DOI] [PubMed] [Google Scholar]

[pone.0260733.ref033] 33.Brok J, Thorlund K, Wetterslev J, Gluud C. Apparently conclusive meta-analyses may be inconclusive—Trial sequential analysis adjustment of random error risk due to repetitive testing of accumulating data in apparently conclusive neonatal meta-analyses. Int J Epidemiol. 2009;38(1):287–98. doi: 10.1093/ije/dyn188 [DOI] [PubMed] [Google Scholar]

[pone.0260733.ref034] 34.Baden LR, El Sahly HM, Essink B, Kotloff K, Frey S, Novak R, et al. Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine. N Engl J Med. 2021. Feb;384(5):403–16. doi: 10.1056/NEJMoa2035389 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref035] 35.Che Y, Liu X, Pu Y, Zhou M, Zhao Z, Jiang R, et al. Randomized, double-blinded and placebo-controlled phase II trial of an inactivated SARS-CoV-2 vaccine in healthy adults. Clin Infect Dis Off Publ Infect Dis Soc Am. 2020. Nov 9;ciaa1703. [Google Scholar]

[pone.0260733.ref036] 36.Ella R, Vadrevu KM, Jogdand H, Prasad S, Reddy S, Sarangi V, et al. Safety and immunogenicity of an inactivated SARS-CoV-2 vaccine, BBV152: a double-blind, randomised, phase 1 trial. Lancet Infect Dis. 2021. Jan 21;21(5):637–64. doi: 10.1016/S1473-3099(20)30942-7 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref037] 37.Folegatti PM, Ewer KJ, Aley PK, Angus B, Becker S, Belij-Rammerstorfer S, et al. Safety and immunogenicity of the ChAdOx1 nCoV-19 vaccine against SARS-CoV-2: a preliminary report of a phase 1/2, single-blind, randomised controlled trial. Lancet Lond Engl. 2020. 15;396(10249):467–78. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref038] 38.Keech C, Albert G, Cho I, Robertson A, Reed P, Neal S, et al. Phase 1–2 Trial of a SARS-CoV-2 recombinant spike protein nanoparticle vaccine. N Engl J Med. 2020. Dec 10;383(24):2320–32. doi: 10.1056/NEJMoa2026920 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref039] 39.Logunov DY, Dolzhikova IV, Shcheblyakov DV, Tukhvatulin AI, Zubkova OV, Dzharullaeva AS, et al. Safety and efficacy of an rAd26 and rAd5 vector-based heterologous prime-boost COVID-19 vaccine: an interim analysis of a randomised controlled phase 3 trial in Russia. The Lancet. 2021. Feb 2;397(10275):671–81. doi: 10.1016/S0140-6736(21)00234-8 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref040] 40.Madhi SA, Baillie V, Cutland CL, Voysey M, Koen AL, Fairlie L, et al. Efficacy of the ChAdOx1 nCoV-19 Covid-19 vaccine against the B.1.351 variant. N Engl J Med. 2021. Mar 16;384(20):1885–98. doi: 10.1056/NEJMoa2102214 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref041] 41.Mulligan MJ, Lyke KE, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Phase I/II study of COVID-19 RNA vaccine BNT162b1 in adults. Nature. 2020. Aug 12;586(7830):589–93. doi: 10.1038/s41586-020-2639-4 [DOI] [PubMed] [Google Scholar]

[pone.0260733.ref042] 42.Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine. N Engl J Med. 2020. Dec 31;383(27):2603–15. doi: 10.1056/NEJMoa2034577 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref043] 43.Sadoff J, Le Gars M, Shukarev G, Heerwegh D, Truyers C, de Groot AM, et al. Interim results of a phase 1–2a trial of Ad26.COV2.S Covid-19 vaccine. N Engl J Med. 2021. Jan 13;384(19):1824–35. doi: 10.1056/NEJMoa2034201 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref044] 44.Sadoff J, Gray G, Vandebosch A, Cárdenas V, Shukarev G, Grinsztejn B, et al. Safety and efficacy of single-dose Ad26.COV2.S vaccine against Covid-19. N Engl J Med [Internet]. 2021. Apr 21 [cited 2021 Apr 28]; 10.1056/NEJMoa2101544 doi: 10.1056/NEJMoa2101544 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref045] 45.Voysey M, Clemens SAC, Madhi SA, Weckx LY, Folegatti PM, Aley PK, et al. Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: an interim analysis of four randomised controlled trials in Brazil, South Africa, and the UK. The Lancet. 2020. Dec 8;397(10269):99–111. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref046] 46.Walsh EE, Frenck RW, Falsey AR, Kitchin N, Absalon J, Gurtman A, et al. Safety and immunogenicity of two RNA-based Covid-19 vaccine candidates. N Engl J Med. 2020. Dec 17;383(25):2439–50. doi: 10.1056/NEJMoa2027906 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref047] 47.Wu Z, Hu Y, Xu M, Chen Z, Yang W, Jiang Z, et al. Safety, tolerability, and immunogenicity of an inactivated SARS-CoV-2 vaccine (CoronaVac) in healthy adults aged 60 years and older: a randomised, double-blind, placebo-controlled, phase 1/2 clinical trial. Lancet Infect Dis. 2021. Feb 3;S1473-3099(20):30987–7. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref048] 48.Xia S, Zhang Y, Wang Y, Wang H, Yang Y, Gao GF, et al. Safety and immunogenicity of an inactivated SARS-CoV-2 vaccine, BBIBP-CorV: a randomised, double-blind, placebo-controlled, phase 1/2 trial. Lancet Infect Dis. 2021. Jan;21(1):39–51. doi: 10.1016/S1473-3099(20)30831-8 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref049] 49.Xia S, Duan K, Zhang Y, Zhao D, Zhang H, Xie Z, et al. Effect of an inactivated vaccine against SARS-CoV-2 on safety and immunogenicity outcomes: interim analysis of 2 randomized clinical trials. JAMA. 2020. Aug 13;324(10):951–60. doi: 10.1001/jama.2020.15543 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref050] 50.Zhu F-C, Guan X-H, Li Y-H, Huang J-Y, Jiang T, Hou L-H, et al. Immunogenicity and safety of a recombinant adenovirus type-5-vectored COVID-19 vaccine in healthy adults aged 18 years or older: a randomised, double-blind, placebo-controlled, phase 2 trial. Lancet Lond Engl. 2020. 15;396(10249):479–88. doi: 10.1016/S0140-6736(20)31605-6 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref051] 51.Zhang Y-J, Zeng G, Pan H-X, Li C-G, Kan B, Hu Y-L, et al. Immunogenicity and safety of a SARS-CoV-2 inactivated vaccine in healthy adults aged 18–59 years: report of the randomized, double-blind, and placebo-controlled phase 2 clinical trial. medRxiv. 2020 Aug 10;2020.07.31.

[pone.0260733.ref052] 52.Ramasamy MN, Minassian AM, Ewer KJ, Flaxman AL, Folegatti PM, Owens DR, et al. Safety and immunogenicity of ChAdOx1 nCoV-19 vaccine administered in a prime-boost regimen in young and old adults (COV002): a single-blind, randomised, controlled, phase 2/3 trial. The Lancet. 2020. Nov 18;396(10267):1979–93. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref053] 53.Richmond P, Hatchuel L, Dong M, Ma B, Hu B, Smolenov I, et al. Safety and immunogenicity of S-Trimer (SCB-2019), a protein subunit vaccine candidate for COVID-19 in healthy adults: a phase 1, randomised, double-blind, placebo-controlled trial. Lancet Lond Engl. 2021. Feb 20;397(10275):682–94. doi: 10.1016/S0140-6736(21)00241-5 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref054] 54.Bueno SM, Abarca K, González PA, Gálvez NM, Soto JA, Duarte LF, et al. Interim report: Safety and immunogenicity of an inactivated vaccine against SARS-CoV-2 in healthy chilean adults in a phase 3 clinical trial. medRxiv. 2021 Apr 1;2021.03.31.21254494.

[pone.0260733.ref055] 55.Han B, Song Y, Li C, Yang W, Ma Q, Jiang Z, et al. Safety, Tolerability and Immunogenicity of an Inactivated SARS-CoV-2 Vaccine (CoronaVac) in Healthy Children and Adolescents: A Randomised, Double-Blind, and Placebo-Controlled, Phase 1/2 Clinical Trial [Internet]. Rochester, NY: Social Science Research Network; 2021 Apr [cited 2021 May 28]. Report No.: ID 3820545. https://papers.ssrn.com/abstract=3820545

[pone.0260733.ref056] 56.Heath PT, Galiza EP, Baxter DN, Boffito M, Browne D, Burns F, et al. Efficacy of the NVX-CoV2373 Covid-19 Vaccine Against the B.1.1.7 Variant. medRxiv. 2021 May 14;2021.05.13.21256639.

[pone.0260733.ref057] 57.Palacios R, Batista AP, Albuquerque CSN, Patiño EG, Santos J do P, Tilli Reis Pessoa Conde M, et al. Efficacy and Safety of a COVID-19 Inactivated Vaccine in Healthcare Professionals in Brazil: The PROFISCOV Study [Internet]. Rochester, NY: Social Science Research Network; 2021 Apr [cited 2021 May 27]. Report No.: ID 3822780. https://papers.ssrn.com/abstract=3822780

[pone.0260733.ref058] 58.Yang S, Li Y, Dai L, Wang J, He P, Li C, et al. Safety and immunogenicity of a recombinant tandem-repeat dimeric RBD-based protein subunit vaccine (ZF2001) against COVID-19 in adults: two randomised, double-blind, placebo-controlled, phase 1 and 2 trials. Lancet Infect Dis [Internet]. 2021. Mar 24 [cited 2021 May 27];0(0). Available from: https://www.thelancet.com/journals/laninf/article/PIIS1473-3099(21)00127-4/abstract doi: 10.1016/S1473-3099(21)00127-4 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref059] 59.Formica N, Mallory R, Albert G, Robinson M, Plested JS, Cho I, et al. Evaluation of a SARS-CoV-2 Vaccine NVX-CoV2373 in Younger and Older Adults. medRxiv. 2021 Mar 1;2021.02.26.21252482. [DOI] [PMC free article] [PubMed]

[pone.0260733.ref060] 60.Chappell KJ, Mordant FL, Li Z, Wijesundara DK, Ellenberg P, Lackenby JA, et al. Safety and immunogenicity of an MF59-adjuvanted spike glycoprotein-clamp vaccine for SARS-CoV-2: a randomised, double-blind, placebo-controlled, phase 1 trial. Lancet Infect Dis [Internet]. 2021. Apr 19 [cited 2021 May 20];0(0). Available from: https://www.thelancet.com/journals/laninf/article/PIIS1473-3099(21)00200-0/abstract doi: 10.1016/S1473-3099(21)00200-0 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref061] 61.Pan H-X, Liu J-K, Huang B-Y, Li G-F, Chang X-Y, Liu Y-F, et al. Immunogenicity and safety of a severe acute respiratory syndrome coronavirus 2 inactivated vaccine in healthy adults: randomized, double-blind, and placebo-controlled phase 1 and phase 2 clinical trials. Chin Med J (Engl). 2021. Jun 5;134(11):1289–1298. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref062] 62.Al Kaabi N, Zhang Y, Xia S, Yang Y, Al Qahtani MM, Abdulrazzaq N, et al. Effect of 2 Inactivated SARS-CoV-2 Vaccines on Symptomatic COVID-19 Infection in Adults: A Randomized Clinical Trial. JAMA. 2021. May 26; doi: 10.1001/jama.2021.8565 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref063] 63.Gobeil P, Pillet S, Séguin A, Boulay I, Mahmood A, Vinh DC, et al. Interim Report of a Phase 2 Randomized Trial of a Plant-Produced Virus-Like Particle Vaccine for Covid-19 in Healthy Adults Aged 18–64 and Older Adults Aged 65 and Older. medRxiv. 2021 May 17;2021.05.14.21257248.

[pone.0260733.ref064] 64.Frenck RW, Klein NP, Kitchin N, Gurtman A, Absalon J, Lockhart S, et al. Safety, Immunogenicity, and Efficacy of the BNT162b2 Covid-19 Vaccine in Adolescents. N Engl J Med. 2021. May 27; [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref065] 65.Shinde V, Bhikha S, Hoosain Z, Archary M, Bhorat Q, Fairlie L, et al. Efficacy of the NVX-CoV2373 Covid-19 Vaccine Against the B.1.351 Variant. N Engl J Med. 2021. May 20;384(20):1899–909. doi: 10.1056/NEJMoa2103055 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref066] 66.Anderson EJ, Rouphael NG, Widge AT, Jackson LA, Roberts PC, Makhene M, et al. Safety and immunogenicity of SARS-CoV-2 mRNA-1273 vaccine in older adults. N Engl J Med. 2020. Dec 17;383(25):2427–38. doi: 10.1056/NEJMoa2028436 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref067] 67.Zhu F-C, Li Y-H, Guan X-H, Hou L-H, Wang W-J, Li J-X, et al. Safety, tolerability, and immunogenicity of a recombinant adenovirus type-5 vectored COVID-19 vaccine: a dose-escalation, open-label, non-randomised, first-in-human trial. The Lancet. 2020. Jun 13;395(10240):1845–54. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref068] 68.Greinacher A, Thiele T, Warkentin TE, Weisser K, Kyrle PA, Eichinger S. Thrombotic thrombocytopenia after ChAdOx1 nCov-19 vaccination. N Engl J Med [Internet]. 2021. Apr 9 [cited 2021 Apr 28];NEJMoa2104840. 10.1056/NEJMoa2104840 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref069] 69.Haas EJ, Angulo FJ, McLaughlin JM, Anis E, Singer SR, Khan F, et al. Impact and effectiveness of mRNA BNT162b2 vaccine against SARS-CoV-2 infections and COVID-19 cases, hospitalisations, and deaths following a nationwide vaccination campaign in Israel: an observational study using national surveillance data. The Lancet. 2021. May 5;397(10287):1819–29. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref070] 70.Vasileiou E, Simpson CR, Shi T, Kerr S, Agrawal U, Akbari A, et al. Interim findings from first-dose mass COVID-19 vaccination roll-out and COVID-19 hospital admissions in Scotland: a national prospective cohort study. The Lancet. 2021. May 1;397(10285):1646–57. doi: 10.1016/S0140-6736(21)00677-2 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref071] 71.Quinn KM, Zak DE, Costa A, Yamamoto A, Kastenmuller K, Hill BJ, et al. Antigen expression determines adenoviral vaccine potency independent of IFN and STING signaling. J Clin Invest. 2015. Mar 2;125(3):1129–46. doi: 10.1172/JCI78280 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref072] 72.Steffensen MA, Holst PJ, Steengaard SS, Jensen BAH, Bartholdy C, Stryhn A, et al. Qualitative and quantitative analysis of adenovirus type 5 vector-induced memory CD8 T cells: not as bad as their reputation. J Virol. 2013. Jun;87(11):6283–95. doi: 10.1128/JVI.00465-13 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref073] 73.Teigler JE, Iampietro MJ, Barouch DH. Vaccination with adenovirus serotypes 35, 26, and 48 elicits higher levels of innate cytokine responses than adenovirus serotype 5 in rhesus monkeys. J Virol. 2012. Sep;86(18):9590–8. doi: 10.1128/JVI.00740-12 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref074] 74.Abdool Karim SS, de Oliveira T. New SARS-CoV-2 variants—clinical, public health, and vaccine implications. N Engl J Med. 2021. Mar 24;384(19):1866–8. doi: 10.1056/NEJMc2100362 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref075] 75.Kumar V, Singh J, Hasnain SE, Sundar D. Possible link between higher transmissibility of B.1.617 and B.1.1.7 variants of SARS-CoV-2 and increased structural stability of its spike protein and hACE2 affinity. bioRxiv. 2021 Apr 29;2021.04.29.441933. [DOI] [PMC free article] [PubMed]

[pone.0260733.ref076] 76.Sanders RW, de Jong MD. Pandemic moves and countermoves: vaccines and viral variants. The Lancet. 2021. Apr 10;397(10282):1326–7. doi: 10.1016/S0140-6736(21)00730-3 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref077] 77.Soh SM, Kim Y, Kim C, Jang US, Lee H-R. The rapid adaptation of SARS-CoV-2-rise of the variants: transmission and resistance. J Microbiol Seoul Korea. 2021. Sep;59(9):807–18. doi: 10.1007/s12275-021-1348-5 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref078] 78.Allotey J, Stallings E, Bonet M, Yap M, Chatterjee S, Kew T, et al. Clinical manifestations, risk factors, and maternal and perinatal outcomes of coronavirus disease 2019 in pregnancy: living systematic review and meta-analysis. BMJ. 2020. Sep 1;370:m3320. doi: 10.1136/bmj.m3320 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref079] 79.Vergara-Merino L, Meza N, Couve-Pérez C, Carrasco C, Ortiz-Muñoz L, Madrid E, et al. Maternal and perinatal outcomes related to COVID-19 and pregnancy: An overview of systematic reviews. Acta Obstet Gynecol Scand. 2021. Feb 9; doi: 10.1111/aogs.14118 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref080] 80.Prevention, Children’s Hospital Medical Center C, Center BM. Observational Maternal COVID-19 Vaccination Study. https://ClinicalTrials.gov/show/NCT04826640; 2021.

[pone.0260733.ref081] 81.COVID-19 vaccines international pregnancy exposure registry. https://ClinicalTrials.gov/show/NCT04705116; 2021. [DOI] [PMC free article] [PubMed]

[pone.0260733.ref082] 82.Active pharmacovigilance study of adsorbed COVID-19 (Inactivated) vaccine. https://ClinicalTrials.gov/show/NCT04845048; 2021.

[pone.0260733.ref083] 83.Rottenstreich A, Zarbiv G, Oiknine-Djian E, Zigron R, Wolf DG, Porat S. Efficient maternofetal transplacental transfer of anti- SARS-CoV-2 spike antibodies after antenatal SARS-CoV-2 BNT162b2 mRNA vaccination. Clin Infect Dis Off Publ Infect Dis Soc Am. 2021. Apr 3;ciab266. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref084] 84.WHO. Who can take the Pfizer-BioNTech COVID-19 vaccine? 2021. https://www.who.int/news-room/feature-stories/detail/who-can-take-the-pfizer-biontech-covid-19-vaccine (accessed April 15th 2021.

[pone.0260733.ref085] 85.A study of Ad26.COV2.S in healthy pregnant participants (COVID-19). https://ClinicalTrials.gov/show/NCT04765384; 2021.

[pone.0260733.ref086] 86.Study to evaluate the safety, tolerability, and immunogenicity of SARS CoV-2 RNA Vaccine Candidate (BNT162b2) against COVID-19 in healthy pregnant women 18 Years of age and older. https://ClinicalTrials.gov/show/NCT04754594; 2021.

[pone.0260733.ref087] 87.Dong Y, Dai T, Wei Y, Zhang L, Zheng M, Zhou F. A systematic review of SARS-CoV-2 vaccine candidates. Signal Transduct Target Ther. 2020. Oct 13;5(1):1–14. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref088] 88.Pormohammad A, Zarei M, Ghorbani S, Mohammadi M, Razizadeh MH, Turner DL, et al. Efficacy and Safety of COVID-19 Vaccines: A Systematic Review and Meta-Analysis of Randomized Clinical Trials. Vaccines. 2021. May;9(5):467. doi: 10.3390/vaccines9050467 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref089] 89.Elliott JH, Turner T, Clavisi O, Thomas J, Higgins JPT, Mavergames C, et al. Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap. PLoS Med. 2014. Feb;11(2):e1001603. doi: 10.1371/journal.pmed.1001603 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0260733.ref090] 90.Elliott JH, Synnot A, Turner T, Simmonds M, Akl EA, McDonald S, et al. Living systematic review: 1. Introduction-the why, what, when, and how. J Clin Epidemiol. 2017. Nov;91:23–30. doi: 10.1016/j.jclinepi.2017.08.010 [DOI] [PubMed] [Google Scholar]

[pone.0260733.ref091] 91.Barrett JR, Belij-Rammerstorfer S, Dold C, Ewer KJ, Folegatti PM, Gilbride C, et al. Phase 1/2 trial of SARS-CoV-2 vaccine ChAdOx1 nCoV-19 with a booster dose induces multifunctional antibody responses. Nat Med. 2020. Dec 17;1–10. [DOI] [PubMed] [Google Scholar]

PERMALINK

Vaccines to prevent COVID-19: A living systematic review with Trial Sequential Analysis and network meta-analysis of randomized clinical trials

Steven Kwasi Korang

Elena von Rohden

Areti Angeliki Veroniki

Giok Ong

Owen Ngalamika

Faiza Siddiqui

Sophie Juul

Emil Eik Nielsen

Joshua Buron Feinberg

Johanne Juul Petersen

Christian Legart

Afoke Kokogho

Mathias Maagaard

Sarah Klingenberg

Lehana Thabane

Ariel Bardach

Agustín Ciapponi

Allan Randrup Thomsen

Janus C Jakobsen

Christian Gluud

Roles

Abstract

Background

Methods and findings

Conclusions

Introduction

Methods

Search strategy and selection criteria

Data analysis

Risk of bias assessment

Association measures

Statistical synthesis

Additional analyses

Summary of findings and assessment of certainty

Table 1. Summary of findings (inactivated vaccines).

Table 4. Summary of findings (viral vector vaccines).

Table 2. Summary of findings (mRNA vaccines).

Table 3. Summary of findings (protein-subunit vaccines).

Results

Fig 1. PRISMA flowchart.

Table 5. Randomized clinical trials included in systematic review of vaccines against COVID-19.

All-cause mortality

Inactivated vaccines

Fig 2. COVID-19 vaccines versus placebo on all-cause mortality.

mRNA vaccines

Protein-subunit vaccines

Viral vector vaccines

Trial sequential analysis and sensitivity analysis on mortality

Network meta-analysis on mortality

Fig 3. Rank heat plot for all-mortality and vaccine efficacy on symptomatic COVID-19 and on severe COVID-19.

Analyses of all vaccines

Prevention of symptomatic COVID-19 participants with positive PCR test

Inactivated vaccines

Fig 4. COVID-19 vaccine efficacy on preventing symptomatic COVID-19 participants with positive PCR.

mRNA vaccines

Protein-subunit vaccines

Viral vector vaccines

Network meta-analysis on prevention of symptomatic COVID-19 participants with positive PCR test

Prevention of severe COVID-19 symptoms with positive PCR test or prevention of positive PCR test only

Serious adverse events

Non-serious adverse events

Discussion

Conclusion

Supporting information

Acknowledgments

Data Availability

Funding Statement

References

Decision Letter 0

Stefanos Bonovas

Roles

Transfer Alert

Acceptance letter

Stefanos Bonovas

Roles

Associated Data

Supplementary Materials

Data Availability Statement