Skip to main content
Wellcome Open Research logoLink to Wellcome Open Research
. 2023 Nov 2;8:96. Originally published 2023 Feb 22. [Version 2] doi: 10.12688/wellcomeopenres.17995.2

Effectiveness of BNT162b2 and ChAdOx1 against SARS-CoV-2 household transmission: a prospective cohort study in England

Samuel Clifford 1,2, Pauline Waight 3, Jada Hackman 1,2, Stephane Hué 1,2, Charlotte M Gower 3, Freja CM Kirsebom 3, Catriona Skarnes 3, Louise Letley 3, Jamie Lopez Bernal 3, Nick Andrews 3, Stefan Flasche 1,2,#, Elizabeth Miller 2,3,a,#
PMCID: PMC10697107  PMID: 38058535

Version Changes

Revised. Amendments from Version 1

In the revised version we have provided additional information for the reader on the choice of age grouping, the assumption of independence vaccine protection against infection and against onward transmission, the use of complexity priors, the parameterisation of vaccine protection priors.

Abstract

Background

The ability of SARS-CoV-2 vaccines to protect against infection and onward transmission determines whether immunisation can control global circulation. We estimated the effectiveness of Pfizer-BioNTech mRNA vaccine (BNT162b2) and Oxford AstraZeneca adenovirus vector vaccine (ChAdOx1) vaccines against acquisition and transmission of the Alpha and Delta variants in a prospective household study in England.

Methods

Households were recruited based on adult purported index cases testing positive after reverse transcription-quantitative (RT-q)PCR testing of oral-nasal swabs. Purported index cases and their household contacts took oral-nasal swabs on days 1, 3 and 7 after enrolment and a subset of the PCR-positive swabs underwent genomic sequencing conducted on a subset. We used Bayesian logistic regression to infer vaccine effectiveness against acquisition and transmission, adjusted for age, vaccination history and variant.

Results

Between 2 February 2021 and 10 September 2021, 213 index cases and 312 contacts were followed up. After excluding households lacking genomic proximity (N=2) or with unlikely serial intervals (N=16), 195 households with 278 contacts remained, of whom 113 (41%) became PCR positive. Delta lineages had 1.53 times the risk (95% Credible Interval: 1.04 – 2.20) of transmission than Alpha; contacts older than 18 years old were 1.48 (1.20 – 1.91) and 1.02 (0.93 – 1.16) times more likely to acquire an Alpha or Delta infection than children. Effectiveness of two doses of BNT162b2 against transmission of Delta was 36% (-1%, 66%) and 49% (18%, 73%) for ChAdOx1, similar to their effectiveness for Alpha. Protection against infection with Alpha was higher than for Delta, 69% (9%, 95%) vs. 18% (-11%, 59%), respectively, for BNT162b2 and 24% (-41%, 72%) vs. 9% (-15%, 42%), respectively, for ChAdOx1.

Conclusions

BNT162b2 and ChAdOx1 reduce transmission of the Delta variant from breakthrough infections in the household setting, although their protection against infection within this setting is low.

Keywords: covid, vaccination, secondary attack rate, SARS-CoV-2, household transmission

Introduction

The rapid development of safe and effective coronavirus disease 2019 (COVID-19) vaccines using both novel and traditional platforms, is an unprecedented scientific achievement. The United Kingdom was the first country to launch a national COVID-19 vaccination programme with the rollout of the Pfizer-BioNTech mRNA vaccine (BNT162b2) on 8th December 2020, followed shortly after by the Oxford AstraZeneca adenovirus vector vaccine (ChAdOx1). By September 2021, over 40% of the world’s population had received at least one dose of a COVID-19 vaccine, whether an mRNA, adenovirus vector, or inactivated whole virion vaccine 1 . In most countries, vaccine deployment has been focussed on direct protection of those individuals at the greatest risk of a severe outcome of SARS-CoV-2 infection, including the elderly and those with co-morbidities. Health care workers and others who, if infected, pose a transmission risk to vulnerable individuals, have also been identified as a priority group for vaccination.

The primary outcome of the efficacy trials of the currently authorised COVID-19 vaccines was symptomatic laboratory confirmed SARS-CoV-2 infection, with little information generated on protection against severe COVID-19 infection nor on the ability of the vaccines to prevent onward transmission in those infected. There is now a growing body of evidence from observational studies showing high protection against severe COVID-19 from inactivated whole virion, mRNA, and adenovirus vector vaccines 24 but information on protection against transmission is still limited 5 . Attempts have been made to infer protection against transmission by comparing the viral load in the nasopharynx of vaccinated individuals with breakthrough infections with that in unvaccinated cases, using cycle threshold (Ct) values as a proxy 6 . Other approaches have used routine diagnostic PCR testing data, constructing households based on individuals’ addresses or identifying them with contact tracing, and to estimate secondary attack rates by vaccination status of the index case. However, these studies are potentially subject to ascertainment bias as they are reliant on the testing behaviour of household contacts 79 .

Here we report the results of a prospective household transmission study set up by Public Health England (PHE) (now the UK Health Security Agency) in January 2021 to assess the effect of the vaccination history of index cases with COVID-19 on transmission of SARS-CoV-2 to household contacts, and the protection afforded to vaccinated contacts under conditions of household exposure.

Methods

Data

Households. The procedures for household recruitment and laboratory testing are the same as those used in the household transmission study conducted prior to vaccine availability and are detailed elsewhere 10 . In brief, infected index cases, identified via community testing in England (known as Pillar 2 testing), and their consenting household contacts are recruited by study nurses, on average, three days after their initial PCR test. No additional measures were taken in the study to prevent household transmission. The vaccination status of index cases and their household contacts is obtained by data linkage with the National Immunisation Management System (NIMS) for England and checked with participants by the study nurse at the time of recruitment. Self-testing kits for the index case and household contacts to take combined nose and throat swabs on Day 1 (day of recruitment), Day 3 and Day 7 are couriered to households and subsequently tested by dual target PCR at PHE Colindale (ORF and E genes). PCR positive swabs are sequenced as part of the COG-UK initiative 11 . Household contacts were defined as infected if one or more swabs was PCR positive.

The household transmission study is ongoing and inclusion in this analysis is based on participants having returned at least one swab, being either unvaccinated or vaccinated with one or two doses of either BNT162b2 or ChAdOx1 with the vaccination dates recorded in the national vaccination register, and the age at time of recruitment and the date of onset of symptoms (fever, cough, runny nose, sore throat, shortness of breath, loss of taste or smell, nausea, diarrhoea, muscle/body pain, headache or other) recorded.

The analysis code used can be found as Extended data 12 .

Statistical analysis

All analysis was conducted in R Project for Statistical Computing (RRID:SCR_001905) 4.1.1 13 with Bayesian models fit using the rjags package (RRID:SCR_017573) 14 . The secondary attack rate (SAR) for each combination of case and contact is estimated here by predicting the probability an unseen contact acquires an infection from an infected case given the vaccination history and age of each and the index case’s variant. As the observed SARs in this study were high, model-estimated odd ratios poorly approximate relative risks. Thus, effect estimates are calculated as risk ratios (RRs) of SARs. Unless mentioned otherwise, the baseline age groups for such comparisons were adult index cases younger than 50 years old and contacts at least 18 years old. The different age grouping for cases and contacts were chosen because of the different age distribution in both groups ( Table 2). The predicted SARs and RRs are summarised with medians and 95% credible intervals.

Household secondary attack rate. We fit a Bayesian hierarchical linear model with Bernoulli likelihood for the probability that a household contact of an index case acquires a SARS-CoV-2 infection within a week of recruitment. The model independently estimates both a protective effect for vaccinated contacts against infection and a reduction in transmission for vaccinated cases. The effect of the first dose is assumed to only occur 21 days after the vaccination is received, and an additional effect of the second dose requires at least seven days have passed since the second vaccination as in the SIREN study, which considers the effectiveness of BNT162b2 in healthcare workers in England 15 . These effects are assumed to depend on the vaccine product, and number of doses thereof, received by both the index case and the contact ( Table 1). The probability of acquiring infection is also assumed to depend on the age of both the case and contact, and the circulating lineage. Vaccine effectiveness is calculated for both protection against infection and reduction of transmission as 1 -RR for RRs of household SARs with and without the vaccine. For such, the SARs were sampled during the Markov Chain Monte Carlo (MCMC) sampling, for each combination of variant and case and contact vaccine status (1 or 2 doses for each product) and age group, against a baseline of that case-contact pair and variant in the absence of any vaccination.

Table 1. Number of contacts with listed vaccine status for each case vaccine status (N).

Numbers in brackets show the additional individuals included in the sensitivity analysis (n). BNT162b2, Pfizer-BioNTech mRNA vaccine; ChAdOx1, Oxford AstraZeneca adenovirus vector vaccine.

Case 1 ChAdOx1
N(n)
2 ChAdOx1
N(n)
1 BNT162b2
N(n)
2 BNT162b2
N(n)
None
N(n)
1 ChAdOx1 17 (4) 1 3 4 23 (5)
2 ChAdOx1 2 (1) 26 (5) 7 (1) 12 (1) 21 (9)
1 BNT162b2 6 1 15 (2) 2 33 (2)
2 BNT162b2 9 8 4 10 9
None 6 2 4 5 48 (2)

For the model of secondary attack rate, the likelihood is

yi~Bern(pi)log(pi1pi)=β0+δVi+β1,vi,ViI(d1,i,contactk1)+β2,vi,ViI(d2,i,contactk2)+γ1,vi,ViI(d1,i,casek1)+γ2,vi,ViI(d2,i,casek2)+εcontactI(Ai,contact<acontact)+εcaseI(Ai,caseacase)

where I is an indicator function, which is 1 when its input is true and 0 otherwise, and d j,i,c is the number of days since the jth dose of vaccine product υ was given to either contact i or their household index case (indexed by c) who is infected with variant V i A fixed effect, δ, accounts for the increased infectivity of Delta beyond that of Alpha. Protection afforded by dose j is assumed to begin after k = {21,7} days. These are currently fixed, but a distribution may be used instead if there is some observed variability we wish to include. Age effects, ε, are assumed to be non-zero when the contact is younger than A i,contact = 18 and when the case is at least as old as A i,case = 50. Where V i was missing due to that household’s swabs not being sequenced, it was sampled at each step of the MCMC from a Bernoulli distribution with its single parameter representing the modelled proportion of sequenced Pillar 2 swabs with Delta lineage at time of that household’s Day 1 swabs.

The priors for the model parameters associated with transmission reduction are parameterised as weakly informative normal distributions (with means and precision ( τ= σ –2))

γj,v,V(γj,0,V,τγ)γj,0,V(0,106)τγ=σγ2σγExp(0.3)

We included penalised complexity priors to favour the NULL model of no protective vaccine effect against transmission. The penalised complexity prior on the standard deviation implies a prior probability of it exceeding 10 of 0.05.

For the infection protection parameters, informative priors are derived from reported vaccine efficacy of the two vaccine products against the Alpha (B.1.1.7) and Delta (B.1.617.2) variants of SARS-CoV-2 16 . The priors are normally distributed for the log-odds ratios, with mean and precision parameters,

β1,1,A(log0.5,2)β1,2,A(log0.43,0.25)β2,1,A(log0.250.5,2)β2,2,A(log0.060.43,0.25)β1,1,D(log0.65,2)β1,2,D(log0.67,0.25)β2,1,D(log0.330.65,2)β2,2,D(log0.120.67,0.25)

Here we have taken the point estimates of the log odds ratios and doubled the standard errors, rounding to the nearest 0.5, in order to provide informative priors with additional variance that ensure that the posteriors are still sensitive to the data. As the β 2 ,υ,V represent the marginal effect of the second dose, we derive B 2 ,υ,V = β 1 ,υ,V + β 2 υ,V , the log-odds of the effect of double vaccination against variant V with vaccine product υ.

The effects of age have informative priors derived from Davies et al. 17 , for under-18s acquiring infection, ε contact~ N(log⁡0.50,24), and similar to post-hoc calculations in Goldstein et al. 18 based on Yousaf et al. 19 for relative transmissibility of a >50y old case, ε case~ N(log⁡1.86,4.67).

To determine how informative the priors above are, we replace the informative priors above for all β j,υ,V with a weakly informative N(0, σβ2 ) prior with σ β ~Exp(0.3) and the effects of age each having a weakly informative N(0,10 –6) prior.

Lineage. At the start of data collection, the B.1.1.7 (Alpha) SARS-CoV-2 variant was most prevalent in the United Kingdom, and an increasing proportion of swabs sequenced by Pillar 2 testing were identified as B.1.617.2 (Delta) variant over time 20 . Where sequencing was not available to determine the variant for a positive swab, the probability that it was the Delta variant was estimated from the date of sampling and a logistic regression model fit to the number of weekly cases identified through Pillar 2 that were either Alpha or Delta variant.

Participants’ age. Vaccine eligibility and type is correlated with age and date of vaccination. This is because from 7th April 2021 the BNT162b2 vaccine was recommended for individuals under 30 years old in preference to ChAdOx1, which was then extended to those between 30 and 40 years old from 7th May 2021 21 and also because, apart from those in high risk groups, vaccination was not offered to the general 16–17 year old population until August 2021 22 and the general 12–15 year old population until September 2021 23 . We account for age in the model by considering that children under 18 years old will have decreased susceptibility to infection, compared to adults 17 , and that older adults are more likely to transmit 18 . While the study did not specifically recruit only adult index cases, the minimum age of index cases was 21 years old. The median age of index cases was 48 years old and so we split adults into younger (between 18 and 49 years old) and older (at least 50 years old) age groups. Few participants were older than 65 years old, so we did not distinguish between groups aged 50–64 and 65+ years old. We did not adjust for prior infection status as information on this was incomplete at the time of data lock, nor for gender as this was previously shown not to be a factor in determining household transmission 10 . Table 2 shows the age and vaccine status breakdown of index cases and their household contacts.

Table 2. Number of index cases and their household contacts with listed vaccine status for each age group (N).

Numbers in brackets show the additional individuals included in the sensitivity analysis (n). There are no index cases younger than 18 years old. BNT162b2, Pfizer-BioNTech mRNA vaccine; ChAdOx1, Oxford AstraZeneca adenovirus vector vaccine.

Status Vaccine Age group
<18
N(n)
18-49
N(n)
50-64
N(n)
65+
N(n)
Case 1 ChAdOx1 0 15 (2) 17 (2) 3 (1)
2 ChAdOx1 0 20 (3) 26 (4) 1
1 BNT162b2 0 22 (1) 13 (2) 2
2 BNT162b2 0 13 17 1
None 0 33 12 (1) 0
Contact 1 ChAdOx1 0 (1) 13 (2) 22 (2) 5
2 ChAdOx1 0 13 (2) 22 (2) 3 (1)
1 BNT162b2 0 22 (2) 9 2 (1)
2 BNT162b2 0 14 (1) 16 3
None 67 (7) 55 (8) 11 (2) 1 (1)

Infection history dynamics. PCR positivity relative to the onset of symptoms was estimated using data from all symptomatic cases and contacts, with pseudo-absences generated to simulate the time of infecting exposure. Comparison is made for each combination of vaccine product, number of doses, and variant against the corresponding unvaccinated group.

Identification of non-household transmission. As per the study design, the index case for each household was by default considered to be the individual who presented for Pillar 2 testing. To reduce the risk of misclassification bias we excluded from the analyses all households where both the index case and an infected household contact were symptomatic and the index case’s symptoms appeared more than two days after the contact’s symptoms.

To further reduce the potential for misclassification bias, a phylogenetic approach was used to identify apparent secondary cases in the household who were in fact infected elsewhere. If none of the sequences from a contact clustered with at least one of the sequences from the household’s index case, then this was considered as evidence for an infection acquired outside of the household; therefore, the contact was excluded from the downstream analysis.

Whole-genome Illumina reads were retrieved from the European Nucleotide Archive (ENA) (RRID:SCR_006515) under the accession PRJEB37886. Consensus genomes were generated using the Snippy pipeline mapping to the reference genome NC_045512.2 24 . Highly ambiguous and/or homoplastic sites were masked in the consensus alignment as described by de Maio et al. 25 . A maximum-likelihood phylogeny was reconstructed from the consensus genomes under the Hasegawa-Kishino-Yano (HKY) model of nucleotide substitution with 1,000 ultrafast bootstrap replicates to assess branch supports and visualized in iTOL (RRID:SCR_018174) 26, 27 .

ClusterPicker was used to identify clusters of transmission in the phylogeny 28 . These were defined as clusters of sequences with patristic distances of no more than 2 SNP (6.6 × 10 -5 substitutions/site) 29 and bootstrap support of at least 70%.

Results

By September 10th, 2021, a total of 213 index cases and 312 contacts had been recruited and met the criteria for inclusion at that time. Two contacts were removed due to lack of genomic proximity (outlined below), which resulted in the removal of each of their households as there were no further contacts. The serial interval was two (95% range: -6, 10) days. A total of 16 households with their respective index cases and a total of 32 contacts were excluded from the main analysis because at least one infected household contact presented symptoms more than two days before the index case. Thus, the main analysis was performed on 195 index cases and their 278 contacts. Households had between one and seven contacts, with a mean of 2.2, median of 2, and standard deviation of 1.2. The mode number of household contacts was 1.

Of the included individuals, 175 index cases (90%) and 113 (41%) contacts tested positive for SARS-CoV-2 at least once in the week since recruitment. For the identification of non-household transmission, sequencing information was available for 121 (69%) and 80 (71%) of those, respectively.

A total of 24% of contacts were less than 18 years old, and therefore not eligible for vaccination at the time. The proportion of at least partially vaccinated (adult) household index cases and contacts was 77% and 69%, respectively ( Table 2). Only 10 index cases (5%) were asymptomatic, reflecting the bias of Pillar 2 testing in the UK towards detecting mostly symptomatic infections. Fully vaccinated cases had received their second dose on average 70 days before enrolment and fully vaccinated contacts 71 days.

Prevalence of lineages

For the main analyses, of the 195 index cases analysed here, 99 were identified as infected with B.1.1.7 (Alpha), 24 with B.1.617.2 (Delta), 20 did not test positive again after recruitment, and 52 were of unknown lineage as their PCR-positive swabs had not yet been sequenced. Of the 72 individuals without information on the infecting lineage, we estimated that 18 were likely of Alpha and 54 were likely of Delta lineage based on the date of sampling and the national prevalence of lineages at the time. That is, 60% of index cases had an Alpha variant infection and the remainder were Delta.

Identification of non-household transmission

Sequencing information for both index case and contact were available for 92 PCR positive case-contact pairs across 79 households. In total, 345 whole-genome sequences (including longitudinal samples) were available for analyses, a majority of which were of Alpha variant (82.6%) and the remainder were Delta (17.4%).

The phylogeny provided evidence that in two households the contact of the recruited index case had acquired infection elsewhere ( Figure 1, households HH002 and HH007). Five households that did not form unique clusters in the phylogeny did not meet the exclusion criteria: in two a sequence from an index case did not cluster with the remaining household sequences but another sequence from the same index case did (HH004 and HH006), while the other three households did not have sufficient bootstrap support to be a part of a cluster (HH001, HH003, and HH005). Of the remaining households, 72 (91%), formed unique, household-specific clusters that included all and only sequences of members of the household, indicating likely direct transmission within the household.

Figure 1. Maximum-likelihood phylogeny of household index cases and contacts’ sequences with 1,000 ultrafast bootstrap replicates rooted to the reference sequence with a scaled bar of 2 SNP (6.6 × 10 -5 substitutions/site).

Figure 1.

The dotted line at bottom left indicates where a single long branch was collapsed for visualisation. The non-grey shading on the outer ring represents non-clustered households where sequences are coloured by their households. HH002 and HH007 were the only households where none of the contacts’ sequences clustered with that of their household’s index case and this is evidence that the contact could have acquired the infection elsewhere and is thus excluded from the analysis. SNP, Single Nucleotide Polymorphism.

Age and lineage effects

We estimate that in the absence of vaccination of either case or contacts, Delta lineage infections were much more transmissible within the household than Alpha lineage infections (RR: 1.53, 95% Credible Interval: 1.04, 2.20 for adult cases <50 years old). Children younger than 18 years old were less likely than adults to acquire an Alpha infection (RR: 0.67, 95%: 0.52, 0.83) and just as likely to acquire a Delta infection (RR: 0.98, 95%: 0.86, 1.07). Compared to a baseline of index cases aged between 18 and 49 years old, those 50 years old and over did not transmit either an Alpha (RR: 1.15, 95%: 0.89, 1.47) or Delta (1.08, 95%: 0.96, 1.30) infection to any greater degree at a 95% level of credibility.

Effectiveness of vaccination

Either one or two doses of BNT162b2 provide contacts with a protective effect against infection from a symptomatic index case with Alpha variant SARS-CoV-2 with a vaccine effectiveness of 51%, (95% credible interval: 4%, 83%) and 69% (95% credible interval: 9%, 95%), respectively ( Table 3). At 0% (-33%, 39%) and 18% (-11%, 59%) the effectiveness of one and two doses of BNT162b2 against infection with the Delta variant was lower than against Alpha. The protection offered by ChAdOx1 to either variant after two doses was also low, with effectiveness against Alpha of 24% (-41%, 72%) and against Delta of 9% (-15%, 42%).

Table 3. Median VE and 95% credible intervals for infection protection in contacts and transmission reduction in cases, by variant, vaccine product, and number of doses.

VE, vaccine effectiveness; BNT162b2, Pfizer-BioNTech mRNA vaccine; ChAdOx1, Oxford AstraZeneca adenovirus vector vaccine.

Variant Vaccine Doses VE infection VE transmission
Alpha ChAdOx1 1 -1% (-42%, 36%) -9% (-63%, 28%)
2 24% (-41%, 72%) 36% (-29%, 74%)
BNT162b2 1 51% (4%, 83%) 23% (-18%, 54%)
2 69% (9%, 95%) 57% (2%, 85%)
Delta ChAdOx1 1 -1% (-28%, 28%) 15% (-17%, 58%)
2 9% (-15%, 42%) 49% (18%, 73%)
BNT162b2 1 0% (-33%, 39%) 10% (-20%, 54%)
2 18% (-11%, 59%) 36% (-1%, 66%)

We estimate that the effectiveness of one and two doses of BNT162b2 against onward transmission from cases infected with the Alpha variant was 23% (-18%, 54%) and 57% (2%, 85%), respectively, and for Delta variant one and two doses reduce transmission by 10% (-20%, 54%) and 36% (-1%, 66%), respectively. RRs for the protective effect of BNT162b2 over ChAdOx1 for one and two doses of against both Alpha and Delta variants indicate that at 95% credibility there is no evidence for a difference between the effectiveness of the two vaccine products. Specifically, the RRs for acquisition of Alpha and Delta after two doses of BNT162b2 vs. ChAdOx1 for an adult contact are 0.41 (0.06, 1.70) and 0.92 (0.52, 1.31), respectively.

Secondary attack rates

The estimated secondary household attack rate among adults in an unvaccinated household was 50% (37%, 64%) for the Alpha variant and 78% (54%, 95%) for the Delta variant ( Figure 2).

Figure 2. Predicted SARs for each combination of vaccine status of case and contact.

Figure 2.

Large numbers inside cells are the median SAR of the posterior distribution, with the small numbers below and above corresponding to the 95% credible interval. SAR, secondary attack rate; BNT162b2, Pfizer-BioNTech mRNA vaccine; ChAdOx1, Oxford AstraZeneca adenovirus vector vaccine.

BNT162b2 is very effective against Alpha variant infection when either the case or contact are vaccinated, and especially when both have received two doses ( Figure 2). SARs for Delta variant infection in unvaccinated case-contact pairs are substantially higher. Full (two dose) vaccination with either vaccine is still effective against Delta infection when both the case and contact are vaccinated, at least halving the SAR; e.g., case and contact both fully vaccinated with BNT162b2 has an SAR of 31% (13%, 59%). Notably, the reduced susceptibility to infection of (unvaccinated) individuals under 18 years old results in Alpha SARs that are no greater than those seen in adult contacts who have received two doses of ChAdOx1. Conversely, for Delta infections, there is no reduced susceptibility for those aged under 18 years and so unvaccinated under- and over-18s have similar probability of becoming infected, with a single dose of either vaccine providing no discernible protection.

Sensitivity analysis

Sensitivity analysis was conducted by including the 16-index case-contact pairs with serial intervals less than two days. This did not qualitatively change our results. The absence of informative priors on the protective vaccine effects against infection led some of the vaccine effectiveness against infection in our study to be re-attributed to effectiveness against onward transmission or to age effects.

Infection history dynamics

We estimate that within a week of symptom onset, the relative risk of symptomatic cases testing PCR positive is near identical for vaccinated and unvaccinated participants. For cases infected with the Alpha variant, there was little difference in PCR positivity generally between vaccinated and unvaccinated cases, while in cases infected with the Delta variant the proportion of participants with PCR detectable infection in participants fully vaccinated with BNT162b2 declined about four days before that in unvaccinated participants. In participants fully vaccinated with ChAdOx1 the effect was slightly less pronounced with PCR positivity declining two to three days earlier in vaccinees than in unvaccinated.

Discussion

In this prospective household-based study of SARS-CoV-2 infection, we showed that both the ChAdOx1 and BNT162b2 vaccines are effective in reducing transmission of the Alpha and Delta variants from those who develop breakthrough infections despite having received two doses. The estimated vaccine effectiveness against acquisition of a Delta infection in the household setting was however low; 9% (-15%, 42%) and 18% (-11%, 59%) after two doses of ChAdOx1 and BNT162b2, respectively. This is much lower than that estimated from cases presenting for Pillar 2 testing in the community for which the effectiveness of two doses of ChAdOx1 against symptomatic infection is estimated as 67.0% (61.3%, 71.8%) and 88.0% (85.3%, 90.1%) for BNT162b2 15 . Effectiveness against acquisition of an Alpha infection in the household was substantially higher in our study than that against Delta but still lower than that estimated from Pillar 2 community testing. The lower protection against acquisition in the household likely reflects the prolonged and intense exposure that occurs in this setting. Similarly, although the effectiveness estimates against Delta transmission within the household were moderate at 49% (18%, 73%) and 36% (-1%, 66%) after two doses of ChadOx1 and BNT16b2, respectively, the protective effect in those with breakthrough infections may be higher in the community where exposure is less intense and of shorter duration. The reduction in duration of PCR positivity in breakthrough infections (average of four days shorter for the Delta variant for those infected after two doses of BNT162b2 and around two to three days for ChAdOx1) will also have more of an impact in the community than in the household setting where generation times between infections are short – around 3.5 days for the Delta variant 30 . Our household contacts were actively followed up with repeated swabbing and showed the high secondary attack rates that occur in this setting; 81% for Delta infections in unvaccinated households but that reduced to 25–40% in households where both index case and contacts were fully vaccinated.

Comparison with other studies

Our finding of a moderate level of protection against onward transmission from fully vaccinated individuals, with either vaccine and against either variant, is in apparent contrast to a study that similarly followed up contacts reported by the UK test and trace system prospectively, about 90% of whom were in the same household as the index case 31 . The study estimated a moderate effect of vaccination against infection but no difference in secondary attack rates with the delta variant between fully vaccinated and unvaccinated index cases (24% and 23%, respectively). However, such estimates were neither controlled for age nor vaccination status of the contact. Notably, only four out of 17 (24%) unvaccinated contacts were infected by fully vaccinated index cases, whereas eight out of 20 (40%) unvaccinated contacts were infected by unvaccinated index cases; a reduction in transmission of 41% albeit based on very small numbers. In a similar study from Singapore Delta-exposed fully vaccinated household, contacts were 56.4% less likely to test positive on quarantine exit screening 32 . Also, this study had insufficient power to detect a significant vaccine effect in onward transmission; the odds of a positive exit screening test for Delta-exposed household contacts was 27% (95% CI: -40, 62) lower in contacts of fully vaccinated index cases. Secondary attack rates in our study were much higher, potentially owing to the regular testing during quarantine and the absence of measures to prevent transmission in the household. This has helped through providing statistical power to the point estimates of the other two studies and show a protective effect against onward transmission. Vaccine effectiveness against onward transmission of 40–80% has been suggested by several retrospective observational studies using either information on the household structure 7 or contact tracing 8, 9 in combination with routine national COVID-19 notification systems to estimate reductions in secondary attack rates from breakthrough infections. While observational studies are prone to biases introduced by testing behaviour particularly for mild disease manifestations, our study combines prospectively collected longitudinal data from recruited households with a robust analytical framework to confirm that both vaccines reduce transmissibility of breakthrough infections in fully vaccinated individuals.

Among symptomatic index cases and contacts, we found a lower rate of PCR positivity within two weeks of symptom onset in all vaccinated groups ( Figure 3). PCR positivity for Delta declined fastest (four days ahead of unvaccinated) in individuals fully vaccinated with BNT162b2. These results largely mirror those in other studies that found enhanced clearance following vaccination 31 , but raise the question whether enhanced clearance can be the driving mechanism for reduced transmission in a frequent contact household setting. Another mechanism may be that while positivity with the highly sensitive PCR test is similar to that in the unvaccinated, vaccination can reduce 33 both peak viral load 6, 34 and viral shedding 35 although such effects have not been reported in all studies and may be masked by age effects.

Figure 3. PCR positivity by variant and vaccination status for symptomatic infections (index cases recruited from Pillar 2 testing and the symptomatic household contacts they infected).

Figure 3.

Lines represent median trajectories, and the ribbon is the 95% credible interval. BNT162b2, Pfizer-BioNTech mRNA vaccine; ChAdOx1, Oxford AstraZeneca adenovirus vector vaccine.

Strengths and limitations of this study

Our study comes with limitations. To minimise the potential for misclassification we restricted the main analyses to only those putative transmission pairs where there was no evidence against direct transmission based on phylogenetic distance (which was available for 63% of all putative transmission pairs) and where symptom onset in the contact did not pre-date that of the index case by more than two days. Our model does not account for the introduction of SARS-CoV-2 into the household from two index cases who acquired the infection separately, opting instead to exclude the most recently PCR-positive index case. Importantly, if there is residual misclassification between infector and infected this would attribute infection protection to transmission protection and vice versa.

Only households with adult index cases were recruited into the study. During the time of data collection, children were ineligible for vaccination and so there would be no vaccine effectiveness for reducing transmission to estimate even if such data were included. The inclusion of households with child index cases would, however, provide useful further information on the protection against acquisition for both adult and child contacts of unvaccinated cases, particularly in understanding the risk of children who acquire infection in their school environment and may transmit to family members.

Prior infection status is not included in the model as the data were not available at the time of data lock. This can be incorporated in the model under the same structure as a vaccine product, though this may be difficult when considering protection against a specific variant provided by infection with previously seen variants when the prior infection’s variant is unidentifiable.

The ability to detect an infection in contacts relies on the sensitivity of PCR and the timing of swabs. A vaccinated contact who acquires infection may be less detectable due to a reduction in viral load and/or shorter shedding period 35 and may have been detectable between the swabs on days three and seven.

We did not include waning of vaccine protection in our analyses. In the analysed dataset the longest reported time since vaccine receipt was 169 days. While some individuals in the analysis have since become eligible for a booster vaccination over concerns of waning protection, some of this potential effect will have been absorbed in our model in the age structuring because of the strong correlation between age and timing of vaccine eligibility as per the vaccine roll-out strategy in the UK. Lastly, data collection spanned a period of multiple months during which Delta became the dominant strain in circulation in the UK and included participants vaccinated with two different vaccine products; thus, requiring sub-strata analyses and reducing the effective sample size for each strata. We used a Bayesian model that allowed the borrowing of strength through the model hierarchy, and priors allowing us to make use of the heterogeneity in risk factors and not only estimate vaccine effectiveness against transmission in these strata but simultaneously estimate the difference in transmissibility in Alpha and Delta variants and the effectiveness of partially completed dosing schedules. The use of informative priors was integral to disentangling the confounded age and vaccine history effects, which arose due to vaccine product prioritisation and were exacerbated by low counts for case-contact vaccine history combinations. Additionally, we assume that carriage of multiple variants does not occur, with genomic sequencing only showing a single variant.

Conclusions

Our findings provide robust evidence that vaccination with either BNT162b2 or ChAdOx1 can help to substantially reduce, but not completely prevent, household transmission with SARS-CoV-2. This highlights the importance of vaccines to limit circulation of SARS-CoV-2 particularly in close and prolonged contact indoor settings. The effectiveness of booster doses to further enhance protection against transmission will need to be evaluated to better understand the extent to which we can rely on vaccination for the control of SARS-CoV-2 infection, particularly during winter seasons when most contacts occur in households or household-like settings.

Ethics approval

UKHSA Research Ethics and Governance Group Statement: Surveillance of COVID-19 testing and vaccination is undertaken under Regulation 3 of The Health Service (Control of Patient Information) Regulations 2002 to collect confidential patient information ( http://www.legislation.gov.uk/uksi/2002/1438/regulation/3/made) under Sections 3(1) (a) to (c), 3(1)(d) (i) and (ii) and 3(3). The study protocol was subject to an internal review by the PHE Research Ethics and Governance Group and was found to be fully compliant with all regulatory requirements. As no regulatory issues were identified, and ethical review is not a requirement for this type of work, it was decided that a full ethical review would not be necessary. All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived. Oral informed consent for sampling and follow up was obtained by the nurses from household members who were free to decline to participate in the surveillance at any time. Consent for children was obtained by a parent or legal guardian. Only anonymised data were provided to non-UKHSA authors.

Acknowledgements

We thank the nurses in the Immunisation and Vaccine Preventable Diseases Division of the UK Health Security Agency who recruited and followed up the households and the administrative staff who sent out the swabbing kits to households and arranged for their collection. We also thank the staff of the Virus Reference Department, Central Sequencing Laboratory and the Core Bioinformatics Team of PHE Colindale who performed the molecular testing and sequencing. Sequencing was financially supported in part by the COG-UK Consortium. COG-UK is supported by funding from the Medical Research Council (MRC) part of UK Research & Innovation (UKRI), the National Institute of Health Research (NIHR) and Genome Research Limited, operating as the Wellcome Sanger Institute. The authors also wish to thank Prof. Neil Ferguson (Imperial College London) for his comments and questions about earlier versions of this analysis.

An earlier version of this article can be found on medRxiv ( https://www.medrxiv.org/content/10.1101/2021.11.24.21266401v2), which was evaluated on sciety ( https://sciety.org/articles/activity/10.1101/2021.11.24.21266401).

Funding Statement

This work was supported by Wellcome [208812, <a href=https://doi.org/10.35802/208812>https://doi.org/10.35802/208812</a>; a Sir Henry Dale Fellowship award to Stefan Flasche and supporting Samuel Clifford. This study was funded by the UK Health Security Agency (formerly Public Health England) (an executive agency of the Department of Health) as part of the COVID-19 response. Samuel Clifford is funded by the UK Medical Research Council (MC_PC_19065 - Covid 19: Understanding the dynamics and drivers of the COVID-19 epidemic using real-time outbreak analytics). Jada Hackman is funded by the Nagasaki University-London School of Hygiene and Tropical Medicine Doctoral Programme under the WISE scheme. EM receives support from the National Institute for Health Research (NIHR) Health Protection Research Unit in Immunisation at the London School of Hygiene and Tropical Medicine in partnership with the UKHSA (Grant Reference NIHR200929). The non-UK HSA funders had no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication. The authors have conducted their research independent from the funders. All authors, external and internal, had full access to all of the data (including statistical reports and tables) in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis is also required.

[version 2; peer review: 2 approved]

Data availability

Underlying data

The data necessary to replicate results are available from the authors on request, subject to a data sharing agreement. Requests for the underlying data should be made via the UKHSA office for data release: https://www.gov.uk/government/publications/accessing-ukhsa-protected-data.

Extended data

Analysis code available from: https://doi.org/10.5281/zenodo.7618847 12

License: MIT

Author contributions

EM developed the household transmission protocol; NA and JLB contributed to the study design; SF advised on the overall analytic approach; PW was responsible for developing and curating the database; CG, FK and CS assisted in data management; LL managed the team of study nurses; SC developed and conducted the Bayesian analysis; JH, SH and SC conducted the genomic analysis; all authors contributed to the interpretation of the data. SC, SF, EM and JH drafted the paper; SC and JH generated the tables and figures. All authors revised the manuscript approved for final submission.

References

  • 1. Ritchie H, Mathieu E, Rodes-Guirao L, et al. : Coronavirus pandemic (COVID-19). Our World Data, 2020. Reference Source
  • 2. Chung H, He S, Nasreen S, et al. : Effectiveness of BNT162b2 and mRNA-1273 covid-19 vaccines against symptomatic SARS-CoV-2 infection and severe covid-19 outcomes in Ontario, Canada: test negative design study. BMJ. 2021;374: n1943. 10.1136/bmj.n1943 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Bernal JL, Andrews N, Gower C, et al. : Effectiveness of the Pfizer-BioNTech and Oxford-AstraZeneca vaccines on covid-19 related symptoms, hospital admissions, and mortality in older adults in England: test negative case-control study. BMJ. 2021;373: n1088. 10.1136/bmj.n1088 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Ranzani OT, Hitchings MDT, Dorion M, et al. : Effectiveness of the CoronaVac vaccine in older adults during a gamma variant associated epidemic of covid-19 in Brazil: test negative case-control study. BMJ. 2021;374: n2015. 10.1136/bmj.n2015 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. World Health Organization: Landscape of observational study designs on the effectiveness of COVID-19 vaccination. World Health Organization;2021; [cited 2021 Oct 1].
  • 6. Chia PY, Ong SWX, Chiew CJ, et al. : Virological and serological kinetics of SARS-CoV-2 Delta variant vaccine breakthrough infections: a multicentre cohort study. Clin Microbiol Infect. 2022;28(4): 612.e1–612.e7. 10.1016/j.cmi.2021.11.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Prunas O, Warren JL, Crawford FW, et al. : Vaccination with BNT162b2 reduces transmission of SARS-CoV-2 to household contacts in Israel. medRxiv. 2021; 2021.07.13.21260393. 10.1101/2021.07.13.21260393 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Eyre DW, Taylor D, Purver M, et al. : The impact of SARS-CoV-2 vaccination on Alpha & Delta variant transmission. 2021; 2021.09.28.21264260. 10.1101/2021.09.28.21264260 [DOI] [Google Scholar]
  • 9. de Gier B, Andeweg S, Joosten R, et al. : Vaccine effectiveness against SARS-CoV-2 transmission and infections among household and other close contacts of confirmed cases, the Netherlands, February to May 2021. Euro Surveill. 2021;26(31): 2100640. 10.2807/1560-7917.ES.2021.26.31.2100640 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Miller E, Waight PA, Andrews NJ, et al. : Transmission of SARS-CoV-2 in the household setting: A prospective cohort study in children and adults in England. J Infect. 2021;83(4):483–489. 10.1016/j.jinf.2021.07.037 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. The COVID-19 Genomics UK (COG-UK) consortium: An integrated national scale SARS-CoV-2 genomic surveillance network. Lancet Microbe. 2020;1(3):E99–E100. 10.1016/S2666-5247(20)30054-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Clifford S, Hackman J: Effectiveness of BNT162b2 and ChAdOx1 against SARS-CoV-2 household transmission. Zenodo. [Code],2023. 10.5281/zenodo.7618848 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. R Core Team: R: A Language and Environment for Statistical Computing.Vienna, Austria: R Foundation for Statistical Computing; 2021. Reference Source
  • 14. Plummer M: rjags: Bayesian Graphical Models using MCMC. 2019. Reference Source
  • 15. Hall VJ, Foulkes S, Saei A, et al. : COVID-19 vaccine coverage in health-care workers in England and effectiveness of BNT162b2 mRNA vaccine against infection (SIREN): a prospective, multicentre, cohort study. Lancet. 2021;397(10286):P1725–1735. 10.1016/S0140-6736(21)00790-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Bernal JL, Andrews N, Gower C, et al. : Effectiveness of Covid-19 Vaccines against the B.1.617.2 (Delta) Variant. N Engl J Med. 2021;385(7):585–594. 10.1056/NEJMoa2108891 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Davies NG, Abbott S, Barnard RC, et al. : Estimated transmissibility and impact of SARS-CoV-2 lineage B.1.1.7 in England. Science. 2021;372(6538): eabg3055. 10.1126/science.abg3055 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Goldstein E, Lipsitch M, Cevik M: On the Effect of Age on the Transmission of SARS-CoV-2 in Households, Schools, and the Community. J Infect Dis. 2021;223(3):362–369. 10.1093/infdis/jiaa691 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Yousaf AR, Duca LM, Chu V, et al. : A Prospective Cohort Study in Nonhospitalized Household Contacts With Severe Acute Respiratory Syndrome Coronavirus 2 Infection: Symptom Profiles and Symptom Change Over Time. Clin Infect Dis. 2021;73(7):e1841–e1849. 10.1093/cid/ciaa1072 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Wellcome Sanger Institute: COVID-19 Genomic Surveillance. 2021; [cited 2021 Oct 18]. Reference Source
  • 21. Andrews NJ, Stowe J, Ramsay ME, et al. : Risk of venous thrombotic events and thrombocytopenia in sequential time periods after ChAdOx1 and BNT162b2 COVID-19 vaccines: a national cohort study in England. Lancet Reg Health Eur. In press;2022;13: 100260. 10.1016/j.lanepe.2021.100260 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. UK Government: All young people aged 16 and 17 in England to be offered vaccine by next week.GOV.UK.2021; [cited 2021 Oct 21]. Reference Source
  • 23. UK Department of Health and Social Care: Universal vaccination of children and young people aged 12 to 15 years against COVID-19.GOV.UK.2021; [cited 2021 Oct 21]. Reference Source
  • 24. Seemann T: Rapid haploid variant calling and core genome alignment. 2020. Reference Source
  • 25. De Maio N, Walker C, Borges R, et al. : Masking strategies for SARS-CoV-2 alignments.Virological.org;2020; [cited 2021 Oct 13]. Reference Source
  • 26. Nguyen LT, Schmidt HA, von Haeseler A, et al. : IQ-TREE: a fast and effective stochastic algorithm for estimating maximum-likelihood phylogenies. Mol Biol Evol. 2015;32(1):268–74. 10.1093/molbev/msu300 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Letunic I, Bork P: Interactive Tree Of Life (iTOL) v5: an online tool for phylogenetic tree display and annotation. Nucleic Acids Res. 2021;49(W1):W293–W296. 10.1093/nar/gkab301 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Ragonnet-Cronin M, Hodcroft E, Hué S, et al. : Automated analysis of phylogenetic clusters. BMC Bioinformatics. 2013;14: 317. 10.1186/1471-2105-14-317 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Lythgoe KA, Hall M, Ferretti L, et al. : SARS-CoV-2 within-host diversity and transmission. Science. 2021;372(6539): eabg0821. 10.1126/science.abg0821 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Hart W, Miller E, Andrews N, et al. : Generation time of the Alpha and Delta SARS-CoV-2 variants. Epidemiology. 2021; [cited 2021 Nov 12]. [Google Scholar]
  • 31. Singanayagam A, Hakki S, Dunning J, et al. : Community transmission and viral load kinetics of the SARS-CoV-2 delta (B.1.617.2) variant in vaccinated and unvaccinated individuals in the UK: a prospective, longitudinal, cohort study. Lancet Infect Dis. 2022;22(2):183–195. 10.1016/S1473-3099(21)00648-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Ng OT, Koh V, Chiew CJ, et al. : Impact of Delta Variant and Vaccination on SARS-CoV-2 Secondary Attack Rate Among Household Close Contacts. Lancet Reg Health West Pac. 2021;17: 100299. 10.1016/j.lanwpc.2021.100299 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Regev-Yochay G, Amit S, Bergwerk M, et al. : Decreased infectivity following BNT162b2 vaccination: A prospective cohort study in Israel. Lancet Reg Health Eur. 2021;7: 100150. 10.1016/j.lanepe.2021.100150 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Levine-Tiefenbrun M, Yelin I, Katz R, et al. : Initial report of decreased SARS-CoV-2 viral load after inoculation with the BNT162b2 vaccine. Nat Med. 2021;27(5):790–792. 10.1038/s41591-021-01316-7 [DOI] [PubMed] [Google Scholar]
  • 35. Shamier MC, Tostmann A, Bogers S, et al. : Virological characteristics of SARS-CoV-2 vaccine breakthrough infections in health care workers. medrxiv. 2021. 10.1101/2021.08.20.21262158 [DOI] [Google Scholar]
Wellcome Open Res. 2023 Nov 23. doi: 10.21956/wellcomeopenres.22475.r69545

Reviewer response for version 2

Tim K Tsang 1

I am ok with the response.

Is the work clearly and accurately presented and does it cite the current literature?

Partly

If applicable, is the statistical analysis and its interpretation appropriate?

Partly

Are all the source data underlying the results available to ensure full reproducibility?

Partly

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Partly

Are sufficient details of methods and analysis provided to allow replication by others?

Partly

Reviewer Expertise:

biostatistics, epidemiology, infectious disease modelling

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2023 Nov 16. doi: 10.21956/wellcomeopenres.22475.r69546

Reviewer response for version 2

John Kubale 1

I appreciate the authors thoughtful responses to my comments (including those I made only because I missed where they had already provided the requested information). I have no further concerns with the manuscript and congratulate the authors on this nice addition to the literature.

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Partly

Reviewer Expertise:

Infectious disease epidemiology

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2023 Jul 17. doi: 10.21956/wellcomeopenres.19952.r60461

Reviewer response for version 1

Tim K Tsang 1

This paper reports the transmission dynamics and VE estimates from a household transmission study. Overall, it is informative and provides insight to the literature. Analysis approach could be improved to make things more accurate. The interpretations of some results could be improved to make it more clear on the meaning of findings.

Major comments:

  1. The Bayesian model in the paper already assumed that contacts could be infected from index only, which may not be accurate. There are many models that can handle this, such as Cauchemez et al. 1 . Optimally such models should be used, then the factors affecting transmission and factors affecting susceptibility could be estimated. At least, it should be mentioned in the limitations.

  2. Following 1, the factors estimated by the model could not be interpreted as factor impacting transmissions, since the model is about infection status of contacts. So terms like ‘reducing transmissions’ are not accurate.

  3. Following 2, I cannot follow how the model can estimate the VE against transmission. Are you putting the index cases’ vaccination status as a factor and consider this as VE against transmission? If so, these estimates are based on the assumption that contacts could only be infected from index and state this limitation clearly.

  4. The force of infection could outside household was not also addressed, and it is again an limitation that should be stated. Some works were done like excluding contacts cases with long serial intervals, but we cannot rule out that two cases with short serial intervals could be both infected from outside household and not household transmission.

Minor comments:

  1.  Figure 2. Regarding the median of SAR, do you mean the median of posterior distribution? or for each household, you compute the SAR and then take median? I think it is the former, but please clarify.

Is the work clearly and accurately presented and does it cite the current literature?

Partly

If applicable, is the statistical analysis and its interpretation appropriate?

Partly

Are all the source data underlying the results available to ensure full reproducibility?

Partly

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Partly

Are sufficient details of methods and analysis provided to allow replication by others?

Partly

Reviewer Expertise:

biostatistics, epidemiology, infectious disease modelling

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

References

  • 1. : A Bayesian MCMC approach to study transmission of influenza: application to household longitudinal data. Stat Med .2004;23(22) : 10.1002/sim.1912 3469-87 10.1002/sim.1912 [DOI] [PubMed] [Google Scholar]
Wellcome Open Res. 2023 Oct 19.
Stefan Flasche 1

Thanks you for the review. We have addressed the minor comment. You are right to highlight that the inferrence of direction of transmission and accounting for potential transmission from the outside as two key aspects of the sutdy. In household studies like this one, one needs to infer the direction of transmission and to account for the potential for infection from outside the household based on suboptimal information. To limit the risk for the latter we conducted a genomic analysis to identify those secondary cases who would not genomically cluster with the other cases in the household. To address the former, one could, like other have done before, infer the direction of transmission purely based on the relative timing of reported symptoms. However, in this study many HH members were children with mild symptoms that may or may not be related to covid and thus such approach may result in misclassification. Instead we decided to assume that the first case severe enough to seek official testing would be the index case but excluded all households where the dates of symptom onset suggested the index case was unlikely the first HH case. We discussed these issues in the first paragraph of the section on strength and limitations. I hope this is clearer now.

Wellcome Open Res. 2023 Jun 19. doi: 10.21956/wellcomeopenres.19952.r57835

Reviewer response for version 1

John Kubale 1

Overall, this is a nice paper from Clifford et al. that will be a positive addition to the literature. My comments are all fairly minor and are primarily aimed at making the methods employed clearer and more accessible to a broader audience.

  • Why the difference in age groups for case and contact comparisons?

  • I’m not sure about the independence assumption between protective effect of vaccinated contacts and reduced transmission of vaccinated cases. Wouldn’t there be some clustering between similar groups?

  • Should consider adding additional detail on complexity prior. It would also be helpful for a sentence or two on why precision is used here for those less familiar with its benefits for Bayesian modeling.

  • Would recommend changing by a factor of 2 to something more intuitive like doubling or 2x causes unnecessary confusion for folks who don’t frequently use this terminology.

  • Should clearly state which age group the case transmission prior is for.

  • Not clear where in the paper by Yousaf et al., the estimate comes from?

  • Negative serial interval?

  • 90% of index cases tested positive at least once in the week prior to recruitment, what about the other 10%?

  • Based on how index cases were defined/identified they must have tested positive to be recruited, what range did you see in this group in days between positive test and recruitment?

  • In one paragraph say that sequencing info available for 122 index cases, but 2 paragraphs down state that 99 were alpha and 24 delta which would make for 123.

  • Will the 72 individuals whose samples hadn’t been sequenced ever have this done? Would be interesting to see how well actual sequences match predictions based on circulation.

  • Nitpicky, but I think saying that you failed to detect any difference between the vaccines would more appropriate than saying there was no difference.

  • “At two to three days the effect in participants fully vaccinated with ChAdOx1 was slightly less pronounced.” Is this effect also a decline? Would be good to state clearly what this effect was.

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Partly

Reviewer Expertise:

Infectious disease epidemiology

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Wellcome Open Res. 2023 Oct 19.
Stefan Flasche 1

Thanks for the thorought review. We had sumbitted a new version that add clarifications as suggested. 

In detail: 

  • Why the difference in age groups for case and contact comparisons?

    -> included: “The different age grouping for cases and contacts were chosen because of the different age distribution in both groups (Table 2)”

  • I’m not sure about the independence assumption between protective effect of vaccinated contacts and reduced transmission of vaccinated cases. Wouldn’t there be some clustering between similar groups?

    -> We believe the assumption of independence is reasonable: one is the protection against detectable infection in contacts and one is the protection against onward transmission in breakthrough infections (cases). We agree though that the formulation in the manuscript is potentially confusing and so we have changed this to “The model independently estimates both a protective effect for vaccinated contacts against infection and a reduction in transmission for vaccinated cases” to avoid suggesting that this would be a major assumption.

  •  Should consider adding additional detail on complexity prior. It would also be helpful for a sentence or two on why precision is used here for those less familiar with its benefits for Bayesian modeling.

     -> we included: “We included penalised complexity priors to favour the NULL model of no protective vaccine effect against transmission.” We used precision for parameterisation as this is the standard parameterisation in the R package used.

  • Would recommend changing by a factor of 2 to something more intuitive like doubling or 2x causes unnecessary confusion for folks who don’t frequently use this terminology.

    -> done

  • Should clearly state which age group the case transmission prior is for.

     -> done

  • Not clear where in the paper by Yousaf et al., the estimate comes from?

    -> we had written: “and from Yousaf et al., 18 cited in Goldstein et al., 19 for case transmission…” but changed to “similar to post hoc calculations in Goldstein et al based on Yousaf et al, for relative transmissibility of a >50y old case” to increase clarity that Yousaf et al did not calculate this themselves but that the value is based on a post-hoc analyses similar to that by Goldstein et al.

  • Negative serial interval?

    -> negative serial intervals are possible in principle but unlikely and may point to misclassification instead. Hence we have included only household in which the assumption that the index case was indeed the first case in the household, resulted in serial intervals larger than -2 days.

  •  90% of index cases tested positive at least once in the week prior to recruitment, what about the other 10%?

    -> It says in the manuscript: “Of the included individuals, 175 index cases (90%) and 113 (41%) contacts tested positive for SARS-CoV-2 at least once in the week SINCE recruitment”. The other 10% tested positive before recruitment but not in the swabs following enrolment.

  • Based on how index cases were defined/identified they must have tested positive to be recruited, what range did you see in this group in days between positive test and recruitment?

    -> Afraid we did not store this information.

  •  In one paragraph say that sequencing info available for 122 index cases, but 2 paragraphs down state that 99 were alpha and 24 delta which would make for 123.

    -> thanks for picking this up. This analysis was done in real time and thus for the main statistical analysis, that succeeded the phylogenetic analysis, we had marginally more sequencing information. We included some language to clarify this.

  • Will the 72 individuals whose samples hadn’t been sequenced ever have this done? Would be interesting to see how well actual sequences match predictions based on circulation.

    -> we agree but only a subset of samples at the time have been sent for sequencing so I am afraid we will never know.

  • Nitpicky, but I think saying that you failed to detect any difference between the vaccines would more appropriate than saying there was no difference.

    -> fair point. Changed to “indicate that at 95% credibility there is no evidence for a difference between the effectiveness of the two vaccine products”

  •  “At two to three days the effect in participants fully vaccinated with ChAdOx1 was slightly less pronounced.” Is this effect also a decline? Would be good to state clearly what this effect was.

    -> changed to “In participants fully vaccinated with ChAdOx1 the effect was slightly less pronounced with PCR positivity declining two to three days earlier in vaccinees than in unvaccinated.”

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    Underlying data

    The data necessary to replicate results are available from the authors on request, subject to a data sharing agreement. Requests for the underlying data should be made via the UKHSA office for data release: https://www.gov.uk/government/publications/accessing-ukhsa-protected-data.

    Extended data

    Analysis code available from: https://doi.org/10.5281/zenodo.7618847 12

    License: MIT


    Articles from Wellcome Open Research are provided here courtesy of The Wellcome Trust

    RESOURCES