ABSTRACT
We have previously used composite reference standards and latent class analysis (LCA) to evaluate the performance of laboratory assays in the presence of tarnished gold standards. Here, we apply these techniques to repeated, cross-sectional study of Canadian blood donors, whose sera underwent parallel testing with four separate SARS-CoV-2 antibody assays. We designed a repeated cross-sectional design with random cross-sectional sampling of all available retention samples (n = 1500/month) for a 12 -month period from April 2020 until March 2021. Each sample was evaluated for SARS-CoV-2 IgG antibodies using four assays an Abbott Architect assay targeting the nucleocapsid antigen (Abbott-NP, Abbott, Chicago IL) and three in-house IgG ELISAs recognizing distinct recombinant viral antigens: full-length spike glycoprotein (Spike), spike glycoprotein receptor binding domain (RBD) and nucleocapsid (NP). We used two analytic approaches to estimate SAR-CoV-2 seroprevalence: a composite reference standard and LCA. Using LCA to estimate true seropositivity status based on the results of the four antibody tests, we estimated that seroprevalence increased from 0.8% (95% CI: 0.5–1.4%) in April 2020 to 6.3% (95% CI: 5.1–7.6%) in March 2021. Our study provides further support for the use of LCA in upcoming public health crises, epidemics, and pandemics when a gold standard assay may not be available or identifiable.
IMPORTANCE Here, we describe an approach to estimating seroprevalence in a low prevalence setting when multiple assays are available and yet no known gold standard exists. Because serological studies identify cases through both diagnostic testing and surveillance, and otherwise silent, unrecognized infections, serological data can be used to estimate the true infection fatality ratio of a disease. However, seroprevalence studies rely on assays with imperfect sensitivity and specificity. Seroreversion (loss of antibody response) also occurs over time, and with the advent of vaccination, distinction of antibody response resulting from vaccination as opposed to antibody response due to infection has posed an additional challenge. Our approach indicates that seroprevalence on Canadian blood donors by the end of March 2021was less than 10%. Our study supports the use of latent class analysis in upcoming public health crises, epidemics, and pandemics when a gold standard assay may not be available or identifiable.
KEYWORDS: SARS-CoV-2 antibody, spike, receptor binding domain, nucleocapsid, IgG, latent class analysis
INTRODUCTION
Serological data are often used to profile the change of infectious disease burden over time, and across geographies (1). High-quality seroprevalence data provides several key insights into epidemics: as serology should provide a record of exposure to a given pathogen over time, seroprevalence curves should reveal the true cumulative incidence of disease over the course of an epidemic (2). Because serological studies capture cases identified through diagnostic testing and surveillance, and otherwise silent, unrecognized infections, serological data can be used to estimate the true infection fatality ratio of a disease (3). If seropositivity is a marker for immunity, serological data can also be used to project the likely trajectory of an epidemic, and assess the need for expanded vaccination, as population-level susceptibility is a key determinant of exponential growth of communicable disease epidemics (4).
Estimates of SARS-CoV-2 seroprevalence in Canada during the first quarter of 2021 are impacted by relatively low infections rates and the relatively slow ramp up of vaccination programs (2, 5). Over the study period (April 2020-March 2021), two major pandemic waves occurred in Canada: a spring wave beginning in March 2020 and subsiding in the summer of 2020, and a fall/winter wave. The size of the waves varied substantially across the country, with the Atlantic provinces (New Brunswick, Nova Scotia, Newfoundland and Labrador, and Prince Edward Island) reporting far lower cumulative case rates (<200 cases per 100,000 population) than the other provinces included in this study, which ranged from 1944 per 100,000 in British Columbia to 3354 per 100,000 in Alberta (6). Prior seroprevalence surveys by members of our group has identified very low levels of seropositivity (e.g., <5%) between April 2020 and the second week of January 2021 (n = 172,919) in Canadian blood donors (2, 7).
The SARS-CoV-2 vaccine was first administered in Canada during the middle of December 2020 (8). SARS-CoV-2 vaccine supplies were insufficient during the first 3 months of 2021 and Canada would later move to extended dosing intervals for Health Canada approved vaccines (5). Canada adopted a risk- and age-based prioritization approach, with early doses allocated to health care and other front-line workers and residents of long-term care homes and other congregate housing, followed by allocation be descending age groups. By late March 2021, 3.5 million Canadians (9.18% population) had received at least one dose of a SARS-CoV-2 vaccine. Only a small percentage of Canadians had received two doses (1.66% population) (9). Most vaccinated Canadians would have received an mRNA vaccine. The BNT162b2 (Pfizer-BioNTech, New York, NY, USA) mRNA vaccine was received by 6.69% of the population (5.49% received one dose and 1.20% received two doses). The mRNA-1273 (Moderna, Cambridge, MA, USA) was administered to 1.66% of the population (1.21% received one dose and 0.45% received two doses). Few Canadians received a viral vector vaccine with 0.81% of the population receiving one dose of a ChAdOx1-nCOV (Serum Institute of India: Covishield, Pune, India licensed from AstraZeneca, Cambridge, United Kingdom) (9). Before donation, Canadian Blood Services routinely asks donors if they received a SARS-CoV-2 vaccine in the past 3 months. In a prior analysis apart from a “yes” and “no” answer for SARS-CoV-2 vaccination we did not have access to vaccine timing or dose received (10).
During the SARS-CoV-2 pandemic, serological studies have provided a number of key insights into this newly emerged infection; they have affirmed that development of an antibody response correlates with clearance of viral shedding (11); they have helped delineate the fraction of infections that are identified as cases (12); have permitted estimation of infection fatality ratios and have facilitated identification of groups and regions with elevated infection risks and ongoing vulnerabilities to infection (13–16). However, seroprevalence studies rely on assays with imperfect sensitivity and specificity (16). Furthermore, estimation of sensitivity and specificity of these tests is made more challenging by the absence of a gold standard with which they can be compared (2). Seroreversion (loss of antibody response) occurs over time, and with the advent of vaccination, distinction of antibody response resulting from vaccination as opposed to antibody response due to infection has posed an additional challenge (7, 17, 18).
While not perfectly representative of the populations from which they are drawn, blood donors are a subpopulation that allows rapid, repeated evaluation of seroprevalence during a public health crisis (1, 2, 7, 17). Since April 2020 Canadian Blood Services has been performing serological testing on “retention” samples left over from routine testing of donor blood (2, 3, 7, 17). Blood donation occurs in large cities and smaller urban areas. CBS has used several assays in parallel to evaluate SARS-CoV-2 response in donors but has noted that responses of different assays are at times inconsistent with one another (2, 7, 17, 19, 20). Furthermore, we identified differences in serological profiles that could be potentially be linked to variability in humoral protection as measured by antibody neutralizing capacity (19, 21).This led us to ask the question of whether antibody assays can be used in parallel to categorize SARS-CoV-2 immune responses in blood donors.
We have previously used composite reference standards and latent class analysis (LCA) to evaluate the performance of laboratory assays in the absence of agreed-upon gold standards (2, 22). Here, we apply these techniques to repeated, cross-sectional study of Canadian blood donors, whose sera underwent parallel testing with four separate antibody assays. We also attempted a re-linkage of serology data to vaccine dose number and timing of vaccination. Our objectives were (i) to estimate the seroprevalence of SARS-CoV-2 infection in Canadians over the first two waves of the pandemic; (ii) to attempt to define antibody profiles that discriminate prior infection from vaccination (iii) to develop an approach to characterization of population immunity to SARS-CoV-2 that can be reproduced by other groups and with other populations.
RESULTS
Study population characteristics.
A total of 17,999 blood donors were included in the study, with samples collected from April 2020 to March 2021. The mean age of participants was 46.3 (standard deviation [SD]: 15.7) years. Participants were more likely to be male (53.9%) and predominantly lived in non-rural locations (87.1%) (Table 1).
TABLE 1.
Characteristics of n = 17999 studya
| Variable | Demographic | Entire study period | April – june 2020 | July – september 2020 | October – december 2020 | January – march 2021 | P value |
|---|---|---|---|---|---|---|---|
| Total participants | 17999 | 4499 | 4500 | 4500 | 4500 | ||
| Sex | F | 8293 (46.1)b | 2087 (46.4) | 2163 (48.1) | 2008 (44.6) | 2035 (45.2) | 0.0058 |
| M | 9706 (53.9) | 2412 (53.6) | 2337 (51.9) | 2492 (55.4) | 2465 (54.8) | ||
| Province | Alberta | 3715 (20.6) | 925 (20.6) | 928 (20.6) | 941 (20.9) | 921 (20.5) | 1 |
| Atlantic provinces | 1906 (10.6) | 477 (10.6) | 478 (10.6) | 477 (10.6) | 474 (10.5) | ||
| British Columbia | 2743 (15.2) | 691 (15.4) | 677 (15) | 693 (15.4) | 682 (15.2) | ||
| Ontario | 7756 (43.1) | 1935 (43.0) | 1951 (43.4) | 1928 (42.8) | 1942 (43.2) | ||
| Manitoba and Saskatchewan | 1879 (10.4) | 471 (10.5) | 466 (10.4) | 461 (10.2) | 481 (10.7) | ||
| Ethnicity | Aboriginal | 213 (1.2) | 54 (1.2) | 43 (1) | 57 (1.3) | 59 (1.3) | <0.001 |
| Asian | 708 (3.9) | 167 (3.7) | 158 (3.5) | 187 (4.2) | 196 (4.4) | ||
| White | 12954 (72) | 3113 (69.2) | 3128 (69.5) | 3336 (74.1) | 3377 (75) | ||
| Other | 1711 (9.5) | 360 (8) | 403 (9) | 508 (11.3) | 440 (9.8) | ||
| Not reported | 2413 (13.4) | 805 (17.9) | 768 (17.1) | 412 (9.2) | 428 (9.5) | ||
| Age | <40 yrs | 6832 (38.0) | 1659 (36.9) | 1706 (37.9) | 1746 (38.8) | 1721 (38.2) | 0.092 |
| 40−59 yrs | 6623 (36.8) | 1696 (37.7) | 1652 (36.7) | 1673 (37.2) | 1602 (35.6) | ||
| 60 yrs and over | 4544 (25.2) | 1144 (25.4) | 1142 (25.4) | 1081 (24) | 1177 (26.2) | ||
| Rural location | 2328 (12.9) | 545 (12.1) | 586 (13) | 708 (15.7) | 489 (10.9) | <0.001 |
P values based on chi-squared test.
No. (%).
Specimens where vaccination history was available.
Between January and March 2021, 138 of 4500 (3%) study participants reported full or partial vaccination at the time of sample collection. 1.5% (n = 2) of vaccinated participants were fully vaccinated (second dose received ≥7 days prior to the date of sample collection); 30.4% (n = 42) had received their first dose at least 14 days prior; 31.1% (n = 43) received their first dose less than 14 days prior to sample collection; and 37.0% (n = 51) of participants reporting having received a least one dose had no information about the timing of dose receipt.
Overall seroprevalence trends.
Using predefined thresholds to determine seropositivity, 92.6% (n = 16,667) of study participants were negative for all four assays. 5.2% (n = 936) were positive for a single assay only. Based on the assumption that sample seropositivity using two or more assays represents a true positive case, we estimated an overall seroprevalence of 2.1% (95% CI: 1.9–2.3) over the study period. Estimated seroprevalence increased from 0.5% (95% CI: 0.23–0.96%) in April 2020 to 5.7% (95% CI: 4.7–7.0%) in March 2021 using the composite reference standard approach (Fig. 1). Results for the individual assays and different assay combinations are shown in Fig. 2 and 3. Adjusted odd ratios for seropositivity are in Table 2.
FIG 1.
Estimated seroprevalence over time. Estimates were derived using two different approaches, composite reference standard and LCA, as described in the methods. Circles represent mean values and bars indicate the 95% confidence intervals. For comparison, cumulative incidence of laboratory-confirmed SARS-CoV-2 infections in the general population for all provinces excluding Quebec over the study period is shown by the gray shaded area.
FIG 2.
Regional trends in seroprevalence. Seroprevalence estimates are shown for each of the two profiles identified by LCA and the overall results. Circles represent mean values and bars indicate the 95% confidence intervals.
FIG 3.
Seropositivity estimates over time based on predefined assay thresholds. (A) Percent of study participants positive for each assay, based on month of sample collection. (B) Percent of study participants positive for two or more assays. The different assay combinations are indicated in the legend and details are provided in the methods.
TABLE 2.
Adjusted odds ratios for SARS-CoV-2 seropositivity among study participants
| Variable | Demographic | Adjusted odds ratio | 95% confidence interval |
|---|---|---|---|
| Sex | F | 1 (referent) | |
| M | 1.16 | (0.94–1.44) | |
| Province | Alberta | 1 (referent) | |
| Atlantic provinces | 0.47 | (0.28–0.77) | |
| British Columbia | 0.80 | (0.55–1.16) | |
| Ontario | 1.21 | (0.92–1.6) | |
| Manitoba and Saskatchewan | 1.00 | (0.67–1.48) | |
| Time period | April-June 2020 | 1 (referent) | |
| July-September 2020 | 1.26 | (0.87–1.83) | |
| October-December 2020 | 1.37 | (0.95–1.98) | |
| January-March 2021 | 3.18 | (2.33–4.43) | |
| Ethnicity | Aboriginal | 1.00 | (0.35–2.32) |
| Asian | 1.13 | (0.65–1.83) | |
| White | 1 (referent) | ||
| Other | 1.40 | (1.01–1.91) | |
| Not reported | 0.96 | (0.68–1.34) | |
| Age | <40 yrs | 1 (referent) | |
| 40−59 yrs | 0.83 | (0.65–1.05) | |
| 60 yrs and over | 0.80 | (0.6–1.05) | |
| Rural location | 1.35 | (0.99–1.8) | |
| Vaccinated | 94.54 | (61.81–148.17) |
The best fit LCA model had 3 classes: one class representing the seronegative class, and two different profiles for presumptive seropositive samples (Table 3). For the seropositive classes, one class (profile 1) was associated with antibodies detected in all four assays, while for the other (profile 2), antibodies for RBD and Spike were more discriminatory of seropositivity (Fig. 4).
TABLE 3.
Group membership probabilities from LCA
| Vaccination/infection | Abbott-NP | NP | RBD | Spike |
|---|---|---|---|---|
| Likely uninfected and unvaccinated | 0.003 | 0.022 | 0.002 | 0.021 |
| Profile 1 (likely prior infection) | 0.901 | 0.919 | 0.976 | 0.984 |
| Profile 2 (likely vaccinated) | 0.020 | 0.144 | 0.629 | 0.768 |
FIG 4.
Seroprevalence estimates by latent class grouping. Seropositivity was determined using LCA, with two different classes identified among presumptive seropositive samples. Profile 1 was associated with antibodies to NP, Spike, and RBD, while Profile 2 was associated with antibodies to Spike and RBD.
Using LCA to estimate true seropositivity status based on the results of the four antibody tests, we estimated an overall seroprevalence of 2.5% (95% CI: 2.3–2.7%) for the study period. Seroprevalence increased from 0.8% (95% CI: 0.5–1.4%) in April 2020 to 6.3% (95% CI: 5.1–7.6%) in March 2021 (Fig. 1). Given the strong agreement between the two approaches used to classify seropositivity (Kappa = 0.895, P < 0.001), we used the LCA classification results in subsequent analyses.
Seroprevalence in the vaccinated population.
By LCA, the 44 vaccinated study participants who were either fully vaccinated or had received their first dose at least 14 days prior to sample collection were all classified as profile 2 (positive for Spike and RBD) while those who had received their first dose less than 14 days prior to donation were divided between seronegative (46.5%) and profile 2 (53.5%) (Fig. 5). For the 51 participants with unreported timing of vaccination relative to sample collection, 70.6% had antibody responses suggestive of vaccination-induced seropositivity (profile 2).
FIG 5.
Antibody profiles of vaccinated participants by time since vaccination at time of sample collection. Seropositivity was determined using LCA, with two different classes identified among presumptive seropositive samples. As in Fig. 4, Profile 1 was associated with antibodies to NP, Spike, and RBD, while Profile 2 was associated with antibodies to Spike and RBD.
Regional seroprevalence trends.
Estimates of seropositivity by province or region are presented in Fig. 2. Despite regions of the country experiencing very different epidemic trajectories, seroprevalence estimates at the final study time point (March 2021), were not substantially different across the country, ranging from a low of 4.2% (2.5–7.0%) in Alberta to a high of 7.0% (4.4%–11.1%) in British Columbia. There were regional differences in the seropositivity profiles, with the Atlantic provinces dominated by antibody responses suggestive of vaccination (profile 2). In contrast, Alberta, British Columbia, and Ontario saw increases in both types of antibody profiles (profile 1 and profile 2) in the December to March stage of the pandemic. These observations are consistent with the lower rates of infection observed in the Atlantic provinces.
Factors associated with seropositivity.
After adjustment for age, sex, province, ethnicity, vaccination status, and rural location, the odds of SARS-CoV-2 seropositivity were increased during the January to March 2021 period, relative to April to June 2020 (adjusted odds ratio (OR): 3.18, 95% confidence interval 95% CI: 2.33–4.43) (Table 2). Residence in the Atlantic provinces was protective (OR: 0.47, 95% CI: 0.28–0.77), while self-reported ethnicity of “Other” was associated with increased risk of being seropositive (OR: 1.40, 95% CI: 1.01–1.91). As expected, being vaccinated was strongly associated with seropositivity.
DISCUSSION
SARS-CoV-2 seropositivity was low but increased over the first year of the pandemic in a sample of Canadian blood donors. This is supported by our earlier work describing this low level of seroprevalence (2, 19). Given the absence of a gold standard (2, 16), we used two approaches to estimate SARS-CoV-2 seropositivity, and results were consistent across methodologies. We also attempted to understand the impact of donor declared vaccine history on SARS-CoV-2 serological profiles. This study did not attempt to infer neutralizing antibody seroprotection from the seroprevalence estimates, as we have previously noted that individuals with anti-S and anti-RBD antibodies may have significant variability in neutralizing capacity against wild type and variant SARS-CoV-2 (19–21).
In LCA, we identified two subgroups of seropositive cases. The first profile (profile 1), with antibodies detected in all four assays used, would be consistent with natural infections. It is possible that some people in this group were vaccinated but had either false-positive results (we feel this is less likely) for nucleocapsid or a positive signal for nucleocapsid due to cross-reactivity with seasonal coronaviruses. The second profile (profile 2), with RBD and Spike antibodies more predictive of seropositivity, would be expected in vaccinated people or potentially in people with a prior infection where nucleocapsid antibodies have waned (7, 17). Among people with known vaccination status, test positivity profiles for RBD and Spike antibodies were consistent with expectation, but it is important to note that the lack of nucleocapsid may not be precise for classifying vaccine status, and some vaccinated people may also have been previously infected (1, 14).
From April to December 2020, estimated seroprevalence was relatively flat, though there was some regional variability in trends. This trend aligns with our previous studies (2, 7, 17). Between December 2020 and January 2021, we observed a marked 2.5-fold increase in seropositivity, from approximately 2% to 5%. This inflection point occurred at a point in time when vaccination program rollout had begun across the country and when the second wave was reaching its peak (23). While we noted an overall increase in seroprevalence, there was an apparent decline in seropositivity associated with nucleocapsid, a marker of natural infection. The reason for this decline is uncertain but could represent antibody waning for people infected in the first pandemic wave or those who were prioritized for vaccination (April to July 2020) (7, 8, 17).
This study used a relatively small sample population (n = 17,999) collected over a 12-month period to understand the complexities of anti-SARS-CoV-2 assays and undertake parallel testing. Other surosurveys of healthy Canadians have identified that the combination of natural and vaccine mediated anti-SARS-CoV-2 was less than 10% in the first 3–4 months of 2021. In a larger monthly sampling of Canadian blood donors by Canadian Blood Services and the Canadian Immunity Task Force tested 16,873 specimens by both the Roche semiquantative anti-S and qualitative anti-N assays (Indianapolis, IN) (February 27-March 13, 2021). In that unpublished study, an adjusted anti-S seroprevalence of 9.9% estimated while an adjusted anti-N of 3.3% was estimated (24). A Statistics Canada and Canadian Immunity Task Force-led dried blood spot survey tested approximately 11,000 Canadians aged 1 and older living in private households between November 2020 to April 2021. Using an aggregate standard of the same immunoassays (except Abbott-anti-N) used in our study, a seroprevalence estimate for Canadian adults aged 20 to 59 by April 2021 was estimated at 4.5%. For Canadians aged 60 and older, the overall antibody seroprevalence was 2.1% (25, 26). It is possible that differences in Canadian seroprevalence rates between studies may be due to a variety of factors, including sample size, study population, antigen detected, assay used and determinant of seropositivity used. Regardless of the approach, in March of 2021, infection and vaccine-mediated seroprevalence in Canadian blood donors (<10%) was much lower than US seroprevalence estimates. At that time, seroprevalence rates for US blood donors were approximately 20% for natural infection and approximately 50% for combined infection and vaccine-mediated seropositivity (1).
Although we did not identify substantial differences in overall seropositivity estimates across the country, we did identify regional differences in the seropositivity profiles, with the Atlantic provinces dominated by antibody responses suggestive of vaccination. In contrast, Odds Ratios for seropositivity were highest in Ontario followed by Alberta (referent), Saskatchewan/Manitoba (combined) and then British Columbia in the December to March stage of the pandemic. These observations suggest lower rates of infection observed in the Atlantic provinces. Our regional results are slightly different than the Statistics Canada and Canadian Immunity Task Force-led dried blood spot survey. That survey suggested that SARS-CoV-2 seroprevalence due to a past infection was higher in Alberta (4.0%), followed by Saskatchewan (2.9%), Ontario (2.5%), Manitoba (2.4%) and British Columbia (1.6%). However, similar to our study, the Atlantic region had the lowest seroprevalence due to past infection (25). Differences between the two studies may be due to a variety of factors as described earlier but also might be due to inclusion of April data in the other study would capture third wave cases (27).
This study has several caveats. We utilized a relatively small number of specimens over a 12-month period. This may create some small sample size driven biases when estimating regional seroprevalence rates. The methodologies used to detect antibody were qualitative and we did not analyze the difference in changing antibody titers over time. We also utilized donor-declared vaccine histories which often lacked information such as dose received and timing of the vaccine dose. There was no information available in the donor records on the type of vaccine (mRNA, brand, vector-based) received. The study was also undertaken as variants of concern were emerging and there was an increasing proportion of N501Y VOCs (e.g., Alpha, Beta and Gamma) identified between mid February and late March 2021 (28). Antibody profiles in our study may differ from those in the late summer of 2021 were Delta VOCs (29) and almost all Canadian Blood donors were anti-S positive due to vaccination (30).
In conclusion, we describe an approach to estimating seroprevalence in a low prevalence setting when multiple assays are available and yet no known gold standard exists. Our approach indicates that seroprevalence on Canadian blood donors by the end of March 2021 was less than 10%. Here, we show a largely susceptible population prior to the large scale roll out of SARS-CoV-2 vaccines. We also show some regional variabilities in blood donor seroprevalence rates. Estimating seroprevalence rates in low prevalence settings can be difficult and confusing. However, our study provides further support for the use of LCA (2, 22) in upcoming public health crises, epidemics, and pandemics when a gold standard assay may not be available or identifiable. In the future, we intend to analyze later subsets of donations with respect Delta and Omicron variants of SARS-CoV-2.
MATERIALS AND METHODS
Ethical considerations.
This project received ethics board clearance from the following institutions Canadian Blood Services, the University of Alberta and Sinai Health, Toronto (Lunenfeld-Tanenbaum Research Institute).
CIHR correlates of immunity study participants and samples.
Canadian Blood Services has blood collection sites concentrated in large and small cities in all Canadian provinces except Quebec. Blood donors must meet the following criteria: be at least 17 years of age; pass health selection criteria screening and pass infectious diseases screening protocols for blood donations that are then used to manufacture products for transfusion. At each donation, there is also an additional EDTA plasma (Becton Dickson [BD], Mississauga, ON, Canada) retention sample collected for additional blood testing if required (31).
Collection of SARS-CoV-2 vaccination history in donors.
All donors at the time of donation were asked if they received a SARS-CoV-2 vaccine in the past 3 months. This was standard practice by Canadian Blood Services. Prior to this study, the study group had access to “yes” and “no” answers for vaccine history. In the autumn of 2021, a relinkage of specimen data to any vaccine history was attempted by Canada Blood Services database managers outside this study group. This also meant that information on the source of vaccine (e.g., producer) was not collected as this was not collected at the time of donation. Provincial vaccine databases are not linked to the blood operator records of donation.
Study design and population.
We designed a repeated cross-sectional design with random cross-sectional sampling of all available retention samples (n = 1500/month) for a 12 -month period from April 2020 until March 2021. A two-stage process sampling approach was used with a random selection of blood donor clinics followed by a random sample selection within clinics. Samples were anonymized. We collected variables, including sex, birth year, residential Forward Sortation Area (FSA, first three characters of postal code), donation date, and collection site were extracted from the Canadian Blood Services donor database. Retention plasma specimens were aliquoted at Canadian Blood Services and transported to test sites (2). One aliquot (250 μl) was stored at −80°C for the remainder of the study.
Comparison of seroprevalence estimates to observed trends in reported infections.
To compare seroprevalence estimates to observed trends in reported infections, we obtained data on cumulative incidence of laboratory-confirmed SARS-CoV-2 infections for all provinces excluding Quebec from (6). Note that these data included reported infections only, were collected over a time period with various criteria for accessing testing and were not restricted by age.
SARS-CoV-2 antibody testing.
Each retained plasma sample was evaluated for SARS-CoV-2 IgG antibodies using four assays, as described previously (2). This study used an Abbott Architect anti-nucleocapsid antigen assay (Abbott-NP, Abbott, Chicago IL) as well as three in-house IgG ELISAs utilizing recombinant viral antigens: full-length spike glycoprotein (Spike), spike glycoprotein receptor binding domain (RBD) and nucleocapsid (NP) (32, 33).
Specimens used for this study included those described in a prior analysis for April-September 2020, inclusive (2). Those results were included in this study and reanalyzed using a different approach as described below.
Estimation of seropositivity status and seroprevalence in the study population.
For each assay, the threshold for positivity was determined by defined cutoffs provided either by the assay manufacturer (1.4 for Abbott-NP) or based on 3 standard deviations from the log mean values of negative controls for the in-house assays (0.19 for spike, 0.186 for RBD, and 0.396 for NP) (2, 32). In the absence of a gold standard test, we used two analytic approaches to estimate SAR-CoV-2 seroprevalence: a composite reference standard and LCA.
Using the composite reference standard approach, a sample was classified as a “true” positive if it was positive for two or more of the assays. LCA is form of latent variable modeling that focuses on identifying subpopulations or groups within a sample based on a certain set of variables and has been used in infectious disease diagnostics to determine positivity when multiple imperfect tests are available (22). In this analysis, the latent variable of interest was infection with SARS-CoV-2 or vaccination against SARS-CoV-2. Based on the four assays (indicator variables), individuals from our sample population are assigned (with a certain probability) to one of two classes: seropositive or seronegative.
Given that our sample includes vaccinated people, who are expected to be positive for spike and RBD but not nucleocapsid, and some infected people may have experienced antibody waning in the time between infection and sampling, we explored models that allowed up to 4 distinct profiles (that is, we assumed that positive samples could have more than one distinct profile across the four assays) and assumed each assay was independent of the others, conditional on a person’s antibody status. Models were estimated using Gibbs sampling, with a burn-in of 1000, 10,000 iterations, and uniform priors. Fit was assessed using the Bayesian Information Criterion (BIC). We used our best-fit model to predict the true seropositivity status for each participant and used this classification to estimate seroprevalence in the study population over time.
We used Wilson’s method to calculate 95% confidence intervals (CIs) and Cohen’s kappa to compare agreement between the two methods used to classify seropositivity. We also constructed a logistic regression model to examine associations between seropositivity and age, sex, and geography, and other factors.
Data storage and statistical analysis.
Microsoft Excel (Redmond, WA, USA) spreadsheet was used for data storage. Data were analyzed as described in the results section using. All data analysis and statistics was performed using R (34, 35).
ACKNOWLEDGMENTS
We thank members of the Gingras laboratory and the Network Biology Collaborative Centre for help with ELISA assays; Yves Durocher at the National Research Council of Canada (NRC) for recombinant antigens used for the ELISA assays. We are also grateful to Canadian Blood Services staff and leadership for this support for this project.
The following authors have no conflicts of interest: S.F.O., D.F., K.T.A., B.R., A.P., K.C., and Q-L.Y. S.J.D. has functioned as a content expert for respiratory viruses for Johnson & Johnson (Janssen), and A-C.G. receives research support from Providence Therapeutics Holdings, Inc. for other projects. A.R.T. was employed by the Public Health Agency of Canada when the research was conducted. The work does not represent the views of the Public Health Agency of Canada.
S.J.D., S.F.O., and A.C.G. received funding through the Canadian Institutes of Health Research (CIHR; VR2-172723) and Alberta Innovates (G2020000360 S.J.D.), A-C.G. also received funding through the Krembil Foundation to the Sinai Health System Foundation, Ontario Together and CIHR (VR1-172711, with supplement from the COVID-19 Immunity Task Force). The robotics equipment used for the ELISA assays is housed in the Network Biology Collaborative Centre at the Lunenfeld-Tanenbaum Research Institute (A-C.G.) a facility supported by Canada Foundation for Innovation funding, by the Ontario Government and by Genome Canada and Ontario Genomics (OGI-139). The development of the spike protein constructs were supported by the CIHR operating grant to the Coronavirus Variants of Concern Rapid Response Network (CoVaRR-Net) to A-C.G. Commercial Abbott Architect SARS-Cov-2 IgG assay kit costs were partially supported by Abbott Laboratories, Abbott Park, Illinois. Abbott analyzers used at Canadian Blood Services were provided by the COVID-19 Immunity task Force (CITF). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. A-C.G. is the Canada Research Chair (Tier 1) in Functional Proteomics, and pillar lead for CoVaRR-Net.
Methodology: A.T., D.F., K.T.A., A.P., K.C. Investigation A.T., D.F., B.R. Funding acquisition: A.T., D.F., A-C.G., S.O., S.J.D. Supervision: A-C.G., S.J.D., S.O. Manuscript drafting: A.T., D.F., S.J.D. Data collation and analysis: A.T., D.F., S.O., Q-L.Y. Project administration: S.J.D.
Contributor Information
Steven J. Drews, Email: steven.drews@blood.ca.
David T. Pride, University of California, San Diego
REFERENCES
- 1.Jones JM, Stone M, Sulaeman H, Fink RV, Dave H, Levy ME, Di Germanio C, Green V, Notari E, Saa P, Biggerstaff BJ, Strauss D, Kessler D, Vassallo R, Reik R, Rossmann S, Destree M, Nguyen K-A, Sayers M, Lough C, Bougie DW, Ritter M, Latoni G, Weales B, Sime S, Gorlin J, Brown NE, Gould CV, Berney K, Benoit TJ, Miller MJ, Freeman D, Kartik D, Fry AM, Azziz-Baumgartner E, Hall AJ, MacNeil A, Gundlapalli AV, Basavaraju SV, Gerber SI, Patton ME, Custer B, Williamson P, Simmons G, Thornburg NJ, Kleinman S, Stramer SL, Opsomer J, Busch MP. 2021. Estimated US infection- and vaccine-induced SARS-CoV-2 seroprevalence based on blood donations, July 2020-May 2021. JAMA 326:1400–1409. doi: 10.1001/jama.2021.15161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Saeed S, O'Brien SF, Abe K, Yi Q-L, Rathod B, Wang J, Fazel-Zarandi M, Tuite A, Fisman D, Wood H, Colwill K, Gingras A-C, Drews SJ. 2021. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) seroprevalence: navigating the absence of a gold standard. PLoS One 16:e0257743. doi: 10.1371/journal.pone.0257743. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Shioda K, Lau MSY, Kraay ANM, Nelson KN, Siegler AJ, Sullivan PS, Collins MH, Weitz JS, Lopman BA. 2021. Estimating the cumulative incidence of SARS-CoV-2 infection and the infection fatality ratio in light of waning antibodies. Epidemiology 32:518–524. doi: 10.1097/EDE.0000000000001361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Metcalf CJE, Viboud C, Spiro DJ, Grenfell BT. 2020. Using serology with models to clarify the trajectory of the SARS-CoV-2 emerging outbreak. Trends Immunol 41:849–851. doi: 10.1016/j.it.2020.06.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Quach C, Deeks S. 2021. COVID-19 vaccination: why extend the interval between doses? JAMMI 6:73–78. doi: 10.3138/jammi-2021-0323. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Government of Canada. 2021. Coronavirus disease (COVID-19): Outbreak update. https://www.canada.ca/en/public-health/services/diseases/2019-novel-coronavirus-infection.html?utm_campaign=hc-sc-phm-21-22&utm_medium=sem&utm_source=ggl&utm_content=ad-text-en&utm_term=coronavirus%20update%20canada&adv=2122-0008&id_campaign=12663296824&id_source=125900518968&id_content=511624188952&gclid=Cj0KCQiA-eeMBhCpARIsAAZfxZDaNLkoO11qdPc3fXEVj_OsKpKvN82TwvcUQugL-YzSVe8rrLhYAxQaAndjEALw_wcB&gclsrc=aw.ds. Last accessed 2022-01-05.
- 7.Saeed S, Drews S, Pambrun C, Yi Q, Osmond L, O'Brien S. 2021. SARS-CoV-2 seroprevalence among blood donors after the first COVID-19 wave in Canada. Transfusion 61:862–872. doi: 10.1111/trf.16296. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Aiello R. 2021. 'V-Day': First COVID-19 vaccines administered in Canada. CTV News, Ottawa. https://www.ctvnews.ca/health/coronavirus/v-day-first-covid-19-vaccines-administered-in-canada-1.5230184. Accedded 2022–01-05. [Google Scholar]
- 9.Canada Go. 2021. COVID-19 vaccination in Canada 2021. https://health-infobase.canada.ca/covid-19/vaccination-coverage/. Accessed 2022-01-05.
- 10.Drews SJ, Hu Q, Samson R, Abe KT, Rathod B, Colwill K, Gingras A-C, Yi Q-L, O'Brien SF. 2022. SARS-CoV-2 virus-like particle neutralizing capacity in blood donors depends on serological profile and donor declared SARS-CoV-2 vaccination history. Submitted to Microbiol Spectrum. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Glans H, Gredmark-Russ S, Olausson M, Falck-Jones S, Varnaite R, Christ W, Maleki KT, Karlberg ML, Broddesson S, Falck-Jones R, Bell M, Johansson N, Färnert A, Smed-Sörensen A, Klingström J, Bråve A. 2021. Shedding of infectious SARS-CoV-2 by hospitalized COVID-19 patients in relation to serum antibody responses. BMC Infect Dis 21:494. doi: 10.1186/s12879-021-06202-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Fisman DN, Greer AL, Brankston G, Hillmer M, O’Brien SF, Drews SJ, Tuite AR. 2021. COVID-19 case age distribution: correction for differential testing by age. Ann Intern Med 174:1430–1438. doi: 10.7326/M20-7003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Kohler P, Güsewell S, Seneghini M, Egger T, Leal O, Brucher A, Lemmenmeier E, Möller JC, Rieder P, Ruetti M, Stocker R, Vuichard-Gysin D, Wiggli B, Besold U, Kuster SP, McGeer A, Risch L, Friedl A, Schlegel M, Vernazza P, Kahlert CR. 2021. Impact of baseline SARS-CoV-2 antibody status on syndromic surveillance and the risk of subsequent COVID-19-a prospective multicenter cohort study. BMC Med 19:270. doi: 10.1186/s12916-021-02144-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Routledge I, Takahashi S, Epstein A, Hakim J, Janson O, Turcios K, et al. 2021. Using sero-epidemiology to monitor disparities in vaccination and infection with SARS-CoV-2. medRxiv PMC8509086. doi: 10.1101/2021.10.06.21264573. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Elfström KM, Blomqvist J, Nilsson P, Hober S, Pin E, Månberg A, Pimenoff VN, Arroyo Mühr LS, Lundgren KC, Dillner J. 2021. Differences in risk for SARS-CoV-2 infection among healthcare workers. Prev Med Rep 24:101518. doi: 10.1016/j.pmedr.2021.101518. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Stein DR, Osiowy C, Gretchen A, Thorlacius L, Fudge D, Lang A, Sekirov I, Morshed M, Levett PN, Tran V, Kus JV, Gubbay J, Mohan V, Charlton C, Kanji JN, Tipples G, Serhir B, Therrien C, Roger M, Jiao L, Zahariadis G, Needle R, Gilbert L, Desnoyers G, Garceau R, Bouhtiauy I, Longtin J, El-Gabalawy N, Dibernardo A, Lindsay LR, Drebot M, Canadian Public Health Laboratory Network (CPHLN) Serology Task Force . 2021. Evaluation of commercial SARS-CoV-2 serological assays in Canadian public health laboratories. Diagn Microbiol Infect Dis 101:115412. doi: 10.1016/j.diagmicrobio.2021.115412. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Saeed S, Drews SJ, Pambrun C, O'Brien SF. 2021. Waning anti-nucleocapsid IgG signal among SARS-CoV-2 seropositive blood donors: May–November 2020. JAMMI 6:10–11.36340216 [Google Scholar]
- 18.Bayart J-L, Douxfils J, Gillot C, David C, Mullier F, Elsen M, Eucher C, Van Eeckhoudt S, Roy T, Gerin V, Wieers G, Laurent C, Closset M, Dogné J-M, Favresse J. 2021. Waning of IgG, total and neutralizing antibodies 6 months post-vaccination with BNT162b2 in healthcare workers. Vaccines 9:1092. doi: 10.3390/vaccines9101092. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Drews SJ, Abe KT, Hu Q, Samson R, Gingras A‐C, Colwill K, Rathod B, Wang J, Fazel‐Zarandi M, Yi Q‐L, Robinson A, Wood H, Tuite A, Fisman D, Evans DH, Lin Y‐CJ, O'Brien SF. 2022. Resistance of SARS-CoV-2 Beta and Gamma variants to plasma collected from Canadian blood donors during the Spring of 2020. Transfusion 62:37–43. doi: 10.1111/trf.16713. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Drews SJ, Devine DV, McManus J, Mendoza E, Manguiat K, Wood H, Girardin R, Dupuis A, McDonough K, Drebot M. 2021. A trend of dropping anti-SARS-CoV-2 plaque reduction neutralization test titers over time in Canadian convalescent plasma donors. Transfusion 61:1440–1446. doi: 10.1111/trf.16364. [DOI] [PubMed] [Google Scholar]
- 21.Abe KT, Li Z, Samson R, Samavarchi-Tehrani P, Valcourt EJ, Wood H, Budylowski P, Dupuis AP, Girardin RC, Rathod B, Wang JH, Barrios-Rodiles M, Colwill K, McGeer AJ, Mubareka S, Gommerman JL, Durocher Y, Ostrowski M, McDonough KA, Drebot MA, Drews SJ, Rini JM, Gingras A-C. 2020. A simple protein-based surrogate neutralization assay for SARS-CoV-2. JCI Insight 5. doi: 10.1172/jci.insight.142362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Fisman DN, Greer AL, Brouhanski G, Drews SJ. 2009. Of gastro and the gold standard: evaluation and policy implications of norovirus test performance for outbreak detection. J Transl Med 7:23. doi: 10.1186/1479-5876-7-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Government of Canada. 2021. SARS-CoV-2 variants: National definitions, classifications and public health actions. Available from: https://www.canada.ca/en/public-health/services/diseases/2019-novel-coronavirus-infection/health-professionals/testing-diagnosing-case-reporting/sars-cov-2-variants-national-definitions-classifications-public-health-actions.html. Accessed January 5, 2022.
- 24.O'Brien SF. 2021. Canadian Blood Services. Personal communication. unpublished. [Google Scholar]
- 25.Statistics Canada S. 2021. Few Canadians had antibodies against SARS-CoV-2 in early 2021. Available from: https://www150.statcan.gc.ca/n1/daily-quotidien/210706/dq210706a-eng.htm. Accessed December 8, 2021.
- 26.COVID-19 Immunity Task Force. 2021. Recent blood donor data suggest that Canadians still remain vulnerable to SARS-CoV-2 infection. 2021. 05–27. https://www.covid19immunitytaskforce.ca/recent-blood-donor-data-suggest-that-canadians-still-remain-vulnerable-to-sars-cov-2-infection/. Accessed January 5, 2022.
- 27.Government of Canada. 2022. COVID-19 daily epidemiology update. https://health-infobase.canada.ca/covid-19/epidemiological-summary-covid-19-cases.html. Accessed January 5, 2022.
- 28.Fisman DN, Tuite AR. 2021. Evaluation of the relative virulence of novel SARS-CoV-2 variants: a retrospective cohort study in Ontario, Canada. CMAJ 193:E1619–E1625. doi: 10.1503/cmaj.211248. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.National Collaborating Centre for Infectious Diseases. 2021. Updates on COVID-19 Variants of Concern. https://nccid.ca/covid-19-variants/#subMenuSection0. Accessed January 5, 2022.
- 30.COVID-19 Immunity Task Force. 2021. Vaccine-induced seroprevalence hits highest level to date, yet early fourth wave hitting those most at-risk: Canadian Blood Services. https://www.covid19immunitytaskforce.ca/vaccine-induced-seroprevalence-hits-highest-level-to-date-yet-early-fourth-wave-hitting-those-most-at-risk-canadian-blood-services-august-report/. Accessed January 5, 2022.
- 31.Canadian Blood Services Surveillance Report. 2019. Available from: https://professionaleducation.blood.ca/en/transfusion/publications/surveillance-report. Accessed December 8, 2021.
- 32.Abe K, Hu Q, Mozafarihashjin M, Samson R, Manguiat K, Robinson A, et al. 2021. Neutralizing antibody responses to SARS-CoV-2 variants in vaccinated Ontario long-term care home residents and workers. medRxiv. [Google Scholar]
- 33.Colwill K, Galipeau Y, Stuible M, Gervais C, Arnold C, Rathod B, et al. 2021. A “Made-in-Canada” serology solution for profiling humoral immune responses to SARS-CoV-2 infection and vaccination. medRxiv. 2021.10.25.21265476. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.White A, Murphy TB. 2014. BayesLCA: an R Package for Bayesian latent class analysis. J Stat Soft 61:1–28. doi: 10.18637/jss.v061.i13. [DOI] [Google Scholar]
- 35.R Core Team. 2021. R: A language and environment for statistical computing. R Foundation for Statistical Computing. Vienna, Austria. https://www.R-project.org/. [Google Scholar]