Skip to main content

This is a preprint.

It has not yet been peer reviewed by a journal.

The National Library of Medicine is running a pilot to include preprints that result from research funded by NIH in PMC and PubMed.

medRxiv logoLink to medRxiv
[Preprint]. 2021 Apr 9:2021.04.05.21254656. [Version 2] doi: 10.1101/2021.04.05.21254656

Glucocorticoids and B Cell Depleting Agents Substantially Impair Immunogenicity of mRNA Vaccines to SARS-CoV-2

Parakkal Deepak 1, Wooseob Kim 2, Michael A Paley 3, Monica Yang 4, Alexander B Carvidi 5, Alia A El-Qunni 6, Alem Haile 7, Katherine Huang 8, Baylee Kinnett 9, Mariel J Liebeskind 10, Zhuoming Liu 11, Lily E McMorrow 12, Diana Paez 13, Dana C Perantie 14, Rebecca E Schriefer 15, Shannon E Sides 16, Mahima Thapa 17, Maté Gergely 18, Suha Abushamma 19, Michael Klebert 20, Lynne Mitchell 21, Darren Nix 22, Jonathan Graf 23, Kimberly E Taylor 24, Salim Chahin 25, Matthew A Ciorba 26, Patricia Katz 27, Mehrdad Matloubian 28, Jane A O’Halloran 29, Rachel M Presti 30, Gregory F Wu 31, Sean PJ Whelan 32, William J Buchser 33, Lianne S Gensler 34, Mary C Nakamura 35, Ali H Ellebedy 36, Alfred HJ Kim 37
PMCID: PMC8043473  PMID: 33851176

Abstract

Background:

Individuals with chronic inflammatory diseases (CID) are frequently treated with immunosuppressive medications that can increase their risk of severe COVID-19. While novel mRNA-based SARS-CoV-2 vaccination platforms provide robust protection in immunocompetent individuals, the immunogenicity in CID patients on immunosuppression is not well established. Therefore, determining the effectiveness of SARS-CoV-2 vaccines in the setting of immunosuppression is essential to risk-stratify CID patients with impaired protection and provide clinical guidance regarding medication management.

Methods:

We conducted a prospective assessment of mRNA-based vaccine immunogenicity in 133 adults with CIDs and 53 immunocompetent controls. Blood from participants over 18 years of age was collected before initial immunization and 1-2 weeks after the second immunization. Serum anti-SARS-CoV-2 spike (S) IgG+ binding, neutralizing antibody titers, and circulating S-specific plasmablasts were quantified to assess the magnitude and quality of the humoral response following vaccination.

Results:

Compared to immunocompetent controls, a three-fold reduction in anti-S IgG titers (P=0.009) and SARS-CoV-2 neutralization (p<0.0001) were observed in CID patients. B cell depletion and glucocorticoids exerted the strongest effect with a 36- and 10-fold reduction in humoral responses, respectively (p<0.0001). Janus kinase inhibitors and antimetabolites, including methotrexate, also blunted antibody titers in multivariate regression analysis (P<0.0001, P=0.0023, respectively). Other targeted therapies, such as TNF inhibitors, IL-12/23 inhibitors, and integrin inhibitors, had only modest impacts on antibody formation and neutralization.

Conclusions:

CID patients treated with immunosuppressive therapies exhibit impaired SARS-CoV-2 vaccine-induced immunity, with glucocorticoids and B cell depletion therapy more severely impeding optimal responses.

INTRODUCTION

The Coronavirus disease 2019 (COVID-19) is a global pandemic caused by severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) that has infected millions, causing countless deaths and widespread economic devastation. Several vaccines against SARS-CoV-2 using either a novel liposomal mRNA-based delivery platform or an adenovirus-based approach have been authorized for emergency use by the Food and Drug Administration (FDA).14 The goal of vaccination is to generate long-lasting protection against infection. Most vaccines in clinical use achieve this protection at least in part through the generation of pathogen-specific antibody responses. Overcoming the COVID-19 pandemic will highly depend on the success of vaccine effectiveness.

The current management of various chronic inflammatory diseases (CID) including inflammatory bowel diseases (IBD), rheumatoid arthritis (RA), psoriasis, systemic lupus erythematosus (SLE), and multiple sclerosis (MS) typically requires immunosuppressive medications to achieve and maintain disease response and remission.59 Thus, patients with CID may be more vulnerable to infectious diseases. Indeed, certain medications such B cell depleting therapies (BCDT), glucocorticoids, and sulfasalazine have been associated with increased hospitalization and death due to COVID-19.10,11 Consequently, vaccination is recommended for CID patients. However, certain immunosuppressive medications have been shown to blunt vaccination responses.12

The seroconversion and magnitude of anti-SARS-CoV-2 antibody reactivity after COVID-19 infection have been reported to be attenuated in tumor necrosis factor-inhibitor (TNFi) [infliximab]-treated IBD patients compared with a gut-selective anti-integrin (vedolizumab), which is further blunted with concomitant thiopurine or methotrexate.13 This suggests that other immunosuppressives may also attenuate humoral responses following SARS-CoV-2 vaccination. The novel delivery platform (liposomal mRNA), along with the lack of data on efficacy and safety in immunosuppressed subjects due to exclusion from clinical trials,1,2 has led to uncertainty whether to continue or hold immunosuppression to maximize SARS-CoV-2 vaccine efficacy, and discordant guidelines from national medical organizations.1416

Emerging data demonstrate reduced antibody responses in immunosuppressed individuals following mRNA vaccination. Organ transplant recipients receiving antimetabolite therapy and older recipients were less likely to develop an antibody response following the first dose of the BNT162b2 or the mRNA-1273 vaccines.17 Furthermore, CID patients (n=26) vaccinated with mRNA vaccines had blunted anti-S IgG levels with modest reduction in neutralization in ~25% of subjects compared to immunocompetent controls.18 Similarly, in 13 IBD patients treated with either TNFi or anti-integrin therapy who completed the two-dose vaccine schedules, reductions in anti-S IgG levels were observed compared to non-IBD controls.19 While these early observations corroborate suspicions that immunosuppression can reduce antibody responses following SARS-CoV-2 vaccination, these studies have inadequate sample sizes to determine which specific immunosuppressive classes drive a reduction in humoral responses to SARS-CoV-2 vaccination.

Here, we report immunogenicity data in 133 patients with CID and 53 immunocompetent controls following completion of the two-dose mRNA SARS-CoV-2 vaccination series. The size of our cohort enables us to test the hypothesis that certain immunosuppressive therapies mediate reductions in vaccine-induced humoral immune responses.

METHODS

Study design

The COVaRiPAD (COVID-19 Vaccine Responses in Patients with Autoimmune Disease) study is a longitudinal observational study seeking to elucidate the magnitude, quality, and evolution of the immune response to SARS-CoV-2 vaccines. The initial phase of COVaRiPAD specifically examined the magnitude and quality of the acute humoral response.

Patient recruitment

133 participants with confirmed CID and 53 immunocompetent controls recruited from the faculty, employees, staff, and patients at Washington University School of Medicine and BJC Healthcare system (St. Louis, MO, USA) and the University of California, San Francisco, UCSF Health, and Zuckerberg San Francisco General Hospital (San Francisco, CA, USA) from 12/10/2020 to 3/20/2021. All participants provided written informed consent. Participants were assessed within two weeks prior to initial vaccination and twenty days post-final vaccination, with 96% of blood samples collected within 14 days post-vaccination. Inclusion and exclusion criteria for CID and immunocompetent controls can be found in the Supplemental Appendix. Medications, including dose and last administration date were confirmed at each study visit. Medications comprising antimetabolites and BCDT are listed in the Supplemental Appendix. All patients continued their immunosuppressive medications per their treating physician, except for five individuals who held methotrexate around immunization.

Assessment of humoral responses

As previously described,20 anti-S IgG quantification was performed using enzyme-linked immunosorbent assay (ELISA), and direct ex-vivo enzyme-linked immunosorbent spot (ELISpot) assays were performed to quantify recombinant S protein-binding IgG-secreting cells. Neutralization assays were performed using a fluorescence-based platform leveraging a chimeric vesicular stomatitis virus (VSV) pseudotyped with the common variant strain (D614G) of the S protein of SARS-CoV-2 that has been modified for high-throughput processing.21,22 Additional details are provided in the Supplementary Appendix.

Statistical analysis

Statistical analyses were performed using Prism v9.1.0 (GraphPad Software) and Stata/MP 13.1. Kruskal-Wallis test followed by Dunn’s multiple comparison’s test or Mann-Whitney test were used as indicated. Effects were further refined via to bit linear regression to account for left-censoring of data below the limit of detection (LoD) and to adjust for pre-vaccination titer, age, and gender. For regression analysis, to test for the effects of medications in the presence of combination therapy, medications were ranked by their impact on vaccine response and patients included in discrete groups by medication having the largest effect size.

Ethics approval

This study was approved by the Washington University School of Medicine Institutional Review Board (protocol #201105110, approved 6/1/2011; protocol #202012081, approved 12/21/2020; and protocol #202012084, approved 12/23/2020) and the UCSF Institutional Review Board (protocol #17-21898, approved 4/22/2017 and protocol #20-33078, approved 1/4/2021).

RESULTS

Between December 2020 and March 2021 at two sites (St. Louis, MO and San Francisco, CA), 133 patients with CIDs and 53 controls were enrolled. The mean age was 45.5±16.0 years old with 14.3% >65 years old (Table 1, Table S1). The majority were female (74.4%) and white (88.0%). The most common CID diagnoses among the subjects were 31.6% with IBD and 28.6% RA. The most common immunosuppressive medications were TNFi (28.6%) and methotrexate (21.8%).

Table 1.

Demographic and Clinical Characteristics of Participants with Chronic Inflammatory Diseases

Characteristics N=133

 Age, years
   Mean ± SD 45.5 ± 16.0
 Age category — no. of participants (%)
   <65yr 114 (85.7)
   ≥65yr 19 (14.3)

 Gender — no. of participants (%)
   Female 99 (74.4)
   Male 34 (25.6)

 Hispanic or Latinx ethnicity – no of participants (%)
   Hispanic or Latinx 6 (4.5)
   Not Hispanic or Latinx 127 (95.5)
 Race or ethnic group — no. of participants (%)
   White 117 (88.0)
   Asian 9 (6.8)
   Black or African American 4 (3.0)
   American Indian or Alaska Native 2 (1.5)
   Multi-racial 1 (0.8)

 BMI [kg/m2], mean ± SD 26.6 ± 6.3

 Days after 2nd immunization for blood sample, mean ± SD 8.5 ± 2.8


Immunologic Diagnosis - no. of participants (%)§
 Inflammatory Bowel Disease 42 (31.6)
   Crohn’s Disease 22 (16.5)
   Ulcerative Colitis 18 (13.5)
   Other 2 (1.5)
 Rheumatoid Arthritis 38 (28.6)
 Spondyloarthritis 20 (15)
   Axial Spondyloarthritis 6 (4.5)
   Psoriatic Arthritis/Psoriasis 10 (7.5)
   IBD Arthritis 4 (3.0)
 Uveitis 5 (3.8)
 Systemic Lupus Erythematosus 15 (11.3)
 Other Connective Tissue Disease 4 (3.0)
 Sjögren’s Syndrome 8 (6.0)
 Vasculitis 5 (3.8)
 Autoinflammatory Syndrome 2 (1.5)
 Multiple Sclerosis 9 (6.8)
 Neuromyelitis Optica 1 (0.8)
 IgG4-Related Disease 2 (1.5)
 Hidradenitis Suppurativa 1 (0.8)
 Human Immunodeficiency Virus 1 (0.8)
 Anti-phospholipid Syndrome 1 (0.8)

Medication exposure - no. of participants (%)
 Prednisone 17 (12.8)
   Mean mg/day ± SD 6.5 ± 5.8
   Range, mg/day 1 - 20
 Disease Modifying Antirheumatic Drug (DMARD)
  Methotrexate 29 (21.8)
   Mean mg/week ± SD 17.1 ± 5.4
   Range, mg/day 7.5 - 25
  Hydroxychloroquine 30 (22.6)
  Mycophenolate Mofetil 9 (6.8)
  Azathioprine 4 (3.0)
  Leflunomide 2 (1.5)
  Sulfasalazine 7 (5.3)
 Janus Kinase inhibitors
  Tofacitinib 10 (7.5)
  Upadacitinib 1 (0.8)
 Biological therapies
  Tumor Necrosis Factor inhibitorsS 38 (28.6)
  B cell depleting therapies 10 (7.5)
  Belimumab 3 (2.3)
  Vedolizumab 12 (9.0)
  Interleukin 12/23 or 23 inhibitors* 10 (7.5)
  Abatacept 2 (1.5)
  Tocilizumab 1 (0.8)
  Canakinumab 1 (0.8)
 Fingolimod 1 (0.8)
 Ibrutinib 1 (0.8)
 Nonsteroidal Anti-inflammatory Drugs (NSAIDs) 27 (20.3)
 No DMARDs or biologics 9 (6.8)
§

Patients could be diagnosed with more than 1 condition, such that the sum of diagnoses is greater than the number of participants.

Gender, Race or ethnic group was reported by the participant.

Other Connective Tissue Disease includes Undifferentiated connective tissue disease and Mixed Connective Tissue Disease.

Š

Tumor Necrosis Factor Inhibitors includes adalimumab (n=13), certolizumab pegol (n=5), etanercept (n=13), golimumab (n=2) and infliximab (n=6).

B cell depleting therapies include rituximab (n=8) and ocrelizumab (n=4).

*

Interleukin 12/23 inhibitors include ustekinumab (n=9) and interleukin 23 inhibitors include guselkumab (n=1)

Immunocompetent controls and most CID participants developed robust anti-SARS-CoV-2 antibody responses after immunization, although CID participants averaged a 3-fold reduction in antibody titers compared to immunocompetent controls (Figure 1AB). This diminished antibody response was associated with a similar 2.7-fold decrease in neutralization of viral infection (Figure 1C). Additionally, we observed a non-statistically significant trend towards impaired plasmablast formation in CID participants (Figure S1A).

Figure 1. Glucocorticoids Reduce Immunogenicity of mRNA-based SARS-CoV-2 Vaccination.

Figure 1.

Immunocompetent (control) and chronic inflammatory disease (CID) participants underwent blood draws pre- and post-vaccination (~1-2 weeks after boost) and concurrent medication use was collected. Quantification of circulating anti-S IgG for immunocompetent (left) and CID (right) participants pre- and post-immunization is shown in Panel A. Each symbol represents an individual for each timepoint. Dotted lines indicate limits of detection (LoD). Horizontal red lines indicate median value. A lower titer of anti-SARS-CoV-2 antibodies post-vaccination in CID vs immunocompetent participants is shown in Panel B. Neutralization of SARS-CoV-2 S protein by serum of immunocompetent and CID participants post-vaccination is shown in Panel C. Pseudotyped vesicular stomatitis virus with SARS-CoV-2 S protein was introduced to Vero cells with decreasing concentrations of serum to identify the dilution required for 50% neutralization. Values are normalized to the median of immunocompetent participants. A lower titer of anti-SARS-CoV-2 antibodies is found in CID participants taking glucocorticoids is shown in Panel D. CID participants are split by prednisone use (shaded black). A decrease in neutralization of SARS-CoV-2 S for CID participants on or off glucocorticoids is shown in Panel E. P values are indicated for each comparison (Dunn’s multiple comparison test).

To identify which medications may reduce the immunogenicity of mRNA-based SARS-CoV-2 vaccination, we first compared participants on or off glucocorticoids with immunocompetent controls. Glucocorticoid use resulted in a 10-fold reduction in anti-S IgG and neutralization titers, as well as fewer circulating plasmablasts after vaccination (Figure 1DE, Figure S1B). Strikingly, seropositivity post-vaccination decreased from 98% in immunocompetent controls, to 92% in CID participants off prednisone, to 65% in CID participants on prednisone. Thus, the use of glucocorticoids negatively impacts the immunogenicity of mRNA-based vaccines.

We next examined whether antimetabolites, particularly methotrexate, influenced the immunogenicity of mRNA-based vaccination in the absence of glucocorticoids. Compared to immunocompetent controls, CID participants on any antimetabolite demonstrated on average a 2-3-fold reduction in anti-spike antibodies and neutralization (Figure 2AB). This effect was seen when specifically examining the effect of methotrexate. We also observed a small decline in circulating plasmablasts associated with antimetabolites, but this sub-analysis contained a high degree of variance (Figure S2). Thus, antimetabolite therapy, including methotrexate, modestly impairs the immunogenicity of mRNA-based vaccines.

Figure 2. Antimetabolites Modestly Reduce Immunogenicity of mRNA-based SARS-CoV-2 Vaccination.

Figure 2.

Decreases in circulating anti-S IgG post-immunization for CID participants either not taking antimetabolites, taking any antimetabolite, or specifically taking methotrexate are shown in Panel A. Methotrexate use is denoted by square symbols. Glucocorticoid use was excluded. Dotted lines indicate limits of detection (LoD). A decrease in neutralization of SARS-CoV-2 S for CID participants on or off antimetabolites is shown in Panel B. Values are normalized to the median of immunocompetent participants. Each symbol represents an individual for each timepoint. Horizontal red lines indicate median value. P values are indicated for each comparison (Dunn’s multiple comparison test).

Given previous reports of targeted therapies impairing vaccine responses,12 we examined the impact of multiple agents on mRNA-based vaccination. Compared to immunocompetent controls, we noted a reduction in antibody titers, neutralization, and circulating plasmablasts for CID participants on TNFi agents; however only neutralization reached statistical significance (Figure 3AB, Figure S3). We did not observe lower anti-S IgG titers in participants taking a combination of TNFi with methotrexate compared to TNFi alone (Figure 3CD).

Figure 3. B Cell Depletion Therapy Reduces Immunogenicity of mRNA-based SARS-CoV-2 Vaccination.

Figure 3.

Quantification of circulating anti-S IgG for immunocompetent (control) and CID participants on TNF inhibitors (TNFi), JAK inhibitors (JAKi), B cell depletion therapy (BCDT), anti-integrin agents, and anti-IL-12/23 agents are shown in Panel A. Combined use with prednisone (PDN) is denoted by solid fill and with methotrexate (MTX) is denoted by square symbols. Dotted lines indicate limits of detection (LoD). Neutralization for the same sub-groups is shown in Panel B. Values are normalized to the median of immunocompetent participants. Quantification of circulating anti-S IgG for CID participants on TNFi, separated by methotrexate use is shown in Panel C. A reduction in neutralization for participants on an TNFi alone is shown in Panel D. Each symbol represents an individual for each timepoint. Horizontal red lines indicate median value. P values are indicated for each comparison (Dunn’s multiple comparison test).

JAKi use also drove a reduction in anti-S IgG and neutralization, although the latter did not reach statistical significance (Figure 3AB). In contrast to TNFi and JAKi, BCDT were associated with a meaningful 36-fold reduction in anti-S IgG and neutralization titers, as well as absence of circulating plasmablasts in one subject where data was available (Figure 3AB, Figure S3). The reduction in seroconversion was most striking in participants who had more recently (within 6 months) received BCDT (Figure S4A) with variable recovery over time (Figure S4B). Other targeted therapies were associated with only a modest reduction in antibody titers, neutralization, or circulating plasmablasts that did not reach statistical significance (Figure 3AC, Figure S3).

To test the strength of association between medications and reduction in antibody titers, regression analyses were performed. We found that, when compared to immunocompetent participants, CID participants on BCDT, prednisone, JAKi, and antimetabolites all had statistically significant reductions in antibody titers in univariate and multivariate models (Table 2, Figure S5). In contrast, antimalarials (i.e., hydroxychloroquine) and TNFi were not significantly associated with reduced antibody titers. This effect of BCDT, prednisone, and JAKi, but not antimetabolites, remained significant when compared to CID participants who were not taking BCDT, prednisone, JAKi, antimetabolites, antimalarials, or TNFi (Table S2). Furthermore, there was no interaction between TNFi and methotrexate therapy in the reduction of antibody titers beyond the effect of methotrexate alone. In contrast, participants taking multiple medications displayed an 83.1% reduction in antibody titers compared to those not on prednisone (Table S3).

Table 2:

Post-vaccine Titer by Chronic Inflammatory Diseases Medication Group versus Immunocompetent Participants.

Medication group1 N Fold Reduction in Titer (95% CI) P value2
B-cell depleting therapy 10 52.7 (18.3 - 152.0) 4.0E-10
Prednisone 14 15.1 (4.9 - 46.3) 9.0E-06
JAK inhibitors 10 6.6 (2.9 - 15.3) 3.0E-05
Antimetabolites 31 2.9 (1.5 - 5.6) 0.0023
Antimalarials 14 2.2 (0.96 - 5.0) 0.062
TNF inhibitors 21 1.7 (0.92 - 3.2) 0.091
Other 3 or No Medications 33 1.6 (0.92 - 2.8) 0.097
1

Each medication group excludes patients in the group(s) above.

2

Tobit regression of log10(post-vaccine titer) left-censored at limit of detection log10(30), adjusting for log10(pre-vaccine titer), age, and gender.

3

Other medications include NSAIDs, sulfasalazine, anti-integrin therapy, anti-IL-12/23 therapy, and ibrutinib.

DISCUSSION

We report the analysis from the initial phase of the COVaRiPAD study, focusing on antibody responses after two doses of either BNT162b2 or mRNA-1273. Using a cohort composed of 133 patients with CID and 53 immunocompetent controls recruited from two tertiary medical centers in the United States, we show that CID patients have a greater reduction in magnitude and quality of antibody responses compared to immunocompetent controls. This is consistent with published or preprint reports in patients with CID.18,19,23 Furthermore, BCDT, glucocorticoids, JAKi, and, to a lesser extent, antimetabolites were associated with reduced antibody responses.

Patients on BCDT had substantial reductions in anti-S IgG as well as neutralizing antibodies, as was observed for influenza and pneumococcal vaccination.24,25 We found this was most prominent when vaccination occurred within 6 months of BCDT administration, with gradual recovery after 9 months post-treatment with rituximab. All four subjects on ocrelizumab had undetectable antibodies, and it remains unclear whether they will experience similar recovery kinetics as those on rituximab. Ocrelizumab has improved antibody-dependent cellular cytotoxicity compared to rituximab, which may prolong its impact on SARS-CoV-2 immunization.26 Consistent with our data, after immunization with BNT162b2, another patient with MS failed to generate detectable anti-S antibodies six months after ocrelizumab treatment.27 These data are concerning as COVID-19 patients on BCDT have increased mortality compared to methotrexate users.11 Notably, in the VELOCE study, immunization against keyhole limpet hemocyanin (KLH), influenza, pneumococcus, and tetanus toxoid elicited antibody responses, albeit reduced, despite ocrelizumab administration 12 weeks prior. 28 Importantly, the KLH and influenza vaccinations consist of three immunization series, raising the question of whether additional boosters in this population may be needed to mount responses. Thus, it may be beneficial to withhold BCDT for some duration or, after appropriate study, provide an additional vaccine booster to enable reasonable antibody responses following mRNA-based SARS-CoV-2 vaccination.

We also found that glucocorticoid use resulted in a 10-fold reduction in antibody titers following SARS-CoV-2 vaccination. This was independent of dose, with very low titers observed in some subjects taking <5mg prednisone daily. Furthermore, use of prednisone in combination with other medications further attenuated antibody titers compared to other medications taken alone. In SLE subjects, high dose prednisone use (>20mg daily) was associated with a decline in seroconversion after influenza vaccination, but a dose-independent effect on seroconversion was observed following pneumococcus, tetanus toxoid, Haemophilus influenzae type B, or hepatitis B vaccination.2931 In contrast, glucocorticoids had minimal impact on seroconversion after influenza vaccination, either at high doses in the setting of asthma or low doses in RA or spondylarthritis patients.32,33 Importantly, repeated immunization against hepatitis B can still boost suboptimal humoral response in immunosuppressed individuals.34 Thus, mRNA-based SARS-CoV-2 vaccination may be more sensitive to the immunosuppressive effects of glucocorticoid use than traditional platforms, and additional booster immunizations may be required in this population to achieve protection. As most prednisone users were on other immunosuppressants in this study, efforts to taper prednisone as safely as possible while initiating additional therapies may be needed to permit optimal antibody responses from mRNA-based vaccines.

The use of methotrexate, TNFi, and JAKi all lowered both antibody and neutralization titers, but only JAKi and antimetabolites demonstrated a statistically significant association in a regression model. Similar data for reduced antibody titers in TNFi users was also noted in the IBD population.23 Reassuringly, the combination of methotrexate with TNFi did not seem to further reduce antibody titers relative to each agent alone. Furthermore, patients who have not held antimetabolite, TNFi, or JAKi therapy can be reassured that the impact on antibody titers is modest.

IL-12/23 inhibitors and vedolizumab had minimal impact on antibody titers. In contrast, lower anti-S titers have been reported after SARS-CoV-2 vaccination with vedolizumab.19 We noted a reduction of neutralization titers for those on vedolizumab, but the low sample size may have limited the ability to detect a significant effect. Additional recruitment will be needed to confirm this observation.

Prior to any evaluation of mRNA-based vaccines in CID patients, professional societies were pressed to provide guidance regarding the use of immunosuppression in CID patients. Current guidelines in IBD and psoriasis do not suggest holding biologics, small molecules, or antimetabolites prior to vaccination against SARS-CoV-2.14,16 In contrast, the COVID-19 Vaccine Clinical Guidance Summary from the American College of Rheumatology (ACR) has a moderate-level consensus in holding certain immunosuppressants such as methotrexate and JAKi for 1 week after each vaccine dose for those with well-controlled disease.15 The blunting of humoral responses in the setting of antimetabolites, TNFi, and JAKi support the initial recommendations from the ACR that certain medications may need to be held in order to optimize vaccine response. Importantly, our study was conducted prior to the release of these recommendations and only five subjects in our cohort held any medications (all methotrexate).

As no cutoff titer has been defined to best associate with protection, the impact of reduced antibody levels on protection remains unclear. Additionally, these data do not directly evaluate protection from SARS-CoV-2 infection nor prevention of hospitalization. Nevertheless, S-specific antibody titers in CID patients (particularly TNFi and JAKi) are comparable to patients with rapid recovery from COVID-19 and may, therefore, provide sufficient humoral protection.35 Furthermore, CD4+ and CD8+ T cell responses were observed in patients with COVID-19,36 suggesting the potential importance of T-cell-mediated immunity against SARS-CoV-2. Indeed, S-specific T cells are easily detected in those previously infected with SARS-CoV-2 immunized with a single dose of either mRNA-based vaccine.37 We plan to examine T cell responses in our cohort to determine this important aspect of post-vaccinal immunity to SARS-CoV-2.

The limitations of the study include small sample sizes for several classes of immunosuppressives (i.e. anti-IL-17, belimumab, abatacept), preventing any analysis. Additionally, we cannot evaluate differences between the two mRNA vaccines, nor with the adenovirus delivery platform. We also have limited racial and ethnic diversity due to selection bias (most subjects are faculty/staff at academic teaching hospitals). We have continued recruitment to address this. We will report safety, reactogenicity, disease state, and changes in disease activity in future studies.

Assessing long-term responses (i.e. 6 months post-booster) and neutralization of variants of concern will be critical as the impact of immunosuppression on vaccine response durability and epitope breadth is unknown. Most immunocompetent subjects vaccinated with mRNA-1273 only had modest reductions in neutralization 3 months post-booster,38 while recovered COVID-19 patients, maintained antibody, B, and T cell responses up to 8 months after infection.39 Of concern though, is the poor neutralization responses to B.1.351 in previously uninfected immunocompetent subjects following mRNA vaccination.40 Whether immunosuppression may further attenuate cross-variant neutralization is unclear.

In summary, this initial analysis of the COVaRiPAD study, focusing on the magnitude and quality of antibody responses after two doses of either BNT162b2 or mRNA-1273, reveals that most patients with CID on immunosuppressive treatment were able to mount responses. Select classes, including JAKi, TNFi, methotrexate, glucocorticoids, and particularly BCDT have a varying deleterious impact on the magnitude and quality of anti-spike IgG and neutralizing responses compared to immunocompetent controls. These data serve as the initial building block for providers and professional societies to reach a broader consensus regarding the use of specific immunosuppressive agents in the peri-vaccination period.

Supplementary Material

Supplement 1
media-1.docx (11.8MB, docx)

ACKNOWLEDGEMENTS

The authors would like to thank the study participants for their generous and enthusiastic participation, the treating clinicians for their support of the study recruitment process, and the staff of the Washington University School of Medicine Infectious Diseases Clinical Research Unit, Clinical Trials Research Unit, Center of Clinical Studies, and the Digestive Diseases Research Core Center for assistance with study visits. We thank the Siteman Tissue Procurement Core for processing and storage of the blood specimens. We thank Grace L. Paley for constructive comments on the manuscript. A.H.J.K. thanks Jinoos Yazdany for constructive conversations.

Funding

This research was funded/supported by The Leona M. and Harry B. Helmsley Charitable Trust, Washington University Digestive Disease Research Core Center (NIDDK P30DK052574), Washington University Rheumatic Diseases Research Resource-Based Center (NIAMS P30AR073752), The Judy Miniace Research Fund for the Washington University Lupus Clinic, NIAID Collaborative Influenza Vaccine Innovation Centers contract 75N93019C00051 for the Washington University Infectious Disease Clinical Research Unit COVID sample collection, and UCSF investigators were funded by PREMIER, a NIAMS P30 Center (P30AR070155) and the Russell/Engleman Rheumatology Research Center. This study utilized samples obtained from the Washington University School of Medicine’s COVID-19 biorepository, which is supported by the Barnes-Jewish Hospital Foundation, the Siteman Cancer Center grant P30CA091842 from the National Cancer Institute of the National Institutes of Health, and the Washington University Institute of Clinical and Translational Sciences grant UL1TR002345 from the National Center for Advancing Translational Sciences of the National Institutes of Health. The content is solely the responsibility of the authors and does not necessarily represent the view of the NIH.

P.D. is supported by a Junior Faculty Development Award from the American College of Gastroenterology and IBD Plexus of the Crohn’s and Colitis Foundation. M.A.P. is supported by the Rheumatology Research Foundation. M.A.C. is supported by R01DK109384 and the Lawrence C. Pakula MD IBD Innovation Fund and Pfizer (IIS #61798927). G.F.W. is supported by the NINDS (R01NS106289) and the National Multiple Sclerosis Society (RG-1802-30253). M.C.N. and L.S.G. are supported by the San Francisco Veterans Health Care System. J.A.O., R.M.P., and A.H.E. are supported by NIAID Collaborative Influenza Vaccine Innovation Centers contract 75N93019C00051. A.H.E. is supported by NIAID grant U01AI141990, NIAID Centers of Excellence for Influenza Research and Surveillance contracts HHSN272201400006C and HHSN272201400008C, and NIAID Collaborative Influenza Vaccine Innovation Centers contract 75N93019C00051. A.H.J.K. is supported by the Rheumatology Research Foundation, NIH/NIAMS P30 AR073752, and PCORI SDM2017C28224.

Competing Interests

P.D. participated in consulting, advisory board, or speaker’s bureau for Janssen, Pfizer, Prometheus Biosciences, Boehringer Ingelheim, AbbVie, and Arena Pharmaceuticals and received funding under a sponsored research agreement unrelated to the data in the paper from Takeda Pharmaceutical, Arena Pharmaceuticals, Bristol Myers Squibb-Celgene, and Boehringer Ingelheim. M.A.C. participated in consulting, advisory board, or speaker’s bureau for AbbVie, Pfizer, Bristol Myers Squibb, and Theravance, and received funding under a sponsored research agreement unrelated to the data in the paper from Incyte, Pfizer, Janssen, and the Crohn’s and Colitis Foundation. G.F.W. received honoraria for consulting for Novartis and Genentech and funding under a sponsored research agreement unrelated to the data in the paper from Biogen, EMD Serono, and Roche. The S.P.J.L. laboratory received funding under a sponsored research agreement unrelated to the data in the paper from Vir Biotechnology, AbbVie, and SAb therapeutics. L.S.G. received honoraria for consulting for AbbVie, Eli Lilly, Gilead, Janssen, Novartis, Pfizer, and UCB received funding under a sponsored research agreement unrelated to the data in the paper from Pfizer and UCB. The A.H.E. laboratory received funding under a sponsored research agreement unrelated to the data in the paper from Emergent BioSolutions and Abbvie. A.H.J.K. participated in consulting, advisory board, or speaker’s bureau for Alexion Pharmaceuticals, Aurinia Pharmaceuticals, Annexon Biosciences, Exagen Diagnostics, Inc., and GlaxoSmithKline and received funding under a sponsored research agreement unrelated to the data in the paper from GlaxoSmithKline. All other authors declare no competing interests.

Contributor Information

Parakkal Deepak, Inflammatory Bowel Diseases Center, Division of Gastroenterology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Wooseob Kim, Division of Immunobiology, Department of Pathology and Immunology, Washington University School of Medicine, St. Louis, MO, USA

Michael A. Paley, Division of Rheumatology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Monica Yang, Division of Rheumatology, Department of Medicine, University of California San Francisco, San Francisco, CA, USA

Alexander B. Carvidi, Division of Rheumatology, Department of Medicine, University of California San Francisco, San Francisco, CA, USA

Alia A. El-Qunni, Division of Rheumatology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Alem Haile, Clinical Trials Unit, Washington University School of Medicine, St. Louis, MO, USA

Katherine Huang, Division of Gastroenterology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Baylee Kinnett, Division of Gastroenterology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Mariel J. Liebeskind, Department of Genetics, Washington University School of Medicine, St. Louis, MO, USA

Zhuoming Liu, Department of Molecular Microbiology, Washington University School of Medicine, St. Louis, MO, USA

Lily E. McMorrow, Division of Rheumatology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Diana Paez, Division of Rheumatology, Department of Medicine, University of California San Francisco, San Francisco, CA, USA

Dana C. Perantie, Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA

Rebecca E. Schriefer, Division of Rheumatology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Shannon E. Sides, Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA

Mahima Thapa, Division of Immunobiology, Department of Pathology and Immunology, Washington University School of Medicine, St. Louis, MO, USA

Maté Gergely, Division of Gastroenterology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Suha Abushamma, Division of Gastroenterology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Michael Klebert, Division of Infectious Diseases, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Lynne Mitchell, Division of Rheumatology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Darren Nix, Division of Gastroenterology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Jonathan Graf, Division of Rheumatology, Department of Medicine, University of California San Francisco, San Francisco, CA, USA

Kimberly E. Taylor, Division of Rheumatology, Department of Medicine, University of California San Francisco, San Francisco, CA, USA

Salim Chahin, Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA

Matthew A. Ciorba, Inflammatory Bowels Diseases Center, Division of Gastroenterology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Patricia Katz, Division of Rheumatology, Department of Medicine, University of California San Francisco, San Francisco, CA, USA

Mehrdad Matloubian, Division of Rheumatology, Department of Medicine, University of California San Francisco, San Francisco, CA, USA

Jane A. O’Halloran, Division of Infectious Diseases, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Rachel M. Presti, Division of Infectious Diseases, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA

Gregory F. Wu, Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA; Division of Immunobiology, Department of Pathology and Immunology, Washington, University School of Medicine, St. Louis, MO, USA; The Andrew M. and Jane M. Bursky Center for Human Immunology and Immunotherapy Programs, Washington University School of Medicine, St. Louis, MO, USA

Sean P.J. Whelan, Department of Molecular Microbiology, Washington University School of Medicine, St. Louis, MO, USA

William J. Buchser, Department of Genetics, Washington University School of Medicine, St. Louis, MO, USA

Lianne S. Gensler, Division of Rheumatology, Department of Medicine, University of California San Francisco, San Francisco, CA, USA; Arthritis/Immunology Section, San Francisco Veterans Administration Health Care System, San Francisco, CA, USA

Mary C. Nakamura, Division of Rheumatology, Department of Medicine, University of California San Francisco, San Francisco, CA, USA; Arthritis/Immunology Section, San Francisco Veterans Administration Health Care System, San Francisco, CA, USA

Ali H. Ellebedy, Division of Immunobiology, Department of Pathology and Immunology, Washington University School of Medicine, St. Louis, MO, USA; The Andrew M. and Jane M. Bursky Center for Human Immunology and Immunotherapy Programs, Washington University School of Medicine, St. Louis, MO, USA

Alfred H.J. Kim, Division of Rheumatology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA; Division of Immunobiology, Department of Pathology and Immunology, Washington University School of Medicine, St. Louis, MO, USA; The Andrew M. and Jane M. Bursky Center for Human Immunology and Immunotherapy Programs, Washington University School of Medicine, St. Louis, MO, USA

REFERENCES

  • 1.Polack FP, Thomas SJ, Kitchin N, et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine. N Engl J Med 2020;383:2603–15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Baden LR, El Sahly HM, Essink B, et al. Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N Engl J Med 2021;384:403–16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Sadoff J, Le Gars M, Shukarev G, et al. Interim Results of a Phase 1–2a Trial of Ad26.COV2.S Covid-19 Vaccine. N Engl J Med 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Voysey M, Clemens SAC, Madhi SA, et al. Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: an interim analysis of four randomised controlled trials in Brazil, South Africa, and the UK. Lancet 2021;397:99–111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Singh JA, Saag KG, Bridges SL Jr., et al. 2015 American College of Rheumatology Guideline for the Treatment of Rheumatoid Arthritis. Arthritis Rheumatol 2016;68:1–26. [DOI] [PubMed] [Google Scholar]
  • 6.Singh JA, Guyatt G, Ogdie A, et al. Special Article: 2018 American College of Rheumatology/National Psoriasis Foundation Guideline for the Treatment of Psoriatic Arthritis. Arthritis Care Res (Hoboken) 2019;71:2–29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Hahn BH, McMahon MA, Wilkinson A, et al. American College of Rheumatology guidelines for screening, treatment, and management of lupus nephritis. Arthritis Care Res (Hoboken) 2012;64:797–808. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Rae-Grant A, Day GS, Marrie RA, et al. Practice guideline recommendations summary: Disease-modifying therapies for adults with multiple sclerosis: Report of the Guideline Development, Dissemination, and Implementation Subcommittee of the American Academy of Neurology. Neurology 2018;90:777–88. [DOI] [PubMed] [Google Scholar]
  • 9.Chang JT. Pathophysiology of Inflammatory Bowel Diseases. N Engl J Med 2020;383:2652–64. [DOI] [PubMed] [Google Scholar]
  • 10.Brenner EJ, Ungaro RC, Gearry RB, et al. Corticosteroids, But Not TNF Antagonists, Are Associated With Adverse COVID-19 Outcomes in Patients With Inflammatory Bowel Diseases: Results From an International Registry. Gastroenterology 2020; 159:481–91.e3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Strangfeld A, Schäfer M, Gianfrancesco MA, et al. Factors associated with COVID-19-related death in people with rheumatic diseases: results from the COVID-19 Global Rheumatology Alliance physician-reported registry. Ann Rheum Dis 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Day AL, Winthrop KL, Curtis JR. The effect of disease-modifying antirheumatic drugs on vaccine immunogenicity in adults. Cleve Clin J Med 2020;87:695–703. [DOI] [PubMed] [Google Scholar]
  • 13.Kennedy NA, Goodhand JR, Bewshea C, et al. Anti-SARS-CoV-2 antibody responses are attenuated in patients with IBD treated with infliximab. Gut 2021. [DOI] [PubMed] [Google Scholar]
  • 14.Siegel CA, Melmed GY, McGovern DP, et al. SARS-CoV-2 vaccination for patients with inflammatory bowel diseases: recommendations from an international consensus meeting. Gut 2021;70:635–40. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.American College of Rheumatology: COVID-19 Vaccine Clinical Guidance Summary for Patients with Rheumatic and Musculoskeletal Diseases. Atlanta, GA: Approved by the ACR Board of Directors on February 8, 2021, and updated on March 4, 2021. (https://www.rheumatology.org/Portals/0/Files/COVID-19-Vaccine-Clinical-Guidance-Rheumatic-Diseases-Summary.pdf.). [Google Scholar]
  • 16.National Psoriasis Foundation: COVID-19 Task Force Guidance Statements. Portland, OR: Updated on April 1, 2021. (https://www.psoriasis.org/covid-19-task-force-guidance-statements/.). [Google Scholar]
  • 17.Boyarsky BJ, Werbel WA, Avery RK, et al. Immunogenicity of a Single Dose of SARS-CoV-2 Messenger RNA Vaccine in Solid Organ Transplant Recipients. Jama 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Geisen UM, Berner DK, Tran F, et al. Immunogenicity and safety of anti-SARS-CoV-2 mRNA vaccines in patients with chronic inflammatory conditions and immunosuppressive therapy in a monocentric cohort. Ann Rheum Dis 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Wong S-Y, Dixon R, Pazos VM, Gnjatic S, Colombel J-F, Cadwell K. Serological response to COVID-19 vaccination in IBD patients receiving biologics. medRxiv 2021:2021.03.17.21253848. [Google Scholar]
  • 20.Ellebedy A, Turner J, Kim W, et al. SARS-CoV-2 infection induces long-lived bone marrow plasma cells in humans. Res Sq 2020. [DOI] [PubMed] [Google Scholar]
  • 21.Case JB, Rothlauf PW, Chen RE, et al. Neutralizing Antibody and Soluble ACE2 Inhibition of a Replication-Competent VSV-SARS-CoV-2 and a Clinical Isolate of SARS-CoV-2. Ssrn 2020:3606354. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Liu Z, VanBlargan LA, Bloyet LM, et al. Identification of SARS-CoV-2 spike mutations that attenuate monoclonal and serum antibody neutralization. Cell Host Microbe 2021;29:477–88.e4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Kennedy NA, Lin S, Goodhand JR, et al. Infliximab is associated with attenuated immunogenicity to BNT162b2 and ChAdOx1 nCoV-19 SARS-CoV-2 vaccines. medRxiv 2021:2021.03.25.21254335. [DOI] [PubMed] [Google Scholar]
  • 24.van Assen S, Holvast A, Benne CA, et al. Humoral responses after influenza vaccination are severely reduced in patients with rheumatoid arthritis treated with rituximab. Arthritis Rheum 2010;62:75–81. [DOI] [PubMed] [Google Scholar]
  • 25.Crnkic Kapetanovic M, Saxne T, Jonsson G, Truedsson L, Geborek P. Rituximab and abatacept but not tocilizumab impair antibody response to pneumococcal conjugate vaccine in patients with rheumatoid arthritis. Arthritis Res Ther 2013;15:R171. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Cartron G, Dacheux L, Salles G, et al. Therapeutic activity of humanized anti-CD20 monoclonal antibody and polymorphism in IgG Fc receptor FcgammaRIIIa gene. Blood 2002;99:754–8. [DOI] [PubMed] [Google Scholar]
  • 27.Khayat-Khoei M, Conway S, Rubinson DA, Jarolim P, Houtchens MK. Negative anti-SARS-CoV-2 S antibody response following Pfizer SARS-CoV-2 vaccination in a patient on ocrelizumab. J Neurol 2021:1–3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Bar-Or A, Calkwood JC, Chognot C, et al. Effect of ocrelizumab on vaccine responses in patients with multiple sclerosis: The VELOCE study. Neurology 2020;95:e1999–e2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Borba EF, Saad CG, Pasoto SG, et al. Influenza A/H1N1 vaccination of patients with SLE: can antimalarial drugs restore diminished response under immunosuppressive therapy? Rheumatology (Oxford) 2012;51:1061–9. [DOI] [PubMed] [Google Scholar]
  • 30.Battafarano DF, Battafarano NJ, Larsen L, et al. Antigen-specific antibody responses in lupus patients following immunization. Arthritis Rheum 1998;41:1828–34. [DOI] [PubMed] [Google Scholar]
  • 31.Aytac MB, Kasapcopur O, Aslan M, Erener-Ercan T, Cullu-Cokugras F, Arisoy N. Hepatitis B vaccination in juvenile systemic lupus erythematosus. Clin Exp Rheumatol 2011;29:882–6. [PubMed] [Google Scholar]
  • 32.Hanania NA, Sockrider M, Castro M, et al. Immune response to influenza vaccination in children and adults with asthma: effect of corticosteroid therapy. J Allergy Clin Immunol 2004;113:717–24. [DOI] [PubMed] [Google Scholar]
  • 33.Elkayam O, Bashkin A, Mandelboim M, et al. The effect of infliximab and timing of vaccination on the humoral response to influenza vaccination in patients with rheumatoid arthritis and ankylosing spondylitis. Semin Arthritis Rheum 2010;39:442–7. [DOI] [PubMed] [Google Scholar]
  • 34.Kuruma KA, Borba EF, Lopes MH, de Carvalho JF, Bonfá E. Safety and efficacy of hepatitis B vaccine in systemic lupus erythematosus. Lupus 2007;16:350–4. [DOI] [PubMed] [Google Scholar]
  • 35.Rodda LB, Netland J, Shehata L, et al. Functional SARS-CoV-2-specific immune memory persists after mild COVID-19. Res Sq 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Grifoni A, Weiskopf D, Ramirez SI, et al. Targets of T Cell Responses to SARS-CoV-2 Coronavirus in Humans with COVID-19 Disease and Unexposed Individuals. Cell 2020; 181:1489–501.e15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Prendecki M, Clarke C, Brown J, et al. Effect of previous SARS-CoV-2 infection on humoral and T-cell responses to single-dose BNT162b2 vaccine. Lancet 2021;397:1178–81. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Widge AT, Rouphael NG, Jackson LA, et al. Durability of Responses after SARS-CoV-2 mRNA-1273 Vaccination. N Engl J Med 2021;384:80–2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Dan JM, Mateus J, Kato Y, et al. Immunological memory to SARS-CoV-2 assessed for up to 8 months after infection. Science 2021;371. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Chen RE, Zhang X, Case JB, et al. Resistance of SARS-CoV-2 variants to neutralization by monoclonal and serum-derived polyclonal antibodies. Nat Med 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement 1
media-1.docx (11.8MB, docx)

Articles from medRxiv are provided here courtesy of Cold Spring Harbor Laboratory Preprints

RESOURCES