Skip to main content
Scientific Reports logoLink to Scientific Reports
. 2020 Apr 30;10:7396. doi: 10.1038/s41598-020-63998-2

Intranasal immunization with outer membrane vesicle pertussis vaccine confers broad protection through mucosal IgA and Th17 responses

René H M Raeven 1,, Dedeke Rockx-Brouwer 1, Gaurav Kanojia 1, Larissa van der Maas 1, Tim H E Bindels 1, Rimko ten Have 1, Elly van Riet 1, Bernard Metz 1, Gideon F A Kersten 1,2
PMCID: PMC7192948  PMID: 32355188

Abstract

A vaccine based on outer membrane vesicles of pertussis (omvPV) is protective in a mouse-challenge model and induces a broad antibody and mixed Th1/Th2/Th17 response against multiple antigens following subcutaneous immunization. However, this route did not result in mucosal immunity and did not prevent nasopharyngeal colonization. In this study, we explored the potential of intranasal immunization with omvPV. Only intranasal immunization induced strong mucosal immune responses that encompasses enhanced pulmonary and nasal IgA antibody levels, mainly directed against Vag8 and LPS. Furthermore, high numbers of IgA- and IgG-producing plasma cells were detected as well as lung-resident IgA memory B-cells. Finally, only intranasal immunization induced pulmonary Th1/Th17-related cytokine responses. The magnitude and type of systemic immunity was comparable between both routes and included high systemic IgG antibody levels, strong IgG-producing plasma cell responses, memory B-cells residing in the spleen and systemic Th1/Th2/Th17-related cytokine responses. Importantly, only intranasal immunization prevented colonization in both the lungs and the nasal cavity. In conclusion, intranasal omvPV immunization induces mucosal IgA and Th17-mediated responses without influencing the systemic immunity profile. These responses resulted in prevention of Bordetella pertussis colonization in the respiratory tract, including the nasal cavity, thereby potentially preventing transmission.

Subject terms: Vaccines, Mucosal immunology, Bacterial infection

Introduction

Immunization against the respiratory pathogen Bordetella pertussis resulted in a dramatic worldwide decrease of whooping cough cases1. However, the current pertussis resurgence occurs even in the vaccinated population, indicating that current pertussis vaccines or vaccination strategies should be improved2,3. Prolonged immunity is an important aspect for new pertussis vaccines as rapid waning of immunity is a major issue of current acellular pertussis vaccines (aPV)4. Moreover, it was demonstrated in baboons that aPV immunization prevents against disease but does not protect against transmission of B. pertussis to other baboons5. Nasopharyngeal carriage of B. pertussis in vaccinated individuals could be a potential cause for continuous spread by transmission6. Therefore, reducing nasal carriage by immunization is an important goal to prevent transmission and lowering the risk of exposure especially to unvaccinated individuals. Induction of mucosal immunity in the respiratory tract and particularly in the nasal cavity could assist preventing nasal colonization by B. pertussis and therefore reducing the chance of transmission7. B. pertussis infections induce powerful mucosal immunoglobulin A (IgA) and T helper (Th) type 17-mediated responses and prevent colonization in the complete respiratory tract upon reinfection8,9. In addition, the immune response after intranasal immunization with the live-attenuated pertussis vaccine BPZE1 is also characterized by Th17 and IgA responses and this vaccine diminishes the capability of B. pertussis to colonize the nose10. Mucosal immunity might therefore be an important mechanism to prevent nasal carriage and reduce the risk for transmission7.

Pertussis outer membrane vesicles (omvPV) are currently developed as a non-replicating vaccine candidate11 that provides protection against a B. pertussis infection in mice after intraperitoneal12 and subcutaneous immunization13. The protective immune response is characterized by a mixed Th1/2/17 response1315 and a broad antibody response against multiple antigens such as Bordetella resistance to killing (BrkA), pertactin (Prn), autotransporter Vag8 and lipopolysaccharide (LPS)16, which are antigens that were all demonstrated to have protective capacity1720. However, despite the excellent induction of systemic responses by systemic omvPV immunization, nasal carriage is not diminished. We recently showed that omvPV can be administrated directly in the respiratory tract leading to faster bacterial clearance from the lungs compared to subcutaneous immunization15,21. Pulmonary immunization also resulted in mucosal Th17 cells and IgA that were not present after subcutaneous immunization. In addition, pulmonary immunization evoked elevated systemic immunoglobulin G (IgG) antibody levels, IgG-producing plasma cells, memory B-cells, and Th17 cells as compared to subcutaneous immunization. While these data revealed the benefits of pulmonary over subcutaneous immunization with omvPV, the feasibility of pulmonary immunization is more challenging in terms of dose delivery, especially in the deeper lung area. Moreover, complete bacterial clearance from the nasal cavity was not achieved with pulmonary immunization. Intranasal immunization could serve as an alternative as the nasal cavity, the natural entrance site for pertussis, is an excellent site for vaccine delivery22 that would allow easier administration and could serve as a more efficient immunization site. Roberts et al. previously demonstrated that intranasal omvPV immunization leads to protection against a B. pertussis infection in the lungs12. However, the profiling of immune responses following intranasal immunization in a direct comparison with subcutaneous immunization are not yet reported in literature. In the current study, we investigated whether intranasal immunization with our omvPV concept provides protection against a B. pertussis infection, and in particular against nasal carriage. Additionally, systemic and mucosal antibody, B-cell and T-cell responses were studied to explore the underlying type of immunity.

Materials and Methods

Ethics statement

The animal experiment was carried out in accordance with the guidelines provided by the Dutch Act on Animal Experimentation. The animal experiment was approved by a local and independent ethical committee for animal experimentation of the Institute for Translational Vaccinology (Intravacc, Bilthoven, The Netherlands).

Immunization and challenge of mice

In a single experiment, 20 female, 8-week old BALB/c mice (Harlan, The Netherlands) were immunized twice (day 0 and 28) with 4 µg total protein omvPV for both administration routes, either administered via the intranasal (10 µL per nostril, total 20 µL), or subcutaneous route (300 µL) (Fig. 1). The B. pertussis challenge with the B1917 strain (2 × 10E5 colony forming units (CFU)) of immunized and naive mice (n = 4 per group, per time point) was performed on day 56 as described previously15.

Figure 1.

Figure 1

Study design. BALB/c mice (20 per group) were immunized with 4 µg outer membrane vesicle pertussis vaccine (omvPV) by the intranasal (IN; red) or subcutaneous (SC; blue) route on days 0 and 28. Subsequently, for both routes the vaccination-induced responses were characterized at day 35 and 56 (n = 6). Subsequently, a B. pertussis challenge (2 × 105 colony-forming units (CFUs)) was performed on day 56 in both vaccinated groups and naive mice (green) after which the level of protection was assessed in the respiratory tract on day 57 and 62 (n = 4).

Sample collection

For immunological assays, mice were sacrificed at day 35 for analysis of plasma cells (n = 6 per group) and at day 56 for analysis of antibody, memory B-cell and T-helper responses (n = 6 per group). For colonization assays, mice were sacrificed at day 1 and day 6 post-challenge (n = 4 per group, per time point). Mice were anesthetized (isoflurane/oxygen) for orbital blood collection and sacrificed by cervical dislocation. (I) Serum for antibody detection was obtained by collecting whole blood in a serum collection tube (MiniCollect 0.8 mL Z Serum Sep GOLD, Greiner). After coagulation (10 min., room temperature), sera were collected by centrifugation (10 min., 3000 g), aliquoted and stored at −80 °C. (II) Whole blood for B-cell assays was collected in heparinized tubes (MiniCollect 1 mL LH, Greiner, Austria) after which erythrocytes were lysed using RBC lysis buffer (Pharm Lyse, BD). (III) Lungs and trachea for colonization assays were homogenized in 900 µL THIJS medium23 using a Bio-Gen PRO200 Homogenizer (Pro Scientific Inc., Oxford, USA). (IV) Nasal lavages for colonization assays were obtained by flushing the nose with 1 mL THIJS medium supplemented with 40 μg/mL cephalexin. (V) For B- and/or T-cell assays, complete lungs and spleens were collected in 5 mL RPMI complete medium (RPMI-1640 medium (Gibco) supplemented with 10% FCS (Hyclone), 100 units penicillin, 100 units streptomycin and 2.92 mg/mL L-glutamine (Invitrogen)) and homogenized using a 70-μm cell strainer (BD Falcon, BD Biosciences) by using a previously described protocol15. Spleen and lung tissue homogenates were treated with home-made lysis buffer (10 g/L NH4CL, 1.25 g/L NaHCO3, 0.125 mM EDTA in H20; pH 7.4) to lyse erythrocytes. (VI) Lung homogenates and nasal lavages were sterile filtered with a 0.22 µm filter (Millex-GV, Millipore) and subsequently used for antibody detection at mucosal sites.

Colonization assays

Lung and trachea homogenates and nose lavages collected at day 1 and day 6 post-challenge were serially diluted (undiluted, 1:10, 1:100, and 1:1000 depending on organ type) in THIJS medium. Subsequently, 100 µL of each sample was plated on Bordet-Gengou agar plates with 15% sheep blood (BD, The Netherlands) and incubated for 5 days at 35 °C. The number of CFU/mL was determined using a colony counter (ProtoCOL, Synbiosis, Cambridge, UK). The limit of detection for this method is 10 CFU/mL.

Multiplex immunoassay (MIA) for antibody measurements

Antibodies against outer membrane vesicles (OMV), BrkA, fimbriae (Fim) 2/3, filamentous hemagglutinin (FHA), Prn, pertussis toxin (Ptx), and an autotransporter (Vag8) were measured using a MIA as described previously15. Serum samples were diluted 1:2000 for anti-OMV IgG and 1:100 for IgG (subclass) and IgA measurements. For measuring IgA levels, lung lysates were ten times diluted while nasal lavages were left undiluted. Data was acquired with a Bio-Plex 200, processed using Bio-Plex Manager software (v5.0, Bio-Rad Laboratories), and presented as fluorescence intensities (FI). The limit of detection of each analyte was set at 3x the background signal as detected in non-immunized mice.

Western blotting for antibody profiling

The antibody profiling using SDS-PAGE and Western blotting to characterize serum IgG, pulmonary IgA and nasal IgA to identify immunogenic proteins was performed as described previously21. The antigen identification of immunogenic antigens was not done in this study but obtained from a previous study16. Two lanes containing a marker and a B. pertussis lysate were cut in pairs after the SDS-PAGE and blotting. These strips were incubated with individual samples. All blots were scanned at the same intensity. The markers were used to align the blots from different groups with each other. Subsequently, the marker of each blot was cropped off and only the blot on the lysate is depicted in the figures.

B-cell ELISpot for plasma and memory B-cells

For analysis of memory B-cells, splenocytes and lung cells were stimulated (5 × 10E5 cells per well, 24-well plate; 5 days, 37 °C) with 10 μg/mL CpG ODN 1826 (Invivogen, San Diego, CA), 10 μg/mL pokeweed mitogen (Sigma-Alderich, Zwijndrecht, The Netherlands), and Staphylococcus aureus protein A of Cowan Strain (1:5000; Sigma) in RPMI complete medium with β-mercaptoethanol (1:25000; Sigma) to induce differentiation into antibody secreting cells24. The percentage of OMV specific antibody secreting cells were subsequently determined by ELISpot. The numbers of OMV-specific IgG- and IgA-producing plasma cells in blood, spleen and lungs were directly determined using the same ELISpot method, with 10 µg/mL wildtype B1917 OMV as coat, as described before15. Spots were counted with an AID iSpot reader (Autoimmun Diagnostika, Strassberg, Germany) and indicated as antibody-secreting cells per 5 × 10E5 cells.

Cell stimulation and MIA for T-helper (Th) cytokine analysis

The single-cell suspension obtained from lungs and spleen was stimulated for 3 days with OMV (1.5 μg/mL) to induce cytokine production after which the supernatant was collected. The concentration of T-helper-related cytokines interleukin-4 (IL-4), IL-5, IL-10, IL-13, IL-17A, TNF-α and IFN-γ was determined in the supernatants using a ProcartaPlex Mix&Match Mouse 7-Plex (ThermoFisher). Data was acquired with a Bio-Plex 200 (Bio-Rad) and analyzed using Bio-Plex Manager software (v 5.0, Bio-Rad). Results were corrected for the background with an unstimulated control per mouse stimulation per cytokine and calculated in pg/mL. Statistical analysis was only performed on results where the average cytokine production per group was ≥2x altered in immunized groups compared to the naive group.

Statistics

Data from antibody, cytokine, and colonization assays were log-transformed and statistically tested using a t-test. Significance of inter-group differences for B-cell ELISpot analysis was determined using a Mann-Whitney t-test. Significant p-values are indicated by *p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001.

Results

Bacterial clearance from respiratory tract

Protection against B. pertussis colonization of the respiratory tract was studied in mice that were immunized intranasally or subcutaneously with an omvPV. This was done by counting the number of viable bacteria, i.e. colony-forming units (cfu) in the lungs, trachea and nose on day 1 and day 6 post-challenge (p.c.) with B. pertussis (Fig. 2). The lungs, trachea and nose of naive mice were heavily colonized on day 1 after the B. pertussis challenge and the number of bacteria further increased on day 6 p.c., indicating successful colonization (Fig. 2A–C). In contrast, in the lungs and trachea of IN-mice, no cfu could be detected on both day 1 and day 6 p.c., whereas the lungs of SC-mice were not cleared 1-day p.c. (Fig. 2A,B). In the nose, only IN-mice were free of viable B. pertussis bacteria, whereas the mice in other groups showed presence of bacteria in the nasal lavages. However, the numbers of bacteria in the noses of SC-mice were lower compared to naive mice indicating some vaccine-induced protection (Fig. 2C). These results indicate that both subcutaneous and intranasal immunization with an omvPV enable faster bacterial clearance following a B. pertussis infection compared to non-immunized animals. However, full protection against colonization at all sites of the respiratory tract was observed with intranasal immunization.

Figure 2.

Figure 2

Colonization of the respiratory tract by B. pertussis. Naive and vaccinated mice were challenged with B. pertussis (2 × 105 cfu) on day 56 and the number of cfu/ml were subsequently determined on day 1 (d57) and day 6 (d62) post-challenge (p.c.) in (A) lungs, (B) trachea, and (C) nasal lavages (mean with SEM and individual samples). The limit of detection (10 CFU/mL (Log1)) is depicted as horizontal dashed line. Significant differences are indicated by *p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001 obtained using a t-test after log-transformation of data. NS = not significant.

Mucosal humoral responses

Mucosal humoral responses were investigated by analyzing (I) anti-OMV IgA-secreting plasma cells, (II) IgA memory B-cells and (III) IgA responses in the lungs, nasal wash and blood (Fig. 3A–F). IN-mice generated a significantly higher number of IgA-secreting plasma cells in the spleen, lung and blood compared to naive or SC-mice (Fig. 3A). Numbers of IgA memory B-cells in the lungs were significantly higher in IN-mice compared to SC-mice or naive mice, but there was no significant difference in the spleen (Fig. 3B). The levels of IgA antibodies directed against Ptx, Prn, FHA, Fim2/3, BrkA, Vag8 and OMV were determined in the lungs (Fig. 3C), nasal wash (Fig. 3D) and serum (Fig. 3E). Pulmonary IgA antibody levels directed against BrkA, Vag8 and OMV were significantly increased in IN-mice compared to SC-mice and naive mice (Fig. 3C). Nasal IgA antibody levels directed against FHA, Fim2/3, Vag8 and OMV were significantly increased in IN-mice compared to SC-mice and naive mice (Fig. 3D). In serum, only the anti-OMV IgA antibodies were significantly increased following intranasal immunization (Fig. 3E). Antibody profiling with Western blotting on a B. pertussis B1917 lysate demonstrated pulmonary and nasal IgA antibodies directed against LPS and Vag8 in the IN-mice but not in SC-mice or naive mice (Fig. 3F). The identity of these antigens was determined previously by mass spectrometry16. In addition, the pulmonary IgA of the IN-mice contained antibodies against three unidentified antigens (U1–3). These results indicate that the mucosal IgA humoral response was stronger after intranasal immunization as compared to subcutaneous immunization and that the IgA memory B-cells induced by intranasal immunization resided in the lungs.

Figure 3.

Figure 3

Mucosal humoral responses. (A) Numbers of OMV-specific IgA-secreting plasma cells in spleens, lungs and blood and (B) numbers of IgA memory cells, that were differentiated into antibody secreting cells (ASC), in spleens and lungs were determined by B-cell ELISpot of 6 mice per group at day 35 and day 56, respectively. Results are indicated as ASC per 5 × 105 cells. Levels of immunoglobulin A (IgA) antibodies directed against Ptx, Prn, FHA, Fim2/3, BrkA, Vag8 and OMV were determined in (C) lungs, (D) nasal wash and (E) serum of 6 mice per group. Results are expressed as fluorescence intensities (FI). (F) Immunoproteomic profiles of pooled (n = 6) pulmonary and nasal IgA were determined using Western blotting using the same scan intensity. In the box plots, the box represent 25th to 75th percentiles, whereas the bars indicate the minimum and maximum value. Horizontal dashed lines represent the limit of detection (background x 3). Significant differences are indicated by *p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001 obtained using a Mann-Whitney t-test (B-cells) and t-test (antibodies) after log-transformation of data.

Systemic humoral responses

Induction of systemic immune responses was determined by measuring (I) anti-OMV IgG-secreting cells, (II) IgG memory B-cells and (III) IgG (subclass) antibody responses. OMV-specific IgG plasma cells were detected in spleen, lungs and blood of all omvPV-immunized mice, whereas these cells were not detected in naive mice, 7 days after booster immunization (Fig. 4A). Intranasal immunization resulted in a significantly higher number of anti-OMV IgG-secreting plasma cells in the lungs compared to the numbers observed in SC-mice. No significant differences in numbers of anti-OMV IgG-secreting plasma cells were observed in blood and spleen between the two immunized groups (Fig. 4A). Increased numbers of OMV-specific IgG memory B-cells were found in the spleens of both immunized groups (Fig. 4B). In addition, the IN-mice contained significantly higher numbers of IgG memory B-cells in the lungs compared to both SC-mice and naive mice (Fig. 4B).

Figure 4.

Figure 4

Systemic humoral responses. (A) Numbers of OMV-specific IgG-secreting plasma cells in spleens, lungs and blood and (B) numbers of IgG memory cells in spleens and lungs were determined by B-cell ELISpot of 6 mice per group at day 35 and day 56, respectively. Results are indicated as antibody-secreting cells (ASC) per 5 × 105 cells. (C–H) Levels of (C) immunoglobulin G (IgG) antibodies and (E–H) IgG subclasses 1, 2a, 2b and 3 antibodies directed against Ptx, Prn, FHA, Fim2/3, BrkA, Vag8 and OMV were determined in serum of 6 mice per group. Results are expressed as fluorescence intensities (FI). (D) Western blot for antibody profiling with pooled (n = 6) serum IgG using B. pertussis B1917 lysate as antigen. The same scan intensity was applied to all blots. In the box plots, the box represent 25th to 75th percentiles, whereas the bars indicate the minimum and maximum value. Horizontal dashed lines represent the limit of detection (background x 3). Significant differences are indicated by *p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001 obtained using a Mann-Whitney t-test (B-cells) and t-test (antibodies) after log-transformation of data.

In serum, the levels of IgG antibodies directed against BrkA, FHA, Prn, OMV, and Vag8 were significantly enhanced in both omvPV-immunized groups, when compared to naive mice (Fig. 4C). The levels of IgG antibodies directed against BrkA were slightly higher in SC-mice compared to IN-mice. A Western blot of anti-sera against bacterial lysate to establish the antigen specificity revealed overall a similar IgG response in intensity and diversity of immunogenic proteins between IN- and SC-mice. However, only the SC-mice induced additional antibodies against GroEL and the unidentified antigens U2 and U7, while the IN-mice had higher antibody formation against antigen U1 and exclusive antibody production against antigen U3 (Fig. 4D). The identity of the identified immunogenic proteins was determined previously by mass spectrometry16. Both SC- and IN-mice induced a broad IgG subclass response. Significant levels of IgG1, IgG2a, IgG2b and IgG3 antibodies against a variety of antigens were detected in vaccinated mice (Fig. 4E–H). Of note, the anti-Prn IgG2a levels were significantly lower in SC-mice when compared to IN-mice. The anti-BrkA IgG1 levels and anti-FHA IgG3 were slightly higher in SC-mice when compared to IN-mice. These results reveal that both subcutaneous and intranasal immunization induce similar, but not identical, systemic immune responses as measured in blood and spleen, while intranasal immunization resulted in elevated presence of IgG-producing plasma and memory B-cells locally in the lungs.

Pulmonary and systemic T-helper cytokine responses

To determine the OMV-specific T-cell responses in spleens and lungs, cell suspensions from both organs were stimulated with OMVs for 3 days, after which concentrations of seven signature cytokines (IL-4, IL-5, IL-10, IL-13, IL-17A, TNF-α and IFN-γ) were determined in the supernatant by MIA (Fig. 5A,B). The Th17-related cytokine IL-17A was significantly increased in the supernatants of stimulated splenocytes and lung cells in both IN-mice and SC-mice compared to naive mice. This IL-17A production was however much higher in the IN-mice as compared to the SC-mice. The production of the Th1-related cytokine IFNγ was increased in lung cells of IN-mice compared to SC- or naive mice. In splenocytes, a similar increase in IFNγ production was observed in both IN- and SC-mice compared to naive mice. When looking at Th2-related cytokines, an increased IL-13 and IL-5 production was seen in the lungs of IN-mice that was absent in SC- and naive mice. In splenocytes, the Th2-related cytokines IL-4, IL-5 and IL-13 were significantly increased in SC- and IN-mice compared to naive mice. This IL-5 production was higher in SC-mice compared to IN-mice. Overall, these results demonstrate that both subcutaneous and intranasal immunization with omvPV result in a mixed Th1/Th2/Th17-related cytokine response, but that the intranasal immunization leads to additional induction of local Th1/Th17-related cytokine responses in the respiratory tract.

Figure 5.

Figure 5

T-helper cytokine profiles in splenocytes and lung cells. Concentrations of T-helper 1, 2 and 17-related cytokines were determined in supernatant after 3-day stimulation with OMV of (A) splenocytes and (B) lung cells. Results in pg/mL are corrected for the background level (IMDM complete medium control) and are given as mean±s.d. of 6 mice per group. Significant differences (≥2x alteration compared to naive group) are indicated by *p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001 obtained using a t-test after log-transformation of data.

Discussion

Current resurgence of pertussis, despite high vaccination coverage, occurs because protection induced by aPV is of limited duration25, is not effective against antigen-deficient (i.e. Prn-deficient) strains26,27 and fails to prevent B. pertussis transmission5. Therefore, the current focus for improving pertussis vaccines is on providing longer-lasting immunity, establishing adaptive immune responses against a broader range of antigens to increase the robustness of protection and prevention of transmission by reducing nasal carriage of B. pertussis.

Earlier we have shown that omvPV induces immune responses against a broad range of antigens, as well as a more Th1/Th17 and less Th2 biased response when administered subcutaneously or in the lungs13,15,16,21. In the current study, we compared intranasal and subcutaneous immunization with omvPV from the B1917 strain (summarized in Table 1). Both subcutaneous and intranasal administration induced a Th1/Th17 polarized response and a broad humoral response in terms of multiple subclasses and against several antigens that were proven to be protective, such as BrkA20,28, LPS17 and Vag818. These results indicate that the Th1/Th17 immune profile is related to omvPV, more than to the route of immunization. With respect to the antibody responses to these antigens, these were found to resemble antibody responses to natural B. pertussis infection in humans29,30 and mice16. These broad antibody responses induced by omvPV may provide protection through multiple antibody mechanisms such as opsonizing and bactericidal activity as well as prevention of bacterial adhesion31,32. However, the functionality of omvPV-induced IgG and IgA antibodies remains to be investigated.

Table 1.

Comparison of immunity profiles induced by subcutaneous and intranasal OMV immunization.

Naive Immunization route for omvPV Difference***
Intranasal Subcutaneous
Protection Lung clearance >6 days p.c. ++++ (<1 day p.c.) +++ (>1 day p.c.) +
Tracheal clearance >6 days p.c. ++++ (<1 day p.c.) ++++ (<1 day p.c.) 0
Nasal clearance >6 days p.c. ++++ (<1 day p.c.) ++ (>6 days p.c.) +++
Systemic immunity Antibodies
Serum IgG + +++ + +++ 0
Serum IgG1 ++++ ++++ +
Serum IgG2a ++++ +++ +
Serum IgG2b ++++ +++ +
Serum IgG3 +++ ++++
Serum IgA +++ +++
Serum IgG specificity* OMV, Vag8, BrkA, Prn, U1, U3, U4, U6, LPS OMV, Vag8, BrkA, Prn, GroEL, U1–2, U4–7, LPS 0
Plasma cells
IgG ASC Blood + + + + 0
IgG ASC Spleen ++ ++ 0
IgG ASC Lung ++++ ++ ++
Memory B-cells
IgG ASC Spleen + + + + 0
IgG ASC Lung ++ ++
T-helper related cytokine responses
Spleen Th1 + ++ + ++ 0
Spleen Th2 ++ ++ 0
Spleen Th17 ++++ +++ +
Mucosal immunity Antibodies
Pulmonary IgA ++++ + + ++
Nasal IgA ++++ + +++
Pulmonary IgA specificity* Vag8, LPS, U1–3 Vag8, +++
Nasal IgA specificity* LPS +++
Plasma cells
IgA ASC Blood + + + +
IgA ASC Spleen ++ ++
IgA ASC Lung ++++ ++++
Memory B-cells
IgA ASC Lung + ++ + ++
T-helper related cytokine responses
Pulmonary Th1 + ++ + +++
Pulmonary Th2 + +
Pulmonary Th17 ++++ + ++++

*Based on combined results of MIA and Western blotting. **Scale ranges from – (absent) to ++++ (highly present). ***Difference between intranasal and subcutaneous omvPV immunization. + to ++++ is advantage intranasal, 0 is no difference, is advantage subcutaneous.

With respect to protection against colonization of B. pertussis, subcutaneous vaccination induced partial protection, whereas intranasal administration of omvPV provided full protection in the complete respiratory tract upon challenge. This is in agreement with the fact that mucosal immune responses such as IgA antibodies and tissue-resident memory B- and T-cells have generally been shown to play an important role in eliminating pathogens locally3336. Also for pertussis vaccines, mucosal immunity may be beneficial to prevent transmission and limit residence time of the bacteria in the respiratory tract6,7. Intranasal immunization with experimental pertussis vaccines has been performed with multiple concepts such as a live-attenuated vaccine10,37, bacterium-like particles38, aPV with new adjuvants such as CpG39, LP-GMP40 or cholera toxin B41, omvPV from the Tohama strain12 and omvPV with detoxified LPS42. These studies demonstrate that intranasal immunization can prevent bacterial colonization in the respiratory tract in mice. Solans et al. demonstrated more specifically that the mechanism of their live-attenuated pertussis vaccine was depending partly on the induction of mucosal IgA responses and IL-17 producing tissue-resident memory T-cells10.

The profiling of underlying immune responses following omvPV immunization in the current study demonstrated that the most profound difference between intranasal and subcutaneous immunization was indeed the induction of strong mucosal responses (Table 1). Intranasal omvPV immunization provides strong mucosal IgA antibody responses against the potentially protective antigens Vag8 and LPS, and induces lung-resident memory B-cells (both IgA and IgG) and Th17-related cytokine responses. Local antigen encounter in the nasal cavity following intranasal immunization is required to evoke local responses such as memory B-cells43. Interestingly, despite administration at the outside of the mucosal barrier, intranasal omvPV immunization maintained a similar level of systemic IgG antibody levels, IgG-producing plasma cells, and spleen-resident memory B-cells as compared to subcutaneous omvPV immunization (Table 1). Both IgA-44 and Th1/Th17-mediated responses45 were previously identified as protective responses against B. pertussis. In line with intranasal omvPV immunization, similar mucosal IgA and Th17 responses were observed after a B. pertussis infection which provides excellent protection against a subsequent B. pertussis challenge8,9,46. Recent studies demonstrated that a B. pertussis infection also primes local innate immune cells, such as alveolar macrophages, M-cells and goblet cells46. These cells may also be induced by mucosal immunization with omvPV and could contribute to the faster bacterial clearance of the respiratory tract upon infection. Importantly, it was shown that an infection also induces tissue-resident T-cells in the lungs47. More research to whether these play a role in longevity of the memory response will be important for future research.

Previously, we demonstrated that induction of mucosal immunity and faster bacterial clearance from the lungs could be achieved through pulmonary administration of omvPV in both spray dried (reconstituted) and liquid form15,21. However, whereas the pulmonary immunization with omvPV led to significant reduction of B. pertussis in the nasal cavity, in the current study we demonstrated that intranasal immunization with omvPV provided complete B. pertussis clearance, also from the nasal cavity of mice. This difference cannot be explained by levels of nasal IgA, since these were similar and directed against the same antigens. In addition, in both cases pulmonary Th17 and IgA memory B-cells were detected21. However, possibly these administration routes result in qualitative differences in IgA, such as T-cell dependent versus independent induction, differences in the ratio of monomers, dimers and polymers or in levels and type of glycosylation of IgA antibodies, that can all affect IgA effector function. Alternatively, a head to head comparison could show whether the presence of local tissue-resident B- and T-cells in the nose could explain this difference.

In accordance with our previous findings15,21, the current study indicates that the intrinsic adjuvant activity present in the current form of the omvPV are suitable for inducing excellent systemic and mucosal immunity, obviating the need for additional adjuvants. In terms of safety, these intrinsic adjuvants may cause pyrogenicity. However, we observed earlier that systemic omvPV immunization induced less pro-inflammatory cytokines as compared to a whole-cell pertussis vaccine13. Due to the mucosal barrier, intranasal immunization may induce even less systemic side effects as compared to systemic immunization. However, to further lower endotoxic activity, an additional LPS modification can be inserted48. Insertion of the detoxified LPS, PagL, in an omvPV in combination with intranasal immunization did indeed further reduce pyrogenicity in mice42. Moreover, two studies reporting on safety in healthy individuals after intranasal immunization with vaccines against Shigella sonnei49 and Shigella flexneri50 based on outer membrane vesicles demonstrated that no serious adverse effects were observed. However, next to pyrogenicity, the local neurotoxic effects in the nose after intranasal omvPV immunization remain to be investigated clinically since this has been observed for E. coli heat-labile toxin adjuvanted influenza vaccine51. The cause of this neurotoxic effects were thought to be the combination of binding of de B subunit of LT to surface gangliosides (especially GM1) and inflammation associated with the A subunit. However, the use of the enzymatic A1 domain was shown to be safe and effective52.

With regard to human vaccination programs, the intranasal route offers a cost effective and patient friendly method for vaccine administration53. Our current findings could therefore justify further testing of different omvPV administration routes in other animal models such as baboons, as well as clinical trials and potentially in a human challenge model54. When used as a stand-alone booster, omvPV immunization could possibly reduce carriage of B. pertussis in the adult population, subsequently limiting the transmission to infants55. Additional research is needed to proof the hypothesis that intranasal administration might prevent carriage of B. pertussis. It would potentially even be more interesting when intranasal immunization with omvPV could be implemented as a primary vaccination to provide better protection against infection through induction of mucosal immunity and priming of children’s immune responses towards a more effective response56.

In conclusion, intranasal immunization of omvPV adds strong and broad mucosal IgA antibody responses, as well as lung-resident memory B-cells (both IgA and IgG) and Th17-related cytokine responses. This mucosal immunity is induced on top of the already promising systemic immune profile provided by subcutaneously administered omvPV that consists of a more Th1/Th17- and less Th2-related cytokine biased response and a broader antibody response (both subtypes and antigenicity) compared to aPV. Most importantly, intranasal administration prevented colonization of the lung, trachea and nose in the current study, which is important to prevent transmission, warranting further investigation in baboons or humans.

Supplementary information

Supplementary Information. (165.3KB, docx)

Author contributions

R.H.M.R., G.F.A.K., and B.M. conceived the experiments; R.H.M.R., D.R., G.K., L.M. and T.H.E.B. conducted the experiments; R.H.M.R., D.R., G.K., L.M. and T.H.E.B. analyzed the results; R.H.M.R. prepared all figures. R.H.M.R., D.R. and G.K. wrote the main manuscript; L.M., T.H.E.B., R.H., E.R., B.M. and G.F.A.K. reviewed the manuscript.

Data availability

The authors declare that the data supporting the findings of this study are available within the paper.

Competing interests

All authors were employed by Intravacc that at the time of submission of the manuscript was completely funded by the Dutch Government.

Footnotes

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

is available for this paper at 10.1038/s41598-020-63998-2.

References

  • 1.Pertussis vaccines: WHO position paper. Releve epidemiologique hebdomadaire / Section d’hygiene du Secretariat de la Societe des Nations = Weekly epidemiological record / Health Section of the Secretariat of the League of Nations85, 385–400 (2010). [PubMed]
  • 2.Libster R, Edwards KM. Re-emergence of pertussis: what are the solutions? Expert review of vaccines. 2012;11:1331–1346. doi: 10.1586/erv.12.118. [DOI] [PubMed] [Google Scholar]
  • 3.Martinon-Torres F, Heininger U, Thomson A, Wirsing von Konig CH. Controlling pertussis: how can we do it? A focus on immunization. Expert review of vaccines. 2018;17:289–297. doi: 10.1080/14760584.2018.1445530. [DOI] [PubMed] [Google Scholar]
  • 4.Burdin, N., Handy, L. K. & Plotkin, S. A. What Is Wrong with Pertussis Vaccine Immunity? The Problem of Waning Effectiveness of Pertussis Vaccines. Cold Spring Harb Perspect Biol9, 10.1101/cshperspect.a029454 (2017). [DOI] [PMC free article] [PubMed]
  • 5.Warfel JM, Zimmerman LI, Merkel TJ. Acellular pertussis vaccines protect against disease but fail to prevent infection and transmission in a nonhuman primate model. Proceedings of the National Academy of Sciences of the United States of America. 2014;111:787–792. doi: 10.1073/pnas.1314688110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Gill C, Rohani P, Thea DM. The relationship between mucosal immunity, nasopharyngeal carriage, asymptomatic transmission and the resurgence of Bordetella pertussis. F1000Res. 2017;6:1568. doi: 10.12688/f1000research.11654.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Solans L, Locht C. The Role of Mucosal Immunity in Pertussis. Frontiers in immunology. 2018;9:3068. doi: 10.3389/fimmu.2018.03068. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Warfel JM, Merkel TJ. Bordetella pertussis infection induces a mucosal IL-17 response and long-lived Th17 and Th1 immune memory cells in nonhuman primates. Mucosal immunology. 2013;6:787–796. doi: 10.1038/mi.2012.117. [DOI] [PubMed] [Google Scholar]
  • 9.Raeven RHM, et al. Molecular Signatures of the Evolving Immune Response in Mice following a Bordetella pertussis Infection. PloS one. 2014;9:e104548. doi: 10.1371/journal.pone.0104548. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Solans L, et al. IL-17-dependent SIgA-mediated protection against nasal Bordetella pertussis infection by live attenuated BPZE1. vaccine. Mucosal immunology. 2018;11:1753–1762. doi: 10.1038/s41385-018-0073-9. [DOI] [PubMed] [Google Scholar]
  • 11.Hozbor DF. Outer membrane vesicles: an attractive candidate for pertussis vaccines. Expert review of vaccines. 2017;16:193–196. doi: 10.1080/14760584.2017.1276832. [DOI] [PubMed] [Google Scholar]
  • 12.Roberts R, et al. Outer membrane vesicles as acellular vaccine against pertussis. Vaccine. 2008;26:4639–4646. doi: 10.1016/j.vaccine.2008.07.004. [DOI] [PubMed] [Google Scholar]
  • 13.Raeven RHM, et al. Bordetella pertussis outer membrane vesicle vaccine confers equal efficacy in mice with milder inflammatory responses compared to a whole-cell vaccine. Sci Rep. 2016;6:38240. doi: 10.1038/srep38240. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Bottero D, et al. Characterization of the immune response induced by pertussis OMVs-based vaccine. Vaccine. 2016;34:3303–3309. doi: 10.1016/j.vaccine.2016.04.079. [DOI] [PubMed] [Google Scholar]
  • 15.Raeven RHM, et al. Molecular and cellular signatures underlying superior immunity against Bordetella pertussis upon pulmonary vaccination. Mucosal immunology. 2018;11:979–993. doi: 10.1038/mi.2017.81. [DOI] [PubMed] [Google Scholar]
  • 16.Raeven RHM, et al. Immunoproteomic Profiling of Bordetella pertussis Outer Membrane Vesicle Vaccine Reveals Broad and Balanced Humoral Immunogenicity. Journal of proteome research. 2015;14:2929–2942. doi: 10.1021/acs.jproteome.5b00258. [DOI] [PubMed] [Google Scholar]
  • 17.Kubler-Kielb J, et al. Oligosaccharide conjugates of Bordetella pertussis and bronchiseptica induce bactericidal antibodies, an addition to pertussis vaccine. Proceedings of the National Academy of Sciences of the United States of America. 2011;108:4087–4092. doi: 10.1073/pnas.1100782108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Suzuki K, et al. Protective effects of in vivo-expressed autotransporters against Bordetella pertussis infection. Microbiol Immunol. 2017;61:371–379. doi: 10.1111/1348-0421.12504. [DOI] [PubMed] [Google Scholar]
  • 19.Weiss AA, Mobberley PS, Fernandez RC, Mink CM. Characterization of human bactericidal antibodies to Bordetella pertussis. Infection and immunity. 1999;67:1424–1431. doi: 10.1128/IAI.67.3.1424-1431.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Marr N, et al. Protective activity of the Bordetella pertussis BrkA autotransporter in the murine lung colonization model. Vaccine. 2008;26:4306–4311. doi: 10.1016/j.vaccine.2008.06.017. [DOI] [PubMed] [Google Scholar]
  • 21.Kanojia, G. et al. Development of a thermostable spray dried outer membrane vesicle pertussis vaccine for pulmonary immunization. J Control Release 286, 167–178, 10.1016/j.jconrel.2018.07.035 (2018). [DOI] [PubMed]
  • 22.Jabbal-Gill I. Nasal vaccine innovation. J. Drug Target. 2010;18:771–786. doi: 10.3109/1061186X.2010.523790. [DOI] [PubMed] [Google Scholar]
  • 23.Thalen M, et al. Rational medium design for Bordetella pertussis: basic metabolism. Journal of biotechnology. 1999;75:147–159. doi: 10.1016/S0168-1656(99)00155-8. [DOI] [PubMed] [Google Scholar]
  • 24.Crotty S, Aubert RD, Glidewell J, Ahmed R. Tracking human antigen-specific memory B cells: a sensitive and generalized ELISPOT system. J. Immunol Methods. 2004;286:111–122. doi: 10.1016/j.jim.2003.12.015. [DOI] [PubMed] [Google Scholar]
  • 25.Brummelman J, Wilk MM, Han WG, van Els CA, Mills KH. Roads to the development of improved pertussis vaccines paved by immunology. Pathogens and disease. 2015;73:ftv067. doi: 10.1093/femspd/ftv067. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Lam C, et al. Rapid increase in pertactin-deficient Bordetella pertussis isolates, Australia. Emerging infectious diseases. 2014;20:626–633. doi: 10.3201/eid2004.131478. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Etskovitz, H., Anastasio, N., Green, E. & May, M. Role of Evolutionary Selection Acting on Vaccine Antigens in the Re-Emergence of Bordetella Pertussis. Diseases7, 10.3390/diseases7020035 (2019). [DOI] [PMC free article] [PubMed]
  • 28.Oliver DC, Fernandez RC. Antibodies to BrkA augment killing of Bordetella pertussis. Vaccine. 2001;20:235–241. doi: 10.1016/S0264-410X(01)00269-9. [DOI] [PubMed] [Google Scholar]
  • 29.Hovingh ES, et al. Detection of opsonizing antibodies directed against a recently circulating Bordetella pertussis strain in paired plasma samples from symptomatic and recovered pertussis patients. Sci. Rep. 2018;8:12039. doi: 10.1038/s41598-018-30558-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Raeven RHM, et al. Antibody Specificity Following a Recent Bordetella pertussis Infection in Adolescence Is Correlated With the Pertussis Vaccine Received in Childhood. Frontiers in immunology. 2019;10:1364. doi: 10.3389/fimmu.2019.01364. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Tuomanen EI, Zapiain LA, Galvan P, Hewlett EL. Characterization of antibody inhibiting adherence of Bordetella pertussis to human respiratory epithelial cells. Journal of clinical microbiology. 1984;20:167–170. doi: 10.1128/JCM.20.2.167-170.1984. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Geurtsen, J., Fae, K. C. & van den Dobbelsteen, G. P. Importance of (antibody-dependent) complement-mediated serum killing in protection against Bordetella pertussis. Expert review of vaccines10, 1229–40, 10.1586/14760584.2014.944901 (2014). [DOI] [PubMed]
  • 33.Holmgren J, Czerkinsky C. Mucosal immunity and vaccines. Nature medicine. 2005;11:S45–53. doi: 10.1038/nm1213. [DOI] [PubMed] [Google Scholar]
  • 34.Mueller SN, Mackay LK. Tissue-resident memory T cells: local specialists in immune defence. Nature reviews. Immunology. 2016;16:79–89. doi: 10.1038/nri.2015.3. [DOI] [PubMed] [Google Scholar]
  • 35.Chiu C, Openshaw PJ. Antiviral B cell and T cell immunity in the lungs. Nature immunology. 2015;16:18–26. doi: 10.1038/ni.3056. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Park CO, Kupper TS. The emerging role of resident memory T cells in protective immunity and inflammatory disease. Nature medicine. 2015;21:688–697. doi: 10.1038/nm.3883. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Mielcarek N, et al. Live attenuated B. pertussis as a single-dose nasal vaccine against whooping cough. Plos pathogens. 2006;2:e65. doi: 10.1371/journal.ppat.0020065. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Shi W, et al. Novel intranasal pertussis vaccine based on bacterium-like particles as a mucosal adjuvant. Immunol Lett. 2018;198:26–32. doi: 10.1016/j.imlet.2018.03.012. [DOI] [PubMed] [Google Scholar]
  • 39.Asokanathan C, Corbel M, Xing D. A CpG-containing oligodeoxynucleotide adjuvant for acellular pertussis vaccine improves the protective response against Bordetella pertussis. Human vaccines & immunotherapeutics. 2013;9:325–331. doi: 10.4161/hv.22755. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Allen AC, et al. Sustained protective immunity against Bordetella pertussis nasal colonization by intranasal immunization with a vaccine-adjuvant combination that induces IL-17-secreting TRM. cells. Mucosal immunology. 2018;11:1763–1776. doi: 10.1038/s41385-018-0080-x. [DOI] [PubMed] [Google Scholar]
  • 41.Isaka M, et al. Mucosal and systemic antibody responses against an acellular pertussis vaccine in mice after intranasal co-administration with recombinant cholera toxin B subunit as an adjuvant. Vaccine. 2003;21:1165–1173. doi: 10.1016/S0264-410X(02)00516-9. [DOI] [PubMed] [Google Scholar]
  • 42.Asensio CJ, et al. Outer membrane vesicles obtained from Bordetella pertussis Tohama expressing the lipid A deacylase PagL as a novel acellular vaccine candidate. Vaccine. 2011;29:1649–1656. doi: 10.1016/j.vaccine.2010.12.068. [DOI] [PubMed] [Google Scholar]
  • 43.Allie SR, et al. The establishment of resident memory B cells in the lung requires local antigen encounter. Nature immunology. 2019;20:97–108. doi: 10.1038/s41590-018-0260-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Hellwig SM, van Spriel AB, Schellekens JF, Mooi FR, van de Winkel JG. Immunoglobulin A-mediated protection against Bordetella pertussis infection. Infection and immunity. 2001;69:4846–4850. doi: 10.1128/IAI.69.8.4846-4850.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Ross PJ, et al. Relative contribution of Th1 and Th17 cells in adaptive immunity to Bordetella pertussis: towards the rational design of an improved acellular pertussis vaccine. Plos pathogens. 2013;9:e1003264. doi: 10.1371/journal.ppat.1003264. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Raeven RHM, et al. Immunological Signatures after Bordetella pertussis Infection Demonstrate Importance of Pulmonary Innate Immune Cells. Plos one. 2016;11:e0164027. doi: 10.1371/journal.pone.0164027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Wilk MM, et al. Lung CD4 Tissue-Resident Memory T Cells Mediate Adaptive Immunity Induced by Previous Infection of Mice with Bordetella pertussis. J. Immunol. 2017;199:233–243. doi: 10.4049/jimmunol.1602051. [DOI] [PubMed] [Google Scholar]
  • 48.Zariri A, van der Ley P. Biosynthetically engineered lipopolysaccharide as vaccine adjuvant. Expert review of vaccines. 2015;14:861–876. doi: 10.1586/14760584.2015.1026808. [DOI] [PubMed] [Google Scholar]
  • 49.Launay O, et al. Safety Profile and Immunologic Responses of a Novel Vaccine Against Shigella sonnei Administered Intramuscularly, Intradermally and Intranasally: Results From Two Parallel Randomized Phase 1 Clinical Studies in Healthy Adult Volunteers in Europe. EBioMedicine. 2017;22:164–172. doi: 10.1016/j.ebiom.2017.07.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Fries LF, et al. Safety and immunogenicity of a proteosome-Shigella flexneri 2a lipopolysaccharide vaccine administered intranasally to healthy adults. Infection and immunity. 2001;69:4545–4553. doi: 10.1128/IAI.69.7.4545-4553.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Lewis DJ, et al. Transient facial nerve paralysis (Bell’s palsy) following intranasal delivery of a genetically detoxified mutant of Escherichia coli heat labile toxin. Plos one. 2009;4:e6999. doi: 10.1371/journal.pone.0006999. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Valli E, et al. LTA1 is a safe, intranasal enterotoxin-based adjuvant that improves vaccine protection against influenza in young, old and B-cell-depleted (muMT) mice. Sci. Rep. 2019;9:15128. doi: 10.1038/s41598-019-51356-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Birkhoff M, Leitz M, Marx D. Advantages of Intranasal Vaccination and Considerations on Device Selection. Indian Journal of Pharmaceutical Sciences. 2009;71:729–731. [Google Scholar]
  • 54.Merkel TJ, Halperin SA. Nonhuman primate and human challenge models of pertussis. The Journal of infectious diseases. 2014;209(Suppl 1):S20–23. doi: 10.1093/infdis/jit493. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Wendelboe AM, et al. Transmission of Bordetella pertussis to young infants. The Pediatric infectious disease journal. 2007;26:293–299. doi: 10.1097/01.inf.0000258699.64164.6d. [DOI] [PubMed] [Google Scholar]
  • 56.da Silva Antunes R, et al. Th1/Th17 polarization persists following whole-cell pertussis vaccination despite repeated acellular boosters. The Journal of clinical investigation. 2018;128:3853–3865. doi: 10.1172/JCI121309. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Information. (165.3KB, docx)

Data Availability Statement

The authors declare that the data supporting the findings of this study are available within the paper.


Articles from Scientific Reports are provided here courtesy of Nature Publishing Group

RESOURCES