Skip to main content
Springer logoLink to Springer
. 2023 Apr 19;46(5):439–448. doi: 10.1007/s40264-023-01295-3

Implications of Non-Specific Effects for Testing, Approving, and Regulating Vaccines

Christine Stabell Benn 1,2,, Nelly Amenyogbe 3, Anders Björkman 4, Jorge Domínguez-Andrés 5, Eleanor N Fish 6,7, Katie L Flanagan 8,9,10, Sabra L Klein 11, Tobias R Kollmann 3, Kirsten Ohm Kyvik 12, Mihai G Netea 5, Naja Hulvej Rod 13, Frederik Schaltz-Buchholzer 1, Frank Shann 14, Liisa Selin 15, Sanne M Thysen 16, Peter Aaby 1,17
PMCID: PMC10116894  PMID: 37074598

Abstract

The current framework for testing and regulating vaccines was established before the realization that vaccines, in addition to their effect against the vaccine-specific disease, may also have “non-specific effects” affecting the risk of unrelated diseases. Accumulating evidence from epidemiological studies shows that vaccines in some situations can affect all-cause mortality and morbidity in ways that are not explained by the prevention of the vaccine-targeted disease. Live attenuated vaccines have sometimes been associated with decreases in mortality and morbidity that are greater than anticipated. In contrast, some non-live vaccines have in certain contexts been associated with increases in all-cause mortality and morbidity. The non-specific effects are often greater for female than male individuals. Immunological studies have provided several mechanisms that explain how vaccines might modulate the immune response to unrelated pathogens, such as through trained innate immunity, emergency granulopoiesis, and heterologous T-cell immunity. These insights suggest that the framework for the testing, approving, and regulating vaccines needs to be updated to accommodate non-specific effects. Currently, non-specific effects are not routinely captured in phase I–III clinical trials or in the post-licensure safety surveillance. For instance, an infection with Streptococcus pneumoniae occurring months after a diphtheria-tetanus-pertussis vaccination would not be considered an effect of the vaccination, although evidence indicates it might well be for female individuals. Here, as a starting point for discussion, we propose a new framework that considers the non-specific effects of vaccines in both phase III trials and post-licensure.

Key Points

The existing framework for testing, approving, and regulating vaccines does not consider that vaccines have broad effects on the immune system that may alter the risk of unrelated infections.
It is now clear that vaccines can have important non-specific effects that can sometimes be very beneficial and sometimes harmful. In current practice, this can go unnoticed.
We propose a new framework for testing, approving, and regulating vaccines, with phase III trials, which should collect data on all symptoms arising during the follow-up, and with phase IV trials designed to assess vaccine effects on overall health.

Introduction: Current Framework for Testing, Approving, and Regulating Vaccines

Vaccines are described as biological preparations that induce immunity towards a specific pathogen by the induction of pathogen-specific antibody-producing B-cells, B-memory cells, T-memory cells, or a combination of cellular responses, that remember the pathogen and respond quickly upon infectious challenge. It is well known that vaccines may cause frequent but generally mild adverse reactions, such as pain at the injection site, redness, soreness, and perhaps fever or fatigue in the days after vaccination. It is also accepted that vaccines, in rare circumstances, may cause serious adverse reactions that can occur weeks to months after vaccination.

The current clinical testing and approval process is built on the following generally accepted concepts. During a phase I trial, small groups of healthy volunteers receive the candidate vaccine. In phase II, the vaccine is given to individuals with characteristics matching those for whom the new vaccine is intended. In phase III, the vaccine is given to thousands of participants in a randomized and blinded manner, with both an intervention and a control group, testing for efficacy and safety. Efficacy is typically the primary objective; safety is most commonly a secondary objective. Efficacy is typically assessed by comparing the vaccinated and the control groups with respect to the occurrence of the vaccine-specific disease and/or correlates of protection against the clinical disease. No standardized protocols exist for how phase III trials should collect data on safety, but there are some guidelines [1]. Typically, safety data are collected and reported in two groups. “Solicited” adverse events (AEs) are expected events related to reactogenicity, such as pain, redness, and swelling at the injection site, and are typically collected up to 2 weeks after a vaccination. “Unsolicited” events are unexpected events that are spontaneously reported by the participant. They are typically collected for up to 4 weeks after the last dose. Furthermore, participants are followed for serious AEs (SAEs; deaths and hospitalizations for any cause) and any pre-specified AEs of special interest for 6 months after the last dose. For vaccines that contain new adjuvants, it is recommended that there should be a follow-up for at least 12 months after the last dose to allow for the documentation of any autoimmune diseases or other immune-mediated AEs [1].

Rare AEs typically do not manifest in the clinical trial programs, and even if they do, there are usually too few cases to draw conclusions of causality. For example, if a vaccine caused a serious adverse reaction in 1 in 10,000 cases, it would take a study with 30,000 subjects to have a 95% chance of detecting even one case [2]. Therefore, after a vaccine has come on the market, there is a reporting system where vaccine providers and the public can report health problems (“post-licensure safety surveillance”). If there is doubt about the real-life effectiveness and safety of a vaccine, regulators can also require that a phase IV trial, a post-authorization safety study, be carried out [3]. This framework has worked well to deliver numerous new vaccines to the market; vaccines that were effective against the specific disease the vaccine was to target and for which we have reasonable assurance that the vaccine is not associated with frequent serious events that would shift the benefit/risk balance.

However, it is now evident that vaccines may affect the risk of other diseases in ways that were not foreseen when the current framework was established. Here, we propose that a new framework for testing, approving, and regulating vaccines is needed. This framework includes an assessment of vaccine effects on infections other than the target infection, and on overall health (such as all-cause mortality, all-cause hospitalization, or all-cause consultation rates).

In the following, we provide a background for this proposition, which is based on the discovery of the non-specific effects of vaccines. Subsequently, we outline the contours of the proposed framework, as a starting point for discussion.

Observations of Non-Specific Effects of Vaccines: Epidemiological Studies

Historically, there is anecdotal evidence that the smallpox vaccine reduced the risk of a number of other diseases [4]. Calmette, co-inventor of the Bacillus Calmette-Guérin (BCG) vaccine, noted that mortality was reduced by 75% among BCG vaccinated children in Paris, much more than could be explained by prevention of tuberculosis; he speculated that the vaccine may have additional benefits, strengthening the general resistance against other infections [5]. In the 1960s and 1970s, the Russian virologist Voroshilova conducted large trials of live enteroviruses, including oral polio vaccine, and found that they significantly reduced the risk of influenza infection [6].

In the 1980s, when the Danish-Guinean field station Bandim Health Project started a systematic investigation into the overall health effects of routinely used childhood vaccines, it became clear that most vaccines affected all-cause mortality and morbidity more than explained by prevention of the target disease. These effects were termed the “non-specific effects” of vaccines [7].

A pattern emerged with differences in effects between live attenuated vaccines and non-live vaccines. The live attenuated vaccines have broadly beneficial non-specific effects [8], beneficial non-specific effects that are seen while they are the most recently administered vaccine. For example, African children, who receive live vaccines, have considerably lower all-cause mortality compared with children who do not receive the live vaccines, and the difference is not explained by differences in mortality due to the vaccine-targeted infection [8]. Because the mortality in such settings is mainly due to infectious diseases, this suggests that the vaccines decrease susceptibility to unrelated infections or their severity, and where it has been possible to stratify by causes of deaths, studies have shown a particular effect against infectious deaths [9, 10]. Lower-than-anticipated all-cause mortality has been observed for four live vaccines: measles-containing vaccine, smallpox vaccine, BCG vaccine, and oral polio vaccine [8]. The initial data came from observational studies. It is difficult to test already approved vaccines in randomized trials, but in some situations, it has been possible, for example, by randomizing children to receive the vaccine at different ages, allowing an unbiased comparison over the time window between when the early group and the late group were vaccinated. Such randomized trials have largely corroborated the beneficial non-specific effects of the BCG vaccine [9, 11], measles vaccine [12, 13], and oral polio vaccine [14]. However, the findings have not always been consistent [1517], interpreted as possibly due to differences in vaccine strains, some strains having stronger immunological effects than others[18], or due to interactions with other vaccines that varied in frequency between trial settings [19]. Thus, non-specific effects are context dependent [20].

In contrast to the live vaccines, some non-live vaccines, though protective against the vaccine’s target disease, may increase the risk of other infections, particularly in female individuals, in certain contexts. For example, in low-income settings, female individuals who receive a non-live diphtheria-tetanus-pertussis (DTP) vaccine have a 1.5–2 times higher mortality rate than female individuals who have not received the vaccine and a similar increased risk above that of male individuals vaccinated with DTP [21]. This pattern has been observed for six non-live vaccines: [8] DTP vaccine, pentavalent vaccine [22] (DTP plus hepatitis B and Haemophilus influenzae type B vaccines), hepatitis B vaccine [23], inactivated polio vaccine[24], H1N1 influenza vaccine [25], and RTS,S malaria vaccine [26]. This has not been consistent in all studies [27, 28], so non-specific effects, positive as well as negative, can be modified—most clearly by sex [8, 21], but also by factors such as the administration of other vaccine types [8].

These non-specific effects are most pronounced when a given vaccine is the most recent vaccine. Most studies have been conducted among children, who usually receive frequent vaccinations, and therefore there are few studies on the duration of the non-specific effects, should no other vaccines be given. However, non-specific effects seem to last at least 6 months [8, 29], and sometimes persist for many years [30, 31]. The non-specific effects of vaccines were initially observed in low-income settings with high mortality due to infectious diseases, but non-specific effects have also been reported in some studies from high-income settings, which assessed the risk of non-targeted infectious disease hospitalizations [32, 33], corroborating that vaccines can affect the risk of unrelated infections.

Immune Mechanisms Underlying the Non-Specific Effects of Vaccines

Supporting the consistent observations from epidemiological studies, immunological studies have demonstrated at least three vaccine-mediated effects on the immune system that can explain how a vaccine might affect the risk for unrelated infections. First, it has been shown that several vaccines alter the ability of innate immune cells to respond to subsequent unrelated challenges, “trained innate immunity” [34]. Monocytes and natural killer cells from humans vaccinated with BCG show an enhanced production of proinflammatory cytokines, not only upon challenge with Mycobacterium tuberculosis (the specific pathogen), but also upon challenge with unrelated pathogens such as Staphylococcus aureus and Candida albicans [35]. This is mediated via epigenetic changes in the promoters and enhancers of proinflammatory cytokine genes. The clinical implications have been demonstrated: when a BCG vaccine was given to human volunteers before challenge with the live yellow fever vaccine, the yellow fever viral load in the circulation was reduced [36]. Likewise, in human experimental studies, the BCG vaccine modified the course of an experimental malaria infection [37]. In a recent study, intravesical BCG in patients with bladder cancer induced trained immunity and decreased the risk of respiratory tract infections [38]. Innate immune training has been demonstrated for live vaccines such as the BCG vaccine and smallpox vaccine [39] and more recently also the adenovirus-based COVID-19 vaccine [40], and may explain why these vaccines have beneficial non-specific effects. In contrast, several non-live vaccines (DTP vaccine [41, 42], typhoid vaccine [43], and non-replicating smallpox vaccine [39]) have been shown to induce innate immune tolerance towards unrelated pathogenic challenges. The increased innate tolerance towards other pathogens may explain why non-live vaccines are associated with increased susceptibility to other infections. However, the pattern of live vaccines inducing innate immune training and non-live vaccines inducing innate tolerance is not completely consistent because recently some non-live vaccines such as inactivated influenza vaccine have been associated with an induction of trained immunity, although these effects appear dependent on adjuvants in the formulation [44, 45].

Second, it has been shown that the BCG vaccine given to neonates leads to emergency granulopoiesis that expands neutrophil storage pools, thereby releasing them in larger numbers in response to ongoing or subsequent infection with non-vaccine pathogens [46], a plausible explanation for the strong protective effects of the BCG vaccine given at birth on all-cause mortality during the first month of life [9]. Third, vaccines may induce cross-protective T cells that can respond to pathogens unrelated to the vaccine pathogen. For instance, in humans, cross-reactive influenza virus-specific CD8+ T cells can contribute to lymphoproliferation in Epstein–Barr virus-associated infectious mononucleosis [47]

The immunological mechanisms underlying the sex differences in the non-specific effects of vaccines have not yet been fully understood, but it is well documented that male and female individuals have different immune responses to a pathogen challenge, and that they exhibit different dynamics and kinetics [48, 49]. Therefore, differential sex-based outcomes should be anticipated [48, 49].

Though there is still a paucity of studies linking immunological non-specific effects to clinical heterologous effects, it is now clear that vaccines affect the immune system in additional ways beyond the induction of vaccine-specific immunity. This adds biological plausibility to the epidemiological studies showing that vaccines may affect the risk of unrelated infections. This new knowledge necessitates a re-evaluation of the current framework for testing, approving, and regulating vaccines.

Gaps in the Current Practice

Insufficient Assessment of the Effect of Vaccines on Unrelated Infectious Diseases and All-Cause Mortality and Morbidity

Current phase III trials can capture unrelated infections as AEs, but such events would be “unsolicited” and reported only upon suspicion by the study participant or investigator. If unrelated infections during follow-up lead to death or hospitalization they would be captured as SAEs, but studies would usually not be powered to detect significant differences in SAEs between groups. If there were statistically significant differences in rates of SAEs between treatments, the guidelines stipulate that they should be interpreted with caution unless the trial was designed to address pre-specified hypotheses regarding such endpoints [1]. It is furthermore stipulated that the biological plausibility that SAEs may be related to vaccination should be taken into consideration when deciding on the need for further pre- or post-licensure trials to investigate and quantify the potential risks [1]. With the current view that relevant vaccine-induced effects are solely those that are pathogen specific: if there were a significant difference in the occurrence of SAEs due to unrelated infections in the two groups—either a lower or higher risk in the intervention than in the control group—this would likely be ascribed to chance, as it would be judged biologically implausible that it was due to the vaccine.

Post-licensing, health professionals and the lay public have little notion that unrelated infections occurring perhaps weeks to months post-vaccination could be related to effects following vaccination, and thus there will be no or very limited reporting of such events. Accordingly, it is possible to introduce in the vaccination program a new vaccine that is associated with effects on other infections and on all-cause mortality and morbidity—positive or negative—without these being detected.

As an example, the “high-titer” measles vaccine (HTMV) introduced by the World Health Organization in 1989 in areas with a high incidence of measles infection was fully protective against measles. Its introduction was based on its ability to induce seroconversion also in the presence of maternal antibodies and a lack of adverse reactions when compared with a few hundred children receiving the standard measles vaccine and with 63 unvaccinated children [50]. When independent researchers examined the vaccine’s non-specific effects in randomized trials, comparing the HTMV with the standard measles vaccine, the HTMV was associated with a doubling of mortality in female individuals compared with the standard measles vaccine [51]. In response, the World Health Organization withdrew the HTMV in 1992 [52], when these findings had been replicated several times. The results of the meta-analysis carried out afterwards [53] indicated that with the mortality level at that time in Africa, the continued use of the HTMV could have led to up to 500,000 excess female deaths per year in Africa. Had independent researchers not assessed the effect of the HTMV on overall health, the negative non-specific and fatal effects of introducing the HTMV in female individuals would likely have gone unnoticed. Even if an excess mortality had been observed, with the current perception of vaccine mechanisms, little thought would have been given to the possibility that the introduction of the HTMV would be associated with fatal non-specific effects, for a vaccine judged effective and safe. Similarly, current practice does not allow for the detection of beneficial non-specific effects of vaccines.

Context Independence Versus Context Dependence

Many studies show that female individuals respond with stronger antibody responses but also more side effects than male individuals [5457]. Though the strength of the immune response may vary by sex and other factors such as age [5557] and geographical latitude, current clinical practice largely assumes that vaccine effects are context independent, that is, that a correctly applied vaccine will induce specific protection in most individuals. Phase III trials often aim for inclusion of both sexes, but often employ quite narrow inclusion and exclusion criteria. Other health interventions that may affect the immune system, such as other vaccines received before or during a follow-up, are rarely accounted for; concomitantly administered vaccines may be investigated, but only to detect if there is an interference in the generation of immune responses or unacceptable reactogenicity.

As indicated in the Introduction, the non-specific effects of vaccines, in contrast, vary significantly by context [8, 20]. The immune response to a vaccine is not limited to specific B and T cells but is influenced by the state of the immune system at the time of vaccination, including other interventions and external factors that affect the immune system. Such interactions may not be considered by vaccinologists, but are well known in pharmacology, where it is standard practice to search for interactions, for example, between drugs that affect cytochrome P450 [58]. Non-specific effects can depend strongly on the temporary order of vaccination [8]. For example, a non-live DTP vaccine given after a live measles-containing vaccine is associated with increased all-cause mortality in female individuals, whereas a measles-containing vaccine given after a DTP vaccine is associated with reduced all-cause mortality [27]. Other identified effect modifiers include interventions that affect the immune system, such as vitamin A supplements, and co-morbidities affecting immune status. The effect of vitamin A supplementation has been shown to depend more on the vaccines with which it is given than on the degree of vitamin A deficiency, being very beneficial when given at the time of a live measles-containing vaccine, but not at the time of a non-live DTP vaccine to female individuals [59]. Interactions can also occur across generations. Maternal priming with a vaccine may influence her child’s non-specific response to the vaccine, for example, a BCG vaccination is significantly more beneficial for the children of women who were themselves BCG vaccinated than in the children of BCG-unvaccinated women [60, 61].

Current practice therefore has two important deficiencies: it does not emphasize systematic assessment of the non-specific effects on unrelated infections and overall health effects, and it rarely considers effect modifiers.

Proposed New Framework

To detect if a vaccine has important non-specific effects with consequences for overall health, we propose a new framework for testing, approving, and regulating a vaccine against a disease for which there is not already an existing vaccine (Table 1) [If there is already an approved vaccine against the disease, there will be other considerations: e.g., whether the new vaccine and the approved vaccine should be compared directly in a randomized trial; this would make sense if the approved vaccine had already been assessed for its non-specific effects].

Table 1.

Current and proposed assessment of vaccine safety

Current phase III trials Proposed phase III trials
“Placebo” Some use another vaccine or the adjuvant Never use another vaccine or the adjuvant if there is no approved vaccine for the targeted infection(s) [because they may also have non-specific effects]
Adverse events Solicited adverse events collected within a limited time frame. Deaths/hospitalization collected for full duration of the trial. Assessed for plausibility All clinical symptoms should be actively asked for and recorded and coded for at least 12 months [everything is plausible]
Coding of adverse events Diagnoses are preferentially coded before signs and symptoms Symptoms should be given priority
Outcomes Typically (symptomatic) infection and/or “correlates of protection” In addition, all infectious diseases and overall mortality and morbidity (e.g., all-cause consultations, hospitalizations, deaths), by sex and age group, as well as biomarkers of non-specific effects, such as in vitro cytokine and immune cell responses to non-related pathogens
Duration of follow-up Variable. Sometimes the control group is vaccinated once the vaccine is approved Blinded follow-up of vaccinated and control subjects for at least 12 months
Current post-licensure surveillance Proposed post-licensure surveillance
Comparison groups Observational studies comparing vaccinated vs unvaccinated; before and after comparisons Randomized trials individually or by cluster; step-wedged roll-out. Powered to study overall health outcomes in both sexes
Safety Reporting by general practitioners and citizens Active follow-up through interviews/registers
Outcomes “Plausible” adverse events All infectious diseases. Overall mortality and morbidity, e.g., all-cause consultation, hospitalization, deaths

Phase III Trials

  • The trials should include the anticipated target population, as already recommended, but not always followed [62].

  • The control group should only have saline, another neutral treatment or no intervention—not another vaccine or adjuvant that might have non-specific effects, thus not being a true control [63].

  • The trials should ideally, if possible, be conducted with a sufficiently large study population to rule out, with a prespecified degree of certainty, any major risk of serious outcomes from the vaccine, such as increased all-cause mortality or hospitalization.

  • A systematic follow-up for all symptoms should be for at least 12 months to register all-cause health outcomes, non-specific effects (positive and negative), and possible AEs. All symptoms occurring during the full duration should be coded by symptom/disease category and by sex and age. They should be reported in the trial publication and to regulatory authorities in sufficient detail to allow for scrutiny by independent researchers.

  • Assessment of biological plausibility should include the possibility that an unrelated infection or an increased severity of infection could be due to non-specific effects, for example, an infection with Streptococcus pneumoniae occurring months after a DTP vaccination could well be an effect of the vaccine.

  • Specific as well as non-specific vaccine effects should be analyzed and reported, applying the intention-to-treat principle from the day of randomization.

  • Vaccine trials should systemically register and report other interventions provided during a follow-up that may affect the immune system, for example, if participants received other vaccines. Efficacy and safety should be reported before and after such additional interventions.

  • In parallel, it is recommended that appropriate biomarkers for both positive and negative non-specific effects be sought. In the future, such biomarkers could potentially serve as “stop-go” signals already in the phase I/II trials.

Post-Licensure Testing

Once a vaccine is approved, it should be randomly allocated to ensure that large groups of initially comparable vaccinated and unvaccinated population groups can be followed and compared over time. This would allow the detection of differences in the incidence or severity of other diseases and provide an assessment of the effect of the vaccine on overall health and its cost effectiveness. There are several ways to do this. One way is to introduce the new vaccine in the form of a cluster randomized trial; the randomization unit could be general practice clinics, municipalities, or regions. Such population-based randomized trials have been carried out in Finland [64].

Alternatively, the vaccine can be introduced gradually, in a step-wedge design. For example, starting vaccination in one region and gradually, over months or years, introducing it to other regions.

The final design of the post-licensure assessment (whether it is conducted as a randomized trial or by a step-wedge roll-out or something else) should be triangulated based on prior knowledge from the phase III trial and information about the type of vaccine. Based on the current evidence, if it is a new vaccine type, or if the vaccine is a non-live vaccine, it should prompt a randomized trial. Furthermore, if the phase III trial does not show an effect on all-cause mortality or morbidity that is in line with what was anticipated based on the vaccine’s effects against the target disease, and/or if the collected biomarkers and/or immunological studies reveal signals of increased innate immune tolerance, this should prompt a more thorough phase IV evaluation.

Importantly, these post-licensure assessments should include information on the context because, as mentioned, the effect of a vaccine on overall health is dependent on factors such as sex and can be modified by the vaccination status of the recipient, by other vaccines and interventions the recipient receives during a follow-up, and other factors that may influence the immune system. At a minimum, a program should assess the overall health effects of new vaccines separately for female and male individuals. These recommendations would gradually lead to the establishment of a global knowledge database on vaccine interactions with clinical consequences, and ways to test these.

Economic Considerations

The cost of undertaking a phase III vaccine trial is presently the responsibility of the developer. The prospect of expanding phase III trials to include more participants comes with a considerable associated cost. However, with more robust results this may reduce the need for some post-licensure studies and the additional health benefits beyond the specific disease protection may result in a wider vaccine uptake, inevitably supported by governments and health authorities. Therefore, there is potential for government-private sector co-sponsorship of phase III vaccine trials. Post-licensure evaluation can occur as a phase IV trial, sponsored by the developer in partnership with the government. Indeed, it may be preferable that oversight for post-licensure evaluation be within the sole jurisdiction of health authorities, to ensure authenticity.

Ethical Considerations

The proposed framework raises some important ethical considerations. Even in situations without any existing vaccines, some would argue that the control group should have some type of intervention. However, as endorsed by a World Health Organization expert panel, placebo use in vaccine trials is ethically acceptable when no efficacious and safe vaccine exists [65].

Larger phase III trials with longer durations could cause delays in the release of a new vaccine. Randomized or step-wedged roll-out of a new vaccine would mean that the vaccine would not be available for all from the date of approval. However, given the reality of production capacity limitations combined with the often slow release of a new vaccine, the suggested framework is not only realistic, but also probably more advantageous for the overall health of the population.

It is no longer defensible to ignore the accumulating evidence that vaccines have broad effects on the immune system and thereby the risk for other infections and ultimately the risk of all-cause mortality and morbidity. Ignoring vaccine non-specific effects would risk new vaccines increasing all-cause morbidity and even mortality, thereby severely undermining the credibility of vaccine programs. For example, the introduction of the HTMV would have led to major increases in childhood mortality if the non-specific effects had not been detected by independent investigators.

A fear is that these proposed changes to the current framework for testing, approving, and regulating vaccines may open the door to an unwarranted discussion of vaccine safety, therefore strengthening the anti-vaccination movement. However, in our view, it would be devastating if the anti-vaccination movement were given this type of power to define, and possibly restrict, the use of a sound scientific method forward.

We believe the public will understand the logic of this reasoned approach, health-wise, scientifically, and economically. Most likely, these initiatives will address safety concerns and increase trust in health authorities to mitigate vaccine hesitancy and counter the rhetoric of the anti-vaccination movement.

Conclusions

Currently, there is a well-developed framework for testing, approving, and regulating vaccines. Yet, with what we know today, we are not optimally testing vaccines before their introduction. There is a growing body of evidence that vaccines have broad effects on the immune system and on the risk of unrelated infections. To optimize vaccine benefits, reduce possible harm, and maintain public trust, it is essential to document that a given vaccine has a net beneficial effect on overall health. With this paper, we hope to start a discussion on how this could best be accomplished.

Declarations

Funding

Open access funding provided by Royal Danish Library.

Conflicts of interest/competing interests

The authors have no conflicts of interest that are directly relevant to the content of this article. The views expressed in this article are the personal views of the authors and may not be understood or quoted as being made on behalf of or reflecting the position of their institutions.

Ethics approval

Not applicable; no data were analyzed.

Consent to participate

Not applicable; no patient contact or data were involved.

Consent for publication

Not applicable.

Availability of data and material

Not applicable.

Code availability

Not applicable.

Authors’ contributions

CSB wrote the first version of the paper after having discussed the topic with the co-authors, particularly with PA. All co-authors (mentioned in alphabetic order) read and commented on the paper and approved the final version of the manuscript.

References

  • 1.WHO. Guidelines on clinical evaluation of vaccines: regulatory expectations; 2017. WHO Technical Report Series 1004, Annex 9, 2017. Available at https://www.who.int/publications/m/item/WHO-TRS-1004-web-annex-9
  • 2.Onakpoya IJ. Rare adverse events in clinical trials: understanding the rule of three. BMJ Evid Based Med. 2018;23(1):6. doi: 10.1136/ebmed-2017-110885. [DOI] [PubMed] [Google Scholar]
  • 3.Peter G. Smith, Richard H. Morrow, David A. Ross (Eds) Field trials of health interventions: a toolbox. Oxford: Oxford University Press; 2015 [PubMed]
  • 4.Mayr A. Taking advantage of the positive side-effects of smallpox vaccination. J Vet Med B Infect Dis Vet Public Health. 2004;51(5):199–201. doi: 10.1111/j.1439-0450.2004.00763.x. [DOI] [PubMed] [Google Scholar]
  • 5.Calmette A. Preventive vaccination against tuberculosis with BCG. Proc R Soc Med. 1931;24(11):1481–1490. [PMC free article] [PubMed] [Google Scholar]
  • 6.Voroshilova MK. Potential use of nonpathogenic enteroviruses for control of human disease. Prog Med Virol. 1989;36:191–202. [PubMed] [Google Scholar]
  • 7.Aaby P, Benn CS. Developing the concept of beneficial non-specific effect of live vaccines with epidemiological studies. Clin Microbiol Infect. 2019;25(12):1459–1467. doi: 10.1016/j.cmi.2019.08.011. [DOI] [PubMed] [Google Scholar]
  • 8.Benn CS, Fisker AB, Rieckmann A, Sorup S, Aaby P. Vaccinology: time to change the paradigm? Lancet Infect Dis. 2020;20(10):e274–e283. doi: 10.1016/S1473-3099(19)30742-X. [DOI] [PubMed] [Google Scholar]
  • 9.Biering-Sorensen S, Aaby P, Lund N, Monteiro I, Jensen KJ, Eriksen HB, et al. Early BCG-Denmark and neonatal mortality among infants weighing <2500 g: a randomized controlled trial. Clin Infect Dis. 2017;65(7):1183–1190. doi: 10.1093/cid/cix525. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Schaltz-Buchholzer F, Aaby P, Monteiro I, Camala L, Faurholt Simonsen S, Nørtoft Frankel H, et al. Immediate Bacille Calmette-Guérin vaccination to neonates requiring perinatal treatment at the maternity ward in Guinea-Bissau: a randomized controlled trial. J Infect Dis. 2021;224(11):1935–1944. doi: 10.1093/infdis/jiab220. [DOI] [PubMed] [Google Scholar]
  • 11.Prentice S, Nassanga B, Webb EL, Akello F, Kiwudhu F, Akurut H, et al. BCG-induced non-specific effects on heterologous infectious disease in Ugandan neonates: an investigator-blind randomised controlled trial. Lancet Infect Dis. 2021;21(7):993–1003. doi: 10.1016/S1473-3099(20)30653-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Aaby P, Martins CL, Garly ML, Bale C, Andersen A, Rodrigues A, et al. Non-specific effects of standard measles vaccine at 4.5 and 9 months of age on childhood mortality: randomised controlled trial. BMJ. 2010;341:c6495. [DOI] [PMC free article] [PubMed]
  • 13.Berendsen MLT, Silva I, Balé C, Nielsen S, Hvidt S, Martins CL, et al. The effect of a second dose of measles vaccine at 18 months of age on nonaccidental deaths and hospital admissions in Guinea-Bissau: interim analysis of a randomized controlled trial. Clin Infect Dis. 2022;75(8):1370–1378. doi: 10.1093/cid/ciac155. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Lund N, Andersen A, Hansen AS, Jepsen FS, Barbosa A, Biering-Sorensen S, et al. The effect of oral polio vaccine at birth on infant mortality: a randomized trial. Clin Infect Dis. 2015;61(10):1504–1511. doi: 10.1093/cid/civ617. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Jayaraman K, Adhisivam B, Nallasivan S, Krishnan RG, Kamalarathnam C, Bharathi M, et al. Two randomized trials of the effect of the Russian strain of Bacillus Calmette-Guérin alone or with oral polio vaccine on neonatal mortality in infants weighing <2000 g in India. Pediatr Infect Dis J. 2019;38(2):198–202. doi: 10.1097/INF.0000000000002198. [DOI] [PubMed] [Google Scholar]
  • 16.Nielsen S, Fisker AB, da Silva I, Byberg S, Biering-Sørensen S, Balé C, et al. Effect of early two-dose measles vaccination on childhood mortality and modification by maternal measles antibody in Guinea-Bissau, West Africa: a single-centre open-label randomised controlled trial. EClinicalMedicine. 2022;49:101467. doi: 10.1016/j.eclinm.2022.101467. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Fisker AB, Nebie E, Schoeps A, Martins C, Rodrigues A, Zakane A, et al. A two-center randomized trial of an additional early dose of measles vaccine: effects on mortality and measles antibody levels. Clin Infect Dis. 2018;66(10):1573–1580. doi: 10.1093/cid/cix1033. [DOI] [PubMed] [Google Scholar]
  • 18.Curtis N. BCG Vaccination and all-cause neonatal mortality. Pediatr Infect Dis J. 2019;38(2):195–197. doi: 10.1097/INF.0000000000002230. [DOI] [PubMed] [Google Scholar]
  • 19.Aaby P, Andersen A, Martins CL, Fisker AB, Rodrigues A, Whittle HC, et al. Does oral polio vaccine have non-specific effects on all-cause mortality? Natural experiments within a randomised controlled trial of early measles vaccine. BMJ Open. 2016;6(12):e013335. doi: 10.1136/bmjopen-2016-013335. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Aaby P, Netea MG, Benn CS. Beneficial non-specific effects of live vaccines against COVID-19 and other unrelated infections. Lancet Infect Dis. 2023;23(1):e34–42. doi: 10.1016/S1473-3099(22)00498-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Aaby P, Ravn H, Fisker AB, Rodrigues A, Benn CS. Is diphtheria-tetanus-pertussis (DTP) associated with increased female mortality? A meta-analysis testing the hypotheses of sex-differential non-specific effects of DTP vaccine. Trans R Soc Trop Med Hyg. 2016;110(10):570–581. doi: 10.1093/trstmh/trw073. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Fisker AB, Ravn H, Rodrigues A, Ostergaard MD, Bale C, Benn CS, et al. Co-administration of live measles and yellow fever vaccines and inactivated pentavalent vaccines is associated with increased mortality compared with measles and yellow fever vaccines only. An observational study from Guinea-Bissau. Vaccine. 2014;32(5):598–605. doi: 10.1016/j.vaccine.2013.11.074. [DOI] [PubMed] [Google Scholar]
  • 23.Garly ML, Jensen H, Martins CL, Bale C, Balde MA, Lisse IM, et al. Hepatitis B vaccination associated with higher female than male mortality in Guinea-bissau: an observational study. Pediatr Inf Dis J. 2004;23(12):1086–1092. doi: 10.1097/01.inf.0000145700.77286.94. [DOI] [PubMed] [Google Scholar]
  • 24.Aaby P, Garly ML, Nielsen J, Ravn H, Martins C, Bale C, et al. Increased female-male mortality ratio associated with inactivated polio and diphtheria-tetanus-pertussis vaccines: observations from vaccination trials in Guinea-Bissau. Pediatr Infect Dis J. 2007;26(3):247–252. doi: 10.1097/01.inf.0000256735.05098.01. [DOI] [PubMed] [Google Scholar]
  • 25.Andersen A, Fisker AB, Rodrigues A, Martins C, Ravn H, Lund N, et al. National immunization campaigns with oral polio vaccine reduce all-cause mortality: a natural experiment within seven randomized trials. Front Public Health. 2018;6:13. doi: 10.3389/fpubh.2018.00013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Klein SL, Shann F, Moss WJ, Benn CS, Aaby P. RTS, S malaria vaccine and increased mortality in girls. MBio. 2016;7(2):e00514–e516. doi: 10.1128/mBio.00514-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Higgins JP, Soares-Weiser K, Lopez-Lopez JA, Kakourou A, Chaplin K, Christensen H, et al. Association of BCG, DTP, and measles containing vaccines with childhood mortality: systematic review. BMJ. 2016;13(355):i5170. doi: 10.1136/bmj.i5170. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Aaby P, Ravn H, Benn CS. The WHO review of the possible nonspecific effects of diphtheria-tetanus-pertussis vaccine. Pediatr Infect Dis J. 2016;35(11):1247–1257. doi: 10.1097/INF.0000000000001269. [DOI] [PubMed] [Google Scholar]
  • 29.Fine PE, Smith PG. 'Non-specific effects of vaccines': an important analytical insight, and call for a workshop. Trop Med Int Health. 2007;12(1):1–4. doi: 10.1111/j.1365-3156.2006.01794.x. [DOI] [PubMed] [Google Scholar]
  • 30.Rieckmann A, Villumsen M, Sorup S, Haugaard LK, Ravn H, Roth A, et al. Vaccinations against smallpox and tuberculosis are associated with better long-term survival: a Danish case-cohort study 1971–2010. Int J Epidemiol. 2017;46(2):695–705. doi: 10.1093/ije/dyw120. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Usher NT, Chang S, Howard RS, Martinez A, Harrison LH, Santosham M, et al. Association of BCG vaccination in childhood with subsequent cancer diagnoses: a 60-year follow-up of a clinical trial. JAMA Netw Open. 2019;2(9):e1912014. doi: 10.1001/jamanetworkopen.2019.12014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Sorup S, Benn CS, Poulsen A, Krause TG, Aaby P, Ravn H. Live vaccine against measles, mumps, and rubella and the risk of hospital admissions for nontargeted infections. JAMA. 2014;311(8):826–835. doi: 10.1001/jama.2014.470. [DOI] [PubMed] [Google Scholar]
  • 33.Bardenheier BH, McNeil MM, Wodi AP, McNicholl JM, DeStefano F. Risk of nontargeted infectious disease hospitalizations among US children following inactivated and live vaccines, 2005–2014. Clin Infect Dis. 2017;65(5):729–737. doi: 10.1093/cid/cix442. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Netea MG, Quintin J, van der Meer JW. Trained immunity: a memory for innate host defense. Cell Host Microbe. 2011;9(5):355–361. doi: 10.1016/j.chom.2011.04.006. [DOI] [PubMed] [Google Scholar]
  • 35.Kleinnijenhuis J, Quintin J, Preijers F, Joosten LA, Ifrim DC, Saeed S, et al. Bacille Calmette-Guerin induces NOD2-dependent nonspecific protection from reinfection via epigenetic reprogramming of monocytes. Proc Natl Acad Sci USA. 2012;109(43):17537–17542. doi: 10.1073/pnas.1202870109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Arts RJW, Moorlag S, Novakovic B, Li Y, Wang SY, Oosting M, et al. BCG vaccination protects against experimental viral infection in humans through the induction of cytokines associated with trained immunity. Cell Host Microbe. 2018;23(1):89–100.e5. doi: 10.1016/j.chom.2017.12.010. [DOI] [PubMed] [Google Scholar]
  • 37.Walk J, de Bree LCJ, Graumans W, Stoter R, van Gemert GJ, van de Vegte-Bolmer M, et al. Outcomes of controlled human malaria infection after BCG vaccination. Nat Commun. 2019;10(1):874. doi: 10.1038/s41467-019-08659-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.van Puffelen JH, Novakovic B, van Emst L, Kooper D, Zuiverloon TCM, Oldenhof UTH, et al. Intravesical BCG in patients with non-muscle invasive bladder cancer induces trained immunity and decreases respiratory infections. J Immunother Cancer. 2023;11(1):e005518. doi: 10.1136/jitc-2022-005518. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Blok BA, Jensen KJ, Aaby P, Fomsgaard A, van Crevel R, Benn CS, et al. Opposite effects of Vaccinia and modified Vaccinia Ankara on trained immunity. Eur J Clin Microbiol Infect Dis. 2019;38(3):449–456. doi: 10.1007/s10096-018-03449-z. [DOI] [PubMed] [Google Scholar]
  • 40.Murphy DM, Cox DJ, Connolly SA, Breen EP, Brugman AA, Phelan JJ, et al. Trained immunity is induced in humans after immunization with an adenoviral vector COVID-19 vaccine. J Clin Invest. 2023;133(2):e162581. doi: 10.1172/JCI162581. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Blok BA, de Bree LCJ, Diavatopoulos DA, Langereis JD, Joosten LAB, Aaby P, et al. Interacting, nonspecific, immunological effects of Bacille Calmette-Guerin and tetanus-diphtheria-pertussis inactivated polio vaccinations: an explorative, randomized trial. Clin Infect Dis. 2020;70(3):455–463. doi: 10.1093/cid/ciz246. [DOI] [PubMed] [Google Scholar]
  • 42.Noho-Konteh F, Adetifa JU, Cox M, Hossin S, Reynolds J, Le MT, et al. Sex-differential non-vaccine-specific immunological effects of diphtheria-tetanus-pertussis and measles vaccination. Clin Infect Dis. 2016;63(9):1213–1226. doi: 10.1093/cid/ciw492. [DOI] [PubMed] [Google Scholar]
  • 43.Blok BA, Arts RJW, van Crevel R, Aaby P, Joosten LAB, Benn CS, et al. Differential effects of BCG vaccine on immune responses induced by vi polysaccharide typhoid fever vaccination: an explorative randomized trial. Eur J Clin Microbiol Infect Dis. 2020;39(6):1177–1184. doi: 10.1007/s10096-020-03813-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Wimmers F, Donato M, Kuo A, Ashuach T, Gupta S, Li C, et al. The single-cell epigenomic and transcriptional landscape of immunity to influenza vaccination. Cell. 2021;184(15):3915–35.e21. doi: 10.1016/j.cell.2021.05.039. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Debisarun PA, Gössling KL, Bulut O, Kilic G, Zoodsma M, Liu Z, et al. Induction of trained immunity by influenza vaccination: impact on COVID-19. PLoS Pathog. 2021;17(10):e1009928. doi: 10.1371/journal.ppat.1009928. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Brook B, Harbeson DJ, Shannon CP, Cai B, He D, Ben-Othman R, et al. BCG vaccination-induced emergency granulopoiesis provides rapid protection from neonatal sepsis. Sci Transl Med. 2020;12(542):eaax4517. [DOI] [PMC free article] [PubMed]
  • 47.Clute SC, Watkin LB, Cornberg M, Naumov YN, Sullivan JL, Luzuriaga K, et al. Cross-reactive influenza virus-specific CD8+ T cells contribute to lymphoproliferation in Epstein-Barr virus-associated infectious mononucleosis. J Clin Invest. 2005;115(12):3602–3612. doi: 10.1172/JCI25078. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Flanagan KL, Fink AL, Plebanski M, Klein SL. Sex and gender differences in the outcomes of vaccination over the life course. Annu Rev Cell Dev Biol. 2017;6(33):577–599. doi: 10.1146/annurev-cellbio-100616-060718. [DOI] [PubMed] [Google Scholar]
  • 49.Flanagan KL, Klein SL, Skakkebaek NE, Marriott I, Marchant A, Selin L, et al. Sex differences in the vaccine-specific and non-targeted effects of vaccines. Vaccine. 2011;29(13):2349–2354. doi: 10.1016/j.vaccine.2011.01.071. [DOI] [PubMed] [Google Scholar]
  • 50.Markowitz LE, Sepulveda J, Diaz-Ortega JL, Valdespino JL, Albrecht P, Zell ER, et al. Immunization of six-month-old infants with different doses of Edmonston-Zagreb and Schwarz measles vaccines. N Engl J Med. 1990;322(9):580–587. doi: 10.1056/NEJM199003013220903. [DOI] [PubMed] [Google Scholar]
  • 51.Aaby P, Samb B, Simondon F, Knudsen K, Seck AM, Bennett J, et al. Sex-specific differences in mortality after high-titre measles immunization in rural Senegal. Bull World Health Organ. 1994;72(5):761–770. [PMC free article] [PubMed] [Google Scholar]
  • 52.Expanded Programme on Immunization (EPI). Safety of high titre measles vaccines. Wkly Epidemiol Rec. 1992;67(48):357–61. [PubMed]
  • 53.Knudsen KM, Aaby P, Whittle H, Rowe M, Samb B, Simondon F, et al. Child mortality following standard, medium or high titre measles immunization in West Africa. Int J Epidemiol. 1996;25(3):665–673. doi: 10.1093/ije/25.3.665. [DOI] [PubMed] [Google Scholar]
  • 54.Fink AL, Engle K, Ursin RL, Tang WY, Klein SL. Biological sex affects vaccine efficacy and protection against influenza in mice. Proc Natl Acad Sci USA. 2018;115(49):12477–12482. doi: 10.1073/pnas.1805268115. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Kuo H, Shapiro JR, Dhakal S, Morgan R, Fink AL, Liu H, et al. Sex-specific effects of age and body mass index on antibody responses to seasonal influenza vaccines in healthcare workers. Vaccine. 2022;40(11):1634–1642. doi: 10.1016/j.vaccine.2021.02.047. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Shapiro JR, Sitaras I, Park HS, Aytenfisu TY, Caputo C, Li M, et al. Association of frailty, age, and biological sex with severe acute respiratory syndrome coronavirus 2 messenger RNA vaccine-induced immunity in older adults. Clin Infect Dis. 2022;75(Suppl_1):S61–71. [DOI] [PMC free article] [PubMed]
  • 57.Potluri T, Fink AL, Sylvia KE, Dhakal S, Vermillion MS, Vom Steeg L, et al. Age-associated changes in the impact of sex steroids on influenza vaccine responses in males and females. NPJ Vaccines. 2019;4:29. doi: 10.1038/s41541-019-0124-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Ogu CC, Maxa JL. Drug interactions due to cytochrome P450. Proc (Bayl Univ Med Cent). 2000;13(4):421–423. doi: 10.1080/08998280.2000.11927719. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Benn CS, Aaby P, Arts RJ, Jensen KJ, Netea MG, Fisker AB. An enigma: why vitamin A supplementation does not always reduce mortality even though vitamin A deficiency is associated with increased mortality. Int J Epidemiol. 2015;44(3):906–918. doi: 10.1093/ije/dyv117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Stensballe LG, Ravn H, Birk NM, Kjaergaard J, Nissen TN, Pihl GT, et al. BCG vaccination at birth and rate of hospitalization for infection until 15 months of age in Danish children: a randomized clinical multicenter trial. J Pediatric Infect Dis Soc. 2019;8(3):213–220. doi: 10.1093/jpids/piy029. [DOI] [PubMed] [Google Scholar]
  • 61.Berendsen MLT, Oland CB, Bles P, Jensen AKG, Kofoed PE, Whittle H, et al. Maternal priming: Bacillus Calmette-Guerin (BCG) vaccine scarring in mothers enhances the survival of their child with a BCG vaccine scar. J Pediatr Infect Dis Soc. 2020;9(2):166–172. doi: 10.1093/jpids/piy142. [DOI] [PubMed] [Google Scholar]
  • 62.Doshi P. Will COVID-19 vaccines save lives? Current trials aren’t designed to tell us. BMJ. 2020;371:m4037. doi: 10.1136/bmj.m4037. [DOI] [PubMed] [Google Scholar]
  • 63.Byberg S, Benn CS. Placebo use in vaccine trials: caution when using active vaccines as placebo. Vaccine. 2015;35(9):1211. doi: 10.1016/j.vaccine.2015.03.024. [DOI] [PubMed] [Google Scholar]
  • 64.Palmu AA, Toropainen M, Kaijalainen T, Siira L, Lahdenkari M, Nieminen H, et al. Direct and indirect effectiveness of the 10-valent pneumococcal conjugate vaccine against carriage in a cluster randomized trial. Pediatr Infect Dis J. 2017;36(12):1193–1200. doi: 10.1097/INF.0000000000001705. [DOI] [PubMed] [Google Scholar]
  • 65.Rid A, Saxena A, Baqui AH, Bhan A, Bines J, Bouesseau MC, et al. Placebo use in vaccine trials: recommendations of a WHO expert panel. Vaccine. 2014;32(37):4708–4712. doi: 10.1016/j.vaccine.2014.04.022. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Drug Safety are provided here courtesy of Springer

RESOURCES