Skip to main content
Elsevier - PMC COVID-19 Collection logoLink to Elsevier - PMC COVID-19 Collection
. 2018 Nov 26;37(38):5796–5802. doi: 10.1016/j.vaccine.2018.08.085

Defining the interval for monitoring potential adverse events following immunization (AEFIs) after receipt of live viral vectored vaccines

Sonali Kochhar a,b,c, Jean-Louis Excler d, Karin Bok e, Marc Gurwith f, Michael M McNeil g, Stephen J Seligman h,i, Najwa Khuri-Bulos j, Bettina Klug k, Marian Laderoute l, James S Robertson m, Vidisha Singh n, Robert T Chen n,o,; For the Brighton Collaboration Viral Vector Vaccines Safety Working Group (V3SWG)1
PMCID: PMC6535369  NIHMSID: NIHMS999620  PMID: 30497831

Abstract

Live viral vectors that express heterologous antigens of the target pathogen are being investigated in the development of novel vaccines against serious infectious agents like HIV and Ebola. As some live recombinant vectored vaccines may be replication-competent, a key challenge is defining the length of time for monitoring potential adverse events following immunization (AEFI) in clinical trials and epidemiologic studies. This time period must be chosen with care and based on considerations of pre-clinical and clinical trials data, biological plausibility and practical feasibility. The available options include: (1) adapting from the current relevant regulatory guidelines; (2) convening a panel of experts to review the evidence from a systematic literature search to narrow down a list of likely potential or known AEFI and establish the optimal risk window(s); and (3) conducting “near real-time“ prospective monitoring for unknown clustering’s of AEFI in validated large linked vaccine safety databases using Rapid Cycle Analysis for pre-specified adverse events of special interest (AESI) and Treescan to identify previously unsuspected outcomes. The risk window established by any of these options could be used along with (4) establishing a registry of clinically validated pre-specified AESI to include in case-control studies. Depending on the infrastructure, human resources and databases available in different countries, the appropriate option or combination of options can be determined by regulatory agencies and investigators.

Keywords: Viral vector, Vaccines, Safety, Surveillance, Duration, Adverse events following immunization (AEFI), Adverse event of special interest (AESI), Treescan

1. Introduction

Immunization against vaccine-preventable diseases (VPD) is a highly cost-effective public health intervention [1], [2]. Traditional methods of vaccine development against several major human pathogens may be less than optimal [3]. New biotechnology approaches are being explored [4] including the development of recombinant viral vector vaccines using an attenuated virus to carry and introduce viral DNA into antigen-presenting cells to induce both humoral and cell-mediated immune responses [5]. “Vector” refers to the virus used as the carrier [6]. Live viral vectors that express heterologous antigens of the target pathogen in vivo are being investigated in the development of vaccines against Human Immunodeficiency Virus type 1 (HIV-1) [7], Plasmodium falciparum [8], Influenza [9], severe acute respiratory syndrome coronavirus (SARS-CoV) [10], Ebola virus [11], Hepatitis C virus [12], Respiratory Syncytial Virus [13], Mycobacterium tuberculosis [14], [15]. Middle East Respiratory Syndrome (MERS) [16], [17] Lassa Fever, Nipah, [17], chikungunya and Zika viruses, etc. [18] (see Table 1 ).

Table 1.

Some viral vector vaccine candidates in different stages of development for use in humans [9], [19], [20].

Non-recombinant viruses no-longer in use in humans Non-recombinant viruses in use in humans Viral vectors already tested in humans Viral vectors in preclinical development Viruses in preclinical development
Vaccinia Ad4 (inactivated; live oral) Vaccinia hCMV Reassortment of Lassa and Mopeia viruses



MVA Ad7 (inactivated; live oral) MVA rLCMV Live attenuated Zika
Measles NYVAC rhCMV Live attenuated Rift Valley Fever
Mumps ALVAC Replicating Ad5
Rubella Fowlpox Ad55
MMR Ad3 ChimpAdY25
YFV 17D, 17DD, 17D204, 17D 213 Ad5 YFV 17D
Live attenuated VZV Ad35 Chimeric Zika
Influenza virus (inactivated) Ad26 Rabies virus
Measles virus
Polio viruses (oral live attenuated; injectable inactivated) ChimpAd63 ChAdC7
EV71 (inactivated) ChimpAd3 Kunjin virus
EV71 + CAV16 (inactivated) ChimAdOx1
SA 14-14-2 JE live attenuated Chimerivax (dengue, JE) Canine distemper virus (CDV)
Adeno Associated Virus Rhesus rhadinovirus
Sendai Newcastle Disease Virus (NDV)
VSV Live attenuated Chinese equine infectious anemia virus (EIAV)

Ad – Adenovirus.

CMV – Cytomegalovirus.

MVA – Modified Vaccinia Ankara.

LCMV – Lymphocytic choriomeningitis.

NYVAC – Highly attenuated vaccinia virus strain.

hCMV – Human cytomegalovirus.

ALVAC – Canary pox virus.

MMR – Measles, Mumps, and Rubella.

YFV – Yellow Fever virus.

VZV – Varicella zoster virus.

EV – Enterovirus.

CAV – Chicken anaemia virus.

JE – Japanese encephalitis virus.

Live recombinant viral vectored vaccines include replication-defective and replication-competent viruses with the possible association of two different heterologous vectors in prime-boost regimens. Replication-defective vectors may have a natural host-restriction such as the avipox vectors [21], or they may have been attenuated either by serial passage (e.g. yellow fever virus) so that they are less virulent with decreased replication competency in humans, e.g., Modified Vaccinia Ankara [22] or by genetic engineering that limits their replication to less than a single cycle (abortive replication), e.g., in the case of most adenovirus vectors [23]. The heterologous antigen gene may be of viral, bacterial, parasitic, oncologic, or gene therapy-based. The heterologous gene may comprise sequences coding for a portion of an antigen or an entire antigen, more than one antigen or heterologous antigen genes from more than one infectious agent [24], [25]. In some cases protection against the wild-type virus from which the vector is derived, may also be sought [26].

The immune response induced by a live recombinant vectored-vaccine depends on the extent and duration of the replication of the vector, the immunogenicity of the expressed heterologous antigen and the antigens of the vector itself. The virulence of live recombinant viral vaccines cannot be predicted from that of the viral vector, even when the vector is already attenuated for humans [25], which emphasizes the need for extensive safety studies during clinical development before public health use. This will be even more critical where a vector of non-human virus origin is utilized. Information on the pathogenicity of the wild-type virus for humans may be limited or absent. The potential for reversion to virulence or for recombination or reassortment with circulating wild-type viruses also must be considered [25], [26]. The same viral vector may not demonstrate an identical safety profile when expressing different foreign antigens [27] (see Table 2 ).

Table 2.

Safety issues for consideration for candidate viral vector vaccines [24].

 (1) Characteristics, pathogenesis, and known adverse events of the wild-type virus, viral vector (before incorporation of the foreign antigen) and final recombinant viral vector vaccine (data from completed Viral Vector Vaccines Safety Working Group (V3SWG) templates can help to determine this) [64]
 (2) Potential for the generation of replication-competent virus from a replication-defective viral vector (measurement of the immune response to an antigen present in replication-competent viruses but absent in replication-defective viruses might help in identifying such a situation)
 (3) Potential for reversion of the viral vector to virulence; this might also occur during manufacture of a batch of vaccine or in vaccine recipients
 (4) Potential for recombination or reassortment with other infectious agents that might coincidentally occur in vaccinees around the time of dosing
 (5) Incidence of viremia
 (6) Assessment of the extent and duration of vaccine shedding and the potential for transmission of the live vectored vaccine to contacts
 (7) Potential for vaccination to trigger autoimmune diseases
 (8) Potential for integration of genes derived from the vector into the host genome
 (9) Consideration of specific adverse events that might reflect the distribution of the vector to specific body sites
 (10) Potential for certain adverse reactions to occur only in subsets, e.g. those with a particular genetic predisposition
 (11) Potential for increased susceptibility to infection by the agent against which protection is being sought due to high levels of immunity to the vector virus
 (12) Potential for nucleotide mutations resulting in changes in the immunogen affecting vaccine effectiveness [65]
 (13) Potential of the viral vector to induce tolerance as evidenced by poor vaccine efficacy in clinical trials or epidemiological studies [66]

As noted earlier, the list of recombinant viral vectors in pre-clinical and clinical development has expanded and thousands of subjects have been enrolled in clinical development for the control of various infectious diseases with recombinant adenovirus and poxviruses being the most advanced platforms [25]. Given the large number of candidate vaccines now in clinical studies, the World Health Organization (WHO) [28], [29], the US Food & Drug Administration (FDA) [30], and the European Medicines Agency (EMA) [24] have provided various guidance documents to identify appropriate regulatory pathways, development gaps and critical data sets to support the advancement of viral vector-based vaccines to licensure.

The Brighton Collaboration formed the Viral Vector Vaccines Safety Working Group (V3SWG) in October 2008 to help standardize the collection, analysis and dissemination of safety data regarding viral vector vaccines in pre- and post-licensure settings [31]. The V3SWG hopes that by improving our ability to anticipate safety issues and meaningfully assess and interpret safety data from clinical trials of new viral vectored-vaccines, this will enhance safety knowledge as well as public confidence and vaccine uptake once licensed.

One way to enhance our understanding of vectored-vaccine safety is to improve surveillance for Adverse Events Following Immunization (AEFI). Vaccine Associated Adverse Events (VAERS), sponsored by CDC and the FDA, has been in use since the 1990s (see below). Robust vaccine safety monitoring has many advantages including the discovery of potentially novel and unanticipated adverse events associated with vectored vaccines, the development and use of safer vaccines and minimization of the risk of Adverse Events (AE) after vaccination by providing specific recommendations, including contraindications and precautions for use [31], [32], [33], [34], [35].

As some live recombinant vectored-vaccines may integrate, one key challenge is defining the length of time for monitoring potentially related AEFI after receipt of viral vectored-vaccines. This time period must be chosen with care and based on considerations of clinical trials data and biological plausibility [36]. The follow-up time must be long enough to include (a) the plausible period of increased risk (also called “risk window” or “risk interval”), and (b) the comparison control “non-risk” time period for study designs where this period occurs post- (vs. pre-) risk window. In some studies of vaccine-associated Guillain Barré syndrome (GBS), the risk interval included days 1–42 after vaccination during which vaccine-associated GBS was considered to be biologically plausible and the control interval was days 43–84 after vaccination. The number of events of each type was tabulated each week and the number of AE in the post-vaccination window was compared with the number in the pre-vaccination window. This case-only self-controlled method (also referred to as self-controlled case series or SCCS) is commonly used in influenza vaccine safety studies to eliminate between-person biases [37]. SCCS is a preferred study design to avoid the “healthy vaccinee” effect (HVE) commonly associated with pre-risk control windows. HVE refers to the fact that if an individual has been ill, recently hospitalized, or otherwise unwell, vaccination may be deferred by the health care provider, patient or primary caregiver until the health of the individual improves. This consideration is especially true for vaccinations in early infancy. Therefore, a vaccinated individual is more likely to be in a healthy state immediately before and after their vaccination. Consequently, HVE reduces AE rates in the immediate pre- and post-vaccination periods, reducing the power to detect AE [38]. Selecting a surveillance duration that is too short or too long could cause a true increase in risk to be missed or obscured by random noise. Ideally, this duration should be based on statistical power considerations (e.g., continued until 90% power is achieved to detect the minimum absolute excess risk that is important for public health) and continued until any important risk can be ruled out. Due to the differences in background rates of specific AESI, the length of planned surveillance may differ by outcome for the same vaccine under study [39]. AESI may take time to manifest and be detected (e.g., the VSV Ebola vaccine that was found in synovial fluid causing arthritis) [11].

A long duration of monitoring is often challenging in low- and middle-income countries (LMIC) with limited health infrastructure, in countries with evolving AEFI monitoring systems with multiple priorities and even in countries with excellent infrastructure which are challenged with new diseases and new vaccines [40], [41].

2. Options for defining the length of follow-up

Some of the available options for defining the optimal length of follow-up for use in clinical trials and epidemiological studies of new pharmaceutical products, including viral vectored-vaccine candidates, are mentioned below.

  • (1)

    Adapt from current relevant existing guidelines

The Risk Interval Working Group of the Clinical Immunization Safety Assessment Network (CISA) was formed in September 2010 due to the critical role that correct specification of risk and control intervals for AEFI play in observational studies of vaccine safety, and the relative paucity of work done to formally assess and determine biologically plausible and evidence-based risk intervals [36]. The group used febrile seizure and acute disseminated encephalomyelitis as models to provide an in-depth review of methodological issues related to the selection of risk and control intervals for consideration in future studies of immunization safety. As knowledge of the risk profile relative to the time since immunization for many AEFI is often incomplete, choosing more than one (e.g., a short and long) biologically plausible risk interval to evaluate in an active surveillance study may be appropriate.

The 2006 FDA guidance on Gene Therapy Clinical Trials – Observing Subjects for Delayed Adverse Events [42] currently explicitly states it does not apply to “Vaccines used to prevent infectious diseases even if you use products analogous to those used for gene therapy.” Nevertheless, its guidance may provide a starting upper bound of a plausible risk interval(s), which may be adjusted downwards for a shorter interval(s) with an appropriate scientific rationale. For example, this guidance recommends a minimum 15-year follow-up, with a possibly shorter risk period(s) if supporting evidence is available (e.g., duration of in vivo vector persistence, transgene expression, feasibility etc.).

The 2015 FDA guidance on Considerations for the Design of Early-Phase Clinical Trials of Cellular and Gene Therapy (CGT) Products [43], states that a year or more of follow-up is appropriate for subjects in early-phase trials.

One source of relevant guidance more suited for resource-limited settings comes from maternal immunization trials [44]. The minimum recommended follow-up period for women is 6 months post-delivery or following the early termination of pregnancy. The minimum recommended follow-up period for infants is until 1 year of age.

Guidance [44] also allows for both shorter and longer follow-up periods with adequate scientific justification. The appropriate duration of follow-up depends on the results of preclinical studies, experience with related products, knowledge of the disease process, biological characteristics of the vaccine, the vaccine-targeted disease or an AESI, including outcomes identified in previous trials, or the characteristics of the vaccine recipient (e.g., nutritional state, underlying diseases such as immune-compromising condition and other associated co-morbidity conditions), or the intention to assess early childhood development (in the case of vaccines for pregnant women) and late-onset outcomes as part of the Risk Management Plan (which may require follow-up periods of 5 years or more). These guidelines acknowledge there are significant logistical challenges with extended follow-up periods, especially in resource-limited settings [40], [44].

In general, long-term monitoring focuses on subject survival, on serious adverse events and AESI (that could include hematologic, immunologic, neurologic, or oncologic AESI). For some purposes, a telephone call to the subject, rather than a clinic visit, may be sufficient to obtain the necessary follow-up information. In addition, completion of long-term monitoring usually is not necessary prior to initiating subsequent trials or submitting a marketing application [43]. Nevertheless, long-term monitoring in LMIC utilizing modern data collection methodology and recipient tracking to detect AEFI will be needed when a new viral vector vaccine is first introduced in these LMIC countries. Otherwise, the new vaccine’s large-scale use may be delayed until such data has been gathered in other countries/settings with appropriate infrastructure.

  • (2)

    Convening a panel of experts to review the evidence from a systematic literature search to narrow down a list of likely or known AEFI and establish the optimal risk window(s)

The Delphi technique is well suited for consensus-building and may be considered for the panel. It utilizes a series of questionnaires delivered using multiple iterations to collect data from a panel of selected subjects. It provides anonymity to respondents, a controlled feedback process, and the suitability of a variety of statistical analysis techniques to interpret the data. Subject selection, time frames for conducting and completing a study, the possibility of low response rates, and unintentionally guiding feedback from the respondent group are areas which should be considered when designing and implementing a Delphi study [45].

For new viral vectored-vaccine candidates, it would involve convening a panel of experts with an appropriate understanding of the biological mechanism of action of the new viral vectored-vaccine and which AESI it may plausibly cause and the likely onset time frame for their occurrence. Such an expert panel was recently convened and was instrumental in developing the Vaccine Safety Datalink’s (VSD) white paper to prioritize studies of the safety of routine childhood immunization schedule [46]. Once the specific AESI(s) and likely risk interval(s) have been pre-specified as hypothesis, the existing pharmacovigilance and pharmacoepidemiological infrastructure designed for pre- and post-marketing can be marshaled to detect and if needed, validate these safety signals.

While this expert-based approach has been widely used historically, the list of previously unsuspected AE once a pharmaceutical product is widely used is long [47]. Unlike efficacy and effectiveness, vaccine safety cannot be measured directly. Human clinical trials typically are conducted using healthy non-pregnant volunteers and the safety assessment is focused on common short-term pre-specified local and systemic AE (e.g., pain at injection site, fever). Rare but serious adverse events associated with vaccines or drugs are often nearly impossible to detect on account of the selected enrollment and limited follow-up of subjects in pre-licensure studies and their detection requires conducting post-marketing monitoring (also called pharmacovigilance) after the introduction in the general population. The FDA also requires more diversity in the population studied because the incidence of AEFI might vary in different populations [48]. Safety of these products can only be inferred by the relative absence of AESI when the population exposed to the new pharmaceutical product of interest is sufficiently large, diverse and monitored adequately. Absolute safety, while understandably desired as a goal, is difficult to assess, let alone guarantee, especially early in the lifecycle of any new product.

  • (3)

    “Real-time“ prospective monitoring for unknown clusters of AEFIs in settings with validated large linked vaccine safety databases

Traditionally, passive surveillance (also called spontaneous reporting) systems have served as a relatively affordable first line source of signals of previously unknown AEFI. The practice of conducting manual individual case reviews is now usually augmented by implementing computerized data mining algorithms on the entire MedDRA coded adverse event database to detect patterns of disproportionate reporting of adverse events [49]. The US FDA and EMA have mandatory requirements for passive reporting of AEFI to the Vaccine Adverse Event Reporting System (VAERS) [47] and EudraVigilance systems [50], respectively. The World Health Organization (WHO) is helping many LMICs improve their capacity to monitor AEFI [51], and these efforts could help to upgrade the capacity to monitor AEFIs over longer follow up periods (including coding AEFI for ICD (International Classification of Diseases), MedDRA (Medical Dictionary for Regulatory Activities) etc. beyond the short follow-up periods currently used.

To help overcome the many methodological limitations of passive surveillance for AEFI (e.g., under-reporting, biased reporting, lack of control groups) [52], several high-income countries have developed active surveillance systems for AEFI for analyses of the association between a vaccine and one or more pre-specified adverse health outcomes. For example, the CDC created the Vaccine Safety Datalink [53] (VSD) project in 1990 in collaboration with several managed care organizations. The VSD uses a distributed data model and de-identified International Classification of Diseases (ICD) coded data downloaded from the individual’s electronic health record to track the use of health services by the members of each participating site. This includes information on vaccinations (e.g., vaccine type, date of vaccination, and other vaccinations given on the same day) and the specific medical illnesses that have been diagnosed at doctors’ offices, urgent care visits, emergency department visits, and hospital stays. AEFI need to be coded accurately to be able to be found in the database. The US FDA oversees a complementary active safety surveillance system for vaccines called the Post-Licensure Rapid Immunization Safety Monitoring (PRISM) program [54]. This consists mostly of insurance claims. The program is attempting to move to healthcare records and this brings with it new challenges.

Traditionally, the VSD and the PRISM systems conduct rigorous vaccine safety studies (e.g., comparing rates of AEFI within risk intervals to rates in control intervals) to test the hypothesized questions or concerns raised from the medical literature and reports to the VAERS. Such VSD studies usually take several years from inception to completion, however. VSD and PRISM studies, while population-based and rigorously conducted, have generally not addressed identification of previously unsuspected possible adverse reactions [55].

The Rapid Cycle Analysis (RCA) method of the VSD was created to allow more timely (e.g., weekly) analysis of pre-specified AESI with pre-specified risk intervals so the public can be informed quickly of possible risks of newly licensed vaccines or new immunization schedules [56]. The RCA uses dynamic data files, aggregation of data, and sequential analysis methods (a new signal detection method that supports continuous or time-period analysis of data as they are collected, adjusting for the multiple statistical testing). PRISM now is developing RCA capabilities. There are also reliable registries in countries like Denmark and Sweden that can do such studies [57].

Excitingly, prospectively scanning for unknown clusters of new AESI in both clinical trial participants, and if licensed, in vaccines in routine use in the general population has become a reality. In the era of “large data”, the dream has been to develop methods that allow for ongoing scanning of administrative health records of pharmaceutical product exposures and medical outcomes for new safety signals, especially those not previously specified. Given the large number of statistical tests done, adjustments for multiple testing are needed to minimize the number of false positive signals that would otherwise waste valuable time and resources needed for assessment of true signals. This hope is coming closer to fruition with the development of the just described RCA for pre-specified AESI [58], [59] and TreeScan [60] (https://www.treescan.org/) for previously unspecified outcomes.

TreeScan is a novel scan statistical method by which the surveillance can be conducted with a minimum of prior assumptions about the group of vaccines that increase risk, and which adjusts for the multiple testing inherent in the many potential combinations [61]. TreeScan is free data mining software that implements the tree-based scan statistic, a data mining method that simultaneously looks for excess risk in any of a large number of individual cells in a database as well as in groups of closely related cells, adjusting for the multiple testing inherent in the large number of overlapping groups evaluated. It has been developed for disease surveillance. For pharmacovigilance, it can be used to simultaneously evaluate thousands of potential adverse events and groups of adverse events, to determine if any one of them occur with higher probability among people exposed to a particular vaccine. For a particular disease outcome (e.g. kidney failure), it can be used to simultaneously evaluate if it occurs with increased risk among people exposed any of hundreds of pharmaceutical drugs or vaccines, or groups of related drugs or vaccines (https://www.treescan.org/). The TreeScan method allows a wide range of unsuspected but potentially adverse reactions to be simultaneously evaluated and otherwise unknown adverse reactions may be found. The main disadvantage is that it is not possible to adjust for all possible confounders. Indeed, no conclusion about causality should be based on TreeScan analyses alone. In effect, the TreeScan method serves as a tool for identifying AE that may merit a further careful pharmaco-epidemiologic investigation [55]. Treescan is only beginning to be used more widely, so more time is needed to assess its effectiveness (e.g., AESI with insidious onset have traditionally been challenging to study in traditional large-linked databases using methods requiring a prior definition of risk intervals). The use of Treescan will also likely to be limited to settings with high-quality administrative health (including immunization) records initially. For LMICs, this requirement may be more likely to be met in some urban centers and INDEPTH Network sites.

The risk-interval established by one or more of the above-mentioned methods can be used with the following option.

  • (4)

    AESI registry and case-control studies

In the cancer field, specific cancer disease registries have been very effective research tools [62]. Case-control studies are particularly suitable for the study of relatively rare diseases with a long induction period, such as cancer and possible AESI. Since cases in a case-control are by definition subjects who have already developed the condition of interest, there is no need to wait for time to elapse. A similar approach can be taken for safety monitoring of viral vector vaccine candidates with the establishment of a registry of cases identified with clinically valid pre-specified AESI and matched controls found from the hospital or neighborhood to compare for vaccine exposure history. These studies can be multi-national under a similar protocol. Given the rarity of these AESI, this is likely feasible only with post-marketing surveillance after substantial vaccine use has occurred. For settings where high-quality administrative health records are unlikely to be a reality in near future, this may be one possible alternative.

3. Conclusion

Live viral vectors that express heterologous antigens of the target pathogen in vivo are being investigated in the development of vaccines for numerous infectious diseases, making use of a variety of viral vectors. Live viral vectored vaccines may be based on replication-defective as well as replication-competent viruses. As some live recombinant vectored vaccine may replicate, one key challenge is defining the length of time for monitoring AEFI after administration of vectored vaccines in clinical trials and epidemiological studies. This time period must be chosen with care and based on considerations of clinical trial data and biological plausibility. A long duration of monitoring is often challenging in countries with poor health infrastructure, in countries with evolving AEFI monitoring systems with multiple priorities and even in countries with excellent infrastructure which are challenged with new diseases and new vaccines [36], [40]. Some of the available options for defining the length of follow-up to be used in studies of new viral vector vaccine candidates include adapting from current relevant regulatory guidelines; convening a panel of experts to review the evidence from a systematic literature search to narrow down a list of likely or known AEFI and optimal biologically plausible risk window(s); conducting “near-real-time“ prospective monitoring for unknown clustering’s of AEFI in validated large linked vaccine safety databases (e.g., Vaccine Safety Datalink (VSD), PRISM, etc.). This includes Rapid Cycle Analysis (RCA) for pre-specified AESI and TreeScan for previously unsuspected outcomes. The risk interval established by one of the above-mentioned methods can be used along with establishing a registry of cases identified with clinically validated pre-specified AESI to include in case-control studies. The available infrastructure, human and financial resources, coded databases in countries and regulatory guidelines will determine which (one or a combination) of these methods would be practically feasible. These options might be broadly applicable to the duration of surveillance for other new pharmaceutical products. The risk intervals selected for clinical trials or epidemiologic studies may not be of the appropriate length to rule out associations in individual cases. Since our knowledge of the pathophysiology of many AEFI is incomplete; a longer risk interval may be required when evaluating an AEFI in an individual. Rare individuals may have genetic immune defects that result in increased susceptibility to vaccine viruses. Mortality rates in vaccine recipients with such defects may be high. However, because of their rarity, they are likely to be discovered only in post-marketing analyses [63].

4. Disclaimer

The findings, opinions, conclusions, and assertions contained in this consensus document are those of the individual members of the Working Group. They do not necessarily represent the official positions of any participant’s organization (e.g., government, university, or corporations) and should not be construed to represent any Agency determination or policy.

Acknowledgments

We thank the following for helpful advice: (1) Martin Kulldorf, Katherine Yih, Paul Garguillo; and (2) other members of the V3SWG during the preparation of this document: Lisa Mac, Louisa Chapman, Richard Condit, Michael Hendry, and Anna-Lise Williamson.

Conflict of interest

Dr Marc Gurwith is employed by PaxVax, Inc which markets and develops vaccines, including developing an adenovirus vector vaccine. He also consults for several other biotech companies, but none develop vector vaccines currently.

Footnotes

Appendix A

Supplementary data to this article can be found online at https://doi.org/10.1016/j.vaccine.2018.08.085.

Appendix A. Supplementary material

The following are the Supplementary data to this article:

Supplementary data 1
mmc1.xlsx (14.2KB, xlsx)

References

  • 1.Rémy V., Zöllner Y., Heckmann U. Vaccination: the cornerstone of an efficient healthcare system. J Mark Access Health Policy. 2015;3 doi: 10.3402/jmahp.v3.27041. 10.3402/jmahp.v3.27041 [PMCID: PMC4802703] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Ozawa S., Mirelman A., Stack M.L., Walker D.G., Levine O.S. Cost-effectiveness and economic benefits of vaccines in low- and middle-income countries: a systematic review. Vaccine. 2012;31(1):96–108. doi: 10.1016/j.vaccine.2012.10.103. [DOI] [PubMed] [Google Scholar]
  • 3.Centlivre M., Combadière B. New challenges in modern vaccinology. BMC Immunol. 2015;16:18. doi: 10.1186/s12865-015-0075-2. [PMCID: PMC4374378] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Kuleš J., Horvatić A., Guillemin N., Galan A., Mrljak V., Bhide M. New approaches and omics tools for mining of vaccine candidates against vector-borne diseases. Mol Biosyst. 2016;12(9):2680–2694. doi: 10.1039/c6mb00268d. [DOI] [PubMed] [Google Scholar]
  • 5.Souza A.P., Haut L., Reyes-Sandoval A., Pinto A.R. Recombinant viruses as vaccines against viral diseases. Braz J Med Biol Res. 2005;38(4):509–522. doi: 10.1590/s0100-879x2005000400004. [PPMID: 15962176] [DOI] [PubMed] [Google Scholar]
  • 6.Choi Y., Chang J. Viral vectors for vaccine applications. Clin Exp Vacc Res. 2013;2(2):97–105. doi: 10.7774/cevr.2013.2.2.97. [PMCID: PMC3710930] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Parks C.L., Picker L.J., King C.R. Development of replication-competent viral vectors for HIV vaccine delivery. Curr Opin HIV AIDS. 2013;8(5):402–411. doi: 10.1097/COH.0b013e328363d389. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Limbach K.J., Richie T.L. Viral vectors in malaria vaccine development. Parasite Immunol. 2009;31(9):501–519. doi: 10.1111/j.1365-3024.2009.01141.x. [DOI] [PubMed] [Google Scholar]
  • 9.de Vries R.D., Rimmelzwaan G.F. Viral vector-based influenza vaccines. Hum Vaccin Immunother. 2016;12(11):2881–2901. doi: 10.1080/21645515.2016.1210729. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Kapadia S.U., Simon I.D., Rose J.K. SARS vaccine based on a replication-defective recombinant vesicular stomatitis virus is morepotent than one based on a replication-competent vector. Virology. 2008;376(1):165–172. doi: 10.1016/j.virol.2008.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Chappell K.J., Watterson D. Fighting Ebola: a window for vaccine re-evaluation? PLoS Pathog. 2017;13(1):e1006037. doi: 10.1371/journal.ppat.1006037. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Halliday J., Klenerman P., Barnes E. Vaccination for hepatitis C virus: closing in on an evasive target. Expert Rev Vacc. 2011;10(5):659–672. doi: 10.1586/erv.11.55. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Guvenel A.K., Chiu C., Openshaw P.J. Current concepts and progress in RSV vaccine development. Expert Rev Vacc. 2014;13(3):333–344. doi: 10.1586/14760584.2014.878653. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Kaufmann S.H., Weiner J., von Reyn C.F. Novel approaches to tuberculosis vaccine development. Int J Infect Dis. 2017;56:263–267. doi: 10.1016/j.ijid.2016.10.018. [DOI] [PubMed] [Google Scholar]
  • 15.<http://www.who.int/immunization/research/meetings_workshops/viral_vecto_meeting_oct13/en/> [accessed on 23 March 2018].
  • 16.Cho H., Excler J.L., Kim J.H., Yoon IK. Development of Middle East Respiratory Syndrome Coronavirus vaccines – advances and challenges. Hum Vaccin Immunother. 2018;14(2):304–313. doi: 10.1080/21645515.2017.1389362. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Ewer K., Sebastian S., Spencer A.J., Gilbert S., Hill A.V.S., Lambe T. Chimpanzee adenoviral vectors as vaccines for outbreak pathogens. Hum Vaccin Immunother. 2017;13(12):3020–3032. doi: 10.1080/21645515.2017.1383575. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Chattopadhyay A., Aguilar P.V., Bopp N.E., Yarovinsky T.O., Weaver S.C., Rose J.K. A recombinant virus vaccine that protects against both Chikungunya and Zika virus infections. Vaccine. 2018;36(27):3894–3900. doi: 10.1016/j.vaccine.2018.05.095. pii: S0264-410X(18)30761-8. [DOI] [PubMed] [Google Scholar]
  • 19.Lauer K.B., Borrow R., Blanchard T.J. Multivalent and multipathogen viral vector vaccines. Clin Vaccine Immunol. 2017;24(1) doi: 10.1128/CVI.00298-16. pii: e00298-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Rayner J.O., Dryga S.A., Kamrud K.I. Alphavirus vectors and vaccination. Rev Med Virol. 2002;12(5):279–296. doi: 10.1002/rmv.360. [DOI] [PubMed] [Google Scholar]
  • 21.Weli S.C., Tryland M. Avipoxviruses: infection biology and their use as vaccine vectors. Virol J. 2011;8:49. doi: 10.1186/1743-422X-8-49. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Altenburg A.F., Kreijtz J.H., de Vries R.D., Song F., Fux R., Rimmelzwaan G.F. Modified vaccinia virus Ankara (MVA) as production platform for vaccines against influenza and other viral respiratory diseases. Viruses. 2014;6(7):2735–2761. doi: 10.3390/v6072735. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Crosby C.M., Matchett W.E., Anguiano-Zarate S.S., Parks C.A., Weaver E.A., Pease L.R. Replicating single-cycle adenovirus vectors generate amplified influenza vaccine responses. J Virol. 2017;91(2) doi: 10.1128/JVI.00720-16. pii: e00720-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Nascimento I.P., Leite L.C. Recombinant vaccines and the development of new vaccine strategies. Braz J Med Biol Res. 2012;45(12):1102–1111. doi: 10.1590/S0100-879X2012007500142. PMCID: PMC3854212. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Guideline on quality, non-clinical and clinical aspects of live recombinant viral vectored vaccines. European Medicines Agency; 24 June 2010. <http://www.ema.europa.eu/docs/en_GB/document_library/Scientific_guideline/2010/08/WC500095721.pdf> [accessed on 23 March 2018].
  • 26.Condit R.C., Williamson A.L., Sheets R., Seligman S.J., Monath T.P., Excler J.L. Unique safety issues associated with virus-vectored vaccines: potential for and theoretical consequences of recombination with wild type virus strains. Vaccine. 2016;34(51):6610–6616. doi: 10.1016/j.vaccine.2016.04.060. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Lauer K.B., Borrow R., Blanchard T.J. Multivalent and multipathogen viral vector vaccines. Clin Vacc Immunol. 2017;24(1) doi: 10.1128/CVI.00298-16. pii: e00298-16, Print 2017 Jan. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.WHO informal consultation: development of viral vectored vaccines for HIV, malaria, tuberculosis and other indications; October 2013. <http://www.who.int/immunization/research/meetings_workshops/Oct2013_viral_vector_meeting_comments.pdf> [accessed on 23 March 2018].
  • 29.WHO informal consultation on characterization and quality aspect of vaccines based on live viral vectors; December 2003. <http://www.who.int/immunization/research/meetings_workshops/viral_vectors_report_full.pdf> [accessed on 23 March 2018].
  • 30.Methods for improving the safety and efficacy of vaccines against emerging virus pathogens. <https://www.fda.gov/BiologicsBloodVaccines/ScienceResearch/BiologicsResearchAreas/ucm127331.htm> [accessed on 23 Mar 2018].
  • 31.Chen R.T., Carbery B., Mac L., Berns K.I., Chapman L., Condit R.C. The Brighton collaboration viral vector vaccines safety working group (V3SWG) Vaccine. 2015;33(1):73–75. doi: 10.1016/j.vaccine.2014.09.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Chen R.T., Davis R.L., Rhodes P.H. Special methodological issues in pharmacoepidemiology studies of vaccine safety. In: Strom B.L., editor. Pharmacoepidemiology. 4th ed. John Wiley & Sons; Sussex: 2005. [Google Scholar]
  • 33.Kochhar S. Communicating vaccine safety during the development and introduction of vaccines. Curr Drug Saf. 2015;10(1):55–59. doi: 10.2174/157488631001150407110435. PMID: 25859676. [DOI] [PubMed] [Google Scholar]
  • 34.Miller Elaine R, Haber Penina, Hibbs Beth, Broder Karen. Surveillance for adverse events following immunization using the Vaccine Adverse Event Reporting System (VAERS). Manual for the surveillance of vaccine-preventable diseases, 5th ed.; 2011.
  • 35.Kochhar S., Bauwens J., Bonhoeffer J. Safety assessment of immunization in pregnancy. Vaccine. 2017;35(48Part A):6469–6471. doi: 10.1016/j.vaccine.2017.09.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Rowhani-Rahbar A., Klein N.P., Dekker C.L., Edwards K.M., Marchant C.D., Vellozzi C. Biologically plausible and evidence-based risk intervals in immunization safety research. Vaccine. 2012;31(1):271–277. doi: 10.1016/j.vaccine.2012.07.024. [DOI] [PubMed] [Google Scholar]
  • 37.Prestel J., Volkers P., Mentzer D., Lehmann H.C., Hartung H.P., Keller-Stanislawski B., GBS Study Group Risk of Guillain-Barré syndrome following pandemic influenza A(H1N1) 2009 vaccination in Germany. Pharmacoepidemiol Drug Saf. 2014;23(11):1192–1204. doi: 10.1002/pds.3638. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Hawken S., Potter B.K., Little J., Benchimol E.I., Mahmud S., Ducharme R. The use of relative incidence ratios in self-controlled case series studies: an overview. BMC Med Res Methodol. 2016;16(1):126. doi: 10.1186/s12874-016-0225-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Yih W.K., Kulldorff M., Fireman B.H., Shui I.M., Lewis E.M., Klein N.P. Active surveillance for adverse events: the experience of the Vaccine Safety Datalink project. Pediatrics. 2011;127(Suppl 1):S54–S64. doi: 10.1542/peds.2010-1722I.41. [DOI] [PubMed] [Google Scholar]
  • 40.Kochhar S., Bonhoeffer J., Jones C.E., Muñoz F.M., Honrado A., Bauwens J., Sobanjo-Ter Meulen A., Hirschfeld S. Immunization in pregnancy clinical research in low- and middle-income countries – study design, regulatory and safety considerations. Vaccine. 2017;35(48 Pt A):6575–6581. doi: 10.1016/j.vaccine.2017.03.103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.World Health Organization report of the second meeting of the global vaccine safety initiative, 19–20 November 2013, New Delhi, India. <http://www.who.int/vaccine_safety/publications/GVSI_meeting2_india_Nov_2013_report.pdf> [accessed on 26 March 2018].
  • 42.FDA guidance for industry gene therapy clinical trials – observing subjects for delayed adverse events; November 2006. <https://www.fda.gov/downloads/BiologicsBloodVaccines/GuidanceComplianceRegulatoryInformation/Guidances/CellularandGeneTherapy/ucm078719.pdf> [accessed on Jan 25, 2018].
  • 43.June 2015 FDA guidance on considerations for the design of early-phase clinical trials of cellular and gene therapy products. <https://www.fda.gov/downloads/BiologicsBloodVaccines/GuidanceComplianceRegulatoryInformation/Guidances/CellularandGeneTherapy/UCM564952.pdf> [accessed on 12 April 2018].
  • 44.Jones C.E., Munoz F.M., Spiegel H.M., Heininger U., Zuber P.L., Edwards K.M. Guideline for collection, analysis and presentation of safety data in clinical trials of vaccines in pregnant women. Vaccine. 2016;34(49):5998–6006. doi: 10.1016/j.vaccine.2016.07.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Hsu C.C., Sandford B.A. The Delphi technique: making sense of consensus. Pract Assess Res Eval. 2007;12(10):1–8. [accessed on 26 March 2018] [Google Scholar]
  • 46.Glanz J.M., Newcomer S.R., Jackson M.L., Omer S.B., Bednarczyk R.A., Shoup J.A. White paper on studying the safety of the childhood immunization schedule in the Vaccine Safety Datalink. Vaccine. 2016;34(Suppl 1):A1–A29. doi: 10.1016/j.vaccine.2015.10.082. [DOI] [PubMed] [Google Scholar]
  • 47.Shimabukuro T., Nguyen M., Martin D., DeStefano F. Safety monitoring in the Vaccine Adverse Event Reporting System (VAERS) Vaccine. 2015;33(36):4398–4405. doi: 10.1016/j.vaccine.2015.07.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Statement on narcolepsy and vaccination. Global vaccine safety; April 2011. <http://www.who.int/vaccine_safety/committee/topics/influenza/pandemic/h1n1_safety_assessing/narcolepsy_statement/en/> [accessed on 12 April 2018].
  • 49.Harpaz R., DuMouchel W., LePendu P., Bauer-Mehren A., Ryan P., Shah N.H. Performance of pharmacovigilance signal-detection algorithms for the FDA adverse event reporting system. Clin Pharmacol Ther. 2013;93(6):539–546. doi: 10.1038/clpt.2013.24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Borg J.J., Aislaitner G., Pirozynski M., Mifsud S. Strengthening and rationalizing pharmacovigilance in the EU: where is Europe heading to? A review of the new EU legislation on pharmacovigilance. Drug Saf. 2011;34(3):187–197. doi: 10.2165/11586620-000000000-00000. [DOI] [PubMed] [Google Scholar]
  • 51.Lei J., Balakrishnan M.R., Gidudu J.F., Zuber P.L.F. Use of a new global indicator for vaccine safety surveillance and trends in adverse events following immunization reporting 2000–2015. Vaccine. 2018;36(12):1577–1582. doi: 10.1016/j.vaccine.2018.02.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Varricchio F., Iskander J., Destefano F., Ball R., Pless R., Braun M.M. Understanding vaccine safety information from the Vaccine Adverse Event Reporting System. Pediatr Infect Dis J. 2004;23(4):287–294. doi: 10.1097/00006454-200404000-00002. [DOI] [PubMed] [Google Scholar]
  • 53.Vaccine Safety Datalink. <https://www.cdc.gov/vaccinesafety/ensuringsafety/monitoring/vsd/index.html> [assessed on 6 March 2018].
  • 54.Baker M.A., Nguyen M., Cole D.V., Lee G.M., Lieu T.A. Post-licensure rapid immunization safety monitoring program (PRISM) data characterization. Vaccine. 2013;31(Suppl 10):K98–K112. doi: 10.1016/j.vaccine.2013.04.088. [DOI] [PubMed] [Google Scholar]
  • 55.Pilot of self-controlled tree-temporal scan analysis for gardasil vaccine. <https://www.sentinelinitiative.org/sites/default/files/Methods/Mini-Sentinel_PRISM_Pilot-Self-Controlled-Tree-Temporal-Scan-Analysis-Gardasil-Vaccine-Protocol_0.pdf> [accessed on 2 April 2018].
  • 56.Davis R.L. Vaccine safety surveillance systems: critical elements and lessons learned in the development of the US Vaccine Safety Datalink’s rapid cycle analysis capabilities. Pharmaceutics. 2013;5(1):168–178. doi: 10.3390/pharmaceutics5010168. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Huang Y.L., Moon J., Segal J.B. A comparison of active adverse event surveillance systems worldwide. Drug Saf. 2014;37(8):581–596. doi: 10.1007/s40264-014-0194-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Yih W.K., Kulldorff M., Sandhu S.K., Zichittella L., Maro J.C., Cole D.V. Prospective influenza vaccine safety surveillance using fresh data in the Sentinel System. Pharmacoepidemiol Drug Saf. 2016;25(5):481–492. doi: 10.1002/pds.3908. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Yih W.K., Maro J.C., Nguyen M., Baker M.A., Balsbaugh C., Cole D.V. Assessment of quadrivalent human papillomavirus vaccine safety using the self-controlled tree-temporal scan statistic signal-detection method in the Sentinel System. Am J Epidemiol. 2018 doi: 10.1093/aje/kwy023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Kulldorff M., Dashevsky I., Avery T.R., Chan A.K., Davis R.L., Graham D. Drug safety data mining with a tree-based scan statistic. Pharmacoepidemiol Drug Saf. 2013;22(5):517–523. doi: 10.1002/pds.3423. [DOI] [PubMed] [Google Scholar]
  • 61.Kulldorff M., Fang Z., Walsh S.J. A tree-based scan statistic for database disease surveillance. Biometrics. 2003;59(2):323–331. doi: 10.1111/1541-0420.00039. PMID: 12926717. [DOI] [PubMed] [Google Scholar]
  • 62.Case-control study in dos Santos Silva, I (ed.) Cancer epidemiology: principles and methods. Lyon (France): International Agency for Research on Cancer (IARC); 1999. <http://www.iarc.fr/en/publications/pdfs-online/epi/cancerepi/CancerEpi-9.pdf> [accessed on 26 March 2018] [chapter 9].
  • 63.Casanova J.L., Conley M.E., Seligman S.J., Abel L., Notarangelo L.D. Guidelines for genetic studies in single patients: lessons from primary immunodeficiencies. J Exp Med. 2014;211(11):2137–2149. doi: 10.1084/jem.20140520. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Chen R., Carbery B., Mac L., Chapman L., Condit R., Excler J.L. The Brighton Collaboration Vector Vaccines safety Working Group (V3SWG) Vaccine. 2015;33(1):73–75. doi: 10.1016/j.vaccine.2014.09.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Wu N.C., Zost S.J., Thompson A.J., Oyen D., Nycholat C.M., McBride R. A structural explanation for the low effectiveness of the seasonal influenza H3N2 vaccine. PLoS Pathog. 2017;13(10):e1006682. doi: 10.1371/journal.ppat.1006682. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Shi M., An Q., Ainslie K.E.C., Haber M., Orenstein W.A. A comparison of the test-negative and the traditional case-control study designs for estimation of influenza vaccine effectiveness under nonrandom vaccination. BMC Infect Dis. 2017;17(1):757. doi: 10.1186/s12879-017-2838-2. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data 1
mmc1.xlsx (14.2KB, xlsx)

Articles from Vaccine are provided here courtesy of Elsevier

RESOURCES