What timing of vaccination is potentially dangerous for children younger than 2 years?

ABSTRACT

Vaccine-preventable diseases still occur although measured coverage rates at 2 y of age are high. The occurrence of these diseases may be explained in part by untimely, that is, late vaccination. Our objective was to identify potentially dangerous vaccination delays for each dose of each vaccine in children younger than 2 y. A 3-round Delphi process was conducted by e-mail. We recruited 37 French experts in vaccines for children: 16 from the Infovac-France group and 21 from the French study group for pediatric infectious diseases. Items were generated by a literature review for the 10 vaccine doses recommended before 2 y of age. Item reduction in round 1 and 2 and any consensus in round 3 used a 70% consensus cutoff. The mean participation rate was 79%. Delays that should not be exceeded were identified for all vaccine doses. The 70% consensus was reached for 6 of the 10 vaccine doses: 15 d after the recommended date for the first 2 doses of the diphtheria-tetanus-acellular pertussis-inactivated polio vaccine/Haemophilus influenzae b vaccine and for the second dose of the pneumococcal conjugate vaccine, 1 month for the meningococcal C vaccine and for the first dose of the measles-mumps-rubella vaccine, and 11 y of age for completion of the hepatitis B vaccination. This Delphi process identified potentially dangerous vaccination delays for children to the age of 2 y. These can be used as new indicators in further studies of vaccine effectiveness and can help to improve the quality of vaccine protection in children.

Introduction

There are several available indicators of the effectiveness of vaccination programs. Among them, vaccine coverage is currently a useful indicator of vaccine uptake by the physicians and populations concerned. It is however a broad feature measured at ages beyond the recommended ages for vaccination. For example, its measurement at 2 y of age does not detect vaccination delays for vaccines recommended at various times before this age.¹ Vaccine-preventable diseases such as pertussis and invasive meningococcal or pneumococcal infections still cause severe illness, disabilities and death despite high levels of vaccine coverage.^2-7 Analysis of a pertussis outbreak in 2010 showed that 140/275 (51%) infants with pertussis could have had 1 dose of the vaccine and 22% at least 2 doses.² The main reason is a delay or failure to vaccinate some patients, resulting in the absence of protection.

Although vaccine coverage rates can be high for the main vaccines recommended for children under 2, giving vaccinations later than recommended can have 2 consequences. The first is an increased risk of vaccine-preventable infections for susceptible infants at the ages of greatest vulnerability, especially when the peak of incidence of the disease is very close to the recommended age of vaccination. A study in the United States a few years ago reported that 55% of children had not received all recommended doses by 24 months of age.⁸ A study in low and middle-income countries showed substantial delays in primary routine vaccination (more than 2 months for more than 25% of children).⁹ The second consequence of delaying vaccination is not completing the immunization schedule by domino effect;¹⁰ this may explain outbreaks of vaccine-preventable infections in healthy children, adolescents and adults.^11,12

These consequences of delay underline the importance of timely vaccination and the potential impact of vaccinations administered later than scheduled. They can have important implications for the effect of new and established vaccines on the burden of these diseases. Potentially dangerous vaccination delays have never been defined. Different cutoffs have been suggested, ranging from 2 weeks to 6 months for the same vaccine.¹⁰ This cutoff can moreover vary one vaccine to another and one dose to another for the same vaccine, depending on the epidemiology and severity of the vaccine-preventable disease and the immunization schedule. A quantitative definition of a potentially dangerous vaccination delay could be useful as a new indicator of vaccine effectiveness for children and could help to improve the quality of vaccine protection in children. The literature provides only sparse information on this topic.

The aim of this study was to apply a Delphi process to reach a consensus on a potentially dangerous vaccination delay for each dose of each vaccine recommended for children younger than 2 y of age, according to the French immunization schedule (Table 1).¹³

Table 1.

French 2015 vaccination schedule and recommendations for children younger than 2 years of age.

Vaccines	2 months	4 months	11 months	12 months	16–18 months
DTaP-IPV-Hib	X	X	X
HBV	X	X	X
PCV	X	X	X
MenC				X
MMR				X	X

DTaP-IPV-Hib: diphtheria tetanus acellular pertussis-inactivated polio vaccine-Hi b vaccine, PCV: pneumococcal conjugate vaccine, MenC: meningococcal C conjugate vaccine, MMR: measles-mumps-rubella vaccine, HBV: hepatitis B vaccine.

Results

Among the 37 experts identified in the 2 groups (French pediatric infectious disease group (GPIP), n=21; Infovac, n=16), the mean rate of participation was 79% with respectively 31, 29, and 28 experts participating in rounds 1, 2, and 3 (77% from Infovac and 81% from the GPIP). All were medical doctors, 26% had a PhD and 71% worked in a University hospital. Six percent had been practicing in the field of pediatric infectious diseases and vaccination for less than 10 years, 48% between 10 and 20 years, and 45% more than 20 y. Their principal fields of research were the epidemiology of infectious diseases, vaccine-preventable diseases, and meningitis.

Results for the first round are presented in Table 2. After this first round, suggestions from some experts led to the introduction into round 2 of 2 additional delays: one of 7 d for the first dose of pneumococcal conjugate vaccine (PCV) and one of 1 month for the first diphtheria-tetanus-acellular pertussis-inactivated polio vaccine-Hib vaccine (DTaP-IPV-Hib) booster. Figure 1 shows the trends in the experts' choices from the first to the third round. After the second round, a consensus set a 1-month vaccination delay as the cutoff for the meningococcal C conjugate vaccine (MenC), (82.8%; 95% confidence intervals [CI]: 63.5–93.5).

Table 2.

Potentially damaging vaccination delay for each dose of each recommended vaccine for children younger than 2 y according to the French immunization schedule: Round 1.

		Vaccination delay
Vaccines	Recommended age*	%	95% CI	%	95% CI	%	95% CI	%	95% CI	%	95% CI
DTaP-IPV/Hiba		≥ 1 d		7 d		15 d		28 d		Other/NAf
1stdose	2 months	24.1	11.0–43.9	13.8	4.5–32.6	27.6	13.4–47.5	31.0	16.0–51.0	3.5	0.2–19.6
2nd dose	4 months	6.9	1.2–24.2	3.5	0.8–17.8	24.1	11.0–43.9	58.6	39.1–75.9	6.9	1.2–24.2
1st booster dose	11 months	≥ 2 m		≥ 6 m		≥ 1 y		≥ 2 y		Other/NAf
		48.3	29.9–67.1	34.5	18.6–54.3	3.5	0.1–14.4	3.5	0.1–14.4	10.3	2.7–28.5
PCVb		≥ 1 d		≥ 15 d		≥ 1 m		≥ 2 m		Other/NAf
1st dose	2 months	31.0	16.0–51.0	37.9	21.0–50.7	24.1	11.0–43.9	6.9	1.2–24.2	0.0	0.0–10.7
2nd dose	4 months	20.7	8.7–40.3	31.0	16.0–51.0	34.5	18.6–54.3	10.3	2.7–28.5	3.5	0.2–19.6
booster dose	11 months	3.5	0.2–19.6	20.7	8.7–40.3	41.4	26.7–57.8	15.0	6.8–37.6 )	17.2	6.5–36.5
MMRc		≥1 m		≥ 3 m		≥ 6 m		≥ 1 y		Other/NAf
1st dose	12 months	75.9	56.1–89.0	20.7	8.7–40.3	0.0	0.0–10.7	0.0	0.0–14.6	3.5	0.2–19.6
2nd dose	16–18 months	24.1	11.0–43.9	24.1	11.0–43.9	31.0	16.0–51.0	13.8	4.5–32.6	6.9	1.2–24.2
MenCd	12 months	≥1 m		≥ 2 m		≥ 6 m		≥ 1 y		Other/NAf
		51.7	32.9–70.1	13.8	4.5–32.6	17.2	6.5–36.5	17.2	6.5–36.5	0.0	0.0–14.6
HBVe	11 months	≥ 16 m		≥ 6 y		≥ 11 y		≥ 16 y		Other/NAf
		41.4	24.1–60.9	13.8	4.6–27.0	31.0	16.6–45.7	6.9	1.2–24.2	6.9	1.2–24.2

^adiphtheria tetanus acellular pertussis-inactivated polio vaccine-Haemophilus influenzae b vaccine;

^bpneumococcal conjugate vaccine;

^cMeasles-Mumps-Rubella vaccine;

^dmeningococcal C vaccine;

^ehepatitis B vaccine ;

^fnot answered. Percentage of vote by experts were rounded off to one decimal, with 95% confidence interval (95% CI)

^*2013 vaccination schedule and recommendations,⁹ still ongoing in 2016

Figure 1.

Development of experts' choices from round 1 to round 3 for each recommended injection of routine vaccines for children younger than 2 y.

By the end of the third round, consensus was reached for most vaccines. A consensus was not reached for delays for 4 vaccinations: the first booster dose of DTaP-IPV-Hib vaccine, the first dose and the booster dose of PCV, and the second dose of measles-mumps-rubella (MMR) vaccine (Table 3). In these cases, the longest “finalist” vaccination delay, i.e., beyond which more than 70% of the experts time agreed that the delay is potentially dangerous, was chosen: 2 months for the first booster dose of DTaP-IPV-Hib, 15 d for the second PCV, 2 months for the PCV booster dose and 6 months for the second MMR. The sensitivity analysis did not result in any significant variation (data not shown).

Table 3.

Potentially damaging vaccination delays for each dose of each vaccine in children younger than 2 y according to the French immunization schedule.

		Most frequently cited delay if consensus (> 70%)			2nd most frequently cited delay in the absence of consensus
Vaccines		Delay 1	%	95% CI	Delay 2	%	95% CI	Potentially dangerous delay
DTaP-IPV/Hiba	1stdose	15 d	71.4	51.1–86.0	/			15 d
2nd dose		15 d	78.6	58.5–91.0	/			15 d
1st booster dose		1 month	52.5	36.3–68.2	2 months	42.9	25.0–62.6	2 months
PCVb	1st dose	15 d	60.7	40.7–77.9	7 d	32.1	16.6–52.4	15 d
2nd dose		15 d	85.7	66.4–95.3	/			15 d
booster dose		1 month	67.9	47.6–83.4	2 months	28.6	14.0–48.9	2 months
MMRc	1st dose	1 month	89.3	70.6–87.2	/			1 month
2nd dose		6 months	64.3	44.1–80.7	1 month	22.5	11.4–38.9	6 months
MenCd		1 month	82.8	63.5–93.5	/			1 month
HBVe		11 y	78.6	58.5–91.0	/			11 y

^adiphtheria tetanus acellular pertussis-inactivated polio vaccine-Haemophilus influenzae b vaccine;

^bpneumococcal conjugate vaccine;

^cMeasles-Mumps-Rubella vaccine;

^dmeningococcal C vaccine;

^ehepatitis B vaccine;

Percentages of vote by experts were rounded off to one decimal, with 95% confidence interval (95% CI)

Discussion

This study provides for the first time definitions of potentially dangerous vaccine delays for routine vaccines in preschool children. They were established by experts in vaccination and infectious diseases in children, through a DELPHI process. For all doses of vaccines a longest tolerable delay was identified, beyond which it was potentially dangerous for each child individually. The 70% consensus was reached for 6 out of the 10 doses of vaccines recommended before the age of 2 y.

DTaP-IPV-Hib and pneumococcal conjugate vaccines are recommended early in life to protect infants against lethal diseases. Vaccination has substantially reduced the rates of diphtheria, tetanus and poliomyelitis, but pertussis and invasive pneumococcal diseases are still common early in life worldwide. A few experts initially proposed a cutoff delay of less than 15 d for the first doses of DTaP-IPV-Hib and PCV. The arguments were that 70% of pertussis cases occur under 3 months of age,¹⁴ and incidence of pneumococcal meningitis peaks at 4 months of age.¹⁵ Regardless of the epidemiological evidence, primary immunization with the DTaP-IPV-Hib and PCV vaccines usually takes place at the same time and involves the same risks when delayed. The experts agreed that a vaccination delay of 15 d or more after the recommended age for these primary immunizations is potentially dangerous. In France, immunization with the primary DTaP-containing combination and PCV has been scheduled at 2 and 4 months since 2013. Thus, this study suggests that delay past 15 d after the scheduled vaccination dose is potentially dangerous, regardless of the primary schedule (2–4 or 3–5 or 2-3-4 or 2-4-6 months). In countries where a third dose is proposed for primary vaccination, however, a tolerable delay for this third dose should be determined.

Questions about the timeliness of childhood immunization have been raised since the end of the 1980s. Previously published studies of national immunization rates focused on up-to-date vaccination, i.e., whether children have had the recommended number of vaccinations by a certain age. The gap between up-to-date and age-appropriate vaccination was first measured for DTaP primary vaccination in Baltimore among 525 inner-city children, at 69.9% and 32.8% respectively.¹⁶ Similar results have been found for other vaccines regardless of differences between their immunization schedules. This new indicator of age-appropriate vaccination is currently used in immunization studies.^8,17–20 However, the acceptable delay beyond the age recommended for vaccination has generally been defined as 1 month for DT-IPV,^1,17,18,21 pertussis,^21–23 measles,²⁴ and hepatitis B vaccine (HBV).²¹ That is, until now, timely vaccination has been defined a priori, without explanations or references.^25,26 Yadav et al. suggested that expert consensus define 2 weeks late as a vaccination delay for all vaccines.²⁷ Neither the a priori definitions nor that by Yadav et al. take the differences in terms of epidemiology and severity of diseases into account. Our study sought to define vaccination delays for each dose of each vaccine and thus to provide a new and more accurate indicator for French immunization studies. Varicella, meningococcal B, and rotavirus vaccination delays were not considered in this study because these vaccines were not recommended in France at that time.

The results of the study must be interpreted carefully. They are not a substitute for official or other recommended immunization schedules. Rather, they quantify unacceptable vaccination delays according to the immunization guidelines for the general population. In this study, the potentially dangerous HBV-delay in the general population was 11 y, because this population is not expected to be exposed to this infection in childhood. Because this infection is not only sexually transmitted, but can be also transmitted through other contacts by unscreened people (i.e., children born from undetected mothers, children adopted from endemic countries, refugees…), guidelines do recommend however that the HBV be administered early during infancy.²⁸ Moreover, neonates and infants born to mothers at the highest risk (from highly endemic countries, or who are drug users or sex workers, or with familial cases) must of course receive early vaccination; if indicated, both vaccination and serotherapy should begin at birth. We considered it important to define a potentially dangerous vaccination delay: immunization schedules cannot always be strictly followed for reasons including lack of physician availability, vacations, and other personal physician and parental constraints. Accordingly, many children experience vaccination delays,⁸ which others have previously calculated as days under-vaccinated.¹ It can certainly be argued, as 24% to 31% of our experts suggested during the first round for the first dose of the PCV and DTaP-IPV-Hib vaccine (Table 2), that any day under-vaccinated is potentially dangerous. What our study sought to clarify was boundaries that must not be crossed for these delays. The experts thus had to consider the risk regarding the epidemiology of these vaccine-preventable diseases. A delay considered the longest tolerable was identified, beyond which individual children might be harmed by their lack of vaccination. Most potentially dangerous vaccine delays are very short —2 months or less. The existence of these delays might be used as evidence and arguments for parents and physicians about the importance of timeliness in vaccinations, and might thus improve overall vaccine protection.

This study may have some biases. The validity of the Delphi procedure relies on a panel of experts.²⁹ Limiting our panel of experts to those from Infovac (n=16) would probably have resulted in an insufficient number of responses and inadequate study power. Extending the study to experts in pediatric infectious diseases from the French GPIP, who frequently provide expertise and advice on vaccines or teach this subject, increased the set of participants without decreasing the quality of expertise. The 79% participation rate diminished participation bias. A fourth round was not conducted to avoid attrition bias. The experts' participation decreased from 81 to 76% between the first and third round and more reminders were needed to obtain that 76% rate. Finally, strict anonymity was not applied insofar as the investigators knew the panel of participating experts. However, quasi-anonymity according to McKenna was respected because each expert was individually screened and answers were anonymous.³⁰ This methodology ruled out subjectivity bias due to group effects and strong personalities.³¹ Although informal discussions might enrich the debate, they might also impoverish it promoting polemics on controversial topics. Moreover, experts' comments and feedback helped us to ensure they understood the process and to adapt the delays offered in each round according to their advice.³² Reproducibility of the Delphi technique has been questioned. Such a procedure was used in the lack of features in the literature, because of originality of the topic.³³ Moreover, we conducted a feasibility survey to test and improve the study tool.

This study could be useful for other countries that wish to analyze vaccination delays and improve routine vaccine protection in preschool children. Our results could be extended to other high-income countries where immunization schedules are very similar to that in France. Similar studies can be conducted with the same study design in countries with greater epidemiological differences. The results should enable the implementation of new public health strategies to improve age-appropriate vaccine protection in children and prevent disease outbreaks.

The timeliness of vaccine protection is a more precise indicator than vaccine coverage for appreciating the quality of immunization, and it varies for each vaccine-preventable disease according to its severity and epidemiology. Potentially dangerous vaccination delays have been identified through this Delphi process for each dose of each routine vaccine recommended for children younger than 2 y. These delays can be used as additional tools in future research to improve follow-up of immunization schedule guidelines.

Methods

Study design and definitions

A 3-round Delphi procedure for consensus was conducted in 2013 via an e-mail survey. The Delphi process was developed to perform a systematic synthesis of experts' opinions in situations where no consensus is available. It includes the following features: anonymity, independence of respondents, iteration with controlled feedback from one round to the next, and statistical aggregation of group responses until a sufficient consensus is reached.³¹

Each potentially dangerous vaccination delay was defined by the time between the recommended age for vaccination (published in the official French national immunization schedule, updated yearly¹³) and the age at which it might be dangerous for individual children to have not been vaccinated.

Participants: investigators and experts

The study investigators had 3 roles in the Delphi process: (i) to define the concept of vaccination delay according to the literature, (ii) to identify and select the most relevant delays for each dose of each vaccine proposed to the experts at the start of the study and (iii) to analyze and interpret of the results for each round, and provide feedback of the survey to the experts for the next round by reducing the number of proposed vaccination delays.

The experts in vaccines for children were identified from members of the GPIP scientific committees and of the Infovac-France group, specialized in vaccination for children. Potential participants were asked about their willingness to participate and informed about the purpose of the study and the amount and type of work expected of them.

Delphi process

Pre-round: identification of delays and feasibility of the study

From December 2012 to January 2013, the investigators searched the literature to identify potentially relevant vaccination delays for children younger than 2 y and for the vaccines considered: DTaP-IPV-Hib, PCV, MenC, MMR, and HBV. We selected 4 initial potentially relevant vaccination delays for each dose of each vaccine after a discussion between the investigators based on the sparse literature data available about these delays, the potential severity of each disease, the incidence peak of each of these infections (if any), and the current immunization schedule. The proposed delays are available in Table 2. These choices took into account that DTaP-IPV-Hib, PCV, and MenC vaccines are designed to protect against life-threatening diseases occurring early in life:^2,3 younger than 1 year for invasive MenC and Hib diseases,^34,35 younger than 6 months for invasive pneumococcal diseases,¹⁵ and younger than 3 months for pertussis.³⁶ It was considered that MMR diseases are less life-threatening in children and that the incidence of measles is relatively constant for children >1 y of age and adolescents.³⁷ HBV vaccine protects against serious chronic diseases with a low incidence in childhood.³⁸ A feasibility survey was performed in January 2013 with 5 pediatricians not involved in the Delphi process and minor changes were made based on their feedback.

Three-round Delphi process

The first round of the Delphi process was e-mailed to the experts along with a document explaining the study background. They received a table presenting the 4 delays selected by the investigators. The table included also one column for an open answer if the expert did not find appropriate any of the delays proposed and space for comments where the experts were encouraged to give explanations about their choice or other various comments. An answer was expected within 2 weeks and an e-mail reminder was sent 2 d before the due date.

The investigators reduced the number of choices for vaccine delays according to the previous round and experts' comments. In each subsequent round, the experts received a revised table presenting the selected vaccination delays and a qualitative summary of comments and results from the previous round. The results were collected within 4 weeks after each round, after 3 e-mail reminders.

Item reduction and analysis

The most commonly used threshold in Delphi studies is 70%.³⁹ Vaccination delays were selected for the following round and defined as consensual according to 2 criteria: i) agreement by at least 70% of experts about a vaccination delay was defined as a consensus; ii) otherwise, the delays with the best responses with a sum of responses rate higher or equal to 70% were selected for the next round. When the 70% threshold was not obtained, delays that should not be exceeded were defined as the maximum delays tolerated by at least 70% of the experts. When experts provided 2 answers instead of 1, both answers were excluded from the main analysis. A sensitivity analysis was then performed in taking into account the 2 answers in turn and comparing them with the main results. Statistical analyses were performed with R Commander Software (version 1.9–5). Percentages of participants and vaccination delays were calculated with their 95% CIs when appropriate.

List of the French experts from Infovac-France group and the GPIP

F. Angoulvant, P. Backhache, J. Beytout, M. Chalumeau, R. Cohen, M.A. Dommergues, V. Dufour, X. Durrmeyer, A. Faye, V. Gajdos, J. Gaudelus, Y. Gillet, C. Gras-Leguen, E. Grimprel, N. Guerin, H. Haas, I. Hau, V. Hentgen, E. Launay, M. Lorrot, F. Madhi, P. Minodier, F. Moulin, D. Pinquier, L. de-Pontual, N. Remus, O. Romain, G. Thiebault, F. Vié le Sage, B. Virey, C. Weil-Olivier.

Abbreviations

CI

confidence interval

DTaP-IPV-Hib

diphtheria-tetanus-acellular-pertussis-poliomyelitis-Haemophilus influenzae b

GPIP

French pediatric infectious disease group

HBV

hepatitis B vaccine

MMR

measles-mumps-rubella

PCV

pneumococcal conjugate vaccine

Disclosure of potential conflicts of interest

No potential conflicts of interest were disclosed.