Skip to main content
PLOS One logoLink to PLOS One
. 2023 Jul 21;18(7):e0288741. doi: 10.1371/journal.pone.0288741

Timeliness of routine childhood vaccination among 12–35 months old children in The Gambia: Analysis of national immunisation survey data, 2019–2020

Oghenebrume Wariri 1,2,3,*, Chigozie Edson Utazi 4,5, Uduak Okomo 1,6, Malick Sogur 7, Kris A Murray 8, Chris Grundy 2, Sidat Fofanna 7, Beate Kampmann 1,9
Editor: Orvalho Augusto10
PMCID: PMC10361478  PMID: 37478124

Abstract

The Gambia’s routine childhood vaccination programme is highly successful, however, many vaccinations are delayed, with potential implications for disease outbreaks. We adopted a multi-dimensional approach to determine the timeliness of vaccination (i.e., timely, early, delayed, and untimely interval vaccination). We utilised data for 3,248 children from The Gambia 2019–2020 Demographic and Health Survey. Nine tracer vaccines administered at birth and at two, three, four, and nine months of life were included. Timeliness was defined according to the recommended national vaccination windows and reported as both categorical and continuous variables. Routine coverage was high (above 90%), but also a high rate of untimely vaccination. First-dose pentavalent vaccine (PENTA1) and oral polio vaccine (OPV1) had the highest timely coverage that ranged from 71.8% (95% CI = 68.7–74.8%) to 74.4% (95% CI = 71.7–77.1%). Delayed vaccination was the commonest dimension of untimely vaccination and ranged from 17.5% (95% CI = 14.5–20.4%) to 91.1% (95% CI = 88.9–93.4%), with median delays ranging from 11 days (IQR = 5, 19.5 days) to 28 days (IQR = 11, 57 days) across all vaccines. The birth-dose of Hepatitis B vaccine had the highest delay and this was more common in the 24–35 months age group (91.1% [95% CI = 88.9–93.4%], median delays = 17 days [IQR = 10, 28 days]) compared to the 12–23 months age-group (84.9% [95% CI = 81.9–87.9%], median delays = 16 days [IQR = 9, 26 days]). Early vaccination was the least common and ranged from 4.9% (95% CI = 3.2–6.7%) to 10.7% (95% CI = 8.3–13.1%) for all vaccines. The Gambia’s childhood immunization system requires urgent implementation of effective strategies to reduce untimely vaccination in order to optimize its quality, even though it already has impressive coverage rates.

Introduction

The Gambian routine childhood vaccination programme is highly successful; for over a decade, it has consistently maintained routine childhood vaccination coverage rates of at least 90% for most routine childhood vaccines [1, 2]. The Gambia is therefore considered a model for the delivery and of coverage of routine childhood vaccines for many sub-Saharan African countries. The country achieved the 2020 Global Vaccine Action Plan (GVAP) coverage target a decade early [1], and is on track to reach the coverage target of the 2030 immunization agenda (IA2030) which aims to achieve at least 90% coverage for routine childhood vaccines [3]. Despite the celebrated success, there is growing evidence that many children are not receiving their vaccines within the recommended time frames [46]. This is particularly worrying as in parts of The Gambia, there has been a recent upsurge of measles, with a 6-fold increase in cases as of mid-2022 compared to 2020 figures despite a high coverage of both doses of measles-containing vaccine (MCV1 and MCV2) [7, 8]. Measles outbreaks are considered a sensitive marker of emerging herd immunity gaps [9] that might be created by untimely vaccination even in populations with otherwise high routine measles vaccination coverage rates [10].

Timely vaccination, operationally defined as vaccination received within the recommended age windows (i.e., valid doses) [11, 12], explores the quality dimension of immunization programs and is important for EPI programs like The Gambia that have already achieved high overage rates for most vaccines [13]. Deciding the appropriate window for childhood vaccination depends on several factors such as local disease epidemiology, presence of maternal antibodies, and the earliest age at which vaccines can be safely administered with maximum efficacy and the lowest risk of adverse effects [14]. Early vaccination, i.e., vaccines received before the earliest recommended window, may result in suboptimal immune response as maternal antibodies may inhibit vaccine response [1418]. Conversely, delayed vaccination, i.e., vaccination received after the latest recommended window, prolongs the exposure of children to potentially life-threatening but vaccine-preventable diseases (VPDs) such as pertussis and measles [14, 19]. There are reports from other settings showing that measles outbreaks have occurred despite high vaccination coverage rates, suggesting a link to untimely vaccination [20]. Furthermore, delayed vaccination may have a domino effect on timeliness of other routine vaccines resulting in a child not completing their required vaccinations or receiving successive doses of a multi-series vaccine in an untimely manner (i.e., untimely interval vaccination) [21].

At the programmatic level, vaccinations given too early (before their earliest recommended window) or that are delayed (after the recommended windows) are key indicators for monitoring and evaluating the quality of an immunization program [22]. Untimely vaccination could be the only early warning signal that may alert the immunization system to potential problems with the delivery and uptake of vaccines. Timeliness of vaccination also has implications for the introduction of novel vaccines. For example, the World Health Organization (WHO) initially placed a strict age limit on the administration of rotavirus vaccine, stating it should not be initiated in infants aged 12 weeks or older to minimize the potential risk of intussusception, a rare form of bowel obstruction [23]. This policy restricted rotavirus vaccine introduction in many low-and middle-income countries (LMICs) where untimely vaccination was a main concern [24].

Studies exploring childhood vaccination timeliness in LMICs have gained momentum in the last decade [25]. In The Gambia, three studies, published in 2014 [6], 2015 [5], and 2016 [4] have so far assessed childhood vaccination timeliness. Nevertheless, many of the studies from LMICs, including the Gambian studies have key methodological issues that limit their utility and comparability. First, previous studies have primarily focused on delayed vaccination, with limited research into other crucial dimensions such as early vaccination and untimely interval vaccination for multi-series vaccines [25]. This one-dimensional approach provides inadequate data needed to gain a holistic understanding of untimely vaccination. Second, most of the previous studies operationalized vaccination timeliness as a categorical variable, mainly reporting the proportion of children with untimely vaccination [25]. While this approach appears pragmatic, it is simplistic, lumping together a wide window of untimely vaccinations and preventing a nuanced interpretation of the outcome. Populations with comparatively longer mean or median number of days children were vaccinated too early or delayed, outside the recommended windows, potentially have a higher likelihood of suboptimal immune response or risk of VPD outbreaks. Third, previous studies did not compare vaccination timeliness to official national routine vaccination coverage rates. Lastly, none of the Gambian studies used a nationally representative data; consequently, their findings give an incomplete picture of the true scale of untimely vaccination in The Gambia. This study, therefore, aims to bridge all the identified gaps by utilizing nationally-representative data to comprehensively investigate all dimensions of routine childhood vaccination timeliness and present categorical and continuous outcomes across two birth cohorts in The Gambia.

Materials and methods

Study setting and context

The Gambia is located in West Africa, with a population of about 2.5 million people and a birth cohort of 90,000 children who are added to the routine childhood immunization program yearly [26]. The national expanded programme on immunization (EPI) was launched in May 1979 and initially delivered six vaccines targeting tuberculosis (BCG vaccine), diphtheria, pertussis, tetanus (combined DTP vaccine), measles, polio, and yellow fever. The current childhood vaccination schedule include vaccines administered at birth and at two, three, four, nine, twelve and eighteen months of life (Table 1) [27]. We explored the timeliness of vaccination using tracer vaccines given in the first year of life, a period when the peaks and severity of VPDs are highest. The included vaccines are Bacilli Calmette Guerin (BCG) and the birth dose of Hepatitis B vaccine (HepB0) administered at birth; the first, second, and third doses of multi-series oral polio vaccine (OPV) and pentavalent vaccine (diphtheria, tetanus, pertussis, hepatitis B, and Haemophilus influenzae type b) given at two, three and four months of life; and the first dose of measles containing vaccine (MCV1), which is administered at nine months in The Gambia (Table 1).

Table 1. The Gambia routine childhood immunization schedule showing vaccines given during infancy and the accepted national vaccination window [27].

Vaccine Vaccination window (Timely or age-appropriate vaccination) Early vaccination Delayed vaccination
Hepatitis B vaccine birth dose (HepB0)* Birth NA > 24 hours of life [28]
Bacilli Calmette Guerin (BCG)* NA > 7 days [29]
Oral Polio Vaccine (OPV0)
Oral Polio Vaccine (OPV1)* 2 Months (61–90 days) <61 days >90 days
Pentavalent vaccine (PENTA1)* <61 days >90 days
Pneumococcal vaccine (PCV1)
Rotavirus vaccine (Rota1)
Oral Polio Vaccine (OPV2)* 3 Months (91–120 days) <91 days >120 days
Pentavalent vaccine (PENTA2)* <91 days >120 days
Pneumococcal vaccine (PCV2)
Rotavirus vaccine (Rota2)
Oral Polio Vaccine (OPV3)* 4 Months (121–150 days) <121 days >150 days
Pentavalent vaccine (PENTA3)* <121 days >150 days
Pneumococcal vaccine (PCV3)
Inactivated Polio Vaccine (IPV)
Measles and Rubella vaccine (MCV1)* 9 Months (271–300 days) <271 days >300 days
Oral Polio Vaccine (OPV4)
Yellow Fever vaccine
OPV1 –OPV2; OPV2 –OPV3 interval* 4–8 weeks (28–56 days) <4 weeks or 28 days** >8 weeks or 56 days**
PENTA1 –PENTA2; PENTA2 –PENTA3 interval* 4–8 weeks (28–56 days) <4 weeks or 28 days** >8 weeks or 56 days**

Note: *The tracer vaccines and vaccination intervals examined in this study. ** untimely interval represents the combination of both scenarios. Pentavalent vaccine = DPT-HepB-Hib.

Data sources, study design and population

We analysed vaccination data from The Gambia Demographic and Health Survey (DHS), 2019–2020. The DHS is a nationally representative household survey that was designed by the global DHS program and implemented by the Gambia Bureau of Statistics (GBoS) [30]. The design, and implementation of the DHS is described in detail elsewhere [30]. In brief, The Gambia DHS 2019–2020 was performed using a two-stage cluster sampling design. In the first stage, the DHS selected a random sample of clusters with a probability proportional to their size within each sampling stratum from an already existing sample frame that was based on an updated version of the 2013 Gambia Population and Housing Census. In the second stage, households were systematically sampled from each cluster. The samples were stratified by urban and rural areas and sample weights were determined that must be applied to generate statistics that are representative at the national, urban and rural levels, and at the Local Government Area levels (i.e., first administrative area). The Gambia DHS 2019–2020 was conducted from 21 November 2019 to 30 March 2020 in 7025 selected households [30].

The Gambia DHS 2019–2020 collected childhood immunization data from 5,148 children aged 0–35 months who received specific vaccines at any time before the survey based on information from the child’s health card or the mother’s recall of vaccination. Overall, 93% of the included children (0–35 months) had vaccination cards, thus, accurate information on date of birth, vaccines received, and the dates of receipt (the variables needed to compute vaccination timeliness) were extracted directly from these cards. To ensure our timeliness analyses were comparable to the routine childhood coverage estimates routinely published in the DHS final reports [30], we generated timeliness output for the 3,248 children across two age groups: 12–23 months; and 24–35 months. A comprehensive breakdown detailing the number of children in the included age group and the availability of their birth and vaccination dates for the calculation of vaccination timeliness can be found in the supporting information (S1 Table).

Measuring the dimensions of vaccination timeliness

At the individual level, we used the difference between vaccination dates and birth date to determine the age at vaccination (in days) for every vaccine. Using the nationally accepted childhood vaccination window in The Gambia (Table 1) [27], we converted the accepted age recommendations given in months and weeks to days. To ensure uniformity and comparability, we considered a month to be equal to 30 days and a week was equal to 7 days. We considered each recommended age to begin at the first day of the window and end at the greatest number of days that could compose the given number of months or weeks (Table 1). For example, for vaccines that are recommended at two months of life, timely vaccination (or “on time") was any dose received between 61 days (the first day the child turned two months) and 90 days (the last day the child was two months). Any vaccination administered outside of the accepted window was considered “untimely” and include the following dimensions; early vaccination, delayed vaccination and untimely interval vaccination.

Early vaccination

This was defined as vaccines received before the earliest nationally accepted valid ages or vaccination window (in days) for a specific vaccine in The Gambia (Table 1). Since BCG and HepB0 are recommended at birth, they can either be timely or delayed and cannot be administered too early unlike the other tracer vaccines.

Delayed vaccination

This was defined as vaccines received after the latest nationally accepted valid ages or vaccination window (in days) for a specific vaccine in The Gambia (Table 1). The WHO recommends that infants receive HepB0 as soon as possible after birth, preferably within 24 hours [28], thus, delayed HepB0 was defined as doses received after 24 hours of life (i.e., 2 days and above). For BCG which is also recommended to be given “as soon as possible after birth”, we instead used The Gambia Ministry of Health’s definition of BCG received after 7 days (one week) as delayed [29].

Untimely interval vaccination

In line with the WHO guideline [31], the recommended interval for subsequent doses of multi-series vaccine in The Gambia is 4–8 weeks (i.e., 28–56 days). Thus, we defined “untimely interval vaccination” as any subsequent dose of a multi-series vaccine received before or after the recommended window (i.e., interval <28 days or >56 days between doses).

Data analysis

Following the DHS direct survey methodology, we computed routine vaccination coverage as the proportion of all eligible children (i.e., 12–23 months and 24–35 months) who were vaccinated. The denominator for computing routine vaccination coverage was all eligible children, within the specified age ranges (12–23 months and 24–35 months), with any form of vaccination evidence (i.e., either vaccination cards or mother’s recall).We subsequently computed vaccination timeliness (timely, early, delayed and untimely interval vaccination) among those who were vaccinated. The denominator for computing vaccination timeliness (timely, early, delayed and untimely interval vaccination) was all eligible children whose date of birth was known, were within the specified age ranges, and whose vaccination dates were available from a vaccination card [12]. We report the proportion vaccinated (coverage, timely, and untimely vaccination) and 95% confidence interval (CI). We also computed vaccination timeliness as continuous variables and reported the median days (and interquartile range) outside the accepted window that children were vaccinated too early or too late (delayed). In all statistical analyses, we accounted for survey design and sample weights following standardized techniques [32], implemented using the survey package in R [33]. All analyses were performed in Rand figures were generated using the ggplot2 package [34].

Ethics

This study was based on the analysis of the openly available The Gambia demographic and health survey 2019/2020 (GDHS 2019–2020). The ethical procedures for GDHS 2019–2020 were the responsibilities of the institutions that commissioned, funded or managed the surveys. The DHS states that it sought written informed consent from all participants before data collection and the study did not include minors. We received formal approval from the DHS program to use GDHS 2019–2020 dataset. The Gambia Government and MRC Unit The Gambia at LSHTM Joint Ethics Committee granted ethical approval for secondary data analysis (Project ID/Ethics ref: 22786; Date: 16 January, 2021).

Results

Pattern of routine vaccination coverage compared to timely vaccination

The routine vaccination coverage was high (90% or more) across all tracer vaccines. However, many children were vaccinated outside the recommended national vaccination windows as shown in the cumulative routine vaccination coverage curve in Fig 1.

Fig 1. Cumulative routine vaccination coverage curve of children 12–35 months in The Gambia.

Fig 1

Note: Green vertical dotted lines indicate the recommended national vaccination windows (≤24 hours for HepB0, 1–7 days for BCG, 61–90 days for OPV1 and PENTA1, 91–120 days for OPV2 and PENTA2, 121–150 days for OPV3 and PENTA3, and 271–300 days for MCV1). Red dotted line indicates WHO routine vaccination coverage target. Denominator is all eligible children with any evidence of vaccination, including vaccination cards and maternal recall.

Fig 2 shows the comparison between routine coverage and timely vaccination coverage in The Gambia. Overall, the coverages of all the included childhood vaccines were above 90% in the two age groups, except the coverage of OPV3 which was 88% (95% CI = 85.7–90.2) in the 24–35 months age group.

Fig 2. The comparison between routine vaccination coverage and timely vaccination coverage in The Gambia.

Fig 2

Note: Red horizontal dotted lines indicate the 2020 Global Vaccine Plan (GVAP) and the Immunization Agenda 2030 (IA2030) country-level crude vaccination coverage target. Error bar indicates 95% confidence interval (CI).

The percentage of children with timely or “on time” vaccination was higher in the 12–23 months compared to the 24–35 months age group. Timely vaccination ranged from 15.1% (95% CI = 12.1–18.1%) to 74.4% (95% CI = 71.7–77.1%) in the 12–23 months age group compared to 8.9% (95% CI = 6.6–11.1%) to 71.9% (95% CI = 68.8–75.0%) in the 24–35 months age group (Fig 1). For specific childhood vaccines, timely vaccination was lowest for the vaccines scheduled to be administered at birth, especially HepB0 and the pattern was similar in the 12–23 and 24–35 age group. Timely vaccination was highest for the vaccines scheduled to be administered at two months of life (OPV1 and Penta1), which corresponds to the next contact with the vaccination system outside the birth period (Fig 2).

Early vaccination (categorical and continuous outcomes)

The proportion of children who received their vaccinations too early was lower compared delayed vaccination. Overall, early vaccination ranged from 4.9% (95% CI = 3.2–6.7) to 10.7% (95% CI = 8.3–13.1) and the proportions were similar in the two age group (Fig 3A). The median number of days children were vaccinated too early, before the recommended window ranged from 3 days (IQR = 1, 11 days) to 14.5 days (IQR = 6.75, 26.25 days) and has a similar pattern in the two age groups (Fig 3B, supporting information [S2 Table]).

Fig 3.

Fig 3

Early vaccination among children 12–23 months and 24–35 months in The Gambia (a) the proportion with early vaccination (categorical timeliness), (b) Number of days before the earliest accepted window that children were vaccinated too early (continuous timeliness). Note: Panel B is truncated at 120 days, thus, does not show the number of days outside the window for the outliers.

As per specific vaccines, the percentage of children with early vaccination was lowest for the vaccine that protect against measles infection, MCV1 (5.1% vs 4.9% in the 12–23 and 24–35 months age groups respectively). However, MCV1 had the highest median number of days that children were vaccinated too early (14.5 days, [IQR = 6.75, 26.25] and 9.0 days, [IQR = 4.0, 26.0] for 12–23 and 24–35 months age group respectively) compared to other vaccines (Fig 3B).OPV2 (in the 12–23 months) and OPV1 (in the 23–35 months) had the highest proportion of children with early vaccination representing 10.7% (95% CI = 8.3–13.1) and 10.6% (95% CI = 8.4–12.8), respectively (Fig 3A).

Delayed vaccination (categorical and continuous outcomes)

Delayed vaccination ranged from 17.5% (95% CI = 14.5–20.4) to 91.1% (95% CI = 88.9–93.4), showing a similar pattern in the two age groups (Fig 4A). The median number of days children were vaccinated too late (i.e., delayed) ranged from 11 days (IQR = 5, 19.5 days) to 28 days (IQR = 11, 57 days) across all vaccines and had a similar pattern in the two age groups (Fig 4B, supporting information [S2 Table]). Overall, HepB0 had the highest proportion of delayed vaccination across the two age groups. Specifically, delayed HepB0 was higher in the 24–35 months age group (91.1% [95% CI = 88.9–93.4], median days delayed = 17 days [IQR = 10, 28 days]) compared to the 12–23 months age group (84.9% [95% CI = 81.9–87.9], median days delayed = 16 days [IQR = 9, 26 days]).

Fig 4.

Fig 4

Delayed vaccination among children 12–23 months and 24–35 months in The Gambia (a) the proportion with delayed vaccination (categorical timeliness), (b) Number of days after the latest accepted window that children were vaccinated too late or delayed (continuous timeliness). Panel B is truncated at 300 days, thus, does not show the number of days outside the window for the outliers.

The percentage of children with delayed vaccination was lowest for the first dose of the multi-series vaccines (i.e., OPV1 and Penta1), with a gradual increase in delayed vaccination with subsequent doses in the series across the two age groups (Fig 4A). Similarly, the median number of days that children were vaccinated too late for OPV1 in the 24–35 months age group increased from 11 days (IQR = 4, 29 days) until it peaked at 28 days (IQR = 11, 57 days) for OPV3 (Fig 4B, supporting information [S2 Table]). The 12–23 months age group also followed a similar pattern of increasing median days children were vaccinated too late with subsequent doses of the multi-series vaccines.

Untimely interval of vaccination between multi-series vaccines

Overall, less than 20% of the vaccinated children received their multi-series vaccines outside of the recommended window (i.e., a minimum interval of four weeks and maximum interval of eight weeks between subsequent doses of multi-series vaccines). This trend was observed consistently across both age cohorts and across all multi-series vaccines (Fig 5). Too early interval (i.e., being vaccinated less than 4 weeks or 28 days between subsequent doses of multi-series vaccines) was the least common, accounting for less than 5% for all multi-series vaccines (Fig 5).

Fig 5. The proportion of children with untimely interval vaccination for subsequent doses of multi-series vaccines in The Gambia.

Fig 5

Note: continuous timeliness (number of days outside the interval) was not computed for this dimension of vaccination timeliness because “untimely interval” include those who were vaccinated before and after the recommended interval for the multi-series vaccines.

Discussion

To the best of our knowledge, this is the first study conducted in an LMIC context to simultaneously investigate all the dimensions of vaccination timeliness (timely, early, delayed, and untimely interval), and presents the outcomes as both categorical and continuous variables. This approach allows for a uniquely nuanced interpretation of the results unlike previous studies that often focused on one dimension or predominantly reported the outcomes as categorical variables. We also compared vaccination timeliness to official national survey-based routine vaccination coverage rates. Although overall coverage was high, a large number of children were vaccinated outside the recommended time-frames. Early vaccination was the least common dimension of untimely vaccination and also had a comparatively shorter median number of days children were vaccinated outside the window. Delayed vaccination was the most common dimension of untimely vaccination, with the highest proportion and longest median number of days children were vaccinated outside the recommended time-frames. Our findings do not align with prior research on vaccination timeliness, as the proportion of delayed vaccinations and the median delays in our study are generally lower compared to the largest study so far that included data of 217,706 children from 45 LMICs [35]. Our findings demonstrate that the Gambia EPI not only achieves high routine childhood vaccination coverage rates but has also ensured that children receive their vaccinations within the recommended time-frames, as much as possible, in comparison to other LMICs.

In the last decade, The Gambian EPI program has further strengthened its commitment to leave no child behind and to reach 100% immunization coverage in the country. This commitment is supported by development partners such as Gavi, the Vaccine Alliance which continues to make huge investments towards ensuring that all children receive all their basic vaccinations within the recommended time-frames [36]. These commitments and investments might explain why vaccination was generally more timely in the younger age group (12–23 months) compared to children in the older age group. This improvement in timely vaccination is similar to the official national survey-based routine vaccination coverage estimates which shows that coverage was also higher among children in the younger age group [30].

For the multi-series vaccines, the proportion and median delays increased gradually and peaked with the third doses, reflecting a pattern similar to previous studies from Indonesia [37], the UK [38], and across LMICs context [35]. This trend is not surprising because the first doses of the multi-series vaccines are administered at two months of life in The Gambia which coincides with the first vaccination visit outside the birth period and may also be an opportunity to receive post-natal services, hence, the timely uptake. Nevertheless, it is worrisome because it reflects the inability of the program to consistently ensure timely vaccination or a lack of enthusiasm by caregivers for subsequent doses of multi-series vaccines. This situation may have a knock-on effect as many children may progress from untimely vaccination in subsequent doses to actual dropout from the system with increasing median delays with subsequent doses. Our results should, therefore, inform the development of retention strategies by the EPI for multi-series vaccines aimed at delivering doses in a timely manner.

Implications for childhood vaccination planning and policy in The Gambia

The fact that HepB0 had the highest proportion (∼90%) and median delay of more than two weeks in both age groups is of particular concern and has implication for immunization planning and public health policy. Globally, about 360 million people are chronically infected with Hepatitis B virus (HBV) and can lead to serious complications such as liver cirrhosis or cancer [28]. In The Gambia, HBV infection is endemic, with 15% to 20% of the population being chronically infected [39]. HBV can be transmitted from mother-to-child during the birthing process and through breast feeding. Thus, the WHO has recommended that HepB0, one of the safest and most effective vaccines, be given within 24 hours of birth and followed by at least two subsequent doses to prevent perinatal infection [28]. The ∼90% delay found in this study is an improvement compared to the 98.9% HepB0 delay recorded in the Gambia in 2015 [4]. However, it highlights the need for more action to ensure timely delivery and uptake of HepB0 in the country. The evidence base suggests that the key drivers of delayed HepB0 are lack of facility delivery or mothers being discharged before their babies can be accessed for vaccination [40, 41]. While these drivers might not be under the direct purview of the EPI, the programme can work collaboratively with the relevant department of the ministry health to better align priorities.

The fact that the categorical measures of vaccination timeliness showed a contrasting pattern to the continuous measures of timeliness for most vaccines, highlights the need for studies to operationalize timeliness using the two outcome measures. The subpopulation with a longer median duration of untimely (early or late) vaccination can create windows of vulnerability, even when the overall proportion of children with early or delayed vaccination is low. For this reason, it is important for EPI programs to supplement routine measures of coverage and categorical timeliness with continuous measures of vaccination timeliness to aid a nuanced interpretation of the quality dimension of routine immunization system performance. Our findings contextualizes the available evidence in The Gambia which shows that routine vaccination coverage of MCV1 is high [2], and the proportion of children vaccinated too early for MCV1 is generally low [5], because we provide additional evidence on the median number of days children are vaccinated outside the recommended time-frames. Efforts at reducing the median number of days that children are vaccinated too early or late, in addition to increasing timely, age-appropriate MCV1 coverage and other measures must be prioritized by the Gambia EPI to halt sporadic measles outbreaks in the country.

Transferability and future research

To ensure comparability of data, future studies examining vaccination timeliness in other LMICs contexts can implement the approach we have adopted in defining the dimensions of vaccination timeliness. We acknowledge that vaccination windows may vary across countries, nevertheless, using the nationally accepted EPI vaccination windows, rather than an arbitrary definition makes it easier to aggregate and compare data across countries, especially LMICs with similar vaccination schedules. Nationally-representative surveys such as DHS and the multiple indicator cluster survey (MICS) are widely implemented in many LMICs and routinely generate national-level routine vaccination coverage rates. The widespread availability of these surveys presents an opportunity to replicate the analysis implemented in this study by comparing routine vaccination coverage rates with estimates of all the dimensions of vaccination timeliness. Through this approach, countries can monitor the quality dimension of their immunization systems, in addition to measuring routine vaccination coverage rates which can mask substantial immunity gaps created by untimely vaccinations.

To effectively implement targeted public health interventions, it might be necessary to move beyond utilizing national and subnational estimates of vaccination timeliness and instead identify specific subpopulations that are ’hotspots’ of untimely vaccination. Future studies should deploy geospatial modelling techniques and generate maps showing the hotspots of early, delayed, and untimely interval vaccination at high-resolution, similar to spatial modelling of routine vaccination coverage already being conducted [4244]. The factors that contribute to the pattern of untimely vaccination observed in this study are likely to be multifaceted and complex. In order to gain a deeper and more comprehensive understanding of these factors, future studies should adopt an action-oriented conceptual framework that takes into account both accessibility and utilization of immunization services, as well as demand- and supply-side factors. This approach will allow for a more robust examination of the various factors contributing to untimely vaccination, providing valuable insights for the development and implementation of effective strategies to improve vaccination timeliness.

Methodological implications and limitations

To compute vaccination timeliness, dates of birth and vaccination are essential, and the percentage of children with vaccination cards must be high to ensure the analysis is powered to generate representative outcomes [45]. Vaccination card availability was high in our dataset and in the age group we included (∼85%), thus, supporting the feasibility of implementing our timeliness analysis. However, in many LMICs context, the retention of vaccination cards is variable and may limit the computation of timeliness outcomes. To conduct timeliness analysis in situations where dates of birth and vaccination are incomplete, there is a need to develop, validate, and deploy methodologies that can input or predict age at vaccination especially in situations where it can be confirmed from maternal recall that the child has been vaccinated. Such imputation or prediction techniques can utilize machine learning approaches that may leverage pre-specified characteristics such as the age at vaccination of children in similar age bands or living in the same spatial location with the index child [35, 46].

The use of DHS data for the analyses of vaccination timeliness presents certain limitations inherent to the nature of the survey data. First, the availability of valid date of birth and date of vaccination for a substantial number of children in the dataset is crucial for accurate analysis. However, the completeness and accuracy of these data elements can vary significantly across many LMIC context where the availability of home-based vaccination records are seldom incomplete. This can potentially introduce biases or limit the generalizability of the timeliness estimates. Second, cross-sectional surveys like DHS provide a snapshot of the population at a specific point in time. Since the data is typically collected every 5 years and focusses on children who were vaccinated 12–35 months before the survey was implemented, it does not reflect the most recent vaccination status and poses challenges in capturing the temporal nature of vaccination timeliness. Locally tailored approaches are needed to generate timely, high-quality, population-based vaccination data needed to assess to temporal trends in vaccination timeliness. The availability of such real-time, routinely collected data has fundamental advantages over data generated through periodic (~5 yearly) surveys like the DHS and can be exploited in the future for the analysis implemented in this study. Despite these limitations, DHS data is a valuable resource for tracking vaccination timeliness. DHS data is collected in a standardized way across countries, which makes it possible to compare vaccination rates across countries. DHS data is also collected from a large sample of households, which makes it possible to get a reliable estimate of vaccination rates.

Supporting information

S1 Fig. Flowchart displaying children included in this study by age group and birth/vaccination data completeness.

(DOCX)

S1 Table. Median number of days children were vaccinated too early and interquartile ranges for all vaccines for children 12–23 and 24–35 months in The Gambia.

(DOCX)

S2 Table. Median delays and interquartile ranges for all vaccines for children 12–23 and 24–35 months in The Gambia.

(DOCX)

Data Availability

The data underlying the results presented in this study were collected as part of the Gambia Demographic and Health Survey (DHS) conducted in 2019-2020. This data is publicly available for download from the DHS Program website at https://dhsprogram.com/data/available-datasets.cfm, however, it is important to note that prior permission from the DHS program must be obtained before accessing the data.

Funding Statement

Funding This project is part of the EDCTP2 Programme supported by the European and Developing Countries Clinical Trials Partnership (grant number TMA2019CDF-2734 – TIMELY). OW was also supported by an Imperial College London Wellcome Trust Institutional Strategic Support Fund (ISSF) (grant no RSRO_P67869). CEU was supported by funding from the Bill & Melinda Gates Foundation (Investment ID INV-003287). The Vaccines and Immunity Theme (OW, UO, and BK) is jointly funded by the UK MRC and the UK Department for International Development (DFID) under the MRC/DFID Concordat agreement and is also part of the EDCTP2 Programme supported by the EU (MC UP_A900/1122, MC UP A900/115). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Wariri O, Edem B, Nkereuwem E, et al. Tracking coverage, dropout and multidimensional equity gaps in immunisation systems in West Africa, 2000–2017. BMJ Global Health 2019; 4(5): e001713–e. doi: 10.1136/bmjgh-2019-001713 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Wariri O, Nkereuwem E, Erondu NA, et al. A scorecard of progress towards measles elimination in 15 west African countries, 2001–19: a retrospective, multicountry analysis of national immunisation coverage and surveillance data. The Lancet Global Health 2021; 9(3): e280–e90. doi: 10.1016/S2214-109X(20)30481-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.World Health Organization. Implementing the Immunization Agenda 2030: A Framework for Action through Coordinated Planning, Monitoring & Evaluation, Ownership & Accountability, and Communications & Advocacy. Geneva, Switzerland: World Health Organization, 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Miyahara R, Jasseh M, Gomez P, et al. Barriers to timely administration of birth dose vaccines in The Gambia, West Africa. Vaccine 2016; 34(29): 3335–41. doi: 10.1016/j.vaccine.2016.05.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Odutola A, Afolabi MO, Ogundare EO, et al. Risk factors for delay in age-appropriate vaccinations among Gambian children. BMC health services research 2015; 15: 346. doi: 10.1186/s12913-015-1015-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Scott S, Odutola A, Mackenzie G, et al. Coverage and timing of children’s vaccination: an evaluation of the expanded programme on immunisation in The Gambia. PLoS One 2014; 9(9): e107280. doi: 10.1371/journal.pone.0107280 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.World Health Organization. Surveillance for Vaccine Preventable Diseases (VPDs). 2022. https://www.who.int/teams/immunization-vaccines-and-biologicals/immunization-analysis-and-insights/surveillance/surveillance-for-vpds (accessed 19 July 2022). [Google Scholar]
  • 8.Sowe A, Njie M, Sowe D, et al. Epidemiology of measles cases, vaccine effectiveness, and performance towards measles elimination in The Gambia. PLoS One 2021; 16(10): e0258961. doi: 10.1371/journal.pone.0258961 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Gastañaduy PA, Goodson JL, Panagiotakopoulos L, Rota PA, Orenstein WA, Patel M. Measles in the 21st Century: Progress Toward Achieving and Sustaining Elimination. J Infect Dis 2021; 224(12 Suppl 2): S420–s8. doi: 10.1093/infdis/jiaa793 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Truelove SA, Graham M, Moss WJ, Metcalf CJE, Ferrari MJ, Lessler J. Characterizing the impact of spatial clustering of susceptibility for measles elimination. Vaccine 2019; 37(5): 732–41. doi: 10.1016/j.vaccine.2018.12.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.MacDonald SE, Russell ML, Liu XC, et al. Are we speaking the same language? an argument for the consistent use of terminology and definitions for childhood vaccination indicators. Hum Vaccin Immunother 2019; 15(3): 740–7. doi: 10.1080/21645515.2018.1546526 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.World Health Organization. Harmonizing vaccination coverage measures in household surveys: A primer. Geneva, Switzerland: WHO, 2019. [Google Scholar]
  • 13.Cutts FT, Izurieta HS, Rhoda DA. Measuring coverage in MNCH: design, implementation, and interpretation challenges associated with tracking vaccination coverage using household surveys. PLoS medicine 2013; 10(5): e1001404. doi: 10.1371/journal.pmed.1001404 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Plotkin SA. Vaccines: Past, present and future. Nature Medicine 2005; 11(4S): S5–S. doi: 10.1038/nm1209 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Nic Lochlainn LM, de Gier B, van der Maas N, et al. Effect of measles vaccination in infants younger than 9 months on the immune response to subsequent measles vaccine doses: a systematic review and meta-analysis. The Lancet Infectious Diseases 2019; 19(11): 1246–54. doi: 10.1016/S1473-3099(19)30396-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Borràs E, Urbiztondo L, Costa J, et al. Measles antibodies and response to vaccination in children aged less than 14 months: implications for age of vaccination. Epidemiol Infect 2012; 140(9): 1599–606. doi: 10.1017/S0950268811002184 [DOI] [PubMed] [Google Scholar]
  • 17.Garly ML, Balé C, Martins CL, et al. Measles antibody responses after early two dose trials in Guinea-Bissau with Edmonston-Zagreb and Schwarz standard-titre measles vaccine: better antibody increase from booster dose of the Edmonston-Zagreb vaccine. Vaccine 2001; 19(15–16): 1951–9. doi: 10.1016/s0264-410x(00)00431-x [DOI] [PubMed] [Google Scholar]
  • 18.Whittle H, Hanlon P, O’Neill K, et al. Trial of high-dose Edmonston-Zagreb measles vaccine in the Gambia: antibody response and side-effects. Lancet 1988; 2(8615): 811–4. doi: 10.1016/s0140-6736(88)92781-x [DOI] [PubMed] [Google Scholar]
  • 19.Guerra FA. Delays in immunization have potentially serious health consequences. Paediatr Drugs; 2007. p. 143–8. doi: 10.2165/00148581-200709030-00002 [DOI] [PubMed] [Google Scholar]
  • 20.Henderson DA, Dunston FJ, Fedson DS, et al. The Measles Epidemic: The Problems, Barriers, and Recommendations. JAMA 1991; 266(11): 1547–52. [PubMed] [Google Scholar]
  • 21.Kiely M, Boulianne N, Talbot D, et al. Impact of vaccine delays at the 2, 4, 6 and 12 month visits on incomplete vaccination status by 24 months of age in Quebec, Canada. BMC Public Health 2018; 18(1): 1364. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.World Health Organization. Training for mid-level managers (MLM) module 5: monitoring the immunization system. Geneva, 2008. [Google Scholar]
  • 23.World Health O. Rotavirus vaccines: an update. Weekly Epidemiological Record = Relevé épidémiologique hebdomadaire 2009; 84(51–52): 533–40. [PubMed] [Google Scholar]
  • 24.Patel MM, Clark AD, Sanderson CF, Tate J, Parashar UD. Removing the age restrictions for rotavirus vaccination: a benefit-risk modeling analysis. PLoS Med 2012; 9(10): e1001330. doi: 10.1371/journal.pmed.1001330 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Wariri O, Okomo U, Kwarshak YK, et al. Timeliness of routine childhood vaccination in 103 low-and middle-income countries, 1978–2021: A scoping review to map measurement and methodological gaps. PLOS Global Public Health 2022; 2(7): e0000325. doi: 10.1371/journal.pgph.0000325 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Worldometer. The Gambia Population. 2021. https://www.worldometers.info/world-population/gambia-population/ (accessed November 19 2021). [Google Scholar]
  • 27.World Health Organization. Vaccination schedule for Gambia. 2023. https://immunizationdata.who.int/pages/schedule-by-country/gmb.html?DISEASECODE=&TARGETPOP_GENERAL= (accessed 29 January 2023). [Google Scholar]
  • 28.World Health Organization. Preventing Perinatal Hepatitis B Virus Transmission: A Guide for Introducing and Strengthening Hepatitis B Birth Dose Vaccination. Geneva, Switzerland: World Health Organization, 2015. [Google Scholar]
  • 29.Ministry of Health The Gambia. Draft policy of the expanded programme on immunisation, Republic of The Gambia. Banjul, The Gambia: Ministry of Health The Gambia, 2006. [Google Scholar]
  • 30.Gambia Bureau of Statistics (GBoS) and ICF. The Gambia Demographic and Health Survey 2019–20. Banjul, The Gambia and Rockville, Maryland, USA, 2021. [Google Scholar]
  • 31.World Health Organization. Summary of WHO Position Papers—Recommended Routine Immunizations for Children. Geneva, Switzerland: World Health Organization, 2020. [Google Scholar]
  • 32.International ICF. Demographic and Health Survey Sampling and Household Listing Manual. MEASURE DHS, Calverton, Maryland, U.S.A.: ICF International, 2012. [Google Scholar]
  • 33.Lumley T. Analysis of Complex Survey Samples. Journal of Statistical Software 2004; 9(8): 1–19. [Google Scholar]
  • 34.R Core Team R. R: A language and environment for statistical computing. 2022. [Google Scholar]
  • 35.Clark A, Sanderson C. Timing of children’s vaccinations in 45 low-income and middle-income countries: an analysis of survey data. Lancet 2009; 373(9674): 1543–9. doi: 10.1016/S0140-6736(09)60317-2 [DOI] [PubMed] [Google Scholar]
  • 36.Gavi The Vaccine Alliance. Program impact: The Gambia. 2022. https://www.gavi.org/programmes-impact/country-hub/africa/gambia (accessed 27 January 2023). [Google Scholar]
  • 37.Oktaria V, Bines JE, Murni IK, et al. Timeliness of routine childhood vaccinations in Indonesian infants in the first year of life. Vaccine 2022; 40(21): 2925–32. doi: 10.1016/j.vaccine.2022.04.001 [DOI] [PubMed] [Google Scholar]
  • 38.Walton S, Cortina-Borja M, Dezateux C, et al. Measuring the timeliness of childhood vaccinations: Using cohort data and routine health records to evaluate quality of immunisation services. Vaccine 2017; 35(51): 7166–73. doi: 10.1016/j.vaccine.2017.10.085 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Kirk GD, Lesi OA, Mendy M, et al. The Gambia Liver Cancer Study: Infection with hepatitis B and C and the risk of hepatocellular carcinoma in West Africa. Hepatology 2004; 39(1): 211–9. doi: 10.1002/hep.20027 [DOI] [PubMed] [Google Scholar]
  • 40.Montagu D, Yamey G, Visconti A, Harding A, Yoong J. Where Do Poor Women in Developing Countries Give Birth? A Multi-Country Analysis of Demographic and Health Survey Data. PLOS ONE 2011; 6(2): e17155. doi: 10.1371/journal.pone.0017155 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Bryce J, Daelmans B, Dwivedi A, et al. Countdown to 2015 for maternal, newborn, and child survival: the 2008 report on tracking coverage of interventions. Lancet 2008; 371(9620): 1247–58. doi: 10.1016/S0140-6736(08)60559-0 [DOI] [PubMed] [Google Scholar]
  • 42.Utazi CE, Nilsen K, Pannell O, Dotse-Gborgbortsi W, Tatem AJ. District-level estimation of vaccination coverage: Discrete vs continuous spatial models. Statistics in Medicine 2021; 40(9): 2197–211. doi: 10.1002/sim.8897 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Dong TQ, Wakefield J. Modeling and presentation of vaccination coverage estimates using data from household surveys. Vaccine 2021; 39(18): 2584–94. doi: 10.1016/j.vaccine.2021.03.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Utazi CE, Thorley J, Alegana VA, et al. High resolution age-structured mapping of childhood vaccination coverage in low and middle income countries. Vaccine 2018; 36(12): 1583–91. doi: 10.1016/j.vaccine.2018.02.020 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Wagai JN, Rhoda D, Prier M, et al. Implementing WHO guidance on conducting and analysing vaccination coverage cluster surveys: Two examples from Nigeria. PLoS One 2021; 16(2): e0247415. doi: 10.1371/journal.pone.0247415 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Li Y, Vinzamuri B, Reddy CK. Regularized weighted linear regression for high-dimensional censored data. Proceedings of the 2016 SIAM International Conference on Data Mining; 2016: SIAM; 2016. p. 45–53. [Google Scholar]

Decision Letter 0

Orvalho Augusto

17 May 2023

PONE-D-23-05149Timeliness of routine childhood vaccination among 12-35 months old children in The Gambia: analysis of national immunisation survey data, 2019-2020PLOS ONE

Dear Dr. Wariri,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 01 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Orvalho Augusto, MD, MPH

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match.

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

This is an important report on the analysis of timeliness to vaccination. This is an important concept almost forgotten in routine immunization programs. The authors show that despite high immunization coverage reached in the Gambia there is little timely immunization according to the national EPI immunization calendar. It should be standard to analyze timeliness as well after one reads this report.

A small minor shortcoming:

Between lines 193 and 195, please cite R. Cite also the survey package (and optionally ggplot2). Also, note that there is no svy function in that package. Please revise.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Firstly, I commend authors’ efforts in undertaking this research project. The topic is both timely and significant, and your findings have the potential to contribute to our understanding in this area.

In general, I find the paper to be well-structured, and the methodology appears sound. You have clearly outlined the objectives of the study, and the literature review provides a comprehensive background for your work. The data analysis is robust, and the results are presented in an organized manner.

However, there are a few areas that could benefit from further improvement:

1. Detailed explanation of the method in supplementary document would help readers to interpret the findings.

2. Limitation of the methodology used in the study should be thoroughly discussed.

3. Line 294 -295 , “ To the best of our knowledge, this is the first study in an LMIC context to examine all the dimensions 295 of vaccination timeliness (timely, early, delayed, and untimely interval)”, is it true? There has been several studies conducted in LMICs (such as in Mongolia, and Nepal) focusing on timeliness in routine childhood vaccinations. Author must conduct thorough literature review and be careful while writing such statements.

4. All the figures provided are unclear due low resolution. These figures should be plotted in high resolution.

Reviewer #2: The authors have assessed the timeliness of childhood vaccination for the vaccines given in the first year of life in The Gambia using the 2019-2020 Demographic and Health Survey. They have shown that despite high coverage rates, timeliness of vaccination were low for many of the vaccines, thereby highlighting the need for the national immunisation programme and the health system to improve on this indicator.

Comments

1. How has the current (low) levels of vaccination timeliness affected the vaccine preventable disease burden in The Gambia?

2. What is the current rates of use of electronic immunisation registries (EIRs) in The Gambia? If high, wouldn't EIRs provide a better means of assessing timeliness of vaccination in comparison to DHS surveys. If EIRs use is low, highlight in the discussion the need and potential impact of EIRs in identifying children for catch-up vaccination and improved timeliness.

3. Why is the vaccination coverage referred to as crude vaccination coverage? The authors specify that survey weights have been applied to the analysis, and if so, why is this still crude vaccination coverage.

4. Line 335: For HBV vaccine, highlight the potential of new HBV maternal vaccines in the pipeline in preventing infections at birth.

5. Figure 5 and corresponding results. Split the untimely interval by vaccination before the minimum window and after the maximum window, and explain the results.

6. What proportion of children are zero-dose children and underimmunised children? For records in the DHS for zero-dose children and underimmunised children, are these included in this analysis and if so, explain how are the indefinite intervals for missed vaccines are taken into it?

7. Make the code used in the analysis publicly accessible in a online repository such as Github.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Jul 21;18(7):e0288741. doi: 10.1371/journal.pone.0288741.r002

Author response to Decision Letter 0


10 Jun 2023

Journal Requirements and Additional Editor Comments

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found HERE and HERE

RESPONSE: Thanks for providing the guidelines. We have revised the manuscript to meet the guidelines.

2. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

RESPONSE: Thank you for highlighting this error. We have revised the information included in the respective sections to ensure that they are correct and match.

3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories. We will update your Data Availability statement on your behalf to reflect the information you provide

RESPONSE: In our data availability section, we did not state that “data from this study are available upon request”, instead, we indicated “Yes - all data are fully available without restriction”.

Since the data are owned by a third party (The DHS Program), and we do not have permission to share the data, . We would like to update our data availability statement to read thus “The data underlying the results presented in this study were collected as part of the Gambia Demographic and Health Survey (DHS) conducted in 2019-2020. This data is publicly available for download from the DHS Program website at https://dhsprogram.com/data/available-datasets.cfm, however, it is important to note that prior permission from the DHS program must be obtained before accessing the data” in line with PLOS requirement.

We have updated the cover letter to reflect the information given above.

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

RESPONSE: We have reviewed the reference and we can confirm that it is complete, correct and we have not cited any paper that have been retracted.

5. This is an important report on the analysis of timeliness to vaccination. This is an important concept almost forgotten in routine immunization programs. The authors show that despite high immunization coverage reached in the Gambia there is little timely immunization according to the national EPI immunization calendar. It should be standard to analyze timeliness as well after one reads this report.

RESPONSE: We express our gratitude to the Editor for their kind and generous comment on our work.

6. A small minor shortcoming:

Between lines 193 and 195, please cite R. Cite also the survey package (and optionally ggplot2). Also, note that there is no svy function in that package. Please revise.

RESPONSE: We have now cited R and the survey package. We have now revised the sentence and edited out “svy function”.

Reviewer #1

1. Firstly, I commend authors’ efforts in undertaking this research project. The topic is both timely and significant, and your findings have the potential to contribute to our understanding in this area.

In general, I find the paper to be well-structured, and the methodology appears sound. You have clearly outlined the objectives of the study, and the literature review provides a comprehensive background for your work. The data analysis is robust, and the results are presented in an organized manner.

However, there are a few areas that could benefit from further improvement.

RESPONSE: We thank the reviewer for the positive comments, and for the time spent reviewing our manuscript. We have provided a point-by-point response that addresses all the concerns raised.

2. Detailed explanation of the method in supplementary document would help readers to interpret the findings.

RESPONSE: We have updated the supplementary document to include additional methods that could help readers interpret the findings. However, the main methods section provides a detailed description of the methods used to derive the presented results.

3. Limitation of the methodology used in the study should be thoroughly discussed.

RESPONSE: We have expanded our discussion of the limitation of the study. See lines 397-414 on pages 12 and 13.

4. Line 294 -295 , “ To the best of our knowledge, this is the first study in an LMIC context to examine all the dimensions 295 of vaccination timeliness (timely, early, delayed, and untimely interval)”, is it true? There has been several studies conducted in LMICs (such as in Mongolia, and Nepal) focusing on timeliness in routine childhood vaccinations. Author must conduct thorough literature review and be careful while writing such statements.

RESPONSE: In lines 294-295, we state that “To the best of our knowledge, this is the first study in an LMIC context to examine all the dimensions of vaccination timeliness (timely, early, delayed, and untimely interval), AND reported the outcomes as categorical and continuous variables…”.

We agree that there has been SEVERAL studies conducted in LMICs focusing on the timeliness of childhood vaccination as shown in our own scoping review which included 224 articles from 103 LMICs and published in 2022 (See article link here: https://journals.plos.org/globalpublichealth/article?id=10.1371/journal.pgph.0000325 and the link to the protocol which we developed and was published a priori in PLOS ONE: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0253423). Our statement was borne out of the evidence from the aforementioned published piece of work which we also clearly reference in the introduction section of this manuscript (i.e., reference 25).

Our intention in that statement was to highlight the unique contribution of our analysis, which is the concurrent reporting of all dimensions of vaccination timeliness as both categorical (proportion delayed) and continuous variables (mean/median number of days children were vaccinated too early or late). This is indicated in the second part of that statement “…and reported the outcomes as categorical and continuous variables”. We have revised the statement for clarity to accurately reflect our claims. It now reads: “To the best of our knowledge, this is the first study conducted in an LMIC context to simultaneously investigate all the dimensions of vaccination timeliness (timely, early, delayed, and untimely interval), and presents the outcomes as both categorical and continuous variables. This approach allows for a uniquely nuanced interpretation of the results unlike previous studies that often focused on one dimension or predominantly reported the outcomes as categorical variables”.

5. All the figures provided are unclear due low resolution. These figures should be plotted in high resolution.

RESPONSE: Thank you for this comment. We have submitted high quality images in the format that meets the requirement of PLOS ONE. Note that sometimes, the quality reduces after they have been rendered as a pdf file from the editorial manager.

Reviewer #2

1. The authors have assessed the timeliness of childhood vaccination for the vaccines given in the first year of life in The Gambia using the 2019-2020 Demographic and Health Survey. They have shown that despite high coverage rates, timeliness of vaccination were low for many of the vaccines, thereby highlighting the need for the national immunisation programme and the health system to improve on this indicator.

RESPONSE: We extend our sincere gratitude to the reviewer for their willingness to review our manuscript and for offering valuable feedback. In response to each comment, we have provided a point-by-point response, addressing the concerns raised.

2. How has the current (low) levels of vaccination timeliness affected the vaccine preventable disease burden in The Gambia?

RESPONSE: Thank you for this very important question and for your interest in our study. Our study was not designed to address this specific question, as we do not have the necessary data to infer causality (i.e., link low levels of timeliness to VPDs burden in The Gambia). At this point, we cannot make any bold claims about the effect of vaccination timeliness on vaccine preventable disease burden in The Gambia. We hope that we are able explore this important question in the near future by integrating population-level routine vaccination data and vaccine preventable diseases surveillance data.

We had suggested in the introduction that “This is particularly worrying as in parts of The Gambia, there has been a recent upsurge of measles, with a 6-fold increase in cases as of mid-2022 compared to 2020 figures despite a high coverage of both doses of measles-containing vaccine (MCV1 and MCV2)”. However, we cannot be certain that the increase in cases of measles are due to “low levels of vaccination timeliness”.

3. What is the current rates of use of electronic immunisation registries (EIRs) in The Gambia? If high, wouldn't EIRs provide a better means of assessing timeliness of vaccination in comparison to DHS surveys. If EIRs use is low, highlight in the discussion the need and potential impact of EIRs in identifying children for catch-up vaccination and improved timeliness.

RESPONSE: The Gambia began implementing Electronic Immunization Registers (EIRs) five years ago. This was done in phases, starting with specific administrative regions in the country. Overall, the progress in scaling up EIR has been encouraging.

There is no doubt that EIRs provides another means of assessing timeliness and its utility is well highlighted in the published literature on vaccination timeliness, especially in high-income countries. However, it is important to acknowledge a key limitation of EIRs: they only capture data of children who visit immunization facilities where EIRs have been implemented, thus, leaves out a key demographic. Therein lies the strength of DHS surveys as they can be considered representative of the overall population due to their survey design that ensure national representativeness.

4. Why is the vaccination coverage referred to as crude vaccination coverage? The authors specify that survey weights have been applied to the analysis, and if so, why is this still crude vaccination coverage.

RESPONSE: Thank you for raising this important point. Throughout the manuscript, we have now edited out “crude” in response to this comment.

5. Line 335: For HBV vaccine, highlight the potential of new HBV maternal vaccines in the pipeline in preventing infections at birth.

RESPONSE: Thank you for raising this important point. Given that maternal hepatitis B vaccines have not yet been implemented in The Gambia and many other LMICs, we have chosen to center our discussion around the public health implications of delayed birth dose of routine childhood hepatitis B vaccine. Our intention is to maintain the focus on the main message conveyed in that section of the discussion, which highlights the risks associated with not delivering the hepatitis B birth dose in a timely manner, particularly in countries like The Gambia where hepatitis B virus infection is endemic and poses a significant public health concern as outlined by the WHO guidelines.

6. Figure 5 and corresponding results. Split the untimely interval by vaccination before the minimum window and after the maximum window, and explain the results.

RESPONSE: Done. Please see updated Figure 5 and the accompanying results section.

7. What proportion of children are zero-dose children and under-immunised children? For records in the DHS for zero-dose children and under-immunised children, are these included in this analysis and if so, explain how are the indefinite intervals for missed vaccines are taken into it? vaccination and develops recommendations that could shape the design and implementation of future research.”

RESPONSE: The focus of this analysis was specifically on assessing the timeliness of vaccination, and as such, we did not delve into the topic of zero-dose. We computed timeliness based on children who had received their vaccinations AND possessed valid dates of birth and vaccination, as these key variables were essential for calculating timeliness, as outlined in lines 144-147 of the manuscript. This approach aligns with the guidelines provided in the 2019 WHO white paper on the harmonization, collection and analysis of vaccination coverage data, which recommends the utilization of valid information from vaccination cards when computing vaccination timeliness.

Furthermore, we state in lines 186-190 “The denominator for computing vaccination timeliness (timely, early, delayed and untimely interval vaccination) was all eligible children whose date of birth was known, were within the specified age ranges, and whose vaccination dates were available from a vaccination card” which further highlights the population included in this analysis.

8. Make the code used in the analysis publicly accessible in a online repository such as Github.

RESPONSE: Thank you for your suggestion. We agree that it is important to make the codes for our research publicly available. As part of our Data Management and Sharing (DMS) plan, we will be making the codes for this particular analysis and for other sub-studies in our EDCTP-funded project publicly available in an online repository at the end of the project. We believe that making the codes publicly available will help to advance scientific research and improve the reproducibility of our findings. It will also allow other researchers to build on our work and develop new insights.

Decision Letter 1

Orvalho Augusto

4 Jul 2023

Timeliness of routine childhood vaccination among 12-35 months old children in The Gambia: analysis of national immunisation survey data, 2019-2020

PONE-D-23-05149R1

Dear Dr. Wariri,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Orvalho Augusto, MD, MPH

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

This is a very nice manuscript. A minor suggestion (not required to do):

- In Figures 3B and 4B, is it possible to put the y-axis in log scale. So we can see the lower values where the cloud of points is concentrated

- Please, share your R code to perform this analysis

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: The authors have addressed my comments well and I have no additional comments.

While you have stated that the codes for this particular analysis and for other sub-studies in our EDCTP-funded project publicly available in an online repository at the end of the project, we expect you to make the code for this study available publicly ahead of publication.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Santosh Kumar Rauniyar

Reviewer #2: No

**********

Acceptance letter

Orvalho Augusto

12 Jul 2023

PONE-D-23-05149R1

Timeliness of routine childhood vaccination among 12-35 months old children in The Gambia: analysis of national immunisation survey data, 2019-2020

Dear Dr. Wariri:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Orvalho Augusto

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Flowchart displaying children included in this study by age group and birth/vaccination data completeness.

    (DOCX)

    S1 Table. Median number of days children were vaccinated too early and interquartile ranges for all vaccines for children 12–23 and 24–35 months in The Gambia.

    (DOCX)

    S2 Table. Median delays and interquartile ranges for all vaccines for children 12–23 and 24–35 months in The Gambia.

    (DOCX)

    Data Availability Statement

    The data underlying the results presented in this study were collected as part of the Gambia Demographic and Health Survey (DHS) conducted in 2019-2020. This data is publicly available for download from the DHS Program website at https://dhsprogram.com/data/available-datasets.cfm, however, it is important to note that prior permission from the DHS program must be obtained before accessing the data.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES