Highlights
-
•
Disruptions during the COVID-19 lockdown caused children to miss immunizations.
-
•
Government catch-up efforts substantially reversed these effects.
-
•
Yet, children that were due vaccinations during the lockdown remained 10–15% less likely to be immunized 4–5 months later.
-
•
Catch-up was more likely to be incomplete among children of low socioeconomic status.
-
•
Ensuring all children are fully immunized requires careful tracking and disaggregated data.
Keywords: Immunization coverage, COVID-19, Pandemics, Catch-up vaccination, India
Abstract
Introduction
Governments around the world suspended immunization outreach to control COVID-19 spread. Many have since resumed services with an emphasis on catch-up vaccinations. This paper evaluated immunization disruptions during India’s March-May 2020 lockdown and the extent to which subsequent catch-up efforts reversed them in Rajasthan, India.
Methods
In this retrospective observational study, we conducted phone surveys to collect immunization details for 2,144 children that turned one year old between January and October 2020. We used logistic regressions to compare differences in immunization timeliness and completed first-year immunization status among children that were due immunizations just before (unexposed), during (heavily exposed), and after (post-exposure) the lockdown.
Results
Relative to unexposed children, heavily exposed children were significantly less likely to be immunized at or before 9 months (OR 0.550; 95% CI 0.367–0.824; p = 0.004), but more likely to be immunized at 10–12 months (OR 1.761; 95% CI 1.196–2.591; p = 0.004). They were also less likely to have completed their key first-year immunizations (OR 0.624; 95% CI 0.478–0.816; p = 0.001) by the time of survey. In contrast, post-exposure children showed no difference in timeliness or completed first-year immunizations relative to unexposed children, despite their younger age. First-year immunization coverage among heavily exposed children decreased by 6.9 pp to 10.4 pp (9.7% to 14.0%). Declines in immunization coverage were larger among children in households that were poorer, less educated, lower caste, and residing in COVID red zones, although subgroup comparisons were not statistically significant.
Conclusion
Disruptions to immunization services resulted in children missing immunization during the lockdown, but catch-up efforts after it was eased ensured many children were reached at later ages. Nevertheless, catch-up was incomplete and children due their immunizations during the lockdown remained less likely to be fully immunized 4–5 months after it lifted, even as younger cohorts due immunizations in June or later returned to pre-lockdown schedules.
1. Introduction
The COVID-19 pandemic has caused severe disruptions to health services worldwide, as health system resources have been reallocated to the pandemic response, supply chains have been disrupted, and travel barriers and fear of contracting the virus have deterred health care utilization [1], [2], [3]. Immunization services are among the key preventive health services that have been affected in both rich and lower income countries [4], [5], [6].
In late March 2020, the WHO issued guidelines to countries to prioritize immunization as a core health service, but to temporarily suspend mass vaccination campaigns and weigh local risks and benefits in decisions on whether to continue immunization outreach activities [7]. More than half of the 129 countries covered in a survey released in May reported complete suspensions or substantial disruptions to immunization services in March and April, putting an estimated 80 million children under 1 year old at increased risk of contracting vaccine preventable diseases [8]. Travel and access barriers, supply-side disruptions due to provider shortages and suspended immunization services, and user fears of contracting COVID-19 have emerged as key reasons for reductions in immunizations [8], [9].
Disruptions to routine and critical care during large disease outbreaks can have sizeable effects on health outcomes. Sharp decreases in health care utilization during the Ebola and SARS epidemics were estimated to have indirect mortality effects similar in magnitude to the direct effects of the virus [10], [11], [12], [13], [14]. Declines in routine immunizations led to significant outbreaks of vaccine preventable diseases like measles [15], [16], [17]. Although young age and female sex are associated with lower COVID-19 mortality risk, early prediction models suggest that the indirect mortality effects of the pandemic among women and children due to lower use of preventive services may be substantial [18], [19]. A modeling analysis covering 54 African countries found that sustaining routine child immunizations would prevent substantially more deaths than excess COVID-19 mortality risk from vaccination clinic visits would cause [20].
Studies have documented large decreases in immunization coverage in higher income countries during the early months of the pandemic, when countries had imposed social distancing and quarantine policies [21], [22], [23], [24]. Much less is known about impacts in lower and middle income countries. Two largescale studies using the government’s electronic immunization records in Pakistan found greater than 50% declines in daily vaccinations during the COVID-19 lockdown [25], [26]. A study of administrative immunization data from 15 African countries found decreases in monthly vaccines of more than 10% in more than half of the countries [27]. However, whether immunization coverage recovered after lockdowns were lifted and immunization activities resumed remains unclear, in part because data tracking immunization status at the individual level are rare [28].
India recorded its first COVID-19 case in January. As case numbers began to increase, the Indian government announced a nationwide lockdown on March 24, 2020 that barred people from leaving their homes and halted almost all commercial activities and transport services to control virus spread [29]. The nationwide lockdown lasted 10 weeks, until May 31, 2020, after which restrictions continued in areas with high case counts. Although health facilities and critical health services were exempt from the lockdown, immunization outreach sessions were discontinued due to concerns that they may increase the spread of COVID-19 [30]. Media reports documented sharp declines in monthly immunizations in April [31]. In late May, the Ministry of Health issued updated guidelines calling for states to resume immunization outreach activities in locations that had prevented or contained COVID-19, with a focus on conducting catch-up immunizations [32].
Catch-up vaccinations are a critical component of the health system’s response during and after a pandemic, as missed immunizations increase the health risks of unvaccinated children and the population [33], [34], [35]. But they make substantial additional demands of already stretched resources [7], [36]. They require identification of individuals, groups, or cohorts with missed immunizations, communication to increase awareness and allay fears, additional supply chain management, and intensified catch-up activities, all while continuing routine immunization services and containing pandemic spread[37]. Understanding the extent to which catch-up efforts effectively reached children who had missed their immunizations is critical to adapting and targeting policies and immunization outreach activities in the coming months. However, publicly available administrative data is not sufficient to answer this question. In India, immunization coverage is monitored through the government’s Health Management Information System (HMIS), which collates data from the primary health care system and reports the total number of children immunized each month. Analysis of these data shows that monthly immunizations dropped by 70% nation-wide in April, but then rebounded substantially (supplement table S1, figures S1, S2). In Rajasthan, immunizations in May were 23% higher than pre-lockdown levels. While these aggregate changes provide an important measure of the health system’s recovery, they cannot assess the extent of catch-up among cohorts with missed immunizations or identify groups that remain unvaccinated, for which individual immunization status is required.
This study aimed to use primary survey data to examine disruptions to child immunizations during the COVID-19 lockdown and the extent to which the government’s efforts at catch-up immunization after the lockdown was eased were successful at reaching missed children in low-income households in Rajasthan, India.
2. Methods
2.1. Study population and data
We conducted a retrospective observational study using primary data collected through phone surveys to track changes in the immunization status of children that turned one year old between January and October 2020. The study was conducted in Rajasthan, the seventh most populous state in India, and among the states with early confirmed COVID-19 cases.[38]. Immunization services, except those provided at health facilities and at birth, were suspended statewide in the first weeks of the lockdown Active immunization outreach through local health facilities and village camps resumed in May, with particular attention given to ensuring catch-up among missed children, but services remained suspended in areas with high case numbers classified as COVID red zones [31].
We focused on children in households participating in the Bhamashah Swasthya Bima Yojana (BSBY), a statewide government health insurance program in Rajasthan. BSBY was launched in 2015 and entitles low-income households across the state to free hospital care, including for childbirths, in public and private hospitals. By 2019, over 6 million insurance claims had been filed under the program. We obtained access to administrative data on all insurance claims filed under the program through October 2019. These data included the service provided and the patient’s age, sex, phone number, and residence location. To identify households with at least one child that turned 12 months old between January and October 2020, and therefore eligible for immunizations in the months before and after the COVID-19 lockdown, we identified all claims for a childbirth between January and October 2019. We stratified claims by delivery month and the household’s residence district, and selected random samples of equal size within each stratum to be surveyed by phone using the numbers included in the insurance records. Because we expected a high share of phone numbers in the administrative records to be incorrect or outdated by the time of the survey, we sampled a substantially higher number of households than we expected would be reached.
The survey was conducted between August and early October 2020. Sampled households were randomly assigned to enumerators to avoid enumerator bias. Up to five attempts were made to reach every phone number on record for each household. Households that confirmed having no child born in or after January 2019 and at least 12 months old by the time of the survey were not surveyed. The survey was conducted with an adult that was most knowledgeable about the health of the children in the household and collected immunization histories, as well as data on COVID-related immunization disruptions, contacts with health care workers, demographics, and socioeconomic status. Details of whether or not every immunization on the national schedule was received, as well as the date of their first measles shot (Measles1) and most recent immunization, were obtained from the child’s immunization card if available. For children whose immunization card was not available at the time of the survey, we asked parents to report immunization details. Because parents have difficulty identifying each immunization and the precise date at which it was delivered, they were asked the total number of injectable immunizations after birth and date and location of the last immunization the child had received [39].
2.2. Exposure groups
To analyze changes in immunization status by how affected children were likely to be by the lockdown, we classified them into groups based on their age at the time of the COVID-19 lockdown period. The lockdown took effect in late March and extended through the end of May. The Measles1 injection is the last of the key first-year immunizations and is due at 9–12 months per the national immunization schedule, though historical data shows that most children get it in their ninth month [40]. Therefore, children who turned 12 months before March 2020 should have received all their first-year immunizations before the lockdown and should be least affected. We classified them as “unexposed”. Children who turned 12 months between March and May 2020 (9 months in December – February) may have been affected by lockdown disruptions if they had not already received their first-year immunizations by 11 months and were classified as “partially exposed”. Children who turned 12 months between June and August (9 months in March - May), were due their Measles1 during the worst of the lockdown and were likely to have faced the most severe consequences. They were classified as “heavily exposed”. Finally, children who turned 12 months in September or October (9 months in June or July), after the worst of the lockdown and when the government had resumed immunization activities, were classified as “post-exposure”.
2.3. Outcomes and measures
The discontinuation of immunization sessions in parts of March and April is expected to have caused children to miss immunizations due that month, but catch-up efforts that began later could have successfully reached these children. To study the extent of missed and catch-up immunizations, we examined the age at which children received their Measles1 immunization. Because parents were unable to reliably remember the name of each immunization over time and the age or date at which it was received, we conducted the analysis of Measles1 for children with an immunization card, which recorded the date for Measles1 if they had received it. Age at Measles1 was calculated as the difference between month of birth and month in which Measles1 was received. We created binary measures for Measles1 immunization received at or before 9 months of age and for Measles1 immunization received at 10 to 12 months. We excluded Measles1 at ages above 12 months to ensure we did not conflate age and exposure effects, as exposed and post-exposure children were younger at the time of survey.
To examine the immunization status of all children by the time of the survey, including those without an immunization card, we created a summary binary measure for whether the child had received all key first-year immunizations, combining data from the immunization card, if available, and parent reports otherwise. Given the difficulties parents face in recalling the names of immunizations, for children without an immunization card we used the total number of immunizations. We excluded BCG, which is due at birth and is typically provided at the delivery facility, and focused on injectable immunizations to avoid confusion between oral immunizations and other medications. Therefore, for children without an immunization card, the completed key first-year immunization status outcome was equal to 1 if the parents reported the child had received at least 4 injectable immunizations and, for children with an immunization card, it was equal to 1 if the Pentavalent1, Pentavalent2, Pentavalent3, and Measles1 immunizations were recorded on the card. Because this measure captured completed first-year immunization status as of the date of the survey, it included the results of catch-up immunization efforts after the lockdown was eased.
2.4. Statistical methods
To study differences in immunization outcomes across child exposure groups, we ran logistic regressions of each binary immunization outcome on indicators for exposure classification, with “unexposed” children as the reference group. The analysis of timeliness of Measles1 immunization was conducted on the subsample of children with an immunization card. The analysis of completed key first-year immunization status was conducted on all children, combining data from the immunization card and parent reports. Adjusted regressions included binary indicators for survey month, low assets, and low caste as controls. Because differences between children with and without an immunization card may be correlated with immunization status and reporting accuracy, the adjusted regressions of completed key first-year immunization status included an additional binary indicator for whether the child had an immunization card. We also reported the raw probability of having received all key first-year immunizations from the same regressions.
To test whether children across exposure groups were similar in other characteristics, we used pairwise t-tests of child sex, low assets, low parent education, low caste, having an immunization card, and exposure to COVID red zones. To check the sensitivity of the analysis to whether data were obtained from the immunization card or from parent reports, we also estimated the probability of completed key first-year immunization status, and differences by exposure group, separately for immunization status measured from each data source. Since immunizations due at younger ages should be unaffected by the lockdown, we ran similar logistic regressions with receipt of Pentavalent1 and Pentavalent2, which are due at less than 9 months, as the outcomes on indicators for exposure group as a falsification test.
To examine whether lockdown exposure had differential effects on immunization status across subgroups, we estimated the change in probability of completed key first-year immunization status for heavily exposed relative to unexposed children for each subgroup. These probabilities were estimated after running logistic regressions of the completed immunization indicator on the interaction of exposure group and each subgroup characteristic with controls for survey month and having an immunization card. Binary subgroups were defined for female sex, low assets (below median index score), at or below 12 years of parent schooling, low caste, and residence in a COVID red zone. The asset index was computed as the standardized first component of a principal component analysis of a list of assets. Households belonging to a scheduled caste or tribe group were classified as low caste. All analysis was conducted using Stata version 16[41].
3. Results
3.1. Survey sample
Of the 5,102 households sampled for survey, 3,418 (67%) were reached by phone and 2,248 households (44.1%) confirmed having a child born in or after January 2019 and at least 12 months old by the time of the survey in the household (supplement table S2). The primary reasons for being unable to reach the household were that the phone number was invalid, outside coverage, or switched off, which was most likely due to households changing their phone numbers over time or possibly to numbers being entered incorrectly in the insurance records. Surveyed households are statistically similar to those unreached for survey in terms of mother’s age, access to health facilities, village characteristics, and exposure to COVID red zone, which increases confidence that surveyed households are representative of those sampled (supplement table S3). 92.6% of eligible households consented to participating in the study, resulting in a final study sample of 2,081 households. Because 63 households had two eligible children, the final sample includes 2,144 children aged at least 12 months old.
Table 1 presents descriptive statistics for children included in the study. 52% of children were male and 26% were in lower caste households. 1,287 (60%) children had an immunization card available. Children with an immunization card available were less likely to be male and poor (supplement table S4). Recent contacts with the public primary health care system were substantial: 82% of children had seen a health worker since the imposition of the lockdown (Table 1). For 31% of children, parents reported experiencing a COVID-related disruption to their immunizations. Fear of contracting COVID-19 was the most common reported cause of disruptions (20%), followed by canceled immunization sessions (15%), and travel barriers that made it difficult to reach the session (10%). 19% of children resided in districts classified as COVID red zones throughout April and May. Overall, 21% of children in the study sample were classified as unexposed to the lockdown, 34% and 37% were classified as partially exposed and heavily exposed, and 9% turned 12 months in September or later and were classified as post-exposure. Children across exposure groups were similar in terms of sex, assets, caste, parental education, and COVID-zone classification (supplement table S5). By construction, unexposed children were oldest (median 19 months) and post-exposure children were youngest (median 12 months) by the time of the survey.
Table 1.
Number | Percent | |
---|---|---|
Characteristicsa | ||
Male | 1,122 | 52 |
Low caste | 556 | 26 |
Low parent education | 1,157 | 54 |
Has immunization card | 1,287 | 60 |
Seen health worker since lockdown | 1,652 | 82 |
Any COVID-related immunization disruption | 649 | 31 |
Avoided due to COVID fear | 407 | 20 |
Immunization camp not held | 315 | 15 |
Travel barriers | 215 | 10 |
Residence in COVID red zone | 414 | 19 |
Exposure Groups | ||
Unexposed (12mo before Mar) | 443 | 21 |
Partially exposed (12mo Mar-May) | 722 | 34 |
Heavily exposed (12mo Jun-Aug) | 796 | 37 |
Post-exposure (12mo Sep-Oct) | 183 | 9 |
The study included 2,144 children from 2,081 households (63 households had two eligible children). Children were classified as low caste if their household belonged to a scheduled caste or tribe and as low parent education if neither parent had completed more than 12 years of schooling. Healthcare worker includes Accredited Social Health Activist, Anganwadi Worker or Auxiliary Nurse Midwife, the three frontline primary health workers. COVID red zones are districts classified by the government as having high COVID-19 cases in late April and May.
3.2. Timeliness of Measles1 immunizations
Fig. 1 presents adjusted odds ratios for receiving Measles1 immunization at or before 9 months and between 10 and 12 months by exposure group. Unadjusted estimates are in supplement table S6. Heavily exposed children experienced a shift in the timing of their Measles1 immunization compared to both unexposed and post-exposure children. They were significantly less likely to have been immunized at or before 9 months than unexposed children (OR 0.550, p = 0.004, 95% CI 0.367 to 0.824) and were significantly more likely to get their immunization later, between 10 and 12 months (OR 1.761, p = 0.004, 95% CI 1.196 to 2.591), suggesting that the efforts to conduct catch-up immunizations after the lockdown reached many of these children at later ages. Post-exposure children showed no differences in timeliness of Measles1 immunizations relative to unexposed children, indicating that children turning 9 months in June or later returned to pre-lockdown immunization schedules. The complete breakdown by age in supplement figure S3 shows that 51% of unexposed children had already received their Measles1 at or before 9 months, this dropped to 34% among heavily exposed children, and increased to 45% among post-exposure children. However, 33% of heavily exposed children were immunized at 11 or 12 months, compared to 13% of unexposed and 19% of post-exposure children, indicating that a substantial share of heavily exposed children was immunized between May and July, when immunization activities resumed.
3.3. Completed first-year immunization status
Fig. 2 presents the unadjusted probability of having completed all key first-year immunizations by the time of the survey across exposure groups, combining children with and without an immunization card. Among unexposed children, who turned 12 months old in February 2020 or earlier, 74.5% (95% CI 70.4% to 78.6%) had received all their key first-year immunizations. Coverage dropped to 70.4% (95% CI 67.0% to 73.7%) among partially exposed children and 64.1% (95% CI 60.7% to 67.4%) among heavily exposed children. However, among post-exposure children coverage increased to 71.0% (95% CI 64.5% to 77.6%). Comparing heavily exposed children to the pre- and post-exposure groups suggests a decline in first-year immunization coverage of 6.9 pp to 10.4 pp, or 9.7% to 14.0%. The covariate-adjusted predicted probabilities are very similar in magnitude (Table 2 Panel A). The complete breakdown by birth cohort shows a fairly steady decline in coverage across children classified as partially and heavily exposed, followed by a rebound amongst the post-exposed (supplement figure S4, table S7).
Table 2.
Panel A: Probability of Completed First-Year Immunizationsa | ||||||
---|---|---|---|---|---|---|
Unadjusted |
Adjusted |
|||||
PR | 95% CI | PR | 95% CI | |||
Unexposed | 0.745 | (0.704–0.786) | 0.741 | (0.701–0.780) | ||
Partially exposed | 0.704 | (0.670–0.737) | 0.700 | (0.668–0.732) | ||
Heavily exposed | 0.641 | (0.607–0.674) | 0.649 | (0.617–0.680) | ||
Post-exposure | 0.710 | (0.645–0.776) | 0.705 | (0.639–0.770) | ||
Panel B: Change in Completed First-Year Immunizations Relative to Unexposed Children | ||||||
Unadjusted |
Adjusted |
|||||
OR | p-value | 95% CI | OR | p-value | 95% CI | |
Unexposed | Ref | Ref | ||||
Partially exposed | 0.813 | 0.128 | (0.623–1.061) | 0.804 | 0.122 | (0.610–1.060) |
Heavily exposed | 0.611 | <0.001 | (0.472–0.790) | 0.624 | 0.001 | (0.478–0.816) |
Post-exposure | 0.840 | 0.374 | (0.572–1.233) | 0.825 | 0.354 | (0.549–1.240) |
Panel A presents unadjusted and covariate-adjusted predicted probabilities of having received all key first-year immunizations by exposure group. The unadjusted probabilities are the same as presented in Fig. 2. Panel B presents odds ratios from logistic regressions of the same binary outcome on indicators for exposure group, with unexposed children that turned 12 months old before March 2020 as the reference group. The outcome is equal to one if the child received Pentavalent1, Pentavalent2, Pentavalent3, and Measles1 on the immunization card or at least 4 injectable immunizations per parent reports, if the immunization card was unavailable. Adjusted regressions include indicators for survey month, low assets, low caste, and whether the child had an immunization card as controls. PR = probability OR = odds ratio.
Table 2 (panel B) presents regression results directly comparing completed first-year immunization across exposure groups relative to unexposed children. The results confirm the patterns in Fig. 2. Heavily exposed children were significantly less likely to have received all their key first-year immunizations by the time of the survey than unexposed children (adjusted OR 0.624, p = 0.001, 95% CI 0.478 to 0.816), while post-exposure children rebounded, with an odds ratio that was higher than heavily exposed children and not significantly different from those of unexposed children (adjusted OR 0.825, p = 0.354, 95% CI 0.549 to 1.240). Part of the decline in coverage between unexposed and heavily exposed children may be due to the lower age of the latter by the time of the survey. However, comparison with the higher estimate for post-exposure children, who were youngest at the time of the survey, relative to heavily exposed children indicates that at least half of this decline cannot be explained by age.
In supplement table S8 we examined the sensitivity of the results to whether data were obtained from the immunization card or parent reports. The probability of completed first-year immunization was higher among children with an immunization card in every exposure group, which may reflect underreporting by parents or higher immunization coverage among children with a card. However, differences in immunization coverage across exposure groups showed similar patterns across the two data sources: large decreases among heavily exposed children relative to the unexposed and a rebound among post-exposure children (supplement table S8). Falsification tests examining immunizations due prior to the ninth month, that should be unaffected by exposure to the lockdown, did not show any differences by exposure group (supplement table S9). Results are also not sensitive to including only the younger of the two children in the 63 households with more than one eligible child (supplement table S10).
3.4. Subgroup analysis
Among unexposed children, the probability of completed first-year immunization status was lower among those in less educated (70.1% vs 79.0%), poorer (71.5% vs 77.1%), and lower caste (72.6% vs 74.8%) households (Fig. 3). Comparing differences between heavily exposed and unexposed children, declines were also larger for each of these subgroups than for their more educated, wealthier, and higher caste counterparts, although the subgroup comparisons were not significant at the 95% level (Fig. 3, supplement table S11). The largest difference was by education: the decline among heavily exposed children was 5.8 pp (p = 0.101) in more educated households and 13.0 pp (p <0.001) in less educated households (7.2 pp difference in declines, p = 0.160). Children residing in COVID red zones also experienced a larger decline (17.9 pp, p = 0.002) than those in other areas (7.7 pp, p = 0.009; 10.2 pp difference; p = 0.109). For most groups, coverage among post-exposure children was similar to that among unexposed children, but levels remained lower in COVID red zones (supplement table S11).
4. Discussion
Using primary data collected through phone surveys on the immunization status of children that turned one year old between January and October 2020, this study found substantial changes in the timeliness of child immunizations. Children due the Measles1 immunization between March and May, during the strictest lockdown, were significantly less likely to receive it at or before 9 months of age than older cohorts, and more likely to have received the Measles1 immunization at older ages, providing evidence that immunization outreach after the lockdown was eased was successful at reaching many of them.
Nevertheless, catch-up efforts did not fully offset the lapses in immunization. We measured the likelihood of having completed all key first-year immunizations at the time of the survey, 4–5 months after the lockdown was eased, across all exposure groups. Children due immunizations during the lockdown had a significantly lower likelihood of completed first-year immunizations at the time of the survey, when they were about 14 months old, than unexposed children. In contrast, among children that were due their immunizations in June or later, after the lockdown eased, completed immunizations levels were not significantly different from pre-lockdown ones. This finding of a rebound among the youngest cohort in our study is important for several reasons. First, it suggests immunization activities may already be on an upward trajectory and returning to pre-lockdown schedules, although this progress will need continuous monitoring. Second, while the lower immunization coverage among heavily exposed relative to unexposed children may reflect the younger age of the former, comparing them with the younger post-exposure children clarifies that age cannot explain the decline. Instead, it provides an alarming sign that, despite the resumption of immunization services, children most exposed to the lockdown were not fully reached through catch-up efforts, even as immunizations among younger cohorts increased, and may be at risk of being missed without careful tracking and targeted interventions.
Subgroup analysis found that children in less educated, poorer, and lower caste households had lower pre-COVID levels of immunization, consistent with prior evidence on the socioeconomic predictors of delayed and incomplete vaccination in India [42], [43]. Worryingly, these subgroups also experienced somewhat larger declines during the lockdown that catch-up efforts had not addressed by the time of this study. These disparities may reflect lower trust or awareness of the importance of immunization among households, but also the inadequate reach of the health system among these populations. An effective post-pandemic response will need to ensure these groups are not left out. We also found larger declines in immunization coverage among children in COVID red zones that are unsurprising, as services in these areas remained suspended after the national lockdown was lifted [29]. However, the risk of vaccine preventable infectious disease outbreaks in these areas needs to be weighed against the risk of COVID-19 spread through immunization outreach [20].
Our findings provide a snapshot of the immunization situation 4–5 months after India’s nationwide lockdown was eased. Immunization status may continue to improve if catch-up efforts to reach children with pending immunizations are successful at addressing both demand and supply side constraints. Nevertheless, our findings offer an early understanding of how immunization status has evolved after the recommencement of services, and the success and shortfalls in coverage that policy efforts must focus on. It is also important to note that, per the HMIS, post-lockdown increases in immunizations were larger in Rajasthan than in other states, suggesting that catch-up may have been more successful in Rajasthan and the share of children with incomplete vaccinations may be much higher elsewhere in India (supplement table S1).
An important implication of this study is that successful catch-up requires careful monitoring of the immunization status of individuals and groups [36], [37]. Monitoring metrics that track total numbers of children immunized each month cannot identify the specific groups that have fallen behind and that catch-up efforts must target. In supplementary analysis of the government’s administrative HMIS data for Rajasthan, we found monthly full immunizations declined from 113,190 before the lockdown to 14,514 in April (-87%) but then increased to 155,416 (+37%) and 141,389 (+25%) in May and June (supplement table S1). Based on the HMIS data, the Rajasthan government announced that it had exceeded its immunization targets in May and June [44]. However, aggregate trends may increase due to seasonal fluctuations in immunization demand rather than successful catch-up. We found that correcting for historical trends reduced these estimates to 23% in May and −4% in June. Furthermore, it is impossible to ascertain whether these aggregate increases reflect expanded immunization coverage among younger cohorts or successful catch-up among older cohorts already in the system, nor whether specific subgroups were left out. Domestic migration, which was substantial after the lockdown in India, further complicates interpretation of absolute numbers [45]. Our study shows that, while there were indeed increases in post-lockdown immunization outreach and coverage, they did not fully offset immunizations missed during the lockdown, particularly among groups that are typically underserved by the health system.
While strengthening the supply of services is critical, catch-up efforts also need to address the demand side. Consistent with evidence no COVID-19 and prior outbreaks, we found that fear of contracting COVID was a commonly reported reason for missed immunizations [6], [8], [9], [12]. Public health policies will need to allay these fears by building trust in public primary care services, clearly communicating the importance of continuing immunizations even during a pandemic, and ensuring that attending immunization camps does not increase the risk of COVID infection.
This study has several limitations. First, the sample is households with an institutional child delivery under the BSBY government health insurance program and findings may not be representative of Rajasthan’s population. Given that BSBY targets low-income households across the state, this population is of particular policy interest, but it may exclude the poorest households that underutilize health facilities. Second, although phone surveys allowed us to rapidly survey a large sample of households at a time when in-person data collection was impossible, because phone numbers were obtained from administrative records from a year ago, this resulted in substantial attrition in the survey. We expected this at the start of the study and oversampled households for survey. Surveyed households were not significantly different from those we were unable to reach on characteristics available in the administrative records, increasing confidence that attrition did not bias our study sample. Third, the study relied on data from the immunization card and parent reports of immunization status, both of which may be subject to error. We found that estimates of levels of completed immunization coverage from immunization cards were typically higher than those from parent reports, which could reflect biases in either data source, but also real differences in immunization status across these groups. Largescale validations of recall in low income contexts have found that parent-reported immunization status is reliable and including it can yield more representative estimates of coverage than health cards alone [46]. Furthermore, our analysis of differences in immunization status across exposure groups showed similar patterns across children with and without an immunization card, suggesting any potential biases were not likely to be differential across exposure groups.
Despite substantial gains in immunization coverage over the last decade, India accounts for 37% of global measles deaths and Rajasthan has lower immunization coverage than the rest of the country [47], [48], [49]. The state resumed immunization activities quickly and effectively after the lockdown and reversed much of the effect of the pandemic on vaccination status. However, without careful tracking to identify the specific individuals and groups that missed immunizations, and targeted efforts prioritizing them for catch-up, a large share of children may remain unvaccinated, turning back decades of progress against infectious diseases.
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgments
Acknowledgements
We would like to thank Putul Gupta for management support on this project and the team of surveyors that helped collect the data.
Contributors
RJ and PD developed the research question and study design. MP and AC oversaw data collection and did the data cleaning. MP, CF, and RJ conducted the statistical analysis. RJ wrote the initial manuscript draft. All authors revised drafts and approved of its final version.
Funding
This work was funded by a grant from the Bill and Melinda Gates Foundation, awarded through the JPAL South Asia CaTCH Initiative’s special COVID-19 funding window. The funders had no role in the study design; in the collection, analysis and interpretation of the data; and in the development of this manuscript.
Ethics
This study received ethical clearance from the institutional review boards at the Institute for Financial Management and Research (IFMR) in India and Stanford University in the US (protocol no. 41683). Participants gave oral consent before taking part in the survey.
Footnotes
Supplementary data to this article can be found online at https://doi.org/10.1016/j.vaccine.2021.06.022.
Appendix A. Supplementary data
The following are the Supplementary data to this article:
References
- 1.World Health Organization. Coronavirus disease (COVID-19) pandemic. 2020.https://www.who.int/emergencies/diseases/novel-coronavirus-2019 [Accessed 16 Nov 2020].
- 2.Birkmeyer J.D., Barnato A., Birkmeyer N. The Impact Of The COVID-19 Pandemic On Hospital Admissions In The United States. Health Aff. 2020;39:2010–2017. doi: 10.1377/hlthaff.2020.00980. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.COVID-19 significantly impacts health services for noncommunicable diseases. Available: https://www.who.int/news/item/01-06-2020-covid-19-significantly-impacts-health-services-for-noncommunicable-diseases [Accessed 16 Nov 2020].
- 4.Nelson R. COVID-19 disrupts vaccine delivery. Lancet Infect Dis. 2020;20:546. doi: 10.1016/S1473-3099(20)30304-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Saxena S., Skirrow H., Bedford H. Routine vaccination during covid-19 pandemic response. BMJ 2020:369. doi:10.1136/bmj.m2392. [DOI] [PubMed]
- 6.Garg S., Basu S, Rustagi R., et al. Primary Health Care Facility Preparedness for Outpatient Service Provision During the COVID-19 Pandemic in India: Cross-Sectional Study. JMIR public Heal Surveill 2020;6:e19927–e19927. doi:10.2196/19927. [DOI] [PMC free article] [PubMed]
- 7.World Health Organisation. Guiding principles for immunization activities during the COVID-19 pandemic. 2020. Available: https://www.who.int/immunization/documents/who_ivb_17.03/en/4https://www.who.int/emergencies/diseases/novel-coronavirus-2019/technical-guidance [Accessed 16 Nov 2020].
- 8.World Health Organisation. At least 80 million children under one at risk of diseases such as diphtheria, measles and polio as COVID-19 disrupts routine vaccination efforts, warn Gavi, WHO and UNICEF. 2020. Available: https://www.who.int/news/item/22-05-2020-at-least-80-million-children-under-one-at-risk-of-diseases-such-as-diphtheria-measles-and-polio-as-covid-19-disrupts-routine-vaccination-efforts-warn-gavi-who-and-unicef [Accessed 16 Nov 2020].
- 9.Saso A., Skirrow H., Kampmann B. Impact of COVID-19 on Immunization Services for Maternal and Infant Vaccines: Results of a Survey Conducted by Imprint—The Immunising Pregnant Women and Infants Network. Vaccines. 2020;8 doi: 10.3390/vaccines8030556. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Wagenaar B.H., Augusto O., Beste J. The 2014–2015 Ebola virus disease outbreak and primary healthcare delivery in Liberia: Time-series analyses for 2010–2016. PLOS Med. 2018;15:1–26. doi: 10.1371/journal.pmed.1002508. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Brolin Ribacke K.J., Saulnier D.D., Eriksson A. Effects of the West Africa Ebola Virus Disease on Health-Care Utilization - A Systematic Review. Front public Heal. 2016;4:222. doi: 10.3389/fpubh.2016.00222. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Chang H.J., Huang N., Lee C.H. The impact of the SARS epidemic on the utilization of medical services: SARS and the fear of SARS. Am J Public Health. 2004;94:562–564. doi: 10.2105/ajph.94.4.562. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Sochas L., Channon A.A., Nam S. Counting indirect crisis-related deaths in the context of a low-resilience health system: the case of maternal and neonatal health during the Ebola epidemic in Sierra Leone. Health Policy Plan. 2017;32:iii32–9. doi: 10.1093/heapol/czx108. [DOI] [PubMed] [Google Scholar]
- 14.Takahashi S., Metcalf C.J.E., Ferrari M.J. Reduced vaccination and the risk of measles and other childhood infections post-Ebola. Science. 2015;347:1240–1242. doi: 10.1126/science.aaa3438. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Suk J.E., Paez Jimenez A., Kourouma M. Post-Ebola Measles Outbreak in Lola, Guinea, January-June 2015. Emerg Infect Dis. 2016;22:1106–1108. doi: 10.3201/eid2206.151652. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Colavita F., Biava M., Castilletti C. Measles Cases during Ebola Outbreak, West Africa, 2013–2106. Emerg Infect Dis. 2017;23:1035–1037. doi: 10.3201/eid2306.161682. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Masresha B.G., Luce R., Jr, Weldegebriel G. The impact of a prolonged ebola outbreak on measles elimination activities in Guinea, Liberia and Sierra Leone, 2014–2015. Pan Afr Med J. 2020;35:8. doi: 10.11604/pamj.supp.2020.35.1.19059. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Williamson E.J., Walker A.J., Bhaskaran K. Factors associated with COVID-19-related death using OpenSAFELY. Nature. 2020;584:430–436. doi: 10.1038/s41586-020-2521-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Roberton T., Carter E.D., Chou V.B. Early estimates of the indirect effects of the COVID-19 pandemic on maternal and child mortality in low-income and middle-income countries: a modelling study. Lancet Glob Heal. 2020;8:e901–e908. doi: 10.1016/S2214-109X(20)30229-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Abbas K., Procter S.R., van Zandvoort K. Routine childhood immunisation during the COVID-19 pandemic in Africa: a benefit–risk analysis of health benefits versus excess risk of SARS-CoV-2 infection. Lancet Glob Heal. 2020;8:e1264–e1272. doi: 10.1016/S2214-109X(20)30308-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Santoli J.M., Lindley M.C., DeSilva M.B. Effects of the COVID-19 Pandemic on Routine Pediatric Vaccine Ordering and Administration - United States, 2020. MMWR Morb Mortal Wkly Rep. 2020;69:591–593. doi: 10.15585/mmwr.mm6919e2. [DOI] [PubMed] [Google Scholar]
- 22.Bramer C.A., Kimmins L.M., Swanson R. Decline in Child Vaccination Coverage During the COVID-19 Pandemic - Michigan Care Improvement Registry, May 2016-May 2020. MMWR Morb Mortal Wkly Rep. 2020;69:630–631. doi: 10.15585/mmwr.mm6920e1. [DOI] [PubMed] [Google Scholar]
- 23.McDonald H.I., Tessier E., White J.M. Early impact of the coronavirus disease (COVID-19) pandemic and physical distancing measures on routine childhood vaccinations in England, January to April 2020. Eurosurveillance. 2020;25 doi: 10.2807/1560-7917.ES.2020.25.19.2000848. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Alrabiaah A.A., Alshaer A.H., Estrella S.M.C. Effects of the Coronavirus disease 2019 pandemic on routine pediatric immunization coverage rates at the main University Hospital in Saudi Arabia. Saudi Med J. 2020;41:1197–1203. doi: 10.15537/smj.2020.11.25457. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Chandir S., Siddiqi D.A., Setayesh H. Impact of COVID-19 lockdown on routine immunisation in Karachi. Pakistan. Lancet Global Health. 2020;8:e1118–e1120. doi: 10.1016/S2214-109X(20)30290-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Chandir S., Siddiqi D.A., Mehmood M. Impact of COVID-19 pandemic response on uptake of routine immunizations in Sindh, Pakistan: An analysis of provincial electronic immunization registry data. Vaccine. 2020;38:7146–7155. doi: 10.1016/j.vaccine.2020.08.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Masresha B. The performance of routine immunization in selected African countries during the first six months of the COVID-19 pandemic. The Pan African Medical Journal. 2020;37(Suppl):1. doi: 10.11604/pamj.supp.2020.37.1.26107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Walker D., Chandir S. COVID-19's lost generation of unvaccinated children. The Lancet Global Health. 2021;9(3) doi: 10.1016/S2214-109X(20)30535-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Ministry of Home Affairs. Government of India. Annexure to Ministry of Home Affairs Order No. 40-3/2020-D. 2020. Available: https://www.mha.gov.in/sites/default/files/Guidelines.pdf [Accessed 16 Nov 2020].
- 30.Ministry of Health and Family Welfare. Government of India. Enabling Delivery of Essential Health Services during the COVID 19 Outbreak: Guidance note. 2020. Available: https://www.mohfw.gov.in/pdf/EssentialservicesduringCOVID19updated0411201.pdf [Accessed 16 Nov 2020].
- 31.Rukmini S. COVID-19 Disrupted India’s Routine Health Services. 2020. Available:https://www.indiaspend.com/covid-19-disrupted-indias-routine-health-services/ [Accessed 16 Nov 2020].
- 32.Ministry of Health and Family Welfare Government of India. Immunization Services during and post COVID-19 Outbreak . 2020. Available: https://www.mohfw.gov.in/pdf/3ImmunizationServicesduringCOVIDOutbreakSummary150520202.pdf [Accessed 16 Nov 2020].
- 33.Guerra F.A. Delays in immunization have potentially serious health consequences. Paediatr Drugs. 2007;9:143–148. doi: 10.2165/00148581-200709030-00002. [DOI] [PubMed] [Google Scholar]
- 34.Dannetun E., Tegnell A., Hermansson G. Timeliness of MMR vaccination–influence on vaccination coverage. Vaccine. 2004;22:4228–4232. doi: 10.1016/j.vaccine.2004.04.018. [DOI] [PubMed] [Google Scholar]
- 35.Siedler A., Hermann M., Schmitt H.-J. Consequences of delayed measles vaccination in Germany. Pediatr Infect Dis J. 2002;21:826–830. doi: 10.1097/00006454-200209000-00008. [DOI] [PubMed] [Google Scholar]
- 36.MacDonald N.E., Comeau J.L., Dubé È. COVID-19 and missed routine immunizations: designing for effective catch-up in Canada. Can J Public Heal. 2020;111:469–472. doi: 10.17269/s41997-020-00385-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.World Health Organization. Working Draft: Leave No One Behind: Guidance for Planning and Implementing Catch-up Vaccination. 2020. Available: https://www.who.int/immunization/programmes_systems/policies_strategies/WHO_Catch-up_guidance_working_draft_11.08.20.pdf?ua=1 [Accessed 16 Nov 2020]
- 38.Dong E., Du H., Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis. 2020;20:533–534. doi: 10.1016/S1473-3099(20)30120-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Suarez L., Simpson D.M., Smith D.R. Errors and correlates in parental recall of child immunizations: effects on vaccination coverage estimates. Pediatrics. 1997;99:E3. doi: 10.1542/peds.99.5.e3. [DOI] [PubMed] [Google Scholar]
- 40.Ministry of Health and Family Welfare Government of India. National Immunization Schedule (NIS) for Infants, Children and Pregnant Women. Available: https://main.mohfw.gov.in/sites/default/files/245453521061489663873.pdf [Accessed 16 Nov 2020]
- 41.StataCorp. Stata Statistical Software: Release 16.
- 42.Shrivastwa N., Gillespie B.W., Kolenic G.E. Predictors of Vaccination in India for Children Aged 12–36 Months. Am J Prev Med. 2015;49:S435–S444. doi: 10.1016/j.amepre.2015.05.008. [DOI] [PubMed] [Google Scholar]
- 43.Choudhary T.S., Reddy N.S., Apte A. Delayed vaccination and its predictors among children under 2 years in India: Insights from the national family health survey-4. Vaccine. 2019;37:2331–2339. doi: 10.1016/j.vaccine.2019.03.039. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Times of India. Covid fallout: Immunisation ‘ignored’ in 800 Rajasthan red zones. 2020. Available: https://timesofindia.indiatimes.com/city/jaipur/covid-fallout-immunisationignored-in-800-raj-red-zones/articleshow/76822918.cms [Accessed 16 Nov 2020]
- 45.Khanna A. Impact of Migration of Labour Force due to Global COVID-19 Pandemic with Reference to India. J Health Manag. 2020;22:181–191. doi: 10.1177/0972063420935542. [DOI] [Google Scholar]
- 46.Brown J., Monasch R., Bicego G. An assessment of the quality of national child immunization coverage estimates in population-based surveys. Chapel Hill Carolina Popul Cent. 2002;700 [Google Scholar]
- 47.World Health Organization. India’s Measles-Rubella Vaccination Campaign a Big Step Towards ReducingChildhood Mortality, Addressing Birth Defects. 2017. Available: https://www.who.int/southeastasia/news/detail/05-02-2017-india-s-measles-rubella-vaccination-campaign-a-big-step-towards-reducing-childhood-mortality-addressing-birth-defects 2016. [Accessed 16 Nov 2020]
- 48.International Institute for Population Sciences. National Family Health Survey (NFHS-4), 2015-16: India, Mumbai, 2017. Available: http://dhsprogram.com/pubs/pdf/FR339/FR339.pdf [Accessed 16 Nov 2020].
- 49.International Institute for Population Sciences. National Family Health Survey (NFHS-3) 2005-06. Vol. 1. 2007. Available: http://dhsprogram.com/pubs/pdf/FRIND3/FRIND3.pdf [Accessed 16 Nov 2020].
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.