Abstract
After many decades of vaccination, measles epidemiology varies greatly between and within countries. National immunization programs are therefore encouraged to conduct regular situation analyses and to leverage models to adapt interventions to local needs. Here, we review applications of models to develop locally tailored interventions to support control and elimination efforts. In general, statistical and semi-mechanistic transmission models can be used to synthesize information from vaccination coverage, measles incidence, demographic, and/or serological data, offering a means to estimate the spatial and age-specific distribution of measles susceptibility. These estimates complete the picture provided by vaccination coverage alone, by accounting for natural immunity. Dynamic transmission models can then be used to evaluate the relative impact of candidate interventions for measles control and elimination and the expected future epidemiology. In most countries, models predict substantial numbers of susceptible individuals outside the age range of routine vaccination, which affects outbreak risk and necessitates additional intervention to achieve elimination. More effective use of models to inform both vaccination program planning and evaluation requires the development of training to enhance broader understanding of models and where feasible, building capacity for modelling in-country, pipelines for rapid evaluation of model predictions using surveillance data, and clear protocols for incorporating model results into decision-making.
Keywords: Measles, Measles vaccination, Rubella, Epidemiology, Elimination, Mathematical models
1. Introduction
The Global Vaccine Action Plan 2011–2020 (GVAP) has a target of eliminating measles and rubella in at least five of the six World Health Organization (WHO) regions by 2020 [1]. The WHO recommends that all countries include a second dose of measles-containing vaccine (MCV) in national vaccination schedules; countries aiming for measles elimination should achieve ≥95% coverage with both doses equitably across all districts. To attain these goals, routine immunization (RI), the regular vaccination of children according to the national immunization schedule, may be complemented by supplementary immunization activities (SIAs), short duration national or subnational campaigns targeting all children within a chosen age range [2]. Progress is very heterogenous [3] hence current measles epidemiological profiles range from persistent high incidence and mortality in some, mainly low- and middle-income countries (LMICS), to sporadic outbreaks, to the elimination of indigenous transmission [4]. Models have been used to analyse measles dynamics since the 1920s and have informed global public health policy [2], [5]. The WHO and the Vaccine Alliance (Gavi) now recommend that countries use models when possible to adapt vaccination strategies to local disease dynamics [2], [6].
In this paper, we review how models are increasingly used to address programmatic questions at the country level in LMICS (Table 1). We illustrate how combining different sources of data in models helps to overcome some of the biases in individual data streams. Although there are many different types of models, we highlight some of the more common forms and their applications. We begin with examples of statistical and semi-mechanistic transmission models, which are used in conjunction with demographic data to estimate the spatial and age-specific distribution of vaccination (from coverage data) and infection (from surveillance data). From these, the location, size and ages of the susceptible population can be estimated [7]. These results are useful in themselves and are input into dynamic transmission models, where the spread of infection is explicitly modelled to estimate how likely transmission is in different population groups, estimate the magnitude of outbreaks, and assess the impact of various vaccination strategies to guide outbreak response or elimination policies (Fig. 1). In turn, modelling helps to show priorities for the collection of further empirical data on infection and immunity [8]. We focus on the contribution of models to measles control and elimination strategies but point out areas of concern for rubella. Other types and uses of models at the global level, such as disease burden estimation [9] and supply chain alternatives [10], are beyond the scope of this paper.
Table 1.
Program question | Empirical data sources | Main disadvantages of current analyses of empirical data | Contribution of models to data analysis and interpretation |
---|---|---|---|
Where are gaps in routine MCV coverage? |
|
|
Geospatial models can help to improve denominator estimates. Model-based geostatistical analyses of household survey data (e.g. DHS) allow high-resolution vaccination coverage estimation (e.g. 1x1km) with corresponding uncertainty levels. Models can incorporate data on spatial covariates (urbanicity, remoteness, poverty, etc.) to produce more granular coverage estimates. Models can thus estimate coverage at much smaller scale, without following administrative boundaries within or between countries. These gaps would be missed when examining data at a larger (e.g., district) scale. This allows for identifying coverage gaps that are contiguous across borders which highlights the need for coordinated action. Note: Models do not completely overcome all potential biases in the original surveys from which data are taken, although they can incorporate data from other sources to try to compensate. The uncertainty around high resolution estimates may also be difficult to convey succinctly to end-users. |
Where are there most unvaccinated persons? |
|
|
Through integration of high-resolution coverage estimates with gridded population data, numbers unvaccinated can be estimated by time and space. This can provide an understanding of the absolute magnitude of risk and allows for more impactful targeting of resources |
Where are the remaining persons susceptible to measles? |
|
|
Models can incorporate historical data on routine and SIA coverage (from highest quality available sources) and estimated incidence over time (adjusting for surveillance quality) to predict residual susceptibility at fine scale. Maps showing hot spots of susceptibility can be produced. These estimates can be combined with data on birth rates at the appropriate scale to estimate the size of the annual susceptible birth cohort in each area. |
What is the likelihood of transmission in susceptible populations? |
|
|
Dynamic transmission models can estimate transmission at multiple levels of the country down to a small scale. They can incorporate data on the size of the susceptible population, rate of replenishment via (births-MCV coverage), connectivity and migration among meta-populations, age-specific contact patterns and seasonal changes in demography and behaviour, to estimate effective reproduction rate R. |
What is the relative importance of the 1st and 2nd dose of MCV in routine programs with or without SIAs? |
|
|
Models help illustrate the importance of distinguishing between a late 1st dose and a true second dose, and the different effects of each on population immunity. Models can be used to project the impact of adding MCV2 to a vaccination schedule, under assumptions of the degree of correlation between doses and the distribution of ages at receipt of each dose |
How can SIA effectiveness be measured? | |||
|
|
|
Conduct geospatial analyses of PCCS data as above, to identify pockets missed by SIA, especially those with high numbers of never-vaccinated children. Use estimates of zero-dose children from the PCCS to calibrate models of routine vaccination and better estimate the remaining never vaccinated children |
|
|
|
As above. If no PCCS, use other available data (e.g. DHS data) to compare coverage of Diphtheria, Tetanus, Pertussis (DTP)-containing vaccines with that of MCV1 at fine spatial scale to identify areas where MCV1 substantially higher than DTP, which may reflect ability of SIAs to reach those missed by routine services (though other explanations cannot be excluded) |
|
|
|
Use geospatial models to produce high resolution estimates of coverage with at least 2 doses of MCV and show areas where the SIA has conferred extra protection |
|
|
|
Use serological data if available, or cohort analysis of coverage and surveillance data, to estimate SIA contribution to immunity. Estimate the reduction in population susceptibility due to the SIA by comparing the goodness-of-fit of calibrated transmission models, which assume a particular efficacy, to data on laboratory confirmed cases (scaled according to the reporting rate) |
|
|
|
More systematic analysis of patterns of surveillance sensitivity using reported indicators (rate of laboratory investigation; rate of rash-and-fever cases that are not measles) shows this variation which can then be accounted for in trend analysis and compared to seroprevalence data if this is available |
Planning future SIAs: when, where, and what age group? |
|
|
Models can estimate number of susceptibles each month/year, by space and age, using data on demography, coverage and incidence (adjusted for under-reporting). Through this, a model can predict impact of SIAs with various upper age limits at national or subnational levels to assess marginal benefits and cost. Models can also consider seasonality of measles and ability to implement SIA well to examine trade-offs in delaying an SIA in order to implement it better |
How effective is outbreak response vaccination? |
|
|
Use birth rate, coverage and incidence data to estimate patterns of immunity and identify spatial regions and age ranges that would be of high priority for outbreak response. Ideally should continue laboratory investigation over the course of the outbreak (can get concurrent measles and rubella or other outbreaks of pathogens that cause rash and fever) and adjust estimates over time as initial outbreak data are reported |
What is the effect of vaccination strategies on Congenital Rubella Syndrome (CRS) burden? |
|
|
Models can project which areas will have the highest theoretical risk, allowing for targeted further investigation and action |
2. Program questions, problems and model contributions
2.1. Where are the gaps in vaccine coverage and where are most unvaccinated children?
2.1.1. Background – vaccination coverage estimates
Countries report administrative coverage for RI vaccination, estimated from the reported number of doses delivered divided by the size of the birth cohort, to WHO annually. Administrative estimates of SIA coverage are reported separately to WHO. Because administrative estimates are often of poor or unknown quality [3], [11], [12], Gavi recommends regular, high quality vaccination coverage surveys and now requires a high-quality post-campaign coverage survey (PCCS) after every SIA it funds [6].
2.1.2. Problem – identifying gaps in vaccination coverage
Administrative coverage estimates suffer from inaccurate estimates of the target population (e.g. due to using outdated census data and failing to account for seasonal changes in the residential population [13]) as well as inaccurate counts of doses received (e.g. errors in tallying doses; doses administered to persons excluded from the denominator such as temporary migrants or individuals outside the target age group) [3]. Denominator problems are amplified in calculations of numbers of unvaccinated children, especially at small spatial scales. Surveys can potentially provide higher quality data, but due to costs, typically aim to measure coverage only at national or the first subnational level (e.g. province) and are infrequent [12].
2.1.3. Model contribution
Geospatial modelling of data from high quality surveys that incorporate geographic coordinates of households allows estimation of coverage at a much finer spatial scale that is more actionable for program managers (Table 1). Models leverage the spatial autocorrelation in the data, as well as geospatial socio-economic, environmental, and physical covariate information from multiple other sources, to predict vaccination coverage at scales smaller than those for which the original survey was designed [14], [15], [16], [17]. This can highlight inequities in coverage which may be masked when analyses are done at provincial or district level [3], [15], [18] and can show contiguous areas of low coverage across countries [16], [17], [18]. Since model estimates at fine scales have wide uncertainty bounds [14], [15], they should be considered as highlighting areas where further investigation (e.g. local mini-censuses of vaccination status [19]), would be more fruitful. Fine scale coverage estimates can be integrated with corresponding geospatial model-based population estimates [20] to map the density of unvaccinated children [15].
Statistical modelling can identify cofactors that correlate with the geospatial distribution of low coverage (e.g. remoteness [15], [21], border areas with transient populations, and financial restrictions to health care [18]). Areas with the highest birth rates and lowest coverage are likely to be those with lower maternal educational levels [22] and socio-economic status [23], where measles case fatality may be highest, and are priorities for RI strengthening.
Administrative coverage estimates and many surveys only provide information on a single birth cohort (the most recent year for administrative data and often 12–23 month old children in surveys). It is important to consider coverage and immunity across all age cohorts, not just the most recent for which coverage is available. Statistical modelling also allows us to characterize the age-specific likelihood of vaccination [24], [25], informing estimates of the cumulative numbers of persons susceptible to measles (see next section).
2.2. How many people are susceptible to measles in different age groups, and where are they?
2.2.1. Background – population susceptibility
The distribution of persons unvaccinated against measles is a useful indicator of program performance but an incomplete assessment of population immunity and its complement, susceptibility. Population immunity derives from vaccination (accounting for vaccine failure [26]) and natural infection. In some high birth rate settings, immunity via maternal antibodies in young infants, which may be lost before the age for routine MCV, is also important [27]. Therefore, estimates of population susceptibility must account for immunity from vaccination, natural infection, and passively acquired maternal antibodies.
2.2.2. Problem – accounting for immunity from natural infection
Measles cases presenting to health facilities may be reported as aggregate numbers per week or month, and/or may be included in a separate case-based reporting (CBR) system [28]. CBR classifies cases as laboratory-confirmed if a blood sample is taken and the virus or measles-specific IgM antibodies are detected in an accredited laboratory; epidemiologically linked if the case is geographically and temporally linked to a laboratory-confirmed case, and clinically compatible if the clinical case definition was met but neither of the former two definitions apply. Countries report the number of measles cases to the WHO and UNICEF annually on the Joint Reporting Form [28], but the source of data (aggregate or CBR) and definitions followed vary over time and place, and reporting is insensitive. Worldwide, less than 3% of cases that models predict to occur [9] are reported [28].
Serological surveys conducted to measure measles sero-prevalence can be useful to show the distribution of immunity to measles, but they have many challenges including time, cost and varying assay sensitivity [7], [29] and only provide a cross-sectional snapshot of the immunity profile [30]. As an alternative to single-purpose surveys, countries can look for opportunities to include measurement of measles antibody in surveys whose primary objective might be different (e.g. HIV sero-surveys [31]). An innovative approach to obtain longitudinal data is to use residual serum samples from rash-fever surveillance programs, but how well these represent the population of interest needs assessment [32].
2.2.3. Model contribution
Models can help address some of the limitations of vaccination coverage and disease surveillance data sources [8], [33], [34], [35], [36], in order to estimate population susceptibility. If data from serological surveys are available, they can be incorporated in a statistical model to estimate a current susceptibility profile from a past cross-sectional snapshot of immunity [37]. Statistical models are useful to examine variation in surveillance quality within and between countries and adjust surveillance data for under-reporting [38] and, where available, age-specific rates of laboratory confirmation.
Estimated age-specific natural infection rates and historical data on RI coverage and SIAs can be used to calculate the proportion of the population in different age groups that is immune, and combined with regional birth rates to estimate the size of the annual susceptible birth cohort and thus the cumulative distribution of susceptible persons by age group at the desired spatial scale [16] as illustrated in Fig. 2. Susceptibility profiles do not necessarily match coverage profiles [30], [38] because in areas of low vaccination coverage, natural infection may generate a relatively large fraction of overall immunity, resulting in more homogeneous patterns of immunity than of vaccination coverage (Fig. 2a-d). Indirect protection due to herd-immunity implies that the force of infection, and thus the contribution of natural immunity to overall population immunity, will be relatively smaller in regions with higher vaccination coverage. Further, the absolute number of susceptibles depends on the interaction between population density and the distribution of immunity (see below), hence examining data on coverage alone is insufficient to predict risk of transmission.
2.3. How likely is measles transmission in different populations?
2.3.1. Background and Problem – persistence and elimination of measles
Persistence of measles transmission in a population depends on the numbers and distribution of susceptible individuals, the rate at which they are replenished by births (minus the number immunized) [39], [40], migration of susceptible persons and infected individuals [41], and socio-behavioral factors affecting the chances of contact of a susceptible individual with an infectious individual [8], [42], [43]. Nonlinearities in transmission dynamics also make predicting risk more complex. Simple analyses of vaccination coverage and reported incidence trends at district level may lead to erroneous predictions of risk, due to suboptimal data quality, heterogeneities at finer spatial scales and contacts between wider populations (see below).
2.3.2. Model contribution
Models that integrate data describing characteristics of persistence can be used to estimate the spatio-temporal and age-specific dynamics of transmission risk. One simple yet critical metric of transmission risk is the effective reproductive number, R. This is defined as the average number of secondary infections produced by a typical infective person in a population, having accounted for existing population immunity via prior immunization or infection. Once an infection has been eliminated, R must be maintained below 1 to prevent the re-establishment of endemic transmission in the event of re-introduction [44]. The level of measles population immunity required to sustain R < 1 (the so-called “herd immunity threshold”) is generally estimated to be above 90% [45], [46] and as high as 96% when susceptibility and contact patterns cluster (see below) [47]. Dynamic transmission models offer a way to estimate R by integrating profiles of susceptibility with data on population demography, pathogen biology, and contact patterns that can then be used to estimate incidence and subsequently the likelihood of achieving elimination or experiencing an outbreak [48], [49] (Fig. 1, Fig. 3).
Though the likelihood of eliminating measles is negatively correlated with R, the exact relationship is complicated and functionally unknown in most operational settings. Measles incidence may drop to zero even when R > 1 due to random chance if low absolute numbers of infectious cases fail to transmit before recovering. This phenomenon, referred to as stochastic fadeout, is more likely in small and remote communities [50]; thus, the absence of infection may not strictly indicate R < 1. Conversely, measles may persist regionally despite all, or many, communities maintaining R < 1 due to so-called “metapopulation dynamics” [51] (Fig. 4). If infected individuals travel, then measles may persist at the regional scale, despite only short, small outbreaks in any given location. The likelihood of persistence at the regional (metapopulation) scale depends on both the distribution of R at the local level (reflecting the degree of spatial aggregation of susceptibility) and the rate of introduction of infection into susceptible populations. Introductions depend on the degree of connectivity to areas where measles is circulating, for example, via main road networks between neighbouring districts and countries [52], [53], or through international travel [54], [55]. Since introduction events can occur on regional or national scales, broader regional dynamics should be considered to estimate the potential for achieving or sustaining elimination [52], [53], [56].
Patterns of contact between different population groups also influence transmission. Low coverage in groups with high contact rates may increase outbreak risk to a greater extent than previously appreciated [47], [57]. Heterogeneities in contact by age have been extensively demonstrated and these dynamics may interact with susceptibility profiles over space. Dynamic transmission models predict that vaccination should increase the mean age of infection and increase inter-annual variability in incidence [46], although this effect correlates inversely with birth rate [41]. Schoolchildren have high contact rates and represent a large proportion of the population in LMICS [58]. Once vaccination raises the mean age of susceptibility from pre-schoolers to school-age, the probability of transmission among susceptible persons may increase [58], although if there are many fewer susceptible people overall, incidence in the total population will decrease.
Seasonal changes in population demographics, contact patterns and access to vaccination should also be considered [32], [41], [52]. Major seasonal migration patterns (e.g. linked to agriculture [52], [53], school holidays [59], national holidays [60], or rural–urban migration [38], [56]) can drive measles fadeouts (when susceptible individuals leave) and outbreaks (where susceptible individuals accumulate and measles virus is imported into the community).
As measles becomes rare due to vaccination, these and other nuances of local conditions take on a bigger role in the dynamics of persistence. Dynamical transmission models are therefore useful in (1) exploring the relative contribution of different processes in persistence at low susceptibility (e.g. metapopulation dynamics, connectivity, clustering, age-specific transmissibility, rates of waning of maternal immunity), (2) identifying the empirical patterns that would indicate which processes are important in a given setting (e.g. changes in age distribution of cases), and (3) characterizing the relative benefit of alternative interventions conditional on the specific local context.
2.4. How effective are different strategies to reduce levels of population susceptibility and the chance of measles transmission?
2.4.1. Background and Problem – routine vaccination with 1 and 2 doses of MCV
Since 2017, WHO and Gavi have encouraged all countries to schedule a second routine dose of MCV (MCV2), irrespective of the coverage of the first routine dose (MCV1), in order to provide an additional opportunity to reach those missed in infancy (in effect, a late 1st dose) and to immunize those who failed to respond to their first dose (a true 2nd dose) [2]. The focus on MCV2 introduction might shift attention from ensuring that infants receive MCV1, and there is potential confusion around reporting of doses administered at or after the scheduled age for MCV2 among children who missed MCV1 in infancy.
2.4.2. Model contribution – quantifying burden outcomes of MCV2 as a late 1st dose vs. a true 2nd dose
The effect of MCV2 on population immunity depends on whether it is a true 1st or 2nd dose – which depends on the degree to which receiving MCV1 is correlated with attending for MCV2 [61]. If they are highly correlated, MCV2 is likely a true 2nd dose and the maximum change in immunity will be around 8% extra protection among vaccinated individuals (since vaccine effectiveness is around 92% in the 2nd year of life and 84% at 9 months [26]). This would be a useful step towards attaining the immunity levels needed for elimination in countries with very high MCV1 coverage. By contrast, when MCV1 coverage is low, an additional 8% immunity among twice-vaccinated individuals is a much smaller effect than that achievable by reducing the number of children who receive no MCV (so-called “zero-dose” children). Every opportunity should therefore be taken to vaccinate all children who missed one or both MCV routine doses at any health services contact, beyond the traditional 12 months of age [2].
The likelihood of receiving a second dose via an SIA may similarly be correlated with first dose if delivery is biased towards individuals with higher access to vaccination services. Dynamic models have been used to evaluate whether burden reductions following SIAs are consistent with the SIA dose being correlated with prior vaccination or not [38], [40]. A natural extension of these methods will be to evaluate whether the observed decline in incidence after introduction of a routine second dose is consistent with model predictions of delivery as a true second dose (small effect) or a first dose for zero dose children (larger effect).
An additional factor affecting impact on transmission is the age at each dose of vaccine, especially in high birth rate countries – the older the child is before receiving each recommended dose, the longer they are at risk of infection and contributing to the pool of susceptible persons. Improving monitoring of both the coverage and timeliness of each dose of vaccine is therefore important at national and subnational levels.
2.4.3. Background and Problem – use of SIAs for measles control and elimination
SIAs are widely used to complement RI and can be a cost-effective measles control strategy [62]. They are, however, resource-intensive and can disrupt routine services, hence meriting careful evaluation. A variety of approaches are used to assess different potential indicators of success (Table 1).
SIA coverage is reported to WHO as the proportion of all persons in the target age group who received vaccine during the SIA; however, because of inaccuracies in denominators and numerators, administrative coverage reports are frequently over 100%. Well-conducted PCCS can provide more accurate data especially if done very soon after the campaign when finger mark or card evidence of vaccination may be available [63]. An important indicator of SIA effectiveness is the percentage of “zero-dose” children who are reached by the SIA – this should be explicitly measured through PCCS. However, the accuracy of information on previous vaccination is unknown, especially for older children whose vaccination records may have been lost [64] and who may have been eligible for inclusion in multiple previous campaigns. Furthermore, coverage of the target population does not equate with impact on susceptibility because targeted individuals may be immune before the SIA (Fig. 5).
If measles surveillance systems have consistent reporting rates over time, SIA impact can be inferred by decreases in reported incidence after an SIA [38], [65] although if measles incidence shows strong seasonality and an SIA occurs after a peak in incidence, susceptible individuals may have been depleted irrespective of the SIA [66]. Measles surveillance methods change over time [67] and in areas with weaker health service infrastructure, where SIAs would be expected to have the greatest effect, reporting may not be sensitive enough to detect changes.
Deciding on the timing and scope (age range and geography) of future SIAs is also challenging (Table 1). In most Gavi-eligible countries, current strategies are not predicted to keep R < 1 [68], hence outbreaks will continue to occur and their timing will become less predictable as birth rates decrease and coverage increases [4]; optimizing outbreak response vaccination (ORV) is an additional challenge.
2.4.4. Model contribution – evaluating SIA success
Geospatial analyses of the coverage of the trivalent Diphtheria, Tetanus, Pertussis vaccine (DTP) (given via RI) can be compared to those of MCV1 (given via RI and SIAs). Where MCV1 coverage is much higher than DTP coverage, the SIA may have been effective, although other reasons for the differences cannot be excluded [69]. Model-based estimates of denominators [70] can be used to improve estimates of target populations for SIAs and can be integrated with estimated coverage before and after the SIA to assess the reduction in the number of unvaccinated individuals.
Since most individuals targeted for SIAs were immune before the SIA due to previous vaccination or infection, the difference in population immunity post-SIA compared to pre-SIA is the strongest evidence of success (Fig. 5). Only a few studies have measured this directly [71], [72], [73], but models can estimate the contribution of SIAs to population immunity [39], especially if serological data [74], [75], [76] or high quality case-based incidence data [38], [40], [77] are available post-SIA.
2.4.5. Model contribution – deciding when and where to conduct SIAs
The impact of SIAs depends on the ability to identify immunity gaps accurately by age and space, and to reach the individuals targeted. Models can examine the trade-offs between the degree to which an SIA would theoretically increase population immunity and the ability to reach different age groups effectively. Prada et al. [68] predict that, in a large country with high birth rates and low routine coverage, a well-conducted SIA targeting children under five years will not entirely prevent outbreaks (since some older persons are susceptible) but is more cost-efficient than a less well-implemented SIA targeting a broader age group. Increasing the upper age beyond age 10 years would have small marginal benefit even if implemented to the same standard. By contrast, after high routine coverage is sustained for many years, the age pattern of immunity changes [39], [78]. As countries progress towards elimination, the upper age that an SIA would have to target to reach 90% of the remaining susceptible individuals increases [4]. In many LMICS (and most high-income countries) susceptible adults would need to be vaccinated to achieve population immunity targets of at least 95% [4], [39].
When seasonality of measles incidence is strong, vaccinating when susceptible build-up is high, but before the onset of the high-transmission season, is predicted to have greatest impact [79], but the incidence of measles in previous years also needs to be accounted for [38]. Ease of access to vaccinate population groups may also vary seasonally, hence SIAs could be timed when the greatest numbers are in areas considered easier to reach [80], [81], [82]. Some large countries like the Demographic Republic of the Congo and India stagger implementation of SIAs over 2–3 years. If the lowest coverage areas are left until last, high burden will continue for longer pre-SIA, but giving those areas more time to prepare might enable the SIA to more effectively reach zero-dose children, and assuming the campaign pushes populations into synchronous local elimination, it optimizes the potential for country-level elimination.
2.4.6. Model contribution – duration of SIA impact
The duration of impact depends on the rate at which susceptible persons accumulate after the SIA; duration is shorter when birth rate is high and/or routine vaccination coverage is low [68], [83]. The WHO encourages countries to use available high quality data on birth rate, vaccination coverage, surveillance, and serological studies to monitor the accumulation of susceptible people and conduct follow-up campaigns before the number of pre-school children susceptible to measles approaches the equivalent of one birth cohort, in order to prevent a measles outbreak [2]. This rule of thumb ignores the contribution to outbreak risk from older persons who are susceptible (see above), susceptibility among infants before the age for routine MCV1, heterogeneity in vaccination coverage, and connectivity within meta-populations, all of which may make outbreaks more likely sooner than predicted from average national data. In countries that exhibit strong internal heterogeneities in RI and birth rates, total susceptibility and susceptible density will accumulate heterogeneously, and models predict that tailoring the inter-SIA period to conditions at sub-national scales can potentially be more cost-effective and equitable than periodic nationwide campaigns [84].
2.4.7. Model contribution – outbreak response vaccination
Models help prioritize areas for intervention using different metrics of risk [85] and predict the impact of different ORV strategies. Minetti et al. [86] estimated that making extra effort to vaccinate persons in the communities considered hardest-to-reach will have greater impact than conventional non-selective SIAs, which target all areas equally and may preferentially reach those already vaccinated [87].
When deciding on the scope of ORV, the age distribution of early cases often drives decisions [77]. Erroneous conclusions can be drawn early in the outbreak, however, due to biases in data on coverage and incidence [30], [88], [89]. If feasible, responses should be reconsidered and adapted as new data become available (e.g. updated incidence data with laboratory confirmation) [89], [90]. Constraints on the data available to inform decisions about the geographic scope of ORV may be even greater, as current methods to measure mobility are imperfect [88].
2.5. What populations are of special concern for rubella?
2.5.1. Background and Problem
Since infection among women of childbearing age is of most concern, vaccination-driven dynamic changes in epidemiology result in unique considerations for control of this pathogen. Childhood rubella vaccination below a critical threshold of vaccination coverage can potentially result in a short-term or annual increase in the number of infants born with congenital rubella syndrome (CRS) by increasing the average age of infection without sufficiently reducing rubella incidence, an outcome reported in Greece and Costa Rica [91], [92], [93].
2.5.2. Model contribution
Transmission models can be used to project the potential country-level impact of different rubella vaccination rollout strategies on CRS incident cases in the short [74] and long term [48]. Based on what is known about rubella transmissibility, the current strategy of a SIA targeting children up to age 15 years at the time of introduction of rubella vaccine into the routine program is considered unlikely to lead to a long-term (30 year) increase in CRS in LMICs as long as coverage is above 80% [48], however there remains risk of short-term increases in CRS [74].
At smaller spatial scales, local elimination and re-introduction dynamics of rubella can nonetheless result in older age profiles of infection in endemic settings among populations below the critical community size (CCS) [50], [94], [95], i.e., where rubella is prone to stochastic elimination. Isolated communities below the CCS, and where local elimination has occurred, may then experience many years of build-up of susceptible individuals (predominantly via births) before infection is re-introduced (Fig. 4). The result may be older ages of infection, and therefore a higher rate of CRS cases. Spatial heterogeneity in disease burden can be exacerbated once vaccination is introduced, if there is a strong correlation between population size and vaccination coverage [95], as a result of lower rates of re-introduction [25]. Models have been used to demonstrate these dynamics, and can be used, in combination with data on spatial demography and connectivity, to highlight populations at theoretical risk of higher burden of CRS post-vaccine introduction. Monitoring rubella epidemiology would be especially important in those areas [96].
3. Discussion
The demographic contexts and the effectiveness of vaccination program implementation vary greatly between regions and countries leading to a range of patterns of measles transmission [4], [66], and countries are now encouraged to carefully review and analyse data to adapt strategies according to the local situation [2], [6]. Models are useful tools to highlight gaps in program implementation and limitations of empirical data and to predict the effects of potential interventions.
Geospatial analyses can identify clusters of low coverage that often cross administrative or national borders [16], [17], [18], [97]; this should lead to investigation to confirm low coverage in the areas identified by models, determine the causes and stimulate appropriate action. Dynamic transmission and statistical models offer the advantages of combining multiple sources of data (e.g. demographics, connectivity, geospatial, coverage, surveillance, serology) to improve estimates of different indicators of program success and their interpretation [98]. Results suggest that focusing on a uniform percentage coverage goal across all districts may not be the most effective way to control measles – consideration of the absolute number of people susceptible to infection, and ideally also assessing contact patterns between them, may lead to different prioritization of areas for intensive efforts [99].
Results of dynamic models show the need to manage expectations about the predicted impact of currently supported interventions. SIAs targeting only children <5 years will not always avoid outbreaks because many countries have substantial immunity gaps in older persons among whom contact rates may be higher. Conversely, when very high routine coverage has been sustained, a shift from SIAs to more operationally challenging, targeted strategies such as selectively vaccinating only individuals without evidence of two prior doses may be more cost-effective [100]. In some countries, this might be achievable through school-entry checks.
By combining information from different data sources, models can help to address some of the biases in the original data which, if ignored, would often lead to erroneous conclusions [98], [101]. Models help to promote the use of more appropriate indicators of success, for example the effectiveness of SIAs in reaching “zero-dose” children and in reducing the number of persons susceptible to infection, rather than focusing only on the proportion of the entire target population vaccinated during the SIA (which is currently the main objective of PCCS [102]). It may be difficult to measure coverage precisely among “zero-dose” children in a PCCS because this would require prohibitively large sample sizes in countries with high routine vaccination coverage. Furthermore, “zero-dose” children may be more likely to be missed during household surveys as they may not be included in typical household listing procedures (e.g. homeless or highly mobile persons), be absent at the time of interview, or refuse to participate due to mistrust of authority. By including other sources of data such as disease incidence data, models can estimate the contribution of SIAs to population immunity and help to overcome drawbacks of single sources such as PCCS. Models have recently helped guide strategies at country level in Nigeria [103], Pakistan [38] and Madagascar [104].
In addition to helping address near-term programmatic questions, models are useful to investigate future trends, including the importance of susceptibility before age 9 months which may increase as the prevalence of natural immunity among women of childbearing age declines [105], [106], and the potential need for additional interventions to reduce susceptibility in older children and adults in the future.
Of course, modelling has its own unique challenges and limitations, including many not discussed in this paper, such as accounting for logistics and economics of vaccine delivery or immunodynamics [107]. Models are only as useful as the data that they are fit to and the assumptions made. To make better evidence-based decisions, more should be invested to improve empirical data. Geospatial analyses are constrained by the time before datasets are available (e.g. Demographic and Health Survey data typically refer to birth cohorts from at least 2 years prior to data release), infrequency and inconsistent quality of surveys; reliance on a verbal history [12] which may be less accurate for the number of doses received or source of vaccination [108], and wide uncertainty limits around estimates in sparsely populated areas [14], [69]. PCCS can give up-to-date information on SIA coverage, and planning for geospatial analysis should become part of their design, but they are still constrained by the quality of recall, especially for wide age ranges, and by potential selection bias as outlined earlier. Investment in strengthening administrative data systems, including censuses and birth registries as well as vaccination recording [109], is therefore important [110].
Measles and rubella surveillance need substantial investment – current rash and fever surveillance depends greatly on the infrastructure of the polio eradication program which is being wound down in many countries. Further improvements are essential to overcome disparities in reporting efficiency and laboratory investigation [111]. The use of serological surveillance in selected sites could be considered to monitor predicted changes in age-specific susceptibility [7]. Continued work is also needed to obtain and incorporate better data on mixing [112], connectivity and migration [20], [53], [59], seasonality [13], [52], [82], and demographic estimates from a range of spatial scales [70], [113]. Differences in contact rates by age has led to age-specific targets for prevalence of immunity in Europe [44] and further information on this is needed in developing countries. In addition, better reporting of deaths from measles and rubella could further improve program targeting to areas of highest mortality.
To move to a setting where planning of interventions is reactive to empirical data requires developing modelling infrastructure now, ideally through training of in-country partners [89], and improving communication about the uses and limitations of modelling [114]. Closer liaison between program managers, donors and modelers should be fostered. Much recent modelling has focused on planning and evaluating SIAs, but results should be used more to inform RI and the equity agenda. The more high-quality background data that are available, and the more pre-existing analyses and modelling done and effectively communicated, the better prepared a country and its international partners can be to conduct analyses of new outbreaks in real time and determine the best response (e.g. current work in Madagascar [104]). Measles surprises even the best-performing countries and a foundation for data-driven response needs to be established worldwide.
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgments
Acknowledgements
This work was funded in part by the Bill and Melinda Gates Foundation (BMGF). FC received consultancy fees from BMGF. AKW, CJM, MJF are supported by BMGF (OPP1094816). KM and NT are supported by Bill & Melinda Gates through the Global Good Fund, Bellevue, WA, USA. AW is supported by the National Library Of Medicine of the National Institutes of Health under Award Number DP2LM013102. AW is also support by a Career Award at the Scientific Interface by the Burroughs Wellcome Fund. A.J.T. is supported by funding from NIH/NIAID (U19AI089674), the Bill & Melinda Gates Foundation (OPP1106427, 1032350, OPP1134076), the Clinton Health Access Initiative, National Institutes of Health and a Wellcome Trust Sustaining Health Grant (106866/Z/15/Z). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or other funding agencies. The funders did not play any role in the collection, analysis, interpretation, writing of final reports, or decision to submit this research.
Author contributions
FTC wrote the first draft of the manuscript. AKW, ST, NT and MF developed schematics. All authors contributed to writing and editing of the manuscript.
References
- 1.World Health Organization. Global vaccine action plan 2011–2020; 2013. https://www.who.int/immunization/global_vaccine_action_plan/GVAP_doc_2011_2020/en/ [accessed July 2, 2019].
- 2.World Health Organization Measles vaccines: WHO position paper. Wkly Epidemiol Rec. 2017;92:205–228. [Google Scholar]
- 3.Mosser J.F., Gagne-Maynard W., Rao P.C., Osgood-Zimmerman A., Fullman N., Graetz N. Mapping diphtheria-pertussis-tetanus vaccine coverage in Africa, 2000–2016: a spatial and temporal modelling study. Lancet. 2019;393:1843–1855. doi: 10.1016/S0140-6736(19)30226-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Graham M., Winter A.K., Ferrari M., Grenfell B., Moss W.J., Azman A.S. Measles and the canonical path to elimination. Science. 2019;364:584–587. doi: 10.1126/science.aau6299. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.World Health Organization Rubella vaccines: WHO position paper. Wkly Epidemiol Rec. 2011;86:301–316. [PubMed] [Google Scholar]
- 6.Gavi the Vaccine Alliance. Apply for vaccine support; 2019. https://www.gavi.org/support/process/apply/vaccine/#mr [accessed July 2, 2019].
- 7.Winter A.K., Martinez M.E., Cutts F.T., Moss W.J., Ferrari M.J., McKee A. Benefits and challenges in using seroprevalence data to inform models for measles and rubella elimination. J Infect Dis. 2018;218:355–364. doi: 10.1093/infdis/jiy137. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Szusz E.K., Garrison L.P., Bauch C.T. A review of data needed to parameterize a dynamic model of measles in developing countries. BMC Res Notes. 2010;3:75. doi: 10.1186/1756-0500-3-75. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Simons E., Ferrari M., Fricks J., Wannemuehler K., Anand A., Burton A. Assessment of the 2010 global measles mortality reduction goal: results from a model of surveillance data. Lancet. 2012;379:2173–2178. doi: 10.1016/S0140-6736(12)60522-4. [DOI] [PubMed] [Google Scholar]
- 10.Wedlock P.T., Mitgang E.A., Haidari L.A., Prosser W., Brown S.T., Krudwig K. The value of tailoring vial sizes to populations and locations. Vaccine. 2019;37:637–644. doi: 10.1016/j.vaccine.2018.12.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Dietz V., Venczel L., Izurieta H., Stroh G., Zell E.R., Monterroso E. Assessing and monitoring vaccination coverage levels: lessons from the Americas. Rev Panam Salud Publica. 2004;16:432–442. doi: 10.1590/s1020-49892004001200013. [DOI] [PubMed] [Google Scholar]
- 12.Cutts F.T., Izurieta H.S., Rhoda D.A. Measuring coverage in MNCH: Design, implementation, and interpretation challenges associated with tracking vaccination coverage using household surveys. PLoS Med. 2013;10 doi: 10.1371/journal.pmed.1001404. [ARTN e1001404] [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Zu Erbach-Schoenberg E., Alegana V.A., Sorichetta A., Linard C., Lourenço C., Ruktanonchai N.W. Dynamic denominators: the impact of seasonally varying population numbers on disease incidence estimates. Popul Health Metr. 2016;14:35. doi: 10.1186/s12963-016-0106-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Utazi C.E., Thorley J., Alegana V.A., Ferrari M.J., Nilsen K., Takahashi S. A spatial regression model for the disaggregation of areal unit based data to high-resolution grids with application to vaccination coverage mapping. Stat Methods Med Res. 2018 doi: 10.1177/0962280218797362. 962280218797362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Utazi C.E., Thorley J., Alegana V.A., Ferrari M.J., Takahashi S., Metcalf C.J.E. High resolution age-structured mapping of childhood vaccination coverage in low and middle income countries. Vaccine. 2018;36:1583–1591. doi: 10.1016/j.vaccine.2018.02.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Takahashi S., Metcalf C.J., Ferrari M.J., Moss W.J., Truelove S.A., Tatem A.J. Reduced vaccination and the risk of measles and other childhood infections post-Ebola. Science. 2015;347:1240–1242. doi: 10.1126/science.aaa3438. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Takahashi S., Metcalf C.J.E., Ferrari M.J., Tatem A.J., Lessler J. The geography of measles vaccination in the African Great Lakes region. Nat Commun. 2017;8:15585. doi: 10.1038/ncomms15585. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Brownwright T.K., Dodson Z.M., van Panhuis W.G. Spatial clustering of measles vaccination coverage among children in sub-Saharan Africa. BMC Public Health. 2017;17:957. doi: 10.1186/s12889-017-4961-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Cutts F.T., Claquin P., Danovaro-Holliday M.C., Rhoda D.A. Monitoring vaccination coverage: defining the role of surveys. Vaccine. 2016;34:4103–4109. doi: 10.1016/j.vaccine.2016.06.053. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Tatem A.J. WorldPop, open data for spatial demography. Sci Data. 2017;4:170004. doi: 10.1038/sdata.2017.4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Metcalf C.J.E., Tatem A., Bjornstad O.N., Lessler J., O’Reilly K., Takahashi S. Transport networks and inequities in vaccination: remoteness shapes measles vaccine coverage and prospects for elimination across Africa. Epidemiol Infect. 2015;143:1457–1466. doi: 10.1017/S0950268814001988. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Restrepo-Méndez M.C., Barros A.J., Wong K.L., Johnson H.L., Pariyo G., França G.V. Inequalities in full immunization coverage: trends in low- and middle-income countries. Bull World Health Organ. 2016;94:794–805B. doi: 10.2471/BLT.15.162172. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Rivadeneira M.F., Bassanesi S.L., Fuchs S.C. Socioeconomic inequalities and measles immunization coverage in Ecuador: a spatial analysis. Vaccine. 2018;36:5251–5257. doi: 10.1016/j.vaccine.2018.07.051. [DOI] [PubMed] [Google Scholar]
- 24.Lessler J., Moss W.J., Lowther S.A., Cummings D.A. Maintaining high rates of measles immunization in Africa. Epidemiol Infect. 2011;139:1039–1049. doi: 10.1017/S0950268810002232. [DOI] [PubMed] [Google Scholar]
- 25.Metcalf C.J.E., Lessler J., Klepac P., Cutts F., Grenfell B.T. Impact of birth rate, seasonality and transmission rate on minimum levels of coverage needed for rubella vaccination. Epidemiol Infect. 2012;140:2290–2301. doi: 10.1017/S0950268812000131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Uzicanin A., Zimmerman L. Field effectiveness of live attenuated measles-containing vaccines: a review of published literature. J Infect Dis. 2011;204:S133–S148. doi: 10.1093/infdis/jir102. [DOI] [PubMed] [Google Scholar]
- 27.Mckee A., Ferrari M.J., Shea K. The effects of maternal immunity and age structure on population immunity to measles. Theor Ecol. 2015;8:261–271. doi: 10.1007/s12080-014-0250-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Dabbagh A., Patel M.K., Dumolard L., Gacic-Dobo M., Mulders M., Okwo-Bele J.M. Progress toward regional measles elimination—worldwide, 2000–2016. MMWR Morb Mortal Wkly Rep. 2017;66:1148–1153. doi: 10.15585/mmwr.mm6642a6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Cutts F.T., Hanson M. Seroepidemiology: an underused tool for designing and monitoring vaccination programmes in low- and middle-income countries. Trop Med Int Health. 2016;21:1086–1098. doi: 10.1111/tmi.12737. [DOI] [PubMed] [Google Scholar]
- 30.Choisy M., Trinh S.T., Nguyen T.N.D., Nguyen T.H., Mai Q.L., Pham Q.T. Sero-prevalence surveillance to predict vaccine-preventable disease outbreaks; A lesson from the 2014 measles epidemic in northern Vietnam. Open Forum Infect Dis. 2019;6:ofz030. doi: 10.1093/ofid/ofz030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Columbia University. PHIA Project – Zambia; 2019. https://phia.icap.columbia.edu/countries/zambia/ [accessed July 8, 2019].
- 32.Winter A.K., Wesolowski A.P., Mensah K.J., Ramamonjiharisoa M.B., Randriamanantena A.H., Razafindratsimandresy R. Revealing measles outbreak risk with a nested immunoglobulin G serosurvey in Madagascar. Am J Epidemiol. 2018;187:2219–2226. doi: 10.1093/aje/kwy114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Ferrari M.J., Djibo A., Grais R.F., Grenfell B.T., Bjornstad O.N. Episodic outbreaks bias estimates of age-specific force of infection: a corrected method using measles as an example. Epidemiol Infect. 2010;138:108–116. doi: 10.1017/S0950268809990173. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Gay N.J., De Serres G., Farrington C.P., Redd S.B., Papania M.J. Assessment of the status of measles elimination from reported outbreaks: United States, 1997–1999. J Infect Dis. 2004;189:S36–S42. doi: 10.1086/377695. [DOI] [PubMed] [Google Scholar]
- 35.Grenfell B.T., Anderson R.M. The estimation of age-related rates of infection from case notifications and serological data. J Hyg (Lond) 1985;95:419–436. doi: 10.1017/s0022172400062859. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Griffiths D.A. Catalytic model of infection for measles. J R Stat Soc Ser C-Appl Stat. 1974;23:330–339. [Google Scholar]
- 37.Beraud G., Abrams S., Beutels P., Dervaux B., Hens N. Resurgence risk for measles, mumps and rubella in France in 2018 and 2020. EUROSURVEILLANCE. 2018;23:2–12. doi: 10.2807/1560-7917.ES.2018.23.25.1700796. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Thakkar N., Gilani S.S.A., Hasan Q., McCarthy K.A. Decreasing measles burden by optimizing campaign timing. Proc Natl Acad Sci USA. 2019;116:11069–11073. doi: 10.1073/pnas.1818433116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Trentini F., Poletti P., Merler S., Melegaro A. Measles immunity gaps and the progress towards elimination: a multi-country modelling analysis. Lancet Infect Dis. 2017;17:1089–1097. doi: 10.1016/S1473-3099(17)30421-8. [DOI] [PubMed] [Google Scholar]
- 40.Li S., Ma C., Hao L., Su Q., An Z., Ma F. Demographic transition and the dynamics of measles in six provinces in China: a modeling study. PLoS Med. 2017;14:e1002255. doi: 10.1371/journal.pmed.1002255. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Ferrari M.J., Grenfell B.T., Strebel P.M. Think globally, act locally: the role of local demographics and vaccination coverage in the dynamic response of measles infection to control. Philos Trans R Soc Lond B Biol Sci. 2013;368:20120141. doi: 10.1098/rstb.2012.0141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Guerra F.M., Bolotin S., Lim G., Heffernan J., Deeks S.L., Li Y. The basic reproduction number (R0) of measles: a systematic review. Lancet Infect Dis. 2017;17:e420–e428. doi: 10.1016/S1473-3099(17)30307-9. [DOI] [PubMed] [Google Scholar]
- 43.Delamater P.L., Street E.J., Leslie T.F., Yang Y.T., Jacobsen K.H. Complexity of the basic reproduction number (R0) Emerg Infect Dis. 2019;25:1–4. doi: 10.3201/eid2501.171901. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Gay N.J. The theory of measles elimination: implications for the design of elimination strategies. J Infect Dis. 2004;189:S27–S35. doi: 10.1086/381592. [DOI] [PubMed] [Google Scholar]
- 45.Fine P.E. Herd immunity: history, theory, practice. Epidemiol Rev. 1993;15:265–302. doi: 10.1093/oxfordjournals.epirev.a036121. [DOI] [PubMed] [Google Scholar]
- 46.McLean A.R., Anderson R.M. Measles in developing countries. Part I. Epidemiological parameters and patterns. Epidemiol Infect. 1988;100:111–133. doi: 10.1017/s0950268800065614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Truelove S.A., Graham M., Moss W.J., Metcalf C.J.E., Ferrari M.J., Lessler J. Characterizing the impact of spatial clustering of susceptibility for measles elimination. Vaccine. 2019;37:732–741. doi: 10.1016/j.vaccine.2018.12.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Lessler J., Metcalf C.J.E. Balancing evidence and uncertainty when considering rubella vaccine introduction. PLoS ONE. 2013;8:e67639. doi: 10.1371/journal.pone.0067639. [ARTN e67639] [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Yang W., Li J., Shaman J. Characteristics of measles epidemics in China (1951–2004) and implications for elimination: a case study of three key locations. PLoS Comput Biol. 2019;15:e1006806. doi: 10.1371/journal.pcbi.1006806. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Metcalf C.J.E., Bjornstad O.N., Ferrari M.J., Klepac P., Bharti N., Lopez-Gatell H. The epidemiology of rubella in Mexico: seasonality, stochasticity and regional variation. Epidemiol Infect. 2011;139:1029–1038. doi: 10.1017/S0950268810002165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Grenfell B., Harwood J. (Meta)population dynamics of infectious diseases. Trends Ecol Evol. 1997;12:395–399. doi: 10.1016/s0169-5347(97)01174-9. [DOI] [PubMed] [Google Scholar]
- 52.Ferrari M.J., Grais R.F., Bharti N., Conlan A.J.K., Bjornstad O.N., Wolfson L.J. The dynamics of measles in sub-Saharan Africa. Nature. 2008;451:679–684. doi: 10.1038/nature06509. http://www.nature.com/nature/journal/v451/n7179/suppinfo/nature06509_S1.html [DOI] [PubMed] [Google Scholar]
- 53.Bharti N., Djibo A., Ferrari M.J., Grais R.F., Tatem A.J., McCabe C.A. Measles hotspots and epidemiological connectivity. Epidemiol Infect. 2010;138:1308–1316. doi: 10.1017/S0950268809991385. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Nic Lochlainn L., Mandal S., de Sousa R., Paranthaman K., van Binnendijk R., Ramsay M. A unique measles B3 cluster in the United Kingdom and the Netherlands linked to air travel and transit at a large international airport, February to April 2014. Euro Surveill. 2016;21 doi: 10.2807/1560-7917.ES.2016.21.13.30177. [DOI] [PubMed] [Google Scholar]
- 55.Lee A.D., Clemmons N.S., Patel M., Gastañaduy P.A. International importations of measles virus into the United States during the postelimination era, 2001–2016. J Infect Dis. 2019;219:1616–1623. doi: 10.1093/infdis/jiy701. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Bharti N., Tatem A.J., Ferrari M.J., Grais R.F., Djibo A., Grenfell B.T. Explaining seasonal fluctuations of measles in Niger using nighttime lights imagery. Science. 2011;334:1424–1427. doi: 10.1126/science.1210554. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Glasser J.W., Feng Z., Omer S.B., Smith P.J., Rodewald L.E. The effect of heterogeneity in uptake of the measles, mumps, and rubella vaccine on the potential for outbreaks of measles: a modelling study. Lancet Infect Dis. 2016;16:599–605. doi: 10.1016/S1473-3099(16)00004-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Funk S., Knapp J.K., Lebo E., Reef S.E., Dabbagh A.J., Kretsinger K. Combining serological and contact data to derive target immunity levels for achieving and maintaining measles elimination. BMC Med. 2019;17:180. doi: 10.1186/s12916-019-1413-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Wesolowski A., Metcalf C.J.E., Eagle N., Kombich J., Grenfell B.T., Bjornstad O.N. Quantifying seasonal population fluxes driving rubella transmission dynamics using mobile phone data. Proc Natl Acad Sci USA. 2015;112:11114–11119. doi: 10.1073/pnas.1423542112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Wesolowski A., Erbach-Schoenberg E.zu., Tatem A.J., Lourenço C., Viboud C., Charu V. Multinational patterns of seasonal asymmetry in human movement influence infectious disease dynamics. Nat Commun. 2017;8:2069. doi: 10.1038/s41467-017-02064-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.McKee A., Ferrari M.J., Shea K. Correlation between measles vaccine doses: implications for the maintenance of elimination. Epidemiol Infect. 2018;146:468–475. doi: 10.1017/S0950268817003077. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Bishai D., Johns B., Nair D., Nabyonga-Orem J., Fiona-Makmot B., Simons E. The cost-effectiveness of supplementary immunization activities for measles: a stochastic model for Uganda. J Infect Dis. 2011;204(Suppl 1):S107–S115. doi: 10.1093/infdis/jir131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Subaiya S., Tabu C., Nganga J., Awes A.A., Sergon K., Cosmas L. Use of the revised World Health Organization cluster survey methodology to classify measles-rubella vaccination campaign coverage in 47 counties in Kenya, 2016. PLoS ONE. 2018;13:e0199786. doi: 10.1371/journal.pone.0199786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Portnoy A., Jit M., Helleringer S., Verguet S. Impact of measles supplementary immunization activities on reaching children missed by routine programs. Vaccine. 2018;36:170–178. doi: 10.1016/j.vaccine.2017.10.080. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Murakami H., Van Cuong N., Van Tuan H., Tsukamoto K., Hien D.S. Epidemiological impact of a nationwide measles immunization campaign in Viet Nam: a critical review. Bull World Health Organ. 2008;86:948–955. doi: 10.2471/BLT.07.048579. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Cutts F.T., Lessler J., Metcalf C.J.E. Measles elimination: progress, challenges and implications for rubella control. Expert Rev Vacc. 2013;12:917–932. doi: 10.1586/14760584.2013.814847. [DOI] [PubMed] [Google Scholar]
- 67.Isere E.E., Fatiregun A.A. Measles case-based surveillance and outbreak response in Nigeria; an update for clinicians and public health professionals. Ann Ib Postgrad Med. 2014;12:15–21. [PMC free article] [PubMed] [Google Scholar]
- 68.Prada J.M., Metcalf C.J., Takahashi S., Lessler J., Tatem A.J., Ferrari M. Demographics, epidemiology and the impact of vaccination campaigns in a measles-free world - Can elimination be maintained? Vaccine. 2017;35:1488–1493. doi: 10.1016/j.vaccine.2017.02.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Utazi C.E., Thorley J., Alegana V.A., Ferrari M.J., Takahashi S., Metcalf C.J.E. Mapping vaccination coverage to explore the effects of delivery mechanisms and inform vaccination strategies. Nat Commun. 2019;10:1633. doi: 10.1038/s41467-019-09611-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Wardrop N.A., Jochem W.C., Bird T.J., Chamberlain H.R., Clarke D., Kerr D. Spatially disaggregated population estimates in the absence of national population and housing census data. Proc Natl Acad Sci USA. 2018;115:3529–3537. doi: 10.1073/pnas.1715305115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Nigatu W., Samuel D., Cohen B., Cumberland P., Lemma E., Brown D.W.G. Evaluation of a measles vaccine campaign in Ethiopia using oral-fluid antibody surveys. Vaccine. 2008;26:4769–4774. doi: 10.1016/j.vaccine.2008.07.005. [DOI] [PubMed] [Google Scholar]
- 72.Ohuma E.O., Okiro E.A., Bett A., Abwao J., Were S., Samuel D. Evaluation of a measles vaccine campaign by oral-fluid surveys in a rural Kenyan district: interpretation of antibody prevalence data using mixture models. Epidemiol Infect. 2009;137:227–233. doi: 10.1017/S0950268808000848. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Kuroiwa C., Xayyavong P., Vongphrachanh P., Khampapongpane B., Yamanaka M., Nakamura S. Difficulties in measles elimination: prevalence of measles antibodies before and after mass vaccination campaign in Laos. Vaccine. 2003;21:479–484. doi: 10.1016/s0264-410x(02)00480-2. [DOI] [PubMed] [Google Scholar]
- 74.Winter A.K., Pramanik S., Lessler J., Ferrari M., Grenfell B.T., Metcalf C.J.E. Rubella vaccination in India: identifying broad consequences of vaccine introduction and key knowledge gaps. Epidemiol Infect. 2018;146:65–77. doi: 10.1017/S0950268817002527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Hao L., Glasser J.W., Su Q., Ma C., Feng Z., Yin Z. Evaluating vaccination policies to accelerate measles elimination in China: a meta-population modelling study. Int J Epidemiol. 2019 doi: 10.1093/ije/dyz103. [DOI] [PubMed] [Google Scholar]
- 76.Hachiya M., Miyano S., Mori Y., Vynnycky E., Keungsaneth P., Vongphrachanh P. Evaluation of nationwide supplementary immunization in Lao People’s Democratic Republic: Population-based seroprevalence survey of anti-measles and anti-rubella IgG in children and adults, mathematical modelling and a stability testing of the vaccine. PLoS ONE. 2018;13:e0194931. doi: 10.1371/journal.pone.0194931. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Minetti A., Bopp C., Fermon F., Francois G., Grais R.F., Grout L. Measles outbreak response immunization is context-specific: insight from the recent experience of medicines Sans Frontiers. PLoS Med. 2013;10 doi: 10.1371/journal.pmed.1001544. [ARTN e1001544] [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Chong K.C., Hu P., Lau S., Jia K.M., Liang W., Wang M.H. Monitoring the age-specificity of measles transmissions during 2009–2016 in Southern China. PLoS ONE. 2018;13:e0205339. doi: 10.1371/journal.pone.0205339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Grassly N.C., Fraser C. Seasonal infectious disease epidemiology. Proc Biol Sci. 2006;273:2541–2550. doi: 10.1098/rspb.2006.3604. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Bharti N., Tatem A.J. Fluctuations in anthropogenic nighttime lights from satellite imagery for five cities in Niger and Nigeria. Sci Data. 2018;5:180256. doi: 10.1038/sdata.2018.256. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Bharti N., Djibo A., Tatem A.J., Grenfell B.T., Ferrari M.J. Measuring populations to improve vaccination coverage. Sci Rep. 2016;5:34541. doi: 10.1038/srep34541. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Buckee C.O., Tatem A.J., Metcalf C.J.E. Seasonal population movements and the surveillance and control of infectious diseases. Trends Parasitol. 2017;33:10–20. doi: 10.1016/j.pt.2016.10.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Verguet S., Johri M., Morris S.K., Gauvreau C.L., Jha P., Jit M. Controlling measles using supplemental immunization activities: a mathematical model to inform optimal policy. Vaccine. 2015;33:1291–1296. doi: 10.1016/j.vaccine.2014.11.050. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Zimmermann M., Frey K., Hagedorn B., Oteri A.J., Yahya A., Hamisu M. Optimization of frequency and targeting of measles supplemental immunization activities in Nigeria: a cost-effectiveness analysis. Vaccine. 2019;37:6039–6047. doi: 10.1016/j.vaccine.2019.08.050. [DOI] [PubMed] [Google Scholar]
- 85.Kundrick A., Huang Z., Carran S., Kagoli M., Grais R.F., Hurtado N. Sub-national variation in measles vaccine coverage and outbreak risk: a case study from a 2010 outbreak in Malawi. BMC Public Health. 2018;18:741. doi: 10.1186/s12889-018-5628-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Minetti A., Hurtado N., Grais R.F., Ferrari M. Reaching hard-to-reach individuals: nonselective versus targeted outbreak response vaccination for measles. Am J Epidemiol. 2014;179:245–251. doi: 10.1093/aje/kwt236. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Grout L., Conan N., Juan Giner A., Hurtado N., Fermon F., N’Goran A. Local discrepancies in measles vaccination opportunities: results of population-based surveys in Sub-Saharan Africa. BMC Public Health. 2014;14:193. doi: 10.1186/1471-2458-14-193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Wesolowski A., Winter A., Tatem A.J., Qureshi T., Engø-Monsen K., Buckee C.O. Measles outbreak risk in Pakistan: exploring the potential of combining vaccination coverage and incidence data with novel data-streams to strengthen control. Epidemiol Infect. 2018;146:1575–1583. doi: 10.1017/S0950268818001449. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Graham M., Suk J.E., Takahashi S., Metcalf C.J., Jimenez A.P., Prikazsky V. Challenges and opportunities in disease forecasting in outbreak settings: a case study of measles in Lola Prefecture, Guinea. Am J Trop Med Hyg. 2018;98:1489–1497. doi: 10.4269/ajtmh.17-0218. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Fonnesbeck C.J., Shea K., Carran S., Cassio de Moraes J., Gregory C., Goodson J.L. Measles outbreak response decision-making under uncertainty: a retrospective analysis. J R Soc Interface. 2018;15 doi: 10.1098/rsif.2017.0575. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Panagiotopoulos T., Antoniadou I., Valassi-Adam E. Increase in congenital rubella occurrence after immunisation in Greece: retrospective survey and systematic review. BMJ. 1999;319:1462–1467. doi: 10.1136/bmj.319.7223.1462. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Morice A., Carvajal X., Leon M., Machado V., Badilla X., Reef S. Accelerated rubella control and congenital rubella syndrome prevention strengthen measles eradication: the Costa Rican experience. J Infect Dis. 2003;187(Suppl 1):S158–S163. doi: 10.1086/368053. [DOI] [PubMed] [Google Scholar]
- 93.Jimenez G., Avila-Aguero M.L., Morice A., Gutierrez H., Soriano A., Badilla X. Estimating the burden of congenital rubella syndrome in Costa Rica, 1996–2001. Pediatr Infect Dis J. 2007;26:382–386. doi: 10.1097/01.inf.0000260000.84792.9e. [DOI] [PubMed] [Google Scholar]
- 94.Rios-Doria D., Chowell G., Munayco-Escate C., Witthembury A., Castillo-Chavez C. Spatial and temporal dynamics of Rubella in Peru, 1997–2006: geographic patterns, age at infection and estimation of transmissibility. In: Chowell G., Hyman J., Bettencourt L.A., Castillo-Chavez C., editors. Mathematical and statistical estimation approaches in epidemiology. Springer; Netherlands: 2009. pp. 325–341. [Google Scholar]
- 95.Metcalf C.J.E., Munayco C.V., Chowell G., Grenfell B.T., Bjornstad O.N. Rubella metapopulation dynamics and importance of spatial coupling to the risk of congenital rubella syndrome in Peru. J R Soc Interface. 2011;8:369–376. doi: 10.1098/rsif.2010.0320. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Wesolowski A., Mensah K., Brook C.E., Andrianjafimasy M., Winter A., Buckee C.O. Introduction of rubella-containing-vaccine to Madagascar: implications for roll-out and local elimination. J R Soc Interface. 2016;13:20151101. doi: 10.1098/rsif.2015.1101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 97.Pacheco F.C., França G.V.A., Elidio G.A., Domingues C.M.A.S., de Oliveira C., Guilhem D.B. Trends and spatial distribution of MMR vaccine coverage in Brazil during 2007–2017. Vaccine. 2019;37:2651–2655. doi: 10.1016/j.vaccine.2019.04.019. [DOI] [PubMed] [Google Scholar]
- 98.Lessler J., Metcalf C.J.E., Grenfell B.T. Measurement of vaccine-derived immunity: how do we use all the data? Expert Rev Vacc. 2012;11:747–749. doi: 10.1586/erv.12.47. [DOI] [PubMed] [Google Scholar]
- 99.Lee B.Y., Brown S.T., Haidari L.A., Clark S., Abimbola T., Pallas S.E. Economic value of vaccinating geographically hard-to-reach populations with measles vaccine: A modeling application in Kenya. Vaccine. 2019;37:2377–2386. doi: 10.1016/j.vaccine.2019.03.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Hagedorn B.L., Dabbagh A., McCarthy K.A. The cost saving opportunity of introducing a card review into measles-containing vaccination campaigns. Vaccine. 2019;37:6093–6101. doi: 10.1016/j.vaccine.2019.08.049. [DOI] [PubMed] [Google Scholar]
- 101.Ntirampeba D., Neema I., Kazembe L. Modelling spatio-temporal patterns of disease for spatially misaligned data: an application on measles incidence data in Namibia from 2005–2014. PLoS ONE. 2018;13:e0201700. doi: 10.1371/journal.pone.0201700. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 102.Vaccination coverage cluster surveys: reference manual. Geneva: World Health Organization; 2018 [WHO/ IVB/18.09, License: CC BY-NC-SA 3.0 IGO].
- 103.Zimmerman M., Frey K., Hagedorn B., Oteri A.J., Yahya A., Hamisu M. Optimization of frequency and targeting of measles supplemental immunization activities in Nigeria: a cost-effectiveness analysis. Vaccine. 2019;37(41):6039–6047. doi: 10.1016/j.vaccine.2019.08.050. [DOI] [PubMed] [Google Scholar]
- 104.Nimpa M.M., Andrianirinarison J.C., Sodjinou V.D., Douba A., Masembe Y.V., Randriatsarafara F. Measles outbreak in 2018–2019, Madagascar: epidemiology and public health implications. Pan Afr Med J. 2019 doi: 10.11604/pamj.2020.35.84.19630. [submitted for publication] [DOI] [PMC free article] [PubMed] [Google Scholar]
- 105.Nokes D.J., McLean A.R., Anderson R.M., Grabowsky M. Measles immunization strategies for countries with high transmission rates: interim guidelines predicted using a mathematical model. Int J Epidemiol. 1990;19:703–710. doi: 10.1093/ije/19.3.703. [DOI] [PubMed] [Google Scholar]
- 106.Metcalf C.J.E., Klepac P., Ferrari M., Grais R.F., Djibo A., Grenfell B.T. Modelling the first dose of measles vaccination: the role of maternal immunity, demographic factors, and delivery systems. Epidemiol Infect. 2011;139:265–274. doi: 10.1017/S0950268810001329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 107.Metcalf C.J., Andreasen V., Bjornstad O.N., Eames K., Edmunds W.J., Funk S. Seven challenges in modeling vaccine preventable diseases. Epidemics. 2015;10:11–15. doi: 10.1016/j.epidem.2014.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 108.Dansereau E., Brown D., Stashko L., Danovaro-Holliday M. A systematic review of the agreement of recall, home-based records, facility records, BCG scar, and serology for ascertaining vaccination status in low and middle-income countries. Gates Open Research. 2019;3:923. doi: 10.12688/gatesopenres.12916.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 109.Tatem A.J. Mapping the denominator: spatial demography in the measurement of progress. Int Health. 2014;6:153–155. doi: 10.1093/inthealth/ihu057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 110.Danovaro-Holliday M.C., Ortiz C., Cochi S., Ruiz-Matus C. Electronic immunization registries in Latin America: progress and lessons learned. Rev Panam Salud Publica. 2014;35:453–457. [PubMed] [Google Scholar]
- 111.Masresha B., Katsande R., Luce R., Fall A., Shibeshi M., Weldegebriel G. Performance of national measles case-based surveillance systems in the WHO African region. 2012–2016. J Immunol Sci. 2018;Suppl:130–134. [PMC free article] [PubMed] [Google Scholar]
- 112.Fumanelli L., Ajelli M., Manfredi P., Vespignani A., Merler S. Inferring the structure of social contacts from demographic data in the analysis of infectious diseases spread. PLoS Comput Biol. 2012;8:e1002673. doi: 10.1371/journal.pcbi.1002673. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 113.Alegana V.A., Atkinson P.M., Pezzulo C., Sorichetta A., Weiss D., Bird T. Fine resolution mapping of population age-structures for health and development applications. J R Soc Interface. 2015;12 doi: 10.1098/rsif.2015.0073. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 114.Metcalf C.J., Edmunds W.J., Lessler J. Six challenges in modelling for public health policy. Epidemics. 2015;10:93–96. doi: 10.1016/j.epidem.2014.08.008. [DOI] [PubMed] [Google Scholar]
- 115.World Health Organization, Measles Programmatic Risk Assessment Tool; 2018. [accessed 20 November 2019].