Skip to main content
PLOS One logoLink to PLOS One
. 2021 Mar 5;16(3):e0248053. doi: 10.1371/journal.pone.0248053

Allocating epidemic response teams and vaccine deliveries by drone in generic network structures, according to expected prevented exposures

Dean Matter 1,*, Linke Potgieter 1
Editor: Gabriele Oliva2
PMCID: PMC7935281  PMID: 33667263

Abstract

The tumultuous inception of an epidemic is usually accompanied by difficulty in determining how to respond best. In developing nations, this can be compounded by logistical challenges, such as vaccine shortages and poor road infrastructure. To provide guidance towards improved epidemic response, various resource allocation models, in conjunction with a network-based SEIRVD epidemic model, are proposed in this article. Further, the feasibility of using drones for vaccine delivery is evaluated, and assorted relevant parameters are discussed. For the sake of generality, these results are presented for multiple network structures, representing interconnected populations—upon which repeated epidemic simulations are performed. The resource allocation models formulated maximise expected prevented exposures on each day of a simulated epidemic, by allocating response teams and vaccine deliveries according to the solutions of two respective integer programming problems—thereby influencing the simulated epidemic through the SEIRVD model. These models, when compared with a range of alternative resource allocation strategies, were found to reduce both the number of cases per epidemic, and the number of vaccines required. Consequently, the recommendation is made that such models be used as decision support tools in epidemic response. In the absence thereof, prioritizing locations for vaccinations according to susceptible population, rather than total population or number of infections, is most effective for the majority of network types. In other results, fixed-wing drones are demonstrated to be a viable delivery method for vaccines in the context of an epidemic, if sufficient drones can be promptly procured; the detrimental effect of intervention delay was discovered to be significant. In addition, the importance of well-documented routine vaccination activities is highlighted, due to the benefits of increased pre-epidemic immunity rates, and targeted vaccination.

Introduction

The COVID-19 pandemic proved a stark reminder of the health risks inherent in our increasingly interconnected and fast-paced world. As international travel increases, so does the spread of microorganisms; including those causing life threatening diseases. Despite routine vaccination campaigns making significant inroads into attaining worldwide herd immunity for many infectious diseases, the risk of epidemics remains—particularly for previously unknown diseases. It is essential that governments and humanitarian aid organisations respond to outbreaks with maximal efficiency, to reduce the loss of life. When such responses to epidemics involve the administration of vaccines, response teams and vaccines need to be allocated to affected areas in a sensible manner. This allocation should take into account the impact of proposed vaccinations in each area on the spread of the epidemic, as well as the opportunity cost of not allocating resources to other affected areas.

Another challenge faced in epidemic response is poor road infrastructure, particularly in developing nations. The recent advent of drone technology has promising applications in this regard, since it enables faster vaccine delivery, and deliveries to areas unreachable by land. Drone deliveries can also possibly curb the spread of an epidemic by reducing human interaction. Since approximately only one quarter of roads in Sub-Saharan Africa are paved [1], and many can be impassable in rainy seasons, drones are a particularly attractive prospect for vaccine deliveries to these hard-to-reach areas, which often have low vaccination rates.

There is existing research into resource allocation in the context of epidemics; Hethcote and Waltman [2] used dynamic programming to find an optimal, lowest-cost solution to a deterministic SIR model, with the cost function assumed to include “money, equipment, personnel, supplies, the disruption of health care elsewhere, etc.” A general linear programming model for healthcare resource allocation was formulated by Feldstein et al., with resource availability constraints and various objective functions discussed [3]. In a similar vein, Vitoriano et al. [4] created a goal programming formulation of the problem of humanitarian aid resource distribution, accounting for objectives including cost and response time. Zaric and Brandeau [5] presented a dynamic investment allocation model with heuristics, with the objective of maximising certain health benefits. In previous related work, Zaric and Brandeau [6] also developed an investment allocation model, in conjunction with a compartmental epidemic model, to maximise “life years gained or the number of new infections averted. Duijzer et al. [7] attempted to maximise the same metric; namely, the “total number of people who escape infection,” by allocating a constrained vaccine stockpile between multiple regions, according to what they term a “dose-optimal vaccination fraction.” This fraction, determined for each region, maximises the total number of averted infections per vaccine dose assigned. Mbah and Gilligan [8] also focused on resource allocation between multiple regions, and proposed candidate allocation strategies for optimality, based upon necessary conditions derived using the Pontryagin maximum principle.

As Duijzer et al. noted [7], multiple previous studies [912] show that “the optimal allocation [of vaccines] depends on the moment of vaccination,” rendering many static resource allocation strategies sub-optimal. In groundbreaking work which accommodates for this, Teytelman and Larson [13] presented a “telescope-to-the-future switching heuristic”, where the resource allocation strategy is dynamically adjusted as new information about an epidemic becomes available over time. This heuristic determines the best vaccine allocations in a network of locations, for each day in the future until a predetermined point, maximising the total number of averted infections by switching batches of vaccine doses between regions. Additionally, they discussed a “greedy heuristic,” where vaccines are allocated to locations according to the largest marginal benefit arising per vaccine, where the benefit is averted infections.

Coupled with the aforementioned research into epidemic resource allocation, the recent emergence of drone technology has caused a flurry of research into the possibility of drone delivery for medical purposes, although none regarding delivery allocation during an epidemic. Murray and Chu considered the case of drones being launched from delivery vehicles, naming this problem the ‘flying sidekick travelling salesman problem (FSTSP)’ [14]. Poikonen et al. named this same type of delivery network a ‘vehicle routing problem with drones (VRPD)’ [15]. Murray and Chu also formulated a ‘parallel drone scheduling TSP (PDSTSP)’, to model an alternative drone delivery scenario; where vehicle deliveries are performed along a TSP route, and supplementary drone deliveries are made directly to demand nodes from a distribution centre [14]. Finally, Scott and Scott modelled a different delivery network, consisting of vehicle deliveries to ‘drone nests’, and drones used for ‘last-mile’ delivery, with the objective of minimizing total delivery time [16].

Future work proposed by Mbah and Gilligan in the field of resource allocation during an epidemic includes the “allowance of heterogeneity in the size of sub-populations,” and investigation into the robustness of resource allocation strategies to changes in epidemiological parameters [8]. These, along with addressing the World Health Organisation’s need for “optimal strategies for reaching hard-to-reach populations [for vaccination]” [17], are among the objectives of this article. The allocation of vaccination teams and vaccine deliveries, to sub-populations in multiple generic population distribution structures, is discussed. An expected prevented exposures (EPE) strategy is proposed for the allocation of each of these resources, and is compared with certain other allocation strategies commonly considered in literature. The feasibility of using drones for vaccine delivery is evaluated, and a range of parameters influencing the spread of an epidemic are discussed.

Methodology

A network-based SEIRVD epidemic model is formulated, to simulate the spread of an epidemic through a network of interconnected populations. This model consists of distinct systems of difference equations, with one for each population. On each daily time step, a small proportion of each population migrates to other populations in the network, to simulate the spatial spread of the epidemic. The epidemic intervention is incorporated into this simulation through daily vaccinations by response teams, for each population in the network. Various resource allocation strategies are then proposed, with the objective of ensuring that these vaccinations are performed at locations such that the greatest overall health benefit is achieved. Among these are the two EPE strategies, for both team and vaccine delivery allocation, which are expounded in this section.

For the purpose of demonstration, measles epidemics are simulated, although the model is general and can easily be applied to other similar diseases. Fixed-wing drones similar to those used by Zipline are assumed to be used for vaccine deliveries, since these drones can usually fly considerably further than quadcopters before requiring a recharge. For simplicity, deliveries are assumed to only originate from a single distribution centre (DC). The temperature at which the vaccines are transported and stored is not considered, and the entire network of populations is assumed to be closed, with no migration into or out of the network. Other intervention strategies such as travel restrictions, quarantine orders, and educational campaigns to increase turnout for vaccination, can also reduce the spread of an epidemic, but are outside of the scope of this article. The vaccination intervention is assumed to be the only one occurring, with no other healthcare activities considered.

Epidemic model

The spread of the epidemic through the network of populations is governed by a set of difference equations for each population, as aforementioned. Let Ni,t denote the population size at location i ∈ {1, …, n} on day t{1,,T}. Similarly, let Si,t, Ei,t, Ii,t, Ri,t, Vi,t, and Di,t, denote the number of susceptible, exposed, infectious, recovered, vaccinated and deceased individuals in the population of location i ∈ {1, …, n} on day t{1,,T}, respectively. Then, for each location i ∈ {1, …, n} and day t{1,,T}, the progression of the epidemic is modelled by

Si,t+1=Si,t-βSi,tIi,tNi,t-vi,tθi,tSλS+j=1,jin(mj,iSj,t-mi,jSi,t), (1)
Ei,t+1=Ei,t+βSi,tIi,tNi,t-σEi,t-vi,tθi,tE72λE+j=1,jin(mj,iEj,t-mi,jEi,t), (2)
Ii,t+1=Ii,t+σEi,t-γIi,t-μIi,t+j=1,jin(mj,iIj,t-mi,jIi,t), (3)
Ri,t+1=Ri,t+γIi,t-vi,tθi,tR+j=1,jin(mj,iRj,t-mi,jRi,t), (4)
Vi,t+1=Vi,t+vi,t(θi,tSλS+θi,tE72λE+θi,tR)+j=1,jin(mj,iVj,t-mi,jVi,t), (5)
Di,t+1=Di,t+μIi,t. (6)

In Eqs (1)(6), β denotes the transmission rate of the disease, which is defined as the basic reproductive number R0, divided by the number of days of infection before recovery. The reciprocal of this duration of infection is used as the daily proportion of infectious individuals who recover, γ. The parameter σ denotes the proportion of exposed individuals becoming infectious on any given day—which, similarly, is the reciprocal of the duration of the latent period between initial exposure and the onset of symptoms (and contagiousness). Finally, the daily death rate (the proportion of infectious people who die each day) is denoted by μ, and is calculated as the case fatality rate, divided by the duration of infection. The values of these parameters are estimated such that the properties of the disease under consideration are accurately replicated in the model.

The movement of individuals between populations is modelled in Eqs (1)(6) using a migration proportion, mi,j, to denote the proportion of the population at location i moving to location j daily. This proportion is defined for each pair of locations i, j ∈ {1, …, n}, and is assumed to be constant for the duration of each simulation. Each value of mi,j is calculated using the gravity model of migration presented by Kraemer et. al [18]—which considers movement between locations to be directly proportional to the sizes of their populations, Ni and Nj, and inversely proportional to the distance between them, Δi,j. Then, where Ti,j denotes the number of people moving from population i to j each day,

Ti,j=kmNiNjΔi,j2.

The parameter km is a multiplier which can be adjusted to model the effect of increased or reduced migration on the epidemic. Given the above formulation, the proportion of population i migrating to population j daily, is calculated as

mi,j=Ti,jNi.

Importantly, note that the above formulation is most accurate for geographic areas no larger than a few hundred kilometres in diameter. In order to better model international migration, more sophisticated migration models can be utilised.

Another important parameter in Eqs (1)(6) is vi,t, the number of vaccinations performed at location i on day t. This parameter is calculated as the minimum between the number of vaccinations which teams can possibly perform, and vaccine stock available:

vi,t=min{ψηi,t,νi,t}.

In the above, the number of daily vaccinations per team is denoted by ψ, and the number of vaccination teams allocated to location i on day t is ηi,t. The number of vaccines in stock is denoted by νi,t. Note that the latter two parameters, ηi,t and νi,t, are the easiest for decision makers to control, through resource allocation strategies for teams and vaccine deliveries, respectively. Turnout for vaccination is not considered to be a limiting factor on the number of vaccinations, and it is assumed that only asymptomatic members of the population are vaccinated, with infected and deceased individuals excluded. More specifically, only individuals in the S, E, and R categories are given vaccinations.

Untargeted vaccination, which is the practice of performing vaccinations while disregarding potential previous vaccinations received, is sometimes used in outbreak response where there is a high risk of the epidemic spreading [19]. As a result, it is used by default in this article, except where otherwise stated. In Eqs (1)(6), this is modelled by initially placing individuals who have been previously vaccinated into the R category; thereby making them a part of the subpopulation to be vaccinated. On the other hand, if targeted vaccination is employed, these individuals are initially considered part of the V category, and remain there for the duration of the simulation, excluded from the subpopulation to be vaccinated.

The final undiscussed parameters used in Eqs (1)(6) are those relating to vaccine efficacy. The susceptible proportion of the remaining unvaccinated (and asymptomatic) population is calculated as

θi,tS=Si,tSi,t+Ei,t+Ri,t.

This is essentially the probability that any individual arriving to be vaccinated is susceptible, and neither exposed nor recovered. Likewise, the ratio of recently-exposed individuals (exposed within 72 hours prior to vaccination) to the remaining unvaccinated and asymptomatic population, at location i on day t, is:

θi,tE72=k=t-3tβSi,kIi,kNi,kSi,t+Ei,t+Ri,t.

These recently-exposed individuals can be successfully immunized against measles, with the success rate thereof denoted by λE. The success rate of vaccinations given to susceptible individuals is denoted by λS. As stated above, each day’s vaccines, aside from those given to susceptible and exposed individuals, are administered to individuals in the R category. Thus, similarly to the previous two ratios, the proportion of vaccines given to recovered individuals is:

θi,tR=Ri,tSi,t+Ei,t+Ri,t.

Naturally, all vaccinations given to already-immune individuals can be considered successful, so the efficacy of vaccinations given to these recovered individuals is assumed to be 100%, and all of them are moved from the R category to the V category.

EPE strategy for team allocation

The number of response teams at each location, ηi,t, is one of the primary decision variables with a direct impact on vi,t, in the epidemic model formulated. In this section, a resource allocation model is presented, for response team allocation between multiple subpopulations within a network. An integer programming problem is solved on each simulated day, to maximise expected prevented exposures (EPE) for the following day, by assigning teams to locations according to the highest marginal benefit arising from each assignment. This allows the allocation of teams to be dynamically adjusted as the epidemic progresses, ensuring that the allocation remains effective. This dynamic approach, and the objective of minimising total cases by considering the marginal benefit of allocations, is similar to that of Teytelman and Larson’s telescope-to-the-future and greedy heuristics for vaccine allocation [13]. However, in this article, response teams and drone deliveries (under the constraint of limited delivery time) are allocated, instead of vaccines (under the constraint of a limited vaccine stockpile and uncertainty about future stock). Allocating deliveries, instead of simply vaccine stock, takes time into account—which ensures that delivery time is most effectively used in the critical first few days and weeks of an epidemic intervention. Another difference of note is that these allocations are performed in multiple generic network structures with heterogeneous population distributions. Their approaches can be seen as higher-level vaccine allocation strategies, perhaps to regions within a country, whereas the strategies in this article are more focused towards the actual delivery of vaccines to allocated response teams at points of dispensing.

Assuming that there are N vaccination teams in the network, a number ηi,t of teams needs to be allocated to each location i ∈ {1, …, n} on day t, such that i=1nηi,t=N,t{1,,T}. Recall that ψ denotes the number of possible vaccinations per team, per day. In order to remove the dependency between team allocation and vaccine allocation, the number of vaccines in stock at each location is assumed to be unlimited in the calculation of EPE. With this assumption, and if ηi,t teams are assigned to location i, the number of vaccinations possible at location i is:

vηi,t,i,t=ψηi,t.

Given this assignment, the number of susceptible individuals remaining, after vaccination at location i on day t, is

Si,t=Si,t-vηi,t,i,tθi,tSλS.

Then, with new exposures, progression into the Infectious category, and vaccines administered taken into account, the expected exposures at location i on day t + 1 is

Eηi,t,i,t+1=Ei,t+βSi,tIi,tNi,t-σEi,t-vηi,t,i,tθi,tE72λE.

Now, for each location i ∈ {1, …, n}, and each number of teams ηi,t{1,N} that could possibly be assigned to location i, the EPE resulting from that team assignment is calculated as:

Eηi,t,i,t+1*=E0,i,t+1-Eηi,t,i,t+1.

Given the above values of EPE, for each possible team assignment at each location i ∈ {1, …, n}, a knapsack problem is formulated, with the objective of maximising total EPE in the network, by allocating teams for day t + 1. The problem is to

maximisei=1nEηi,t,i,t+1* (7)
s.t.i=1nηi,tN, (8)
η1,t,η2,t,,ηn,tinteger. (9)

On each simulated day t{1,,T}, this knapsack problem is solved by iteratively assigning teams to the locations with the highest increase in EPE resulting from each newly-added team. This way, the greatest ratio of payoff (EPE) to cost (using one of the available teams) is repeatedly selected, until there are no teams remaining. If Eqs (7)(9) is reformulated as a 0/1 knapsack problem, as any integer knapsack problem can be [20, p. 524], this greedy solution procedure is akin to the branch and bound method proposed by Kolesar [21], which produces an optimal solution for 0/1 knapsack problems when the constraint is binding [22]. Therefore, the proposed solution procedure results in an optimal team allocation each day, in terms of maximised EPE for the whole network.

The exact formulation of the solution procedure follows. Initially, ηi,t = 0, ∀i ∈ {1, …, n}. Then, the first team is allocated to the location

i=maxi{E(ηi,t+1),i,t+1*(ηi,t+1),i{1,,n}}.

Once this team is allocated, ηi′, t is incremented. Each subsequent team is allocated in the same manner, until there are no unassigned teams remaining.

EPE strategy for vaccine delivery allocation

Once response teams have been allocated to locations in the network affected by the epidemic, it is imperative to provide these teams with an immediate and uninterrupted supply of vaccines. The use of drones to do so can be significantly faster than vehicles, especially for remote areas with poor or non-existent transport infrastructure. The problem of allocating vaccine resources to locations in the affected area is similar to that of team assignment, except that, with a limited number of drones, the constraint is the amount of delivery time available each day, rather than the number of teams. Given this, a similar formulation of EPE is presented; in this case, EPE is calculated as the number of expected prevented exposures resulting from each drone delivery to each location. Then, another knapsack problem is presented, to maximise total EPE in the network by allocating drone deliveries under the constraint of limited daily delivery time. These deliveries increase νi,t, the quantity of vaccine stock available at each location delivered to. This, in turn, may increase vi,t, the number of vaccinations performed at that location, and can thereby curb the spread of the epidemic.

Vaccine deliveries to locations are dependent on the number of teams allocated there, ηi,t, the quantity of vaccines already in stock, νi,t, and the number of days for which those vaccines will remain potent outside of the cold chain before expiry—which is 3 days in the case of measles vaccines [23]. The exact number of vaccines to be used for the following 3 days at each location can naturally not be foreknown, but is estimated according to the number of unvaccinated people remaining in that location, and the vaccination capacity per response team, ψ. More formally, the (non-negative) number of vaccines still required—that is, likely to be used but not yet in stock—on day t at location i, is

vi,t=max{min{Si,t+Ei,t+Ri,t,3ψηi,t}-νi,t,0}.

For simplicity, let xi denote the number of vaccines delivered to location i on the day considered, t. Given this quantity, the number of vaccinations possible on day t is the minimum between the assigned teams’ total vaccination capacity, and vaccine stock:

vxi,i,t=min{ψηi,t,νi,t+xi}.

The number of expected exposures is calculated using Si,t, defined as the number of remaining susceptible individuals after these vxi, i, t vaccinations have been performed on day t, but before migration and epidemic progression for day t + 1 are accounted for:

Si,t=Si,t-vxi,i,tθi,tSλS.

Taking Si,t into account, the expected exposures on day t + 1 at location i, after the xi vaccines were delivered on day t, is

Exi,i,t+1=Ei,t+βSi,tIi,tNi,t-σEi,t-vxi,i,tθi,tE72λE.

Given that Exi,i,t+1 exposures are expected after the vaccine deliveries (and resulting vaccinations) have happened on day t, the expected prevented exposures (EPE) caused by the delivery of xi vaccines is

Exi,i,t+1*=E0,i,t+1-Exi,i,t+1,i{1,,n}.

Let di denote the number of drone deliveries to location i on the day considered, and let c denote the number of vaccines which can be delivered per flight. Then, the total number of vaccines delivered to location i on the day considered is xi = cdi. Further, let δi denote the return flight time in minutes, for a drone flight from the DC to location i and back. Across all locations, the total number of daily deliveries is constrained by the total available minutes of delivery time per day, H. Subject to this constraint, the allocation of deliveries to locations, which maximises the total number of expected prevented exposures in the network, may then be found by solving

maximisei=1nExi,i,t+1*, (10)
s.t.i=1ndiδiH, (11)
xivi,t+c-1,i{1,,n}\{i*}, (12)
d1,d2,,dninteger. (13)

The daily time available for drone deliveries, H, is the primary constraint on this problem. As aforementioned, this is in contrast to Teytelman and Larson’s greedy heuristic and other literature, where vaccine stock is the primary constraint; here instead, the focus is on allocating the limited amount of daily delivery time best. The other constraint, (12), ensures that no drone deliveries will occur to locations for which the amount of vaccines still needed there, vi,t, is already exceeded. Furthermore, since the distribution centre, location i*, is assumed to have unlimited vaccine stock, it is excluded from the delivery network and the problem formulated above.

This integer program can be solved by iteratively assigning deliveries to locations—incrementing one di value and adding c to the vaccine stock there, νi,t—where the location to be delivered to each time has the highest resultant EPE per minute of delivery time, of all locations. More explicitly, this location is

i=maxi{Ec,i,t+1*δi,i{1,,n}}.

Once a delivery is allocated and stock levels are updated accordingly, the EPE value is recalculated for that location (to become the EPE resulting from another delivery), and the next best location is selected to receive the next delivery. As in the team allocation problem’s solution procedure, the highest payoff (EPE) per unit of cost (time) is repeatedly selected—although due to the second constraint (12), and the fact that (11) may not always be a binding constraint, the solutions are not necessarily optimal.

Alternate dynamic resource allocation methods

In order to compare the effectiveness of the two presented EPE resource allocation strategies with other dynamic allocation methods, alternate strategies are presented; for both team allocation, and vaccine delivery allocation. In both cases, the strategies essentially either prioritize total population, susceptible population, or infected population—with varying implementations according to the resources being allocated. Teams are allocated to locations proportionally to the considered population size at each, and vaccines are delivered to locations in an order of priority set by these population sizes. The strategy of proportional allocation according to total population size is commonly known as the “pro-rata” strategy, and since it is generally considered equitable it is often used in practice, and is frequently discussed in literature [7, 8, 13]. The strategies presented here which prioritize susceptible population and infected population are similar to those proposed by Mbah and Gilligan [8]. The alternate methods considered for the allocation of the N available teams in the network, with non-integer values stochastically rounded up or down, are:

  • Team allocation proportional to total population:
    ηi,tN×Ni,tj=1nNj,t.
  • Team allocation proportional to susceptible population:
    ηi,tN×Si,tj=1nSj,t.
  • Team allocation proportional to infected population:
    ηi,tN×Ii,tj=1nIj,t.
  • Team allocation proportional to each location’s ratio of infections to total population:
    ηi,tN×Ii,tNi,tj=1nIj,tNj,t.
  • An even distribution of teams, where the N available teams are evenly spread across the n locations using stochastic rounding, with random allocation of leftover teams thereafter:
    ηi,tNn.

As aforementioned, similar strategies are considered for vaccine delivery allocation also. In each of these methods, drone deliveries (of c vaccines per delivery) are repeatedly performed to the selected location i′, by incrementing di, until no more vaccines are required there (i.e., when vi,t=0). Thereafter, the second-best location is selected to receive deliveries until it no longer requires any more vaccines, and so on. Therefore, the delivery strategies essentially define varying lists of locations in descending order of priority. The considered strategies are:

  • Delivery allocation in descending order of total population, where the location i′ selected to receive the first delivery is:
    i=maxi{Ni,t,i{1,,n}}.
  • Delivery allocation in descending order of susceptible population, with:
    i=maxi{Si,t,i{1,,n}}.
  • Delivery allocation in descending order of infected population, with:
    i=maxi{Ii,t,i{1,,n}}.
  • Delivery allocation in descending order of total population, per minute of delivery time. The division by delivery time is performed to ensure that this method also takes it into account when selecting a location. This division is also performed for the EPE delivery strategy. The location i′ selected to receive the first delivery is
    i=maxi{Ni,tδi,i{1,,n}}.
  • Delivery allocation in descending order of susceptible population, per minute of delivery time, with:
    i=maxi{Si,tδi,i{1,,n}}.
  • Delivery allocation in descending order of infected population, per minute of delivery time, with:
    i=maxi{Ii,tδi,i{1,,n}}.

Parameters

The SEIRVD model presented in Eqs (1)(6) is sufficiently general such that it can validly simulate the progression of any communicable disease comprising the categories S, E, I, R, V, and D. More specifically, such a disease is exclusively transmitted through interpersonal contact, has a latent period prior to contagiousness, and results in either death or permanent immunity upon recovery. The parameters appearing in Eqs (1)(6), such as the daily transmission rate, death rate, and daily proportion of infectious individuals recovering, govern the progression of the disease. For all results in this article, except where otherwise stated, the values used for these parameters are set to simulate the spread of measles—and are listed in Table 1, along with other default parameter values. In order to simulate another disease, alternate values for these parameters must be estimated from literature, or from data about the progression of epidemics of that disease. The default team allocation strategy is pro-rata allocation proportional to total population, and the default vaccine delivery strategy prioritizes locations in order of descending population size. Untargeted vaccination and the monocentric network type are both used by default, unless otherwise stated.

Table 1. Initial set of parameters used in epidemic and intervention simulations.

Parameter Symbol Value Reference
Daily proportion of exposed individuals becoming infectious σ 110 [24]
Basic reproductive number R0 15 [25]
Daily transmission rate β 158 [25, 26]
Daily proportion of infectious individuals recovering γ 18 [26]
Migration multiplier km 1 -
Daily proportion of infectious individuals dying μ 0.03298 [26, 27]
Vaccine efficacy in susceptible individuals λS 95% [28]
Vaccine efficacy in recently-exposed individuals λE 83% [29]
Number of response teams in network N 15 -
Working minutes per day, for deliveries and vaccinations H 660 [30]
Number of vaccines administered per team per day ψ 2000 [30]
Number of vaccines delivered per drone flight c 60 [28, 31]
Maximum drone flight range, in kilometres - 160 [31]
Days of measles vaccine potency before expiry - 3 [23]
Proportion of a location’s population to be infected before epidemic declaration - 0.9% -
Working days per week, for deliveries and vaccinations - 7 -
Delay in days between the declaration of an epidemic and intervention starting - 15 [32]
Duration of intervention - Unlimited -
Number of delivery drones - 5 -
Average drone flight speed, in kilometres per hour - 100 [31]
Time taken to launch each drone, in minutes - 10 [33]
Scaled diameter of monocentric network, in kilometres - 40 -
Scaled diameter of polycentric network, in kilometres - 100 -
Scaled diameter of city network, in kilometres - 20 -
Scaled diameter of rural network, in kilometres - 150 -
Population vaccination rate - 66% -
Targeted or untargeted vaccination - Untargeted -

The epidemic model requires an input dataset containing information about a physical network of locations in a hypothetically affected area. This dataset contains Cartesian x- and y-coordinates and population sizes for each location in the network, as well as the number of (exposed, and infectious) index cases at the start of the simulation. The coordinates of each location are programmatically scaled such that the maximum distance between any two locations equals an adjustable parameter D, the diameter of the network. Euclidean distances between each pair of locations are calculated based on these coordinates. These distances are used to select the distribution centre (DC) in the manner described below, and to calculate the drone delivery times, from the DC to each location. The maximum flight range of a single drone is 160km [31]. Therefore, under the assumption that drones only deliver to a single location per flight, the single DC must be placed less than 80km away from all locations, if possible.

The total initial population, Ni,0, at each location i, is partitioned into the categories Si,0 and Ri,0, or Vi,0, depending on the vaccination rate in each area, and on whether or not targeted vaccination is used. The quantity of vaccine stock νi,0, and the number of response teams at each location i ∈ {1, …, n}, are initially set to zero.

The input required is sufficiently general such that any geographical network of locations can be used as the affected area in the simulated epidemics. For the purposes of this article, four generic network structures are considered that are comparable to real-world population distribution structures: a dense city network with high, homogeneous population density, a sparse rural network with low, homogeneous population density, a monocentric urban network with decreasing density as distance from the centre increases, and a polycentric urban network with multiple centres from which the density reduces as distance from each centre increases. The input data for each of these four generic networks are supplied in S1S4 Tables, and the networks are depicted in S4 Fig.

Drone deliveries in each network are assumed to originate from a single DC, with an unlimited supply of vaccines available. This DC is selected from the locations defined in the network, using a minimax facility location problem. This problem is to choose a location i*, such that the maximum distance from i* to any other location ji*, is minimized. This facility location method is selected, so that as many locations as possible lie within the aforementioned delivery range of drones originating from the selected location. More formally, the DC is placed at

i*=minimax{Δi,j,i,j{1,,n},ij}.

Using an average flight speed of 100km/h [31], and a fixed launch time of 10 minutes per flight [33], along with the direct distance Δi,j between each pair of locations i and j as the flight distance, the return flight time (in minutes), from the DC to each location i and back, is calculated to be

δi=10+2Δi,i*100×60,i{1,,n}.

Results

Prior to the presentation of simulation results, a description of the process of validation undertaken, to establish the reliability of the simulation model, is outlaid. Thereafter, simulation results are presented in three sections; firstly, benchmark results using the base set of parameters are outlaid, followed by a comparison of the effectiveness of the resource allocation strategies presented, and a sensitivity analysis of relevant epidemic-related parameters.

Validation

The validation for the model outlined in this article is performed on a measles outbreak in Niamey, Niger, which lasted from November 2003 until midway through 2004. All parameters and data used for this validation are derived from those used by Grais et al. in their presentation of a simulation model on the same epidemic [34], where possible.

Niamey has an approximately monocentric population distribution, and as such the monocentric network structure defined previously is used. In the actual intervention undertaken, children aged 6-59 months were targeted, as they are the most susceptible to measles. Therefore, the population values specified in the input dataset provided in S5 Table refer only to this age group, for which a vaccination rate of 70% is assumed—a total population of 160 000. Distances between locations are scaled such that the diameter of the network is 20km, and an initial 10 index cases are specified in the centre of the network to start the epidemic. In accordance with the proportion estimated by the World Health Organization [35], and the work done by Grais et al. [34], only 50% of actual simulated cases are considered ‘detected’ in the simulations, and are reported on in the validation results.

The simulation of this Niamey outbreak is set to run for 40 weeks, with vaccination being performed for 10 days, as was the case in the actual intervention. In the simulation, an unlimited quantity of vaccine stock is available to the 33 response teams distributed throughout the network, and teams are allocated proportionally to the total population in each location; the common pro-rata strategy described previously. In order to match the total number performed in actuality, 256 vaccinations are performed by each team per day, without regard for potential previous vaccinations (i.e. untargeted vaccination is performed). After performing a grid search with repeated simulations with a step size of 0.05, a value of R0 = 7.00 was found to provide the best fit to the reported epidemic curve—and is thus used in the validation simulations. In the same grid search, the ratio of infections to population at the epicentre, when the epidemic is declared, was estimated to be 9 cases in 1000. As a result, this value is used as the epidemic detection threshold for other simulations in this article also.

The best simulated match to the actual epidemic’s progression is depicted in Fig 1. Over 100 such simulations, the average number of reported cases per epidemic is 10 857 (with a sample standard deviation of just 0.049)—which is very close to the 10 880 actual recorded cases in Niamey. This was accomplished with exactly 84 480 vaccinations per simulation, near to the 84 563 actually performed. Since the number of teams and daily vaccinations per team are constant values, this number of vaccinations per simulation is also. Given these results, it is clear that the SEIRVD model presented in this article, together with the resource allocation methods used, is able to successfully simulate an actual epidemic.

Fig 1. Comparison between actual and simulated weekly reported cases for Niamey epidemic.

Fig 1

Base simulation results

Using the base set of parameters listed in the previous section, simulations were performed using each of the four generic network structures. In order to ensure that results are accurate and that randomness is not an influencing factor, 100 simulations were performed for each network type. Each set of 100 observations, from which the result metrics are calculated, have sufficiently low variance such that the following formula, for the required number of simulations, equates to less than 100 for all results and metrics:

Nsims=(Z(1-α/2)Sxϵx)2.

In this formula, where xi is the ith simulation’s value for metric x, x_=1100i=1100xi is the sample mean of the metric, and Sx=1100-1i=1100(xi-x_)2 is the sample standard deviation. The confidence level is 1 − α = 0.95, and the error level is ϵ = 0.05.

The aggregated results of these simulations for each network are contained in Table 2, and the figures in S5 Fig depict example epidemic progression curves, for a single simulation in each network. It is clear in Table 2 that interventions employing targeted vaccination are more cost efficient (they require fewer vaccinations and drone deliveries), and more effective at reducing the number of cases and subsequent deaths—particularly in less densely populated networks with slower epidemic progression.

Table 2. Simulation results for various network structures with and without vaccination.

Network type Intervention type Cases Deaths Vaccinations Deliveries
City None 395459 12596 0 0
City Untargeted 376483 11992 1257301 17055
City Targeted 337983 10766 600630 8356
Rural None 60773 1936 0 0
Rural Untargeted 34469 1098 225070 3182
Rural Targeted 9338 298 101482 1390
Monocentric None 202797 6459 0 0
Monocentric Untargeted 178297 5679 724251 8782
Monocentric Targeted 148102 4718 462797 5798
Polycentric None 293785 9357 0 0
Polycentric Untargeted 278093 8858 824228 11830
Polycentric Targeted 255099 8126 379448 5736

Resource allocation strategy selection

The selected prioritization of certain locations in resource allocation decisions has significant ramifications for the livelihoods of people there. Ethical arguments can be made regarding the fairness of resource allocation to locations with differing socio-economic contexts, but for the purposes of this article, the assumption is made that the target of an epidemic intervention is the reduction of total cases. Therefore, for these resource allocation models and strategies, the minimisation of cases is of first priority, followed by the minimisation of vaccines used. Considering that vaccines are often expensive and in short supply, using the same amount of vaccines more effectively to reduce cases is preferable.

Comparison of strategy pairs

Since the team allocation strategies and delivery allocation strategies must be used in conjunction with one another, pairs of strategies are compared; in terms of cases and vaccinations. The figures below contain scatter plots, where each point represents a strategy pair, and is positioned according to the average number of cases and vaccinations occurring in repeated simulations using that strategy pair. The colour of each point represents its team allocation strategy, and the symbol represents its delivery allocation strategy, as represented by the figure legends.

Fig 2 depicts such a scatter plot, for the monocentric network with untargeted vaccination. It is clear that, for this network, the results are somewhat clustered by team allocation strategy, represented by each of the six colours. Evidently, the team allocation strategies resulting in the fewest cases (regardless of vaccine usage) are allocation proportional to total population, susceptible population, and infections. The EPE team allocation strategy performs poorly for this untargeted intervention in the monocentric network, although the number of vaccines given is minimised. In contrast, for the city and rural network types, the EPE team strategy is the best overall, for both targeted and untargeted interventions—highlighting the need for consideration of population distributions when making resource allocation decisions.

Fig 2. Comparison of strategy pairs for untargeted vaccination on monocentric network.

Fig 2

Notably, for every team allocation strategy in this network besides EPE, the best delivery allocation strategy is EPE. This is followed by both delivery allocation strategies which prioritise locations by susceptible population. The worst-performing delivery allocation strategies in this network are those prioritising locations according to total population and number of infections. This is aligned with the findings of Mbah and Gilligan [8], Teytelman and Larson [13], and Duijzer et al. [7], who all found the pro-rata population strategy to be inferior to other, perhaps less equitable, strategies. A likely hypothesis for the poor performance of the EPE team strategy, considering the superiority of the EPE delivery strategy, is the fact that the primary constraint on vaccinations when using the default parameter set is the amount of available delivery time, rather than the number of teams. Therefore, the selection of an appropriate delivery strategy is more important than that of a team strategy—especially when inefficient untargeted vaccination is employed.

Fig 3 contains a scatter plot depicting the results for all strategy pairs, for a targeted intervention on the monocentric network. Once again, the results are largely clustered by team allocation strategy, and the results are similar to the untargeted intervention—with the best strategies being team allocation proportional to population, or infections. If the minimisation of vaccinations is a factor, however, then team allocation according to either EPE, or susceptible population, is superior, since approximately 50 000 fewer vaccines are used, for a marginally higher number of cases. As in the untargeted intervention, prioritising total population and the number of infections for delivery allocation results in an increase in cases, as well as an increase in cost. Note again that the best vaccine delivery strategy, for reducing both cases and vaccinations required, is EPE—for all team allocation strategies, by a significant margin.

Fig 3. Comparison of strategy pairs for targeted vaccination on monocentric network.

Fig 3

Identical scatter plots are also presented for each of the three other network structures considered, in S1S3 Figs. Each of the other networks have similar results to the monocentric one—the EPE vaccine delivery strategy, for all team allocation strategies, usually results in the fewest number of cases and vaccinations. This superiority of the EPE delivery strategy is more prominent when interventions are targeted. It is clear that prioritising total population for vaccine deliveries to locations is a poor strategy, in comparison with all others presented.

Comparison of team allocation strategies

When the base parameter set is used, the primary constraint on vaccinations at locations is vaccine stock availability, due to the limited delivery time available. To prevent this, and the delivery allocation strategies, from influencing the comparison of team allocation strategies, each location is assumed to have unlimited vaccine stock. Then, repeated simulations are performed for each team strategy and network type, with the mean number of cases and vaccinations recorded for each pair. These are compared with the overall mean values for cases and vaccinations for each network type, such that percentage deviations from the network’s means for each metric are calculated. These percentage deviations are used as the coordinates of each point in the scatter plots depicted in Fig 4—representing untargeted and targeted interventions, respectively. These scatter plots thus show an aggregate view of which team strategy performs best for each network type, when vaccine availability is not a constraint.

Fig 4. Comparison of team allocation strategies for differing network types, with unlimited vaccine availability—For untargeted (left), and targeted interventions (right).

Fig 4

It is evident that the polycentric and rural networks have the largest difference between team allocation strategies, for both targeted and untargeted interventions. With targeted vaccination, the EPE strategy results in the minimum number of cases for all network types—and this is accomplished with the minimum vaccine usage in all networks besides the monocentric one. Results are similar for the untargeted intervention also, although slightly less prominent. Therefore, particularly where targeted vaccination is used, and sufficient vaccine stock is available, the EPE team allocation strategy is superior to the other strategies considered; minimising both the number of cases, and vaccinations. Aside from the EPE strategy, it is clear that proportional team allocation according to susceptible population is most effective—particularly for reducing vaccine usage, while resulting in a similar, or lower, number of cases than other strategies. Allocating teams proportionally to total population also performs reasonably well, although results in more vaccines being used. Finally, allocating teams proportionally to the number of infections at each location appears to be a costly strategy, and is often less effective in reducing cases. It seems that the effectiveness of certain strategies depends on the network type, and as a result it is useful to consider the spatial population distribution of an area when allocating response teams in an epidemic intervention.

Comparison of delivery allocation strategies

A similar comparison to the above is performed for the delivery allocation strategies also. The previously presented base simulation results, using each combination of team and delivery allocation strategies, are used; the results are grouped by delivery strategy and network type, and are aggregated over the team allocation strategies used. Fig 5 depicts similar scatter plots to those previously presented—where, in this case, each point represents the results of repeated simulations using a particular delivery strategy and network type. In these figures, the x- and y- axes represent the deviations of each point’s results from the mean number of vaccinations and cases for that network, respectively. This allows the delivery strategies to be more easily compared, in a similar fashion to the team strategies.

Fig 5. Comparison of delivery allocation strategies for differing network types, aggregated over team allocation strategies—For untargeted (left) and targeted interventions (right).

Fig 5

As in the team strategy comparison, there is a larger difference between delivery strategies for the polycentric and rural networks than the others. For the rural network, there is a significant outlier; the strategy where vaccine deliveries are performed according to total population. In fact, in all four networks, prioritising either population, or population per minute of delivery time, is an ineffective delivery strategy. In comparison with others, when these strategies are used, vaccine usage is almost always higher, and the number of cases is usually higher also. This is also the case for the two strategies prioritising infected population, albeit to a lesser extent, and with the exception of the rural network type. This is unfortunate since the allocation of vaccines according to population size is seen as an intuitively fair strategy by many decision makers. These results, along with those of Mbah and Gilligan [8], Teytelman and Larson [13], and Duijzer et al. [7], indicate that, while apparently equitable and politically acceptable, strategies prioritizing total population are often inferior to others.

In contrast to this, the two delivery strategies prioritising susceptible population usually result in consistently low cases and vaccine usage, for all network types. Selecting locations for deliveries based on susceptible population, per minute of delivery time, is a particularly effective strategy—for many networks, resulting in the minimum number of cases, if the EPE strategy is disregarded. However, if it is possible to implement an EPE vaccine delivery strategy in a targeted epidemic intervention, simulations indicate that it minimises both cost and the number of cases, compared to all other strategies. In untargeted interventions, the EPE strategy is not as clearly superior, but still minimises both cost and cases in three of the four network types considered.

Sensitivity analysis

A brief sensitivity analysis was performed on certain parameters, to evaluate the effect that changes in their default values have on the simulation results. Each parameter is varied individually, with the remaining parameters constant; for 100 simulations per parameter value. The metrics of most interest that are reported on in this analysis are the number of simulated cases, and the number of vaccines administered—which is directly proportional to the cost of the intervention.

Epidemic parameters

Four epidemic-related parameters are considered for sensitivity analysis; the average number of days between initial exposure and becoming infectious, the average number of days being infectious before recovery, the basic reproductive number R0, and the morbidity rate. The effects of changes in these parameters on the average number of cases and vaccines administered are depicted in Fig 6. As both the number of days exposed and infectious increase, the number of cases reduce slightly; likely due to the epidemic progressing more slowly, allowing the intervention to be more timely and effective. As R0 increases, the average number of cases also increases, as expected—albeit increasing at a reducing rate as R0 rises. The final notable result is the apparent near-exponential growth in the number of vaccines administered as the average number of days exposed rises. This is most likely the consequence of vaccines being ineffective on most asymptomatic, exposed individuals; the longer the duration of exposure, the more vaccines are wasted on exposed individuals.

Fig 6. Sensitivity of average cases (left) and vaccinations (right) to changes in epidemic parameters.

Fig 6

Intervention parameters

The second set of parameters investigated are those relating to the intervention itself; the number of working hours for deliveries and vaccinations per day, the number of daily vaccinations per response team, the delay before an epidemic is declared, and the delay between epidemic declaration and the start of the intervention. The sensitivities of both cases and vaccinations to changes in these parameters are plotted in Fig 7.

Fig 7. Sensitivity of average cases (left) and vaccinations (right) to changes in intervention parameters.

Fig 7

The modelled effect of an increase in working hours is a proportional increase in daily vaccinations per team, as well as allowing more daily drone deliveries to be possible. Therefore, when either the daily working hours or the daily vaccinations per team is increased, the resultant near-identical slight reduction in cases is expected. The two most notable results for this parameter set are the respective impacts of epidemic detection delay, and intervention delay, on the number of cases. If the epidemic is detected earlier, there is a large reduction in the number of cases. The same applies for intervention delay after epidemic detection; the sooner the intervention, the fewer cases occur on average. Epidemic detection delay is near-impossible for decision-makers in an epidemic intervention to influence, and can only be reduced by more effective routine epidemic monitoring in healthcare systems. On the contrary, while difficult to reduce, the intervention delay is somewhat under the control of decision-makers. The effect of the intervention delay on the number of cases is so pronounced that, for each further day of delay (in the monocentric network), the number of cases in the epidemic increases by 1.5%, for the range considered. For the polycentric, city, and rural networks modelled, this daily increase in total cases is 0.4%, 0.6%, and 2.7%, respectively. These values were obtained as the respective slopes of least-squares linear regression approximations of each network’s sensitivity plot for intervention delay, as depicted in Fig 8. It is clear that reducing the intervention delay, by even a single day, can make a large difference in the number of total cases and deaths in an epidemic. As this difference is most significant for rural networks, the use of drones to perform prompt deliveries to hard-to-reach locations is an even more attractive prospect.

Fig 8. Effect of intervention delay on cases, for various network structures.

Fig 8

The effects of changes in the number of response teams are depicted separately to the remainder of the parameter set, in Fig 9—since the results merit further discussion, and are presented for both an untargeted and a targeted intervention. As expected, as the number of response teams increases, there are fewer cases—with a decreasing marginal benefit as more teams are added. This reduction in marginal benefit, which is most pronounced for targeted interventions, indicates that the benefit of using an additional team in an intervention should be weighed against the marginal cost thereof. The effect of changes in the number of teams on vaccinations is, however, less intuitive. As expected, the addition of more teams results in slightly more vaccinations being possible, for both vaccination types. However, as the number of teams reduces, there is a sharp increase in the number of vaccines required for the untargeted intervention, while the targeted intervention’s vaccinations continue to decrease. A likely hypothesis for this is that the reduction in teams, and ineffective untargeted vaccination, results in a failure to timeously control the epidemic. This perhaps-surprising result indicates that a failure to effectively control an epidemic initially may result in an increase in cost required to eventually do so. Furthermore, as previously discussed, this highlights the superiority of targeted vaccination to untargeted vaccination.

Fig 9. Sensitivity of average cases (left) and vaccinations (right) to changes in number of response teams.

Fig 9

Network parameters

The sensitivities of the result metrics to changes in three network-related parameters are depicted in Fig 10. As the amount of migration (i.e. the migration multiplier km) is increased, there is a small increase in the average number of cases, and a small decrease in the number of vaccinations. This result is expected, since increased migration spreads the epidemic more quickly. Further investigation into the impact of reduced migration, perhaps using a more accurate migration model or agent-based simulation, may be insightful. As the diameter of the monocentric network increases, there is a slight decrease in the number of cases (since there is less migration between locations), and an even slighter reduction in the number of vaccinations. The larger the network, the longer drone deliveries take; which results in marginally lower vaccine stock levels. Naturally, increases in the total population of the network cause a proportional increase in the number of cases and vaccinations—although, the former increases comparatively more than the latter.

Fig 10. Sensitivity of average cases (left) and vaccinations (right) to changes in network parameters.

Fig 10

An additional network-related parameter, the population vaccination rate at the start of an epidemic, obviously plays a significant role in the progression thereof. In simulations, it was found that, for each percentage point increase in the vaccination rate within the range considered, the number of cases reduces by 3.32%, and the number of vaccinations by 0.27%. That is, if the epidemic even occurs at all—the higher the vaccination rate, the less likely an epidemic, and its resultant cost, becomes. Consequently, it is imperative that routine vaccination activities achieve higher population vaccination rates.

Drone parameters

A range of drone-related parameters were tested, to determine the sensitivity of results to changes in their values. The results found were fairly intuitive; as either the drone capacity or average speed increases, the number of possible vaccinations increases—and subsequently, the number of cases decreases. Conversely, as the launch time per flight increases, the number of vaccinations reduces, and the number of cases increases. Although these results are expected, the extent to which these seemingly unimportant parameters affect the number of cases is notable. This is the case because, with a limited number of drones, every hour of delivery time is valuable. A 50% decrease of the flight launch time (from 10 minutes, to 5 minutes) results in more than a 5% increase in the number of vaccinations, and a reduction in total cases by over 2%. If the average speed per flight is reduced from 100km/h to 50km/h, the mean total number of cases per simulation increases by 2.4%. Similarly, if the number of vaccines delivered per flight is reduced from 60 to 30, the number of cases increases by 3.5%. These results indicate that, due to their increased speed, fixed-wing drones are more effective than quadcopter drones for prompt vaccine delivery—particularly for larger networks. It seems also that a sense of urgency must be maintained when performing deliveries, as every minute wasted can have an impact on the number of cases. These results do not, however, take into account response teams’ potential need for travel time between locations, particularly in rural networks with hard-to-reach populations where team availability may be a constraint, instead of vaccine stock.

An additional parameter relating to drones was also investigated; the number of drones available for deliveries. This is a parameter of such importance in an intervention using drone delivery that results are presented separately, for a variety of population levels in the monocentric network, in Fig 11. This allows the impact of increased population size on the number of required drones to be seen clearly. As expected, as the number of drones is increased from the default value of 5, the number of cases decreases—albeit with a much-reduced marginal benefit as more and more drones are added. It is also clear that the benefit of adding more drones is greater for networks with a smaller population, which is expected; the addition of a drone for a network with triple the population naturally affects proportionately fewer members of that network’s population. The number of cases for most population levels appears to reach an equilibrium of sorts when 15 or more drones are used, although providing a general recommendation would be misleading, since the number of drones required is strongly dependent upon the population level and diameter of a network.

Fig 11. Impact of number of drones on cases, for various population levels.

Fig 11

Conclusion

This article introduced some of the logistical challenges faced in epidemic interventions, and the possibility of using drones for the delivery of vaccines and other medical supplies, in the context of an epidemic. A network-based SEIRVD epidemic model was formulated, to investigate the feasibility of drone delivery, and the effect of certain resource allocation strategies and parameters of interest on an epidemic. Repeated simulations were performed using this model, with four generic network structures as input; representing common population distributions. This allowed the results to be more general than if specific case studies had been considered.

Two resource allocation models were formulated and integrated with this simulation model. These models maximise expected prevented exposures (EPE), by optimising daily resource allocation decisions during each simulation. In order to evaluate the effectiveness of these models, they were compared with a variety of alternative resource allocation strategies, on the basis of cases and vaccines used.

The simulation model was validated on a 2003-04 measles epidemic in Niger, and proved to replicate the actual epidemic’s propagation accurately. Initial simulations with each of the four network structures indicated that using targeted vaccination reduces cases significantly, and requires approximately 50% fewer vaccinations to do so—a result which highlights the importance of documenting the vaccination history of individuals well.

Both EPE resource allocation models formulated in this article were shown to be highly effective in reducing epidemic cases, as well as vaccine usage—particularly for targeted interventions. This is the case for all network types, although to varying extents; the efficiencies of the strategies considered appear somewhat inconsistent across network types. In the comparison of team allocation strategies, under the assumption of unlimited vaccine availability, the EPE team strategy performed above-average for all networks, for both targeted and untargeted interventions. In fact, for the former, the EPE strategy resulted in the minimum number of cases for all network types. Besides this, team allocation proportionally to total population and susceptible population were shown to be fairly effective strategies. Conversely, allocating teams uniformly, or proportionally to the number of infections per location, is ineffective, and results in an increased number of cases and vaccines required. When the vaccine delivery strategies were compared by aggregating results over the team strategies, the EPE delivery strategy was again found to be superior to the alternatives. With the exception of the rural network with untargeted vaccination, the EPE delivery strategy resulted in the minimum number of cases and vaccinations, for all networks and for both targeted and untargeted vaccination. Both delivery strategies prioritising locations according to susceptible population performed consistently well, whereas, in accordance with existing literature, the strategies prioritising total population and infections performed poorly, usually resulting in higher costs and more cases. It is important to note, though, that since the effectiveness of the strategies varies according to network type, it is important to consider a network’s population distribution when making resource allocation decisions.

Simulations performed for sensitivity analysis revealed the devastating impact which each day of delay before epidemic intervention causes. Increases in both epidemic detection delay, and intervention delay, result in a notable increase in epidemic cases. For the latter, a single further day of delay was shown to increase cases by between 0.4% and 2.7%, depending on the network structure. The urgency of epidemic intervention is already well known, and this result confirms that notion. The impact of a failure to promptly control an epidemic, with insufficient response teams, was also demonstrated; with fewer teams, there are inevitably more cases, and an increase in cost when vaccination is untargeted. In addition to these conclusions, the importance of routine vaccination activities was highlighted by the result that, for each percentage point increase in the pre-epidemic vaccination rate within the range tested, there’s a 3.32% decrease in the average number of epidemic cases.

Sensitivity analysis on four drone-related parameters revealed that, due to their superior speed and range, fixed-wing drones are more appropriate for epidemic response than quadcopters, for the network types considered; a reduction of the average drone speed from 100km/h to 50km/h caused a 2.4% increase in the average simulated number of cases. It is difficult to provide a general recommendation for how many drones should be used in an epidemic response, since this depends on the population, network type and drone capacity. For the fixed-wing drones and networks considered though, 15 drones appear to suffice for most population levels; although the more, the better.

Potential avenues for future work and extension upon this article include: the use of agent-based simulation to model migration and interpersonal disease propagation more accurately; forecasting EPE to an arbitrary future date instead of one day ahead; random, parameterized generation of network structures, instead of only considering four specific ones; and constraining vaccine availability at the DC.

To reiterate the conclusions drawn, and provide a recommendation for improved epidemic response thereon; the EPE models presented were the most effective resource allocation strategies for reducing cases, as well as cost. They are thus recommended for implementation in epidemic interventions. In the absence of such models, resource allocation according to susceptible population, rather than infections or total population, is best. Further, since targeted vaccination is superior to untargeted vaccination, and each day of intervention delay notably affects an epidemic’s spread, a targeted intervention with minimal delay is advisable. Finally, fixed-wing drones are a viable option for vaccine delivery in an epidemic intervention, if a sufficient number of them are used—and may be tremendously helpful in areas with poor road infrastructure.

Supporting information

S1 Fig. Resource allocation strategy comparisons for the polycentric network structure.

Results for the untargeted intervention are depicted on the left, and results for the targeted intervention are on the right.

(TIF)

S2 Fig. Resource allocation strategy comparisons for the city network structure.

Results for the untargeted intervention are depicted on the left, and results for the targeted intervention are on the right.

(TIF)

S3 Fig. Resource allocation strategy comparisons for the rural network structure.

Results for the untargeted intervention are depicted on the left, and results for the targeted intervention are on the right.

(TIF)

S4 Fig. Generic network structure maps.

The population size at each network location is represented by the radius of the dot, and the epicentre is marked in red. The monocentric network is top left, the polycentric network is top right, the city-type network is bottom left, and the rural-type network is bottom right.

(TIF)

S5 Fig. Base simulation progression plots.

The below plots depict the progression of a single simulated measles epidemic, in each of the four network types considered. Each of the four simulations were performed with the default set of parameters, and untargeted vaccination. The plots each give an indication of how the total network population progresses between the S, E, I, R, V, and D categories in that network. The monocentric network is top left, the polycentric network is top right, the city-type network is bottom left, and the rural-type network is bottom right.

(TIF)

S1 Table. Input dataset for monocentric network structure.

(PDF)

S2 Table. Input dataset for polycentric network structure.

(PDF)

S3 Table. Input dataset for city network structure.

(PDF)

S4 Table. Input dataset for rural network structure.

(PDF)

S5 Table. Input dataset for Niamey epidemic validation.

(PDF)

Acknowledgments

We primarily acknowledge God, for without Him any lives saved in epidemic interventions are purposeless and ephemeral. Therefore, above all, we thank Him for the eternal life we are offered through Jesus. We thank James Mba Azam and Prof. Juliet Pulliam for introducing us to the idea of vaccine delivery using drones, and for the useful consultations and literature references regarding the challenges faced in the vaccine supply chain. We thank our families for their continual support, and Matter specifically thanks Daniella Neville and Brandon Coetzer, for the inspiration to strive for excellence.

Data Availability

All relevant data are within the manuscript and its Supporting information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1. Gwilliam K, Foster V, Archondo-Callao R, Briceño-Garmendia C, Nogales A, Sethi K. The burden of maintenance: roads in sub-Saharan Africa. AICD Background Paper. 2008;14:4. [Google Scholar]
  • 2. Hethcote HW, Waltman P. Optimal vaccination schedules in a deterministic epidemic model. Mathematical Biosciences. 1973;18(3-4):365–381. 10.1016/0025-5564(73)90011-4 [DOI] [Google Scholar]
  • 3. Feldstein MS, Piot MA, Sundaresan TK. The resource allocation model. Bulletin of the World Health Organization. 1973;48:79–88. [PubMed] [Google Scholar]
  • 4. Vitoriano B, Ortuño MT, Tirado G, Montero J. A multi-criteria optimization model for humanitarian aid distribution. Journal of Global optimization. 2011;51(2):189–208. 10.1007/s10898-010-9603-z [DOI] [Google Scholar]
  • 5. Zaric GS, Brandeau ML. Dynamic resource allocation for epidemic control in multiple populations. Mathematical Medicine and Biology: A Journal of the IMA. 2002;19(4):235–255. 10.1093/imammb/19.4.235 [DOI] [PubMed] [Google Scholar]
  • 6. Zaric GS, Brandeau ML. Resource allocation for epidemic control over short time horizons. Mathematical Biosciences. 2001;171(1):33–58. 10.1016/S0025-5564(01)00050-5 [DOI] [PubMed] [Google Scholar]
  • 7. Duijzer LE, van Jaarsveld WL, Wallinga J, Dekker R. Dose-optimal vaccine allocation over multiple populations. Production and Operations Management. 2018;27(1):143–159. 10.1111/poms.12788 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Mbah MLN, Gilligan CA. Resource allocation for epidemic control in metapopulations. PLoS one. 2011;6(9):e24577. 10.1371/journal.pone.0024577 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Mylius SD, Hagenaars TJ, Lugnér AK, Wallinga J. Optimal allocation of pandemic influenza vaccine depends on age, risk and timing. Vaccine. 2008;26(29-30):3742–3749. 10.1016/j.vaccine.2008.04.043 [DOI] [PubMed] [Google Scholar]
  • 10. Medlock J, Galvani AP. Optimizing influenza vaccine distribution. Science. 2009;325(5948):1705–1708. 10.1126/science.1175570 [DOI] [PubMed] [Google Scholar]
  • 11. Matrajt L, Longini IM Jr. Optimizing vaccine allocation at different points in time during an epidemic. PloS one. 2010;5(11):e13767. 10.1371/journal.pone.0013767 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Matrajt L, Halloran ME, Longini IM Jr. Optimal vaccine allocation for the early mitigation of pandemic influenza. PLoS Comput Biol. 2013;9(3):e1002964. 10.1371/journal.pcbi.1002964 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Teytelman A, Larson RC. Multiregional dynamic vaccine allocation during an influenza epidemic. Service Science. 2013;5(3):197–215. 10.1287/serv.2013.0046 [DOI] [Google Scholar]
  • 14. Murray CC, Chu AG. The flying sidekick traveling salesman problem: Optimization of drone-assisted parcel delivery. Transportation Research Part C: Emerging Technologies. 2015;54:86–109. 10.1016/j.trc.2015.03.005 [DOI] [Google Scholar]
  • 15. Poikonen S, Wang X, Golden B. The vehicle routing problem with drones: Extended models and connections. Networks. 2017;70(1):34–43. 10.1002/net.21746 [DOI] [Google Scholar]
  • 16.Scott J, Scott C. Drone delivery models for healthcare. In: Proceedings of the 50th Hawaii international conference on system sciences; 2017. p. 3297–3304. Available from: http://hdl.handle.net/10125/41557.
  • 17. World Health Organisation. Measles vaccines: WHO position paper—April 2017. Weekly Epidemiological Record. 2017;92(17):205–228. 28459148 [Google Scholar]
  • 18. Kraemer M, Golding N, Bisanzio D, Bhatt S, Pigott D, Ray S, et al. Utilizing general human movement models to predict the spread of emerging infectious diseases in resource poor settings. Scientific reports. 2019;9(1):5151. 10.1038/s41598-019-41192-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Danet C, Fermon F. Management of a measles epidemic. Médecins Sans Frontières; 2013. Available from: https://medicalguidelines.msf.org/viewport/mme/english/management-of-a-measles-epidemic-30542833.html.
  • 20. Winston WL, Goldberg JB. Operations research: applications and algorithms. vol. 3. Thomson/Brooks/Cole; 2004. [Google Scholar]
  • 21. Kolesar PJ. A branch and bound algorithm for the knapsack problem. Management Science. 1967;13(9):723–735. 10.1287/mnsc.13.9.723 [DOI] [Google Scholar]
  • 22.Avis D. Branch and bound for knapsack problem. 2002. Available from: http://cgm.cs.mcgill.ca/~avis/courses/360/notes/knap_bb.pdf.
  • 23.Juan A, Panunzi I, Alsalhani A, Lambert V, Barrie I, Van Herp M. Evaluation of the stability of the measles vaccine for use in Extended Controlled Temperature Conditions (ECTC). MSF Access Campaign. 2018;.
  • 24. Moss WJ. Measles still has a devastating impact in unvaccinated populations. PLoS medicine. 2007;4(1):e24. 10.1371/journal.pmed.0040024 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Guerra FM, Bolotin S, Lim G, Heffernan J, Deeks SL, Li Y, et al. The basic reproduction number (R0) of measles: a systematic review. The Lancet Infectious Diseases. 2017;17(12):e420–e428. 10.1016/S1473-3099(17)30307-9 [DOI] [PubMed] [Google Scholar]
  • 26.World Health Organisation. 2019. Available from: https://www.who.int/news-room/fact-sheets/detail/measles.
  • 27. Wolfson LJ, Grais RF, Luquero FJ, Birmingham ME, Strebel PM. Estimates of measles case fatality ratios: a comprehensive review of community-based studies. International journal of epidemiology. 2009;38(1):192–205. 10.1093/ije/dyn224 [DOI] [PubMed] [Google Scholar]
  • 28.Centers For Disease Control And Prevention. 2018. Available from: https://www.cdc.gov/vaccines/pubs/pinkbook/meas.html.
  • 29.Sheppeard V, Forssman B, Ferson MJ, Moreira C, Campbell-Lloyd S, Dwyer DE, et al. The effectiveness of prophylaxis for measles contacts in NSW. 2009. Available from: http://www.publish.csiro.au/nb/NB08014. [DOI] [PubMed]
  • 30. Poncin M, Zulu G, Voute C, Ferreras E, Muleya CM, Malama K, et al. Implementation research: reactive mass vaccination with single-dose oral cholera vaccine, Zambia. Bulletin of the World Health Organization. 2018;96(2):86. 10.2471/BLT.16.189241 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Zipline. 2021. Available from: https://flyzipline.com/how-it-works/.
  • 32. Grais R, De Radiguès X, Dubray C, Fermon F, Guerin P. Exploring the time to intervene with a reactive mass vaccination campaign in measles epidemics. Epidemiology & Infection. 2006;134(4):845–849. 10.1017/S0950268805005716 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Ackerman E, Koziol M. IEEE Spectrum; 2019. Available from: https://spectrum.ieee.org/robotics/drones/in-the-air-with-ziplines-medical-delivery-drones.
  • 34. Grais RF, Conlan AJ, Ferrari MJ, Djibo A, Le Menach A, Bjørnstad ON, et al. Time is of the essence: exploring a measles outbreak response vaccination in Niamey, Niger. Journal of the Royal Society Interface. 2008;5(18):67–74. 10.1098/rsif.2007.1038 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Médecins Sans Frontières. Management of measles epidemics; 1999.

Decision Letter 0

Gabriele Oliva

24 Dec 2020

PONE-D-20-28939

Allocating epidemic response teams and vaccine deliveries by drone in generic network structures, according to expected prevented exposures

PLOS ONE

Dear Dr. Matter,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Feb 07 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Gabriele Oliva, Ph.D

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please upload a copy of Supporting Information Tables S5, S6 and S7 which you refer to in your text on page 23.

Additional Editor Comments:

Two reviews were collected, both suggesting minor revision. After carefully reviewing the manuscript myself, I confirm this judgement.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors formulate a network-based SEIRVD epidemic model and propose response team and vaccine delivery allocations according to expected prevented exposures. They compare their models to alternative resource allocation strategies and show their proposed strategies reduce the number of cases and number of vaccines required. Overall, the analysis looks plausible and well executed, however, I have a few comments and suggestions.

1.) Given that the majority of the results presented compare untargeted and targeted vaccination, the reader may benefit from a more detailed explanation of how the vaccinated population for recovered individuals is incorporated in the SEIRVD equations (Eq 1-6) under both the targeted and untargeted vaccination strategies.

2.) The parameter delta_i first appears in the text on page 8 in constraint (11) of the delivery allocation model, yet the formal definition for this parameter is not given until page 11, right before the Results section. I suggest either moving this formal definition to be included in the model description or provide a brief description of what delta_i defines in the model description.

3.) Are the parameter values defined in Table 1 specific to the measles pandemic? If so, I suggest mentioning this in the Parameters section and how the values would need to be adapted for other pandemics.

4.) Tables S4, S5, and S9 define a location CBD but this acronym is never clearly defined. Please clarify.

5.) It is not clear from the S10 Fig caption whether the results are from targeted or untargeted vaccination. It appears as if they are untargeted (based on Table 2) but the numbers do not seem to align between Table 2 and S10 Fig (i.e., vaccinations for the city network type is 1.2 million in S10 Fig but 1.25 million in Table 2). Please clarify this discrepancy. If S10 Fig is just from a single simulation instance, then this should be stated in the figure caption.

6.) Please include which plot corresponds to untargeted and targeted vaccination in the captions for S1, S2, S3 Figures.

7.) An acknowledgement and discussion of any limitations in your research should be included in the Conclusion section.

Reviewer #2: The paper introduced a method for addressing logistical challenges in an epidemic intervention context, such as vaccine shortages and poor road infrastructure. Specifically, the authors explored the feasibility of using drones to deliver vaccines and other medical supplies in order to develop a vaccine allocation strategy coupled with a team allocation strategy. These models maximize expected prevented exposures (EPE), optimizing day-to-day resource allocation decisions. Multiple network structures are evaluated with the resource allocation models to represent interconnected populations over which simulations are performed. The paper is overall interesting and well structured, but I would report below some comments that may help the authors to strengthen their work:

- The analysis of vaccine delivery allocation is based on the constraint of limited daily delivery time, but there is no mention of limits regarding the maximum distances that drones can travel.

- It is specified that vaccines deliveries to locations are dependent on the number of teams allocated there, but in eq. 10-11-12-13 there is no coupling term with the problem developed in the previous section, regarding the strategy for team allocation.

- It might be interesting to remove in the calculation of EPE the assumption that the number of vaccines in stock is unlimited since on page 13 it is pointed out that generally vaccines are very expensive and in short supply.

- At the beginnig, the paper appears to be set in the context of the current Covid-19 outbreak, but later only discusses data from the measles outbreak. Is it therefore possible to adapt the same analysis to different epidemics, or is it necessary to modify the models?

- Equation 11 related to the constraint on the times turns out in general unclear. Please edit for clarity explaining the terms.

- It is not very clear whether the untargeted or targeted vaccination strategy is chosen for the analysis and why.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Mar 5;16(3):e0248053. doi: 10.1371/journal.pone.0248053.r002

Author response to Decision Letter 0


2 Feb 2021

The paper has been revised according to the reviewers’ remarks. The authors would like to sincerely thank the reviewers for their comments, and the time taken to review the paper. Please find below the list of reviewers’ comments, each accompanied by a response from the authors.

Reviewer 1:

The authors formulate a network-based SEIRVD epidemic model and propose response team and vaccine delivery allocations according to expected prevented exposures. They compare their models to alternative resource allocation strategies and show their proposed strategies reduce the number of cases and number of vaccines required. Overall, the analysis looks plausible and well executed, however, I have a few comments and suggestions.

1.) Given that the majority of the results presented compare untargeted and targeted vaccination, the reader may benefit from a more detailed explanation of how the vaccinated population for recovered individuals is incorporated in the SEIRVD equations (Eq 1-6) under both the targeted and untargeted vaccination strategies.

Response: Thank you for this valuable observation. We have amended our description of the treatment of recovered individuals under targeted and untargeted interventions, respectively – and realized we made a significant omission from the SEIRVD equations. We had accidentally omitted the number of recovered individuals vaccinated on day t at each location i, which is now represented by the quantity vi,tθRi,t. This quantity is added to Vi,t+1 and subtracted from Ri,t+1, in equations (5) and (4), respectively. Fortunately, this omission was only from the described formulation of the equations and not from the implementation thereof – and as a result, all results remain valid and unchanged. We have added a description of this new quantity in the final paragraph of the subsection titled “Epidemic model”.

2.) The parameter delta_i first appears in the text on page 8 in constraint (11) of the delivery allocation model, yet the formal definition for this parameter is not given until page 11, right before the Results section. I suggest either moving this formal definition to be included in the model description or provide a brief description of what delta_i defines in the model description.

Response: As suggested, we have now defined delta_i immediately prior to its appearance in the formulation in (10)-(13). This is consistent with the pattern used for other parameters such as c, which is defined prior to (10)-(13), and is only attributed a particular value in the Parameters section.

3.) Are the parameter values defined in Table 1 specific to the measles pandemic? If so, I suggest mentioning this in the Parameters section and how the values would need to be adapted for other pandemics.

Response: The values are indeed measles-specific. We have added a discussion of the parameter values and generality of the SEIRVD model to the Parameters section, and have explicitly stated that the values are specifically set to simulate a measles epidemic. Despite this, the sensitivity analysis performed indicates that the results are not particularly sensitive to changes in these parameters, and as a result, the conclusions are most likely valid for similar epidemics.

4.) Tables S4, S5, and S9 define a location CBD but this acronym is never clearly defined. Please clarify.

Response: We have replaced the occurrences of the acronym “CBD” (Central Business District), with the more appropriate descriptor, “Centre”.

5.) It is not clear from the S10 Fig caption whether the results are from targeted or untargeted vaccination. It appears as if they are untargeted (based on Table 2) but the numbers do not seem to align between Table 2 and S10 Fig (i.e., vaccinations for the city network type is 1.2 million in S10 Fig but 1.25 million in Table 2). Please clarify this discrepancy. If S10 Fig is just from a single simulation instance, then this should be stated in the figure caption.

Response: We have clarified the distinction in the paragraph prior to Table 2, and in the caption of S10 Fig. S10 Fig does only depict the progression curves of a single simulation instance per network, whereas Table 2 contains results aggregated over 100 simulations. The adjustment to the paragraph is quoted below, for the convenience of the reader:

“The aggregated results of these simulations for each network are contained in Table 2, and the figures in S10 Fig depict the example epidemic progression curves for each, for a single simulation in each network.”

6.) Please include which plot corresponds to untargeted and targeted vaccination in the captions for S1, S2, S3 Figures.

Response: We have added captions to S1, S2, and S3 Figures to indicate that results for untargeted vaccination are plotted on the left, and targeted vaccination on the right.

7.) An acknowledgement and discussion of any limitations in your research should be included in the Conclusion section.

Response: We have added a list of avenues for future work in the penultimate paragraph of the Conclusion section. This list reveals the limitations in the research that we are aware of and propose future investigation into. The list is quoted below:

“Potential avenues for future work and extension upon this article include: the use of agent-based simulation to model migration and interpersonal disease propagation more accurately; forecasting EPE to an arbitrary future date instead of one day ahead; random, parameterized generation of network structures, instead of only considering four specific ones; and constraining vaccine availability at the DC.”

Reviewer 2

The paper introduced a method for addressing logistical challenges in an epidemic intervention context, such as vaccine shortages and poor road infrastructure. Specifically, the authors explored the feasibility of using drones to deliver vaccines and other medical supplies in order to develop a vaccine allocation strategy coupled with a team allocation strategy. These models maximize expected prevented exposures (EPE), optimizing day-to-day resource allocation decisions. Multiple network structures are evaluated with the resource allocation models to represent interconnected populations over which simulations are performed. The paper is overall interesting and well structured, but I would report below some comments that may help the authors to strengthen their work:

1. The analysis of vaccine delivery allocation is based on the constraint of limited daily delivery time, but there is no mention of limits regarding the maximum distances that drones can travel.

Response: We have specified the drone delivery radius more explicitly in the Parameters section, and have added it to Table 1. Under our simplifying assumption stated in the second paragraph of the Methodology section – that there is only one DC – the diameter of the entire network must be selected to be small enough for drones to be able to fly from the DC to any location and back. The fixed-wing drones under consideration are only able to make single deliveries per flight, and therefore drone deliveries are simply there-and-back, instead of a more complex routing problem. As a result of both of these points, since drone flight range is already taken into account when selecting the DC and all locations in each network can be reached, we do not consider flight range to be a constraint in the vaccine delivery allocation problem as well.

2. It is specified that vaccines deliveries to locations are dependent on the number of teams allocated there, but in eq. 10-11-12-13 there is no coupling term with the problem developed in the previous section, regarding the strategy for team allocation.

Response: In the second paragraph of the subsection, “EPE strategy for vaccine delivery allocation”, it is stated that “[v]accine deliveries to locations are dependent on the number of teams allocated there”. The parameter representing the number of teams at location i on day t is eta_{i,t}, which is the same parameter used in the team allocation problem. We have added this parameter to the aforementioned statement for clarity. To explain the link between the models further; eta_{i,t} forms part of the equation for parameter v`_{i,t}, which in turn forms part of the upper bound (Eq 12) of vaccines delivered per location. In addition to this, eta_{i,t} forms part of the equation for the quantity v_{xi,i,t}, which implicitly affects the EPE value.

3. It might be interesting to remove in the calculation of EPE the assumption that the number of vaccines in stock is unlimited since on page 13 it is pointed out that generally vaccines are very expensive and in short supply.

Response: Considering limited vaccine availability is indeed a valuable area for investigation. We have included a related item in the newly-added list of proposed areas for further research (in the Conclusion section): “constraining vaccine availability at the DC”. While that does not necessarily cover the proposed adjustment to the EPE calculation, it is important to note that this assumption of unlimited availability is only used for the calculation of team allocation EPE, and not for delivery allocation EPE. In the latter, existing vaccine stock is represented by the parameter nu_{i,t}, and forms a significant part of the calculation. Firstly, this assumption is merely present in order to prevent a complex circular dependency between the two problems; if teams are dependent on vaccine availability, and vaccine availability is dependent on teams, the optimization of either becomes difficult. Secondly, on a practical note, vaccines can not necessarily be stored at a point of dispensing unless a team is present, and therefore allocating teams first is necessary. Additionally, it is challenging to quantify an estimated constraint for vaccines in stock at each location without having any teams present to base that constraint upon.

4. At the beginnig, the paper appears to be set in the context of the current Covid-19 outbreak, but later only discusses data from the measles outbreak. Is it therefore possible to adapt the same analysis to different epidemics, or is it necessary to modify the models?

Response: We have amended the first paragraph in the Parameters section to discuss the generality of the SEIRVD model and its ability to simulate other communicable diseases sharing similar properties. As discussed there, it is possible to adapt the analysis to other epidemics by adjusting the parameter values in the model. However, despite the occurrence of a latent period for the virus, attempting to apply the model to COVID-19 may be unhelpful, in the absence of accurate parameter estimates and substantive evidence of permanent post-infection immunity (a property we’ve listed there as a requirement for application of the model).

5. Equation 11 related to the constraint on the times turns out in general unclear. Please edit for clarity explaining the terms.

Response: As requested by the other reviewer also, we have clarified the explanation of Eq 11 by adding a description of the constraint and the parameters therein, prior to the constraint. As described there, the constraint is a limit on the number of deliveries which can be performed to each location, based on the time it takes to make each delivery.

6. It is not very clear whether the untargeted or targeted vaccination strategy is chosen for the analysis and why.

Response: We have clarified the explanation of untargeted and targeted vaccination in the second paragraph of page 5. We state there that, “[untargeted vaccination] is used by default in this article, except where otherwise stated.” The reason for this is cited prior; “[untargeted vaccination is] sometimes used in outbreak response where there is a high risk of the epidemic spreading”. Throughout the results, where it is not indicated or there is no comparison between targeted and untargeted vaccination, untargeted vaccination is employed. We have repeated this assertion – that untargeted vaccination is used by default – in the first paragraph of the Parameters section.

Attachment

Submitted filename: Response to Reviewers.pdf

Decision Letter 1

Gabriele Oliva

19 Feb 2021

Allocating epidemic response teams and vaccine deliveries by drone in generic network structures, according to expected prevented exposures

PONE-D-20-28939R1

Dear Dr. Matter,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Gabriele Oliva, Ph.D

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Both reviewers agree that the revision has successfully addressed their comments. I concur with this evaluation.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: (No Response)

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Acceptance letter

Gabriele Oliva

23 Feb 2021

PONE-D-20-28939R1

Allocating epidemic response teams and vaccine deliveries by drone in generic network structures, according to expected prevented exposures

Dear Dr. Matter:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Gabriele Oliva

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Resource allocation strategy comparisons for the polycentric network structure.

    Results for the untargeted intervention are depicted on the left, and results for the targeted intervention are on the right.

    (TIF)

    S2 Fig. Resource allocation strategy comparisons for the city network structure.

    Results for the untargeted intervention are depicted on the left, and results for the targeted intervention are on the right.

    (TIF)

    S3 Fig. Resource allocation strategy comparisons for the rural network structure.

    Results for the untargeted intervention are depicted on the left, and results for the targeted intervention are on the right.

    (TIF)

    S4 Fig. Generic network structure maps.

    The population size at each network location is represented by the radius of the dot, and the epicentre is marked in red. The monocentric network is top left, the polycentric network is top right, the city-type network is bottom left, and the rural-type network is bottom right.

    (TIF)

    S5 Fig. Base simulation progression plots.

    The below plots depict the progression of a single simulated measles epidemic, in each of the four network types considered. Each of the four simulations were performed with the default set of parameters, and untargeted vaccination. The plots each give an indication of how the total network population progresses between the S, E, I, R, V, and D categories in that network. The monocentric network is top left, the polycentric network is top right, the city-type network is bottom left, and the rural-type network is bottom right.

    (TIF)

    S1 Table. Input dataset for monocentric network structure.

    (PDF)

    S2 Table. Input dataset for polycentric network structure.

    (PDF)

    S3 Table. Input dataset for city network structure.

    (PDF)

    S4 Table. Input dataset for rural network structure.

    (PDF)

    S5 Table. Input dataset for Niamey epidemic validation.

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.pdf

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES