Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Nov 17;16(11):e0259700. doi: 10.1371/journal.pone.0259700

Evaluation of the United States COVID-19 vaccine allocation strategy

Md Rafiul Islam 1, Tamer Oraby 2, Audrey McCombs 3, Mohammad Mihrab Chowdhury 4, Mohammad Al-Mamun 5, Michael G Tyshenko 6, Claus Kadelka 1,*
Editor: Martial L Ndeffo Mbah7
PMCID: PMC8598051  PMID: 34788345

Abstract

Background

Anticipating an initial shortage of vaccines for COVID-19, the Centers for Disease Control (CDC) in the United States developed priority vaccine allocations for specific demographic groups in the population. This study evaluates the performance of the CDC vaccine allocation strategy with respect to multiple potentially competing vaccination goals (minimizing mortality, cases, infections, and years of life lost (YLL)), under the same framework as the CDC allocation: four priority vaccination groups and population demographics stratified by age, comorbidities, occupation and living condition (congested or non-congested).

Methods and findings

We developed a compartmental disease model that incorporates key elements of the current pandemic including age-varying susceptibility to infection, age-varying clinical fraction, an active case-count dependent social distancing level, and time-varying infectivity (accounting for the emergence of more infectious virus strains). The CDC allocation strategy is compared to all other possibly optimal allocations that stagger vaccine roll-out in up to four phases (17.5 million strategies). The CDC allocation strategy performed well in all vaccination goals but never optimally. Under the developed model, the CDC allocation deviated from the optimal allocations by small amounts, with 0.19% more deaths, 4.0% more cases, 4.07% more infections, and 0.97% higher YLL, than the respective optimal strategies. The CDC decision to not prioritize the vaccination of individuals under the age of 16 was optimal, as was the prioritization of health-care workers and other essential workers over non-essential workers. Finally, a higher prioritization of individuals with comorbidities in all age groups improved outcomes compared to the CDC allocation.

Conclusion

The developed approach can be used to inform the design of future vaccine allocation strategies in the United States, or adapted for use by other countries seeking to optimize the effectiveness of their vaccine allocation strategies.

Introduction

Prior to the U.S. Food and Drug Administration’s Emergency Use Authorization of COVID-19 vaccines, the Centers for Disease Control and Prevention (CDC), guided by the federal Advisory Committee on Immunization Practices (ACIP), ranked population groups by priority for initial vaccination roll-out, based on available scientific evidence, the feasibility of different implementation strategies, and ethical considerations [1, 2]. Phase 1a included health care personnel and long-term care facility (LTCF) residents; Phase 1b included frontline essential workers and individuals 75 years old or older; and Phase 1c included other essential workers, 16–64 year olds with high-risk conditions, and 65–74 year olds. Phase 2 included 16–64 year olds without high-risk conditions or comorbidities [2].

COVID-19 vaccine prioritization strategies have been studied in many ways, by using deterministic differential equation models [38], agent-based models [9, 10], network models [11, 12], and various other approaches [13, 14], as well as by considering ethical factors [15, 16]. Most studies focused solely on age and age-dependent disease behavior [68, 14]. Some studies included further characteristics such as occupation (e.g., distinguishing essential workers) [3, 4, 13], comorbidities [5], and contact patterns [9, 10]. However, none of the model-based studies considered together all characteristics included in the CDC recommendations (age, occupation, comorbidity status, and living condition). More importantly, none of the studies investigated all possible vaccine allocation strategies; rather, a small number of strategies were typically selected for comparison based on expert opinion. The goal of this study was to directly evaluate the CDC recommendation by comparing it to all potentially optimal allocation strategies that stagger the vaccine roll-out in up to four phases (17.5 million strategies).

Methods overview

Model design

To achieve an accurate evaluation of the CDC vaccine allocation strategy, we developed a compartmental disease model that stratifies the U.S. population by all characteristics included in the CDC recommendations. Using recent U.S. census data, we divided the population into different sub-populations based on age (four classes: 0 − 15, 16 − 64, 65 − 74, 75+ years old), co-morbidity status (two classes: none or at least one known risk factor associated with more severe COVID-19 disease other than age), job type of the working-age population (four classes: healthcare workers, frontline essential workers, other essential workers, and all remaining people), and living situation of individuals 65 and older (two classes: congested living or not). The model also takes into account various important components of the COVID-19 pandemic (Fig 1): age-dependent susceptibility to infection and severity of disease [17, 18] (S1 Fig); age- and comorbidity status-dependent case fatality rates [19]; average rates of contact that differ with age, profession, and living conditions [2022] (S2 Fig); population-wide social distancing levels that depend on the active number of cases (S3 Fig); the exact speed of the U.S. vaccine roll-out and vaccine hesitancy (S4 Fig); and the emergence of more transmissible virus variants over time [23] (S5 Fig).

Fig 1. Overview of the model.

Fig 1

Upon infection, susceptible individuals (left most column) transition through the various disease compartments (middle columns) until reaching a final compartment (death or recovery; right most columns). All pre-clinical, clinical and asymptomatic individuals may cause new infections (red dashed box). A detailed description of the various compartments and parameters can be found in Table 1 and the Detailed Methods section.

We derived most model parameters from the literature (Table 1), and employed an elitist genetic algorithm to estimate the remaining parameters by fitting the model to observed cumulative deaths and cases between December 14, 2020 and April 29, 2021 [24] (S1 Table and S6 Fig). The model was implemented in Python 3.8 using the open source JIT compiler numba for improved run time.

Table 1. Model parameters, description and sources.

Parameter Description Value Source
N i number of people in sub-population i see Table 2 [25]
X ij average daily number of contacts a person in sub-population i has with sub-population j see S2G Fig [21, 22]
c log10 value of active cases at which overall contacts are reduced by 50% c = 4.0346 (see S1 Table for fitted values used in the sensitivity analysis) fitted (see Model calibration)
k sensitivity of contact reduction to changes in active cases (shape of the Hill function) k = 5.0266 (see S1 Table for fitted values used in the sensitivity analysis) fitted (see Model calibration)
β i age-dependent susceptibility to infection see S1 Table fitted (see Model calibration)
1/μE incubation period 3.7 days [26]
q i age-dependent clinical fraction varied, see S1 Fig [27]
1/μA average time of virus spread by truly asymptomatic individuals 5 days [17]
1/μP average time of virus spread before symptom onset 2.1 days [17]
1/μC average time of virus spread after symptom onset 2.723 days estimated from CDC raw data
1/μQ + 1/μC average time between symptom onset and possible death 22 days estimated from U.S. deaths and case counts [28]
CFRi sub-population-dependent case fatality ratio see Case fatality rates calculated from [29, 30]
f A relative contagiousness of truly asymptomatic individuals 75% (25% and 100% in sensitivity analysis) [27]
f V relative contagiousness of vaccinated individuals 50% (0% and 100% in sensitivity analysis) no data
none vaccine hesitancy 30% [31, 32]
ξ(t) daily number of available vaccines see S4 Fig [33]
none vaccine effectiveness: reduction of symptomatic infections among vaccinated (compared to non-vaccinated) 90% [34]
σ and δ reduction in infections and symptomatic infections (when infected) among vaccinated (compared to non-vaccinated) individuals 70% and 66.7% (varied such that 1 − (1 − σ)(1 − δ) = 90% in sensitivity analysis) [35]

Study design and outcomes

There are 417 ≈ 1.7 × 1010 ways to allocate 17 sub-populations into four phases, the number of phases specified by the CDC recommendations. A large number of these allocations can be ruled out as non-optimal, for the following reasons. First, any strategy that recommends vaccination of a specific group of people (i.e., certain age, occupation and living condition) without comorbidities before vaccination of that same group with comorbidities can be improved by switching the two phase assignments, as this leads to a reduction of deaths while not changing case numbers. This rule reduces the number of feasible allocations to 4 × 108. Second, individuals of the same age and the same comorbidity status but with jobs with higher contact rates or in congested living conditions should never be vaccinated later than people with a lower-contact job or not in congested living conditions, as this leads to a reduction of cases and a subsequent reduction in deaths. This rule reduces the number of feasible, potentially optimal allocations to 1.75 × 107.

In a novel global optimization approach, we compared all these 17.5 million potentially optimal vaccine allocation strategies that stagger the vaccine roll-out in up to four phases using four primary outcome metrics: total deaths, total cases, total infections (symptomatic and asymptomatic), and total years of life lost (YLL) at the end of 2021, slightly more than one year after the beginning of the public vaccine roll-out in the United States (Table 2). We computed all strategies that are Pareto-optimal and compared with the CDC allocation strategy (Fig 2). Pareto-optimal strategies cannot be improved in one metric without obtaining a worse outcome in another metric. As a secondary outcome measure, we investigated how deaths were distributed across different age groups as one element of health equity, as equitable vaccine allocation has received attention both from government agencies and the media [36].

Table 2. Comparison of CDC and optimal vaccine allocation strategies.

For each sub-population (characteristics and population sizes defined in the left columns) and each objective (top row), the priority phase corresponding to the optimal allocation strategy is shown. At the bottom, absolute and relative outcomes are compared for the CDC allocation and all optimal allocation strategies.

Age Job / living situation Comorbidity Number of people [millions] Sub-population ID in model CDC allocation fewest deaths [thousands] lowest YLL [millions] fewest cases [millions] fewest infections [millions]
0-15 NA NA 64.71 1 4 4 4 4 4
16-64 healthcare workers no 13.29 2 1 1 1 1 1
yes 7.71 3 1 1 1 1 1
frontline essential workers no 18.98 4 2 2 2 2 2
yes 11.02 5 2 2 2 2 2
other essential workers no 12.66 6 3 3 3 2 2
yes 7.34 7 3 3 2 2 2
remaining people no 87.61 8 4 4 4 3 3
yes 50.85 9 3 3 3 3 3
65-74 congested living no 0.28 10 1 2 3 3 3
yes 0.76 11 1 1 2 3 3
remaining people no 8.20 12 3 3 4 4 4
yes 22.34 13 3 3 3 4 4
75+ congested living no 0.39 14 1 3 3 3 4
yes 1.57 15 1 1 2 3 4
remaining people no 4.07 16 2 3 4 4 4
yes 16.47 17 2 2 3 4 4
Respective outcome of specific allocation CDC 652 11.6 38.1 56.4
fewest deaths 651 11.6 37.9 56.2
lowest YLL 657 11.5 37.3 55.3
fewest cases 688 11.8 36.6 54.2
fewest infections 695 11.9 36.6 54.2
% difference in outcome between specific and respective optimal allocation CDC 0.19 0.97 4 4.07
fewest deaths 0 0.67 3.64 3.74
lowest YLL 0.88 0 1.9 2.08
fewest cases 5.75 2.44 0 0.01
fewest infections 6.73 2.84 0.03 0

Fig 2. Comparison of CDC and optimal vaccine allocation strategies.

Fig 2

(A) Spearman correlation between four measures of disease burden based on a complete comparison of all 17.5 million meaningful four-phase vaccine allocation strategies. (B) Pareto frontier of all optimal strategies based on a global search of all 17.5 million meaningful vaccine allocation strategies. For strategies on the Pareto frontier, there exists no other strategy that performs better in one objective (minimizing deaths or cases) while not performing worse in the other objective. The death and case count resulting from four specific allocations is highlighted. (C) For the four strategies highlighted in (B), the distribution of all resulting deaths across the four age groups is shown as a measure of equity. (D-F) Pareto frontiers of all optimal strategies are shown when restricting (D) children, (E) healthcare workers without comorbidities, (F) 16–64 year old without comorbidities and without an essential occupation to a certain priority phase. S8 Fig contains Pareto frontiers for all sub-populations.

Results

Evaluation of vaccine allocation strategies

Overall, the CDC strategy performed well in all metrics but never optimally (Table 2). According to the established model, there were other allocations that resulted in 0.19% lower mortality, 0.97% lower YLL, 4.0% fewer cases and 4.09% fewer infections. Prioritizing the vaccination of the working age population generally led to fewer cases and infections at the expense of higher deaths and YLL, highlighting the anticipated trade-off in multi-objective decision making. Indeed, pairwise Spearman correlations between the four metrics (Fig 2A) revealed that it is not possible to find a single allocation strategy that is optimal under each objective.

Rather, there exist several Pareto-optimal solutions to the multi-objective optimization problem. The Pareto frontier consists of all strategies that cannot be further improved in one objective without obtaining a worse outcome in another objective. The two-dimensional Pareto frontier based on deaths and cases reveals that the strategy chosen by the CDC was almost optimal (Fig 2B), and could only be outperformed by a few strategies (S2 Table). All these Pareto-dominant strategies put more emphasis on a differential phase assignment of individuals with and without comorbidities; that is, vaccinating individuals with COVID-19 risk factors earlier.

Equitable allocation in the vaccine roll-out has received attention both from government agencies and the media [36]. Here, we investigated how deaths are distributed across different age groups as one element of health equity. Interestingly, the allocation strategy that minimizes overall mortality also leads to a more even distribution of deaths across the age groups, compared to other single-objective optimal allocations or the CDC allocation (Fig 2C). Across all 17.5 million investigated allocations, the most age-equitable allocation strategy, measured using the entropy of the mortality distribution across the four age groups, performed poorly in all other objectives, as did an unstructured vaccine roll-out without phases (S7 Fig).

Vaccinating children in any but the last phase always led to a worse outcome, irrespective of the specific objective (Table 2 and Fig 2D). The CDC prioritization of healthcare workers is validated by the model (Fig 2E). Similarly, the CDC assignment of the general public, 16–64 year-olds with non-essential occupations and no comorbidities, to the last phase is also validated (Fig 2F), with the following exception: If solely incidence (i.e., cases) is minimized irrespective of YLL and mortality, then this group (sub-population 8 in Table 2) should be vaccinated before older individuals with comparably fewer contacts (sub-populations 12–17). Interestingly, the CDC allocation is very similar to the allocation that minimizes mortality except for the phase assignment of three older age groups with no comorbidities, two of which are in congested living; these sub-population are vaccinated earlier under the optimal mortality allocation (Table 2).

Sensitivity of results to unknown parameters

Several parameters related to virus spread and vaccine function are still unknown [27]. We therefore investigated the robustness of our findings when the relative contagiousness of asymptomatic (compared to symptomatic or pre-symptomatic), fA, the relative contagiousness of vaccinated (compared to non-vaccinated) individuals who are infected, fV, and the age-dependent clinical fraction (scaled by q75+) were varied. Overall, variation of a single parameter only led to slight changes in the optimal allocations (S3 Table). Interestingly however, if vaccination does not reduce virus spread (fV = 1) other than through a reduction of infections, prioritization of elderly people becomes less important as the vaccine does not act as a barrier to infection among the elderly. This is evident from S3 Table when comparing the phase assignment of individuals 65 and older in the scenarios fV = 0 and fV = 1: In the latter scenario, several elderly sub-populations get vaccinated later when minimizing either deaths or cases.

We next investigated if variation in the population-wide level of vaccine hesitancy affects allocation priorities. We computed the optimal vaccine allocation under four different levels of vaccine hesitancy (30%, 20%, 10%, 0%). Despite minor variations, the optimal strategies for each objective were mostly consistent across all levels of vaccine hesitancy (Fig 3A). Similarly, for any level of vaccine hesitancy between 0% and 30%, the relative differences in outcomes between the CDC and the respective optimal allocation were also comparable (Fig 3B–3D). As expected, both the CDC and the respective optimal allocation led to a worse outcome the higher the level of hesitancy in the population. In the absence of vaccine hesitancy, the United States using the CDC allocation strategy would have suffered 579,804 COVID-19-related deaths at the end of 2021, compared to 652,043 when 30% of the population refuse the vaccine.

Fig 3. Dependency of findings on vaccine hesitancy.

Fig 3

(A) For different levels of vaccine hesitancy (30%, 20%, 10%, 0%), the optimal vaccine allocation strategies with respect to three objectives (top row) are shown, in addition to the CDC allocation. Sub-populations 1–17 are defined as in Table 2. (B-D) Comparison of outcomes (total deaths (B), years of life lost (C) and total cases (D)) when using the respective optimal allocation strategy from (A; black line) and the CDC strategy (red line), for any vaccine hesitancy between 0% and 30%. The background color indicates which of the allocation strategies, identified in (A; bottom row), was optimal for a specific level of hesitancy.

Impact of vaccine function

While clinical trials provide a good estimate of vaccine effectiveness (around 90% for both the Pfizer-BioNTech and Moderna vaccine, the first two vaccines used in the United States [34]), vaccine function is less well understood. We therefore examined the dependency of our findings on the way a vaccine works: through a reduction of infections (σ), and/or a reduction of symptomatic infections and a proportional increase of truly asymptomatic infections (δ). A longitudinal UK COVID-19 infection study indicated σ = 70% and δ = 67% for the AstraZeneca and Pfizer-BioNTech vaccines (the values used throughout this study) [35]. However, vaccine function can differ strongly between vaccines, as a continuum of combinations of these two parameters can give rise to the same vaccine effectiveness (Fig 4A).

Fig 4. Dependency of findings on vaccine function.

Fig 4

(A) A continuum of combinations of σ, the reduction of infections among vaccinated, and δ, the reduction of symptomatic infections among vaccinated infected individuals, can lead to a vaccine effectiveness of 50%, 75% or 90%. (B) Total deaths (y-axis) under a variety of scenarios, assuming a vaccine effectiveness of 90% and the use of the CDC allocation strategy. Scenarios differ in the relative contribution of σ and δ to the vaccine effectiveness (x-axis, see (A)), and the relative contagiousness of vaccinated individuals (compared to non-vaccinated), specified by line type (dashed: 0%, solid: 50%, dotted: 100%). (C) For three different objectives, the optimal vaccine allocation strategies are compared between two vaccines of extreme function: a vaccine that solely prevents infections (σ = 90%, δ = 0%) and a vaccine that solely prevents symptoms among infected individuals ((σ = 0%, δ = 90%). Sub-populations (defined as in Table 2) that are allocated to a later (earlier) priority phase in the latter vaccine are indicated by ↑ (↓). S4 Table contains the specific phase assignments for each sub-population.

In addition, it is currently unknown how contagious vaccinated infected individuals are compared to non-vaccinated individuals. Deaths under the CDC allocation were highest in scenarios where vaccinated individuals were relatively more contagious and when a vaccine was less effective at preventing infections and more effective at reducing symptoms (Fig 4B). In scenarios with a higher relative contagiousness of vaccinated individuals, vaccine function had a stronger influence on mortality. However, if vaccinated individuals were assumed to not cause any new infections, mortality was similar no matter if the vaccine solely prevented infections (σ = 90%, δ = 0%) or solely prevented symptomatic infections among vaccinated infected individuals (σ = 0%, δ = 90%).

Vaccine function did not affect the choice of optimal allocation when minimizing incidence (Fig 4C and S4 Table). When minimizing mortality, however, vaccine function mattered. The less effective a vaccine was at preventing infections (and correspondingly the more effective at reducing symptoms) the more vaccination prioritizations shifted towards the elderly and comorbid population, to the extent that e.g. healthcare workers without comorbidities were no longer part of the first phase in the extreme case of a vaccine that only prevents symptoms (σ = 0%). The general trend towards the elderly and comorbid population was also prevalent when minimizing YLL.

Discussion

Any vaccine allocation strategy must balance several competing goals, including minimizing mortality and infections, ensuring equity across demographic groups, and maintaining health care capacity. Overall, the CDC allocation performed well in all metrics utilized in this study (fewest deaths, lowest YLL, fewest infections, fewest cases); for each metric, the CDC allocation was within 5% of the respective single-objective optimal allocation. Single-objective optimal allocations tended to do poorly in other objectives, with the optimal YLL strategy best balancing trade-offs associated with minimizing mortality versus incidence (Table 2).

The most equitable allocation across age groups in terms of mortality performed poorly in all other objectives (S7 Fig). The allocation that minimized overall mortality led to a more even distribution of deaths across age groups than any other single-objective optimal allocation, and led to almost identical equitability as the CDC allocation (e.g., 53.05% vs. 53.13% of deaths occurred within the 75+ age group; Fig 2C). Our model also validates the CDC allocation with respect to maintaining health care capacity [36]. All optimal strategies agree with the CDC allocation in ranking healthcare workers as a higher priority than frontline essential workers, who are a higher priority than other essential workers. In general, the optimal allocation strategy depends strongly on the goal of the vaccination campaign: for example, sub-population 15 (age 75+ in congested living with comorbidities) should be vaccinated in the first phase to minimize mortality, in the second phase to minimize YLL, in the third phase to minimize cases, and in the last phase to minimize infections (Table 2).

The CDC allocation did not include children under 16 as part of its phased allocation scheme, as clinical trials leading to the first Emergency Use Authorization authority (EUAs) did not involve children [2], and most children seem at low risk for complications from COVID-19 [37]. However, this demographic comprises approximately 20% of the U.S. population and through social contact with adults can act as disease vectors. Our model therefore investigated the potential for possible indirect and/or cascade effects across the entire population if children under 16 were not targeted for priority vaccination. Our model validated the CDC’s decision—vaccinating children in any but the last phase always led to a worse outcome (Fig 2D).

Our model included several dynamic elements of the COVID-19 pandemic that were important for a good fit to the data. First, the overall social distancing level at a particular time depended on the number of current active cases. We modeled this response through a Hill function, which allows for an initially slow response to changing case numbers reported by the media, followed by a strong response that eventually tapers off (S3 Fig). This approach does not account for changes in social distancing behavior over time, as, for example, people experiencing quarantine fatigue may increase their social interactions later in the pandemic even when case counts are high.

The model included two age-dependent biological parameters: the susceptibility to infection and the fraction of cases that develop symptoms (clinical fraction; S1 Fig). We modeled both parameters as linearly increasing with age, and fitted the former parameter to observed cumulative cases and deaths, using a weighted least squares approach that places larger weights on more recent data. This choice of weights ensures that the fit is good toward the end of the time series in order to obtain more realistic model predictions. Note that fitting both parameters at the same time is not possible given only death and case counts (over-fitting), which is why we conducted uncertainty analyses to examine the effect of variation of the age-dependent clinical fraction on the choice of optimal allocation strategies 1.

Finally, a time-dependent transmission rate accounted for the emergence of more transmissible variants of SARS-COV-2. The relative transmission rate was calculated based on biweekly estimates of the prevalence of variants in the population and the estimated relative transmission rate of the circulating variants (S5 Fig). These four dynamic model elements—case-dependent social distancing level, age-dependent susceptibility to infection, age-dependent clinical fraction, and time-dependent transmission rate—were essential to capturing realistic dynamics in our model (S6 Fig). By identifying these elements as essential to the modeling process, we have also identified important aspects of COVID-19 epidemic dynamics that warrant further study, and should be included in realistic models of COVID-19 epidemiology.

Our model suggests one improvement that could be made to future vaccination allocations should they become necessary. The allocations identified as optimal for minimizing deaths and YLL distinguished between people with and without comorbidities in all age groups, and assigned priority to those with comorbidities. The CDC allocation only prioritizes people with comorbidities among the general working age population, and while accounting for comorbidity status in older populations leads to better model outcomes, segregating these populations may be impractical, especially in congested living conditions.

The level of vaccine hesitancy affected optimal vaccine allocation strategies only slightly (Fig 3). The CDC allocation was most similar to the allocation that minimized mortality irrespective of the level of hesitancy, and generally as hesitancy decreased the difference in outcomes between the CDC allocation and the respective optimal allocation increased. That is, the CDC allocation performs closest to optimality at the high U.S. estimate of 30% vaccine hesitancy [32].

One limitation of this study is the simplifying assumption that all sub-populations exhibit the same level of vaccine hesitancy, and that hesitancy does not change over time. Incorporating these additional dynamic elements into the model would improve the accuracy of the results, but would significantly increase model complexity.

Further limitations stem from uncertainties regarding key model parameters. Rates of contact between individuals of different age groups were based on extensive pre-pandemic survey work in eight European countries and inferred for the United States [20, 21]. In the absence of data, we assumed that contacts within a group in a congested living situation occur at double the rate of the same age group not living in congested conditions, and the additional contacts are with other individuals in the same congested living situation. Model results depend strongly on the contact matrix, and better information about contact rates, especially during the pandemic, could improve the accuracy of model predictions. The contagiousness of asymptomatic as well as vaccinated individuals is still not well understood. The model results were however robust to uncertainty in these parameters (S3 Table): variation in both phase assignments and the overall shape of the Pareto frontier were small.

We did not consider reinfections in our model. Repeated infections have been reported in the literature [38], but they seem rare and a recent study suggests prolonged immunity in most successfully vaccinated or previously infected individuals [39]. We further assumed that individuals were immediately fully protected once they received their first vaccine dose. While this model simplification overestimates the immediate effect of the vaccine, it does so uniformly and should thus not affect relative comparisons between allocation strategies.

In conclusion, the CDC allocation strategy performed well in all considered vaccination goals but never optimally, and the CDC allocation was most similar to the optimal allocation strategy that minimizes mortality. Our model validates the CDC allocation strategy with respect to equity across age groups, maintaining health care capacity, and assigning children under the age of 16 to the lowest-priority vaccination phase. Vaccine strategies that prioritize individuals with comorbidities led to slightly better outcomes than the CDC allocation strategy. The developed global optimization approach can be used to inform the design of future vaccine allocation strategies in the United States and elsewhere.

Detailed methods

Compartmental disease model

We used a compartmental disease model comprised of a system of deterministic ordinary differential equations to depict the dynamics of the COVID-19 epidemic in the United States. Every individual is either susceptible to the virus (S), recently infected but not yet spreading the virus (E: exposed), not yet showing symptoms but spreading the virus (P: pre-clinical), showing symptoms and spreading the virus (C: clinical), showing symptoms but not spreading the virus due to isolation or hospitalization (Q: quarantine), infected but asymptomatic (i.e., never showing symptoms) and spreading the virus (A), recovered (i.e., no longer spreading virus) after having had symptoms (RC), recovered after an asymptomatic course of infection (RA) or dead (D). In addition, every individual is either vaccinated (V), willing to be vaccinated (W) or not willing to be vaccinated (N). Combined, this leads to 20 different compartments:

SN,SW,SV,EN,EW,EV,AN,AW,AV,RAN,RAW,RAV,PN,PW,PV,C,CV,Q,RC,D.

We assume that individuals who exhibit COVID-19 symptoms are not being vaccinated, therefore we only distinguish between vaccinated and non-vaccinated individuals in the clinical compartment. Due to the initial shortage of vaccines we also assume that people who have recovered from a symptomatic COVID-19 infection do not get vaccinated, since recovered individuals have some immunity against the disease. People currently in quarantine and people who have died from the disease also do not get vaccinated, therefore we only used one compartment for each of these three groups (Q, RC, D).

The model parameters governing transitions between compartments depend on an individual’s characteristics (Fig 1). We therefore divided the population into different classes based on age (four classes: 0–15, 16–64, 65–74, 75+ years old), co-morbidity status (two classes: none or at least one known risk factor associated with more severe COVID-19 disease other than age), job type of the working-age population (four classes: healthcare workers, frontline essential workers, other essential workers, and all remaining people), and living situation for the elderly population of ages 65 and older (two classes: congested living or not). As of May 10, 2021, children under the age of 16 were not eligible for vaccination, and are not stratified by co-morbidity status. This leads to a total of 17 sub-populations (see Table 2) and 17 × 20 = 340 different compartments, each governed by a differential equation (see Model equations).

Based on 2019 data from the U.S. Census Bureau, we used a total population size of N = 328, 239, 523 [25]. 64.47 million are children under the age of 16, 209.46 million are 16–64 years old (an estimated 21 million health care personnel, 30 million frontline essential workers, 20 million other essential workers [2]), 31.58 million are 65–74 years old and 22.5 million are 75 and older. Around 1.35 million people live in nursing homes and 65.3% of them are 75 and older [40]. Due to unavailability of data, we assumed the same age distribution for individuals living in congested long-term care facilities, yielding an estimated 1.04 million 65–74 year old and 1.96 million 75+ year old in congested living conditions. Using published population-level estimates and U.S. census data, we inferred the proportion of individuals with co-morbidities to be 36.72%, 73.15%, and 80.18% for the age groups 16–64, 65–74, and 75+, respectively [19, 25]. Altogether, this yields the number of people in each of the 17 sub-populations, denoted Ni and shown in Table 2.

Infection

The force of infection depends on the number of contagious individuals, their contagiousness, the age-dependent susceptibility to infection and the contact rates between the various sub-populations. The relative contagiousness of asymptomatically infected individuals, denoted fA, is a heavily debated element in the spread of COVID-19 [27, 41]. Following the best estimate of the CDC and the Office of the Assistant Secretary for Preparedness and Response (ASPR) we assumed that asymptomatically infected individuals are 25% less contagious than pre-symptomatic and symptomatic individuals [27]. In sensitivity analyses, we varied this number from 25% to 100%, the CDC’s lower and upper bound for that reduction. Similarly, we assumed that vaccinated infected individuals may have lower contagiousness, denoted by fV where fV = 1 implies equal contagiousness as non-vaccinated infected individuals (see Vaccine function for details).

Previous work indicates that the rate of susceptibility to infection may vary with age [17]. Here, we assumed that this rate depends linearly on age, while it does not depend on job type, living situation or comorbidity status (these latter three characteristics are incorporated into the model via the interaction matrix, see Contact rates). That is,

βi=b0+b1·meanageofsub-populationi, (1)

for i = 1, …, 17, where b0 and b1 are parameters, which we fitted using the observed cumulative cases and deaths between December 14, 2020 and April 29, 2021 (see Model calibration for details).

To account for the emergence of variants with up to 50% increased infectivity, we included in the model a time-dependent relative infectivity ϕ(t) ∈ [100%, 150%], which we calculated from CDC genomic surveillance data as follows [42]. For each available time point, we computed the average infectivity based on the prevalence of variants B.1.1.7 and B.1.351 with an estimated 50% increased transmissibility [23, 43], variants B.1.427 and B.1.429 with an estimated 20% increased transmissibility [44], and the rest with standard transmissibility (S5 Fig).

The force of infection for sub-population i, i = 1, …, 17 at time t, is then given by

Λi=ϕ(t)(1r(activecases))βi··j=117Xij((fA(AjN+AjW+fVAiV)+PjN+PjW+fVPjV+Cj+fVCjV))/Nj,

where r(active cases) represents the overall social-distancing level based on the current number of active cases (see Population-wide social distancing level), and Xij denotes the average daily number of contacts an individual in sub-population i has with individuals from sub-population j.

Contact rates

Rates of contact between individuals of different ages have been identified through extensive survey work in eight European countries and subsequently inferred for a total of 152 countries including the United States [20, 21]. The age-to-age interactions in these sources are provided for 5-year age groups (e.g., 0 − 4, 5 − 9, 10 − 14, … years of age). Using 2019 U.S. census data [25], we transformed the original contact matrix into a 4 × 4-contact matrix with age groups corresponding to those used in this study (0 − 15, 16 − 64, 65 − 74, 75+ years of age; S2A and S2B Fig). As they are based on empirical survey data, the original contact matrices are typically not symmetric. We therefore symmetrized the 4 × 4-contact matrix using an established procedure [45] (S2C Fig). Finally, we expanded the 4 × 4-contact matrix into a 17 × 17-contact matrix, which describes the rates of contact among the 17 sub-populations (S2D and S2E Fig), and adjusted this matrix for differences in contact rates due to the types of jobs and living conditions as follows (S2F and S2G Fig).

A recent multivariate statistical analysis found that healthcare workers have a 3.4-fold increase in their risk of infection compared to the general population [22]. Assuming this increased risk is due to increased contacts, we calculated the relative differences in overall contacts for healthcare workers (sub-populations 2&3) compared to the general 16–64 year-old population (sub-populations 8&9). In the absence of data, we assumed that frontline essential workers (sub-populations 4&5) and other essential workers (sub-populations 6&7) have fewer contacts than healthcare workers but more than the general public, and we assumed a linear trend. The relative number of overall contacts for the different job types (healthcare workers, frontline essential workers, other essential workers, and the remainder) is therefore [3.4, 2.6, 1.8, 1], respectively. Using the sub-population sizes as weights [46], we then calculated the absolute daily contact numbers for the different job groups so that the overall total contact rate is not changed (S2F Fig).

In the absence of data, we assumed that people in congested living conditions (sub-populations 10&11 and 14&15) have double the number of contacts than peers of the same age group (sub-populations 12&13 and 16&17). We assumed that all increased contacts happen within the congested living environment and increased the respective entries proportional to their relative values. In the end this procedure yielded a 17 × 17 contact matrix that describes the rates of contact between the different sub-populations (S2G Fig).

Population-wide social distancing level

To adjust for various levels and intensities of lockdowns and other non-pharmaceutical interventions aimed at reducing virus spread, we included a variable social distancing level that depends on the current number of active cases, i=117(Ci+CiV). In particular, we used a Hill function to model the contact reduction,

r(activecases)=111+(clog10(activecases))k, (2)

where c and k, the two parameters governing the shape of this function, were fitted to the observed cumulative cases and deaths between December 14, 2020 and April 29, 2021 (see Model calibration and S3 Fig).

Model dynamics and disease parameters

Non-vaccinated susceptible individuals (SiN and SiW) become infected at a rate of Λi. This rate is reduced by a factor of σ for vaccinated individuals. Upon infection, susceptible individuals move into the respective exposed compartment (EiN, EiW and EiV). Individuals remain in the exposed compartment for an average of 1/μE = 3.7 days [26]. After this incubation period, individuals start to spread the virus. A fraction qi of exposed individuals (called the clinical fraction) becomes pre-clinical (PiN, PiW and PiV), while the others will never develop symptoms and remain asymptomatic (AiN, AiW and AiV). The rate of truly asymptomatic infections is still not well known [41]. We assumed that the clinical fraction changes linearly with age:

qi=q75+γ·meandifferenceinagebetweenagegroup75+andsub-populationi, (3)

for i = 1, …, 17, where q75+ is the probability of symptomatic infection for age group 75+ and γ is chosen such that the overall (expected) clinical fraction across all ages is 70%, the CDC’s most likely estimate [27]. In the model, we used q75+ = 85% as the base value and considered q75+ = 70% and q75+ = 100% in uncertainty analyses (S1 Fig).

Pre-clinical individuals start exhibiting symptoms after an average of 1/μP = 2.1 days and move into the clinical compartments, Ci and CiV [17]. Symptomatic individuals continue to spread the virus for an average of 1/μC = 2.72 days—the average time between the reported onset of symptoms and a positive test in individual case data released by the CDC [47]. We assume that the clinical cases stop spreading the disease due to either isolation (moving into compartment Qi). After an average of 1/μQ = 19.28 days, individuals either recover or die. A sub-population-dependent case fatality rate CFRi describes the fraction of individuals who die (move into compartment Di; see Case fatality rates for details). We used 1/μC + 1/μQ = 22 days for the average time from symptom onset to death as the best fit for the delay between the curves of reported U.S. cases and deaths [28].

Asymptomatic individuals (in AiN, AiW and AiV) spread the virus at a lower rate than symptomatically infected. The parameter fA describes the relative contagiousness of asymptomatic individuals, compared to individuals in the pre-clinical and clinical compartments. We used fA = 75% and varied this important parameter from 25% to 100% in sensitivity analyses [27] (S3 Table). Asymptomatic individuals spread the virus for an average of 1/μA = 5 days [17], after which they move into their corresponding recovered compartment, RAiN, RAiW or RAiV. We distinguish between recovered individuals who were symptomatically and asymptomatically infected because the latter may receive a vaccine since we did not consider seropositivity tests prior to vaccination. All individuals willing to receive the vaccine and without a history of symptomatic COVID-19 infection (i.e., those in SiW,EiW,PiW,AiW and RAiW) get vaccinated at a rate νi(t), which depends on the vaccine allocation strategy and the number of daily available vaccines (see Vaccine function), and transition into the corresponding compartment upon vaccination (i.e, SiV,EiV,PiV,AiV, and RAiV).

Case fatality rates

We calculated the sub-population-specific case fatality rates, CFRi, by combining several sources. First, we divided CDC age-structured death counts by case counts to estimate the age group-dependent CFRs: 0.0129%, 0.4533%, 4.9781%, 16.7279% for the four age groups used in this study, 0 − 15, 16 − 64, 65 − 74 and 75+ years of age [48]. From existing U.S. population level estimates [19], we calculated the prevalence of comorbidities among individuals in each age group to be 18.60%, 36.72%, 73.15%, 80.18%. A study of U.S. health insurance claims indicated that 51.71% of all individuals diagnosed with COVID-19 had at least one comorbidity, while the percentage was 83.29% in individuals who died from the disease [30]. We therefore assumed that individuals with a comorbidity, irrespective of age, have a (0.8329/0.5171)/(0.1671/0.4829) = 4.65 times higher CFR. Combining these calcuations yields an age-dependent CFR of 0.1935%, 1.13551%, 4.2560% for adults without comorbidities and 0.8997%, 6.3012%, 19.7907% for adults with comorbidities in the age groups 16 − 64, 65 − 74 and 75+, respectively. Note that in this study we do not distinguish between children with and without comorbidities, and instead use the overall CFR of 0.0129% for this age group.

Vaccine function

Vaccinated individuals have a lower chance of developing a symptomatic COVID-19 infection. After clinical trials reported efficacy rates of around 95% [49, 50], initial data from the US vaccine roll-out found the Pfizer/BioNTech BNT162b2-mRNA and Moderna mRNA-1273 vaccines to be 90% effective [34]. This means that, all other things being equal (e.g., age, contact rates, comorbidity status), a vaccinated person is 90% less likely to develop a symptomatic COVID-19 infection than a non-vaccinated person. In a compartmental model, this reduction could be due to one or both of two mechanisms:

  1. a vaccine-induced reduced susceptibility to infection, i.e., a reduction in the number of individuals who move from the S compartment to the E compartment. We denote this reduction factor by σ ∈ [0, 1], or

  2. a vaccine-induced reduced probability of developing a symptomatic infection (when infected), i.e., a reduction in the number of individuals who move from the E compartment to the P compartment, with a corresponding increase in the number of individuals who move from the E compartment to the A compartment. We denote this reduction factor by δ ∈ [0, 1].

Vaccine effectiveness and the two reduction factors are related by:

vaccineeffectiveness=1(1σ)(1δ).

Fig 4A shows all possible combinations of reduction factors that yield a particular vaccine effectiveness. A longitudinal British study of the effectiveness of the AstraZeneca and the Pfizer-BioNTech vaccine suggests that σ = 70% and δ = 66.7% [35]. In sensitivity analyses, we varied both values from 0% to 90% (Fig 4). In practice, these two reduction factors as well as vaccine effectiveness may differ among sub-populations (e.g., with age or comorbidity status) or among different vaccines; in this study we only investigated fixed reduction factors.

In addition, vaccinated infected individuals may spread the virus at a lower rate than non-vaccinated individuals. The reduced contagiousness of vaccinated individuals, fV ∈ [0%, 100%] accounts for this in the force of infection. fV = 0% corresponds to a complete stop of virus spread while fV = 100% means no reduction compared to non-vaccinated individuals. Due to a lack of data, we assumed fV = 50% in the base model—that is, a vaccinated infected person is 50% less contagious than a non-vaccinated infected person at the same stage of the disease. In a sensitivity analysis, we varied fV from 0% to 100% (Fig 4B).

Vaccine hesitancy

Recent data indicates that up to 30% of the population are hesitant to receive COVID-19 vaccines [31, 32]. We evaluated the CDC allocation using a base value of 30% hesitancy but also studied the effect of lower hesitancy on the choice of optimal vaccine allocations (Fig 3). That is, we set SiN(0)=hesitancy(SiN(0)+SiW(0)). Note that we assumed uniform hesitancy levels for all sub-populations.

Vaccination campaign

The public vaccine roll-out in the United States began on December 14, 2020, denoted by t0. For simplicity, we considered a single vaccination event per individual. We assumed that the number of individuals newly vaccinated at day t, denoted ξ(t), is half the 7-day average in total doses administered, based on U.S. vaccination records released by the CDC and the two-dose vaccine regimen [33]. After May 5, 2021, we projected future daily vaccination levels as follows: Non-vaccinated individuals willing to get vaccinated will likely become increasingly harder to find. We thus assumed that the number of daily vaccinations decreases linearly at a rate such that it becomes zero exactly when all individuals willing to be vaccinated have been vaccinated (S4 Fig).

The CDC announced in December 2020 two phases of vaccine roll-out that were further divided into a total of four priority phases (1a, 1b, 1c, 2; Table 2) [2]. To enable a direct evaluation of the CDC vaccine allocation strategy, we also considered four phases, labeled 1, 2, 3, and 4, for brevity. All sub-populations i that are allocated to the current priority phase receive the vaccine at the same time-dependent rate

νi(t)=ξ(t)sub-populationkpartofthecurrentphaseSkW(t)+EkW(t)+AkW(t)+RAkW(t)+PkW(t).

For all other sub-populations j, we have νj(t) = 0. That is, all individuals without a present or past symptomatic COVID-19 infection are available to receive the vaccine, and we do not consider seropositivity tests and the corresponding exclusion of currently or previously asymptomatically infected people from vaccination. Once there are no more non-vaccinated individuals who are willing to be vaccinated and are part of a certain priority phase, the vaccination campaign moves to the next phase. Once all people willing to be vaccinated receive the vaccine the campaign stops. We do not consider reinfections, so the lack of vaccination of previously symptomatically infected individuals has no effect on the model dynamics.

Model equations

A schematic illustration of the compartmental model is shown in Fig 1. The compartmental model is described by the following system of differential equations, where i = 1, …, 17 enumerates the 17 sub-populations:

SiN˙=ΛiSiNSiW˙=ΛiSiWνiSiWSiV˙=Λi(1σ)SiV+νiSiWEiN˙=ΛiSiNμEEiNEiW˙=ΛiSiWμEEiWνiEiWEiV˙=ΛiSiV(1σ)μEEiV+νiEiWAiN˙=μE(1qi)EiNμAAiNAiW˙=μE(1qi)EiWμAAiWνiAiWAiV˙=μE(1qi(1δ))EiVμAAiV+νiAiWRAiN˙=μAAiNRAiW˙=μAAiWνiRAiWRAiV˙=μAAiV+νiRAiWPiN˙=μEqiEiNμPPiNPiW˙=μEqiEiWμPPiWνiPiWPiV˙=μEqi(1δ)EiVμPPiV+νiPiWCi˙=μP(PiN+PiW)μCCiCiV˙=μPPiVμCCiVQi˙=μC(Ci+CiV)μQQiRCi˙=(1CFRi)μQQiDi˙=CFRiμQQi} (4)

Model calibration

Most model parameters were derived from the literature (Table 1). We used an elitist genetic algorithm [51] to estimate four model parameters by fitting the modeled to the observed cumulative cases and deaths between December 14, 2020 and April 29, 2021, obtained from the COVID-19 Data Repository at the Center for Systems Science and Engineering at Johns Hopkins University [24, 47]. Two of these parameters, b0 ∈ [0, 0.1] and b1 ∈ [0, 0.01], describe the linearly changing age-dependent rate of susceptibility to infection (Eq 1). The other two parameters, c ∈ [4, 6] and k ∈ [2, 16], describe the shape of the Hill function used to model the population-wide social-distancing level, which depends on the number of active cases (Eq 2).

In the genetic algorithm, we chose meaningful ranges for the parameters that ensured positive rates and probabilities in [0, 1]. We used a fitness function f given by a weighted sum of squared errors (wSSE) between the observed and predicted cumulative deaths and cases,

f(deaths,cases)=wSSE(deaths)+wSSE(cases),

where

wSSE(deaths)=d=December14,2020April29,2021wd·(observedminuspredicteddeathsuptodayd)2,
wSSE(cases)=d=December14,2020April29,2021wd·(observedminuspredictedcasesuptodayd)2,

where we used quadratically increasing weights, wDecember 14, 2020 = 1, wDecember 15, 2020 = 4, wDecember 16, 2020 = 9, …. This choice of weights ensures that the fit is particularly good at the end, yielding more realistic future model dynamics than, for instance, an unweighted fit to cumulative deaths would. To allow for equal weighing of the fit of deaths and case counts, we divided the observed and predicted cumulative cases by 50 (corresponding to a CFR of 2%) before calculating the wSSE of observed and predicted cumulative cases.

We let the genetic algorithm minimize the fitness function f using 50 iterations and a population of 1000 parameter sets. Each iteration, we assigned the 300 best parameter sets as “parents” from which we generated 700 new “children” parameter sets using uniform crossover with a probability of 50%. In addition, we randomly mutated each parameter choice (within its respective range) with a probability of 10%, except for the top 10 parameter sets. That is, we used an elite ratio of 1%, which ensures that the best parameter sets are never lost due to random mutation.

Because genetic algorithms may get stuck at local optima, we performed 100 separate elitist genetic algorithms and used the parameter set with the overall lowest fitness function values for the study. For each scenario with different fA, fV or q75+ value, we ran 100 separate elitist genetic algorithms to obtain the respective best parameter sets. S1 Table shows the fitted parameter values under the CDC allocation strategy.

Model implementation and outcomes

The model is implemented in Python 3.8 using the open source JIT compiler numba for improved run time. We ran the model for each of the 17.5 million possibly optimal allocation strategies. At the end of each run, we recorded the total number of (i) deaths, (ii) (symptomatic) cases and (iii) infections per age group. Based on the 2017 period life table from the U.S. Social Security Administration [52], we calculated that individuals in age groups 0 − 15, 16 − 64, 65 − 74 and 75+ have 71.49, 41.31, 15.97 and 7.97 expected years of life left. We used these numbers to derive, for each run, the total years of life lost (YLL) due to the COVID-19 pandemic. We also considered how deaths were distributed across the four age groups and used the Shannon entropy to summarize the variation in the distribution in a single measure of health equity in S7 Fig [53].

Supporting information

S1 Fig. Age-dependent probability of symptomatic infection.

The probability of symptomatic infection is shown for the different age groups (x-axis) and different scenarios (colors). The average probability of symptomatic infection is 70% in each scenario. This probability increases linearly with year of age up to a fixed value of 70% (blue x), 85% (orange circles; default), 100% (green diamonds) for the age group 75+.

(TIF)

S2 Fig. Multi-step generation of the contact matrix.

(A) The original 4 × 4 U.S. age-age contact matrix inferred from survey data [20, 21] was transformed, using (B) U.S. census data, into (C) a symmetric 4 × 4 contact matrix [45]. Using (D) information on the number of individuals within each of the 17 sub-populations used in this study (characteristics defined in Table 2), the symmetric 4 × 4 contact matrix was expanded into (E) a 17 × 17 contact matrix. Some jobs require more physical contact than others. Inclusion of the average contact rates per job type yielded (F) an adapted contact matrix. Similarly, elderly individuals in congested living conditions have more contacts than their peers and all these increased contacts were assumed to occur within the congested living environment, which yielded (G) the final contact matrix used in this study.

(TIF)

S3 Fig. Case-dependent contact reduction.

A variable contact reduction (Hill function) accounts for changes in the population-wide activity level based on the severity (i.e., the number of active cases) of the epidemic in the United States. The shape of the case-dependent contact reduction used in the base model (black line) is shown along with the shapes of the most extreme parameter choices allowed in the genetic algorithm (dashed lines).

(TIF)

S4 Fig. Speed of the vaccine roll-out.

In the model, the number of newly fully vaccinated individuals each day is set to 50% of the 7-day average of the total number of administered doses (black line). Colored lines show predictions of the future speed of the vaccine roll-out for different levels of vaccine hesitancy.

(TIF)

S5 Fig. Time-varying infectivity of the circulating virus strains.

(A) Prevalence of several variants of concern based on > 40, 000 sequences collected through CDC’s national genomic surveillance since Dec 20, 2020 and grouped in 2-week intervals [42]. (B) For the midpoint of each two-week interval, the relative infectivity of circulating virus strains based on a 50% increased infectivity for B.1.1.7 and B.1.351 and 20% increased infectivity for B.1.427 and B.1.429 is shown (orange circles). A fitted logistic equation with asymptotes at 100% and 150% projects the future relative infectivity (blue line).

(TIF)

S6 Fig. Model fit.

The observed (dashed line) and model-predicted (solid line) cumulative deaths (A) and cases (B) are shown. The model parameters used are described in Table 1 and in the first row of S1 Table.

(TIF)

S7 Fig. Death and case count for all vaccine allocation strategies.

The death and case count of all 17.5 million evaluated meaningful vaccine allocation strategies fall within the dotted region. For strategies on the Pareto frontier (solid line), there exists no other strategy that performs better in one objective (minimizing deaths or cases) while not performing worse in the other objective. The death and case counts resulting from six specific allocations are highlighted.

(TIF)

S8 Fig. Pareto frontiers when fixing one sub-population’s priority phase.

Each subpanel shows four Pareto frontiers. For each frontier, one sub-population’s priority phase is fixed (see Table 2 for group characteristics). For strategies on the Pareto frontier, there exists no other strategy that performs better in one objective (minimizing deaths or cases) while not performing worse in the other objective.

(TIF)

S1 Table. Parameters associated with the best fits for the different scenarios.

For each scenario (described by the parameters in the three most left columns), 100 separate elitist genetic algorithms were performed and the parameters associated with the best fit are shown, in addition to the value of the cost function (wSSE) that the algorithm minimized.

(TIF)

S2 Table. Allocation strategies that outperform the CDC allocation in all three objectives.

This table shows the CDC allocation (first row) and all allocation strategies on the three-dimensional Pareto frontier that lead to fewer deaths, cases and YLL at the same time (bottom 28 rows). Sub-populations 1–17 are defined as in Table 2; sub-populations with comorbidities are highlighted in yellow.

(TIF)

S3 Table. Comparison of CDC and optimal allocation strategies for seven scenarios.

For each sub-population (characteristics and population sizes defined in the left columns) and seven combinations of unknown disease parameters (q75+, the proportion of symptomatic infections among individuals 75 and older; fA, the relative contagiousness of asymptomatic infected individuals; fV, the relative contagiousness of vaccinated infected individuals), the priority phase corresponding to the optimal allocation strategy is shown. At the bottom, predicted outcomes (deaths, YLL and cases) resulting from the CDC allocation and the respective optimal allocation strategy are compared.

(TIF)

S4 Table. Variation of optimal allocation strategies with vaccine function.

For different types of vaccines with 90% effectiveness (specified by σ vs δ), the optimal vaccine allocation strategies with respect to three objectives (top row) are shown. Sub-populations 1–17 are defined as in Table 2.

(TIF)

Data Availability

Data and all relevant code is available at GitHub: https://github.com/ckadelka/COVID19-CDC-allocation-evaluation.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1. Dooling K, McClung N, Chamberland M, Marin M, Wallace M, Bell BP, et al. The Advisory Committee on Immunization Practices’ Updated Interim Recommendation for Allocating Initial Supplies of COVID-19 Vaccine—United States, 2020. Morbidity and Mortality Weekly Report. 2021;69(51-52):1657–1660. doi: 10.15585/mmwr.mm695152e2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Dooling K, Marin M, Wallace M, McClung N, Chamberland M, Lee GM, et al. The Advisory Committee on Immunization Practices’ Interim Recommendation for Allocating Initial Supplies of COVID-19 Vaccine—United States, 2020. Morbidity and Mortality Weekly Report. 2020;69(49):1857–1859. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Ferranna M, Cadarette D, Bloom DE. COVID-19 Vaccine Allocation: Modeling Health Outcomes and Equity Implications of Alternative Strategies. Engineering. 2021;. doi: 10.1016/j.eng.2021.03.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Buckner JH, Chowell G, Springborn MR. Dynamic prioritization of COVID-19 vaccines when social distancing is limited for essential workers. Proceedings of the National Academy of Sciences. 2021;118(16). doi: 10.1073/pnas.2025786118 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Moore S, Hill EM, Dyson L, Tildesley MJ, Keeling MJ. Modelling optimal vaccination strategy for SARS-CoV-2 in the UK. PLoS computational biology. 2021;17(5):e1008849. doi: 10.1371/journal.pcbi.1008849 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Bubar KM, Reinholt K, Kissler SM, Lipsitch M, Cobey S, Grad YH, et al. Model-informed COVID-19 vaccine prioritization strategies by age and serostatus. Science. 2021;371(6532):916–921. doi: 10.1126/science.abe6959 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Foy BH, Wahl B, Mehta K, Shet A, Menon GI, Britto C. Comparing COVID-19 vaccine allocation strategies in India: A mathematical modelling study. International Journal of Infectious Diseases. 2021;103:431–438. doi: 10.1016/j.ijid.2020.12.075 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Matrajt L, Eaton J, Leung T, Brown ER. Vaccine optimization for COVID-19: Who to vaccinate first? Science Advances. 2021. 2;7:eabf1374. doi: 10.1126/sciadv.abf1374 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Jentsch PC, Anand M, Bauch CT. Prioritising COVID-19 vaccination in changing social and epidemiological landscapes: a mathematical modelling study. The Lancet Infectious Diseases. 2021;. doi: 10.1016/S1473-3099(21)00057-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Chen J, Hoops S, Marathe A, Mortveit H, Lewis B, Venkatramanan S, et al. Prioritizing allocation of COVID-19 vaccines based on social contacts increases vaccination effectiveness. medRxiv; 2021. published online February 06, 2021. https://www.medrxiv.org/content/10.1101/2021.02.04.21251012v1 (preprint version 1).
  • 11. Markovič R, Šterk M, Marhl M, Perc M, Gosak M. Socio-demographic and health factors drive the epidemic progression and should guide vaccination strategies for best COVID-19 containment. Results in Physics. 2021;p. 104433. doi: 10.1016/j.rinp.2021.104433 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Kadelka C, McCombs A. Effect of clustering and correlation of belief systems on infectious disease outbreaks. medRxiv. 2020;published online December 11, 2020. https://www.medrxiv.org/content/10.1101/2020.12.08.20246298v1 (preprint, version 1).
  • 13.Babus A, Das S, Lee S. The optimal allocation of Covid-19 vaccines. medRxiv. 2020;published online December 03, 2020. https://www.medrxiv.org/content/10.1101/2020.07.22.20160143v2 (preprint version 2).
  • 14.Chen X, Li M, Simchi-Levi D, Zhao T. Allocation of COVID-19 vaccines under limited supply. SSRN; 2020. published online June 30, 2020. https://ssrn.com/abstract=3593098 or 10.2139/ssrn.3593098 (preprint version 1). [DOI]
  • 15. Millar MR, Gourtsoyannis Y, Jayakumar A. Ethics of vaccination: Should capability measures be used to inform SARS-CoV-2 vaccination strategies? British Journal of Clinical Pharmacology. 2021;. doi: 10.1111/bcp.14875 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Persad G, Peek ME, Emanuel EJ. Fairly prioritizing groups for access to COVID-19 vaccines. Jama. 2020;324(16):1601–1602. doi: 10.1001/jama.2020.18513 [DOI] [PubMed] [Google Scholar]
  • 17. Davies NG, Klepac P, Liu Y, Prem K, Jit M, Eggo RM, et al. Age-dependent effects in the transmission and control of COVID-19 epidemics. Nature Medicine. 2020;26:1205–1211. doi: 10.1038/s41591-020-0962-9 [DOI] [PubMed] [Google Scholar]
  • 18. Zhang J, Litvinova M, Liang Y, Wang Y, Wang W, Zhao S, et al. Changes in contact patterns shape the dynamics of the COVID-19 outbreak in China. Science. 2020;368(6498):1481–1486. doi: 10.1126/science.abb8001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Adams ML, Katz DL, Grandpre J. Population-based estimates of chronic conditions affecting risk for complications from coronavirus disease, United States. Emerging infectious diseases. 2020;26(8):1831. doi: 10.3201/eid2608.200679 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Mossong J, Hens N, Jit M, Beutels P, Auranen K, Mikolajczyk R, et al. Social contacts and mixing patterns relevant to the spread of infectious diseases. PLoS Med. 2008;5(3):e74. doi: 10.1371/journal.pmed.0050074 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Prem K, Cook AR, Jit M. Projecting social contact matrices in 152 countries using contact surveys and demographic data. PLoS Computational Biology. 2017;13(9):e1005697. doi: 10.1371/journal.pcbi.1005697 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Nguyen LH, Drew DA, Graham MS, Joshi AD, Guo CG, Ma W, et al. Risk of COVID-19 among front-line health-care workers and the general community: a prospective cohort study. The Lancet Public Health. 2020;5(9):e475–e483. doi: 10.1016/S2468-2667(20)30164-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Davies NG, Abbott S, Barnard RC, Jarvis CI, Kucharski AJ, Munday JD, et al. Estimated transmissibility and impact of SARS-CoV-2 lineage B. 1.1. 7 in England. Science. 2021;372 (6538). doi: 10.1126/science.abg3055 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. The Lancet Infectious Diseases. 2020;20(5):533–534. doi: 10.1016/S1473-3099(20)30120-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.U S Cenus Bureau. American community survey 1-year estimates; 2019. Data retrieved from https://data.census.gov/cedsci/table?q=age&tid=ACSST1Y2019.S0101&hidePreview=false.
  • 26. McAloon C, Collins Á, Hunt K, Barber A, Byrne AW, Butler F, et al. Incubation period of COVID-19: a rapid systematic review and meta-analysis of observational research. BMJ Open. 2020;10(8):e039652. doi: 10.1136/bmjopen-2020-039652 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.CDC and ASPR. COVID-19 Pandemic Planning Scenarios, CDC and the Office of the Assistant Secretary for Preparedness and Response (ASPR); 2020. https://www.cdc.gov/coronavirus/2019-ncov/hcp/planning-scenarios.html (accessed June, 6, 2021).
  • 28.Centers for Disease Control and Prevention. COVID-19 Case Surveillance Public Use Data; 2021. https://data.cdc.gov/Case-Surveillance/COVID-19-Case-Surveillance-Public-Use-Data-with-Ge/n8mc-b4w4.
  • 29. Stokes EK, Zambrano LD, Anderson KN, Marder EP, Raz KM, Felix SEB, et al. Coronavirus disease 2019 case surveillance—United States, January 22–May 30, 2020. Morbidity and Mortality Weekly Report. 2020;69(24):759. doi: 10.15585/mmwr.mm6924e2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Makary M. Risk Factors for COVID-19 Mortality among Privately Insured Patients, Johns Hopkins University School of Medicine, November 11, 2020; 2020. https://www.fairhealth.org/publications/whitepapers.
  • 31. Reiter PL, Pennell ML, Katz ML. Acceptability of a COVID-19 vaccine among adults in the United States: How many people would get vaccinated? Vaccine. 2020;38(42):6500–6507. doi: 10.1016/j.vaccine.2020.08.043 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Sallam M. COVID-19 vaccine hesitancy worldwide: a concise systematic review of vaccine acceptance rates. Vaccines. 2021;9(2):160. doi: 10.3390/vaccines9020160 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Centers for Disease Control and Prevention. Trends in Number of COVID-19 Vaccinations in the US; 2021. https://covid.cdc.gov/covid-data-tracker/#vaccination-trends (accessed May 8 2021).
  • 34. Thompson MG. Interim Estimates of Vaccine Effectiveness of BNT162b2 and mRNA-1273 COVID-19 Vaccines in Preventing SARS-CoV-2 Infection Among Health Care Personnel, First Responders, and Other Essential and Frontline Workers—Eight US Locations, December 2020–March 2021. Morbidity and Mortality Weekly Report. 2021;70. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Pritchard E, Matthews PC, Stoesser N, Eyre DW, Gethings O, Vihta KD, et al. Impact of vaccination on SARS-CoV-2 cases in the community: a population-based study using the UK’s COVID-19 Infection Survey. medRxiv; 2021. published online April 23, 2021. https://www.medrxiv.org/content/10.1101/2021.04.22.21255913v1?versioned=true (preprint, version 1).
  • 36. McClung N, Chamberland M, Kinlaw K, Matthew DB, Wallace M, Bell BP, et al. The Advisory Committee on Immunization Practices’ ethical principles for allocating initial supplies of COVID-19 vaccine—United States, 2020. Morbidity and Mortality Weekly Report. 2020;69(47):1782. doi: 10.15585/mmwr.mm6947e3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Lee PI, Hu YL, Chen PY, Huang YC, Hsueh PR. Are children less susceptible to COVID-19? Journal of Microbiology, Immunology, and Infection. 2020;53(3):371. doi: 10.1016/j.jmii.2020.02.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Iwasaki A. What reinfections mean for COVID-19. The Lancet Infectious Diseases. 2021;21(1):3–5. doi: 10.1016/S1473-3099(20)30783-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Turner JS, Kim W, Kalaidina E, Goss CW, Rauseo AM, Schmitz AJ, et al. SARS-CoV-2 infection induces long-lived bone marrow plasma cells in humans. Nature. 2021;p. 1–8. doi: 10.1038/s41586-021-03647-4 [DOI] [PubMed] [Google Scholar]
  • 40. Harris-Kojetin LD, Sengupta M, Lendon JP, Rome V, Valverde R, Caffrey C. Long-term care providers and services users in the United States, 2015-2016. Vital Health Stat 3(43). 2019. [PubMed] [Google Scholar]
  • 41. Oran DP, Topol EJ. The proportion of SARS-CoV-2 infections that are asymptomatic: a systematic review. Annals of Internal Medicine. 2021;. doi: 10.7326/M20-6976 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Centers for Disease Control and Prevention. Variant Proportions; 2021. https://covid.cdc.gov/covid-data-tracker/#variant-proportions (accessed April 20, 2021).
  • 43.Pearson CA, Russell TW, Davies N, Kucharski AJ, working group CC, Edmunds WJ, et al. Estimates of severity and transmissibility of novel South Africa SARS-CoV-2 variant 501Y; 2021. https://cmmid.github.io/topics/covid19/sa-novel-variant.html.
  • 44.Deng X, Garcia-Knight MA, Khalid MM, Servellita V, Wang C, Morris MK, et al. Transmission, infectivity, and antibody neutralization of an emerging SARS-CoV-2 variant in California carrying a L452R spike protein mutation. medRxiv; 2021. published online March 09, 2021. https://www.medrxiv.org/content/10.1101/2021.03.07.21252647v1 (preprint, version 1).
  • 45.Funk S. Socialmixr: Social mixing matrices for infectious disease modelling, The Comprehensive R Archive Network; 2018. https://cran.r-project.org/web/packages/socialmixr/index.html.
  • 46.U S Census Bureau. Current Population Survey, Annual Social and Economic Supplement 2019, Age and Sex Composition in the United States (Table 1); 2020. Data retrieved from https://www.census.gov/data/tables/2019/demo/age-and-sex/2019-age-sex-composition.html.
  • 47.Center for Systems Science and Engineering at Johns Hopkins University. COVID-19 data repository; 2021. https://github.com/CSSEGISandData/COVID-19 (accessed May 01, 2021).
  • 48.Centers for Disease Control and Prevention. COVID-19 Case Surveillance Public Data Access, Summary, and Limitations (version date: March 31, 2021); 2021. https://data.cdc.gov/Case-Surveillance/COVID-19-Case-Surveillance-Public-Use-Data/vbim-akqf.
  • 49. Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine. New England Journal of Medicine. 2020;383(27):2603–2615. doi: 10.1056/NEJMoa2034577 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Baden LR, El Sahly HM, Essink B, Kotloff K, Frey S, Novak R, et al. Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine. New England Journal of Medicine. 2021;384(5):403–416. doi: 10.1056/NEJMoa2035389 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Solgi R. Standard and elitist genetic-algorithm (GA) version 1.0.1; 2020. Available at: https://github.com/rmsolgi/geneticalgorithm.
  • 52.Office of the Chief Actuary. Actuarial Life Table by the United States Social Security Administration; 2021. Accessed: 2021-04-23. https://www.ssa.gov/oact/STATS/table4c6.html#ss.
  • 53. Shannon CE. A mathematical theory of communication. The Bell system technical journal. 1948;27(3):379–423. doi: 10.1002/j.1538-7305.1948.tb01338.x [DOI] [Google Scholar]

Decision Letter 0

Martial L Ndeffo Mbah

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

13 Oct 2021

PONE-D-21-26548Evaluation of the United States COVID-19 Vaccine Allocation StrategyPLOS ONE

Dear Dr. Kadelka,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Nov 27 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Martial L Ndeffo Mbah, Ph.D

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

Please, address the handful of minor comments and suggestions of Reviewer 2.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: In the present paper, the authors present their study about evaluating the Vaccine allocation strategy implemented by the Centers for Disease Control (CDC) in the US. This subject is of great importance in present times since the vaccine administration has started worldwide. Therefore, it is crucial to have instruments to monitor the vaccination campaign.

The study design and methodology are well structured and clearly explained. The results and conclusions are well presented and thoroughly discussed. Therefore, the present study may be of great help in optimising the vaccination strategy in different countries.

The description of the compartmental model and the calibration procedure is very precise, and the discussion of the parameters is exhaustive. Overall, the paper is well written and well organised.

My only concern is relative to the code availability; no Python code is available at

the address https://github.com/ckadelka/COVID19-CDC-allocation-evaluation reported in the text.

Therefore, the decision is to accept the paper in the present form only after the python source codes are available.

Reviewer #2: Using mathematical modeling, this manuscript analyzes if the strategy of vaccine allocation followed in the United States was suitable in terms of certain objective functions such as minimizing the number of deaths and the number of cases. The authors find that such strategy was not precisely optimum but performed similarly to the optimum strategies (for each objective function).

In general, the manuscript is very well written, complete, and relevant. I am convinced that the translation of this model to other scenarios (for example other epidemic episodes ad regions) can be extremely helpful to guide public health policy in vaccination matters.

As any modelling exercise, the authors are forced to propose simplifications and state uncorroborated assumptions to arrive to solutions. This is perfectly understandable. To me, the assumptions of the model seem appropriate.

In sum, I find this paper truly interesting and well executed. Congratulations.

Some recommendations follow:

(a) To me, the clinical and epidemiological information presented in table 1 (i.e., info relevant to set the values of the model parameters) should be presented within the main text.

(b) Similarly, I recommend moving the scheme in S1 Figure to the main text.

(c) Line 105: “If solely incidence is minimized irrespective of YLL and mortality, then this group 105 should be vaccinated before older individuals with comparably fewer contacts”. Please clarify/elaborate.

(d) Line 118: “Interestingly however, if vaccination does not reduce virus spread (fV = 1) other than through a reduction of infections, prioritization of elderly people becomes 119 less important as the vaccine does not act as a barrier to infection among the elderly”…. This statement unclear to me. Please elaborate and discuss….

(e) Line 146: The following statement can be misleading: “The higher the relative contagiousness of vaccinated individuals, the higher was the influence of vaccine function on mortality; if vaccinated individuals did not cause any new infections, vaccine function had no noticeable effect on mortality”. This can be understood in a general sense: vaccination does not decrease mortality. Please reformulate to convey the sense of comparison….

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Nov 17;16(11):e0259700. doi: 10.1371/journal.pone.0259700.r002

Author response to Decision Letter 0


14 Oct 2021

Please see the attached Word document, which distinguishes reviewer comments and our response and edits by color.

Here, the plain txt version:

Reviewer #1: In the present paper, the authors present their study about evaluating the Vaccine allocation strategy implemented by the Centers for Disease Control (CDC) in the US. This subject is of great importance in present times since the vaccine administration has started worldwide. Therefore, it is crucial to have instruments to monitor the vaccination campaign.

The study design and methodology are well structured and clearly explained. The results and conclusions are well presented and thoroughly discussed. Therefore, the present study may be of great help in optimising the vaccination strategy in different countries.

The description of the compartmental model and the calibration procedure is very precise, and the discussion of the parameters is exhaustive. Overall, the paper is well written and well organised.

My only concern is relative to the code availability; no Python code is available at

the address https://github.com/ckadelka/COVID19-CDC-allocation-evaluation reported in the text.

Therefore, the decision is to accept the paper in the present form only after the python source codes are available.

We thank the reviewer for their positive assessment of our work. At the same time, we apologize for the oversight on our end. We simply forgot to upload the Python code to the GitHub repository, https://github.com/ckadelka/COVID19-CDC-allocation-evaluation. It is now uploaded.

Reviewer #2: Using mathematical modeling, this manuscript analyzes if the strategy of vaccine allocation followed in the United States was suitable in terms of certain objective functions such as minimizing the number of deaths and the number of cases. The authors find that such strategy was not precisely optimum but performed similarly to the optimum strategies (for each objective function).

In general, the manuscript is very well written, complete, and relevant. I am convinced that the translation of this model to other scenarios (for example other epidemic episodes ad regions) can be extremely helpful to guide public health policy in vaccination matters.

As any modelling exercise, the authors are forced to propose simplifications and state uncorroborated assumptions to arrive to solutions. This is perfectly understandable. To me, the assumptions of the model seem appropriate.

In sum, I find this paper truly interesting and well executed. Congratulations.

We also thank this reviewer for their positive assessment of our study. Below, we describe how we addressed the particular recommendations.

Some recommendations follow:

(a) To me, the clinical and epidemiological information presented in table 1 (i.e., info relevant to set the values of the model parameters) should be presented within the main text.

We followed the reviewer’s recommendation and moved the table with the model parameters into the main text (what used to be S1 Table is now Table 1).

(b) Similarly, I recommend moving the scheme in S1 Figure to the main text.

Again, we followed the reviewer’s recommendation and moved S1 Figure to the main text (what used to be S1 Figure is now Figure 1).

(c) Line 105: “If solely incidence is minimized irrespective of YLL and mortality, then this group 105 should be vaccinated before older individuals with comparably fewer contacts”. Please clarify/elaborate.

We clarified the sentence by (i) explicitly stating that minimizing incidence is the same as minimizing cases, and (ii) explicitly referencing the specific sub-populations in Table 1 (now Table 2) that are compared here: sub-population 8, which falls into phase 3 when minimizing cases/incidence and sub-populations 12-17, which fall into phase 4. The adapted sentence now reads:

If solely incidence (i.e., cases) is minimized irrespective of YLL and mortality, then this group (sub-population 8 in Table 2) should be vaccinated before older individuals with comparably fewer contacts (sub-populations 12-17).

(d) Line 118: “Interestingly however, if vaccination does not reduce virus spread (fV = 1) other than through a reduction of infections, prioritization of elderly people becomes 119 less important as the vaccine does not act as a barrier to infection among the elderly”…. This statement unclear to me. Please elaborate and discuss….

We thank the reviewer for pointing this out. We have clarified this finding with additional explanatory sentence as follows:

Interestingly however, if vaccination does not reduce virus spread (fV = 1) other than through a reduction of infections, prioritization of elderly people becomes less important as the vaccine does not act as a barrier to infection among the elderly. This is evident from S3 Table when comparing the phase assignment of individuals 65 and older in the scenarios f_V=0 and f_V=1: In the latter scenario, several elderly sub-populations get vaccinated later when minimizing either deaths or cases.

(e) Line 146: The following statement can be misleading: “The higher the relative contagiousness of vaccinated individuals, the higher was the influence of vaccine function on mortality; if vaccinated individuals did not cause any new infections, vaccine function had no noticeable effect on mortality”. This can be understood in a general sense: vaccination does not decrease mortality. Please reformulate to convey the sense of comparison….

We agree with the reviewer: the statement may be misleading, especially when read by a non-expert who may not understand the comparison conducted here. We rewrote the statement (and also slightly adapted the previous sentence) as follows:

Deaths under the CDC allocation were highest in scenarios where vaccinated individuals were relatively more contagious and when a vaccine was less effective at preventing infections and more effective at reducing symptoms (Fig. 4B). In scenarios with a higher relative contagiousness of vaccinated individuals, vaccine function had a stronger influence on mortality. However, if vaccinated individuals were assumed to not cause any new infections, mortality was similar no matter if the vaccine solely prevented infections ($\\sigma=90\\%, \\delta=0\\%$) or solely prevented symptomatic infections among vaccinated infected individuals ($\\sigma=0\\%, \\delta=90\\%$).

Attachment

Submitted filename: Response to reviewers_PLOSONE.docx

Decision Letter 1

Martial L Ndeffo Mbah

25 Oct 2021

Evaluation of the United States COVID-19 Vaccine Allocation Strategy

PONE-D-21-26548R1

Dear Dr. Kadelka,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Martial L Ndeffo Mbah, Ph.D

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have properly addressed all the requests, therefore I suggest to publish the manuscript in the present form.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Acceptance letter

Martial L Ndeffo Mbah

27 Oct 2021

PONE-D-21-26548R1

Evaluation of the United States COVID-19 Vaccine Allocation Strategy

Dear Dr. Kadelka:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Martial L Ndeffo Mbah

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Age-dependent probability of symptomatic infection.

    The probability of symptomatic infection is shown for the different age groups (x-axis) and different scenarios (colors). The average probability of symptomatic infection is 70% in each scenario. This probability increases linearly with year of age up to a fixed value of 70% (blue x), 85% (orange circles; default), 100% (green diamonds) for the age group 75+.

    (TIF)

    S2 Fig. Multi-step generation of the contact matrix.

    (A) The original 4 × 4 U.S. age-age contact matrix inferred from survey data [20, 21] was transformed, using (B) U.S. census data, into (C) a symmetric 4 × 4 contact matrix [45]. Using (D) information on the number of individuals within each of the 17 sub-populations used in this study (characteristics defined in Table 2), the symmetric 4 × 4 contact matrix was expanded into (E) a 17 × 17 contact matrix. Some jobs require more physical contact than others. Inclusion of the average contact rates per job type yielded (F) an adapted contact matrix. Similarly, elderly individuals in congested living conditions have more contacts than their peers and all these increased contacts were assumed to occur within the congested living environment, which yielded (G) the final contact matrix used in this study.

    (TIF)

    S3 Fig. Case-dependent contact reduction.

    A variable contact reduction (Hill function) accounts for changes in the population-wide activity level based on the severity (i.e., the number of active cases) of the epidemic in the United States. The shape of the case-dependent contact reduction used in the base model (black line) is shown along with the shapes of the most extreme parameter choices allowed in the genetic algorithm (dashed lines).

    (TIF)

    S4 Fig. Speed of the vaccine roll-out.

    In the model, the number of newly fully vaccinated individuals each day is set to 50% of the 7-day average of the total number of administered doses (black line). Colored lines show predictions of the future speed of the vaccine roll-out for different levels of vaccine hesitancy.

    (TIF)

    S5 Fig. Time-varying infectivity of the circulating virus strains.

    (A) Prevalence of several variants of concern based on > 40, 000 sequences collected through CDC’s national genomic surveillance since Dec 20, 2020 and grouped in 2-week intervals [42]. (B) For the midpoint of each two-week interval, the relative infectivity of circulating virus strains based on a 50% increased infectivity for B.1.1.7 and B.1.351 and 20% increased infectivity for B.1.427 and B.1.429 is shown (orange circles). A fitted logistic equation with asymptotes at 100% and 150% projects the future relative infectivity (blue line).

    (TIF)

    S6 Fig. Model fit.

    The observed (dashed line) and model-predicted (solid line) cumulative deaths (A) and cases (B) are shown. The model parameters used are described in Table 1 and in the first row of S1 Table.

    (TIF)

    S7 Fig. Death and case count for all vaccine allocation strategies.

    The death and case count of all 17.5 million evaluated meaningful vaccine allocation strategies fall within the dotted region. For strategies on the Pareto frontier (solid line), there exists no other strategy that performs better in one objective (minimizing deaths or cases) while not performing worse in the other objective. The death and case counts resulting from six specific allocations are highlighted.

    (TIF)

    S8 Fig. Pareto frontiers when fixing one sub-population’s priority phase.

    Each subpanel shows four Pareto frontiers. For each frontier, one sub-population’s priority phase is fixed (see Table 2 for group characteristics). For strategies on the Pareto frontier, there exists no other strategy that performs better in one objective (minimizing deaths or cases) while not performing worse in the other objective.

    (TIF)

    S1 Table. Parameters associated with the best fits for the different scenarios.

    For each scenario (described by the parameters in the three most left columns), 100 separate elitist genetic algorithms were performed and the parameters associated with the best fit are shown, in addition to the value of the cost function (wSSE) that the algorithm minimized.

    (TIF)

    S2 Table. Allocation strategies that outperform the CDC allocation in all three objectives.

    This table shows the CDC allocation (first row) and all allocation strategies on the three-dimensional Pareto frontier that lead to fewer deaths, cases and YLL at the same time (bottom 28 rows). Sub-populations 1–17 are defined as in Table 2; sub-populations with comorbidities are highlighted in yellow.

    (TIF)

    S3 Table. Comparison of CDC and optimal allocation strategies for seven scenarios.

    For each sub-population (characteristics and population sizes defined in the left columns) and seven combinations of unknown disease parameters (q75+, the proportion of symptomatic infections among individuals 75 and older; fA, the relative contagiousness of asymptomatic infected individuals; fV, the relative contagiousness of vaccinated infected individuals), the priority phase corresponding to the optimal allocation strategy is shown. At the bottom, predicted outcomes (deaths, YLL and cases) resulting from the CDC allocation and the respective optimal allocation strategy are compared.

    (TIF)

    S4 Table. Variation of optimal allocation strategies with vaccine function.

    For different types of vaccines with 90% effectiveness (specified by σ vs δ), the optimal vaccine allocation strategies with respect to three objectives (top row) are shown. Sub-populations 1–17 are defined as in Table 2.

    (TIF)

    Attachment

    Submitted filename: Response to reviewers_PLOSONE.docx

    Data Availability Statement

    Data and all relevant code is available at GitHub: https://github.com/ckadelka/COVID19-CDC-allocation-evaluation.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES