Skip to main content
Vaccines logoLink to Vaccines
. 2021 May 14;9(5):506. doi: 10.3390/vaccines9050506

Strategies for Vaccine Prioritization and Mass Dispensing

Eva K Lee 1,*, Zhuonan L Li 1, Yifan K Liu 1, James LeDuc 2
Editor: Ju-Young Shin
PMCID: PMC8157047  PMID: 34068985

Abstract

We propose a system that helps decision makers during a pandemic find, in real time, the mass vaccination strategies that best utilize limited medical resources to achieve fast containments and population protection. Our general-purpose framework integrates into a single computational platform a multi-purpose compartmental disease propagation model, a human behavior network, a resource logistics model, and a stochastic queueing model for vaccination operations. We apply the modeling framework to the current COVID-19 pandemic and derive an optimal trigger for switching from a prioritized vaccination strategy to a non-prioritized strategy so as to minimize the overall attack rate and mortality rate. When vaccine supply is limited, such a mixed vaccination strategy is broadly effective. Our analysis suggests that delays in vaccine supply and inefficiencies in vaccination delivery can substantially impede the containment effort. Employing an optimal mixed strategy can significantly reduce the attack and mortality rates. The more infectious the virus, the earlier it helps to open the vaccine to the public. As vaccine efficacy decreases, the attack and mortality rates rapidly increase by multiples; this highlights the importance of early vaccination to reduce spreading as quickly as possible to lower the chances for further mutations to evolve and to reduce the excessive healthcare burden. To maximize the protective effect of available vaccines, of equal importance are determining the optimal mixed strategy and implementing effective on-the-ground dispensing. The optimal mixed strategy is quite robust against variations in model parameters and can be implemented readily in practice. Studies with our holistic modeling framework strongly support the urgent need for early vaccination in combating the COVID-19 pandemic. Our framework permits rapid custom modeling in practice. Additionally, it is generalizable for different types of infectious disease outbreaks, whereby a user may determine for a given type the effects of different interventions including the optimal switch trigger.

Keywords: vaccine prioritization, mixed vaccination strategy, switch trigger, mass vaccination, vaccine efficacy, biological-behavior-logistics-queueing computational framework

1. Introduction

Vaccination is one of the cornerstones in controlling infectious disease outbreaks, reducing mortality, and protecting population health [1,2]. However, the development and manufacturing of vaccines usually take months to years, and vaccine shortages during epidemic outbreaks are not uncommon [3,4,5]. While the U.S. government’s Operation Warp Speed program set an unprecedented landmark in the rapid development of highly viable vaccines against SARS-CoV-2, the virus that causes COVID-19, the manufacturing cycle and supply-chain limitations prevent rapid production at the scale needed to protect the global population in a timely manner. Similarly, the 2017 yellow fever outbreaks in Brazil and multiple African countries brought to light the insufficiency of vaccine supply [6,7], and exposed the intrinsic difficulty in controlling an outbreak without an adequate supply of vaccines. Even if vaccine supplies are available, planning and stockpiling vaccines for an entire nation is financially daunting and logistically complicated [8]. Resource-limited and inadequate supply chain systems in some developing countries further impede the distribution of vaccines [9]. Because of limited vaccine supply, the effect of reduced and diluted dosage has been studied [10,11,12], aiming to cover a larger population with an existing vaccine supply. Clinically, individual-level vaccine immunogenicity prediction using system biology and machine learning helps to personalize and target vaccine delivery only to those who benefit from it, thus avoiding potential adverse effects and preventing waste [13,14,15,16].

In addition to the effort to best utilize vaccines at individual-level, systematic prioritized vaccination is widely considered one of the best strategies to contain a pandemic [17,18]. Normally, healthcare workers [19], children, pregnant women, and individuals with special medical conditions will be classified as the high-risk groups and be the first to receive the vaccines. Proper definition of high-risk groups who should receive vaccines first has been extensively investigated [20,21]. Since searching for an optimal prioritized strategy for a general definition of risk groups under practical constraints can be computationally difficult, some studies solved a relaxation problem by assuming adequate vaccine supply [22] or prioritizing a relatively simply-structured risk group [23]. Other works on prioritized vaccination strategy include fusing the spatial information with demographic data [24], minimizing the years of life lost [25], and optimizing multiple evaluation metrics [26].

Wallinga et al. studied the optimal allocation of medical resources with limited data by targeting intervention measures at the group with the highest risk of infection per individual [27]. Mylius et al. studied the vaccination strategy under different supply scenarios of influenza vaccines and suggested prioritizing individuals with high-risk of complications [28]. Longini et al. studied the optimal vaccine distribution pattern based on different strains of virus, availability of vaccines, and structure of objective function [29]. Patel et al. used stochastic epidemic simulations and meta-heuristics to find the optimal vaccine distributions [30]. Computer simulation is also used to compare different prioritization strategies and definitions of risk groups to assist decision-making, as discussed in Lee et al. [31,32]. While most studies assume the supply of vaccines is instant, Meyers et al. optimized the allocation of vaccines when there is a delay in vaccine supply [33]. In practice, most public health departments in the U.S. use a mixed strategy approach by prioritizing the vaccines to cover the high-risk population initially, and switch to the general public at a later time. Lee et al. proposed a compartmental-based model to determine the optimal switch trigger between prioritized and non-prioritized strategies [34] and solved the problem of determining the switch point via numerical optimization.

In this study, we focus on a mixed vaccination strategy to mitigate the current COVID-19 pandemic. Since the first four cases reported in Wuhan on 29 December 2019, the COVID-19 pandemic has spread to 191 countries, infecting over 106.6 million people, and causing over 2.33 million deaths (9 February 2021). With the emergence of more contagious variants from United Kingdom, Brazil, South Africa, and Denmark, public health officials are racing against the clock to vaccinate as many people as possible. Several analyses on vaccine allocation based on risk, equity and age distribution have been proposed. The National Academies analyzed the framework for equitable allocation [35]. Some models partition the population according to age-groups [36], while others incorporate demographic information, and risk factors [37,38]. Although serological tests have been used as surrogates to determine the degree of exposure to the SARS-CoV-2 virus in a population, most of these tests do not measure the neutralizing antibodies, thus some seropositive individuals may remain susceptible to COVID-19 and could require protection via vaccination.

We develop a general-purpose modeling framework that incorporates disease spread with interventions to analyze the effect of mass vaccination on disease containment. A unique feature in our model is that the vaccination operations inside the dispensing clinics or point-of-dispensing sites (POD) are explicitly modeled. Similar to our work on human influenza [34], mass vaccination strategy is optimized using the RealOpt system [39,40,41]. We employed numerical optimization to determine an optimal switch trigger that transitions from a prioritized to a non-prioritized strategy that minimizes overall attack and mortality rates. We investigated the results under different vaccine supply levels and severity of the outbreak, as represented by the basic reproduction number and the initial infectious population. We used an agent-based simulation-optimization system within RealOpt (Center for Operations Research in Medicine and Healthcare, Atlanta, GA, USA) to validate our model results. We then performed sensitivity analyses and examined the robustness of the optimized mixed strategy.

Our analysis across hundreds of cities/counties reveals that employing an optimal mixed strategy can significantly reduce the attack and mortality rates, on average by 3-fold and 2.8-fold respectively, when compared to the full prioritized vaccination strategy. The findings suggest that delays in vaccine supply and inefficiencies in vaccination delivery can substantially impede the containment effort. A 3-week delay increases the total infection and mortality by nearly 3-fold on average and lengthens the containment period by 90%. The more infectious the virus, the earlier it helps to open the vaccine to the public. As vaccine efficacy decreases, the attack and mortality rates rapidly increase; this highlights the importance of early vaccination to reduce spreading as quickly as possible to lower the chances for further mutations to evolve and to reduce the excessive healthcare burden. To maximize the protective effect of available vaccines, of equal importance are determining the optimal mixed strategy and implementing effective on-the-ground dispensing. The optimal mixed strategy is quite robust against variations in model parameters and can be implemented readily in practice. Studies with our holistic modeling framework strongly support the urgent need for early vaccination in combating the COVID-19 pandemic.

The modeling framework not only applies to mitigating the current COVID-19 outbreaks, but can also be readily tailored to a specific infectious disease using the appropriate compartmental disease model. The system is attractive in practice since it can assist the decision-making process in real-time to achieve the maximum population protection. Public health responders and decision makers can input multiple model parameters with respect to the biological characteristics of the disease, vaccine supply, demographic information, health risk and other factors, and implement the resulting optimal switch trigger to facilitate vaccine dispensing in emergencies to minimize the overall infections and mortalities.

2. Materials and Methods

To study the transmission of COVID-19 in the population, we develop a baseline disease model with 8 compartments: (S) usceptible, (E) xposed, (P) Infectious, (A) symptomatic, (I) symptomatic, (Q) Recovered but still infectious, (R) ecovered, (D) eceased [42]. In addition to the transition of compartments due to disease propagation and new infections, the vaccination process is also modeled in detail to reflect the importance of vaccination in containing the COVID-19 outbreaks. Two more compartments are also added: Hospitalization: individuals with symptoms of COVID-19 (positive molecular test) and are seriously ill will be properly treated and quarantined, and Vaccinated and immune: individuals who receive vaccines and develop immunity. We separate the population into two environments: (a) intra-POD: those who are currently at point-of-dispensing sites (POD) to receive COVID-19 vaccine and (b) outer-POD: the outside general public. This classification is intuitive and effective since individuals in these two environments have different contact rates.

At the POD, besides the potential natural propagation of COVID-19 by undetected infectious individuals, the layout of the facility and its operations efficiency in triage, vaccination and management of crowds also play a critical role in mitigating intra-facility disease transmission. A typical POD consists of at least three stations: at the triage/screening station providers determine if an individual is suitable to receive vaccine. At the medical counseling station providers advise individuals who may have already been infected about self-quarantining or seeking medical treatment, and answer questions and address concerns regarding the vaccine. At the vaccination station providers administer the vaccines. Upon vaccination, individuals will be observed for a period of 15–30 min to ensure they do not experience acute adverse reactions from the vaccine [43].

The operations inside the PODs are modeled as time-variant parameters in the disease propagation schema in Figure 1. Figure 2a shows a POD setup specifically for COVID-19 vaccine dispensing. Figure 2b illustrates the disease dynamics of people and their interplay within and between stations at a dispensing site.

Figure 1.

Figure 1

The stage transition diagram of our COVID-19 model. Solid lines are transitions associated with new infections and disease propagation. Dashed lines are transitions associated with vaccination and treatment.

Figure 2.

Figure 2

(a) A process flowchart of the COVID-19 point-of-dispensing (POD) operations. The service time at each station is fitted with real-life time-motion studies from multiple vaccination events. (b) Disease stages of individuals within each station of the POD, their interplay and progression dynamics. A susceptible individual at a station may become exposed and move to “Exposed” disease stage in the next station. False negative (FN) individuals may have recovered from COVID-19; or a newly FN individual can become infectious at some point inside the POD. Recovered individuals can be recovered with immunity (RI) or recovered without immunity (R).

Although online/phone scheduling and “screening” is performed to ensure only those eligible are scheduled for vaccination, individuals at various stages—susceptible, exposed, pre-symptomatic infectious, and asymptomatic—may arrive at the POD (Figure 3, first column light blue arrows). We assume that only the susceptible and exposed individuals may develop immunity after vaccination according to an estimated vaccine efficacy probability (Figure 3, deep green arrows). Figure 3 shows some individuals may become exposed to the disease during the vaccination process (red dashed arrow). Once vaccinated, it typically takes a few weeks after vaccination for the body to build protection (immunity) against the virus that causes COVID-19. That means it is possible a person could still get COVID-19 just after vaccination (the light-blue disease progression). Some vaccinated people may develop only partial immunity and may contract disease still, although mostly with only mild or no symptoms at all (dark blue disease progression). A small percentage may fail to develop immunity.

Figure 3.

Figure 3

Immunity and disease stages of individuals upon vaccination. Individuals may become exposed to the disease during the vaccination process (red arrow). Once vaccinated, it typically takes a few weeks for the body to establish immunity against the virus. A person could still get COVID-19 just after vaccination (the light-blue disease progression). Some vaccinated people may develop only partial immunity and may contract disease still, although mostly with only mild or no symptoms at all (dark blue disease progression). A small percentage may fail to develop immunity.

The general-purpose modeling framework and the systems of ordinary differential equations (ODEs) and their application to COVID-19 are briefly described in the Appendix A.

To demonstrate the importance of prioritizing vaccination, we partition the population into groups based on age, service, and health-risk: “healthy individuals”, “healthcare workers”, “elderly 65 years-old or above”, and “patients under 65 with high-risk health conditions.” The latter three groups are categorized as high-risk. Healthcare workers have higher contact rates to infections (41% to 63%) [44,45]. Elderly 75-year-old or above [46,47], and patients with associated health conditions are more vulnerable to infection and mortality [48]. The Centers for Disease Control and Prevention estimate that over 85% of older adults (65+ years old) have at least one chronic disease [49]. We will use the risk group model with these groups to discuss the prioritization of vaccines. There is currently no approved vaccine formula for those under 16 years-old, though Moderna’s mRNA-1273 clinical trials for 12- to 17-year-olds started in late December 2020 in the United States [50], and United Kingdom is planning for a clinical trial of Oxford-AstraZeneca coronavirus vaccine AZD1222, for pediatric ages 6–17 [51].

To realistically reflect the logistics in emergency response, we assume that the arrival rate at the PODs is a time-variant parameter instead of uniform throughout the duration of the disease outbreak. Let λ denote the basic pooled arrival rate of individuals, i.e., it is the arrival rate at the beginning of the vaccination process when non-prioritized policy is used. If prioritized policy is used, all the arrivals are from the high-risk group, with population adjusted arrival rate λ(t)=λN0(t)N where N is the total population of high-risk group, and N0(t). is the high-risk population at time t who have not yet visited the vaccination facility. As vaccination progresses, the arrival rate at the PODs will gradually decrease as more individuals are vaccinated or treated. When vaccines are open to the public (non-prioritized policy), the arrival rate will be expressed as λ(t)=λN0(t)N. where N and N0(t) are the initial population and the population who have not yet visited POD from both the high-risk and normal groups. The basic arrival rate λ is inferred from our previous mass vaccination time-motion studies [39,52], and the composition of population is obtained using demographic statistics. Based on the expression of the arrival rate, there will be an increase in the arrival rate upon the switching, since the high-risk population is significantly smaller compared to the normal healthy adult group.

A mixed strategy is a vaccination approach that first prioritizes the vaccines to cover the high-risk population, and switches to the general public at a later time. The switch trigger (associated with a mixed strategy), g, is expressed as the percentage of vaccine given to the high-risk population before vaccination is opened to the general population. Let π be the percentage of high-risk population, and c denote the vaccine inventory. When the switch occurs, gc/π of the high-risk population are vaccinated. When g=0, the corresponding strategy is full nonprioritized, i.e., vaccines are administrated to everyone with no special priority given to the high-risk groups. When g=min{πc, 1} the associated strategy is full prioritized where all vaccines are distributed first to high-risk groups.

We use the overall attack rate and mortality rate as evaluation metrics. Overall attack rate measures the cumulative percentage of population infected with COVID-19 during the course of the outbreak. We seek an optimal switch trigger g. for a mixed strategy that minimizes the overall attack and mortality rates by the end of the outbreak, with the constraint on availability of vaccine inventory. In our analysis, we contrast continuous vaccine supply levels versus batch arrival. Our earlier study showed that the overall protective effect of batched vaccine supply is far inferior due to the delay in vaccine supply and/or in dispensing, rendering a higher overall infectivity and mortality [34]. The two objectives, attack and mortality rates, are derived from the output of the ODE systems, and are controlled by the switch trigger g. Therefore, to obtain an optimal g, we construct multiple ODE systems by varying the value of g and run the system until it reaches an equilibrium; a line search algorithm is then applied to find an optimal solution that minimizes the attack and mortality rates. Due to the complexity and the nonlinearity of the ODE systems, each instance of switch trigger optimization requires about 6000 CPU minutes to solve. We develop a fast heuristic algorithm that returns near optimal solutions within 800 CPU seconds.

In addition to assigning each risk group its own disease compartments, the modeling framework is highly flexible and can be extended in multiple ways. Specifically, it can incorporate any types of interventions and resource requirements and analyze the overall effectiveness and tradeoffs. It can accept various POD layout configurations and any characteristics and structure of disease propagation. To optimize POD vaccine distribution operations, we leverage the computational capability and features of RealOpt-POD, a large-scale modeling and optimization decision-support system for public health emergency response developed at the Centers for Disease Control and Prevention [39,40,41,53]. We also use the agent-based simulation module in RealOpt to trace the behavior and disease status of each individual inside the PODs. This allows comparison and validation of results obtained for this new vaccination allocation-distribution system.

3. Results

We analyze COVID-19 vaccine prioritization for the Greater Houston metropolitan area with 7.0 million population, among which 16.6% are high-risk (5.4% healthcare workers, 10.2% 65+ years-old, and 1.0% patients under 65 with high-risk health conditions) [54,55]. A total of 2.8% are immune from previous infection [56]. Seventy-five PODs are set up across the city to vaccinate the citizens efficiently. Two doses will be administered per individual, given 21–30 days apart. The efficacy is estimated to be 70–95% [57]. Since it takes so long to induce immunity (Pfizer: 21 days + 7 to 14 days), protective measures including use of facemasks, social distancing, strategic testing, isolation, and quarantine continue during the periods when vaccines are dispensed. At the time of our analysis, the estimated basic reproduction number in Houston is R0=1.2 with 0.5% active infectious population [58].

3.1. Vaccine Level Versus Switch Trigger

We first report the optimal switch triggers for a mixed vaccination strategy under five vaccine supply scenarios: 10%, 20%, 30%, 40% and 50% population coverage with no supply interruption. Figure 4a contrasts the results of the overall attack rate and mortality rate against high-risk group coverage. The optimal switch triggers, g*, and the associated high-risk group population coverage under each supply scenario, are marked. Observe that when the vaccine supply is greater than 10%, if all high-risk individuals are prioritized to receive vaccine first, the attack rate and mortality rate are higher than when the optimal switch trigger is used. The higher the vaccine supply level, the earlier the vaccine is optimally open to the general population. Analyzing the 50% vaccine supply (green curves), the full prioritized policy results in a 4-fold increase in infection and a 3.2-fold increase in mortality over those from the optimal switch trigger (10.54% attack rate and 0.29% mortality rate versus 2.13% and 0.069%, respectively). We remark that a 1% reduction in attack rate corresponds to 70,000 fewer infectious individuals, thus the reduction amounts to 588,700 infections and 15,470 deaths. This demonstrates the importance of adopting the optimal switch trigger mixed strategy. In addition, the curvatures around the optimal solutions for all five scenarios are rather flat (maximum), showing that the optimal switch trigger is robust, and can be readily translated into practical implementation with a large fault tolerance. During an emergency, the inventory data of vaccines, the calculation of proportions of high-risk populations, and the record of administrated vaccines may not be accurate. Thus, the robustness in our solution is critical and desirable.

Figure 4.

Figure 4

(a) Plot of overall attack rate and mortality rate (evaluated on Day 360) as a function of percentage of high-risk coverage. R0=1.2. Red, yellow, purple, blue and green curves correspond to, respectively, 10%, 20%, 30%, 40% and 50% uninterrupted vaccine supply inventory. The black curves show the batched 30% vaccine supply with delay: 10% arrived on Day 0, Day 30, and Day 60. Solid curves denote attack rates, dashed denote mortality rates. Points marked on the curves indicate the associated optimal switch trigger. (b) This graph shows the rapid increase in attack rates (solid curves) and mortality rates (dashed curves) for full prioritized strategies with respect to the optimal mixed strategies as more vaccine becomes available. It also shows that there is more urgency to open up more vaccines to the general public.

Now consider an alternative scenario where vaccine becomes available intermittently, in batches over time. Assume the batched vaccine supply arrives in an increment of 10% with 30 days apart between each shipment: Day 0, Day 30, Day 60. We can clearly observe the inferior results when vaccine arrives in batches with interruption. Although eventually 30% of vaccines are available, the resulting attack rate (black solid curve) is inferior to a 20% uninterrupted vaccine supply (yellow solid curve), underscoring the difficult competition of racing to vaccinate against the continuous disease spread. Hence timely supply and vaccination is a must.

Under the basic reproduction number of R0=1.2, the optimal mixed strategy is superior to both full nonprioritized and full prioritized strategies. The attack rates of the five scenarios under full nonprioritized policy are 36.79%, 23.82%, 11.95%, 4.84%, and 2.54% respectively; whereas the attack rates under the full prioritized policy are 29.02% for 10% vaccine supply, and converge close to 10.54% to 12.95%, when vaccine supply is above 20%. The attack rates for the optimal mixed strategy are 29.02%, 11.04%, 5.44%, 3.14%, and 2.13%, respectively.

Figure 4b shows the increase in attack rate and mortality rate with respect to the optimal mixed strategies for the full prioritized and full nonprioritized strategies as the vaccine inventory increases. We can observe that as more vaccines are available, there is little incentive to prioritize and that a large portion of the vaccine should be open to the public quickly. Even at 20% supply, we see a clear benefit in adopting the optimal switch trigger for the best population protection.

Contrasting the reduction in infection and mortality (the solid curves versus the dashed curves), for the high-risk individuals, as vaccines are open to the public, mortality reduction is less than infection reduction since high-risk individuals have higher mortality rate (navy blue curves). Likewise, mortality reduction is slightly higher than infection reduction when vaccine is dedicated to the high-risk (pink curves), since the general public has lower mortality. The optimal mixed strategy offers a tradeoff balance between the two objectives: minimizing total infection versus total deaths.

Figure 5 shows the overall infection during the COVID-19 outbreak under three vaccination strategies: optimal mixed strategy, full prioritized, and full non-prioritized, when the vaccine supply level is 30% and R0=1.2. Individual-based stochastic simulation (dotted-dashed) from RealOpt is used to verify the output of the ODE systems (solid curves). Both methods suggest the same trend: the optimal mixed strategy can significantly reduce the attack rate and mortality throughout the outbreak and leads to timely disease containment. Focusing on the 30% non-interrupting supply (Figure 5a), with full prioritized strategy (pink curve), the attack rate at containment is 11.51%, and the outbreak starts to contain at around Day 256. The optimal mixed strategy (purple curve) achieves an overall attack rate of 5.44% with time of containment at Day 185, a 27% timeline improvement and 111% infection reduction compared to the full prioritized strategy. Note that the optimal mixed strategy from the batched supply (black curve) results in an attack rate of 10.45% at containment, a 92% increase over the non-interrupted supply (Figure 5b).

Figure 5.

Figure 5

The two figures show overall infection under three vaccination strategies—optimal mixed strategy, full prioritized, and full non-prioritized—when the vaccine supply level is 30%, R0 = 1.2, and initial infection is 0.5%. The solid curves are results from the ODE-based system and the dotted-dashed curves are results from RealOpt agent-based simulation. (a) Results from non-interrupting supply. (b) Results from batched supply. Note the optimal mixed strategy from the batched supply (b. black curves) results in 92% increase in attack rate over the non-interrupted supply (a. purple curves).

These figures show the best possible overall infection outcome based on various vaccination strategies. Under the optimal mixed strategy, we can see a clear march to a plateau on the attack rate within 3 to 4 months, while it takes 5–7 months under the other two strategies. We caution that infection surges could occur due to variants and other external human and social factors including gatherings during holidays and major life events [56,59].

3.2. Delay in Supply and Vaccination, and Dispensing Operations

Figure 6 depicts the effect of delay in supply of vaccines or vaccination. Looking at the 30% vaccine supply curves (purple), when there is no delay (solid purple curve), the peak of the daily disease prevalence occurs at Day 22 with 0.579% maximum and starts to reduce afterward. When the vaccine supply or vaccination is delayed by 3 weeks (dotted purple curve), the number of infectious individuals reaches a peak by Day 42 with a maximum prevalence of 1.435%. The longer the delay, the later the peak appears since the spread of disease is not effectively controlled before the arrival of vaccines and the administering of the vaccine, and thus the infectious population keeps growing. Besides the longer time needed to achieve containment, the delay also significantly increases the cumulative infections and deaths. This underscores the importance of both the vaccine availability and the ability to administer them without delay to ensure effective disease containment.

Figure 6.

Figure 6

In this figure we show daily prevalence of COVID-19, resulting from various vaccine supply levels when vaccination begins on time, or with delays of one week, two weeks, and three weeks, and is dispensed according to the associated optimal mixed strategy. Here, R0 = 1.2 and the initial infected population is 0.5%. The x-axis represents the number of days since vaccination began. The colors correspond to the vaccine levels, the line types correspond to the delay timeline.

We observe that infections continue to rise for a while after the first vaccination. Depending on the vaccination effort, the time before reduction begins ranges from 28 days to 70 days. This latency phenomenon partially reflects the time required for immunity to kick in, and the real-life compliance of masking and social distancing. Vaccinated individuals may feel protected and become lax in compliance. Our findings appear to reflect the on-the-ground real situation well [56,59]. We note that Texas had a state mask mandate in place between the period 3 July 2020 to 10 March 2021, during which compliance rates hovered between 80% to 90%.

To quantify the impact of delay of initial vaccine supply in containing the outbreak, we contrast the overall attack rate and mortality rate versus the vaccine supply level under a time delay of 1 to 3 weeks. Figure 7 shows a clear setback in containment across all levels due to delay. A delay of one week increases the attack rates by 2.0% to as much as 58.0% for vaccine supply levels ranging from 10% to 50%. Likewise, mortality rates increase by 2.5% to as much as 62.2%. Three weeks delay seriously dampens the response effort with both the attack rate and mortality rate increasing by over 200% for vaccine levels greater than 20%. Our analysis again underscores the importance of early vaccine availability and the need to vaccinate without any delay. The results also drill into the necessity of vaccine supply without interruption and the precious time loss to disease spread. Although the batched supply has a total of 30%, the overall impact is far inferior due to its interrupted arrival schedule.

Figure 7.

Figure 7

In this figure we contrast the overall attack rate and mortality rate (Day 0 to Day 180) associated with six different vaccine supply/delay scenarios, all operating under the optimal switch triggers. The solid lines denote attack rate, and the dashed lines denote the mortality rate. R0 = 1.2, initial infection is 0.5%. Note the diminished effect of the batched supply (black).

Figure 8 shows the attack and mortality rates at containment under the optimal mixed vaccination strategies against dispensing efficiency at the vaccine clinics. When the throughput efficiency is higher than 60%, the impact on effective outbreak control is negligible. However, the attack rate and mortality rate increase significantly when the dispensing efficiency drops below 40%. Therefore, maintaining a high dispensing efficiency at all vaccine clinics is crucial and essential in accelerating disease containment. With available vaccines, POD managers must optimally allocate resources to achieve maximal throughput possible to ensure timely disease containment.

Figure 8.

Figure 8

In this figure we compare the overall attack and mortality rates under the optimal switch triggers against different dispensing throughput efficiency levels at the vaccine clinics. R0 = 1.2, initial infection is 0.5%. Solid curves denote attack rates; dotted curves denote mortality rates.

Individuals visiting the vaccine clinics or PODs may be pre-symptomatic infectious or asymptomatic, and hence may facilitate disease spread. Therefore, proper contact-tracing and screening should be carried out, and social distancing should be observed, as large crowds at vaccine clinics and PODs increase risks of infection.

3.3. Severity of the Pandemic and Initial Prevalence

Table 1 contrasts the optimal switch trigger for mixed strategy under different combinations of vaccine supply level and basic reproduction number R0. When R0 increases, the optimal switch trigger for all supply levels drops, indicating an earlier switch to the nonprioritized strategy. This observation is intuitive since the more severe the pandemic is, the earlier the strategy protects all populations instead of only the high-risk population. This is because a high basic reproduction number will dominate the effect of high infectivity and mortality associated with high-risk population. The results also suggest that the overall attack rate and mortality of the optimal mixed strategy is much lower compared to the other two strategies, cutting as much as half the infections throughout the COVID-19 outbreak in some cases. In addition, we observe that by using the optimal mixed strategy, the attack rate can be superior to that of non-optimal strategies with higher vaccine supply levels (for example, for all R0,  an optimal mixed strategy at 30% vaccine inventory offers better overall protection than a 40% supply full prioritized strategy). This underscores the significance of optimal control in vaccine allocation and distribution for disease containment.

Table 1.

Optimal switch trigger for mixed strategy under different vaccine supply levels and basic reproduction numbers, the associated attack rates achieved; and their comparison to the full prioritized and the full nonprioritized strategies.

R 0 Vaccine Supply Optimal Mixed Strategy % Increase in Attack Rate
Switch Trigger Attack Rate Full Prioritized Full Nonprioritized
1.2 20% 78.84% 11.05% +17.18% +115.63%
30% 48.55% 5.44% +111.49% +119.68%
40% 33.20% 3.14% +246.08% +54.17%
1.6 20% 78.48% 39.98% +11.18% +18.69%
30% 49.80% 26.89% +64.39% +29.19%
40% 35.86% 14.71% +199.31% +49.82%
2.0 20% 76.03% 56.84% +7.98% +6.46%
30% 49.09% 44.27% +38.65% +9.33%
40% 35.25% 31.38% +95.59% +14.76%

Figure 9 shows the optimal switch trigger of mixed strategy with respect to different basic reproduction number, initial percentage of infection, and the level of vaccine supply. Closer analysis shows that the optimal switch trigger drops below 100% in all combinations of R0 and initial infectious population when the vaccine supply level exceeds 12%. This conclusion can simplify the determination of optimal switch trigger in real emergencies: when the level of vaccine supply is below 12%, all should be dispensed to high-risk groups; the switch between strategies needs to be considered only when the vaccine supply exceeds this threshold. The results suggest that the performance of the optimal mixed strategy is quite robust against model parameters. This property is particularly useful in promoting and adopting the use of optimal mixed strategy: when combating various types of infectious disease outbreaks (COVID-19 or others), even if the estimates of R0 and initial infection may not be accurate, it does not have a significant impact in the optimal switch triggers.

Figure 9.

Figure 9

In this panel we show the optimal switch trigger (percentage of vaccine dispensed to the high-risk groups) against the vaccine supply levels in the optimal mixed strategy for different combinations of basic reproduction number and percentage of initial infectious population. Analyzing the values closely, we see that when the vaccine supply covers more than 12% of the entire population, not all individuals in the high-risk group need to be vaccinated before switching to non-prioritized strategy.

3.4. Vaccine Efficacy and Immunity, and Diagnostic Accuracy

The rapid design of COVID-19 mRNA vaccines offers great promise to contain the disease and allows citizens to get back to a new normal life. However, numerous uncertainties exist in the efficacy of the vaccine, duration of immunity, the level of protection in transmission reduction, and more importantly, their effectiveness against new variants. As the more contagious variants from United Kingdom [60] are raging in United Kingdom and Europe and moving rapidly through the United States, public health and infectious disease leaders are racing to investigate and understand the sustained protection offered by the vaccines. There are also other variants, including the South African, Brazilian, and Danish that are circulating around different parts of the world, including the United States [61]. While the ultimate effectiveness and risks and benefits of vaccines can only be ascertained through public health investigation, analytic investigations can shed insights into potential risks and outcomes that we should anticipate. Such information can advise the public regarding vigilance in social distancing and use of facemasks for continued protection.

Figure 10 depicts how the overall attack and mortality rates change with respect to vaccine efficacy. Currently, both mRNA vaccines offer over 90% efficacy, which results in excellent overall attack rates, ranging from 5.44%, 11.04%, to 29.02% for vaccine supplies of 30%, 20% and 10%, respectively. As the efficacy drops to 50%, we see a rapid uptake of infection, increasing from 34% for the 10% supply to over 316% for 30% vaccine supply. This underscores the urgency in developing vaccine boosters to fight against the more contagious Brazil, United Kingdom, and South Africa variants. This also showcases the vulnerability of our population and the critical importance to continue non-invasive non-pharmaceutical interventions to minimize any potential disease escalation. Rapid disease containment of the current outbreak is of paramount importance.

Figure 10.

Figure 10

In this figure we depict the overall protection of the vaccine with respect to its efficacy across different levels of vaccine supply. The rapid decreases in attack and mortality rates across all vaccine supply levels as vaccine efficacy increases underscores the importance of rapid vaccination to contain the current outbreak and the development of booster shots to safeguard the public from new variants. Solid curves denote attack rates; dotted curves denote mortality rates.

We assume the mass vaccination plan is to offer vaccine to everyone who has no prior COVID-19 infection, where prior infection is confirmed through a positive molecular RT-PCR test. RT-PCR is extremely sensitive and detects viral nucleic acid and reflects acute infection or perhaps residual RNA post-infection. Numerous studies have been conducted to gauge the accuracy of the tests, with varying false negative rates depending on the day of test with respect to timing of infection [62]. We desire to understand how diagnostic accuracy may impact the overall effectiveness of the vaccine strategies.

Figure 11 depicts the optimal switch trigger with respect to the diagnostic accuracy of false negatives and false positives ranging from 0% to 10%. False negative individuals who have had COVID-19 will still be vaccinated. While this may use up valuable vaccine resources, false negatives have only a slight impact on the number of infections and mortalities, and do not significantly change the corresponding optimal switch trigger.

Figure 11.

Figure 11

The optimal switch trigger under different diagnostic accuracy rates.

On the other hand, the optimal switch trigger increases as the diagnostic false positive rate decreases. When the false positive rate is 10% (i.e., diagnostic accuracy is 90%), the optimal triggers for the three vaccine supplies are 69.69%, 44.27%, and 41.19%, respectively, as opposed to 78.84%, 50.32%, and 48.55% when the accuracy is 100% (no false positives). Since more healthy/susceptible individuals are diagnosed as infectious and hence do not receive vaccines, fewer vaccines will be dispensed, and the time of switching to the non-prioritized strategy will be earlier.

4. Discussion

In this study, we propose a general-purpose modeling framework for infectious disease outbreaks with human interventions. We focus on the COVID-19 outbreaks scenario and study the effect of different vaccination strategies due to a limited supply of vaccine on overall attack and mortality rates. We propose the idea of an optimal switch trigger, which represents the percentage of vaccine given to the high-risk population before switching to a non-prioritized vaccination strategy. We integrate the multi-purpose compartmental disease propagation model with the human behavior network, the (hospital) resource logistics model, and the stochastic vaccine queueing model, into a single computational platform and then develop numerical optimization on that framework. To ensure realism, we use vaccination data from our previous mass vaccination time-motion studies to populate the vaccine clinic model parameters and determine human behavior within the model. Empirical results are obtained for hundreds of cities and counties in the United States. They follow a consistent pattern; and for brevity, herein we only report detailed analysis for Greater Houston. Sensitivity analyses are included to investigate the impact of various perturbations in implementing the optimal mixed vaccination strategy, including perturbations in vaccine efficacy, delay of vaccine supply, dispensing efficiency, and diagnostic accuracy.

A full prioritized vaccination strategy is one where all vaccines are distributed first to high-risk groups, whereas a full nonprioritized is one where vaccines are administrated to everyone with no special priority given to high-risk groups. A mixed strategy is a hybrid approach that first prioritizes the vaccines to cover some of the high-risk population, and switches to the general public at a later time. Our analyses suggest that the optimal mixed vaccination strategy outperforms both the full prioritized and the full non-prioritized strategies in minimizing the overall attack and mortality rates under different combinations of model parameters and availability of vaccines (Figure 4a, Table 1). When the vaccine supply is very limited, all vaccines should be dispensed to high-risk groups for best containment results. But when the vaccine supply exceeds a threshold, a switch in the dispensing strategy can be favorable and result in lower attack and mortality rates (Figure 9). This threshold hovers between 12–16% among the hundreds of cities that we have analyzed. Delay of vaccine supply or vaccinations can have a significant impact on the trend of the disease outbreak and may result in an increase in the cumulative infectious population (Figure 7); thus, early dispensing operations and availability of vaccines are crucial in containing disease outbreaks. The result of implementing the optimal mixed strategy can also be influenced by various factors, including the operational efficiency at vaccine clinics/PODs, vaccine efficacy, and diagnostic accuracy (Figure 8, Figure 10 and Figure 11).

The optimal switch trigger is robust and is achieved with a large fault tolerance, thus forgiving to the many uncertainties in inventory supply accounting, risk group assessment, and exact administered doses. Our analysis reveals that public health leaders should ensure vaccines are dispensed at high efficiency and safeguard intra-facility disease spread by means of smart POD layout design that provides short queues and wait times. Use of electronic health records (EHR), use of electronic scanning technologies [63], optimal design of POD layout, and optimal allocation of healthcare workers, are important to facilitate achieving the best containment results [39,40,41].

Given the emergence of treatment-resisting and vaccine-evading variants, such as the South African and Brazilian variants, it is desirable to reduce spreading as quickly as possible so as to lower the chances for further mutations to evolve and to reduce the excessive healthcare burden (Figure 10). Further analysis on vaccine efficacy and virus variants are underway.

The high-risk partition presented herein represents the optimal risk categories that are most impactful for rapid disease containment. Comprehensive analysis of how inclusion of different risk-groups affects the optimal switch trigger and the containment timeline will be detailed in a subsequent study.

To the best of our knowledge, this is the first general-purpose computational model designed for guiding intervention efforts to contain infectious disease outbreaks that combines biological characteristics, human behavior, hospital resources and intervention operations logistics, into a single platform (Figure 12) [64]. The framework accounts for disease progression and transmission (light blue) that vary according to the specific pathogen. At the same time, it incorporates human behavior, social and environmental influences, and risk factors (light beige) to model heterogeneous transmission dynamics on how disease spread takes hold. Interventions, pharmaceutical or non-pharmaceutical, in combination or alone, play crucial roles in containing the disease. For example, behavioral changes such as handwashing and use of facemasks can have significant positive impact in combating contagious infectious disease, and they are both human/social behavior change as well as a means of non-pharmaceutical intervention. The model was first utilized in evaluating timelines for non-pharmaceutical interventions, including school closure, business telecommuting, social distancing, and face masking in March 2020; providing recommendations to state and federal policy makers.

Figure 12.

Figure 12

The biological-behavior-intervention informatics computational framework. The solid line arrows represent the natural disease progression. The blue dotted line arrows represent paths individuals take on an intervention; it can be via behavior or social environmental changes; or due to available resources (e.g., diagnostic tests, hospital beds). The red dotted line arrows reflect pathways of patient conditions upon receiving intervention. The figure includes some example interventions and pathways.

This modeling framework accommodates populations with different risks by assigning each risk group its own disease compartments. It is noteworthy that traditional ODE models have mostly been inadequate for COVID-19, largely because what drives the rate of transmission is not only the contact rate of the most active individual spreader but the formation of groups.

The system facilitates the analysis of vaccine security, exploring vaccine benefits and risks and tradeoffs and how they manifest across different risk groups and populations. Specifically, different groups can have their own disease compartment modules, and each module can be coupled with the vaccination process flow shown in Figure 3, which can include risks and adverse effects along the pathways. The findings can have serious implications in decision making for both public health leaders and the public. In a CDC report, data shows that out of 13.7 million Americans vaccinated during December 2020 and January 2021 side effects were higher among women [65]. Specifically, “Headache (22.4%), fatigue (16.5%), and dizziness (16.5%) were the most frequently reported symptoms after vaccination with either vaccine. Sixty-two reports of anaphylaxis have been confirmed, 46 (74.2%) after receipt of the Pfizer-BioNTech vaccine and 16 (25.8%) after receipt of the Moderna vaccine.”

Investigations of vaccine adverse effects of cases of rare blood clots resulting from the AstraZeneca vaccine are ongoing by the European Medicines Agency, and Medicines and Healthcare products Regulatory Agency [66,67]. At the time of this writing, CDC and FDA have put a pause on the Johnson and Johnson vaccine.

It is critical to have a better understanding of vaccine risks and benefits. It affects mass vaccination campaigns, public confidence, and vaccine hesitancy. We are currently investigating these issues and will report our findings in a future paper.

This modeling framework is highly flexible: it is not constrained by a single type of disease or intervention method. To model different types of diseases—e.g., vector-borne diseases such as Zika, dengue and yellow fever, or food-borne diseases like cholera—decision makers only need to plug in the corresponding structure for the compartmental disease model along with estimates of parameters based on biological information and then use the modeling framework and computational engine to derive optimal interventions, such as the switch trigger for the best mixed vaccination strategy. In addition, our definition of optimal switch trigger integrates not only the property of disease propagation itself but also the vaccine supply and logistics in actual vaccine dispensing operations. Other important factors that impact the decision-making process are also highlighted in the sensitivity analysis, making the framework a practical and effective tool to use in real emergencies.

The ordinary differential equation (ODE) system, the human connectivity, and the resource and logistics queueing-based modeling framework are computationally intense already; finding the optimal switch trigger adds to the complexity. Our result suggests that the agent-based simulation model for disease propagation has good performance similar to that of the ODE-based model; but it remains computationally challenging. We develop efficient numerical strategies to improve the time needed for obtaining the optimal switch trigger for the agent-based simulation model (ABM) in RealOpt-ABM©, and we are currently integrating the efficient solver for the approximated solution of the ODE system into a general-purpose digital disease surveillance and response system, RealOpt-ASSURE©. RealOpt-ASSURE allows users to understand the disease dynamics and the effectiveness of different intervention methods, and it assists decision-makers in choosing the best combination of strategies via simulations of possible trends of disease outbreak development.

With an increasing danger of global disease outbreaks and insufficient supply or even unavailability of vaccines, it remains a challenge to determine the best way to protect more people despite limited resources. The SARS-CoV-2 virus and COVID-19 present grave challenges in determining the best public health pandemic response. In addition to analyzing vaccine immunogenicity prediction on an individual level for optimal utilization of vaccines, we tackle this problem by analyzing the strategies for allocation and dispensing. One advantage of our approach is that decision-makers only need to know an estimate of the overall vaccine efficacy to derive the optimal switch trigger. In addition, sensitivity analyses indicate that the optimal switch trigger is highly robust against multiple parameters. A near-optimal result can still be achieved and useful in practice even when accurate estimations of model parameters are not immediately available. This makes our modeling framework attractive in practice as it empowers government and public health leaders to take risk-informed rapid actions in emergencies.

Acknowledgments

The authors would like to thank Randall Robinson, Richard Gallagher, and Doug Samuelson for their comments, insights, and proofreading of the manuscript. The authors also thank the reviewers for their critiques and suggestions.

Appendix A. General-Purpose Modeling Framework for Infectious Disease Outbreaks with Intervention

We introduce a general-purpose holistic modeling framework for infectious disease outbreaks with interventions (vaccination, treatment. quarantine, and non-pharmaceutical interventions). The disease stages are categorized according to their roles and properties in the spread of infectious diseases. Utilizing this framework, we derive the mathematical expression for contact-based and vector-borne diseases. The resulting modeling framework enables derivation of any existing epidemiology models, allows generation and investigation of new ones, and analysis of impact on intervention based on mathematical expression of the basic reproduction numbers.

Let Φ denote the collection of all possible stages an individual can belong to during the course of the disease. Each disease stage can be categorized in two different ways:

Passive/Active stages. Individuals in a passive stage will not change their statuses spontaneously. On the contrary, individuals in an active stage will change their statuses spontaneously. Let ΦP and ΦA denote the collection of passive and active stages respectively. A stage will be either passive or active. Therefore, ΦPΦA = Φ Vulnerable/Contagious/Unaffected stages: Individuals are vulnerable if they can be infected by contacting infectious populations. Individuals are contagious if they can infect others who are vulnerable. Unaffected stages are those who are neither vulnerable nor contagious. Let ΦV denote the collection of vulnerable stages, ΦC the collection of contagious stages, and ΦU the unaffected stages. Note that ΦVΦCΦU=Φ.

For example, the susceptible stage is passive and vulnerable; the infectious stage is active and contagious. All stages in a natural disease progress can be described using this categorization.

We define the vector y=ϕ(t)|ϕΦ as the number of individuals in each stage at time t. Let μ=μϕ|ϕΦ denote the transition rate vector for all stages in the model. Since only the active stages have well-defined transition rates, thus μϕ=0. for all ϕΦP Similarly, let β=βϕ|ϕΦ be the vector of baseline infection rate of all vulnerable stages in the model adjusted by the total population. For ϕΦV, βϕ=0.

Let s. be a function on Φ: s(ϕ) represents the set of all successor stages of ϕ. Let matrix C=cab|aΦ, bΦ. be the disease contagious matrix, where cab=1. if aΦV and bΦC, and ckb=1. for all ks(a). if aΦV. and bΦC. Let matrix D=dab|aΦ, bΦ be the disease transition matrix, where dab is the transition probability from stage b to stage a. Then the ordinary differential equations for the compartmental model for contact-based disease without intervention can be derived as

y=(DI)diag(μ)y+diag((D+I)diag(β)y)Cy (A1)

where I is the identity matrix. (DI)diag(μ)y models the population change in different stages as the disease progresses; and diag((D+I)diag(β)y)Cy models the change in population due to new infections [68].

To model the effect of interventions, new stages are introduced to the system. The new stages can still be described using the same categorization, but they do not belong to the natural disease propagation process, and thus do not contribute to the disease transition matrix D. Therefore, dab=0 if either a or b belongs to the intervention stages. For mass vaccination in this paper, we separate the environment into two parts: intra-POD disease propagation and outer-POD disease propagation to depict the effect of PODs and vaccine clinics in disease outbreak and containment. Assume a POD has K stations, and station i is manned with ni healthcare workers, each of them provides the same service at a nominal rate λi. Then the service rate (departure rate) at station i is

hi(ϕ)=min{ni, yi1}λiϕiyi1 (A2)

where yi is the vector of population in each stage at station i. After service at certain stations, individuals can be transitioned to other stages. For example, a susceptible individual will become immune with a probability after vaccination. This transition is summarized in a stage-jump matrix Ji=jab|aΦ, bΦ, where jab is the probability of individuals transitioning from stage b to stage a at station i. We use a matrix T to summarize the output at each station:

T=[J1h1(Φ), J2h2(Φ), , JKhK(Φ)] (A3)

where the i-th column of matrix T indicates the rates of individuals from different stages leaving from station i. We note that disease stage changes could happen inside the POD, but immunity does not occur instantly. For all the available COVID-19 vaccines, it takes days to weeks before individuals will begin to develop sufficient antibodies to fight off the SARS-CoV-2 virus [69,70].

Besides transitioning between disease stages, clients move inside the PODs according to its layout and design, as shown in Figure 2a. To model the change of population because of movement, let matrix Qi=qkb|k{1,2,,K}, bΦ be the station-jump probability matrix of the POD, where qkb is the probability of clients in disease stage b moving from station k to station i. For completeness and simplicity, we use subscript 0 to represent the corresponding parameters for outer-POD disease propagation [71].

Finally, to connect the inter- and outer-POD models, let ψi be an indicator variable of whether station i is the first station to visit in the POD, and let r=rϕ|ϕΦ be the arrival rate of individuals outside the POD. Therefore, the disease system for intra-POD disease propagation is given as

yi=(DI)diag(μ)yi+diag((D+I)diag(β)yi)Cyi+ψidiag(r)y0y01+diag(TQi)1hi(Φ) (A4)

for all i, and the disease system for outer-POD disease propagation is represented by

y0=diag(r)y0y01+(DI)diag(μ)y0+diag((D+I)diag(β)y0)Cy0+diag(TQ0)1 (A5)

This modeling framework accommodates populations with different risks by assigning each risk group its own compartments. In this paper, healthcare workers have dual disease compartments–one at work, and one outside in public. Also, if the system has multiple vaccine clinics and PODs, each of them can be modeled separately with the method discussed above, and then aggregated according to the percentage of population served by each POD. For example, assume the system has M PODs, each serves pi of the entire population, where ipi=1. Then, POD i. has a rate of input approximately equal to pidiag(r)y0/y01. A detailed theoretical derivation of the modeling framework has been reported in a separate manuscript [68].

In this paper, we use the COVID-19 POD layout shown in Figure 2a with K = 3. The allocation of healthcare workers and their respective processing rate are optimized using RealOpt based on our mass vaccination time-motion study service times [39,52]. We analyze the COVID-19 outbreak in various cities and states, including Greater Houston where the total population is 7.0 million, 16.60% of which are high-risk population. A total of 75 PODs/vaccine clinics are set up. Other parameters used in the analysis are summarized in Table A1.

Table A1.

Values of parameters used in our empirical analysis.

Description Value Source
Distribution of population in different risk groups: healthy adults and children, healthcare workers, elderly 65 years-old or above, patients under 65 with high-risk health conditions. [83.4%, 5.4%, 10.2%, 1.0%] [54,55]
Basic reproduction number of COVID-19 Ranges between 1.05 to 3 Estimates based on U.S. local/regional COVID-19 data
Percentage of initial infectious population Ranges between 0.5% to 2.0% Based on current on-the-ground reporting.
Mean exposed duration 2 days (25%), 5.2 days (55%), and 12.5 days (20%) [72]
Mean pre-symptomatic infectious duration 1 days Estimate [73]
Mean symptomatic, asymptomatic durations 3 days Estimate [73]
Mean post-recovery infectious probability and duration 3 days Estimate [73]
Symptomatic probability 2/3 [44,74,75,76,77]
Mean time between showing symptoms to quarantine/hospitalization 4.5–9 days [72]
Mean hospitalization time 9.2 days [72]
Percentage of vaccine efficacy
  • Probability of full immunity

  • Probability of partial immunity

  • Probability of no immunity (behave like any susceptible individuals)

70–90%
70–90%
5–25%
5%
[69,70]
(Unvaccinated) symptomatic hospitalization rate:
June 2020-present
14–18% Estimates based on Houston data [58]
(Unvaccinated) hospitalization mortality rate:
June 2020-present
9–11% Estimates based on Houston data [58]
Risk factor of infection in different groups [1,3,3,3] Guided by mortality [44,45,46,47,48]
Initial arrival rate 15/min [39,41,52]

Author Contributions

Conceptualization, E.K.L.; methodology, E.K.L., Y.K.L.; software, E.K.L., Z.L.L.; validation, Z.L.L. and Y.K.L.; formal analysis, E.K.L., Z.L.L.; investigation, E.K.L., Z.L.L.; resources, E.K.L.; data curation, Z.L.L., J.L.; writing—original draft preparation, E.K.L., Y.K.L.; writing—review and editing, E.K.L., J.L.; visualization, E.K.L., Z.L.L., Y.K.L., J.L.; supervision, E.K.L.; funding acquisition, E.K.L. All authors have read and agreed to the published version of the manuscript.

Funding

This work is partially supported by grants from the Centers for Disease Control and Prevention, 200-2016-90873 and the National Science Foundation, IIP-1516074. Findings and conclusions in this paper are those of the authors and do not necessarily reflect the views of the Centers for Disease Control and Prevention and the National Science Foundation.

Data Availability Statement

All data used in this manuscript is obtained from public sources or from peer-reviewed literature (Table A1). COVID-19 data: New York Times Coronavirus (Covid-19) Data in the United States, https://github.com/nytimes/covid-19-data. Greater Houston data: https://houstonemergency.org/houston-covid-19-deaths/, https://www.houston.org/reopen-safely-dashboard (accessed on 17 June 2020), U.S. Census Bureau: https://www.census.gov/ U.S Bureau of Labor: https://www.bls.gov/ (accessed on 20 August 2020).

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Salk J.E. Considerations in the preparation and use of poliomyelitis virus vaccine. J. Am. Med. Assoc. 1955;158:239–1248. doi: 10.1001/jama.1955.02960140001001. [DOI] [PubMed] [Google Scholar]
  • 2.Hamborsky J., McIntyre L., Wolfe C., Atkinson W. Epidemiology and Prevention of Vaccine-Preventable Diseases. 10th ed. CDC, Department of Health and Human Services; Washington, DC, USA: 2007. Smallpox. [Google Scholar]
  • 3.Chalumeau H.P. Vaccine manufacture at the time of a pandemic influenza. Eur. J. Epidemiol. 1994;10:487–490. doi: 10.1007/BF01719684. [DOI] [PubMed] [Google Scholar]
  • 4.Ulmer J.B., Valley U., Rappuoli R. Vaccine manufacturing: Challenges and solutions. Nat. Biotech. 2006;24:1377–1383. doi: 10.1038/nbt1261. [DOI] [PubMed] [Google Scholar]
  • 5.Nathan N., Barry M., Van Herp M., Zeller H. Shortage of vaccines during a yellow fever outbreak in guinea. Lancet. 2001;358:2129–2130. doi: 10.1016/S0140-6736(01)07185-9. [DOI] [PubMed] [Google Scholar]
  • 6.Gershman M.D. Addressing a yellow fever vaccine shortage—United States, 2016–2017. Morb. Mortal. Wkly. Rep. 2017;66:457–459. doi: 10.15585/mmwr.mm6617e2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Kraemer M.U., Faria N.R., Reiner Jr R.C., Golding N., Nikolay B., Stasse S., Johansson M.A., Salje H., Faye O., Wint G.W., et al. Spread of yellow fever virus outbreak in Angola and the Democratic Republic of the Congo 2015–16: A modelling study. Lancet Infect. Dis. 2017;17:330–338. doi: 10.1016/S1473-3099(16)30513-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Schwartz B., Orenstein W.A. Prioritization of pandemic influenza vaccine: Rationale and strategy for decision making. Curr. Top. Microbiol. Immunol. 2009;333:495–507. doi: 10.1007/978-3-540-92165-3_24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Kaufmann J.R., Miller R., Cheyne J. Vaccine supply chains need to be better funded and strengthened, or lives will be at risk. Health Aff. 2011;30:1113–1121. doi: 10.1377/hlthaff.2011.0368. [DOI] [PubMed] [Google Scholar]
  • 10.Treanor J., Keitel W., Belshe R., Campbell J., Schiff G., Zangwill K., Wolff M., Klimov A., Levandowski R., Lambert L., et al. Evaluation of a single dose of half strength inactivated influenza vaccine in healthy adults. Vaccine. 2002;20:1099–1105. doi: 10.1016/S0264-410X(01)00440-6. [DOI] [PubMed] [Google Scholar]
  • 11.La Montagne J.R., Fauci A.S. Intradermal influenza vaccination—Can less be more? N. Engl. J. Med. 2004;351:2330–2332. doi: 10.1056/NEJMe048314. [DOI] [PubMed] [Google Scholar]
  • 12.Frey S.E., Newman F.K., Cruz J., Shelton W.B., Tennant J.M., Polach T., Rothman A.L., Kennedy J.S., Wolff M., Belshe R.B., et al. Dose-related effects of smallpox vaccine. N. Engl. J. Med. 2002;346:1275–1280. doi: 10.1056/NEJMoa013431. [DOI] [PubMed] [Google Scholar]
  • 13.Querec T.D., Akondy R.S., Lee E.K., Cao W., Nakaya H.I., Teuwen D., Pirani A., Gernert K., Deng J., Marzolf B., et al. Systems biology approach predicts immunogenicity of the yellow fever vaccine in humans. Nat. Immunol. 2009;10:116–125. doi: 10.1038/ni.1688. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Lee E.K., Nakaya H., Yuan F., Querec T., Pietz F., Benecke B.A., Burel G., Pulendra B. Machine learning for predicting vaccine immunogenicity. Interfaces. 2016;46:368–390. doi: 10.1287/inte.2016.0862. [DOI] [Google Scholar]
  • 15.Nakaya H.I., Hagan T., Duraisingham S.S., Lee E.K., Kwissa M., Rouphael N., Frasca D., Gersten M., Mehta A.K., Gaujoux R., et al. Systems analysis of immunity to influenza vaccination across multiple years and in diverse populations reveals shared molecular signatures. Immunity. 2015;43:1186–1198. doi: 10.1016/j.immuni.2015.11.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Kazmin D., Nakaya H.I., Lee E.K., Johnson M.J., Van Der Most R., Van Den Berg R.A., Ballou W.R., Jongert E., Wille-Reece U., Ockenhouse C., et al. Systems analysis of protective immune responses to RTS,S malaria vaccination in humans. Proc. Natl. Acad. Sci. USA. 2017;114:2425–2430. doi: 10.1073/pnas.1621489114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Meltzer M.I., Cox N.J., Fukuda K. The economic impact of pandemic influenza in the United States: Priorities for intervention. Emerg. Infect. Dis. 1999;5:659–671. doi: 10.3201/eid0505.990507. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Uscher-Pines L., Omer S.B., Barnett D.J., Burke T.A., Balicer R.D. Priority setting for pandemic influenza: An analysis of national preparedness plans. PLoS Med. 2006;3:e436. doi: 10.1371/journal.pmed.0030436. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Pearson M.L., Bridges C.B., Harper S.A. Influenza vaccination of health-care personnel. Morb. Mortal. Wkly. Rep. 2006;55:RR-2. [PubMed] [Google Scholar]
  • 20.Cosgrove S.E., Fishman N.O., Talbot T.R., Woeltje K.F., Schaffner W., Fraser V.J., McMillan J.A., Perl T.M. Strategies for use of a limited influenza vaccine supply. JAMA. 2005;293:229–232. doi: 10.1001/jama.293.2.229. [DOI] [PubMed] [Google Scholar]
  • 21.Emanuel E.J., Wertheimer A. Who should get influenza vaccine when not all can? Science. 2006;312:854–855. doi: 10.1126/science.1125347. [DOI] [PubMed] [Google Scholar]
  • 22.Tuite A.R., Fisman D.N., Kwong J.C., Greer A.L. Optimal pandemic influenza vaccine allocation strategies for the Canadian population. PLoS ONE. 2010;5:e10520. doi: 10.1371/journal.pone.0010520. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Conway J.M., Tuite A.R., Fisman D.N., Hupert N., Meza R., Davoudi B., English K., Van den Driessche P., Brauer F., Ma J., et al. Vaccination against 2009 pandemic H1N1 in a population dynamical model of vancouver, Canada: Timing is everything. BMC Public Health. 2011;11:932. doi: 10.1186/1471-2458-11-932. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Wu J.T., Riley S., Leung G.M. Spatial considerations for the allocation of pre-pandemic influenza vaccination in the United States. Proc. R. Soc. Lond. B Biol. Sci. 2007;274:2811–2817. doi: 10.1098/rspb.2007.0893. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Miller M.A., Viboud C., Olson D.R., Grais R.F., Rabaa M.A., Simonsen L. Prioritization of influenza pandemic vaccination to minimize years of life lost. J. Infect. Dis. 2008;198:305–311. doi: 10.1086/589716. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Medlock J., Galvani A.P. Optimizing influenza vaccine distribution. Science. 2009;325:1705–1708. doi: 10.1126/science.1175570. [DOI] [PubMed] [Google Scholar]
  • 27.Wallinga J., van Boven M., Lipsitch M. Optimizing infectious disease interventions during an emerging epidemic. Proc. Natl. Acad. Sci. USA. 2010;107:923–928. doi: 10.1073/pnas.0908491107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Mylius S.D., Hagenaars T.J., Lugnér A.K., Wallinga J. Optimal allocation of pandemic influenza vaccine depends on age, risk and timing. Vaccine. 2008;26:3742–3749. doi: 10.1016/j.vaccine.2008.04.043. [DOI] [PubMed] [Google Scholar]
  • 29.Longini I.M., Ackerman E., Elveback L.R. An optimization model for influenza A epidemics. Math. Biosci. 1978;38:141–157. doi: 10.1016/0025-5564(78)90023-8. [DOI] [Google Scholar]
  • 30.Patel R., Longini I.M., Halloran M.E. Finding optimal vaccination strategies for pandemic influenza using genetic algorithms. J. Infect. Dis. 2005;234:201–212. doi: 10.1016/j.jtbi.2004.11.032. [DOI] [PubMed] [Google Scholar]
  • 31.Lee B.Y., Brown S.T., Korch G.W., Cooley P.C., Zimmerman R.K., Wheaton W.D., Zimmer S.M., Grefenstette J.J., Bailey R.R., Assi T.M., et al. A computer simulation of vaccine prioritization, allocation, and rationing during the 2009 H1N1 influenza pandemic. Vaccine. 2010;28:4875–4879. doi: 10.1016/j.vaccine.2010.05.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Lee B.Y., Brown S.T., Korch G.W., Cooley P.C., Zimmerman R.K., Wheaton W.D., Zimmer S.M., Grefenstette J.J., Bailey R.R., Assi T.M., et al. A computer simulation of employee vaccination to mitigate an influenza epidemic. Am. J. Prev. Med. 2010;38:247–257. doi: 10.1016/j.amepre.2009.11.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Medlock J., Meyers L.A. Optimizing allocation for a delayed influenza vaccination campaign. PLoS Curr. 2009;1:RRN1134. doi: 10.1371/currents.RRN1134. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Lee E.K., Yuan F., Pietz F.H., Benecke B.A., Burel G. Vaccine prioritization for effective pandemic response. Interfaces. 2015;45:425–443. doi: 10.1287/inte.2015.0814. [DOI] [Google Scholar]
  • 35.Gayle H., Foege W., Brown L., Kahn B. Framework for Equitable Allocation of COVID-19 Vaccine. NASEM; Washington, DC, USA: 2020. [PubMed] [Google Scholar]
  • 36.Bubar K.M., Reinholt K., Kissler S.M., Lipsitch M., Cobey S., Grad Y.H., Larremore D.B. Model-informed COVID-19 vaccine prioritization strategies by age and serostatus. Science. 2021;371:916–921. doi: 10.1126/science.abe6959. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Buckner J.H., Chowell G., Springborn M.R. Dynamic Prioritization of COVID-19 Vaccines When Social Distancing is Limited for Essential Workers. Proc. Natl. Acad. Sci. USA. 2021;118 doi: 10.1073/pnas.2025786118. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Matrajt L., Eaton J., Leung TBrown E.R. Vaccine optimization for COVID-19, who to vaccinate first? medRxiv. 2020 doi: 10.1101/2020.08.14.20175257. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Lee E.K., Pietz F., Benecke B., Mason J., Burel G. Advancing public health and medical prepared- ness with operations research. Interfaces. 2013;43:79–98. doi: 10.1287/inte.2013.0676. [DOI] [Google Scholar]
  • 40.Lee E.K., Liu Y.F., Pietz F. A Computational Framework for a Digital Surveillance and Response Tool: Application to Avian Influenza. American Medical Informatics Society. AMIA Annu. Symp. Proc. 2017;2017:1090–1099. [PMC free article] [PubMed] [Google Scholar]
  • 41.Lee E.K., Chen C.H., Liu Y.F., Pietz F.H. Proceedings of the 2017 International Conference on Digital Health. ACM; New York, NY, USA: 2017. An Interactive Web-based Decision Support System for Mass Dispensing, Emergency Preparedness, and Biosurveillance; pp. 137–146. [Google Scholar]
  • 42.Lee E.K. Modeling and Evaluating Intervention Options and Strategies for COVID-19 Containment: Biological-Behavioral-Logistics Computation Decision Framework. IEEE; New York, NY, USA: 2020. [Google Scholar]
  • 43.Centers for Disease Control and Prevention Interim Clinical Considerations for Use of COVID-19 Vaccines Currently Authorized in the United States. [(accessed on 23 April 2021)]; Available online: https://www.cdc.gov/vaccines/covid-19/info-by-product/clinical-considerations.html.
  • 44.Bai Y., Yao L., Wei T., Tian F., Jin D.Y., Chen L., Wang M. Presumed Asymptomatic Carrier Transmission of COVID-19. JAMA. 2020;323:1406–1407. doi: 10.1001/jama.2020.2565. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Artiga S., Rae M., Pham O., Hamel L., Muñana C. COVID-19 Risks and Impacts among Health Care Workers by Race/Ethnicity. Racial Equity and Health Policy. KFF; San Francisco, CA, USA: 2020. [Google Scholar]
  • 46.South China Morning Post. [(accessed on 11 February 2020)]; Available online: https://multimedia.scmp.com/infographics/news/china/article/3047038/wuhan-virus/index.html.
  • 47.CDC Severe outcomes among patients with coronavirus disease 2019 (COVID-19)—United States, February 12–March 16, 2020. Morb. Mortal. Wkly. Rep. 2020;69:343–346. doi: 10.15585/mmwr.mm6912e2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.CDC Preliminary Estimates of the Prevalence of Selected Underlying Health Conditions Among Patients with Coronavirus Disease 2019—United States, February 12–March 28, 2020. Morb. Mortal. Wkly. Rep. 2020;69:382–386. doi: 10.15585/mmwr.mm6913e2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.CDC National Center for Health Statistics. [(accessed on 20 July 2020)]; Available online: https://www.cdc.gov/nchs/health_policy/adult_chronic_conditions.htm.
  • 50.A Study to Evaluate the Safety, Reactogenicity, and Effectiveness of mRNA-1273 Vaccine in Adolescents 12 to <18 Years Old to Prevent COVID-19 (TeenCove) [(accessed on 19 December 2020)]; Available online: https://clinicaltrials.gov/ct2/show/NCT04649151.
  • 51.Covid: Oxford-AstraZeneca Vaccine to Be Tested on Children. [(accessed on 14 February 2021)]; Available online: https://www.bbc.com/news/uk-56052673.
  • 52.CDC RealOpt User Manual. [(accessed on 15 August 2020)]; Available online: https://sites.google.com/view/evaklee/realopt.
  • 53.Lee E.K., Maheshwary S., Mason J., Glisson W. Decision support system for mass dispensing of medications for infectious disease outbreaks and bioterrorist attacks. Ann. Oper. Res-Comp. Opt. Med. Life Sci. 2006;148:25–53. doi: 10.1007/s10479-006-0087-7. [DOI] [Google Scholar]
  • 54.U.S Bureau of Labor [(accessed on 20 August 2020)]; Available online: https://www.bls.gov/
  • 55.U.S. Census Bureau [(accessed on 20 August 2020)]; Available online: https://www.census.gov/
  • 56.New York Times Coronavirus (Covid-19) Data in the United States. [(accessed on 17 June 2020)]; Available online: https://github.com/nytimes/covid-19-data.
  • 57.Pfizer and BioNTech Announce Vaccine Candidate against COVID-19 Achieved Success in First Interim Analysis from Phase 3 Study. [(accessed on 9 November 2020)]; Available online: https://www.pfizer.com/news/press-release/press-release-detail/pfizer-and-biontech-announce-vaccine-candidate-against.
  • 58.Houston COVID-19 Dashboard. [(accessed on 15 September 2020)]; Available online: https://www.houston.org/reopen-safely-dashboard.
  • 59.IHME COVID-19 Projects. [(accessed on 20 April 2021)]; Available online: https://covid19.healthdata.org/united-states-of-america?view=total-deaths&tab=trend.
  • 60.Kirby T. New variant of SARS-CoV-2 in UK causes surge of COVID-19. Lancet Respir. Med. 2021;9:20–21. doi: 10.1016/S2213-2600(21)00005-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Map of Tracked Variant Occurrence. GISAID. [(accessed on 14 March 2021)]; Available online: https://www.gisaid.org/hcov19-variants/
  • 62.Kucirka L.M., Lauer S.A., Laeyendecker O., Boon D., Lessler J. Variation in False-Negative Rate of Reverse Transcriptase Polymerase Chain Reaction–Based SARS-CoV-2 Tests by Time Since Exposure. Ann. Intern. Med. 2020;173:262–267. doi: 10.7326/M20-1495. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Lee E.K., Liu Y.F. Comparing Electronic Technologies for Data Collection of Patient and Data Flow at Vaccination Clinics. 2021. Submitted.
  • 64.Lee E.K. Strategies for COVID-19 Containment: A Biological-Behavioral-Logistics Computation Decision Framework. COVID-19 Summit Keynote Speech. [(accessed on 5 May 2020)]; Available online: https://www.youtube.com/watch?v=LB1Q4KGHerQ&t=716s.
  • 65.Gee J. First Month of COVID-19 Vaccine Safety Monitoring—United States, December 14, 2020–January 13, 2021. Morb. Mortal. Wkly. Rep. 2021;70:283–288. doi: 10.15585/mmwr.mm7008e3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.AstraZeneca’s COVID-19 Vaccine Links to Very Rare Cases of Unusual Blood Clots with Low Blood Platelets. European Medicines Agency. [(accessed on 20 April 2021)]; Available online: https://www.ema.europa.eu/en/news/astrazenecas-covid-19-vaccine-ema-finds-possible-link-very-rare-cases-unusual-blood-clots-low-blood.
  • 67.MHRA Advice on COVID-19 AstraZeneca Vaccine and Extremely Rare, Unlikely to Occur Blood Clots. Medicines and Healthcare Products Regulatory Agency. [(accessed on 20 April 2021)]; Available online: https://www.gov.uk/government/news/mhra-issues-new-advice-concluding-a-possible-link-between-covid-19-vaccine-astrazeneca-and-extremely-rare-unlikely-to-occur-blood-clots.
  • 68.Lee E.K., Liu Y.F., Debboun M., Shah U.A. A General-Purpose Modeling Framework for Analyzing Infectious Disease Outbreaks. [(accessed on 15 August 2020)];2021 Available online: https://www.evalee-innovation.net/Request/Download/20201208_General_Purpose_Disease_Model.pdf.
  • 69.Polack F.P., Thomas S.J., Kitchin N., Absalon J., Gurtman A., Lockhart S., Perez J.L., Pérez Marc G., Moreira E.D., Zerbini C., et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine. N. Engl. J. Med. 2020;383:2603–2615. doi: 10.1056/NEJMoa2034577. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Baden L.R., El Sahly H.M., Essink B., Kotloff K., Frey S., Novak R., Diemert D., Spector S.A., Rouphael N., Creech C.B., et al. Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N. Engl. J. Med. 2021;384:403–416. doi: 10.1056/NEJMoa2035389. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Lee E.K., Chen C.H., Pietz F., Benecke B. Disease propagation analysis and mitigation strategies for effective mass dispensing. AMIA Annu. Symp. Proc. 2010;2010:427–431. [PMC free article] [PubMed] [Google Scholar]
  • 72.Li Q., Guan X., Wu P., Wang X., Zhou L., Tong Y., Ren R., Leung K.S., Lau E.H., Wong J.Y., et al. Early Transmission Dynamics in Wuhan, China, of Novel Coronavirus–Infected Pneumonia. N. Engl. J. Med. 2020;382:1199–1207. doi: 10.1056/NEJMoa2001316. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Rothe C., Schunk M., Sothmann P., Bretzel G., Froeschl G., Wallrauch C., Zimmer T., Thiel V., Janke C., Guggemos W., et al. Transmission of 2019-nCoV Infection from an Asymptomatic Contact in Germany. N. Engl. J. Med. 2020;382:970–971. doi: 10.1056/NEJMc2001468. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Pan Y., Zhang D.T., Yang P., Poon L.L.M., Wang Q.Y. Viral load of SARS-CoV-2 in clinical samples. Lancet Infect. Dis. 2020 doi: 10.1016/S1473-3099(20)30113-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Jung C.Y., Park H., Kim D.W., Choi Y.J., Kim S.W., Chang T.I. Clinical Characteristics of Asymptomatic Patients with COVID-19: A Nationwide Cohort Study in South Korea. Int. J. Infect. Dis. 2020;99:266–268. doi: 10.1016/j.ijid.2020.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Lee S., Kim T., Lee E., Lee C., Kim H., Rhee H., Park S.Y., Son H.J., Yu S., Park J.W., et al. Clinical Course and Molecular Viral Shedding Among Asymptomatic and Symptomatic Patients With SARS-CoV-2 Infection in a Community Treatment Center in the Republic of Korea. AMA Intern. Med. 2020;180:1447–1452. doi: 10.1001/jamainternmed.2020.3862. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Johansson M.A., Quandelacy T.M., Kada S., Prasad P.V., Steele M., Brooks J.T., Slayton R.B., Biggerstaff M., Butler J.C. SARS-CoV-2 Transmission from People Without COVID-19 Symptoms. JAMA Netw. Open. 2021;4:e2035057. doi: 10.1001/jamanetworkopen.2020.35057. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

All data used in this manuscript is obtained from public sources or from peer-reviewed literature (Table A1). COVID-19 data: New York Times Coronavirus (Covid-19) Data in the United States, https://github.com/nytimes/covid-19-data. Greater Houston data: https://houstonemergency.org/houston-covid-19-deaths/, https://www.houston.org/reopen-safely-dashboard (accessed on 17 June 2020), U.S. Census Bureau: https://www.census.gov/ U.S Bureau of Labor: https://www.bls.gov/ (accessed on 20 August 2020).


Articles from Vaccines are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES