Skip to main content
Elsevier - PMC COVID-19 Collection logoLink to Elsevier - PMC COVID-19 Collection
. 2021 Sep 23;152:111458. doi: 10.1016/j.chaos.2021.111458

Ranking non-pharmaceutical interventions against Covid-19 global pandemic using global sensitivity analysis—Effect on number of deaths

Kalpana Hanthanan Arachchilage 1,, Mohammed Yousuff Hussaini 1
PMCID: PMC8457923  PMID: 34580567

Abstract

In this study, we use Global Sensitivity Analysis (GSA) to rank four non-pharmaceutical interventions (NPIs) in a deterministic compartmental model that might control Covid-19 related deaths in the United States. The NPIs are social distancing, isolation of infected individuals, identifying asymptomatically infected individuals through testing, and the use of face masks. The model uses a fear-based behavioral model that leads unmasked susceptible individuals to wear masks. The model parameters are estimated from the reported deaths for the United States of America from March 1, 2020 to November 26, 2020. Two GSA tools, the Sobol’ sesntivity indices and Partial Rank Correlation Coefficient are used to obtain the rankings of the input parameters at different stages of the disease propagation. We found that social distancing and outward mask efficiency alone decreases the output uncertainty by 25–45%. Sobol’ second order indices show that the combined effect of social distancing with increased mask usage and identifying and isolating asymptomatically infected individuals decreases uncertainty an additional 10%.

Keywords: Covid-19, Non-pharmaceutical interventions, Global sensitivity analysis, Social distancing, Mask use, Sobol’ sensitivity indices, Partial rank correlation coefficient

MSC: 0000, 1111

1. Introduction

The world is now facing a pandemic of a novel coronavirus (SARS-Cov-2), which started in Wuhan city of China in December 2019 [1]. As of November 27, 2020, the Covid-19 pandemic had spread across 218 countries and territories worldwide [2], had 60.5 million reported cases and a death toll of 1,426,101 [3]. So far, 12.8 million cases have been reported in the United States with 263,454 Covid-19 related deaths. Furthermore, it has caused significant disruptions in socio-economic foundations [4].

The novel coronavirus spreads through interactions with an infected individual via the respiratory system. Primarily, when an infected individual sneezes, coughs, or talks, the virus can be expelled into the air through droplets or aerosols [5], [6], [7] which can be inhaled by others. It is found that airborne transmission can occur from these aerosols for up to three hours [5]. Furthermore, the virus can survive on surfaces for 2–3 days and can infect when mouths, eyes, or noses are touched with contaminated hands [8], [9].

Due to the socio-economical impact of the Covid-19, it is crucial to create policies that effectively control and mitigate disease transmission. These approaches can be categorized into two, based on their mode of transmission 1) direct infection through droplets or aerosols, and 2) contact with facial orifices from the fomite inoculum deposited on surfaces. Control measures to limit direct infection through droplets include physical distancing, isolation of the exposed through contact tracing, lockdown, preventing large gatherings, shielding high-risk populations, quarantine, use of face masks, and as a pharmaceutical intervention, vaccination. Frequent hand washing and surface disinfecting can be identified as control measures against the second transmission mechanism. It should be noted that all these non-pharmaceutical interventions (NPIs) create an additional strain on the general public. Thus, it is crucial to know the effectiveness of these interventions to make effective decisions with minimum pressure on the population.

Mathematical epidemiological models have been extensively used to predict and understand the dynamics of the Covid-19 transmission [10], [11], [12], [13], [14], [15], [16], [17], [18], [19], [20]. Among various epidemiological models, Kermack-Mckendrick [21], [22] type models are the most popular. In these models, the total population is divided into non-overlapping compartments according to their disease status. The Simplest model, the SIR model, divides the population into three compartments: Susceptible (S), Infected or Infectious (I), and Recovered (R). Disease transmission occurs when an infected individual interacts with the susceptible population.

More advanced versions of the SIR model captures different scenarios in epidemiology. As an example, when there is an incubation period (time required for a susceptible individual to get infected after been exposed to an infected person), an exposed compartment (E) can be added between susceptible and infected compartments (i.e., SEIR model). Similarly, different configurations (e.g., SEIRD (includes death), SEIARD (includes deaths and asymptomatically infected) can be designed to model different scenarios and interventions.

Among the many Covid-19 prediction models [10], [11], [12], [13], [20], [23], [24], [25], [26], some [12], [14], [15], [17], [18], [27], [28], [29] have focused on controlling and mitigating the spreading of the coronavirus. Non-pharmaceutical interventions include the lockdown [12], [14], [15], mask usage [16], [17], [18], physical distancing [14], contact tracing [18], quarantine [10], [14], [15], school closures [15], personal hygiene [16] and isolation of high-risk individuals [15].

The effectiveness of the interventions themselves has been studied by implementing different levels of control [12], [17], [19], and through optimum control theory [19]. Davies et al. [15] used a stochastic age-structured compartmental model to study the importance of 1) school closure, 2) physical distancing, 3) self-isolation of symptomatically infected individuals, and 4) shielding high-risk individuals. Even though all these interventions are found to be effective in reducing the ICU demand, none of them alone could maintain the ICU demand below the capacity. Only the combinations of these interventions effectively kept the ICU demand below capacity.

In this study, we propose global sensitivity analysis (GSA) to rank the effectiveness of NPIs against Covid-19. Sensitivity analysis is a study of how output uncertainty is apportioned to the input parameter uncertainties [30], [31]. It is distinct from the uncertainty analysis that focuses on the model output uncertainties. Sensitivity analysis can be conducted for factor prioritization, parameter fixing, and variance cutting [31], [32], [33], [34]. In factor prioritization, input parameters are ranked according to their influence on the output uncertainty. Factor prioritization allows one to identify the most influential parameter that needs special attention to achieve the highest reduction in output uncertainty. Parameter fixing, on the other hand, recognizes the least significant parameters to the output uncertainty which allows one to simplify the model by fixing those parameters anywhere in their possible value range since their input uncertainty does not contribute significantly to the output variance. In variance cutting, input parameter variances of the influential parameters are identified and are reduced to obtain a threshold output uncertainty [34]. The main application of the variance cutting setting is to assess the risk [33], [34].

Sensitivity analysis methods can be categorized as local and global. In local sensitivity analysis, the input parameters are perturbed one at a time, fixing the others at their nominal values. On the other hand, the global sensitivity methods vary the input parameters simultaneously in their respective parameter space and can capture parameter interactions. Global sensitivity methods can be used for both linear and nonlinear models. Most sensitivity analysis literature uses local sensitivity because it is simple and computationally efficient [30], [33], [34], [35], [36], [37]. According to [30], most of the outcomes and suggestions of such studies are erroneous and misleading.

In this study, we use GSA tools (Partial Rank Correlation Coefficient (PRCC) [38] and Sobol’ sensitivity indices [33], [39], [40]) to rank the input parameters to understand which NPI is the most dominant in controlling the dynamics of Covid-19 progression in the United States. We use the cumulative number of deaths as the quantity of interest (QoI). We develop a deterministic compartmental model and the model parameters are estimated by comparing the model results to the number of reported fatalities in the United States. The time evolution of the sensitivity indices (both Sobol’ and PRCC) is used to understand how model parameters affect the number of deaths at different stages of the disease propagation.

2. Mathematical model

The proposed epidemiological model is a deterministic, compartmental model that divides the total population into 12 compartments (defined in Tabel 1 ) according to their disease status (Fig. 1 ). The model assumes that the birth rate and the non-covid related death rates are equal. Therefore, the constant total population, N can be written as

N=SU+SM+EU+EM+IU+IM+AU+AM+IH+IICU+R+D (1)

Table 1.

Description of the model compartments.

Compartment Description
SU Unmasked susceptible
SM Masked susceptible
EU Unmasked exposed
EM Masked exposed
IU Unmasked symptomatically infected
IM Masked symptomatically infected
AU Unmasked asymptomatically infected
AM Masked asymptomatically infected
IH Hospitalized
IICU Admitted to Intensive Care Units
R Recovered
D Death

Fig. 1.

Fig. 1

Schematic of the Compartmental Model.

Furthermore, we assume the model parameters are independent of the population demography.

The model is an extension of the basic SEIR model that uses four compartments, Susceptible, Exposed, Infected/Infectious, and Recovered. As shown in Fig. 1, the susceptible population is divided into two compartments as SU and SM (subscripts U and M represent unmasked and masked populations, respectively). Similarly, exposed and infected populations are also divided into masked and unmasked categories. The infected population can be further categorized as symptomatically infected (IU,IM) and asymptomatically infected (AU,AM). A portion of the infected individuals who show severe symptoms are hospitalized (IH) for medical treatments. The critical hospitalized individuals are then moved to intensive care units (IICU). The infected individuals (IU,IM,AU,AM,IH,IICU) can then be transferred into either the recovered (R) or the death (D) compartments. The yellow and red color connections in Fig. 1 represent the recovery and mortality paths, respectively.

The transition from a susceptible to exposed compartment depends on the transmission rate, β(t), the product of transmission probability and the contact rate. In standard SIR or SEIR compartment models, the transition rate from the susceptible to exposed compartment has the form βSI/N, where S/N represents the portion of susceptible individuals. Therefore, βS/N is the rate of disease propagation by one infected individual. In the current compartmental model, five infected compartments (IU,IM,AU,AM and IH) contribute to disease transmission. We assume that the individuals in IICU and D compartments are entirely isolated from the susceptible individuals and do not contribute to the disease transmission. Hospitalized and asymptomatically infected individuals have relatively lower infectiousness compared to the symptomatically infected [17], [18]. Therefore, the relative infectiousness terms, ηA and ηH are used to obtain the contribution of the asymptomatically infected (AU/M) and the hospitalized (IH) individuals to the disease transmission, respectively. To differentiate between unmasked and masked infectiousness, our model uses inward (ϵi) and outward (ϵo) mask efficiencies, which measure the mask’s efficiency to prevent the virus from transferring in or out of the masks [17], [18]. Then the transition rate from SUEU can be written as

SUEU=β(t)(IU+ηAAU+(1ϵo)(IM+ηAAM+ηHIH))N(D+IICU)SU (2)

Due to the outward mask efficiency, the effective viral shedding of the masked individuals are decreased by a factor of (1ϵo). The transition rate for SMEM has an analogous form, but due to the inward efficiency of the mask, only a factor of 1ϵi contributes to disease transmission. Therefore, the transition rate from SMEM can be written as

SMEM=(1ϵi)β(t)SUN(D+IICU)(IU+ηAAU)+(1ϵi)β(t)SUN(D+IICU)(1ϵo)(IM+ηAAM+ηHIH). (3)

The challenging portion of the model is to include behavioral changes [5], [41] to understand how many individuals wear masks or follow social distancing protocols. Most private and public establishments in the United States have a mask policy to reduce disease transmission [42]. However, it is not uncommon to see individuals who do not follow the Center for Disease Control guidelines (high-quality face mask with two or more layers that cover the mouth and nose without any large openings). We assume that the people who fear getting infected would change their behavior with or without legal requirements and so a fear-based mechanism is implemented to transfer individuals from unmasked to masked and masked to unmasked susceptible compartments. The rates κ1 and κ2 represent the forward and reverse transition. When the death toll increases, the fear grows with a time delay resulting in a shift in SUSM. The reverse process occurs when there are more recovered and unmasked susceptible populations present in public. The exposed compartment population is directed to either asymptomatically infected or symptomatically infected categories. Here, we assume that the transition rate (σ) and the fraction of the infected population being asymptomatic (f) is independent of whether a person wears a mask or not. Individuals in the IU compartment might change their behavior when they get tested positive for the coronavirus. To facilitate that, we create a link between IU and IM. The model considers four mortality rates and recovery rates corresponding to the symptomatically infected, asymptomatically infected, hospitalized and admitted to ICU population groups. A detailed description of all the model parameters are presented in Table 2 .

Table 2.

Description of model parameters.

Parameter Description
N Total population
β(t) Transmission rate - contact rate × transmission probability
ηA Infectiousness of asymptomatically infected individuals
relative to symptomatically infected individuals
ηH Infectiousness of hospitalized individuals relative to
symptomatically infected individuals
ϵi Inward mask efficiency
ϵo Outward mask efficiency
βf Rate of fear-induced behavior change
λ3 Exponential delay factor for fear-induced behavior change
μf The rate at which aware masked susceptible individuals
move to unmasked susceptible individuals
σ The rate at which exposed individuals move to symptomatic
or asymptomatic infected compartments
(reciprocal of the incubation period)
f The probability of an infected individual being asymptomatic
θ(t) The rate at which individuals in the IU compartment
move to the IM compartment
ϕ The rate at which symptomatically infected individuals move
to the hospitalized compartment
ν The rate at which critical hospitalized individuals
are admitted to the intensive care unit
γI The recovery rate of symptomatically infected individuals
γA The recovery rate of asymptomatically infected individuals
γH The recovery rate of hospitalized individuals
γICU The recovery rate of individuals in the ICU compartment
δI The mortality rate of symptomatically infected individuals
δA The mortality rate of asymptomatically infected individuals
δH The mortality rate of hospitalized individuals
δICU The mortality rate of individuals in the ICU compartment

This model is represented by 12 nonlinear ordinary differential equations Eqs. (4)(15) and the unknown parameters and rates need to be estimated by matching with the actual data. It should be noted that we assume time-dependent transmission coefficient (i.e., β(t)) and transition rate from IUIM (i.e., θ(t)) in Eqs. (4)(15) to obtain the multiple waves we observe in Covid-19 deaths in the United States [2], [3].

dSUdt=β(t)(IU+ηAAU+(1ϵo)(IM+ηAAM+ηHIH))N(D+IICU)SUζ1βf(1eλ3Dt)DN(D+IICU)SUκ1+μf(SU+R)N(D+IICU)SMκ2 (4)
dSMdt=(1ϵi)β(t)(IU+ηAAU+(1ϵo)(IM+ηAAM+ηHIH))N(D+IICU)SMζ2+βf(1eλ3Dt)DN(D+IICU)SUκ1μf(SU+R)N(D+IICU)SMκ2 (5)
dEUdt=ζ1σEU (6)
dEMdt=ζ2σEM (7)
dIUdt=(1f)σEUθ(t)IUϕIUγIIUδIIU (8)
dIMdt=(1f)σEM+θ(t)IUϕIMγIIMδIIM (9)
dAUdt=fσEUγAAUδAAU (10)
dAMdt=fσEMγAAMδAAM (11)
dIHdt=ϕIU+ϕIMγHIHνIHδHIH (12)
dIICUdt=νIHγICUIICUδICUIICU (13)
dRdt=γA(AU+AM)+γI(IU+IM)+γHIH+γICUIICU (14)
dDdt=δA(AU+AM)+δI(IU+IM)+δHIH+δICUIICU (15)

2.1. Basic reproduction number (R0)

The basic reproduction number denoted by R0 is defined as the number of secondary infections resulting from a single infected individual in a completely susceptible community during its infectious period. We use the next generation matrix based approach [43], [44] to obtain a closed-form expression for the reproduction number (see Eq. (A.6)). Here we consider a special case, where we neglect the time dependence of parameters β(t) and θ(t) and assume a constant value for the reproduction number calculations (see Table 2 for parameter definitions). For more information on the method and steps involved in the calculation process, refer to Appendix A.

3. Parameter estimation

The model parameters in Table 2 are estimated to match the time series fatality data reported in the United States by the Center for Systems Science and Engineering at Johns Hopkins University [45] from March 1, 2020, to November 26, 2020. Fig. 2 shows the number of mortalities related to Covid-19 in the US. The daily reported deaths show fluctuations in the number of deaths, which could be partly due to the different reporting standards across states. To remedy that, a 7-day moving average data are used for parameter estimation (Fig. 2, black circles).

Fig. 2.

Fig. 2

The number of Covid-19 deaths reported in the US from March 1, 2020 - November 26, 2020.

The other challenge is the presence of multiple waves of the disease. This could be partly due to the state-wise differences in actions against Covid-19 in terms of the level of enforcement and the timeline [42]. A time-dependent transmission rate had to be used to capture these multiple waves of the disease propagation as shown in Fig. 2. The time-dependent transmission rate β(t) can be written as

β(t)={β1+β2tτ1β1+β2eλ1(tτ1)τ1<tτ2β1+β2eλ1(τ2τ1)+β3(1eλ2(tτ2))τ2<tτ3β1+β2eλ1(τ2τ1)+β3(1eλ2(τ3τ2))+β4eλ1(tτ3)τ3<tτ4β5(t)τ4<t (16)

where

β5=β1+β2eλ1(τ2τ1)+β3(1eλ2(τ3τ2))+β4eλ1(tτ3)+β5(1eλ2(tτ4)), (17)

and β1,β2,β3,β4,β5,λ1,λ2,τ1,τ2,τ3 and τ4 are constants that need to be inferred. Furthermore, the time-dependent θ(t) value is defined as

θ(t)={θ1t<τ2θ2τ2t (18)

Relative infectiousness is taken as 0.5 for both asymptomatically infected and hospitalized individuals [17], [18]. It is reported that around 25% of the infected population are asymptomatic [46], hence the value of f is fixed at 0.25. The value of inward and outward mask efficiencies is assumed as 0.5. More information on mask efficiencies can be obtained in [17], [18], [29].

Parameter estimation was done using lsqnonlin [58], a nonlinear least-squares algorithm implemented in MATLAB. Table 3 provides the model parameter estimates and initial conditions used in the current study. It should be noted that the inferred values of parameters β15,λ12,θ12, and τ14 are also provided in Table 3. We plot the transient behavior of the transmission coefficient in Appendix B (Fig. B1).

Table 3.

Parameter estimates.

Parameter Value Source Parameter Value Source
Model Parameters
ηA 0.5 [18], [47] ηH 0.5 [18], [47]
ϵi 0.5 [17], [18] ϵo 0.5 [17], [18]
βf 4.8 [48] μf 0.54 [49], [50]
f 0.25 [17], [18], [51] ν 0.083 [18]
σ 1/5.1 [17], [18], [52], [53] ϕ 1/5 [18]
γI 1/10 [18], [54], [55] γA 0.13978 [18], [54], [55]
γH 1/8 [18], [55] γICU 1/10 [55]
δI 0.015 [18] δA 0.0075 [18]
δH 0.015 [18] δICU 0.0225 [18]
β1 0.225 fitted β2 0.659 fitted
β3 0.097 fitted β4 0.5671 fitted
β5 0.10658 fitted λ1 0.179 fitted
λ2 13.53 fitted λ3 0.0388 fitted
τ1 27.5 fitted τ2 97.98 fitted
τ3 127.6 fitted τ4 222.1 fitted
θ1 0.1098 fitted θ2 0.847 fitted

Initial Conditions
N 328.2×106 [56] SM(t=0) 3,276,578 fitted
EU(t=0) 0 assumed EM(t=0) 0 assumed
IU(t=0) 169 fitted IM(t=0) 0 assumed
AU(t=0) 440 fitted AM(t=0) 877 fitted
IH(t=0) 0 [57] IICU(t=0) 0 [57]
R(t=0) 2014 fitted D(t=0) 1 [45]

Fig. B1.

Fig. B1

Time variation of transmission coefficient β(t) from March 1, 2020 to November 26, 2020. See Eqs. (16) and (17) for the definition of dependent transmission coefficient and Table 3 for inferred model parameters..

Fig. 3 shows how well the model predictions and inferred input parameter values match with the deaths reported in the US.

Fig. 3.

Fig. 3

Comparison of the deaths reported in the US and the model prediction Eqs. (4) - (15) with the inferred parameters in Table 3. (a - daily deaths, b - cumulative deaths).

4. Global sensitivity analysis

As mentioned in the Section 1, we use two GSA methods to find the parameter rankings. This section introduces the Partial Rank Correlation Coefficient (PRCC) and Sobol’ sensitivity indices.

4.1. Partial rank correlation coefficient

PRCC or the Partial Rank Correlation Coefficient is a statistical measure also known as Spearman’s correlation coefficient [38], [59]. It quantifies the nonlinear correlation between input parameters and model output. Unlike the Pearson correlation coefficient [35], [38], PRCC allows users to identify nonlinear correlations to the model output [38]. However, the perturbations of each individual input parameter within their parameter space should result in a monotonically varying behavior in the output. This condition must be satisfied to use PRCC sensitivity indices [38], [59].

The calculation of the PRCC indices is as follows. We consider a model with p number of model parameters. Then, the model output, y can be a written as a function of all the model parameters xi, where i=1,2,,p (i.e., y=f(x1,x2,,xp)). As mentioned earlier, PRCC indices require the model output to vary monotonically when each individual input parameters are perturbed. This can be tested by sampling each parameter within its parameter space, while keeping rest of the model parameters at their nominal/inferred values [38]. The model evaluations corresponding to these perturbations should result in a monotonic behavior.

If the monotonicity condition is satisfied, one can proceed to the PRCC calculations. First, samples for each model parameter should be obtained using their joint probability distribution. It would result in a sample matrix of size, N×p, where N is the sample size. It is recommended to use Latin Hypercube [60] type quasi-random sampling techniques to achieve fast convergence [38]. Then, the a vector of output values (size of 1×N) needs to be generated by conducting function evaluations corresponding to each iteration. Then, the PRCC indices (ρxi,y) for the parameter xi can be calculated as [38], [59]

ρxi,y=Cov(xRi,yR)Var(xRi)×Var(yR)=j=1N(xRi,jxRi¯)(yRjyR¯)j=1N(xRi,jxRi¯)2j=1N(yRjyR¯)2 (19)

where xR and yR represent the rank transformed input matrix and output vector. Cov and Var represent the covariance and variance of the arguments, respectively. The overbars in the quantities represent the sample means. The PRCC indices ranges from -1 to 1. The positive values indicate a positive correlation and negative values indicate negative correlations. The magnitude indicates the importance of each parameter. For more information on the implementation and applications, see [37], [38], [59], [61], [62], [63].

4.2. Sobol’ sensitivity indices

The Sobol’ sensitivity approach is a variance-based sensitivity analysis method. However, the computations are more complex and computationally expensive than the PRCC calculations. Sobol’ sensitivity indices are not limited to linear models or monotonic input-output relationships. The concept behind the Sobol’ approach is to decompose the model output variance apportioned to the input parameter uncertainties [32], [33], [39], [64]. It can be achieved through analysis of variance (ANOVA).

Sobol’ [39] proposed the following total output variance decomposition when the input parameters are independent

Var(y)=iVi+ij>iVij++V123p (20)

where

Vi=Varxi(Exi(y|xi)),Vij=Varxi,xj(Ei,j(y|xi,xj))ViVj,Vijk=Varxi,xj,xk(Exijk(y|xi,xj,xk))VijVikVjkViVjVk,etc.

The quantity E(y|xi) represents the conditional expected value of y given xi, and Varxi(Exi(y|xi)) is the first order effect of the parameter xi on the output uncertainty (i.e., the output variance when the parameter xi is fixed). Then the Sobol’ first order sensitivity index (Eq. (21)) can be obtained by normalizing the first order effect by the total variance, so that 0Si1.

Si=Varxi(Exi(y|xi))Var(y) (21)

By dividing Eq. (20) by the total output variance, we can obtain

iSi+ij>iSij++S123p=1 (22)

The term Sij, indicates the second-order Sobol’ indices or the effect of second-order parameter interactions on the output uncertainty (i.e., the output variance, when both xi and xj are fixed). Similarly, higher order indices (i.e., Sijk,Sijkl,,S123p) provide higher order parameter interactions. The summation of first order and all the higher order indices for parameter xi calculates the total order index, SiT. It provides the maximum possible variance reduction that can be obtained by fixing any combination of parameters that includes parameter xi.

The total order Sobol’ index (SiT) can be calculated as [65], [66]

SiT=Exi(Varxi(y|xi))Var(y)=1Varxi(Exi(y|xi))Var(y). (23)

Since SiT is the sum of the first order and all the higher order indices for parameter xi,

iSi1,SiSiT. (24)

For an additive model, where the parameter interactions/higher order effects are negligible, iSi=1 and Si=SiT. References [33], [35], [40], [64], [66], [67] provide detailed information on different numerical implementations of these sensitivity indices. We have implemented an in-house code on MATLAB and the algorithm is described in [35], [36]. The current approach utilizes 2(p+1)N model calculations to obtain first order, second order and total order Sobol’ indices. The sample size, N is estimated using a trial and error method to ensure convergence of the sensitivity indices, Si,Sij and SiT.

4.3. Problem formulation

The proposed mathematical model Eqs. (4) - (15) has 32 model parameters. Furthermore, parameters such as transmission rate, β(t), and the rate at which unmasked symptomatically infected individuals change their behavior to wear masks, θ(t) are time-dependent. Handling time-varying parameters in sensitivity analysis is complicated. As an example, let’s consider the transmission rate, β(t). As shown in Eq. (16), it is a function of β15,τ14 and λ12. If all these 11 parameters are included for the sensitivity analysis, the perturbations of each parameter would vary both magnitude and shape of β(t). Thus, it could provide nonphysical model behavior. As a solution, two dummy variables (Cβ,Cθ) are introduced and utilized for the sensitivity analysis as scaling factors for β(t) and θ(t), respectively. The nominal value of Cθ and Cβ are fixed at one that keep the transmission rate remains unchanged. It is assumed that the values of β15,τ14,λ12 and θ12 are fixed at their inferred values and only the scaling factors Cβ and Cθ are perturbed in the sensitivity analysis. This allows us to reduce the dimensionality of the sensitivity analysis by fixing β15, τ14,λ12 and θ12 from 32 to 21.

In the sensitivity analysis, the scaling parameters, Cθ and Cβ are assumed to vary according to a uniform distribution with and upper and lower bounds of 10% (i.e., U(0.9,1.1)). The other parameters used for the sensitivity analysis are ϵi,ϵo,βf,μf,f,ηA,ηH,ν,σ,ϕ,γI,γA,γH,γICU,δI,δA,δH, and δICU. They are also sampled assuming a uniform distribution; however, they are perturbed ±25% of their nominal values (i.e., U(0.75XNom,1.25XNom)). All the initial conditions are kept at their nominal values.

5. Results and discussion

Here we examine the transient behavior of PRCC and Sobol’ sensitivity indices to understand the influence of model parameters on the number of cumulative deaths (i.e., the Quantity of Interest, QoI) at different stages of the disease progression in the US from March 1, 2020, to April 14, 2021.

5.1. Sensitivity analysis - Partial rank correlation coefficient

Here, we conduct sensitivity analysis using the PRCC approach described in the Section 4.1. A sample size of 100,000 is used for the PRCC calculations to ensure the convergence of the sensitivity indices. The validity of the PRCC approach in the context of this research problem is examined by obtaining how the model predictions (i.e., number of cumulative deaths) vary when each input parameter is perturbed within their parameter space, one at a time (Fig. 4 ). Fig. 4 shows four output variations corresponding to four time instances, June 8, 2020 (cyan), September 16, 2020 (blue), December 25, 2020 (red), and April 14, 2021 (black). It should be noted that the y-axis of Fig. 4 is the number of cumulative deaths. It can be seen that all four time instances satisfy the monotonicity requirement of all the model parameters. At early stages (June 8, 2020, and September 16, 2020), all the input parameters have a linear correlation with the number of deaths; however, with time, the nonlinear correlation can be observed. This also shows the importance of conducting global sensitivity analysis instead of local sensitivity as local sensitivity analysis cannot accurately capture nonlinear correlations.

Fig. 4.

Fig. 4

Monotonicity requirement for each of the model parameters varied - Quantity of interest - number of cumulative deaths (cyan - June 8, 2020, blue - September 16, 2020, red - December 25, 2020 and black - April 14, 2020). (For interpretation of the references to colour in this figure legend, the reader is referred to the web version of this article.)

Fig. 5 shows the time evolution of the PRCC coefficients of the influential parameters (i.e., max|PRCC(t)|0.15). Among the influential parameters, σ,ηA,ηH and Cβ show a positive correlation on the number of deaths, while ϵo,ϕ,γI, and γH show a negative correlation.

Fig. 5.

Fig. 5

Time evolution of the Partial Rank Correlation Coefficient indices. Only the influential parameters are shown, i.e., max|PRCC(t)|0.15. (solid lines - positive correlations, dashed lines - negative correlations).

The positive correlation of σ with the number of deaths means that increasing the value of σ (or shortening the incubation period) increases the number of deaths. At the early stages, σ is the most influential parameter. However, with time its importance decreases. The incubation period governs the rate at which individuals move from the exposed compartment to the infected compartments. In the beginning, the number of infected individuals is low; therefore the rate of transitioning from infected to death or other subsequent compartments is primarily governed by the rate of individuals entering the infected compartment. However, with time more and more individuals accumulate in the infected compartments, and the importance of σ decreases.

The measure of social distancing, Cβ, has a strong positive influence throughout the disease propagation. When Cβ increases, the rate at which susceptible individuals transfer to the exposed compartment increases that lead to increased mortality. Thus implementing social distancing measures leads Cβ to decrease, results in a decrement in the number of deaths. The other positively correlated parameters are ηA and ηH, the relative infectiousness of asymptomatically infected and hospitalized individuals, respectively implying that identifying asymptomatically infected individuals and properly isolating them from the society is another effective intervention. The PRCC value of ηA consistently stays at the same value, but the PRCC value of ηH increases with time, which could be due to the increased hospitalizations with time.

Among the negatively correlated parameters, outward mask efficiency, ϵo is the most influential. Increasing the outward mask efficiency would result in a reduction in the transmission rate as high-efficiency masks could prevent most of the aerosol and droplets expelling from an infected individual. The recovery rates of asymptomatically and symptomatically infected individuals also negatively affect the fatalities. Faster recovery rates affect the number of system in two different ways, 1). higher recovery rates remove infected individuals from symptomatically and asymptomatically infected compartments at a higher rate, reducing the amount of infected individuals in the society that contribute to the disease prevalence, 2). number of deaths are proportionate to the number of infections (e.g. death rate of IU compartment is δIIU and since higher recovery rates reduces the number of individuals in IU compartment, the death rate is also decreases).

5.2. Sobol’ sensitivity indices

We now present Sobol’ sensitivity indices to examine the transient behavior of the input parameters on the model output. Fig. 6 shows the time evolution of Sobol’ first order (Fig. 6(a)) and total order (Fig. 6(b)) indices for the influential parameters. The convergence of the results was obtained with a sample size of 1 million. Therefore, it required 44 million function evaluations, i.e., 2×(21+1)×106. However, the first and total order indices converged at a faster rate than the second order indices (i.e, first order and total order indices converged with 250,000 samples).

Fig. 6.

Fig. 6

Time evolution of the Sobol’ sensitivity indices (a - Sobol’ first order indices, b - Sobol’ total order indices).

From the first glance, it can be seen that Sobol’ first order indices are comparable with the PRCC results. Similar to the PRCC indices, Sobol’ indices also show that σ is the most influential parameter in the beginning and with time, its influence decreases. The first order indices show that in April 2020 around 35% of the output uncertainty comes from the input uncertainty of σ and it reduces to 5% in October 2020. The transmission coefficient, Cβ also shows a consistent influence of around 20% of the output uncertainty, but it has a slight reduction around October 2020. Similar to the PRCC results, outward mask efficiency shows an increasing trend with time.

Even though both PRCC and Sobol’ first order indices provide similar results, PRCC data cannot provide information on how individual parameters interact with each other. The effect of parameter interactions or higher order effects can be recognized by comparing first order and total order Sobol’ indices. A significant level of interactions can be seen in Cβ,ηA,ϕ and γI. The total indices of most parameters show similar trend behavior to the first order indices. As an example, both first and total order indices for the parameter σ have a higher value in the beginning and decrease with time. The only difference is the magnitude indicating that parameter interactions do not vary with time. However, parameters Cβ and ηA show a clear variation in the first and total order sensitivity indices. As an example, the total order indices of the parameter Cβ show a peak around September 2020 while first order indices show a slight drop during that period. The same occurred for ηA as well. These variations indicate that there is a transient behavior in the higher order effects.

To further understand these transient higher order effects, we calculated second order sensitivity indices. Since Cβ shows the highest level of parameter interactions, the time evolution of the second order Sobol’ indices for parameter Cβ are depicted in Fig. 7 . The parameter Cβ mainly interacts with ϵo and their strongest influence occurs around December 2020 and results in around 6% output uncertainty (i.e., simultaneous implementation of mask usage and social distancing would result in an additional control over number of deaths). The interaction between Cβ and σ has its peak at the beginning, which is around 4.5% of the output uncertainty. A similar interaction can be found in between the parameters ηA and ϕ which has a similar peak around September 2020.

Fig. 7.

Fig. 7

Time evolution of second order Sobol’ indices for parameter Cβ.

6. Conclusions

We developed a mathematical model to analyze the effect of the Covid-19 pandemic in the United States and used Sobol’ and PRCC global sensitivity analysis tools to identify the influential non-pharmaceutical interventions. The NPIs included in the mathematical model are social distancing, isolation of infected individuals, identifying asymptomatically infected individuals through testing, and the use of face masks. We used a fear-based model to simulate how individuals change their behavior to wear masks and follow social distancing guidelines.

We inferred model parameters using the number of fatalities reported in the US from March 1, 2020, to November 26, 2020. In the sensitivity analysis, we perturbed all the model parameters ±25% of their inferred values (i.e., assuming uniform distribution), except for parameters Cθ and Cβ, which are perturbed ±10%. We summarize our findings under two categories, 1. model simplification and prediction uncertainty reduction, 2. ranking of non-pharmaceutical interventions to control and mitigate the Covid-19 pandemic. We used the number of cumulative deaths as the quantity of interest in the sensitivity analysis.

6.1. Model simplification and prediction uncertainty reduction

According to the PRCC sensitivity indices, only the parameters Cβ,ϵO, ηA,ηH,σ, ϕ,γI, and γA are found to be influential (i.e., |PRCC(t)|1.5). Since the rest of the parameters have little to no influence on the QoI, we can simplify our modeling efforts by fixing these non-influential parameters at their nominal values. According to the first-order indices, these non-influential parameters contribute less than 5% of output uncertainty throughout the time period.

Prediction uncertainty is another issue that model builders and policymakers often face. Here, we suggest an accurate estimation of the aforementioned influential parameters to reduce the prediction uncertainty. As an example, in the beginning, both PRCC and Sobol’ sensitivity indices show that parameter σ (i.e., the reciprocal of the incubation period) is the most influential parameter that contributes 35% of the prediction uncertainty. Thus, an accurate estimation of the parameter σ would benefit the prediction uncertainty at least in the first few months. Similarly, the prediction of transmission coefficient and relative infectiousness can reduce the output uncertainty significantly (around 30–35%).

6.2. Ranking of non-pharmaceutical interventions against Covid-19

As mentioned earlier, parameter σ has the most contribution to the output uncertainty initially and decreases with time. The influence of parameter Cβ increased with time, indicating that social distancing measures have increasing control over the number of Covid-19 related fatalities. Additionally, the parameters ηA and ηH (relative infectiousness of asymptomatically infected and hospitalized, respectively) also positively influenced the model output uncertainty, showing the importance of frequent testing to identify asymptomatically infected individuals and of effective isolation from the susceptible population.

Outward mask efficiency and the rate at which unmasked symptomatically infected individuals make behavioral changes to wear masks are factors that decreased the number of deaths. It should be noted that the inward mask efficiency, ϵI is one of the non-influential parameters even though the outward mask efficiency plays a significant role. To recall, the outward mask efficiency measures the efficiency of the mask preventing the disease transmission from an infected individual, and the inward mask efficiency measures the efficiency of the mask containing the transmission of the disease to a susceptible individual. This means that the influence of an infected individual wearing a high-quality mask is much more beneficial than the influence of a susceptible individual wear a high-quality mask. Therefore, when the demand for high-quality masks is high, priority can be given to the infected individuals, given a sufficient amount of testing being done to identify asymptomatically individuals.

The Sobol’ sensitivity indices showed a similar parameter ranking as PRCC. However, a comparison between the first order and total order sensitivity indices indicated that some parameters have non-zero higher-order effects due to parameter interactions. By estimating the second-order sensitivity indices, we found that simultaneous implementation of non-pharmaceutical interventions is more suitable to control the number of deaths. For example, implementing social distancing and mask usage decreased the output uncertainty up to 6% (i.e., in addition to their individual effects).

Finally, we found that the number of deaths can be decreased by increasing social distancing efforts, effective mask usage, and identifying and isolating asymptomatically infected individuals.

Data availability

Replication code is available from GitHub, https://github.com/khanthanan/Covid-19

CRediT authorship contribution statement

Kalpana Hanthanan Arachchilage: Conceptualization, Methodology, Software, Validation, Formal analysis, Writing – original draft, Writing – review & editing. Mohammed Yousuff Hussaini: Conceptualization, Writing – review & editing, Supervision.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Appendix A. Calculation of Basic Reproduction Number

Here we provide the calculation procedure of the basic reproduction number, R0, for a special case of the mathematical model Eqs. (4)(15) where the time-dependent parameters, β(t) and θ(t), are assumed to be constant (i.e., β(t)=β0, θ(t)=θ0). We use the next generation matrix approach [43], [44] to calculate the basic reproduction number. The system has a disease-free equilibrium state (DFE) and it is DFE(SU=N,SM=0,EU=0,EM=0,IU=0,IM=0,AU=0,AM=0,IH=0,IICU=0,R=0,D=0). The system has seven disease compartments and they are EU,EM,IU,IM,AU,AM,IH. As explained in Section 2, we assume the diseased and ICU compartments are completely isolated. Therefore, D and IICU compartments are not considered as disease compartments.

Then, we decompose the disease compartment model equations Eqs. (6)(13) such that dMdt=FV, where M=[EU,EM,IU,IM,AU,AM,IH].

F=[ζ1ζ200000]T (A1)

See Eqs. (4) and (5) for the definitions of ζ1 and ζ2 terms.

V=[σEUσEM(1f)σEU+(θ0+ϕ+γI+δI)IU(1f)σEM+(ϕθ0+γI+δI)IMfσEU+γAAU+δAAUfσEM+γAAM+δAAMϕ(IU+IM)+(γH+ν+δH)IH] (A2)

Matrices F|DFE and V|DFE are calculated as

Fi,j|DFE=FiMj|DFEVi,j|DFE=ViMj|DFE (A3)
F|DFE=[00β0β0(1ϵO)β0ηAβ0ηA(1ϵO)β0ηH(1ϵO)000000000000000000000000000000000000000000] (A4)
V|DFE=[σ0000000σ00000(1f)σ0k100000(1f)σθ0k2000fσ000δA+γA000fσ000δA+γA000ϕϕ00k3] (A5)

where k1=δI+γI+ϕ+δ, k2=δI+γI+ϕ and k3=δH+γH+ν.

Then the basic reproduction number is given by the dominant eigen value of the new generation matrix (FV1) and can be written as

R0=β0ηfδA+γA+β0θ0(1ϵO)(1f)δI+γI+ϕ+θ0+β0θ0(1ϵO)(1f)(δI+γI+ϕ)(δI+γI+ϕ+θ0)+β0ηHϕ(1ϵO)(1f)(δH+γH+ν)(δI+γI+ϕ) (A6)

At t=0, when the value of β0=β(t=0)=0.8840 and θ0=θ(t=0)=0.1098, the numerical value of R0 becomes 3.0549.

Appendix B. Time Variation of Transmission Coefficient

References

  • 1.Li Q., Guan X., Wu P., Wang X., Zhou L., Tong Y., et al. Early transmission dynamics in wuhan, china, of novel coronavirus-infected pneumonia. N Engl J Med. 2020;382(13):1199–1207. doi: 10.1056/NEJMoa2001316. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Worldometer. Worldometer. https://www.worldometers.info/coronavirus/countries-where-coronavirus-has-spread/[Online; accessed November 26, 2020]; 2020.
  • 3.World Health Organization. WHO coronavirus disease (COVID-19) dashboard [Online; accessed November 26, 2020]. https://covid19.who.int/; 2020.
  • 4.Nicola M., Alsafi Z., Sohrabi C., Kerwan A., Al-Jabir A., Iosifidis C. The socio-economic implications of the coronavirus pandemic (COVID-19): a review. Int J Surg. 2020;78:185–193. doi: 10.1016/j.ijsu.2020.04.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Howard J., Huang A., Li Z., Tufekci Z., Zdimal V., Westhuizen H., et al. Face masks against COVID-19: an evidence review. PNAS. 2021;118(4) doi: 10.1073/pnas.2014564118. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Meselson M. Droplets and aerosols in the transmission of SARS-CoV-2. N Engl J Med. 2020;382(21) doi: 10.1056/NEJMc2009324. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Anfinrud P., Bax C., Stadnytskyi V., Bax A. Could SARS-CoV-2 be transmitted via speech droplets. medRxiv: the preprint server for health sciences. 2020 doi: 10.1101/2020.04.02.20051177. [DOI] [Google Scholar]
  • 8.Kampf G., Todt D., Pfaender S., Steinmann E. Persistence of coronaviruses on inanimate surfaces and their inactivation with biocidal agents. J Hosp Infect. 2020;104(3):246–251. doi: 10.1016/j.jhin.2020.01.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Stutt R., Retkute R., Bradley M., Gilligan C., Colvin J. A modelling framework to assess the likely effectiveness of facemasks in combination with ’lock-down’ in managing the covid-19 pandemic. Proc R Soc A. 2020;476(2238) doi: 10.1098/rspa.2020.0376. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Annas S., Pratama M., Rifandi M., Sanusi W., Side S. Stability analysis and numerical simulation of SEIR model for pandemic COVID-19 spread in Indonesia. Chaos Solitons and Fractals. 2020;139 doi: 10.1016/j.chaos.2020.110072. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Bekiros S., Kouloumpou D. SBDiEM: a new mathematical model of infectious disease dynamics. Chaos Solitons and Fractals. 2020;136 doi: 10.1016/j.chaos.2020.109828. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Biswas S., Ghosh J., nd U. Ghosh S.S. COVID-19 pandemic in India: a mathematical model study. Nonlinear Dyn. 2020:1–17. doi: 10.1007/s11071-020-05958-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Cakir Z., Savas H. A mathematical modelling approach in the spread of the novel 2019 coronavirus SARS-CoV-2 (COVID-19) pandemic. Electron J Gen Med. 2020;17(4) doi: 10.29333/ejgm/7861. [DOI] [Google Scholar]
  • 14.Ayana M., Hailegiorgis T., Getnet K. The impact of infective immigrants and self isolation on the dynamics and spread of Covid-19 pandemic: a mathematical modeling study. J Pure Appl Math. 2020;9(6):109–117. [Google Scholar]
  • 15.Davies N., Kucharski A., Eggo R., Gimma A., Edmunds W. Effects of non-pharmaceutical interventions on COVID-19 cases, deaths and demand for hospital services in the UK: a modelling study. Lancet Public Health. 2020;5(7):E375–E385. doi: 10.1016/S2468-2667(20)30133-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Bouchnita A., Jebrane A. A hybrid multi-scale model of COVID-19 transmission dynamics to assess the potential of non-pharmaceutical interventions. Chaos Solitons and Fractals. 2020;138 doi: 10.1016/j.chaos.2020.109941. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Eikenberry S., Mancuso M., Iboi E., Phan T., Eikenberry K., Kuang Y., et al. To mask or not to mask: modeling the potential for face mask use by the general public to curtail the COVID-19 pandemic. Infect Dis Model. 2020;5:293–308. doi: 10.1016/j.idm.2020.04.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Ngonghala C., Iboi E., Eikenberry S., Scotch M., Maclntyre C., Bonds M. Mathematical assessment of the impact of non-pharmaceutical interventions on curtailing the 2019 novel coronavirus. Math Biosci. 2020;325 doi: 10.1016/j.mbs.2020.108364. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Deressa C., Mussa Y., Duressa G. Optimal control and sensitivity analysis for transmission dynamics of coronavirus. Results Phys. 2020;19 doi: 10.1016/j.rinp.2020.103642. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Vytla V., Ramakuri S., Peddi A., Srinivas K., Ragav N. Mathematical models for predicting covid-19 pandemic: a review. J Phys Conf Ser. 2021;1797(1):012009. doi: 10.1088/1742-6596/1797/1/012009. [DOI] [Google Scholar]
  • 21.Kermack W., McKendrick A. A contribution to the mathematical theory of epiemics. Proc R Soc A. 1927;115(772) [Google Scholar]
  • 22.Brauer F. The Kermack-McKendrick epidemic model revisited. Math Biosci. 2005;198(2):119–131. doi: 10.1016/j.mbs.2005.07.006. [DOI] [PubMed] [Google Scholar]
  • 23.Bertozzi A., Franco E., Mohler G., Short M., Sledge D. The challenges of modeling and forecasting the spread of COVID-19. PNAS. 2020;117(29):16732–16738. doi: 10.1073/pnas.2006520117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Khan M., Atangana A. Modeling the dynamics of novel coronavirus(2019-nCov) with fractional derivative. Alex Eng J. 2020;59(4):2379–2389. doi: 10.1016/j.aej.2020.02.033. [DOI] [Google Scholar]
  • 25.Khan M., Ullah S., Kumar S. A robust study on 2019-nCOV outbreaks through non-singular derivative. Eur Phys J Plus. 2021;136(168) doi: 10.1140/epjp/s13360-021-01159-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Chu Y., Ali A., Khan M.A., Islam S., Ullah S. Dynamics of fractional order COVID-19 model with a case study of Saudy Arabia. Results Phys. 2021;21:103787. doi: 10.1016/j.rinp.2020.103787. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Oud M., Ali A., Alrabaiah H., Ullah S., Khan M., Islam S. A fractional order mathematical model for Covid-19 dynamics with quarantine, isolation, and environmental viral load. Adv Differ Equ. 2021;1(106) doi: 10.1186/s13662-021-03265-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Alqarni M., Alghamdi M., Muhammad T., Alshomrani A., Khan M. Mathematical modeling for novel coronavirus (COVID-19) and control. Numer Methods Partial Differ Equ. 2020:1–17. doi: 10.1002/num.22695. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Rowan N., Moral R. Disposable face masks and reusable face coverings as non-pharmaceutical interventions (NPIs) to prevent transmission of SARS-CoV-2 variants that cause coronavirus disease (COVID-19): role of new sustainable NPI design innovations and predictive mathematical modeling. Sci Total Environ. 2021;772 doi: 10.1016/j.scitotenv.2021.145530. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Saltelli A., Aleksankina K., Becker W., Fennell P., Ferretti F., Holst N., et al. Why so many published sensitivity analyses are false: a systematic review of sensitivity analysis practices. Environ Model Softw. 2019;114:29–39. [Google Scholar]
  • 31.Saltelli A. Sensitivity analysis for importance assessment. Risk Anal. 2002;22(3):579–590. doi: 10.1111/0272-4332.00040. [DOI] [PubMed] [Google Scholar]
  • 32.Smith R. SIAM Computational Science & Engineering Series: Philadelphia, PA, USA; 2004. Uncertainty quantification: theory, implementation, and applications. [Google Scholar]
  • 33.Salelli A., Tarantola S., Campolongo F., Ratto M. John Wiley & Sons Ltd; 2004. Sensitivity analysis in practice, a guide to assessing scientific models. [Google Scholar]
  • 34.Salelli A., Ratto M., Andres T., Campolongo F., Cariboni J., Gatelli D. John Wiley & Sons Ltd; 2008. Global sensitivity analysis, the primer. [Google Scholar]
  • 35.Wentworth M., Smith R., Banks H. Parameter selection and verification techniques based on global sensitivity analysis illustrated for an HIV model. SIAM/ASA Int J Uncertain Quantif. 2016;4:266–297. [Google Scholar]
  • 36.Leon L., Smith R.C., Oates W.S., Miles P. Analysis of a multi-axial quantum-informed ferroelectric continuum model: part 2 - Sensitivity analysis. J Intell Mater Syst Struct. 2018;29(13):2840–2860. doi: 10.1177/1045389X18781024. [DOI] [Google Scholar]
  • 37.Jarrett A., Gao Y., Hussaini M., Cogan N., Katz D. Sensitivity analysis of a pharmacokinetic model of vaginal anti-HIV microbicide drug delivery. J Pharm Sci. 2016;105(5):1772–1778. doi: 10.1016/j.xphs.2016.02.015. [DOI] [PubMed] [Google Scholar]
  • 38.Marino S., Hogue I., Ray C., Kirschner D. A methodology for performing global uncertainty and sensitivity analysis in systems biology. J Theor Biol. 2008;254(1):178–196. doi: 10.1016/j.jtbi.2008.04.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Sobol I. Global sensitivity indices for nonlinear mathematical models and their monte carlo estimates. Math Comput Simul. 2001;55:271–280. [Google Scholar]
  • 40.Jansen M. Analysis of variance designs for model output. Comput Phys Commun. 1999;117(1–2):35–43. doi: 10.1016/S0010-4655(98)00154-4. [DOI] [Google Scholar]
  • 41.Harper C., Satchell L., Fido D., Latzman R. Functional fear predicts public health compliance in the COVID-19 pandemic. Int J Ment Health Addict. 2020 doi: 10.1007/s11469-020-00281-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.The New York Times. See reopening plans and mask mandates for all 50 states. https://www.nytimes.com/interactive/2020/us/states-reopen-map-coronavirus.html[Online; accessed January 8, 2021].
  • 43.den Driessche P.V., Watmough J. Reproduction numbers and sub-threshold endemic equilibria for compartmental models of disease transmission. Math Biosci. 2002;180(1–2):29–48. doi: 10.1016/S0025-5564(02)00108-6. [DOI] [PubMed] [Google Scholar]
  • 44.Diekmann O., Heesterbeek J., Metz J. On the definition and the computation of the basic reproduction ratio R0 in the models for infectious disease in heterogeneous populations. J Math Biol. 1990;28:365–382. doi: 10.1007/BF00178324. [DOI] [PubMed] [Google Scholar]
  • 45.Dong E., Du H., Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis. 2020;20(5):533–534. doi: 10.1016/S1473-3099(20)30120-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Heneghan C., Brassey J., Jefferson T.. What proportion are asymptomatic?https://www.cebm.net/covid-19/covid-19-what-proportion-are-asymptomatic/[Online; accessed August 1, 2020].
  • 47.Li R., Pei S., Chen B., Song Y., Zhang T., Shaman J. Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV-2) Science. 2020;368(6490):489–493. doi: 10.1126/science.abb3221. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Kim S., Seo Y., Jung E. Prediction of COVID-19 transmission dynamics using a mathematical model considering behavior changes in Korea. Int J Epidemiol. 2020;42 doi: 10.4178/epih.e2020026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Chen H., Xu W., Paris C., Reeson A., Li X. Social distance and SARS memory: impact on the public awareness of 2019 novel coronavirus (COVID-19) outbreak. medRxiv. 2020 doi: 10.1101/2020.03.11.20033688. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Mbabazi F.K., Gavamukulya Y., Awichi R., Olupot–Olupot P., Rwahwire S., Biira S., et al. A mathematical model approach for prevention and intervention measures of the COVID–19 pandemic in Uganda. medRxiv. 2020 doi: 10.1101/2020.05.08.20095067. [DOI] [Google Scholar]
  • 51.Anderson R., Heesterbeek H., Klinkenberg D., Hollingsworth T. How will country-based mitigation measures influence the course of the COVID-19 epidemic? Lancet. 2020;395(10228):931–934. doi: 10.1016/S0140-6736(20)30567-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Lai C., Shih T., Ko W., Tang H., Hsueh P. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and coronavirus disease-2019 (COVID-19): the epidemic and the challenges. Int J Antimicrob Agents. 2020;55(3) doi: 10.1016/j.ijantimicag.2020.105924. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Lauer S., Grantz K., Jones F., Zheng Q., Meredith H., Azman A., et al. The incubation period of coronavirus disease 2019 (COVID-19) from publicly reported confirmed cases: estimation and application. Ann Intern Med. 2020 doi: 10.7326/M20-0504. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Zou L., Ruan F., Huang M., Liang L., Huang H., Hong Z., Yu J., Kang M., Song Y., Xia J., Guo Q., Song T., He J., Yen H.-L., Peiris M., Wu J. SARS-CoV-2 viral load in upper respiratory specimens of infected patients. N top N Engl J Med. 2020;382(12):1177–1179. doi: 10.1056/NEJMc2001737. [DOI] [PMC free article] [PubMed] [Google Scholar]; PMID: 32074444
  • 55.Tang B., Wang X., Li Q., Bragazzi N., Tang S., Xiao Y., et al. Estimation of the transmission risk of the 2019-nCoV and its implication for public health interventions. J Clin Med. 2020;9(2):462. doi: 10.3390/jcm9020462. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Beruau USC. U.S. Population. https://www.census.gov/quickfacts/fact/table/US/PST045219[Online; accessed August 8, 2020].
  • 57.The COVID Tracking Project. https://covidtracking.com/data/national/hospitalization[Online; accessed August 8, 2020].
  • 58.Coleman T., Li Y. On the convergence of interior-reflective Newton methods for nonlinear minimization subject to bounds. Math Program. 1994;67:189–224. doi: 10.1007/BF01582221. [DOI] [Google Scholar]
  • 59.Jarrett A., Cogan N., Hussaini M. Combining two methods of global sensitivity analysis to investigate MRSA nasal carriage model. Bull Math Biol. 2017;79(10):2258–2272. doi: 10.1007/s11538-017-0329-7. [DOI] [PubMed] [Google Scholar]
  • 60.McKay M., Beckman R., Conover W. Comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics. 1979;32(2):239–245. doi: 10.2307/1268522. [DOI] [Google Scholar]
  • 61.Jarrett A., Cogan N., Shirtliff M. Modelling the interaction between the host immune response, bacterial dynamics and inflammatory damage in comparison with immunomodulation and vaccination experiments. Math Med Biol. 2015;32(3):285–306. doi: 10.1093/imammb/dqu008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Blower S., Dowlatabadi H. Sensitivity and uncertainty analysis of complex models of disease transmission: an HIV model, as an example. Int Stat Rev. 1994;62(2):229–243. doi: 10.2307/1403510. [DOI] [Google Scholar]
  • 63.Bianca C., Chiacchio F., Pappalardo F., Pennisi M. Mathematical modeling of the immune system recognition to mammary carcinoma antigen. BMC Bioinformatics. 2012;13 doi: 10.1186/1471-2105-13-S17-S21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Sobol I. Sensitivity estimates for nonlinear mathematical models. Math Model Comput Exp. 1993;1(4):407–414. [Google Scholar]
  • 65.Saltelli A., Tarantola S. On the relative importance of input factors in mathematicalmodels: safety assessment for nuclear waste disposal. J Am Stat Assoc. 2002;97(459):702–709. doi: 10.1198/016214502388618447. [DOI] [Google Scholar]
  • 66.Homma T., Saltelli A. Importance measures in global sensitivity analysis of nonlinear models. Reliab Eng Syst Saf. 1996;52(1):1–17. doi: 10.1016/0951-8320(96)00002-6. [DOI] [Google Scholar]
  • 67.Miles P., Leon L., Smith R., Oates W. Analysis of a multi-axial quantum informed ferroelectric continuum model: part 1 - Uncertainty quantification. J Intell Mater Syst Struct. 2018;29(13):2823–2839. doi: 10.1177/1045389X18781023. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Replication code is available from GitHub, https://github.com/khanthanan/Covid-19


Articles from Chaos, Solitons, and Fractals are provided here courtesy of Elsevier

RESOURCES