Skip to main content
Tropical Medicine and Infectious Disease logoLink to Tropical Medicine and Infectious Disease
. 2022 Sep 3;7(9):227. doi: 10.3390/tropicalmed7090227

Importation, Local Transmission, and Model Selection in Estimating the Transmissibility of COVID-19: The Outbreak in Shaanxi Province of China as a Case Study

Xu-Sheng Zhang 1,*, Huan Xiong 2, Zhengji Chen 2, Wei Liu 2
Editor: Yannick Simonin
PMCID: PMC9502723  PMID: 36136638

Abstract

Background: Since the emergence of the COVID-19 pandemic, many models have been applied to understand its epidemiological characteristics. However, the ways in which outbreak data were used in some models are problematic, for example, importation was mixed up with local transmission. Methods: In this study, five models were proposed for the early Shaanxi outbreak in China. We demonstrated how to select a reasonable model and correctly use the outbreak data. Bayesian inference was used to obtain parameter estimates. Results: Model comparison showed that the renewal equation model generates the best model fitting and the Susceptible-Exposed-Diseased-Asymptomatic-Recovered (SEDAR) model is the worst; the performance of the SEEDAR model, which divides the exposure into two stages and includes the pre-symptomatic transmission, and SEEDDAAR model, which further divides infectious classes into two equally, lies in between. The Richards growth model is invalidated by its continuously increasing prediction. By separating continuous importation from local transmission, the basic reproduction number of COVID-19 in Shaanxi province ranges from 0.45 to 0.61, well below the unit, implying that timely interventions greatly limited contact between people and effectively contained the spread of COVID-19 in Shaanxi. Conclusions: The renewal equation model provides the best modelling; mixing continuous importation with local transmission significantly increases the estimate of transmissibility.

Keywords: basic reproduction number, Bayesian inference, COVID-19, mathematical modelling, model selection, local transmission, importation

1. Introduction

The emerging coronavirus disease, COVID-19, has been circulated worldwide since January 2020 [1,2,3]. To control its spread, it is crucial to accurately estimate its important epidemiological characteristics such as transmissibility and to predict its further potential spread under different control measures. For this, mathematics and statistics have been used to model the transmission dynamic processes [4,5,6,7]. To obtain reliable estimates of the epidemiological characteristics from modelling analyses, correctly distinguishing and using different outbreak data in an appropriate transmission model is essential [8,9,10,11,12,13].

The transmissibility of an infectious agent describes how easy and fast an infectious disease can spread within a population. It is usually measured by the basic reproduction number (denoted as R0), which is defined as the average number of secondary infections generated by an infectious person introduced into a completely susceptible population [5]. Although many methods of estimating R0 have been developed [14,15], the difficulty in measuring R0 of COVID-19 lies in the fact that it is a novel coronavirus. The knowledge of the well-known coronaviruses such as severe acute respiratory syndrome (SARS) and Middle East respiratory syndrome (MERS) has been borrowed to understand the early transmission dynamics of COVID-19 [11]. Nevertheless, the epidemiological characteristics of COVID-19 appear quite different from those of both SARS and MERS [16]. Further, as R0 is determined by the infectiousness of SARS-CoV-2 and the contact rate between individuals, its value should be different among regions that implemented different control measures. Therefore, the basic knowledge of COVID-19 epidemiological features should be obtained from the epidemic data during outbreaks.

During the initial outbreaks of COVID-19 in China from January to March 2020, the national and provincial governments and public health authorities collected lots of data about the outbreaks and individual cases. These data undoubtedly provide a good chance for us to understand the transmissibility of COVID-19 and the impact of control measures implemented on stopping the spread. The reliable and accurate estimates depend on our understanding of how SARS-CoV-2 is transmitted in the population and the appropriate inference methods to calibrate the transmission models. We noticed that although some modelling studies have been published [17,18,19,20,21,22,23,24], they might have problems in obtaining reliable estimates of epidemiological parameters because of inappropriate use of the outbreak data. For example, when estimating R0, those studies used the daily number of cases, which implicitly summarised local and imported cases. During the early stages of the COVID-19 pandemic, one common feature among the outbreaks, except that in the epicentre, Wuhan city, was the continuous importation due to quick and easy modern transportation. During the outbreaks, the role played by imported cases is different from that of local cases when counting the transmissibility of SARS-CoV-2: local cases as a result of local transmission can increase R0, while imported cases as a potential source of transmission should reduce the estimate of R0. A previous modelling study of the spatial transmission of pandemic flu [25] shows that early importation plays a relatively more important role in estimating transmissibility. Models that mixed up continuous importation with local transmission enlarged the estimate of R0 [18,19,20,21,22,23,24,26], and mislead our assessment. To get a reliable estimate of R0, it is crucial to separate imported cases from local cases [13,21,26,27,28,29].

Many different models have been proposed to describe the transmission dynamics of COVID-19, such as compartmental transmission dynamics models [8,9,10,11,12,13,28,30,31], the renewal equation model [32], machine learning [31], the Richards growth model [33,34], and time series models, such as the ARIMA model [35]. In theory, we need to ask: which one is better to approximate the spread of infection among the population given the data collected? In practice, we must search for the one that can provide a simple and accurate tool for us to estimate the essential epidemiological parameters and predict the trend of spread within the population.

In this study, we took the COVID-19 outbreak from January to February 2020 in Shaanxi province, China as an example to show how to avoid the common pitfall in estimating R0 during the early stage of the COVID-19 pandemic in mainland China and other similar situations and show how to select the best transmission model by comparing their fitting to outbreak data. Two models [17,24] have been used for analysing the Shaanxi outbreak. Bai et al. [17] proposed a Susceptible-Exposed-Diseased-Asymptomatic-Recovered (SEDAR) compartmental transmission model, and Yang et al. [24] used the Richards growth model. The same implicit and problematic assumption in their modelling is that the Shaanxi outbreak was caused by one importation event at the very beginning of the outbreak. Based on this assumption, they obtained nearly the same estimate of the basic reproduction number (2.95 and 3.11, respectively). In view of these two models, we will propose five models to analyze the Shaanxi outbreak: the Richards growth model, the renewal equation model, the SEDAR model, the SEEDAR model in which the exposure interval in SEDAR is divided into two with the latter one being infectious, and the SEEDDAAR model in which not only two exposed classes are present as in the SEEDAR model but there are two classes in both diseased and asymptomatic infections, so infectious periods following gamma-distributions. As we show below, the estimate of the basic reproduction number of COVID-19 during the Shaanxi outbreak under the actual continuous importation is below the critical level, 1.0, which is the consequence of the timely and draconian control measures implemented in Shaanxi province.

Although the Shaanxi outbreak was relatively small over a short period of about one month and might be out of date, it was a typical situation of local outbreaks in mainland China except for the epicentre, Wuhan city, and it represented many similar situations in other countries during the early phases of COVID-19 pandemic. It is therefore hoped that this study provides some useful modelling methods in dealing with similar outbreak situations in future.

2. Materials and Methods

2.1. Data

The outbreak data for COVID-19 were collected from the Shaanxi provincial government website from 23 January to 20 February 2020. Variables used in the line list data for COVID-19 included age, gender, place of origin, exposure date, symptom onset date, hospital admission date, close contacts, cluster number, medical history, symptoms, and travel history. The serial interval and incubation period are estimated by applying the R language function fitdistr to the line list data of the Shaanxi outbreak. Among 245 cases reported during the period, 113 were imported from outside of Shaanxi (Figure 1A). The dates of symptom onset were recorded for 210 cases, from which the delay from symptom onset to reporting was estimated to have a mean of 7.54 days and a standard deviation of 4.12 days. The other 35 cases whose dates of symptom onset were missed were imputed from their reporting dates and the distribution of delays from symptom onset to reporting. The timeline of dates of symptom onset of 245 cases is shown in Figure 1B.

Figure 1.

Figure 1

Figure 1

Timeline of the COVID-19 outbreak in Shaanxi province, China based on (A) reported dates, (B) dates of symptom onset, and (C) modified dates of symptom onset. For modelling’s sake, the daily numbers of imported and local cases have been marked separately.

To provide the direct dates for local transmission modelling, we constructed modified dates of symptom onset for imported cases. If the date of symptom onset of one imported case was earlier than the date of entry into Shaanxi province, then its modified date of symptom onset is its entry date; otherwise, the modified date of symptom onset is its date of symptom onset. There are 19 cases whose dates of the symptom onset were earlier than their entry dates. This modification of symptom onset dates of imported cases will help in modelling the transmission within Shaanxi province. With these arrangements, the timeline of modified dates of symptom onset is shown in Figure 1C.

Once person-to-person transmission of COVID-19 was confirmed and announced on 20 January 2020 in mainland China, the Shaanxi provincial government took rapid actions to launch control measures for COVID-19 containment from 21 January 2020 [36]. The measures implemented in Shaanxi included strict traffic health quarantine, strictly limiting public gathering activities, timely and effective medical treatments, overall coordination of personnel and material allocation, timely release of information according to the law, strengthening publicity and education, professional training, and resolutely safeguarding social stability. These measures effectively controlled the local transmission and quickly reduced the number of importations, as reflected in the epidemic curve shown in Figure 1.

2.2. Models

We proposed five models for analysing the SARS-CoV-2 outbreak in Shaanxi: the Richards growth model, the renewal equation model, and three compartmental models: the Susceptible-Exposed-Diseased-Asymptomatic-Recovered (SEDAR), Susceptible-Exposed-Exposed-Diseased-Asymptomatic-Recovered (SEEDAR), and Susceptible-Exposed-Exposed-Diseased-Diseased-Asymptomatic-Asymptomatic-Recovered (SEEDDAAR) models. Bayesian inference via Markov chain Monte-Carlo (MCMC) sampling was used to estimate R0 by calibrating the five models to Shaanxi outbreak data. The details of models and inference methods are given below.

2.2.1. Richards Growth Model

The Richards growth model is an extended form of logistic growth model, an ecological population growth model used to describe the growth of a population under competition for resources due to carrying capacity [37,38]. It has been widely used in population biology, including infectious disease dynamics [32,33]. For an outbreak caused by C0 seeds of infection at time t0, the Richards growth model states that the cumulative number of cases at time t is given by the following equation [24,33,39]:

Ct=K1+KC0ν1exprνtt01ν.

Here, r is the growth rate, ν is the scaling exponent, and K is the final epidemic size given C0 = C(t0) seeds. If importation is continuing (e.g., there are Ci cases that are imported at ti, i = 0,…, n − 1) and the outbreaks that importation at different times can cause are of the same final size K and growth rate r, then the total cumulative number of cases should be summarized as:

Ct=Ki=0n1Htti1+KCiν1exprνtti1ν. (1)

Here, H(tti) is the Heaviside function: which is 1 if t > ti and 0 otherwise. The daily number of new local cases can be calculated as μ(t) = C(t) − C(t − 1). The basic reproductive number R0 can be calculated from the growth rate and serial interval which is assumed to follow gamma-distribution g(τ;α,β) by [40,41]

R0=10gτ;α,βerτdx=1+rβα. (2)

2.2.2. Renewal Equation Model

It is assumed that, once infected, individuals have an infectivity profile given by a probability distribution ws, dependent on time since infection of the case, s, but independent of calendar time, t. The distribution ws typically depends on individual biological factors such as pathogen shedding or symptom severity. For simplicity, the distribution ws is approximated by the distribution of serial interval (SI), the lag in onset dates of symptoms between an infector and its infectee. In the original renewal equation model, Fraser [42] considers a situation where the only importation is index case(s) at the very beginning of the outbreak and other cases are generated by local transmission (this assumption was also made in its direct application software for estimating the time-varying reproduction number [43]). During the spread of COVID-19 in 2020, the outbreak within a region (except the epicentre, Wuhan) took place with continuous importation. To take this into account, Fraser’s model is slightly modified as in the following (c.f., [44]). Let ct be the number of local cases whose symptoms onset at day t, its expected value is approximated by:

Ect=R0j=1mint1,SI_maxws(cts+Its). (3)

Here, Its is the number of imported cases that have the onset date of symptoms on day ts and ws represents the probability mass function of the SI of length s days, which can be obtained by ws=GsGs1, with G(.) representing the cumulative distribution function of the gamma distribution. The gamma distribution is characterized by its mean SI_mean and standard deviation SI_sd, both of which are to be estimated jointly with R0 from the outbreak data [45]. Because only 19 cases among 113 imported cases had symptom onset before entering Shaanxi province, the assumption that all cases started their infectivity duration within Shaanxi province, which is implicitly required in Equation (3), should be approximately satisfied.

In Equation (3) an implicit assumption made is that the transmissibility (i.e., R0) remained constant during the outbreak duration. This should be reasonable in view of the timely control measures implemented in Shaanxi province: control measures started on 21 January 2021 [36] and raised to their first-class emergency responses on 25 January 2020, just 2 days after the reporting of the first three imported cases in Shaanxi province [16,23]. To estimate the daily-varying transmissibility Rt, Equation (3) is rearranged as:

Rt=ct/j=1mint1,SI_maxws(cts+Its).

That is, Rt can be estimated by the ratio of the number of new infections produced at time step t, ct, to the total infectiousness of infected individuals at time t, given by j=1mint1,SI_maxws(cts+Its), the sum of infection incidence, including both imported and locally generated, up to time step t−1 or the maximum of SI (whichever is the smallest), weighted by the infectivity function ws. Rt is the average number of secondary cases that each infected individual would infect if the conditions remained as they were at time t [43], and it is used to monitor the change in transmissibility along the course of an outbreak.

2.2.3. SEDAR Transmission Model

Figure 2A shows the schematic for the SEDAR compartmental model: susceptible individuals (S) contract SARS-CoV-2 virus from infectious people and then it enters the latent class (E); a fraction (θ) of those exposed after an average latent period (L1) progress to become diseased (I) and the other fraction (1 − θ) remains asymptomatic (A) but becomes infectious after an average latent period (L2). The diseased infections will be detected and admitted to hospital and isolated from the community after an average period of D1 and the asymptomatic cases recover after an average infectious period of D2. The model can be described by the following set of differential equations:

ddtSt=βStIt+ξAt/N
ddtEt=βStIt+ξAt/NθEt/L11θEt/L2
ddtIt=θEt/L1It/D1+Importedt (4)
ddtAt=1θEt/L2At/D2
ddtRt=It/D1+At/D2
Figure 2.

Figure 2

Figure 2

Flow chart of (A) SEDAR transmission model, (B) SEEDAR transmission model, and (C) SEEDDAAR transmission model.

Here, N is the size of the population under investigation (N = 37,330,000 for Shaanxi province) and is assumed to be constant during the outbreak. The definitions of model parameters are given in Table 1. Importantly, the model includes an item for imported cases (i.e., Imported(t) in equation for I(t)) from outside of the population as reported [16]. This is to treat imported cases as the source rather than the results of local transmission from the region under investigation, therefore removing the importation as a result of the local transmissibility.

Table 1.

Parameter estimates of five transmission models.

Parameter Richards Growth Renewal Equation SEDAR SEEDAR SEEDDAAR
Prior Posterior Prior Posterior Prior Posterior Prior Posterior Posterior
Growth rate (r) [0,1.0] 0.02 [0.012,0.032]
Final epidemic size (K) [1,6600] 3315 [56,6521]
Scaling exponent (ν) [0.1,50] 24.51 [0.72,48.81]
Mean of SI (SI_mean) U [3.5,10.0] 4.66 [3.53,7.18]
Standard deviation of SI (SI_sd) U [3.0,15.0] 11.73 [5.85,14.88]
Transmission coefficient (β) U [.001,0.5] 0.155 [0.117,0.186] U [.001,0.5] 0.066 [0.029,0.154] 0.072 [0.032,0.180]
Latent period (L1) * U [1.6,14.0] 1.81 [1.61,2.82] U [1.0,10.0] 5.04 [1.25,9.65] 5.25 [1.28,9.76]
Pre-symptomatic infectious period (L3) U [1.0,10.0] 1.45 [1.04,4.43] 1.45 [1.04,4.43]
Infectious period (D1) of diseased infections * U [3.5,25.0] 3.75 [3.51,5.16] U [1.5,15.0] 4.78 [1.61,14.06] 5.40 [1.68,13.97]
Dispersion parameter (η) U [1.01,50.0] 1.58 [1.06,2.86] U [1.01,50.0] 2.47 [1.56,4.431] U [1.01,50.0] 1.73 [1.08,3.26] 1.71 [1.09,3.18]
R 0 1.13 [1.08,1.21] U [0.05,3.0] 0.61 [0.54,0.68] 0.59 [0.50,0.70] 0.45 [0.30,0.76] 0.53 [0.35,0.85]
DIC 140.2 127.9 175.1 160.5 160.8

*: For three compartmental transmission models, the relative infectivity (ξ) of asymptomatic infections to symptomatic infection is set at 0.5, and the incubation and infectious period for asymptomatic infections are set to be equal to the counterparts of symptomatic infections (i.e., L2 = L1 and D2 = D1). As the proportion of asymptomatic infections is very small (i.e., 1 − θ = 1.1%), the other choices of these three parameters (say ξ = 1, L2 = 2L1 and D2 = 2D1) do not noticeably change the estimates of the model parameters listed here. The priors for the SEEDAR and SEEDDAAR models are the same. : R0 for the Richards growth model is calculated via equation (2) with the gamma-distributed serial interval of mean = 6.29 days and SD = 4.11 days (shape parameter = 2.343, rate parameter = 0.372). : Deviance information criterion (DIC) is a measure of model fitting.

The steady-state solution of the equation system (4) can be easily obtained. The expression for S* (the size of the population susceptible to infection at equilibrium) is:

S*=Nθ/L1+1θ/L2β[θD1/L1+ξ1θD2/L2].

From this, we can obtain the expression of basic reproduction number:

R0N/S*=β[θD1/L1+ξ1θD2/L2/θ/L1+1θ/L2] (5)

Ref [14,30]. In the special situation where L1 = L2, expression (5) reduces to:

R0=βθD1+ξ1θD2. 

2.2.4. SEEDAR Transmission Model

Ferretti et al. [46] show that 30% to 50% of all transmissions are pre-symptomatic transmissions. To take the pre-symptomatic transmission into account, we modify the above SEDAR model by including a secondary exposure compartment (see Figure 2B). For simplicity, this new compartment is assumed to be asymptomatic but of the same infectivity as the symptomatic infections. The corresponding equations are modified as:

ddtSt=βStE2t+It+ξAt/N,
ddtE1t=βStE2t+It+ξAt/NθE1t/L11θE1t/L2,
ddtE2t=θE1t/L1E2t/L3,
ddtIt=E2t/L3It/D1+Importedt, (6)
ddtAt=1θE1t/L2At/D2,
ddtRt=It/D1+At/D2.

Compared with the SEDAR model, a new parameter L3, the duration of the late incubation period in which the infected person can pass the virus on, is introduced and is to be estimated (See Table 1).

Similarly, the basic reproduction number R0 for the SEEDAR model can be obtained by deriving the expression of the equilibrium number of susceptible people, and it is given by:

R0=βθ(L3+D1/L1+ξ1θD2/L2/θ/L1+1θ/L2]. (7)

2.2.5. SEEDDAAR Transmission Model

In view of the empirical observations that the infectious period follows the gamma distribution rather than the usual exponential distribution [47,48,49,50,51,52], we introduce the intermediate compartments by evenly dividing diseased compartment I(t) into I1(t) and I2(t), and dividing asymptomatic compartment A(t) into A1(t) and A2(t). Adding the two new compartments to Equation (6), the model equations for the SEEDDAAR model are given as:

ddtSt=βStE2t+I1t+I2t+ξ(A1t+A2t)/N,
ddtE1t=βStE2t+I1t+I2t+ξ(A1t+A2t)/NθE1t/L11θE1t/L2,
ddtE2t=θE1t/L1E2t/L3,
ddtI1t=E2t/L32I1t/D1+Importedt, (8)
ddtI2t=2I1t/D12I2t/D1,
ddtA1t=1θE1t/L22A1t/D2,
ddtA2t=2A1t/D22A2t/D2,
ddtRt=2I2t/D1+2A2t/D2.

The inclusion of additional compartments in diseased and asymptomatic infections does not change the expression of the basic reproduction number, and the SEEDDAAR model has its basic reproduction number as in Equation (7).

2.3. Inference Method by Calibration to Shaanxi Outbreak

Inference is carried out within the Bayesian framework [53,54], obtained through the combination of the prior distributions and the likelihood function. We denote the set of model parameters to be inferred as Θ = {r, ν, K} for the Richards growth model, Θ = {R0, SI_mean, SI_sd} for the renewal equation model, Θ = {β, L1, D1} for the SEDAR model and Θ = {β, L1, L3, D1} for the SEEDAR and SEEDDAAR models under the special situation where both asymptomatic and symptomatic infections are of the same latent period and infectious period (i.e., L2 = L1 and D2 = D1). For simplicity, the proportion of symptomatic infections (θ) is set at 98.9% as reported [16]. Given the values of parameters Θ for the Richards growth model and the renewal equation model, simulating the time series of local infections, denoted as μ(t), t = tstart, …, tend, is straightforward. Here, tstart and tend represent the start day and end day of the outbreak data collected, respectively. For each set of parameter values of SEDAR, SEEDAR, and SEEDDAAR models, the Runge–Kutta fourth order method is used to solve the model equations and to obtain predicted time series of infections. In the inference of model parameters, directly observed cases of modified symptom onset dates (see the definition in the data above) are used as illustrated in the following. The likelihood function for the observed time series of local cases x(t), t = tstart, …, tend, is given as:

L(Θ|Data)=t=tstarttendΓxt+rtΓrtΓxt+11ηrt11ηxt.

Here, rt=μtη1 with η being the dispersion parameter of the negative binomial distribution. The parameters are estimated using MCMC methods with Gibbs sampling and non-informative flat priors. The boundaries of uniformly distributed priors are set forth as in the literature [16] and the data collected from Shaanxi province (Figure 3). The details of the MCMC sampling method are given below.

Figure 3.

Figure 3

Distributions of (A) serial interval (SI), (B) incubation period, and (C) delay from date of symptom onset to hospital visit. The blue pillars represent the data, and the estimate of the mean and its standard deviation in brackets are obtained by fitting gamma distribution to nonnegative data (red curve) and normal distribution to all data (black curves shown in the graphs).

MCMC Sampling

To propose new values for parameters, we use normal random walk. Suppose the current value of the jth parameter of Θ is Θj(t−1), the new proposal is:

Θj* = Θj(t−1) + σjz.

Here, z is a standard normal variable and σj is the step size of the jth parameter. The normal proposal density is given by:

q(Θ*|Θt1)=1σ2πexpΘ*Θt122σ2.

That is, Θj* follows Nj (t−1), σj2) (normal distribution with mean = Θj (t−1), and standard deviation = σj). The proposal is accepted as the next step of the Markov chain with probability α = min(A,1), where:

A=πΘ*πΘt1L(Θ*|y)L(Θt1|y)q(Θt1|Θ*)q(Θ*|Θt1).

Here, π(.) denotes the prior density, Lj*|y) the likelihood of parameter Θj* given data y. For a truncated normal walk on the range (a,b), the proposal density is given by:

qΘ*|Θt1|a,b=qΘ*|Θt1ΦbΘt1σΦaΘt1σ.

where Φ(.) is the cumulative distribution function of standard normal. The expression for A is consequently modified as:

A=πΘ*πΘt1L(Θ*|y)L(Θt1|y)ΦbΘt1σΦaΘt1σΦbΘ*σΦaΘ*σ.

Sample a uniformly distributed random number (r) between 0 and 1,

Θj (t) = Θj* if r < α (accepted);
Θj (t) = Θj (t−1) otherwise (rejected).

To generate nearly independent samples of model parameters, the samples are to be thinned every 400th observation. To respond to the acceptance rate, the following adaptive procedure is applied: if the acceptance ratio over 400 × 200 iterations is less than 12%, then decrease the jump step to 80% of its current size (i.e., σj = 0.8σj); if it exceeds 40%, then σj = 1.2σj. Otherwise, the jump step σj remains unchanged. To allow the MCMC process to fully converge, a burn-in period of 400,000 iterations is chosen, and the estimates of model parameters are obtained from the further 400,000 iterations.

To compare the performance of the five models [55], the deviance information criterion (DIC), which combines the goodness of fit and model complexity [56], is used. It measures fit via the deviance Dev(Θ) = −2logL(Θ|Data) and complexity by an estimate of the ‘effective number of parameters’ pD = mean(Dev(Θ)) − Dev(mean(Θ)) (i.e., posterior mean deviance minus deviance evaluated at the posterior mean of the parameters). The DIC is calculated as:

DIC = Dev(mean(Θ)) + 2pD = mean(Dev(Θ)) + pD.

The model that has the smallest DIC is the best.

3. Results

3.1. Estimates of SI and Incubation Period from Line List Data

The results are shown in Figure 3. Fitting the nonnegative data to gamma distributions, the estimates are: From 85 pairs of infector–infectees observed during the outbreak, the SI is estimated to have a mean of 6.29 days and a SD of 4.11 days (so the fitted gamma distribution has a shape parameter of α = 2.34 and a rate parameter of β = 0.37). From 100 cases that had dates of exposure and symptom onset, the incubation period is estimated to have a mean of 6.76 days and a SD of 4.41 days, and the delay from the onset of symptoms to hospitalization from 222 cases has a mean of 3.71 days and a SD of 2.83 days. If fitting all collected data (including both negative and positive) to normal distributions, the estimates will be shorter (Figure 3). These estimates are consistent with the system review of both the serial interval and the incubation period [57].

3.2. Estimate of R0 in Shaanxi Outbreak

3.2.1. Richards Growth Model

Model fitting to the daily number of local cases suggests the growth rate r = 0.020 with a 95% confidence interval (95% CI): 0.012, 0.032, and the final epidemic size K = 3315 (95% CI: 56, 6521) (Table 1). Based on the estimate of gamma-distributed serial interval (Figure 3), the basic reproduction number is calculated using Formula (2) to be 1.13 (95% CI: 1.08, 1.21). We note that although the prediction of the Richards growth model can be fitted to the daily number of local cases within the outbreak period of 30 days, the continuing increase in the daily number of local cases that the model predicts obviously deviated from the actual observations after the outbreak (Figure 4A). That is, even though the model calibration performs well, the external validation is bad. Our estimate of the growth rate is very near to zero, the nonnegative limit. This is in sharp contrast with Yang et al. 2021 [24] who obtained an estimate of growth rate r = 0.23 per day by assuming one importation event and mixing up imported cases thereafter with local cases in their modelling study. This points out the limitation of applying the Richards growth model to infection spread processes. In general, infections can either increase, decrease, or remain the same within a population (i.e., r can be positive, negative, or zero, with R0 being larger, less than, or equal to 1.0). Applying the Richards growth model to an infection spread process, it is implicitly assumed that its growth rate is positive and R0 >1, which is wrong for the situation of well-controlled infections such as COVID-19 in Shaanxi province during January and February of 2020.

Figure 4.

Figure 4

Fitting of (A) the Richards growth model, (B) the renewal equation model, (C) the SEDAR model, (D) the SEEDAR model, and (E) the SEEDDAAR model to outbreak data of symptom onset dates. Red dots represent the imported cases, and the blue triangles are the cases locally transmitted in Shaanxi province. The thick green line represents the median of MCMC samples, and the thin lines represent their upper and lower levels of 95% confidence intervals.

3.2.2. Renewal Equation Model

Bayesian inference suggests the basic reproduction number (R0) has a median of 0.61 and 95% CI from 0.54 to 0.68 (Table 1). The SI is estimated to have a mean of 4.66 days and an SD of 11.73 days, which is shorter than but comparable with the direct observation of SI from the outbreak (Figure 3). The model projection into next month (Figure 4B) indicates that the outbreak will die out within two weeks (i.e., the end of February 2020) and is unlikely to generate any further local cases under the current restriction measures.

The time-varying reproduction number Rt shown in Figure 5 demonstrates how the transmissibility changed along the course of the outbreak. Rt increased to about 2.0 within the first week, and then reduced to low values, but occasionally exceeding the critical value of 1.0. Its overall average is 0.61, which is equal to the median of posterior R0 in the above model fitting. The change of Rt reflects the stochasticity of transmission events within the Shaanxi outbreak.

Figure 5.

Figure 5

The effective reproductive number (Rt) along the course of the outbreak in Shaanxi province, China under the SI distributions of SI_mean = 4.6 days, SI_sd = 11.7 days (the Maximum likelihood estimate of SI from model calibration of the renewal equation). Rt is evaluated by averaging over one, two, and four days.

3.2.3. SEDAR Model

The calibration of the SEDAR model under the situation with equal incubation and infectious periods for both symptomatic and asymptomatic infection shows that: R0 is estimated at 0.59 with 95% CI from 0.51 to 0.71 (Table 1). The incubation period is 1.8 days (95% CI: 1.6, 2.9), and the infectious period is 3.8 days (95% CI: 3.5, 5.3). The SEDAR model fitting and its prediction over one month ahead are shown in Figure 4C. Sensitivity analyses (data not shown) show that nearly the same estimates of model parameters are obtained when considering different values of latent period (L2) and infectious period (D2) for asymptomatic infections and the relative infectivity (ξ) of asymptomatic infections to symptomatic infections. This reflects the fact that, in the Shaanxi outbreak, the asymptomatic infections occupied a very small proportion of all infections (1.1%) [16] and therefore had small effects on model performance.

3.2.4. SEEDAR Model

The R0 is estimated at 0.45 with 95% CI from 0.30 to 0.76 (Table 1). The incubation period of symptomatic infection is 5.0 days (95% CI: 1.3, 9.7), which is consistent with the observed values (mean = 6.76 days and sd = 4.41 days), and the infectious period of symptomatic infections is 4.8 days (95% CI: 1.6, 14.1), which is longer than the delay from the onset date of symptoms to hospitalization: mean = 3.71 days and sd=2.83 days (Figure 3). The duration of pre-symptomatic transmission (L3) is estimated at 1.5 days (95% CI: 1.0, 4.4 days); this suggests the fraction of transmission from strictly pre-symptomatic infections was about 1.5/(1.5 + 4.8) =24%, which is in agreement with previous estimates [46]. The SEEDAR model fits well with the observed data and predicts that the outbreak will die out within about three weeks (Figure 4D).

3.2.5. SEEDDAAR Model

The R0 is estimated at 0.53 with 95% CI from 0.35 to 0.85 (Table 1). The incubation period of symptomatic infection is 5.3 days (95% CI: 1.3, 9.8), and the infectious period of symptomatic infection is 5.4 days (95% CI: 1.7, 14.0). The duration of pre-symptomatic transmission (L3) is estimated at 1.5 days (95% CI: 1.0 to 4.4 days). Those estimates of model parameters are very similar to those of the SEEDAR model. Similar to the SEEDAR model, the SEEDDAAR model equally well fits the observed data and predicts that the outbreak will die out within about three weeks (Figure 4E).

4. Discussion

In this study, five transmission models were proposed to model the COVID-19 epidemic within Shaanxi province of China from early January to late February 2020. By distinguishing imported and local cases in their contribution to local transmission dynamics, we show that the basic reproduction number R0 of COVID-19 in the Shaanxi outbreak was well below the critical value of 1.0. This indicates that SARS-CoV-2 cannot self-sustain under the current control measures within Shaanxi province, China, and would stop once the importation of COVID-19 cases was halted. Our model successfully predicted the actual epidemic situation in Shaanxi province from late February 2020.

The estimates of R0 from the renewal equation and the SEDAR models are close to each other, and its estimates from the SEEDAR and SEEDDAAR models are lower; nevertheless, their 95% CIs are closely overlapped. Overall, the estimate of R0 is in the range from 0.45 to 0.61. The model fittings to the local cases, shown in Figure 4, indicate that the renewal equation model provides the best fit to the observations and the SEDAR model is the worst. This is further confirmed by the values of DIC in Table 1 [55]: 127.9, 175.1, 160.5, and 160.8 for the renewal equation, and the SEDAR, SEEDAR, and SEEDDAAR models, respectively. Furthermore, the better performance of the SEEDAR and SEEDDAAR models than the SEDAR model confirms the existence of pre-symptomatic transmission [46]. It is worth mentioning that the SEEDDAAR model that has its infectious periods following gamma distribution does not appear better than SEEDAR that has its infectious period following simple exponential distribution. The Richards growth model, which is borrowed from ecological population dynamics [37,38], can provide a better model fit to the daily number of local cases than three compartmental transmission models (i.e., SEDAR, SEEDAR, and SEEDDAAR). However, the increasing trend of infections after the first month, which the Richards growth model predicts, deviates from the actual observation and hence invalidates the Richards growth model as an appropriate model for the Shaanxi outbreak.

It is worth emphasizing that although the renewal equation model is the simplest in its structure, it gives the best model fit [52]. Given the distribution of SI of COVID-19, it is straightforward to obtain the estimate of the R0 [58]. In this study, we perform a joint estimation of R0 and SI, and the results agree well with three compartmental models in estimation of R0 and the empirical knowledge of SI [16,57]. Nevertheless, it should be kept in mind that the successful performance of the joint estimation of R0 and SI in this study may be conditional on the very low proportion (i.e., 1.1%) of asymptomatic infections [58].

One important issue worth pointing out is the continuous importation along the course of an outbreak within one region, except for the epicenter, Wuhan city, China, during the early stages of the COVID-19 pandemic in mainland China. This spectacular feature, unlike previous infectious disease pandemics (such as the 2003 SARS pandemic and the 2009 influenza pandemic), may reflect the rapid and huge movements of modern human beings. If assuming the earliest importation as the only index case(s), the transmission dynamics cannot be appropriately investigated and might be misled [17,24]. Both Bai et al. [17] and Yang et al. [24] also modelled the Shaanxi outbreak but mixed up imported cases with local cases; they obtained estimates of R0 of about 3.0. Simple reasoning will show that this estimate is problematic. Let us consider a situation where all the 132 cases were generated within Shaanxi province only by the 113 imported cases, a rough estimate is R0 = 132/113 ≈ 1.2. Some local cases might have been infected by other early local cases rather than directly from imported cases, which implies that the actual R0 should be less than 1.2. With the similar treatments of continuous importation, the high and problematic estimates of R0 for outbreaks in the major cities of China (except the epicentre, Wuhan city) were also reported [20,21]. Based on estimates of their SEDAR model parameters, Bai et al. [17] predicted that the Shaanxi outbreak would last until April 2020, which is more than one month longer than the actual occurrence. Our analyses show that the occurrence of the Shaanxi outbreak was mainly due to the large and continuous importation rather than the high local transmissibility of COVID-19 within the province. Furthermore, our prediction is consistent with what happened in Shaanxi province.

In modelling the COVID-19 transmission over the whole of mainland China, we found that R0 was estimated at 2.23 before 8th February 2020 and then it dropped to 0.04 [30]. Hao et al. [8] also confirmed the effectiveness of the timely prevention and control measures implemented in China in bringing the R0 well below the critical level of 1.0. To check whether there was any potential breaking point in the transmissibility of COVID-19 within the Shaanxi outbreak, we calculated the instantaneous reproduction number Rt [43]. The result shown in Figure 5 indicates that no clear pattern emerged that supported a potential breaking point in transmissibility although Rt exceeded 1.0 on five days. In contrast, having mixed up imported cases with local cases, Yang et al. [24] used the renewal equation method [43] to obtain a time-varying reproduction number (Rt), which persistently decreased over time and stayed beyond the critical level of 1.0 over more than half the course of the outbreak.

Our estimate of R0 for the Shaanxi outbreak sharply differs from other studies which suggest R0 = 2–7 [16,49,59,60] for SARS-CoV-2. In theory, R0 is determined by the infectiousness of SARS-CoV-2 as well as the contact rate between people [5]. In the situation where no vaccine and effective drugs were available to protect people against the virus, the result of R0 < 1 is due to the highly reduced contact rate between people [30]. This resulted from the timely and strong control measures implemented within Shaanxi province soon after it was announced in public on 20 January 2020 that COVID-19 could be transmitted among people. On the other hand, this indicates the success of the interventions executed in Shanxi province, China.

5. Conclusions

Modern inference methodology and mathematical theory can help reveal the unobserved transmission dynamic process and hence provide valuable information for us to understand and control the spread of COVID-19. However, it is important to separate continuous importation from local transmission when modelling the local transmission dynamics of COVID-19. The renewal equation model, albeit being simple in model structure, provides better model fitting and therefore is a practical candidate for analyzing transmission dynamics and monitoring the change in transmissibility.

Author Contributions

Conceptualization, X.-S.Z. and W.L.; methodology, X.-S.Z.; software, X.-S.Z.; validation, X.-S.Z., H.X. and Z.C.; formal analysis, X.-S.Z., H.X., Z.C. and W.L.; investigation, X.-S.Z. and H.X.; resources, X.-S.Z.; data curation, H.X. and Z.C.; writing—original draft preparation, X.-S.Z.; writing—review and editing, X.-S.Z.; visualization, X.-S.Z.; project administration, W.L.; funding acquisition, W.L. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Ethical review and approval were waived for this study since this is a theoretical study with the personal identifications being removed from the outbreak data.

Informed Consent Statement

Patient consent was waived due to patients’ identification being removed from the outbreak data.

Data Availability Statement

The data supporting reported results are provided in Figure 1 and Figure 3.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

Funding Statement

This research was funded by UKHSA, National Nature Science Foundation of China, grant number 81860607; and Innovative Research Team of Yunnan Province (2019(6)), China. The APC was funded by Innovative Research Team of Yunnan Province (2019(6)).

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Worldometer Coronavirus. [(accessed on 19 September 2021)]. Available online: https://www.worldometers.info/coronavirus/
  • 2.World Health Organization [(accessed on 31 August 2021)]; Available online: https://www.who.int/publications/m/item/weekly-epidemiological-update-on-COVID-19.
  • 3.Hale T., Angrist N., Goldszmidt R., Kira B., Petherick A., Phillips T., Webster S., Cameron-Blake E., Hallas L., Majumdar S., et al. A global panel database of pandemic policies (Oxford COVID-19 Government Response Tracker) Nat. Hum. Behav. 2021;5:529–538. doi: 10.1038/s41562-021-01079-8. [DOI] [PubMed] [Google Scholar]
  • 4.Ross R. The Prevention of Malaria. John Murray; London, UK: 1911. [Google Scholar]
  • 5.Anderson R.M., May R.M. Infectious Diseases of Humans: Dynamics and Control. Oxford University Press; Oxford, UK: 1991. [Google Scholar]
  • 6.Heesterbeek J.A.P., Diekmann O. Mathematical Epidemiology of Infectious Diseases: Model Building, Analysis and Interpretation. John Wiley & Sons; Hoboken, NJ, USA: 2000. [Google Scholar]
  • 7.Keeling M.J., Rohani P. Modelling Infectious Diseases in Human and Animals. Princeton University Press; Princeton, NJ, USA: 2007. [Google Scholar]
  • 8.Hao X., Cheng S., Wu D., Wu T., Lin X., Wang C. Reconstruction of the full transmission dynamics of COVID-19 in Wuhan. Nature. 2020;584:420–424. doi: 10.1038/s41586-020-2554-8. [DOI] [PubMed] [Google Scholar]
  • 9.Kucharski A.J., Russell T.W., Diamond C., Liu Y., Edmunds J., Funk S., Eggo R.M., Sun F., Jit M., Munday J.D., et al. Early dynamics of transmission and control of COVID-19: A mathematical modelling study. Lancet Infect. Dis. 2020;20:553–558. doi: 10.1016/S1473-3099(20)30144-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Lai S., Ruktanonchai N.W., Zhou L., Proper O., Luo W., Floyd J.R., Wesolowski A., Santillana M., Zhang C., Du X., et al. Effect of non-pharmaceutical interventions for containing the COVID-19 outbreak in China. Nature. 2020;585:410–413. doi: 10.1038/s41586-020-2293-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Wu J.T., Leung K., Leung G.M. Nowcasting and forecasting the potential domestic and international spread of the 2019-nCoV outbreak originating in Wuhan, China: A modelling study. Lancet. 2020;395:689–697. doi: 10.1016/S0140-6736(20)30260-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Zhang J., Litvinova M., Wang W., Wang Y., Deng X., Chen X., Li M., Zheng W., Yi L., Chen X., et al. Evolving epidemiology and transmission dynamics of coronavirus disease 2019 outside Hubei province, China: A descriptive and modelling study. Lancet Infect. Dis. 2020;20:793–802. doi: 10.1016/S1473-3099(20)30230-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Adekunle A.I., Adegboye O.A., Gayawan E., McBryde E.S. Is Nigeria really on top of COVID-19? Message from effective reproduction number. Epidemiol. Infect. 2020;148:e166. doi: 10.1017/S0950268820001740. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Heffernan J.M., Smith R.J., Wahl L.M. Perspectives on the basic reproductive ratio. J. R. Soc. Interface. 2005;2:281–293. doi: 10.1098/rsif.2005.0042. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Vynnycky E., White R.G. An Introduction to Infectious Disease Modelling. Oxford University Press; Oxford, UK: 2010. [Google Scholar]
  • 16.Biggerstaff M., Cowling B.J., Cucunubá Z.M., Dinh L., Ferguson N.M., Gao H., Hill V., Imai N., Johansson M.A., Kada S., et al. Early Insights from Statistical and Mathematical Modeling of Key Epidemiologic Parameters of COVID-19. Emerg. Infect. Dis. 2020;26:e201074. doi: 10.3201/eid2611.201074. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Bai Y., Liu K., Chen Z., Chen B., Shao Z. Early transmission dynamics of novel coronavirus pneumonia Epidemic in Shaanxi Province. Chin. J. Nosocomiol. 2020;30:834–838. [Google Scholar]
  • 18.Wu W., Bai R., Li D., Feng A., Xu A., Lü J. Preliminary prediction of the epidemic trend of 2019 novel coronavirus (2019-nCoV) pneumonia in Guangdong province. J. Jinan Univ. 2020;41:1–6. [Google Scholar]
  • 19.D’Arienzo M., Coniglio A. Assessment of the SARS-CoV_2 basic reproduction number, R0, based on the early phase of COVID-19 outbreak in Italy. Biosaf. Health. 2020;2:57–59. doi: 10.1016/j.bsheal.2020.03.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Cheng Q., Liu Z., Cheng G., Huang J. Heterogeneity and effectiveness analysis of COVID-19 prevention and control in major cities in China through time-varying reproduction number estimation. Sci. Rep. 2020;10:21953. doi: 10.1038/s41598-020-79063-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Han K., Jia W., Cai W., Wang S., Song Y., Yang S., Li J., Kou F., Liu M., He Y., et al. Estimation of real-time basic reproduction number and epidemic status of 20-19 novel coronavirus disease (COVID-19) in first-tier cities. Acad. J. Chin. PLA Med. Sch. 2020;4:421–426. [Google Scholar]
  • 22.Song P., Chen C., Lou Y., Jiang H., Li W., Zhu L. Assessing effectiveness of integrated strategies for preventing and controlling the outbreak of COVID-19 and predicting impact of opening exit channels to leave Hubei Province. Chin. J. Appl. Prob. Stat. 2020;36:321–330. [Google Scholar]
  • 23.Yuan J., Li M., Lv G., Lu Z.K. Monitoring transmissibility and mortality of COVID-19 in Europe. Int. J. Infect Dis. 2020;95:311–315. doi: 10.1016/j.ijid.2020.03.050. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Yang L., Wang C., Shang H., Zhang X., Zhang L., Wang K. Epidemiological parameter estimation and characteristics of the novel coronavirus (COVID-19) transmission in Shaanxi Province. J. Pub. Health Prev. Med. 2021;32:195–199. [Google Scholar]
  • 25.Birrell P.J., Zhang X.-S., Pebody R.G., Gay N.J., De Angelis D. Reconstructing a spatially heterogeneous epidemic: Characterising the geographic spread of 2009 A/H1N1pdm infection in England. Sci. Rep. 2016;6:29004. doi: 10.1038/srep29004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Chong K.C., Cheng W., Zhao S., Ling F., Mohammad K.N., Wang M., Zee B.C., Wei L., Xiong X., Liu H., et al. Transmissibility of coronavirus disease 2019 in Chinese cities with different dynamics of imported cases. PeerJ. 2020;8:e10350. doi: 10.7717/peerj.10350. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Yuan H.Y., Blakemore C. The impact of multiple non-pharmaceutical interventions on controlling COVID-19 outbreak without lockdown in Hong Kong: A modelling study. Lancet Reg. Health West. Pac. 2021;20:100343. doi: 10.1016/j.lanwpc.2021.100343. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Yuan H.Y., Blakemore C. The impact of contact tracing and testing on controlling COVID-19 outbreak without lockdown in Hong Kong: An observational study. Lancet Reg. Health West. Pac. 2022;20:100374. doi: 10.1016/j.lanwpc.2021.100374. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Bernal J.L., Panagiotopoulos N., Byers C., Vilaplana T.G., Boddington N., Zhang X.-S., Charlett A., Elgohari S., Coughlan L., Whillock R., et al. Transmission dynamics of COVID-19 in household and community settings in the United Kingdom, January to March 2020. Eurosurveillance. 2022;27:2001551. doi: 10.2807/1560-7917.ES.2022.27.15.2001551. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Zhang X.S., Vynnycky E., Charlett A., De Angelis D., Chen Z.J., Liu W. Transmission dynamics and control measures of COVID-19 outbreak in China: A modelling study. Sci. Rep. 2021;11:2652. doi: 10.1038/s41598-021-81985-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Yang Z., Zeng Z., Wang K., Wong S.-S., Liang W., Zanin M., Liu P., Cao X., Gao Z., Mai Z., et al. Modified SEIR and AI prediction of the epidemics trend of COVID-19 in China under public health interventions. J. Torac. Dis. 2020;12:165–174. doi: 10.21037/jtd.2020.02.64. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Flaxman S., Mishra S., Gandy A., Unwin H.J.T., Mellan T.A., Coupland H., Whittaker C., Zhu H., Berah T., Eaton J.W., et al. Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe. Nature. 2020;584:257–261. doi: 10.1038/s41586-020-2405-7. [DOI] [PubMed] [Google Scholar]
  • 33.Lee S.Y., Lei B., Mallick B. Estimation of COVID-19 spread curves integrating global data and borrowing information. PLoS ONE. 2020;15:e0236860. doi: 10.1371/journal.pone.0236860. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Dahal S., Luo R., Subedi R.K., Dhimal M., Chowell G. Transmission Dynamics and Short-Term Forecasts of COVID-19: Nepal 2020/2021. Epidemiologia. 2021;2:639–659. doi: 10.3390/epidemiologia2040043. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Swaraj A., Verma K., Kaur A., Singh G., Kumar A., Melo L., Sale D. Implementation of stacking based ARIMA model for prediction of COVID-19 cases in India. J. Biomed. Inform. 2021;121:103887. doi: 10.1016/j.jbi.2021.103887. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Shaanxi Provincial Health Committee. [(accessed on 18 October 2020)]; Available online: http://sxwjw.shaanxi.gov.cn/sy/wjyw/index_66.html.
  • 37.Richards F. A flexible growth function for empirical use. J. Exp. Bot. 1959;10:290–300. doi: 10.1093/jxb/10.2.290. [DOI] [Google Scholar]
  • 38.Nelder J.A. 182. note: An alternative form of a generalized logistic equation. Biometrics. 1962;18:614–616. doi: 10.2307/2527907. [DOI] [Google Scholar]
  • 39.Hsieh Y.-H. 2015 Middle East Respiratory Syndrome Coronavirus (MERS-CoV) nosocomial outbreak in South Korea: Insights from modeling. PeerJ. 2015;3:e1505. doi: 10.7717/peerj.1505. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Wallinga J., Lipsitch M. How generation intervals shape the relationship between growth rates and reproductive number. Proc. Biol. Sci. 2007;27:599–604. doi: 10.1098/rspb.2006.3754. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Nishiura H., Chowell G., Safan M., Castillo-Chavez C. Pros and cons of estimating the reproduction number from early epidemic growth rate of influenza A (H1N1) 2009. Theor. Biol. Med. Model. 2010;7:1. doi: 10.1186/1742-4682-7-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Fraser C. Estimating Individual and Household Reproduction Numbers in an Emerging Epidemic. PLoS ONE. 2007;2:e758. doi: 10.1371/journal.pone.0000758. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Cori A., Ferguson N.M., Fraser C., Cauchemez S. A new Framework and software to estimate time varying reproduction numbers during epidemics. Am. J. Epidemiol. 2013;178:1505–1512. doi: 10.1093/aje/kwt133. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Roberts M.G., Nishiura H. Early Estimation of the Reproduction Number in the Presence of Imported Cases: Pandemic Influenza H1N1-2009 in New Zealand. PLoS ONE. 2011;6:e17835. doi: 10.1371/journal.pone.0017835. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Griffin J.T., Garske T., Ghani A.C., Clarke P.S. Joint estimation of the basic reproduction number and generation time parameters for infectious disease outbreaks. Biostatistics. 2011;12:303–312. doi: 10.1093/biostatistics/kxq058. [DOI] [PubMed] [Google Scholar]
  • 46.Ferretti L., Ledda A., Wymant C., Zhao L., Ledda V., Abeler-Dörner L., Kendall M., Nurtay A., Cheng H.-Y., Ng T.-C., et al. The timing of COVID-19 transmission. medRxiv. 2020 doi: 10.2139/ssrn.3716879. [DOI] [Google Scholar]
  • 47.Wearing H.J., Rohani P., Keeling M.J. Appropriate models for the management of infectious diseases. PLoS Med. 2005;2:e174. doi: 10.1371/journal.pmed.0020174. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Pasetto D., Lemaitre J.C., Bertuzzo E., Gatto M., Rinaldo A. Range of reproduction number estimates for COVID-19 spread. Biochem. Biophys. Res. Commun. 2021;538:253–258. doi: 10.1016/j.bbrc.2020.12.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Xiang Y., Jia Y., Chen L., Guo L., Shu B., Long E. COVID-19 epidemic prediction and the impact of public health interventions: A review of COVID-19 epidemic models. Infect. Dis. Model. 2021;6:324–342. doi: 10.1016/j.idm.2021.01.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Röst G., Bartha F.A., Bogya N., Boldog P., Dénes A., Ferenci T., Horváth K.J., Juhász A., Nagy C., Tekeli T., et al. Early phase of the COVID-19 outbreak in Hungary and post-lockdown scenarios. Viruses. 2020;12:708. doi: 10.3390/v12070708. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Polver M., Previdi F., Mazzoleni M., Zucchi A. A SIAT3 HE model of the COVID-19 pandemic in Bergamo, Italy. IFAC Pap. 2021;54:263–268. doi: 10.1016/j.ifacol.2021.10.266. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Champredon D., Dushoff J., Earn D.J.D. Equivalence of the Erlang-distributed SEIR epidemicmodel and the renewal equation. SIAM J. Appl. Math. 2018;78:3258–3278. doi: 10.1137/18M1186411. [DOI] [Google Scholar]
  • 53.Bettencourt L.M.A., Ribeiro R.M. Real time Bayesian estimation of the epidemic potential of emerging infectious diseases. PLoS ONE. 2008;3:e2185. doi: 10.1371/journal.pone.0002185. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Cauchemez S., Carrat F., Viboud C., Valleron A.J., Boëlle P.Y. A Bayesian MCMC approach to study transmission of influenza: Application to household longitudinal data. Stat. Med. 2004;23:3469–3487. doi: 10.1002/sim.1912. [DOI] [PubMed] [Google Scholar]
  • 55.Burnham K.P., Anderson D.R. Model Selection and Multimodel Inference: A Practical Information—Theoretic Approach. 2nd ed. Springer; New York, NY, USA: 2002. [Google Scholar]
  • 56.Spiegelhalter D.J., Best N., Carlin B.P., van der Linde A. Bayesian measures of model complexity and fit. J. Roy. Stat. Soc. B. 2002;64:583–639. doi: 10.1111/1467-9868.00353. [DOI] [Google Scholar]
  • 57.Alene M., Yismaw L., Assemie M.A., Ketema D.B., Gietaneh W., Birhan T.Y. Serial interval and incubation period of COVID-19: A systematic review and meta-analysis. BMC Infect. Dis. 2021;21:257. doi: 10.1186/s12879-021-05950-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Chen Z.J., Wei T., Li H.D., Feng L.H., Liu H.N., Li N., Gu R., Zhang N., Lu W., Zhang X.-S. Renewal equation model for the COVID-19 in Yunnan. Chin. Med. Humanit. 2021;7:53–55. [Google Scholar]
  • 59.Liu Y., Gayle A.A., Wilder-Smith A., Rocklov J. The reproductive number of COVID-19 is higher compared to SARS coronavirus. J. Travel Med. 2020;27:taaa021. doi: 10.1093/jtm/taaa021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Achaiah N.C., Subbarajasetty S.B., Shetty R.M. R0 and Re of COVID-19: Can We Predict When the Pandemic Outbreak will be Contained? Indian J. Crit. Care Med. 2020;24:1125. doi: 10.5005/jp-journals-10071-23649. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The data supporting reported results are provided in Figure 1 and Figure 3.


Articles from Tropical Medicine and Infectious Disease are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES