Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 May 21;16(5):e0252019. doi: 10.1371/journal.pone.0252019

Dynamical SPQEIR model assesses the effectiveness of non-pharmaceutical interventions against COVID-19 epidemic outbreaks

Daniele Proverbio 1,*, Françoise Kemp 1, Stefano Magni 1, Andreas Husch 1, Atte Aalto 1, Laurent Mombaerts 1, Alexander Skupin 1, Jorge Gonçalves 1, Jose Ameijeiras-Alonso 2, Christophe Ley 3
Editor: Michele Tizzoni4
PMCID: PMC8139462  PMID: 34019589

Abstract

Against the current COVID-19 pandemic, governments worldwide have devised a variety of non-pharmaceutical interventions to mitigate it. However, it is generally difficult to estimate the joint impact of different control strategies. In this paper, we tackle this question with an extended epidemic SEIR model, informed by a socio-political classification of different interventions. First, we inquire the conceptual effect of mitigation parameters on the infection curve. Then, we illustrate the potential of our model to reproduce and explain empirical data from a number of countries, to perform cross-country comparisons. This gives information on the best synergies of interventions to control epidemic outbreaks while minimising impact on socio-economic needs. For instance, our results suggest that, while rapid and strong lockdown is an effective pandemic mitigation measure, a combination of social distancing and early contact tracing can achieve similar mitigation synergistically, while keeping lower isolation rates. This quantitative understanding can support the establishment of mid- and long-term interventions, to prepare containment strategies against further outbreaks. This paper also provides an online tool that allows researchers and decision makers to interactively simulate diverse scenarios with our model.

Introduction

The current global COVID-19 epidemic has led to significant impairments of public life world-wide. To mitigate the spread of the virus and to prevent dramatic situations in the healthcare systems, many countries have implemented a combination of rigorous measures like lockdown, isolation of symptomatic cases and the tracing, testing, and quarantine of their contacts. In order to obtain information about the efficacy of such measures, a quantitative understanding of their impact is necessary. This can be based on statistical methods [1] and on epidemiological models [2]. Epidemiological modeling in particular can provide detailed mechanisms for the epidemic dynamics and allow investigating how epidemics will develop under different assumptions.

Preliminary efforts have been made to quantify the contribution of different policy interventions [3], but these rely on complex models based on a number of assumptions. Instead, we base our study on a classical SEIR-like epidemiological model. SEIR models are minimal mechanistic models that consider individuals transitioning through Susceptible → Exposed → Infectious → Removed state during the epidemics [4]. The essential control parameter is the basic reproduction number R0 [5], that worldwide non-pharmaceutical mitigation strategies aim at reducing below the threshold value 1. Several literature studies consider the effect of single interventions in SEIR-like models [68]. We aim at considering the added value of early interventions, namely those that target Susceptible and Exposed people, and the effect of different combinations of control strategies on the infection curve. To do so, we incorporate additional compartments reflecting different categories of control strategies, identified by socio-political studies [9]. In particular, the model focuses on four main mitigation programs: social distancing (lowering the rate of social contacts), active protection (decreasing the number of susceptible people), active removal of latent asymptomatic carriers [10], and active removal of infectious carriers. This study investigates how these programs achieve mitigation both individually and combined, first conceptually and then by cross-country comparison. By our modelling choice, we consider how and how much preventive interventions can supplement the quarantining of contagious individuals. We ultimately show that analogous containment levels of the infectious curve can be achieved by alternative synergies of non-pharmaceutical interventions. This information can supply Government decisions, helping to avoid overloading the healthcare system and to minimise stressing the economic system (due to prolonged lockdown). We expect our model, together with its interactive online tool, to contribute to crucial tasks of decision making and to prepare containment strategies against further outbreaks.

Materials and methods

This study links policy measures to epidemiological modelling, focusing on how the dynamics of the infectious curve is controlled by several interventions. Initially, we perform a conceptual analysis, like in other works [11, 12]. Then, we investigate how well the considered control synergies reproduce and explain the evolution of empirical data from the first COVID-19 wave in six different countries. By doing so, we hope to contribute to discussions about the relevance of such conceptual strategies in real-world conditions. In this section, we illustrate the modelling choices and the use of data.

The classical SEIR model

SEIR models are continuous-time, mass conservative compartment-based models of infectious diseases [4, 13]. They assume a homogeneously mixing population (or fully connected graphs) and focus on the evolution of mean properties of the closed system. All of these models are classical and widely used tools to investigate the principal mechanisms governing the spread of infections and their dynamics. There is a broad range of such models, from more conceptual to more realistic versions, e.g. SEIR with delay [14], spatial coupling [15, 16], extended compartments [17], or those that consider progression of treatments and age distribution [18].

Main compartments of SEIR models (see Fig 1, framed) are: susceptible S (the pool of individuals socially active and at risk of infection), exposed E (corresponding to latent carriers of the infection), infectious I (individuals having developed the disease and being contagious) and removed R (those that have processed the disease, being either recovered or dead). The model’s default parameters are the average contact rate β, the inverse of mean incubation period α and the inverse of mean contagious period γ. When focusing on infection dynamics rather than patients’ fate, the latter combines recovery and death rate [19]. From these parameters, epidemiologists calculate the “basic reproduction number” R0 = β/γ [20] at the epidemic beginning. During the epidemic progression, isolation after diagnosis, vaccination campaigns and active mitigation measures are in action. Hence, we speak of “effective reproduction number” R^(T) [21].

Fig 1. Scheme of the SPQEIR model.

Fig 1

The basic SEIR model (framed blue blocks) is extended by the red blocks to the SPQEIR model. Parameters that are linked to mitigation strategies are shown in red. Interpretation and values of parameters are given in Table 2.

Data and analyzed countries

When investigating the ability of our conceptual model to explain mitigation, we compared it with empirical data. To do this, we considered the main non-pharmaceutical interventions applied by several countries, by integrating multi-disciplinary information. In fact, governments worldwide have issued a number of social measures, including those for public health safeguard, economic support, movement restriction and non-pharmaceutical interventions to hamper disease spreading. Scholars from political sciences and sociology have recorded and classified such measures [22, 23]. Among the resources listed on the World Health Organization “Tracking Public Health and Policy Measures” [9], we used information from the ACAPS database [24] that contains a curated categorization of policy measures. ACAPS is an independent, non-profit information provider helping humanitarian actors to respond more effectively to disasters. The ACAPS analysis team has aggregated and classified interventions from different sources (media, governments and international organizations), for all countries and in time. Mitigation measures against the epidemic are classified under “Movement restrictions”, “Lockdown”, “Social Distancing” and “Monitoring and Surveillance”. Our modelling choice is based on these categories, which are reflected by additional compartments to the classical SEIR model (see next section).

Epidemiological data for all selected countries and regions were obtained from the COVID-19 Data Repository by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University [25]. The data are from 22 Jan 2020 to 08 July 2020. Lombardy data were obtained from the Protezione Civile Italiana data repository “Dati COVID-19 Italia” [26], from 22 Feb 2020 to 08 July 2020. We acknowledge that the quality of data of early detection of COVID-19 cases is often associated with limited testing capabilities, which could bias subsequent analysis. However, across the analysed countries, the share of positive tests was similar (see e.g. [27]), and no significant deviation from expected dynamics was observed by studies applying Benford’s law [28, 29], possibly indicating that these data still capture to a reasonable extent the dynamics of the epidemic wave. In addition, the analysed countries were selected based on the fact that they sufficiently met the other model assumptions, e.g. low spatial heterogeneity and large amount of cases to fulfill the mean field assumption.

This study analyses the effect of mitigation measures in flattening the curve. Despite having a precise starting date, such measures take some days to be fully effective. We estimate an average delay using the Google Mobility Reports [27, 30] for the selected countries. Google provides changes in mobility with respect to a monthly baseline, w.r.t. 6 locations: Retail & Recreation, Grocery & Pharmacy, Transit stations, Workplaces, Residential, Parks. We average the decrease in mobility at the first four locations (corresponding to those where social mixing happens more frequently [31]) to get a proxy of the time needed for hard lockdown to be fully effective (cf. Fig 4c).

The extended SPQEIR model to reflect suppression strategies

SEIR models reproduce the typical bell-shaped epidemic curves for the number of infected people. The dynamics of this curve is of high importance for practical policy making. Not only it relates to the main stressors for the health system [17, 18, 31], but it also has an impact on the economic system [3234], e.g. because it takes some time (T) to mitigate the curve, until the number of new infections is below an accepted threshold. Commonly, mitigation measures against epidemics aim at flattening the curve of new infections [10]. However, the classical SEIR model is not granular enough to investigate mitigation measures when they need to be considered or should be sequentially reduced if already in place. Therefore, we extend the classical SEIR model as in Fig 1 (red insertions) into the SPQEIR model, to reflect the intervention categories described above. We particularly focus on the control of Susceptible and Exposed people, given by preventive isolation, contact tracing or social distancing measures, but we also include the control of infectious people by isolation. The model can be summarized as follows:

  • The classical blocks S, E, I, R are maintained;

  • A social distancing parameter ρ is included to tune the contact rate β;

  • Two new compartments are introduced where:
    • Protected P includes individuals that are removed from the susceptible pool and are thus protected from the virus. This can happen through full isolation as in China in early 2020 [35] or by different vaccination strategies which reduce the susceptible pool;
    • Quarantined Q describes latent carriers that are identified and quarantined after monitoring and tracing of contacts.

We do not explicitly introduce a second quarantined state for isolation of confirmed cases after the Infectious state [17, 36] but consider this together with the Removed state, by tuning the removal rate with an extra parameter (see [37] and references therein). Quarantining infected symptomatic patients is a necessary first step in every epidemic [38]. An additional link from Q to R, even though realistic, is neglected as both compartments are already outside the “contagion system” and would therefore be redundant from the perspective of evolution of the infection. In general, protected individuals can get back to the pool of susceptible after a while, but here we neglect this transition, to focus on simulating mitigation programs alone at their early stage. Long-term predictions could be modelled even more realistically by considering such link, that would lead to an additional parameter to be estimated and is beyond the scope of the present paper.

The model has in total 7 parameters. Three of them (β, α, γ introduced in Fig 1) are based on the classical SEIR model. The new parameters ρ, μ, χ, η account for alternative mitigation programs to control the infectious curve (see Table 2 for details). Commonly, social distancing is modelled by the parameter ρ. In a closed-system setting where all individuals belong to the susceptible pool, but interact less intensively with each other, ρ tunes the contact rate parameter β, resulting in the effective reproduction number R^=ρβγ1. The parameter μ stably decreases the susceptible population by introducing an active protection rate. This accounts for improvements of public health, e.g. stricter lockdown of communities, or reduction of the pool of susceptible people after reduced commuters’ activity, or vaccination. The parameter χ introduces an active removal rate of latent carriers. Intensive early contact tracing and improved methods to detect asymptomatic latent carriers may enhance the removal of exposed subjects from the infectious network. Following earlier works [39, 40] and adjusting the current parameters, R^ can be then expressed as R^=βγ1α(α+χ)1. Finally, η models the isolation of contagious individuals by handling the removal rate. This would correspond to identifying infectious individuals before they recover or die, and prevent them from infecting other susceptibles. Consequently, for this parameter alone R^=β(γ+η)1. Parameter values that are not related to mitigation strategies are set from COVID-19 epidemic literature [37, 41], as the main focus of the present model lies on sensitivity analysis of mitigation parameters. Our model can be further extended by time dependent parameters [38]. Default values for mitigation parameters are {ρ, μ, χ, η} = {1,0,0,0}, corresponding to the classical SEIR model.

The dynamics of our SPQEIR model is described by the following system of differential equations:

S˙=-ρβSIN-μS,E˙=ρβSIN-(χ+α)E,I˙=αE-(γ+η)I,R˙=(γ+η)I,P˙=μS,Q˙=χE,

Here, N.=0 with N = S + E + I + R + P + Q, implying the conservation of the total number of individuals. As value for the qualitative study, we used N = 10,000. For the cross-country assessment, N is adjusted to true population values for each country. Overall, the effective reproductive number becomes

R^=ρβγ+ηαα+χSN, (1)

Mitigation measures are initiated several days after the first infection case. Hence, we activate non-default parameter values after a delay τ. For data fitting, we fit and compare τ to the official date when measures are initialized (cf. Table 1). To integrate the model numerically, we use the odeint function from scipy.integrate Python library.

Table 1. Test countries, with measures implemented.

Country Measures Param. involved Starting Date Population (rounded)
Austria (AT) Partial lockdown μ, ρ 16 Mar 9,000,000
Social distancing ρ, μ 16 Mar
Contact tracing χ 16 Mar
Phase-out Around 14 April
Denmark (DK) Social distancing ρ, μ 13 Mar 6,000,000
Mild surveillance η 13 Mar
Phase-out 14 Apr
Ireland (IR) Partial lockdown μ, ρ 28 Mar 5,000,000
Social distancing ρ, μ 13 Mar
Phase-out 18 May
Israel (IL) Partial lockdown μ, ρ 15 Mar 9,000,000
Social distancing ρ, μ 15 Mar
Contact tracing χ 15 Mar
Phase-out 19 April
Lombardy (LO) Lockdown μ, ρ 13 Mar (Italian) 10,000,000
Social distancing ρ, μ 13 Mar
Phase-out Around 15 Apr
Switzerland (CH) Lockdown μ, ρ 16 Mar 8,500,000
Social distancing ρ, μ 16 Mar
Phase-out 27 Apr

Test countries, with corresponding implemented measures (following the ACAPS database [24]), parameters in our SPQEIR model, starting date and rounded population of each country. For Lombardy, we used the Italian official date for lockdown. Ireland issued measures on two different dates; we use this case to compare social distancing and lockdown effect in a single country. We assume that the parameter η is associated to all countries, which worked to isolate contagious individuals.

Model fitting

To show how our conceptual analysis is able to reproduce and explain empirical data, we fit the model to the official number of currently infected (active) cases of the first epidemic wave (winter-spring 2020), for each considered country. The choice is corroborated by the fact that all considered countries applied rapid, population-wide measures [24]. Model fitting to the infectious curves is performed in two steps, using the parameters known to be active (cf. Table 1). First, we estimate the “model consistent” date of first infection, so that the simulated curve matches the reported data of active infections. This initial step corresponds to setting the time initial conditions of the SEIR model [17]. The fitting is performed with default parameter values, on a subset of data corresponding to the first outbreak, from first case until when measures are implemented (cf. Table 1). We use a grid search method for least squares, sufficient to fit a single parameter:

t0={tRMS=minti=ttm(x(i)-x^(i))2n} (2)

where t0 is the “model consistent” estimated date of first infection, tm refers to the date measures are implemented, x^ and x are respectively reported and model-predicted data, and n is the number of points between t and tm.

The second step estimates a reasonable set of the mitigation parameters that yield the best fitting of the simulated SPQEIR curve on reported data, during the first phase with implemented measures. This period is identified between the starting date tm (also included in the fitting) and the phase-out date tp, cf. Table 1. Holding the epidemic parameters to literature values to achieve cross-country comparison on intervention parameters alone, the fitting is performed for a set of mitigation parameters relative to each country, as reported by policy databases (cf. Table 1). The fit is performed with the widely used lmfit Python library. In S1 Text, we discuss such fitted parameters set and alternative ones.

We also perform a comparative quantitative analysis between our extended model and the simplest SEIR that lumps parameters under a single “social distancing” ρ. This allows comparing the estimate reproduction number R^ and shows the similarity or divergence of different control strategies in explaining the data. To assess how well they allow to fit the data, we employ the classical reduced χ2 statistics to evaluate the goodness-of-fit for each of the two models, considering the degrees of freedom [43]:

χred2=1n-1-kj=1n(yj-yj^)2yj^ (3)

where n′ is the number of data points until phase-out, k is the number of parameters in the model, yj are estimated values (from data) and yj^ the expected ones (from model simulations).

Results

First, we focus on the conceptual analysis of the effect of preventive mitigation interventions, initially for single measures (social distancing, active protection and active quarantining) and subsequently for a number of synergistic approaches. Additionally, we compare them to the effect of isolating contagious individuals. In particular, we study how crucial quantities, namely R^, the infectious peak height and time to zero infectious T, depend on mitigation parameters. We define T as the time when there are less than 0.5 individuals in the I compartment, because ODE models approximate discrete quantities with continuous variables. Finally, we perform model fitting and intervention assessment over a set of countries. This provides quantitative outputs about the effectiveness of control measures, informing about the synergies applied and enabling cross-comparison.

Simulations of single suppression measures

Only social distancing

The parameter ρ captures social distancing effects, taking values in the interval [0, 1], where 0 indicates no contacts among individuals while 1 is equivalent to no action taken. To perform the current simulations, we assume a delay τ in implementing the measures of 10 days. Such value does not modify the qualitative behavior of the epidemic dynamics but influences the quantitative estimations of peak height and mitigation timing. We refer to S1 Text for further discussion. Overall, Fig 2 reports simulation results about the effects of ρ. The curve of infectious is progressively flattened by social distancing (Fig 2a) and its peak mitigated (Fig 2b). However, the time to mitigation gets delayed for decreasing ρ, until a threshold yielding a disease-free equilibrium rapidly (Fig 2c). In this case, the critical value for ρ is 0.4, leading to R^<1. Fig 2c reveals that the dependence of T on ρ is not monotonous. With the current settings, values of ρ ≤ 0.3 are best effective to minimise the mitigation timing. In general, the optimal ρ value that minimises mitigation timing depends on τ, as discussed in S1 Text. In fact, longer delays in issuing interventions are not only associated with higher peaks in the infection curves, but also in more stringent parameter values that are necessary to obtain minimal T. This fact further stresses the importance of prompt interventions to control the quantitative aspects of epidemic mitigation.

Fig 2. Effect of social distancing.

Fig 2

(a) Effects of social distancing on the epidemic curve. The grey area indicates when measures are not yet in place. (b) The peak is progressively flattened until a mitigation is reached for sufficiently small ρ. For these settings, the critical value for ρ is 0.4 (it pushes R^ below 1). (c) Unless ρ is small enough, stronger measures of this kind might delay the mitigation time T of the epidemic.

Only active protection

As discussed above and in S1 Text, our simulations take into account 10 days delay from the first infection to the initiation of active protection. Small values can reflect continuous improvement of protection measures (as people learnt better how to deal with the virus) or different vaccination strategies (thus going beyond non-pharmaceutical strategies). Higher values are considered to model certain effects of a step-wise hard lockdown (see following paragraph). The results are reported in Fig 3. We see that small precautions can make an initial difference (Fig 3a and 3b). The time to zero infectious is decreased with higher values of active protection (Fig 3a and 3b). In particular, μ = 0.01d−1 mitigates the epidemics in about 6 months by protecting 70% of the population. Higher values of μ achieve mitigation faster, while protecting almost 100% of the population. It is probably not fully realistic to consider that these protection rates are obtained only by isolation. Instead, they could represent improved hygiene routines or vaccination strategies and are thus worthy to consider.

Fig 3. Effect of lock-down.

Fig 3

(a) Effects of active protection on the infectious curve. The grey area indicates when measures are not yet in place. μ is expressed in d−1. (b) Dependency of peak height on μ: the peak is rapidly flattened for increasing μ, then it is smoothly reduced for higher parameter values. (c) High μ values are effective in anticipating the mitigation of the epidemic, but require protecting more than 90% of the population.

In addition to what analysed above, we also consider strategies which isolate many people at once [44]. This corresponds to reducing S to a relatively small fraction rapidly. Since μ is a rate, we mimic what could happen during a step-wise hard lockdown: large values of μ, but whose effect only lasts for a short period of time (Fig 4b). We thus use the notation μld. In the figure, an example shows how to rapidly protect about 68% of the population with a step-wise μld function. In particular, we use an average four-days long step-wise μld function (Fig 4b) to mimic the rapid, but not abrupt, change in mobility observed in many countries by Google Mobility Reports [30] (Fig 4c). The effects of strong, rapid protection are reported in Fig 4a, showing that such strategy is effective in mitigating the epidemic curve and in reducing the time to mitigation.

Fig 4. Effect of step-wise hard lock-down.

Fig 4

(a) Flattening the infectious curve by hard lockdown. Rapidly isolating a large population fraction is effective in mitigating the epidemic spreading. (b) Modeling hard lockdown: high μld (orange) is active for four days to isolate and protect a large population fraction rapidly (blue). As an example, we show μld = 0.28d−1 if t ∈ [10, 14]. It results in protecting about 68% of the population in two days. Higher values, e.g. μld = 0.65d−1 would protect 93% of the population at once. (c) Google Mobility Report visualization [30] for analysed countries, around the date of measures setting. Each line reports the mean in mobility change across Retail & Recreation, Grocery & Pharmacy, Transit stations, and Workplaces, around the date of implementation of the measures. A minimum of four days (from top to bottom of steep decrease) is required for measures to be fully effective. Abbreviations explanation: AT = Austria, CH = Switzerland, DK = Denmark, IL = Israel, IR = Ireland, LO = Lombardy.

Only active quarantining

Controlling latent carriers before symptom onset is an important strategy to limit transmission. We here consider how mitigation is achieved by targeted interventions, e.g. by contact tracing, and we quantify the interplay between precision and delay in tracing, thus expanding [45]. As above, not only we consider the impact on R^ but on the whole infectious curve, its height and its time evolution.

The simulations in this part are based on realistic assumptions: testing a person is effective only after a few days that that person has been exposed (to have a viral charge that is detectable). This induces a maximal quarantining rate θ, which we set θ = 0.33d−1 as testing is often considered effective after about three days from contagion [46]. Therefore, we get the active quarantining rate χ = χ′ ⋅ θ, where χ′ is a tuning parameter associated e.g. to contact tracing. As θ is fixed, we focus our analysis on χ′. As above, we also assume that testing starts after the epidemic is seen in the population, i.e. some infectious are identified with 10 days delay in the activation of measures.

The corresponding results are reported in Fig 5. The curve is progressively flattened by latent carriers quarantining and its peak mitigated, but the time to mitigation gets delayed for increasing χ′. This happens until a threshold value of χthr=0.9 that pushes R^ below 1. This value holds if we accept a strategy based on testing, with θ = 0.33. If preventive quarantine of suspected cases does not need testing (for instance, when it is achieved by contact tracing apps), the critical χ′ value could be drastically lower. In particular, χthr=0.3d1 if θ = 1d−1, i.e. latent carriers are quarantined the day after a contact.

Fig 5. Effect of latent carriers quarantining.

Fig 5

(a) Effects of active latent carriers quarantining on the epidemic curve. The grey area indicates when measures are not yet in place. (b) The peak is progressively flattened until a disease-free equilibrium is reached for sufficiently large χ′. (c) Unless χ′ is large enough, stronger measures of this kind might delay the mitigation of the epidemic. Note that the critical χ′ can be lowered for higher θ, e.g. if preventive quarantine does not wait for a positive test.

The parameter χ′ tunes the rate of removing latent carriers. Hence, it combines tracing and testing capacities, i.e. probability of finding latent carriers (Pfind) and probability that their tests are positive (P+). The latter depends on the false negative rate δ as

P+=(1-δ-). (4)

So, χ′ = PfindP+. Hence, mitigating the peak of infectious requires an adequate balance of accurate tests and good tracing success as reported in Fig 6. Further quantifying the latter would drastically improve our understanding of the current capabilities and of bottlenecks, towards a more comprehensive feasibility analysis.

Fig 6. Dependence of latent carriers quarantining on control parameters.

Fig 6

Assessing the impact of Pfind and P+ on the peak of infectious separately. This way, we separate the contribution of those factors to look at resources needed from different fields, e.g. network engineering or wet lab biology. Solutions to boost the testing capacity like [47] could impact both terms.

Only isolation of infectious

Isolating contagious individuals is a first step to contrast the pandemic, on top of preventive measures. In this section, we consider its effect alone, to be compared with that of other single parameters shown above. As discussed above, we here consider simulations that include a delay of 10 days from the first infection to the initiation of the measures. Quantitative changes associated with different τ are discussed in the S1 Text. The results are reported in Fig 7. Targeting the infectious population means that fewer people can spread the contagion. The curve of infections is progressively flattened, the more rapidly contagious people are identified and isolated, until a threshold value η = 0.51 (for our initial parameters). In turn, the mitigation time gets longer if η is increased, but has not yet crossed the threshold value. These findings point to the importance of complementing the control of contagious individuals with additional preventive measures such as the ones presented above. We acknowledge that these results are valid on average, but that breaking the infectious chain at specific links can have additional benefits in heterogeneous social networks.

Fig 7. Dependence of infectious isolation on control parameters.

Fig 7

(a) Effects of isolation of contagious individuals on the epidemic curve. The grey area indicates when measures are not yet in place. (b) The peak is progressively flattened until a disease-free equilibrium is reached for sufficiently large η. (c) Unless η is large enough, stronger measures of this kind might delay the mitigation of the epidemic. Note that the critical η can be higher if there is delay in intervening, i.e. if infectious individuals are isolated after several days and can thus spread the infection.

Synergistic scenarios

Fully enhanced active quarantining and active protection might not be always feasible, e.g. because of limited resources, technological limitations or welfare restrictions. On the other hand, the isolation of a limited portion of contagious individuals could not be sufficient. Therefore a synergistic approach is very attractive as it can flatten the curve with combinations of interventions that target different population groups and require distinct resources. This section shows a number of possible synergies, concentrating as before on abstract scenarios to investigate how combining different mitigation programs impact the control parameter R^ (cf. Eq (1), the infection curves and the mitigation timing.

As case studies, we consider the 6 synergistic scenarios listed below. Parameters are set without being specific to real measures taken: their value is so far conceptual and meaningful when compared across scenarios. Just like above, we consider a 10 days delay from the first infection to issuing measures; as suggested in other studies [48], delaying action could worsen the situation. To differentiate between a rapid isolation and a constant protection, we use μld (associated to “hard lockdown strategies”, see Section “Only active protection”) separated from μ. To get R^ when measures are initiated, we follow Eq 1, considering χ = χ′ ⋅ θ as in Section “Only active quarantining”. Our scenarios are the following:

  1. During the first COVID-19 wave, many European countries opted for a lockdown strategy. A quite large fraction of the population was isolated, individuals were recommended to self-quarantine in case of suspected positiveness, social distancing got mandatory but was sometimes not fully followed, masks and sprays were suggested for protection. So, we set an initial “rapid protection” μld = 0.12 to protect around 38% of the population quickly. Then we chose ρ = 0.7, χ′ = 0.12, η = 0.12 and μ = 0. This yields R^=0.65.

  2. In case that isolation of contagious individuals fails, an alternative procedure is to rapidly protect only the population fraction at high risk (μld = 0.06, driving 15% of initial S to P). Social distancing and latent carrier quarantine should then be enforced (ρ = 0.65, χ′ = 0.55). This gives R^=0.67.

  3. In case both preventive quarantine of latent carriers and isolation of contagious are not greatly effective (χ′ = 0.03, η = 0.07), and in case of low protection rate and scarce isolation (μ = 0, μld = 0.08), we rise social distancing for all individuals doing business as usual (ρ = 0.45). In this case, R^=0.64.

  4. If there are no safety devices that provide an adequate protection (μ = 0) and no isolation is foreseen (μld = 0), we set ρ = 0.6, χ′ = 0.2, η = 0.25 to get R^=0.65.

  5. This case has higher R^ than the previous ones, namely R^=0.84. The corresponding parameters are μld = 0.1, μ = 0.002, ρ = 0.7, η = 0.1. This shows that even low enforcement of single interventions can achieve R^<1, even thought the corresponding mitigation is slower.

  6. Finally, we consider “draconian” [49] measures such that R^=0.32 only through isolation and massive screening, that targets Exposed and Infectious individuals. So, μld = 0.3, χ′ = 0.1, η = 0.2 while ρ = 1 and μ = 0. This points to the importance of tracing capacities to minimise the total isolation period.

Simulation results in Fig 8 show that different synergies can lead to different timing, even though the peak is contained similarly (Fig 8a). This has an impact on the cumulative number of cases (Fig 8b) that will be reflected on the death toll. This holds even when the R^ values are very close, as in scenarios 1 to 4: even though R^ is the main driver of the epidemic, the contribution of finer-grained parameters is relevant for the fine-tuning of interventions. Focusing on scenarios 2 and 3, we notice that prevention measures and latent quarantine accelerate the mitigation, even when isolating only vulnerable people. This achieves similar effects as strong social distancing. In addition, active protective measures with relatively low values further concur in mitigating the peak. This finding asks for rapid assessment of masks and sanitising routines.

Fig 8. Synergistic scenarios.

Fig 8

Simulations of the 6 synergistic scenarios. (a) Curves of infectious Individuals, (b) Cumulative cases. The grey area indicates when measures are not yet in place. It is evident that scenarios leading to similar R^ could show different patterns and mitigation timing. (c) Distribution of times to zero infections T for different scenarios.

Overall, the strength of mitigation measures influences how and how fast the epidemic is flattened. μld mostly governs the peak height after measures are implemented, ρ mainly tunes the curve steepness together with μ, while χ shifts the decaying slope up and down. Overall, a R^<1 suffices to avoid breakdown of the health system, but its effects could be too slow. Decreasing its value with additional synergistic interventions could speed up epidemic mitigation. A careful assessment of measures’ strength is thus recommended for cross-country comparison.

Model fitting and interventions assessment

In this section, we test our results on several datasets, to estimate the likely impact of different strategies and to show which combination could have yield a similar R^. This way, we show how countries could achieve mitigation through a synergy of control measures with similar impact on the epidemic but different management and possibly socio-economic impact.

Model fitting

As described in the Methods section, we first estimate the “model consistent” date of first infection t0, i.e. the temporal initial condition for the SPQEIR model. Comparing this date with the starting date for intervention measures (Table 1) corresponds to estimating τ for each country. We do not claim this to be the true date of first infection in a country; it is the starting date of infections in case of homogeneous transmission, under the assumption of no superspreading events [50], and with the hypothesis of coherent R0 (cf. Table 2). During the second fitting step, we also estimate the date at which mitigation measures start having effect on the infectious curve, tm. Comparing tm with official intervention dates from Table 1, we notice that about 8 days are necessary to register lockdown effects. This is consistent to early findings on lockdown effectiveness [51]. Estimated dates are reported in Table 3.

Table 2. SPQEIR model parameters.
Fixed parameters Mitigation parameters
β = (average contact rate in the population) = 0.85 d−1 μ = (rate of active protection) [d−1]
α = (mean incubation period)−1 = 0.2 d−1 ρ = (social distancing tuning)
γ = (mean infectious period)−1 = 0.34 d−1 χ = (active removal rate) [d−1]
R0 = 2.5 η = (rate of contagious isolation)[d−1]

SPQEIR model parameters with their standard values for the COVID-19 pandemic from literature [37, 42]. Here “d” denotes days.

Table 3. COVID-19 significant dates.
Country AT DK IR IL LO CH
1st official detection 24 Feb 04 Mar 29 Feb 21 Feb 21 Feb 25 Feb
t0 22 Jan 22 Jan 29 Jan 24 Jan 05 Jan 14 Jan
tm 26 Mar 21 Mar 06 Apr 30 Mar 19 Mar 21 Mar

Dates of official detection of first COVID-19 case [25], estimated dates for first infection t0 (according to Eq 2) and date at which measures start being effective tm, per country.

Then, we fit mitigation parameters to data of active cases, from the estimated starting date of control measures tm to phase-out tp (cf. Table 1). The active parameters for the fit are reported in the same table. For the protection parameter, we used μld acting on 4 days (as introduced in Fig 4) since it better reflects the rapid protection of certain individuals that happened during the first COVID-19 wave. Since SN, its quantitative impact is anyway greater on the S compartment. Other compartments are impacted by the remaining parameters. The results of the model fitting are reported in Fig 9. The SPQEIR model, with appropriate parameters for each country (cf. Table 1), is fitted to reported infection curves and, overall, model fitting have good agreement with data. This supports the model structure as very simple yet realistic enough to capture the main dynamical behaviour of the infection curves in multiple countries. In addition, it allows for each country to obtain multiple sets of parameters representing different strategies. We notice that the effect of social distancing (ρ) is predominant as it homogeneously prevents the big pool of Susceptible individuals to stream into the Exposed compartment. However, also tracing and isolation can have a considerable effect in complementing population-wide interventions. The values associated to the fitted parameters correspond to non-negligible numbers of individuals affected by the interventions. Such values are discussed in S1 Text. This is informative about how synergistic approaches can realistically explain the mitigation of the infectious curve, and highlight the potential advantages associated with modifying the combination of strategies in subsequent epidemic waves. Finally, it allows a comparison between different countries through the corresponding best fit parameters. For Ireland, although initial social distancing advises were issued on 13th March (cf. Table 1), fitting the complete curve was only possible when considering the lockdown date (28th March) as the major driver of the mitigation.

Fig 9. Results of model fitting.

Fig 9

Results of model fitting. Infection curves for the considered countries (dotted) are fitted with the SPQEIR model with appropriate parameters (red curves). We also show a comparison with the fitted curve obtained from the “basic” SEIR model with only social distancing (turquoise curves). Parameter values are reported for each country, as well as the corresponding R^ (for the grey area, following Eq 1) and χred2. The period of measures enforcement, from tm to tp, is highlighted by the grey region. Time progresses from the estimated day of first infection t0 (cf. Table 3). Population fraction refers to country-specific populations (cf. Table 1). After phase-out, we prolong the fitted curve (parameter values unchanged) to compare observed data with what could have been if measures had not been lifted (dashed lines). From the data, we can observe a resurgence of cases that points to possible “second outbreaks” (particularly in Israel).

Model fitting is slightly hindered by data quality. For instance, Ireland reported intermittent data, while Lombardy is not perfectly represented, probably because of some data reporting issues and larger heterogeneity in its spacial patterns.

Finally, the reduced χ2 metric (Eq 3) reports that the complete SPQEIR model and the simple social distancing one attain similar goodness of fit, although values for the SPQEIR are slightly lower in all cases. Country-specific extra parameters (cf. Table 1) are thus useful to fine-tune the reproduction of epidemic curves, as noticed in the conceptual analysis, Sec. “Synergistic scenarios”. This shows that synergistic measures are able to provide a similar mitigation of the curve of infections, and an analogous R^, as the pure social distancing scenario. In turn, synergistic approaches allow lower social distancing values, possibly having less severe social and psychological impacts on the population. This in turn supports the use of several interventions to control the epidemic curve in an effective and timely manner, while balancing social benefits. In addition, the SPQEIR is confirmed to be informative, on top of being fully interpretable and linked to recognised social policy categories.

Cross-country interventions assessment

Fitting a number of countries with the same model containing the same epidemiological parameters allows to perform a comparison on the efficacy of their interventions, to inform future decision making. In Fig 9, parameter values providing the best fit of model to data are reported, together with the simulation results (mean values) calculated by the lmfit algorithm [52]. Different synergies yield similar values for R^, but the curve is different in its evolution as already observed in the previous sections. As expected from the model analysis above, the lower R^ is (below 1), the faster the mitigation of the epidemic. In addition, different parameter combinations generate curves that differ in amplitude and time evolution. This might well explain differences in reported total cases and deaths between various countries. Comparing Austria, Denmark and Lombardy, we observe that contact tracing and monitoring contribute to speeding up the curve decay, despite the fact that population-wide interventions played so far a major role. In general, combined isolation and tracing strategies would reduce transmission in addition to social distancing or self-isolation alone. In general, a strong, rapid lockdown that combines protection and social distancing seems the best option, as also suggested by the conceptual analysis. However, intervening with additional synergies is a viable option to mitigate the epidemic faster and with lower social values.

Finally, we observe the value of timely interventions: we see that intervening earlier with respect to the date of first infection helps reducing the daily curves by almost a factor of 10. For instance, we can compare Denmark and Lombardy in Fig 9: the first one got a peak corresponding to about 0.08% of the whole population, while the second region registered a number of active cases of about 0.5% of the whole population. This translates in more than 3800 infectious on the Danish peak, and on more than 37000 on Lombardy’s.

Discussion

The SPQEIR model assesses and compares the effectiveness of several control measures to mitigate the COVID-19 epidemic curve. It integrates previous literature and considers synergy strategies often considered alone. In particular, we focus on preventive measures, i.e. those that target people that are not yet fully infectious. Initially, we perform conceptual simulations to investigate the effect of single and combined measures not only on R^, but also on the complete time evolution of the infectious curve. Then, we compare them with the isolation of contagious individuals. The possibility of choosing among several strategies is of practical importance for decision makers: a comparison of Figs 2, 3, 5 and 7 reveals that increasing social distancing delays and decrease the height of the peak of infections, increasing active protection as well decreases the height of the peak of infections, but anticipates the occurrence of such peak, increasing active quarantining also delays and decrease the height of the peak of infections like social distancing, but the same peak mitigation by active quarantining is associated with shorter delays than with social distancing.

Moreover, the model is fitted to several countries, to estimate the plausible impact of synergistic strategies. The fit is performed until phase-out dates for the first epidemic wave (winter-spring 2020), when measures are progressively lifted and therefore the model assumptions do not hold anymore. We remark that the current set of parameters may not be unique, as there is high correlation among parameters. This is a common identifiability issue of SIR parameters, particularly when several of them contribute to the same control parameter R^ [53]. For instance, the lmfit diagnostic reports 0.9 correlation between ρ and μld and 0.99 between ρ and χ, for Austria. This means that they can equally well explain the evolution of the curve, so they could be alternatively chosen for epidemic control, while targeting different population groups. This is in line with our above analysis, as we aim at showing how different combinations of interventions can tune the mitigation of infection curves. We remark that, due to this degeneracy of parameters (i.e. several combination can yield to same R^), the ones reported in Fig 9 constitute a reasonable set obtained by an automatic least-square algorithm, but estimating their true values (inverse problem) needs to be complemented with alternative, targeted approaches.

In Fig 9 we extrapolate the model, with same parameter values, after phase-out (dashed lines), to compare observed data to the most optimistic scenario, where measures would not have been lifted. We observe that, up to July 8th, the infection curves mostly maintained an inertial decreasing trend: despite some fluctuations that make them generally higher than the best scenario, they kept on following a downward trend similar to that of the model. We speculate that this phenomenon is linked to changed behaviors, face masks [54] and improved sanitising practices that maintained social distancing values, as well as contact tracing practices issued by many countries along with the phase-out. However, some countries (Israel in particular, but also Austria) already showed a worrisome upward trend, eventually associated to a second outbreak [27]. As this is not a low probability event, we stress the usefulness of our analysis to prepare for future developments in pandemic progression.

It has been asked whether the peak of infections was reached because of herd immunity or because of interventions [55]. An added value of this study is to confirm that the peak of infection, for the considered countries, was not reached because of herd immunity. On the contrary, it is the effect of a number of mitigation measures that reduced the number of cases artificially. This should warn about the high numbers of people that are still susceptible.

We acknowledge the limitations of our analysis. Due to its structure and the use of ordinary differential equations, the model only accounts for average trends. However, it cannot reproduce fluctuations in the data, being them intrinsic in the epidemic, or from testing and reporting protocols that might differ among countries. The model focuses on initialization of measures that last for short-medium periods, as it does not include out-fluxes from the “safeguarded” compartments P and Q. This assumption is not completely realistic and we are aware that household infections concurred to a significant number of contagions. Like other studies [56], our simulations thus underestimate the disease burden coming from this source. However, the synergy with other parameters can retain the modulation of the dynamics posed by different behaviors. Overall, our model is used to assess the validity of control measures rather than to predict the complete evolution of the epidemic. Similarly, in order to concentrate on the generic control of infectious curves, we did not include further compartments about hospitalization, as they are already upstream with respect to the I compartment, nor we considered asymptomatic patients, that would not impact the main findings about synergistic mitigation. In addition, the constant nature of parameters used in this analysis allows good agreement between model and data when countries implemented rapid and strong measures point-wise in time, with little follow-ups. Further studies, with time varying parameters, could obtain more precise values. In the same way, transferring models from country to country requires fulfilling the same assumptions on model structure and basic hypothesis. This is shown by the different fitting performances, that suggest that a transfer is not always possible. The same fitting performance is often impacted by the data quality, related to monitoring, testing and reporting; despite our carefulness in selecting countries that had similar positive rates, there could be additional uncertainties to the parameter values that we estimated. Finally, we remark that the retrospective dates in Table 3 should be interpreted under the model assumptions: they could suggest that the first infection happened several weeks before the official detection, but they could as well be associated to the inherent identifiability limits of SIR-like parameters [57, 58].

In general, this study is not intended to make a ranking of country responses, nor to suggest that different strategies could have led to better outcomes. Contrariwise, it should be used as a methodological step towards quantitatively inquiring the effect of different intervention categories and of their combinations. It examines possible abstract scenarios and compares quantitative, model-based outputs, but it is not intended to fully represent specific countries nor to reproduce the epidemic complexity within societies. In fact, the model does not provide fine-grained quantification of specific interventions, e.g. how effective masks are in protecting people, how much proximity tracing apps increase Pfind, how changes in behavior are associated with epidemic decline [59] and so on. We acknowledge that the new compartments cannot perfectly match policy measures, but are a reasonable approximation. Some real measures might also affect multiple parameters at once, e.g. safety devices and lockdown could impact both μ and ρ. Comparing results of this macro-scale model with those of complex, micro-scale ones [3] could inform researchers and policy makers about the epidemic dynamics and effective synergies to hamper it. Any conclusion should be carefully interpreted by experts, and the feasibility of tested scenarios should be discussed before reaching consensus.

Conclusion

We have developed a minimal model to link intervention categories against epidemic spread to epidemiological model compartments. This allows quantitative assessment of non-pharmaceutical mitigation strategies on top of social distancing, for a number of countries. Strategies have different effects on epidemic evolution in terms of curve flattening and timing to mitigation. As with previous studies [31, 60], we have observed the need to enforce containment measures (i.e., detect and isolate cases, identify and quarantine contacts and at risk neighborhoods) along with mitigation (i.e., slow down viral spread in the community with social distancing).

By extending the classic SEIR model into the SPQEIR model, we distinguished the impact of different control programs in flattening the peak and anticipating the mitigation of the epidemic. Depending on their strength and synergy, non-pharmaceutical interventions can hamper the disease from spreading in a population. First, we performed a complete sensitivity analysis of their effects, both alone and in synergy scenarios. Then, we moved from idealised representations to fitting realistic contexts, allowing preliminary mapping of intervention categories to abstract programs. We verified that the model is informative in interpolating the infection curves for a number of countries, and performed cross-country comparison. We could then obtain model-based outputs on the strength of interventions, for a number of countries that respected the model assumptions. This provides better, quantitative insights on the effect of mitigation measures and their timing, and allows improved comparison.

Overall, this work could contribute to quantitative assessments of epidemic mitigation strategies. To tackle current epidemic waves, and against possible resurgence of contagion [61] (also cf. Fig 9), better understanding the effect of different non-pharmaceutical interventions could help planning mid- and long-term measures and to prepare preventive plans while allowing a relaxation of social distancing measures. In fact, this synergistic approach still remains of high importance in this second lockdown times, where countries still need to balance different non-pharmaceutical interventions to keep the infection at bay while complementing vaccination strategies and containing the impacts on other aspects of society.

Supporting information

S1 File

(TXT)

S1 Text

(PDF)

Acknowledgments

The authors thank the Research Luxembourg—COVID-19 Taskforce for mutual collaborations. They also thank two anonymous reviewers for helpful comments and suggestions that led to an improvement of this paper.

Data Availability

Databases of social measures can be accessed at https://www.who.int/emergencies/diseases/novel-coronavirus-2019/phsm. ACAPS database is at https://www.acaps.org/covid19-government-measures-dataset. Worldwide epidemiological data collection from John Hopkins University is at https://github.com/CSSEGISandData/COVID-19. Lombardy data were retrived from https://github.com/pcm-dpc/COVID-19. Google mobility data were accessed through https://ourworldindata.org/covid-mobility-trends. The code for analysis can be found at https://github.com/daniele-proverbio/assessing_strategies.

Funding Statement

DP and SM’s work is supported by the FNR PRIDE DTU CriTiCS, ref 10907093. FK’s work is supported by the Luxembourg National Research Fund PRIDE17/12244779/PARK-QC. A.H. work was partially supported by the Fondation Cancer Luxembourg. JG is partly supported by the 111 Project on Computational Intelligence and Intelligent Control, ref B18024. AA is supported by the Luxembourg National Research Fund (FNR) (Project code: 13684479). JAA is supported by the FWO research project G.0826.15N (Flemish Science Foundation), GOA/12/014 project (Research Fund KU Leuven), Project MTM2016-76969-P from the Spanish State Research Agency (AEI) co--funded by the European Regional Development Fund (ERDF) and the Competitive Reference Groups 2017--2020 (ED431C 2017/38) from the Xunta de Galicia through the ERDF.

References

  • 1. Ng Y, Li Z, Chua YX, Chaw WL, Zhao Z, Er B, et al. Evaluation of the effectiveness of surveillance and containment measures for the first 100 patients with COVID-19 in Singapore–January 2–February 29, 2020. In: MMWR Morb Mortal Wkly Rep 2020. 2020. p. 307–311. 10.15585/mmwr.mm6911e1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Currie CSM, Fowler JW, Kotiadis K, Monks T, Onggo BS, Robertson DA, et al. How simulation modelling can help reduce the impact of COVID-19. Journal of Simulation. 2020;14(2):83–97. 10.1080/17477778.2020.1751570 [DOI] [Google Scholar]
  • 3. Kucharski AJ, Klepac P, Conlan AJ, Kissler SM, Tang ML, Fry H, et al. Effectiveness of isolation, testing, contact tracing, and physical distancing on reducing transmission of SARS-CoV-2 in different settings: a mathematical modelling study. The Lancet Infectious Diseases. 2020;20(10):1151–1160. 10.1016/S1473-3099(20)30457-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Anderson RM, May RM. Population biology of infectious diseases: Part I. Nature. 1979;280(5721):361–367. 10.1038/280361a0 [DOI] [PubMed] [Google Scholar]
  • 5. Legrand J, Grais RF, Boelle PY, Valleron AJ, Flahault A. Understanding the dynamics of Ebola epidemics. Epidemiology & Infection. 2007;135(4):610–621. 10.1017/S0950268806007217 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Lai S, Ruktanonchai NW, Zhou L, Prosper O, Luo W, Floyd JR, et al. Effect of non-pharmaceutical interventions to contain COVID-19 in China. Nature. 2020;585(2):410–413. 10.1038/s41586-020-2293-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. de Camino-Beck T. A modified SEIR Model with Confinement and Lockdown of COVID-19 for Costa Rica. medRxiv. 2020;. [Google Scholar]
  • 8. Anand N, Sabarinath A, Geetha S, Somanath S. Predicting the Spread of COVID-19 Using SIR Model Augmented to Incorporate Quarantine and Testing. Transactions of the Indian National Academy of Engineering. 2020;5(2):141–148. 10.1007/s41403-020-00151-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.WHO. Tracking Public Health and Social Measures—a global dataset. https://wwwwhoint/emergencies/diseases/novel-coronavirus-2019/phsm. 2020;.
  • 10. Anderson RM, Heesterbeek H, Klinkenberg D, Hollingsworth TD. How will country-based mitigation measures influence the course of the COVID-19 epidemic? The Lancet. 2020;395(10228):931–934. 10.1016/S0140-6736(20)30567-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Mancastroppa M, Burioni R, Colizza V, Vezzani A. Active and inactive quarantine in epidemic spreading on adaptive activity-driven networks. Physical Review E. 2020;102(2):020301. 10.1103/PhysRevE.102.020301 [DOI] [PubMed] [Google Scholar]
  • 12. Alrashed S, Min-Allah N, Saxena A, Ali I, Mehmood R. Impact of lockdowns on the spread of COVID-19 in Saudi Arabia. Informatics in Medicine Unlocked. 2020;20:100420. 10.1016/j.imu.2020.100420 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Kermack WO, McKendrick AG. A contribution to the mathematical theory of epidemics. Proceedings of the royal society of london Series A, Containing papers of a mathematical and physical character. 1927;115(772):700–721. 10.1098/rspa.1927.0118. [DOI] [Google Scholar]
  • 14. Yan P, Liu S. SEIR epidemic model with delay. The ANZIAM Journal. 2006;48(1):119–134. 10.1017/S144618110000345X [DOI] [Google Scholar]
  • 15. Arino J, Davis JR, Hartley D, Jordan R, Miller JM, Van Den Driessche P. A multi-species epidemic model with spatial dynamics. Mathematical Medicine and Biology. 2005;22(2):129–142. 10.1093/imammb/dqi003 [DOI] [PubMed] [Google Scholar]
  • 16. Gatto M, Bertuzzo E, Mari L, Miccoli S, Carraro L, Casagrandi R, et al. Spread and dynamics of the COVID-19 epidemic in Italy: Effects of emergency containment measures. Proceedings of the National Academy of Sciences. 2020;117(19):10484–10491. 10.1073/pnas.2004978117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Giordano G, Blanchini F, Bruno R, Colaneri P, Di Filippo A, Di Matteo A, et al. Modelling the COVID-19 epidemic and implementation of population-wide interventions in Italy. Nature Medicine. 2020; p. 1–6. 10.1038/s41591-020-0883-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Sjoedin H, Johansson AF, Brannstrom A, Farooq Z, Kriit HK, Wilder-Smith A, et al. COVID-19 healthcare demand and mortality in Sweden in response to non-pharmaceutical mitigation and suppression scenarios. International Journal of Epidemiology. 2020;. 10.1093/ije/dyaa121 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Syafruddin S, Noorani M. SEIR model for transmission of dengue fever in Selangor Malaysia. IJMPS. 2012;9:380–389. 10.1142/S2010194512005454 [DOI] [Google Scholar]
  • 20. Fraser C, Donnelly CA, Cauchemez S, Hanage WP, Van Kerkhove MD, Hollingsworth TD, et al. Pandemic potential of a strain of influenza A (H1N1): early findings. Science. 2009;324(5934):1557–1561. 10.1126/science.1176062 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Althaus CL. Estimating the reproduction number of Ebola virus (EBOV) during the 2014 outbreak in West Africa. PLoS Currents. 2014;6. 10.1371/currents.outbreaks.91afb5e0f279e7f29e7056095255b288 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Hale T, Petherick A, Phillips T, Webster S. Variation in government responses to COVID-19. Blavatnik school of government working paper. 2020;31. [Google Scholar]
  • 23.World Health Organization and others. Coronavirus disease 2019 (COVID-19): situation report, 88; 2020.
  • 24.ACAPS. COVID-19 Government measures dataset. https://wwwacapsorg/covid19-government-measures-dataset. 2020;.
  • 25. Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. The Lancet infectious diseases. 2020;20(5):533–534. 10.1016/S1473-3099(20)30120-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Dipartimento della Protezione Civile—Emergenza Coronavirus. Dati COVID-19 Italia. https://githubcom/pcm-dpc/COVID-19/tree/master/dati-regioni. Accessed 14 Jun 2020;.
  • 27.Max Roser EOO Hannah Ritchie, Hasell J. Coronavirus Pandemic (COVID-19). Our World in Data. 2020;.
  • 28. Kennedy AP, Yam SCP. On the authenticity of COVID-19 case figures. PloS one. 2020;15(12):e0243123. 10.1371/journal.pone.0243123 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Lee KB, Han S, Jeong Y. COVID-19, flattening the curve, and Benford’s law. Physica A: Statistical Mechanics and its Applications. 2020;559:125090. 10.1016/j.physa.2020.125090 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Google. COVID-19 Community Mobility Reports. https://wwwgooglecom/covid19/mobility/. Accessed 14 Jun 2020;.
  • 31. Ferguson NM, Laydon D, Nedjati-Gilani G, Imai N, Ainslie K, Baguelin M, et al. Impact of non-pharmaceutical interventions (NPIs) to reduce COVID-19 mortality and healthcare demand. Imperial College, London: https://doi.org/1025561/77482. 2020;. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Alvarez FE, Argente D, Lippi F. A simple planning problem for COVID-19 lockdown. National Bureau of Economic Research; 2020. [Google Scholar]
  • 33. Atkeson A. What will be the economic impact of COVID-19 in the us? rough estimates of disease scenarios. National Bureau of Economic Research; 2020. [Google Scholar]
  • 34. Altig D, Baker S, Barrero JM, Bloom N, Bunn P, Chen S, et al. Economic uncertainty before and during the COVID-19 pandemic. Journal of Public Economics. 2020;191:104274. 10.1016/j.jpubeco.2020.104274 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Lau H, Khosrawipour V, Kocbach P, Mikolajczyk A, Schubert J, Bania J, et al. The positive impact of lockdown in Wuhan on containing the COVID-19 outbreak in China. Journal of travel medicine. 2020;27(3):taaa037. 10.1093/jtm/taaa037 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Feng Z. Final and peak epidemic sizes for SEIR models with quarantine and isolation. Mathematical Biosciences & Engineering. 2007;4(4):675. 10.3934/mbe.2007.4.675 [DOI] [PubMed] [Google Scholar]
  • 37. Liu Y, Gayle AA, Wilder-Smith A, Rocklöv J. The reproductive number of COVID-19 is higher compared to SARS coronavirus. Journal of Travel Medicine. 2020; 10.1093/jtm/taaa021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Wearing HJ, Rohani P, Keeling MJ. Appropriate models for the management of infectious diseases. PLoS medicine. 2005;2(7). 10.1371/journal.pmed.0020174 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Li MY, Graef JR, Wang L, Karsai J. Global dynamics of a SEIR model with varying total population size. Mathematical biosciences. 1999;160(2):191–213. 10.1016/S0025-5564(99)00030-9 [DOI] [PubMed] [Google Scholar]
  • 40. Heffernan JM, Smith RJ, Wahl LM. Perspectives on the basic reproductive ratio. Journal of the Royal Society Interface. 2005;2(4):281–293. 10.1098/rsif.2005.0042 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Kucharski A, Russell T, Diamond C, Liu Y. Analysis and projections of transmission dynamics of nCoV in Wuhan. CMMID repository. 2020;2. [Google Scholar]
  • 42. Wu JT, Leung K, Leung GM. Nowcasting and forecasting the potential domestic and international spread of the 2019-nCoV outbreak originating in Wuhan, China: a modelling study. The Lancet. 2020;395(10225):689–697. 10.1016/S0140-6736(20)30260-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43. Taylor J. An Introduction to Error Analysis—University Science Books. Mill Valley, California. 1997;. [Google Scholar]
  • 44.Liu X, Hewings GJ, Qin M, Xiang X, Zheng S, Li X, et al. Modelling the situation of COVID-19 and effects of different containment strategies in China with dynamic differential equations and parameters estimation. Available at SSRN 3551359. 2020; 10.2139/ssrn.3551359. [DOI]
  • 45. Kretzschmar ME, Rozhnova G, Bootsma MC, van Boven M, van de Wijgert JH, Bonten MJ. Impact of delays on effectiveness of contact tracing strategies for COVID-19: a modelling study. The Lancet Public Health. 2020;5(8):e452–e459. 10.1016/S2468-2667(20)30157-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DK, et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Eurosurveillance. 2020;25(3):2000045. 10.2807/1560-7917.ES.2020.25.3.2000045 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Hanel R, Thurner S. Boosting test-efficiency by pooled testing strategies for SARS-CoV-2. arXiv preprint arXiv:200309944. 2020;. [DOI] [PMC free article] [PubMed]
  • 48.Deutsche Gesellschaft für Epidemiologie. Stellungnahme der Deutschen Gesellschaft für Epidemiologie (DGEpi) zur Verbreitung des neuen Coronavirus (SARS-CoV-2). www.dgepi.de. 2020;.
  • 49. Moodley K, Obasa A, London L. Isolation and quarantine in South Africa during COVID-19: Draconian measures or proportional response? SAMJ: South African Medical Journal. 2020;110(6):1–2. [DOI] [PubMed] [Google Scholar]
  • 50. Liu Y, Eggo RM, Kucharski AJ. Secondary attack rate and superspreading events for SARS-CoV-2. The Lancet. 2020;395(10227):e47. 10.1016/S0140-6736(20)30462-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Vinceti M, Filippini T, Rothman KJ, Ferrari F, Goffi A, Maffeis G, et al. Lockdown timing and efficacy in controlling COVID-19 using mobile phone tracking. EClinicalMedicine. 2020; p. 100457. 10.1016/j.eclinm.2020.100457 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Newville M, Stensitzki T, Allen DB, Ingargiola A. LMFIT: Non-Linear Least-Square Minimization and Curve-Fitting for Python; 2014. Available from: 10.5281/zenodo.11813. [DOI]
  • 53. Roda WC, Varughese MB, Han D, Li MY. Why is it difficult to accurately predict the COVID-19 epidemic? Infectious Disease Modelling. 2020;5:271–281. 10.1016/j.idm.2020.03.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54. Stutt RO, Retkute R, Bradley M, Gilligan CA, Colvin J. A modelling framework to assess the likely effectiveness of facemasks in combination with ‘lock-down’in managing the COVID-19 pandemic. Proceedings of the Royal Society A. 2020;476(2238):20200376. 10.1098/rspa.2020.0376 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55. Okell LC, Verity R, Watson OJ, Mishra S, Walker P, Whittaker C, et al. Have deaths from COVID-19 in Europe plateaued due to herd immunity? The Lancet. 2020;. 10.1016/S0140-6736(20)31357-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56. López L, Rodó X. The end of social confinement and COVID-19 re-emergence risk. Nature Human Behaviour. 2020;4(7):746–755. 10.1038/s41562-020-0908-8 [DOI] [PubMed] [Google Scholar]
  • 57. Postnikov EB. Estimation of COVID-19 dynamics “on a back-of-envelope”: Does the simplest SIR model provide quantitative parameters and predictions? Chaos, Solitons & Fractals. 2020;135:109841. 10.1016/j.chaos.2020.109841 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58. Comunian A, Gaburro R, Giudici M. Inversion of a SIR-based model: a critical analysis about the application to COVID-19 epidemic. Physica D: Nonlinear Phenomena. 2020;413:132674. 10.1016/j.physd.2020.132674 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59. Cowling BJ, Ali ST, Ng TW, Tsang TK, Li JC, Fong MW, et al. Impact assessment of non-pharmaceutical interventions against coronavirus disease 2019 and influenza in Hong Kong: an observational study. The Lancet Public Health. 2020; 10.1016/S2468-2667(20)30090-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60. Peak CM, Kahn R, Grad YH, Childs LM, Li R, Lipsitch M, et al. Individual quarantine versus active monitoring of contacts for the mitigation of COVID-19: a modelling study. The Lancet Infectious Diseases. 2020; 10.1016/S1473-3099(20)30361-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. Kissler SM, Tedijanto C, Goldstein E, Grad YH, Lipsitch M. Projecting the transmission dynamics of SARS-CoV-2 through the postpandemic period. Science. 2020;368(6493):860–868. 10.1126/science.abb5793 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Michele Tizzoni

16 Dec 2020

PONE-D-20-26921

Dynamical SPQEIR model assesses the effectiveness of non-pharmaceutical interventions against COVID-19 epidemic outbreaks

PLOS ONE

Dear Dr. Proverbio,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

In particular, Referee #2 has raised a number of critical remarks regarding the model structure and the statistical analysis that require careful consideration.

Please submit your revised manuscript by Jan 30 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Michele Tizzoni

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please note that in order to use the direct billing option the corresponding author must be affiliated with the chosen institute. Please either amend your manuscript to change the affiliation or corresponding author, or email us at plosone@plos.org with a request to remove this option.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The paper introduces in the SEIR model 3 different types of non-pharmaceutical interventions i.e. social distancing, quarantine of exposed individuals and generalized lock-down. After the outbreak of COVID pandemic several papers have been published in this direction e.g.

Das et al. medRXIV https://doi.org/10.1101/2020.06.04.20122580;

Tomas de-Camino-Beck. medRXIV https://doi.org/10.1101/2020.05.19.20106492;

Perkins et al. Bulletin of Mathematical Biology 82, 118 (2020);

Lai et al. Nature volume 585, 410–413 (2020);

Alrrashed et al Informatics in Medicine Unlocked 20, 100420 (2020)

and also for the SIR model where quarantine is directly introduced on the infected nodes:

Anand et al. Transactions of the Indian National Academy of Engineering 5, 141–148 (2020)

Giordano et al. Nature Medicine 26, 855–860 (2020)

Mancastroppa et al. Phys. Rev. E 102, 020301(R) (2020)

Many other papers have been recently published or submitted.

In these models often several aspects are taken into account which are overlooked in the present paper e.g. hospitalization, asymptomatic individuals, heterogeneous behavior of the individuals. The authors should explain what is the main advance with respect the vast recent literature.

In this respect, the authors consider the simultaneous adoption of three different kinds of measures, however it is not clear in the paper what is the main advantages of introducing this modelization. In particular which are the different effects due to the three strategy of containment? E.g. when you consider the fit of datasets the use of a single strategy (i.e. social distancing) provides a very similar fit of the case where the synergy of the different strategies is considered; also the improvement in the X^2 is very small. So it is not clear what is the advantage of adopting the different strategies, in the description of non-pharmaceutical interventions. In summary the paper introduces a model with a description of three types of non-pharmaceutical interventions, this interventions have been already introduced in different papers even if with some differences. In this context, from a theoretical point of view the authors do not evidence any peculiar or interesting effect due to the presence of these three terms; while a comparison with datasets does not show any advantages in interpretations of the epidemic evolution in the different countries. In this perspective I think that the paper is not suitable for publication without a significant improvement.

Another very important remark is about the model for a generalized lock-down. In your approach only susceptible nodes are isolated in the state P while I expect that a fraction of the whole population in a lock-down is isolated; in particular I expect that the sudden isolation of infected and exposed individuals should have a larger effect than the isolation of susceptible ones. Moreover I think that the process should be described only by the approach in figure 4 i.e. a sudden isolation of a large number of individuals which remain isolated during the whole period of non-pharmaceutical interventions; while other individuals do not self isolates (e.g. they do an essential job), so that after the quick self isolation mu is restored to 0. On the other hand, a self isolation with constant rate, in the whole period of intervention seems to be very unlikely. An even a similar and simpler model of a generalized lock down could be at the beginning of the intervention an instantaneous isolation in the state P of a fraction of individuals (independently of their states). Therefore, I think that the different scenarios and the data fitting should take into account only the approach in figure 4 (clearly with possible different fraction of people that self isolate).

Reviewer #2: REVIEWER COMMENTS TO AUTHORS

Referee report: PONE-D-20-26921

Evaluation

The paper has a number of shortcomings, and would require a much deeper

discussion of several parts (see my main points). Also, the

epidemiological language should be improved in many points. Some cited

papers are weak. Therefore, the authors should (i) do an effort to

(substantially) amend their paper according to the indications reported

below, but especially (ii) put into evidence their findings that are of

main epidemiological interest, particularly in relation to the insights

that the adopted modeling framework would provide in relation to the

understanding of COVID-19 control.

Main points

The proposed SPQEIR model is quite restrictive in its formulation and

therefore the underlying hypotheses should be carefully discussed.

First, P individuals are – according to the stated hypotheses - fully

protected, which corresponds to full segregation forever i.e., during

the entire history of intervention measures. But measures aimed at

confining susceptible people hardly can go beyond home confinement, and

there is strong evidence that – during lockdowns - much COVID

transmission occurred within households (especially during the first

wave). Pairwise, also removed E individuals are fully inactivated in the

SPEIR. Also, this should be discussed carefully. Moreover, as E

individuals can be removed mostly by way of tracing, it is not clear to

me why you do not allow a pairwise option for I individuals (e.g.

asymptomatic or pauci-symptomatic) by the same mechanism. Last, I

understand screening and isolation of actively infected individuals is

incorporated into removal (L99), which is an option. However, did you

handle your removal rate to account for this (perhaps I didn’t note

details)?

L141 “We fit the model to the official number of currently infected

(active) cases, for each considered country.” The authors are surely

aware that published numbers of currently infectious cases poorly

represent true infectious cases. So, this should at least be discussed

more carefully. Moreover, this information risks of being severely

biased when you aim at making comparisons between different countries –

especially during the first wave - because it reflects the inter-country

differences in testing and tracing, making comparisons unreliable.

L>140. Fitting procedures. The authors adopted a nonlinear least squares

procedure citing a rather old textbook whereas the basic statistics of

epidemic data has progressed dramatically in the last twenty years,

first of all maximum likelihood techniques. For example, I do not

understand how the quantity in (3) can be used to document the

improvement in fit compared to the baseline model.

L83 “the time T passed until no new infections occur”, this is quite

wrong at least as far as your model is a deterministic one, as I

understand it is. In the practice of simulation this does not need to be

a problem (and indeed you acknowledge this at a later stage), but the

sentence should be modified.

L119, the effective reproduction number is not explicit in the SIR

model, because the susceptible fraction is not explicit. Therefore, the

formula drawn from ref [26] is an approximation. The problem is that it

is far from being general and rests on a number of hypotheses, which I

find somewhat naive. This also holds for eq (1). I noted that even in

the cited paper [26] the formula is given without a justification. The

formula trivially holds if you assume that the removal by segregation of

the susceptible population occurs rapidly, that is before the

susceptible population is sufficiently depleted. In this case S(t) =

Nexp(-\\�t), so that if you additionally assume that \\�t is small (which

contradicts that segregation occurs fast) and resort to the linear

approximation of the exponential function you arrive to the point.

Anyhow, is this relevant for this paper? On top, I recommend to avoid to

cite whatever paper appeared in this epoch because the quality is not

necessarily good (sometimes poor) and may induce errors in readers.

Legends of simulation exercises are scanty and should be improved.

Other points

> L34, “homogeneous propagation media” is naïve for most readers of the

> Journal; as epidemiologists we speak of “a homogeneously mixing

> population” which is a nowadays somewhat universally agreed

> terminology.

IBM models are not continuous but discrete models (due to their very

structure of simulative models)

L42, "likely" : socially active and at risk of infection

L83 Clearly, the SEIR model by its I curve provides only a very indirect

measure of the pressure on PH system (instead represented by ICU and

hospitals occupancy). Even more so for the economic system. This should

be discussed.

L112 “resulting in the effective reproduction number”, In epidemiology

the effective reproduction number deals with a situation where the

susceptible proportion is depleted below one, as you correctly say in

the subsequent line. Suggest to rephrase.

L126 “We use mean values etc”, please clarify

L129 “with conservation of the total number of individuals, meaning N’ =

0”, the argument goes the other way round, your system fulfills N’=0

implying that N is conserved.

L86 “Mainstream suppression measures against the epidemic aim at

flattening the curve of new infections”, replace “suppression “ by

“mitigation” (flattening the epidemic curve is somewhat different from

suppressing)

L161 “comparative information analysis” this is not an agree terminology

Minor points

I suggest to delete “new” from the abstract and simply state: “an

extended SEIR model including quarantine of susceptible an latently

infected individuals”

L8 “statistical methods allow for accurate characterization of the

population's health state", stated like this is a bit trivial.

L42, "likely" : socially active and at risk of infection

L111 “repression” not appropriate

L117 “physical reduction of a country's population” ?

L182 I suggest to replace “mathematical” in the title with “Simulation”:

it is a simulative analysis

L189 “eradication time” inappropriate wording

L194 Citation 32 is not appropriate. That paper considered a model with

behavioral responses which are not included here.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 May 21;16(5):e0252019. doi: 10.1371/journal.pone.0252019.r002

Author response to Decision Letter 0


29 Jan 2021

Dear editor, dear reviewers,

We thank you for your careful review and for the list of suggested improvements. Please find below detailed responses to the points you raised. In the main text, the parts we edited, following your suggestions, are in red. Please notice that we also added Fig. 7 and updated Fig. 8 and 9 (of the new version) according to what suggested by you and discussed in the answers below.

Reviewer #1:

The paper introduces in the SEIR model 3 different types of non-pharmaceutical interventions i.e. social distancing, quarantine of exposed individuals and generalized lock-down. After the outbreak of COVID pandemic several papers have been published in this direction e.g.

Das et al. medRXIV https://doi.org/10.1101/2020.06.04.20122580;

Tomas de-Camino-Beck. medRXIV https://doi.org/10.1101/2020.05.19.20106492;

Perkins et al. Bulletin of Mathematical Biology 82, 118 (2020);

Lai et al. Nature volume 585, 410–413 (2020);

Alrrashed et al Informatics in Medicine Unlocked 20, 100420 (2020)

and also for the SIR model where quarantine is directly introduced on the infected nodes:

Anand et al. Transactions of the Indian National Academy of Engineering 5, 141–148 (2020)

Giordano et al. Nature Medicine 26, 855–860 (2020)

Mancastroppa et al. Phys. Rev. E 102, 020301(R) (2020)

Many other papers have been recently published or submitted.

>We updated out bibliography with recent publications, including some of the ones mentioned above [6, 7, 8, 11, 12, 16, 18, 35, 45, 49, 52, 55, 56, 57]. We also integrated our references with a discussion of relevance of epidemic control not only on the healthcare [17,18,31], but also on the economic system [32,33,34]. Additionally, we discussed the reliability of the empirical data used for model fitting. In fact, we payed particular attention that, across the analysed countries, the share of positive tests was similar [27] and no significant deviation from expected dynamics was observed by studies applying Benford’slaw [28, 29].

Regarding the vast recent modelling literature, several studies have deeply analyzed the effects of specific interventions in selected countries, by statistical methods on simple and interpretable SIR-like models [1, 2, 6, 7, 8, 16, 17, 18, 35, 44], while in our study we consider the plausible impact of a combination of multiple strategies, and the difference from applying single interventions. A similar analysis was done with complex and data-demanding agent-based models [3, 31], which are often less generic, since focusing mostly on one country at a time. Instead, our model provides generic results that can be valid over several countries as shown in Fig. 9. Other works focus on single interventions with stochastic models [45, 55, 59]; we complement them by a different perspective. Many papers are focused on developing future projections [17, 41, 42, 60], but our aim is to discuss how to obtain similar mitigation with different strategies, to inform future decisions. As pointed out by Reviewer#1 below, additional papers account for extra features of importance for pandemic modelling. We discuss this in our response below. We are aware of abundant literature that consider conceptual models and the effect of different parameters (either published [11,12] or as preprints, e.g. Chladnà, medRxiv, 2020). We believe that our additional comparison with empirical data (Fig. 9) can contribute to the discussion about the relevance of such abstract strategies in real-world settings. Finally, our choice of modelling and selection of empirical data is based on socio-political analysis reports (sec 2.2 and Table 1), thus incorporating a multi-disciplinary approach in our study.

In these models often several aspects are taken into account which are overlooked in the present paper e.g. hospitalization, asymptomatic individuals, heterogeneous behavior of the individuals. The authors should explain what is the main advance with respect the vast recent literature.

>Our paper aims at complementing the recent literature by synthetizing several control strategies into a readily interpretable model and by assessing their efficacy both alone and in synergy. This way, we can discuss the merits of each strategy and the possibility of mitigating the curve by a combination of them. The paper focuses on the average effects of such strategies on the infectious curve. We ultimately show that analogous containment levels of the infectious curve can be achieved by alternative synergies of non-pharmaceutical interventions. Hence, policymakers could aim to achieve the desired mitigation by measures targeting different population groups. This synergistic approach still remains of high importance in these second/third waves, where countries need to balance different non-pharmaceutical interventions to keep the infection at bay, while containing the impacts on other aspects of society. Following the remarks by reviewers, and recent literature, we have included isolation of infectious individuals into the model and simulations, on top of isolation of latent carriers.

We acknowledge that there are aspects of the pandemic found in other studies that were overlooked here, such as hospitalization, asymptomatic individuals, and heterogeneous behaviour of individuals. While these are all important aspects that can be crucial to answer certain questions, they are not needed here to answer the main question of the present paper: how strategies mitigate the infectious curve. Asymptomatic/undetected cases do play a role on the infection curve, but estimating their numbers is affected by large uncertainties. Thus, we opted for a more conceptual model without explicit asymptomatic/undetected compartments. When we compare our framework to empirical data, our goal is mostly to show that the model can reproduce the realistic dynamics observed in real data across a multitude of countries, and that synergies of several measures applied with moderate intensity can still provide the same benefit than a much more intense application of one intervention only.

On the other hand, to address different questions that require hospitalizations and asymptomatic/undetected cases, our group carried out a distinct study that includes such additional aspects, plus deaths and vaccination, throughout several epidemic waves (https://www.medrxiv.org/content/10.1101/2020.12.31.20249088v1.full).

In this respect, the authors consider the simultaneous adoption of three different kinds of measures, however it is not clear in the paper what is the main advantages of introducing this modelization. In particular which are the different effects due to the three strategy of containment? E.g. when you consider the fit of datasets the use of a single strategy (i.e. social distancing) provides a very similar fit of the case where the synergy of the different strategies is considered; also the improvement in the X^2 is very small. So it is not clear what is the advantage of adopting the different strategies, in the description of non-pharmaceutical interventions.

>The model links several control strategies to real-world intervention programs, to investigate the possibility of achieving similar mitigation effects by using different strategies. The possibility of choosing among several strategies is of practical importance for decision makers. The impact of said strategies on the infectious curve is investigated in the dedicated sections (3.1.1, 3.1.2, 3.1.3, 3.1.4) and in panels (a) of Fig. 2, 3, 5 and 7). Increasing social distancing delays and decrease the height of the peak of infections. Increasing active protection as well decreases the height of the peak of infections, but it anticipates the occurrence of such peak. Increasing active quarantining also delays and decrease the height of the peak of infections like social distancing, but the same decrease in height of the peak by active quarantining is associated with shorter delay than with social distancing. The effects of measures targeting S and E population groups is also compared with those of isolation of contagious individuals (3.1.4). This shows how much preventive measures can buffer imperfect isolation of I persons. While not described by the model, these strategies are also expected to potentially have different effects on the population at the economic, social and psychological levels.

In addition, the performed fitting illustrates how well we can explain the evolution of empirical infectious curves with different control strategies. The chi^2 illustrates that the epidemic curves from 6 countries could indeed be fitted equally well (similar X^2, only small changes) by either a strong “social distancing” intervention or by milder \\rho and synergistic measures. This is clearer in Fig.9 of the new version, where we also consider the isolation of infectious individuals. Moreover, we observe a high degree of correlation among some parameters. This is informative about the advantage of adopting a synergy of interventions instead of just one (e.g. only social distancing), in that it achieves a similar mitigation of the infection curve with interventions that can be selected based on the goal of limiting the impact on economy and society. This analysis can thus inform policymakers about the effects of strengthening non-pharmaceutical interventions others than social distancing, as e.g. contact tracing, mass testing, rapid testing.

In summary the paper introduces a model with a description of three types of non-pharmaceutical interventions, this interventions have been already introduced in different papers even if with some differences. In this context, from a theoretical point of view the authors do not evidence any peculiar or interesting effect due to the presence of these three terms; while a comparison with datasets does not show any advantages in interpretations of the epidemic evolution in the different countries. In this perspective I think that the paper is not suitable for publication without a significant improvement.

We complement the analysis of other valuable works, by considering combinations of control interventions in a simple, easily interpretable SIR-like model. Some seminal works did so with Agent-based models (e.g. [31]) but they require large and variegate data sets and are often less generic, since focusing mostly on one country at a time. Here, we highlight a general finding, which we found occurring in multiple countries. Introducing new terms allows for clearer interpretation of the effect of distinct control strategies that can achieve the same mitigation as untargeted, population-wide social distancing. From our experience in the Luxembourg COVID-19 Taskforce, this is useful to balance different options in decision making. The key message of our study is that fostering, strengthening and empowering additional interventions (other than social distancing) can achieve the same mitigation on the infection curve. This is investigated both from a conceptual point of view (Fig. 8) and by considering the evolution of empirical data under mitigation strategies (Fig.9). In the latter, differences in rho might appear small, but in fact correspond to significant changes in people’s lifestyle in terms of measures employed to obtain them (curfew, home office, closure of restaurants, shops, recreational activities, sport clubs and ultimately lockdown). Changes in the second digit of \\rho do correspond to significant changes in lifestyle for a considerable amount of people, see e.g. https://www.medrxiv.org/content/10.1101/2020.12.31.20249088v1.full.

Another very important remark is about the model for a generalized lock-down. In your approach only susceptible nodes are isolated in the state P while I expect that a fraction of the whole population in a lock-down is isolated; in particular I expect that the sudden isolation of infected and exposed individuals should have a larger effect than the isolation of susceptible ones. Moreover I think that the process should be described only by the approach in figure 4 i.e. a sudden isolation of a large number of individuals which remain isolated during the whole period of non-pharmaceutical interventions; while other individuals do not self isolates (e.g. they do an essential job), so that after the quick self isolation mu is restored to 0. On the other hand, a self isolation with constant rate, in the whole period of intervention seems to be very unlikely. An even a similar and simpler model of a generalized lock down could be at the beginning of the intervention an instantaneous isolation in the state P of a fraction of individuals (independently of their states). Therefore, I think that the different scenarios and the data fitting should take into account only the approach in figure 4 (clearly with possible different fraction of people that self isolate).

>The approach described by Reviewer#1 was used for the fitting, in which a fraction of individuals (independently of their state) is isolated or disconnected through the action of all parameters together. Indeed, we used the mu_ld from Fig.4 for the fitting. Following Reviewer#1 comments, we edited the text to make the point clearer (“For the protection parameter, we used μ_ld acting on 4 days (as analysed in Fig. 4) since it better reflects the rapid isolation that happened during the first COVID-19 wave”, Line 369) and we corrected the labels in Fig. 9.

Reviewer#2:

Evaluation

The paper has a number of shortcomings, and would require a much deeper discussion of several parts (see my main points). Also, the epidemiological language should be improved in many points. Some cited papers are weak. Therefore, the authors should (i) do an effort to (substantially) amend their paper according to the indications reported below, but especially (ii) put into evidence their findings that are of main epidemiological interest, particularly in relation to the insights that the adopted modeling framework would provide in relation to the understanding of COVID-19 control.

>We thank Reviewer#2 for his/her careful comments and remarks.

Main points

The proposed SPQEIR model is quite restrictive in its formulation and therefore the underlying hypotheses should be carefully discussed. First, P individuals are – according to the stated hypotheses – fully protected, which corresponds to full segregation forever i.e., during the entire history of intervention measures. But measures aimed at confining susceptible people hardly can go beyond home confinement, and there is strong evidence that – during lockdowns - much COVID transmission occurred within households (especially during the first wave). Pairwise, also removed E individuals are fully inactivated in the SPEIR. Also, this should be discussed carefully.

>We included these points for discussion and disclosed the model assumptions more explicitly (Sec 2.3 and Discussion, lines 473-485). In general, such points would indeed diminish the effectiveness of the control strategies, for which we assess the theoretical impact. We agree that including these aspects would likely make a significant difference on the exact values of the model variables during the epidemic waves. Nevertheless, we believe that they would not impact our take home message, i.e. that different measures impact differently the epidemic curves, but the same desired mitigation of the infectious curve can be obtained by social distancing plus synergies of other measures with potentially smaller socio-economic impact. We indeed proved this for 6 European countries. Fitting their data using either social distancing alone, or a synergy of strategies, results in milder social distancing (higher rho), thus assessing the generality of this finding.

Moreover, as E individuals can be removed mostly by way of tracing, it is not clear to me why you do not allow a pairwise option for I individuals (e.g. asymptomatic or pauci-symptomatic) by the same mechanism. Last, I understand screening and isolation of actively infected individuals is incorporated into removal (L99), which is an option. However, did you handle your removal rate to account for this (perhaps I didn’t note details)?

We agree with Reviewer#2’s remarks. The reason why we originally did not allow a pairwise option for I individuals, i.e. the possibility for I individuals to be removed from the infectious pool by quarantining, is that the first focus of the study was on investigating the role and the importance of preventive measures targeting S and E population groups, like tracing (e.g by app), protection of vulnerable individuals, and social distancing. Nevertheless, we fully agree that these neglect the fact that, once a person has become infectious (I), he/she might be tested and subsequently before having naturally recovered. Comparing the effect of this intervention with preventive ones is therefore very interesting. Hence, we modified the model, simulations and figures to incorporate this advice from reviewer 2. In particular, the ODEs are modified by an extra parameter \\eta handling the removal rate, which in turn modifies R (Eq. 1). Then, we performed its systematic analysis in Sec. 3.1.4 and Fig. 7. The proposed synergies (Sec 3.2 and Fig. 8) now take \\eta into account, as well as the fitting performed in Fig. 9. For fitting, we assumed by default that all countries worked to isolate contagious individuals; hence, the parameter \\eta is associated to all. This is also disclosed in the description of Table 1. In other sections, the text was edited accordingly (Lines 151-154, 434-440).

L141 “We fit the model to the official number of currently infected (active) cases, for each considered country.” The authors are surely aware that published numbers of currently infectious cases poorly represent true infectious cases. So, this should at least be discussed more carefully. Moreover, this information risks of being severely biased when you aim at making comparisons between different countries – especially during the first wave - because it reflects the inter-country differences in testing and tracing, making comparisons unreliable.

>We agree with the reviewer that published data of currently infected cases do not fully represent the true infectious cases, largely due to a fraction undetected cases, either because asymptomatic or because of lack of sufficient testing. Estimating this fraction of undetected can be based on prevalence studies based on antibodies tests, but ultimately this fraction remains largely uncertain. Thus, we decided not to employ such estimates in our model, as we considered the measured numbers of detected cases sufficient for the scope of our study, which is not to produce projections of the future evolution of the epidemic. Instead, it is intended to show how a synergy of measures could explain the observed curves of infection as nicely as social distancing alone, with lower levels of social distancing itself.

When choosing the countries for the subsequent analysis, we considered those with similar share of positive tests, aiming at excluding countries with too inefficient testing strategies and thus with overwhelmingly high numbers of undetected cases. We would like to stress that, while we do fit to 6 countries, our aim is not to compare the numbers of active infections between countries, but rather to verify our analysis of the effect of synergies on a number of real-world settings. Moreover, our focus is not on the values of active cases between countries, but rather on their dynamics, i.e. the shape of the infections curves. In addition, recent studies showed no statistically significant divergence of the data of the considered countries from theoretical trends [28,29]. Hence, it is reasonable to assume that these time-series data are capturing plausible time evolutions, which are thus informative of the epidemic dynamic.

In general, we acknowledge that Reviewer#2’s remark is particularly important for the overall interpretation of the results, so we broadened our discussion and reported the above discussion in the text (Lines 87-95 and 491-498).

L140. Fitting procedures. The authors adopted a nonlinear least squares procedure citing a rather old textbook whereas the basic statistics of epidemic data has progressed dramatically in the last twenty years, first of all maximum likelihood techniques. For example, I do not understand how the quantity in (3) can be used to document the improvement in fit compared to the baseline model.

>We acknowledge that most advanced inference techniques exist and are often employed in other frameworks. For instance, in a recent follow up study that our group developed in https://www.medrxiv.org/content/10.1101/2020.12.31.20249088v1.full, we employed Bayesian inference relying on Markov Chain Monte Carlo Methods to fit an extension of the present model. Here we considered the number of parameters small enough and the problem simple enough to justify the use of a simple non-linear least squares. Thus, the fitting procedure applied in this study relied on a non-linear Python pipeline that is in common use for problems with similar degrees of freedom as ours. To support that the method is enough for the goal, we can observe in Fig. 9 that the parameter values obtained allow to the model simulation to fit reasonably well the time-series data.

Finally, the reduced chi squared metric of eq.3 was not used for fitting, but to assess the goodness-of-fit, as it is a common diagnostic tool [Maydeu-Olivares, Alberto. "Maximum likelihood estimation of structural equation models for continuous data: Standard errors and goodness of fit." Structural Equation Modeling: A Multidisciplinary Journal 24.3 (2017): 383-394.; but also: Wen, Zhonglin, Kit-Tai Hau, and W. Marsh Herbert. "Structural equation model testing: Cutoff criteria for goodness of fit indices and chi-square test." Acta psychologica sinica 36.02 (2004): 186-194.]. The statistical justifications for this can be found e.g. in [43]. In fact, the chi square is the simplest possible form of the likelihood, obtained when writing the likelihood function assuming that errors on the measurement of the data are Gaussian distributed. In absence of better knowledge on the sources of errors on the available data, Gaussian distributed errors are the most common assumption in mean field models. An intuitive understanding can be gained as follows. The reduced chi square (3) is a quantity based on summing up the square distances of data-points from corresponding simulation values. It does provide a measure of the geometrical distance between the model simulation and the datapoints. Thus, smaller reduced chi square means smaller distance between model simulation and data, i.e. better fit. Thus, computing the quantity (3) for two models (e.g. the baseline model and the model with synergies) and comparing the two obtained numbers allow to asses which of the two models provide a better fit to the data.

L83 “the time T passed until no new infections occur”, this is quite wrong at least as far as your model is a deterministic one, as I understand it is. In the practice of simulation this does not need to be a problem (and indeed you acknowledge this at a later stage), but the sentence should be modified.

>We agree, thus the sentence has now been modified (Line 108).

L119, the effective reproduction number is not explicit in the SIR model, because the susceptible fraction is not explicit. Therefore, the formula drawn from ref [26] is an approximation. The problem is that it is far from being general and rests on a number of hypotheses, which I find somewhat naive. This also holds for eq (1). I noted that even in the cited paper [26] the formula is given without a justification. The formula trivially holds if you assume that the removal by segregation of the susceptible population occurs rapidly, that is before the susceptible population is sufficiently depleted. In this case S(t) = Nexp(-\\�t), so that if you additionally assume that \\�t is small (which contradicts that segregation occurs fast) and resort to the linear approximation of the exponential function you arrive to the point. Anyhow, is this relevant for this paper? On top, I recommend to avoid to cite whatever paper appeared in this epoch because the quality is not necessarily good (sometimes poor) and may induce errors in readers.

>We agree with Reviewer#2’s analysis and his/her remark that, in fact, an explicit dependence to mu does not hold in case of hard lockdown (e.g Fig. 4) and does not add value to our analysis. Hence, we edited the text accordingly (line), by avoiding citing poorly supported papers and by editing eq. 1 in general terms that are not subject to the mentioned assumptions. The subsequent analysis is performed following the updated eq.1.

As for the remark about recent literature, we agree about being careful when citing non-peer reviewed works from the latest months. We amended our bibliography in this respect.

Legends of simulation exercises are scanty and should be improved.

>We improved the legends in simulation and fitting figures.

Other points

L34, “homogeneous propagation media” is naïve for most readers of the Journal; as epidemiologists we speak of “a homogeneously mixing population” which is a nowadays somewhat universally agreed terminology.

>The text was edited (Line 47).

IBM models are not continuous but discrete models (due to their very structure of simulative models)

>The text was edited (Line 52).

L42, "likely" : socially active and at risk of infection

>The text was edited (Line 55).

L83 Clearly, the SEIR model by its I curve provides only a very indirect measure of the pressure on PH system (instead represented by ICU and hospitals occupancy). Even more so for the economic system. This should be discussed.

>We edited the text to avoid overstatements about possible direct influences of the I curve on other systems (Lines 106-109), and we discussed and supported its relevance in epidemic management by referring to multidisciplinary studies [17, 18, 31-34]. We did not include such aspects in the current model because they went beyond the question we tackle here.

L112 “resulting in the effective reproduction number”, In epidemiology the effective reproduction number deals with a situation where the susceptible proportion is depleted below one, as you correctly say in the subsequent line. Suggest to rephrase.

>The text was edited (Lines 141-144).

L126 “We use mean values etc”, please clarify

>The text was edited (Line 155).

L129 “with conservation of the total number of individuals, meaning N’ = 0”, the argument goes the other way round, your system fulfills N’=0 implying that N is conserved.

>The text was edited (Line 160).

L86 “Mainstream suppression measures against the epidemic aim at flattening the curve of new infections”, replace “suppression “ by “mitigation” (flattening the epidemic curve is somewhat different from suppressing)

>The text was edited (Line 112 and throughout the text).

L161 “comparative information analysis” this is not an agree terminology

>The text was edited (Line 193-196).

Minor points

I suggest to delete “new” from the abstract and simply state: “an extended SEIR model including quarantine of susceptible an latently infected individuals”

>We agree about this and edited the text accordingly.

L8 “statistical methods allow for accurate characterization of the population's health state", stated like this is a bit trivial.

>The text was edited (Line 8).

L111 “repression” not appropriate

>The text was edited (Line 140 and throughout the text).

L117 “physical reduction of a country's population” ?

>We meant that the active population within a country could diminish after reduced commuters’ activity. For instance, this happened and had a great impact in the country of our institution (Luxembourg). The text was therefore edited (Line 146).

L182 I suggest to replace “mathematical” in the title with “Simulation”: it is a simulative analysis

>The text was edited (Line 214).

L189 “eradication time” inappropriate wording

>The text was edited (Line 221).

L194 Citation 32 is not appropriate. That paper considered a model with behavioral responses which are not included here.

>We agree with Reviewer#1 and we removed the reference not to confuse the reader and edited the text accordingly (Line 224).

Attachment

Submitted filename: Response to reviewers.docx

Decision Letter 1

Michele Tizzoni

23 Feb 2021

PONE-D-20-26921R1

Dynamical SPQEIR model assesses the effectiveness of non-pharmaceutical interventions against COVID-19 epidemic outbreaks

PLOS ONE

Dear Dr. Proverbio,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Reviewer #1 has raised some concerns that require an additional revision, in particular regarding the fit and the parameters of the model. 

Please submit your revised manuscript by Apr 09 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Michele Tizzoni

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors now clarify the main claim of their work: "We ultimately show that analogous containment levels of the infectious curve can be achieved by alternative synergies of non-pharmaceutical interventions." So the message of the paper now is clear and one can better evaluate the results. However several important points in my opinion still require improvement.

- The authors claim that similar results can be obtained with different interventions. Figure 8 indeed provides similar curves for the first 4 scenarios where the value of the effective reproductive number is similar, while the evolution of scenarios 5 and 6 is different but these scenarios present a different effective R. In this perspective one could infer that scenarios with similar reproductive number display similar epidemic evolution, which is not surprising. Can you discuss this point? Moreover, you fit the data set using as fitting parameters only social distancing or considering all the parameters of the non-pharmaceutical interventions. Similar quality of the fittings are obtained, evidencing that different approachess can be adopted. However, the fit with the whole parameter set is very similar to the case where only social distancing is present (the parameters rho are close, while mu_ld chi and eta are very small). Therefore one could suppose that social distancing is the main intervention observed in the data. What happens e.g. if you consider in the fit only a lock down, which has been a common intervention in the first wave of COVID 19? You state that important correlations among the fitting parameters is observed. It should be interesting if you are able to show what is the region in the parameter space (rho,mu_ld, eta) where you obtain a nice fitting of the epidemic curves with a similar (small) value of chi^2. In this way one could compare the relevance of the different possible interventions. According to the previous hypothesis this region should correspond to a region at constant value of the reproductive number.

- A small constant value of mu as modelling of protection in my opinion is not realistic. The case where a fraction of the population isolate in a small time well represent a lock down. While a constant rate of isolation during the whole epidemics it seems to me that do not represent a realistic non pharmaceutical intervention. While people should self isolate with a small constant rate? On the other hand, a constant mu could well represent vaccination which is not a pharmaceutical intervention. Moreover, the sentence: "In particular, μ = 0.01 d −1 ..... through isolation, this is unrealistic." seems to be in contrast with the large value of mu of figure 2.

- In the lock down description where a large value of mu is activated for a small time to isolate quickly a finite fraction of the population I do not understand why only susceptible people are put into quarantine. I expect that a general measure as a lock down involves all the population including also exposed and infected individuals. Indeed the aim of a lock down is not only protection of the susceptible nodes but also isolation of potentially infected people.

- 10 days from the onset of the first contagion is an arbitrary choice. The importance of an early adoption of measure of containment is a well known fact. Clearly 10 days belongs to such early adoption framework what happens if measures are taken after a longer time. The different strategies are still equivalent?

- I do not understand the sentence: "However, we notice that values of ρ ' 0.3 or lower are more effective in mitigating the epidemic faster.?" clearly the smaller is rho the more is effective the measure to contain the epidemics, but what is the relevance of this comment?

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Piero Manfredi

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 May 21;16(5):e0252019. doi: 10.1371/journal.pone.0252019.r004

Author response to Decision Letter 1


2 Apr 2021

Dear editor, dear reviewers,

We are glad that Reviewer #2 is entirely satisfied by our revision, and we thank Reviewer #1 for the list of suggested improvements, which encouraged us to significantly extend our work, and making it more complete. Please find below detailed responses to the points that were raised. Our responses are in blue. In the main text, the parts that we edited based on comments from Reviewer #1 are in red. Following Reviewer #1 suggestions, we performed the analysis of further interesting aspects that complement the main findings reported in the manuscript, and we created a Supplementary Information S1 Text to discuss those additional analysis.

Reviewer #1: The authors now clarify the main claim of their work: "We ultimately show that analogous containment levels of the infectious curve can be achieved by alternative synergies of non-pharmaceutical interventions." So the message of the paper now is clear and one can better evaluate the results. However several important points in my opinion still require improvement.

- The authors claim that similar results can be obtained with different interventions. Figure 8 indeed provides similar curves for the first 4 scenarios where the value of the effective reproductive number is similar, while the evolution of scenarios 5 and 6 is different but these scenarios present a different effective R. In this perspective one could infer that scenarios with similar reproductive number display similar epidemic evolution, which is not surprising. Can you discuss this point?

The point raised by Reviewer #1 is correct. It is indeed known that epidemic dynamics are driven by the control parameter R_eff. However, there are multiple ways to achieve the same R_eff. Indeed, R_eff results from different combinations of finer-gained parameters. Figure 8 shows how to achieve fine-tuning of different interventions by acting on specific parameters, which could eventually be lumped into the global R_eff as explained in Eq. 1. While Fig. 8 displays a limited number of example scenarios, others can be simulated with our companion Shinyapp (https://jose-ameijeiras.shinyapps.io/SPQEIR_model/). Following Rev. #1’s suggestion, we discussed this point further in the text (Sec. 3.2).

- Moreover, you fit the data set using as fitting parameters only social distancing or considering all the parameters of the non-pharmaceutical interventions. Similar quality of the fittings are obtained, evidencing that different approachess can be adopted. However, the fit with the whole parameter set is very similar to the case where only social distancing is present (the parameters rho are close, while mu_ld chi and eta are very small). Therefore one could suppose that social distancing is the main intervention observed in the data.

The fitting called “only social distancing” is primarily performed to assess a reasonable value for R_eff that is less sensitive to the identifiability issue (fitting degenerate parameters) discussed in the text. This is done to make a comparison with the R_eff value obtained with fine-grained parameters fitting. Indeed, we observe that social distancing plays an important role even for the other combinations of interventions, which is not surprising as it is the main population-wide intervention during European-like lockdowns (as also reported in Table 1), while others are more targeted to individuals. Nonetheless, other parameters, despite being low, induce non-negligible impacts (for instance, a moderately high number of individuals flow into the outer compartments, as reported in Table1 of SI Text). We discuss this impact in the main text (Sec. 3.3 and 4) as well as in the new Supplementary Information SI Text (SI Sec. 2), which was added for this purpose.

- What happens e.g. if you consider in the fit only a lock down, which has been a common intervention in the first wave of COVID 19?

Our strategy was based on fitting only those parameters that are associated with interventions observed and reported in the considered countries (as discussed in Table 1 of Main Text). Hence, we did not perform different fitting with alternative parameters combinations, that were instead not observed in reality (cf. ACAPS database reference in Main Text). As this goes beyond the scopes of the present manuscript, further studies might investigate these aspects. To improve the discussion, we expanded this point in the text (Sec. 3).

- You state that important correlations among the fitting parameters is observed. It should be interesting if you are able to show what is the region in the parameter space (rho,mu_ld, eta) where you obtain a nice fitting of the epidemic curves with a similar (small) value of chi^2. In this way one could compare the relevance of the different possible interventions. According to the previous hypothesis this region should correspond to a region at constant value of the reproductive number.

The identifiability of epidemiological parameters is indeed an interesting point. To better explore the parameter space, we expanded our previous analysis, that was based on a gradient descent non-linear fitting from the lmfit python library. The new extension of our analysis was performed with a Bayesian Inference framework based on Markov Chain Monte Carlo (MCMC) methods. This allowed a better exploration of the parameters space, highlighting regions corresponding to similar R_eff values and similar fitness to data. This additional analysis is now included in the new Supplementary Information SI Text (SI Sec. 2). Figs. 5-7 outline the areas of parameter space (for different couples of parameters and different countries) corresponding to a high posterior probability, and thus a good fitness of the model to the data.

- A small constant value of mu as modelling of protection in my opinion is not realistic. The case where a fraction of the population isolate in a small time well represent a lock down. While a constant rate of isolation during the whole epidemics it seems to me that do not represent a realistic non pharmaceutical intervention. While people should self isolate with a small constant rate? On the other hand, a constant mu could well represent vaccination which is not a pharmaceutical intervention. Moreover, the sentence: "In particular, μ = 0.01 d −1 ..... through isolation, this is unrealistic." seems to be in contrast with the large value of mu of figure 2.

We agree with Reviewer #1’s comment and we edited the considered sentences accordingly.

In general, small \\mu values are investigated in their corresponding section to complete the conceptual analysis, but only high values during a short time were used to perform the country-wise fitting, thus mimicking the beginning of a lockdown in Europe and reproducing the behavior discussed in Fig. 4.

- In the lock down description where a large value of mu is activated for a small time to isolate quickly a finite fraction of the population I do not understand why only susceptible people are put into quarantine. I expect that a general measure as a lock down involves all the population including also exposed and infected individuals. Indeed the aim of a lock down is not only protection of the susceptible nodes but also isolation of potentially infected people.

This is indeed an important point. From a modelling perspective, all outfluxes from the main epidemic compartments (framed in Fig.1) to Q and P compartments correspond to isolating measures. During the whole intervention period, all outflux parameters are active, thus modelling the observed interventions that were applied during European-like lockdowns, which also targeted potentially infected people as explained in Table 1.

On the other hand, we named the intervention parameters after the compartment they act upon. So the action of “protection” is on susceptibles only, whereas the removal of individuals from the infectious compartments (framed in Fig.1) comes from the combination of all outflux parameters.

- 10 days from the onset of the first contagion is an arbitrary choice. The importance of an early adoption of measure of containment is a well known fact. Clearly 10 days belongs to such early adoption framework what happens if measures are taken after a longer time. The different strategies are still equivalent?

We agree with the reviewer that 10 days is to some extent arbitrary. This aspect is indeed of interest for readers, as the delay \\tau represents an extra parameter that might influence the dynamics. To answer in detail and to improve the content of our manuscript, we performed additional simulations and included an extended discussion section in the Supplementary Information SI Text (SI Sec. 1). We observe that the qualitative evolution (trends, dependence on parameters, etc.) of the epidemic curve under interventions does not change, and its quantitative details (height of the peak, absolute number of days until mitigation) change according to Figs. SI 1-4. Of particular interest is the resulting tradeoff of prompt-but-weak and delayed-but-strong interventions, which cause different quantitative outcomes. Interestingly, such outcomes are currently observed in several European countries.

- I do not understand the sentence: "However, we notice that values of ρ ' 0.3 or lower are more effective in mitigating the epidemic faster.?" clearly the smaller is rho the more is effective the measure to contain the epidemics, but what is the relevance of this comment?

In Fig.2c of main text, we highlight a non-monotonous and, more intriguing, non-linear relationship between the peak height (and the mitigation timing) and the intervention parameters. The aforementioned sentence was intended to stress this point, and the fact that there are certain parameter values that minimize the peak and the timing. However, we acknowledge that it was initially not entirely clear, and we now edited the text accordingly.

We thank Reviewer #1 for his/her feedback, which led us to perform further analysis and increase the depth of the manuscript.

Attachment

Submitted filename: response_to_reviewers.docx

Decision Letter 2

Michele Tizzoni

16 Apr 2021

PONE-D-20-26921R2

Dynamical SPQEIR model assesses the effectiveness of non-pharmaceutical interventions against COVID-19 epidemic outbreaks

PLOS ONE

Dear Dr. Proverbio,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please, in your revision address the minor issues raised by Reviewer 1. 

Please submit your revised manuscript by May 31 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Michele Tizzoni

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have answered to my previous questions and in general the paper is improved accordingly.

However some points still require an improvement:

My comment on the fact that during a lock down not only susceptible individuals are removed but

also infected and exposed, has not been addressed clearly:

"This is indeed an important point. From a modelling perspective, ........the

combination of all out-flux parameters"

If this means that during the short period of isolation of individuals (4 days) you set mu=mu_ld

but also eta=mu_ld and xi=mu_ld so that also exposed and infected individuals are removed with the same rate?

In my opinion this should be a correct approach: during a lock down the same fraction of S, E and I individuals are typically protected. If this is the case it should be explained, otherwise if you set only mu=mu_ld, the model isolate only susceptible individuals during a lock down which is not very likely and some explanations should be added.

The authors introduce, in the supplementary, the analysis of the posterior probability distribution for different values of the parameters, evidencing that a nice fit of the experimental data is obtained in a wide region of the parameter set. This nice point answer to one of my previous question. However, I do not understand in figures 5,6 and 7 when you plot the probability as a function of two of the parameters how do you fix the value of the other parameters which are not consider in the plot.

There is a typo at page 12: "Sec. ??"

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 May 21;16(5):e0252019. doi: 10.1371/journal.pone.0252019.r006

Author response to Decision Letter 2


3 May 2021

Dear editor, dear reviewers,

Once again, we thank the reviewers for their further suggestions and improvements. Please find below detailed answers to the questions raised, and explanations on how we tackled the points specified by reviewer #1. Our responses are in blue. In the main text, the parts we edited following your suggestions are in red.

- Reviewer #1: The authors have answered to my previous questions and in general the paper is improved accordingly.

However some points still require an improvement:

- My comment on the fact that during a lock down not only susceptible individuals are removed but also infected and exposed, has not been addressed clearly:

"This is indeed an important point. From a modelling perspective, ........the

combination of all out-flux parameters" If this means that during the short period of isolation of individuals (4 days) you set mu=mu_ld but also eta=mu_ld and xi=mu_ld so that also exposed and infected individuals are removed with the same rate?

In my opinion this should be a correct approach: during a lock down the same fraction of S, E and I individuals are typically protected. If this is the case it should be explained, otherwise if you set only mu=mu_ld, the model isolate only susceptible individuals during a lock down which is not very likely and some explanations should be added.

We fully agree with Reviewer #1 that the suggested fitting scheme is more realistic. Hence, following the reviewer’s suggestion, we have now tested both methods (mu=mu_ld, as we employed so far, and all parameters=mu_ld during the initial 4 days of rapid isolation). While the latter is more realistic, as mentioned, the “mu=mu_ld” method is better connected to our conceptual analysis. Thus, testing both methods give an indication if a more complex model improves the goodness of fit.

Hence, we performed the fitting to country data with one method at a time, thus obtaining two sets of fitted parameters rho, mu_ld, eta etc., like in Fig.9. Our results confirm that, during the first epidemic wave, the two approaches yield similar quantitative results, as the fitted parameters differ only in the second significative digit while the reduced chi-squared metrics gets slightly worse. Thus, we can conclude the two approaches reproduce the epidemic dynamics equally well, leaving our conclusions unaltered. For illustration, we report fitting values for some example countries. Others display similar subtle changes.

Denmark

Method; rho; mu_ld; chi’; eta; R; chi2red

mu_ld acting on S; 0.35; 0.003; 0; 0.0014; 0.73; 3.8864e-09

mu_ld acting on all compartments; 0.36; 0.019; 0; 0.0013; 0.73; 6.2272e-09

Israel

Method; rho; mu_ld; chi’; eta; R; chi2red

mu_ld acting on S; 0.31; 0.001; 0.001; 0.004; 0.7; 1.6054e-08

mu_ld acting on all compartments; 0.30; 0.001; 0.001; 0.001; 0.7; 4.4888e-08

Switzerland

Method; rho; mu_ld; chi’; eta; R; chi2red

mu_ld acting on S; 0.28; 0.001; 0; 0.001; 0.67; 6.0977e-09

mu_ld acting on all compartments; 0.276; 0.001; 0; 0.001; 0.66; 6.9493e-09

This is due to the fact that, at the beginning of the pandemic, the S compartment contains by far the greatest number of individuals (since S~N); hence, parameters related to the S compartment have a larger impact on the infection dynamics. In addition, the overall impact of mu_ld is smaller than that of other parameters, such as rho, because of the nature of European-like lockdowns. In fact, the variable P in our model, controlled by the parameter mu_ld, represents the compartment of individuals with zero probability of getting infected, which correspond to a minority of people, e.g. to elderly people fully isolated and not the majority of individuals who had still some external contacts due to e.g. going to work, having a family member going to work, doing the groceries etc. The effect of the lockdown on these individuals is represented in our model by the parameter rho, which describes a decreased (but not an absence) level of social interactions.

Following Reviewer#1, we edited the text (lines 386-389) to make this point clearer.

- The authors introduce, in the supplementary, the analysis of the posterior probability distribution for different values of the parameters, evidencing that a nice fit of the experimental data is obtained in a wide region of the parameter set. This nice point answer to one of my previous question. However, I do not understand in figures 5,6 and 7 when you plot the probability as a function of two of the parameters how do you fix the value of the other parameters which are not consider in the plot.

We now realised this part was not clearly explained in the text. An important point here is that the parameters are not statistically independent. The posterior distribution for a particular parameter depends on the values of other parameters. Hence, to visualise a joint posterior distribution of 2 parameters from a high dimensional one, we need to first marginalise it against the other parameters. In probability, marginalising corresponds to projecting high dimensional distributions to the dimensions of interest by integrating over the remaining (“marginalised-out”) parameters. As an example, taken from https://en.wikipedia.org/wiki/Marginal_distribution, to obtain the marginal probability of x from the joint probability distribution of x and y we would take

p_X (x)= ∫_y▒〖p_(X|Y) (x|y) p_Y (y)dy〗

This can also be exemplified by the following figure (CC0, taken from https://en.wikipedia.org/wiki/Marginal_distribution), where a 2D distribution (highlighted by the green ellipse) is marginalised over X (leading to the 1D red p(y) distribution) and Y (leading to the 1D blue p(x) one), respectively.

[figure shown in attached .docx fie]

Similarly, we marginalised the full distribution obtained by MCMC chains to produce Figures 5, 6 and 7 of Supplementary Information. We added the word marginal to clarify this point, and discussed it further in Sup Mat (end of Sectioon 2.2. of Supplementary Information).

Finally, it has been reported (cf. Table 1) that some countries did not employ certain strategies. Thus, for those countries, the corresponding parameters were fixed to default values as described in Sec. “The extended SPQEIR model to reflect mitigation strategies”.

- There is a typo at page 12: "Sec. ??"

The typo has now been corrected, we thank Reviewer#1 for noticing.

Attachment

Submitted filename: response_to_reviewer.docx

Decision Letter 3

Michele Tizzoni

10 May 2021

Dynamical SPQEIR model assesses the effectiveness of non-pharmaceutical interventions against COVID-19 epidemic outbreaks

PONE-D-20-26921R3

Dear Dr. Proverbio,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Michele Tizzoni

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: (No Response)

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have answered to all my previous comments and now the article can be published on Plos One

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Acceptance letter

Michele Tizzoni

12 May 2021

PONE-D-20-26921R3

Dynamical SPQEIR model assesses the effectiveness of non-pharmaceutical interventions against COVID-19 epidemic outbreaks 

Dear Dr. Proverbio:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Michele Tizzoni

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File

    (TXT)

    S1 Text

    (PDF)

    Attachment

    Submitted filename: Response to reviewers.docx

    Attachment

    Submitted filename: response_to_reviewers.docx

    Attachment

    Submitted filename: response_to_reviewer.docx

    Data Availability Statement

    Databases of social measures can be accessed at https://www.who.int/emergencies/diseases/novel-coronavirus-2019/phsm. ACAPS database is at https://www.acaps.org/covid19-government-measures-dataset. Worldwide epidemiological data collection from John Hopkins University is at https://github.com/CSSEGISandData/COVID-19. Lombardy data were retrived from https://github.com/pcm-dpc/COVID-19. Google mobility data were accessed through https://ourworldindata.org/covid-mobility-trends. The code for analysis can be found at https://github.com/daniele-proverbio/assessing_strategies.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES