Skip to main content
PLOS One logoLink to PLOS One
. 2021 Feb 17;16(2):e0247182. doi: 10.1371/journal.pone.0247182

Development of an interactive, agent-based local stochastic model of COVID-19 transmission and evaluation of mitigation strategies illustrated for the state of Massachusetts, USA

Alexander Kirpich 1,2,#, Vladimir Koniukhovskii 3,#, Vladimir Shvartc 3, Pavel Skums 4, Thomas A Weppelmann 5, Evgeny Imyanitov 6, Semyon Semyonov 7, Konstantin Barsukov 3, Yuriy Gankin 7,*
Editor: Gergely Röst8
PMCID: PMC7888623  PMID: 33596247

Abstract

Since its discovery in the Hubei province of China, the global spread of the novel coronavirus SARS-CoV-2 has resulted in millions of COVID-19 cases and hundreds of thousands of deaths. The spread throughout Asia, Europe, and the Americas has presented one of the greatest infectious disease threats in recent history and has tested the capacity of global health infrastructures. Since no effective vaccine is available, isolation techniques to prevent infection such as home quarantine and social distancing while in public have remained the cornerstone of public health interventions. While government and health officials were charged with implementing stay-at-home strategies, many of which had little guidance as to the consequences of how quickly to begin them. Moreover, as the local epidemic curves have been flattened, the same officials must wrestle with when to ease or cease such restrictions as to not impose economic turmoil. To evaluate the effects of quarantine strategies during the initial epidemic, an agent based modeling framework was created to take into account local spread based on geographic and population data with a corresponding interactive desktop and web-based application. Using the state of Massachusetts in the United States of America, we have illustrated the consequences of implementing quarantines at different time points after the initial seeding of the state with COVID-19 cases. Furthermore, we suggest that this application can be adapted to other states, small countries, or regions within a country to provide decision makers with critical information necessary to best protect human health.

Introduction

The epidemic of a novel coronavirus was first detected in the city of Wuhan in the Chinese province Hubei on December of 2019 [14]. Despite the unprecedented efforts from Chinese authorities including the complete lockdown of the entire city of Wuhan on January 22, 2020 the virus has rapidly spread to all continents except Antarctica. The World Health Organization (WHO) officially declared the coronavirus a global pandemic on March 11, 2020 [5], only three months after the first case was detected. The novel coronavirus is now officially named SARS-CoV-2 and the disease caused by it has been called COVID-19 [6] to distinguish from SARS-CoV and the corresponding severe acute respiratory syndrome (SARS) pandemic from 2003 [7, 8]. Despite the much lower case-fatality rate, SARS-CoV-2 has caused morbidity and mortality orders of magnitude higher than severe acute respiratory syndrome (SARS) and Middle East respiratory syndrome (MERS) combined [9]. As of May 13, 2020, more than 4.1 million infections have been reported worldwide, with more than 287, 000 deaths due to complications of COVID-19 [10]. As of May, 2020 there is neither an effective virus-specific treatment, nor Food and Drug Administration (FDA) approved vaccine available for SARS-CoV-2 [1118]. As such, social distancing and quarantine are the only available measures to reduce the transmission and prevent overwhelming the capacity of existing healthcare systems. Social distancing in this context means practice of physical distancing between individuals to prevent transmissions. Quarantine involves more targeted actions and restrictions for those individual who are or are suspected to be infected with the goal of keeping them away from the others. Starting at the epicenter of Hubei province [19] in January, 2020, governments around the world have implemented society lockdown measures of varying degrees [2024]. Since such measures remain the only available tools to control the spread of the pandemic, it is critical to understand the transmission dynamics of SARS-CoV-2 in the population. This would allow for the prediction of COVID-19 cases and deaths over time under different mitigation strategies, which could be implemented to reduce morbidity and mortality; as well as the allocation of limited resources to medical providers.

To achieve this goal, multiple approaches can be implemented that are typically driven by the quality and precision of the available data. The most commonly reported data for epidemics are the incidence of new cases and deaths represented as a time series over the fixed intervals (e.g. days or weeks) aggregated across multiple regions and reporting sources [2527]. This aggregated data can be used for incidence curve reconstruction, modeling, and prediction when more detailed information about each infected individual is not available [2832]. Such models are called compartmental models [33] where the study population is divided into groups while individuals within each group are assumed to have the same characteristics of interest (e.g. susceptible, infected, vaccinated, or immune). The compartmental models are formulated via a defined system of differential equations that allows for both deterministic and stochastic formulations to quantify the uncertainty of the model fit. Those models provide insight into the underlying epidemic dynamics and allow for the prediction of future trends in incidence under different transmission scenarios, including interventions such as social distancing, quarantines, and vaccinations. Another approach are the agent-based models [3439], which utilize a synthetic population, that attempts to realistically represent the social interactions in time and space between individuals with different characteristics and infection status [36]. Compared to compartment models, agent-based models rely on detailed data about the study population, making them more computationally intensive while allowing for more realistic simulations of human transmission pathways.

An example of an agent-based model that has been developed to study influenza but has been successfully applied to study other respiratory diseases, including the efficacy of quarantine measures for containment of SARS-CoV-2 is the FluTE model [35, 40] which was specifically adopted with the name Corvid [38]. The FluTE model is based on the assumption that the synthetic study population is parsed in social subgroups and the interactions between them are modeled at different community levels (household, neighborhood, work), age groups, time of the day, and other characteristics. In this work, we propose an agent based model that can be applied by regional governments to local epidemiological settings, using incidence data from Massachusetts, USA. The proposed model incorporates the infected individuals that are reported in the beginning of an epidemic for a given area and their personal characteristics such as the date the infection was confirmation, geographic location, and demographic characteristics. Thus, by using a limited amount of information, such as the populations of each zip code and number of reported cases, a robust simulation is generated with time series data of predicted disease morbidity and mortality. Furthermore, by incorporating different quarantine strategies, the reduction in the number of new cases and deaths can be estimated for each locale depending on their unique characteristics. Since this model uses limited input data that are publicly available and is implemented in the form of an interactive web application, we believe that this tool could represent a widely adaptable format for state and local governments and health officials to make informed decisions as they consider easing or ceasing mandatory quarantines. Once effective treatments and vaccines become available, this framework could also be used to allocate treatment resources and plan vaccination campaigns tailored to fit different geographic regions. The reported demographics data can also be depersonalized in accordance to HIPAA regulations [41] to make the use of the model versatile and not to violate the privacy of individuals.

Materials and methods

The model structure

The model stochastic simulations are generating the infected individuals at different times and stages. Those individuals are indexed by k and have individual characteristics presented below:

Qk=((xk,yk),tinfk,detk,stgk,agek,radk,pcont(k),contk,R0(k),severk,durk,stk(t)). (1)

The characteristics of each individual Qk are determined and updated within the simulation process and have the following details:

  • (xk, yk)—the Cartesian coordinates (in pixels) of the individual Qk that do not change within the simulation process after they are introduced;

  • tinfk—the time of infection onset for the individual Qk which is measured in relation to the simulation baseline time denoted as 0;

  • detk—the detection time variable measured in days that corresponds to a period from an infection acquisition until the proper diagnosis and reporting of individual Qk;

  • stgk = (stg1(k), stg2(k), stg3(k))—the vector of durations of three disease infection stages measured in days that characterize the infectivity of the given individual during those stages. It is assumed that stg1(k) + stg2(k) + stg3(k) = detk;

  • agek—the age of the individual Qk at the time of the infection onset;

  • radk—the distance (in meters) up to which the individual Qk is able to infect the nearby individuals;

  • pcont(k)—the probability that during each day the individual Qk has any contacts which lead to new infections;

  • contk=(μcont(k),σcont(k)2)—the individual-specific parameters that define the distribution of the number of successful infection transmissions to other individuals within a given day. This number is generated randomly for each day t, provided that the individual has any transmissions on the given day (according to the contact probability pcont(k)).

  • R0(k)—the individual’s reproduction number. This variable stores the number of individuals that is infected by Qk during the infection period detk. The average of those reproduction numbers across individuals and simulations are used to estimate the basic reproduction number R0 [42] which is a characteristic of the entire epidemic;

  • severk—the disease severity variable for the individual Qk that takes three values, where 1 corresponds to lethal, 2 corresponds to severe, and 3 corresponds to mild; the disease severity does not change for a given individual after it is determined randomly from a trinomial distribution;

  • durk—the disease duration from the infection onset to cure (or death) in days, which is generated randomly based on the severk parameter;

  • stk(t)—the status of the individual Qk at a given day t. The status of the individuals within the simulation is expected to change over time and is expected to take the following values:
    • stk(t) = 0—the individual is detected based on the external information i.e. from the reported data that are used as the model input;
    • stk(t) = 1—the individual is infected but has not been identified as such yet;
    • stk(t) = 2—the individual has been infected and detected as such, which has also implied the individual’s isolation (quarantine).
    • stk(t) = 3—the individual has recovered and is immune;
    • stk(t) = 4—the individual has deceased.

The asymptomatic infections are incorporated inside the model via three severities that are generated for each infected individual. This incorporation of asymptomatic infections into those with a “mild” severity status is made to improve the model computational tractability. Since the model parameters are calibrated based on the detected cases and the output of the model presents the detected cases as well the prediction abilities for detected and reported cases within the model are preserved. The severities are discussed in details in the manuscript supplement S1 Appendix. In the beginning of the simulations the model utilizes multiple local epidemic epicenters E={E1,E2,,EI}. Those epicenters serve as the model initial conditions and represent the introductory geographic points for the index cases that are introduced into the susceptible population. The epicenters can either correspond to the actual address coordinates for those places where the initial outbreaks were detected or to the centers of the corresponding aggregated geographic units. The latter may be the case, if either the exact infection acquisition locations are not known, or the privacy concerns prevent the inclusion of such data into the model. In the latter case the centers of the aggregated geographic units are taken as epicenters Ei for each i=1,2,,I.

The local epicenters in the model are defined by a pair of geographic coordinates (Lat, Long) and by an epicenter-specific region radius Ri which is defined in meters. Therefore, for i=1,2,,I the epicenter region is defined by a triplet:

Ei=((Lati,Longi),Ri). (2)

The epicenter regions are defined from the surveillance epidemiological data [43]. As the initial conditions in addition to the local epicenters the model incorporates the areas of high density P={P1,P2,,PJ} for j=1,2,,J, where each Pj represents a large city or a densely populated area and which is also defined by a triplet:

Pj=((Latj,Longj),Rj). (3)

In the model the reporting times (days) for the initial index cases for each epicenter i precede the modeled epidemic starting time which corresponds to the baseline time slot t = 0. Therefore, the reported time slot indexes across the epicenters Ei are denoted as s=1,2,,S with the corresponding times t˜1,t˜2,,t˜S. The earliest reported cases and their dates are used for the model input with indexes s=1,2,,S˜ such that S˜<S and the corresponding times t˜1,t˜2,,t˜S˜. The corresponding number of confirmed and reported infections for each local epicenter Ei up to and including the time t˜S˜ for s=1,2,,S˜ is denoted as ni(t˜S˜). The corresponding set of infected and reported (i.e. with the status stk(t) = 1) individuals across all epicenter is denoted as:

D={Q˜1,Q˜2,,Q˜KS˜}, (4)

where k=1,2,,KS˜ is the global index for initial cases across all times t˜1,t˜2,,t˜S and KS˜ is the total number of the initial index cases that is simulated within the model based on the input data. The tilde notation for Q˜k-s in D emphasizes the link to the model input data. The newly infected individuals are generated spatially in relation to the population area centers in the beginning and later in relation to the previously infected individuals. The individual’s coordinates are generated randomly using the distribution mechanism described in details in the manuscript supplement S1 Appendix.

The time index that corresponds to individual day within the model is denoted as t and is equal to 0 at the model baseline. The simulation baseline time t = 0 corresponds to the latest reporting time t˜S˜ of the earliest reported cases that are used for the model input. The actual infection times for those index cases precede the selected baseline simulation time t = 0 due to the infectivity periods generated for those index cases prior to their reporting. The actual simulation starting time that accounts for the infectivity periods is denoted as t = Tmin and is smaller than the baseline time t = 0. This simulation starting time t = Tmin is generated within the model, while the baseline time t = 0 is defined by the data and is defined by the largest index within the set of calibration indexes s=1,2,,S˜. The largest simulation time t = Tmax is determined by the model user based on the desired length of prediction. The initial set of index cases D from (4) defines the model initial cases that are allocated across the local epicenters (2) at times up to the baseline time t = 0.

Based on the model geographic characteristics (2) and (3) and the initial set of reported individuals D from (4) the new lists L(t) of of modeled individuals are simulated for time slots t ∈ [Tmin;Tmax] where TmaxTmin + 1 is the total number of the simulated time slots. The simulated lists L(t) have the following format:

L(t)={Q1,Q2,,QK(t)} (5)

where the value of K(t) is defined by the simulation at every simulation time step t ∈ [Tmin;Tmax]. During this procedure the input set individuals D defined in (4) is allocated between the different epicenters and time slots within the lists L(t) defined by (5). The allocations of the set D is performed during the time slots t[Tmin;t˜S˜] where t˜S˜<Tmax.

The overall model flow

The entire modeling process can be summarized via the following steps:

  • The model input time interval is determined by fixing the first S˜ reporting indexes out of the total S where S˜<S. Those indexes correspond to the reporting time slots t˜1,t˜2,,t˜S˜. This completely defines the list of reported index cases D from (4) that are used as the model initial conditions. The baseline time of the model t = 0 is assumed to correspond to t˜S˜.

  • The individuals from the reported set D that are defined in (4) are assigned to the local epicenters of the future epidemic Ei for i=1,2,,I based on the available (from the input data) geographic distribution.

  • The geographic data about the areas of high density Pj for j=1,2,,J are incorporated into the model.

  • The model is initialized with the index cases from D. Based on those index cases that are defined in (4) the initial infection time Tmin is determined. This step is necessary to incorporate the infection times that have been present before the first reporting time t˜1 into the model.

  • The final time point of the stochastic simulations Tmax is define by the user based on the desired study and prediction goals.

  • The initial list of infected individuals L(Tmin) is initialized at time Tmin only with the earliest model input cases from the list D(Tmin).

  • The infected list of individuals L(t+1) for the time slot t + 1 is generated sequentially for all t ∈ [Tmin;Tmax − 1] based on the list of individuals L(t) from previous time slot t and the individual’s characteristics within the list L(t+1) are updated at this time step t + 1. The details of the new infection generations are provided in S1 Appendix.

Based on the lists L(t) at every time slot t ∈ [Tmin;Tmax] the infected modeled population summaries can be computed and summarized. In particular, the total number of currently infected but not identified individuals (i.e. those with the status st(t) = 1) is saved into Inf(t) variable for every t. The total number of treated or quarantined individuals (i.e. with the status st(t) = 2) is saved into Treat(t) variable for every t. The total number of recovered individuals (i.e. with the status st(t) = 2) is saved into Recov(t) variable for every t. The total number of deceased individuals (i.e. with the status st(t) = 4) is saved into Dead(t) variable for every t. Those numbers are used in the model calibration procedures, epidemiological summaries and in the model predictions. The model input utilizes only the first S˜ reported indexes with the corresponding reported times t˜s for s=1,2,,S˜ with the total number of reported indexes equal to S and S˜<S. The remaining reported indexes S˜+τ,S˜+τ+1,,S for some integer τ are divided into the two groups:

{S˜+τ,S˜+τ+1,,S˙}and{S˙+1,S˙+2,,S}. (6)

The first group of the reported indexes from (6) is used for the model calibration and estimation of the unknown parameters. The second group of the reported indexes from (6) is used to evaluate the quality of the model predictions. The Massachusetts surveillance data that are used for the model calibration, validation and predictions are freely available at the Massachusetts Department of Public Health web site [43]. The first reported date which corresponds to the time index t˜1 in the model is March 13, 2020. The latest reported date that is used for the model input is March 26, 2020 which corresponds to the time index t˜S˜ in the model. The time indexes that correspond to t˜S˜+τ and t˜S˙ are April 14, 2020 and April 22, 2020 respectively. The parameter optimization is performed by minimizing the sum of squared differences between the model-produced outputs and the calibration data by using the Nelder–Mead numerical minimization method [44]. The additional details about the model formulation, parameterization, and calibration are summarized in the S1 Appendix.

After the model calibration is performed various quarantine and transmission intervention strategies are investigated within the calibrated model. Those intervention strategies are based on the assumption that the probability of contacts between the individuals decreases after the quarantine measures are enforced. Within the model this is implemented by an immediate change in the contact probability parameter starting from a certain calendar date. The earlier implementation of the quarantine in the model is represented by an earlier calendar date when the change in parameter value occurs. Those earlier quarantine dates result in the smaller transmission probability and fewer infected individuals in comparison to the later quarantine dates. The quarantine date in the end of the simulation period corresponds to no quarantine scenario. As an example, three scenarios with different quarantine start dates are presented and the corresponding reduction in the number of cases is discussed. There is also an option to consider other quarantine enforcement dates interactively within the current model implementation.

The model availability

The model has been implemented in multiple environments which include the application tool for Microsoft Windows [45] and the web prediction tool [46, 47] (summaries only). The model application tool for Microsoft Windows is freely available under the terms of the MIT license [48]. The tool source code, the application, and the relevant documentation are available on GitHub [45]. The current model tool has been calibrated based on the state of Massachusetts (United States) incidence data [43]. In addition to that the user has an option to adjust interactively the tool parameters which include, in particular, the transmission parameters and the quarantine implementation dates(s). Overall, the proposed framework and the code are fairly general and can be adopted for other areas and territories where the demographics of the incidence cases and population characteristics are known with at least some geographic precision, and where the rapid evaluations of social distancing measures have to be quantified.

Results

Within the model multiple epidemic progression scenarios can be considered. In particular, three different quarantine strategies are presented in this manuscript as an illustration of the model. The alternative quarantine scenarios can be produced and customized interactively within the model application tool if necessary. The difference between the presented scenarios is in the quarantine date at which the transmission probability parameter changes to smaller one. The smaller transmission parameter values result in fewer infections therefore the earlier quarantine dates result in less infections overall in comparison to the later dates. The predicted numbers of infections for each scenario are defined by the quarantine implementation date and those number can be compared. The first scenario corresponds to the quarantine date on March 29, 2020 i.e. the early reduction in contact probabilities and social distancing between individuals. The second scenario assumes the implementation of the quarantine measures on April 6, 2020, and the third scenario assumes the implementation of the quarantine measures on April 13, 2020. The point estimates and the prediction bands have been produced by replicating each of the three scenarios and taking the median values across 500 model runs for the point estimates and 5-th and 95-th percentiles for the 90% prediction intervals. The results are summarized in Tables 1 and 2 for the model-predicted cases and deaths, respectively. For example, the summaries from Table 1 can be compared after one month of the baseline date i.e. on April 26, 2020. For the first scenario the model predicts 24, 039 cumulative cases (with the 90% PI (20, 665;27, 296)), for the second scenario the model predicts 56, 587 cumulative cases (with the 90% PI (46, 944;66, 401)), and for the thirds scenario the model predicts 123, 351 cumulative cases (with the 90% PI (100, 113;144, 018)). Compared to the quarantine start date in the second scenario, the first scenario results in 58% reduction in cumulative cases on April 26, 2020, in 63% reduction in cumulative cases on May 26, 2020, and in 65% reduction in cumulative cases on June 26, 2020. Compared to the quarantine start date in the third scenario, the first scenario results in 81% reduction in cumulative cases on April 26, 2020, in 87% reduction in cumulative cases on May 26, 2020, and in 88% reduction in cumulative cases on June 26, 2020. Based on the model outputs the earliest quarantine measures and the reduction in contact probabilities can be extremely beneficial in mitigation of the outbreak consequences. The analogues summaries for the model-predicted death across the three scenarios are summarized in Table 2. Compared to the quarantine start date in the second scenario, the first scenario results in 52% reduction in cumulative deaths on April 26, 2020, in 63% reduction in cumulative deaths on May 26, 2020, and in 65% reduction in cumulative deaths on June 26, 2020. Compared to the quarantine start date in the third scenario, the first scenario results in 70% reduction in cumulative deaths on April 26, 2020, in 86% reduction in cumulative deaths on May 26, 2020, and in 88% reduction in cumulative deaths on June 26, 2020.

Table 1. The predicted number of cumulative cases produced by the model over time for three different quarantine scenarios and three time periods together with the corresponding 90% prediction intervals.

Scenario Quarantine Date April 26, 2020 May 26, 2020 June 26, 2020
First March 29, 2020 24, 039 (20, 665;27, 296) 32, 692 (27, 361;38, 221) 36, 767 (30, 288;43, 976)
Second April 06, 2020 56, 587 (46, 944;66, 401) 89, 727 (72, 843;106, 797) 105, 464 (84, 859;127, 796)
Third April 13, 2020 123, 351 (100, 113;144, 018) 245, 255 (197, 748;294, 750) 307, 128 (243, 184;362, 104)

Table 2. The predicted number of cumulative death produced by the model over time for three different quarantine scenarios and three time periods together with the corresponding 90% prediction intervals.

Scenario Quarantine Date April 26, 2020 May 26, 2020 June 26, 2020
First March 29, 2020 1, 432 (1, 248;1, 614) 2, 236 (1, 879;2, 619) 2, 603 (2, 156;3, 066)
Second April 06, 2020 2, 959 (2, 473;3, 405) 5, 987 (4, 863;7, 118) 7, 397 (5, 947;8, 870)
Third April 13, 2020 4, 813 (3, 996;5, 591) 16, 046 (12, 859;19, 007) 21, 339 (16, 884;25, 086)

The model is presented via the graphic user interface (GUI) application for Microsoft Windows as well as the as web prediction tool [46, 47] (summaries only) that can be used for the geographic visualization of various epidemiological curves and geographic visualization of cases in the state of Massachusetts. Users can work with the tool and utilize the available model customizations. The appearance of the GUI for MS Windows application is presented in Fig 1. The state of Massachusetts MassGIS data were used to produce the tool map. The data are available for download and are public records from the Bureau of Geographic Information (MassGIS), Commonwealth of Massachusetts, Executive Office of Technology and Security Services [49].

Fig 1. The tool graphic user interface.

Fig 1

The visualization tool GUI for Microsoft Windows. The tool provides the geographic visualizations of epidemic on the state of Massachusetts map and constructs the epidemiological summaries and curves. The tool allows interactive model calibrations and step-by-step simulations.

The presented application does not require installation and can be launched directly by running the executable file. The tool allows the parameters optimizations and the visual animated simulations of the model outputs and their comparison with the reported data. The user can interactively customize the most important simulation parameters, change the duration of prediction, and adjust manually the locations of high population density. This allows the user to consider multiple scenarios of the epidemic spread. In addition, the user has flexibility to re-run the model multiple times either step by step or entirely for all time slots. The user can scroll via each day of the recently completed simulation to see the visualized results of that specific day and choose which epidemiological curves to include in the summary graphs. The modeled cases and other summaries are saved into the comma-separated values (csv) files after the end of each simulation. The tool also provides the estimate of the population basic reproduction number R0 for each simulation run together with the corresponding 90% confidence intervals. The estimates for R0 are provided based on the quantiles of the individual’s reproduction numbers R0(k) across multiple individuals k both before and after the quarantine date that is defined by the user. The resulting distribution of the individual’s reproduction numbers R0(k) from the tool before and after the quarantine are summarized in Fig 2.

Fig 2. The distribution of the individual’s reproduction numbers R0(k).

Fig 2

The example of the tool output for the distribution of the individual’s reproduction numbers R0(k). The output graph contains the estimated probability density function of the individual’s reproduction numbers R0(k) together with the cumulative distribution functions both before and after the quarantine implementation date.

The example of the summary graphs for the model-produced outputs for the second scenario from Tables 1 and 2 are presented in Fig 3, which contains the four combined graphs available in the “Statistics” tab in the top right corner of the tool. Those graphs within the tool can be produced by setting the “Max Simulation Time” and “Forecast Day” fields to July 15, 2020 and by running the model 500 times by using the “Daily Forecast Evaluation” button. The 500 runs are necessary to produce the median predictions and the corresponding 90% uncertainty prediction bands across those runs by taking the 5-th and the 95-th percentiles across those situations for each time slot. Those graphs include the cumulative numbers of reported cases and deaths, together with the currently hospitalized patients and unreported cases. The graphs also include the reported data in blue. The calibration time period is highlighted in blue and is bounded by vertical bars.

Fig 3. The model-produced predictions.

Fig 3

The median of the model-produced 500 runs together with the corresponding 90% uncertainty prediction bands for different model outputs. The top left graph includes the cumulative numbers of reported cases. The top-right graph summarizes the cumulative subset of the reported cases that have deceased. The bottom graphs summarize the number of hospitalized and unreported patients in the given moment of time. The reported data are displayed in blue for visual comparison.

Discussion

In this work the local agent-based modeling framework for respiratory diseases has been presented. This framework incorporates the reported geographic incidence data that are typically available from surveillance, which include individual’s age, infection status, and the severity of the disease. The model accounts for the latent period of the individual’s infection before detection and proper reporting as well as for different disease severity levels. The framework also allows to incorporate the exact geographic addresses of individuals (if available) or the random geographic distribution of individuals within those aggregated districts where they are reported in case of privacy concerns. The model allows to perform predictions with different levels of social isolation between individuals and quarantine measures. Those measures are implemented at different times to compare different quarantine scenarios. As expected, there was a decrease in the cumulative incidence and deaths inversely proportional to the date quarantine was implemented; which resulted in approximately 50-80% reduction in cases and deaths depending on the scenario. This agrees with already published results that strict social distancing combined with proper testing will keep the disease at level that does not overwhelm the capacity of heath care system [18].

Compared to complex agent-based models, the compartmental models are based on the assumptions of homogeneous mixing and can be parameterized by a relatively small set of rates and initial conditions. The main challenges for the compartmental models [30, 31, 50] are the determination of the compartment types that are used in the model, the assignment of individuals between compartment i.e. the specifications of the set of rules that assign each particular individual to each type of compartments, and the determination of the parameters of interest which can either be postulated from external sources or estimated from data.

The agent based models, due to their inherited complexity, incorporate separate individuals with multiple different characteristics and parameters per individual. This adds another layer of parameterization flexibility, but also introduces another layer of modeling challenges, since the number of individual’s characteristics within the model is determined by the modeler [18, 3436]. This typically implies some additional assumptions about the model behavior and the overall model parametrization. Those assumptions are expected to be region-specific, since the transmission times, patterns, and other characteristics typically wary from region to region. The respiratory infections, which include SARS-CoV-2, add another level of complexity to any model due to quality of reported data. The asymptomatic cases are typically neither identified nor properly recorded and surveillance systems for symptomatic cases are never perfect either. As a result a substantial (but unknown) amount of cases is not reported and the modeler has to account for those asymptomatic and unreported symptomatic cases who still participate in the disease transmission process.

Ideally, the model has to be: 1) flexible enough to incorporate the possible social and geographic characteristics of individuals and to provide the way to realistically represent the social interactions and the disease transmission mechanisms; 2) simple enough to avoid the problems with parameterization, but able to capture the actual transmission patterns with the goal of predictions and intervention studies; 3) utilize the available surveillance and public health data in the best possible way. The best possible way in this context means, that all the information from the data that can be used to answer the questions of interest are utilized, while the number of assumptions within the model beyond the information available from the data is the smallest possible that is necessary to implement the model.

In the case of COVID-19, an epidemic which has quickly evolved into a pandemic, the local epidemic developments in every region are expected to have different dynamics influenced by multiple region-specific factors. Thus, an agent based model which utilizes local settings is likely superior to a global agent-based model in this setting and can be implemented with minimal inputs as long as local data are available. In this example, we chose regional data for the state of Massachusetts, however we believe this framework and interactive tool could be adopted and useful for small or middle size countries or other administrative districts within a larger country, that have comparable reporting and data quality across different administrative regions.

Conclusion

In this paper, we have presented a novel, localized agent-based model that can be used within minimal input data, which is publicly available and tailored to the population distributions of Massachusetts, USA. After calibration the model provided a good estimation of the actual incidence, hospitalizations, and death rates, with the added benefit of estimating the number of undetected infections in the population. Given the necessity for making decisions of easing or ceasing quarantines that are specific to a state or county based on their reported case counts, adaptation of this framework could prove to be very useful with efforts to reopen the economy, while quantifying the disease burden posed by such decisions. In addition, this model could be used for future outbreaks of other novel respiratory diseases to protect public health and possibly designed tailored interventions of treatment and vaccination campaigns.

Supporting information

S1 Appendix. Model details.

The details about the model formulation, parameterization, and calibration.

(PDF)

Data Availability

The manuscript contains all the references. They are also duplicated below. The code is available here: https://github.com/quantori/COVID19-MA-Transmission The input data are available here: https://www.mass.gov/info-details/archive-of-covid-19-cases-in-massachusetts.

Funding Statement

The authors Vladimir Koniukhovskii (VK), Vladimir Shvartc (VS) and Konstantin Barsukov (KB) are employed by the commercial company EPAM Systems in Saint Petersburg, Russia. The authors Yuriy Gankin (YG) and Semyon Semyonov (SS) are employed by the commercial company Quantori in Cambridge, Massachusetts, United States. EPAM Systems provided support in the form of salaries for authors VK and VS, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section. The authors worked on the publication at their leisure time unrelated to their job duties. Quantori provided support in the form of salaries for authors YG and SS and relevant publication fees. YG is a Chief Scientific Officer (CFO) of Quantori was an inspirer for the project due to COVID-19 situation and SS worked on the project under the supervision of YG. The specific roles of these authors are articulated in the ‘author contributions’ section. Alexander Kirpich (AK), Pavel Skums (PS), Thomas A. Weppelmann (TAW), and Evgeny Imyanitov (EI) received no funding for their work on the project. The specific roles of these authors are articulated in the ‘author contributions’ section.

References

PLoS One. 2021 Feb 17;16(2):e0247182. doi: 10.1371/journal.pone.0247182.r001

Author response to previous submission


Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

4 Aug 2020

Attachment

Submitted filename: Responses_to_reviewers_VK_AK_Cleaned_FINAL.pdf

Decision Letter 0

Gergely Röst

12 Oct 2020

PONE-D-20-24277

Development of an interactive, agent-based local stochastic model of COVID-19 transmission and evaluation of mitigation strategies illustrated for the state of Massachusetts, USA

PLOS ONE

Dear Dr. Gankin,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Nov 26 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Gergely Röst

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following in the Competing Interests section:

"The authors have declared that no competing interests exist."

We note that one or more of the authors are employed by a commercial company: EPAM Systems, Quantori.

2.1. Please provide an amended Funding Statement declaring this commercial affiliation, as well as a statement regarding the Role of Funders in your study. If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study. You can update author roles in the Author Contributions section of the online submission form.

Please also include the following statement within your amended Funding Statement.

“The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.”

If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement.

2.2. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc.  

Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and  there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

3. We note that Figure 1 in your submission contain map images which may be copyrighted. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission:

3.1.    You may seek permission from the original copyright holder of Figure 1 to publish the content specifically under the CC BY 4.0 license. 

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission.

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

3.2.    If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

The following resources for replacing copyrighted map figures may be helpful:

USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/

The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/

Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html

NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/

Landsat: http://landsat.visibleearth.nasa.gov/

USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/#

Natural Earth (public domain): http://www.naturalearthdata.com/

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Kirpich et al present an agent-based model of COVID spreading. They fit their model to data on COVID infections in Massachusetts. And provide an online tool to test their model.

There are a few major issues with the presentation and the results of the manuscripts:

1. The authors do not consider asymptomatic COVID patients in the model, but they could also spread the virus. So the fits provided only to symptomatic patients could be mis-parameterized due to the lack of the presence of asymptomatic patients in the model.

2. It is also a bit strange how virus spreading is handled. There are initial epicenters of the infections, but agents are not directly moving, rather just changing their contacts. The pandemic here spreads between places, but unclear how the spatial structure is taken into account – out of plotting the results on a map.

3. Most of the details of the model are presented only in the supplement and even there some details are unclear. For instance, the authors discuss the effects of quarantines and social distancing, but it is not clear how the model is adjusted to take into account these effects. They mention 3 quarantine scenarios, but it seems these are just three separate times of quarantine initiation. Based on the text, only individuals with symptoms are quarantined, which is a far weaker restriction than what is generally applied by authorities.

4. In the responses to earlier referees it is stated that various answers and extensions were added to the text, but unclear how the text was eventually changed. No supporting file of tracked changes is provided. There is one tracked file for the supplement, but it seems only half a sentence was changed in that document.

Reviewer #2: I have finished my review of the assigned manuscript. In this study, the authors develop a complex agent-based model to elucidate transmission dynamics of COVID-19. Their model includes unique features and substantial heterogeneity, not found in other compartmental based models.

1) In the agent based model, the location of the agents are given by pixel coordinates. However, it is unclear how many agents can occupy a particular pixel. Is it one agent/pixel? What about the resolution of the epicenters and population densities? Are they at the pixel resolution also?

2) The parameters used in the study should be summarized in the table. It is unclear how the natural history of disease progresses for each agent. For example, in the appendix, the authors use a Lognormal distribution to sample the durations of stg_{1, 2} in equations 8 and 9, but no reference or justification is given for why these durations were picked. (The authors' reply to another reviewer suggest they indeed included a table, but it should be provided in the main manuscript.)

4) Instead of justifying the parameter values used in their study, the authors (correctly) state that they are input values and interested readers have the ability to modify these values in the provided software. There are a few concerns with this:

--- the code is compiled only for Windows, leaving Mac and Linux users unable to run the software (without jumping through hoops such as virtual machines). For these users, the authors should justify their parameters and provide some sensitivity analysis.

--- If the goal is to only provide a framework/software, it should be provided as a web-based tool. Moreover, the narrative of the manuscript needs to be revised to indicate that the work simply provides a tool. As currently written, the narrative is as if they are trying to describe transmission dynamics of COVID-19. For this, the authors definitely need to provide more justification for parameter values.

--- The authors should check in a README.md file in their github repository with explicit instructions on compiling and running the software. In addition, all the comments (which describe the flow) are not in English, which makes it difficult to verify/find any possible bugs in the system.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

Gergely Röst

11 Jan 2021

PONE-D-20-24277R1

Development of an interactive, agent-based local stochastic model of COVID-19 transmission and evaluation of mitigation strategies illustrated for the state of Massachusetts, USA

PLOS ONE

Dear Dr. Gankin,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

ACADEMIC EDITOR:

Dear Authors,

for the final version please take into consideration the following remarks of the reviewers.

"The authors properly answered my questions in their response letter. My major concern about asymptomatic patients is now mentioned in the main text, with a reference to more details in the supplement, but the supplement was only minimally changed and the word asymptomatic does not even appear in the supplement. Thus some further update on the supplement and maybe on the main text could help to make this complete.

The results and the discussion sections are relatively short. It might have been useful to add a section on the limitations of the model as it stands now.

The above points are quite properly explained now in the authors' response letter. Maybe some of the comments from here could be moved into the main text or the supplement."

and

"The authors have addressed my concerns, although the flow and narrative of the manuscript can be improved. For example, the authors addressed my comments regarding the lack of a table describing the parameters by including an external link in the manuscript to their code repository. This forces the reader to decipher and navigate the code repository website (github), thus creating an accessibility issue "

Once these minor changes are implemented, I will recommend the acceptance of the paper. I apologize for the longer than usual process, but now I think this can be done very quickly.

Best regards,

Gergely Röst

==============================

Please submit your revised manuscript by Feb 25 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Gergely Röst

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors properly answered my questions in their response letter. My major concern about asymptomatic patients is now mentioned in the main text, with a reference to more details in the supplement, but the supplement was only minimally changed and the word asymptomatic does not even appear in the supplement. Thus some further update on the supplement and maybe on the main text could help to make this complete.

The results and the discussion sections are relatively short. It might have been useful to add a section on the limitations of the model as it stands now.

The above points are quite properly explained now in the authors' response letter. Maybe some of the comments from here could be moved into the main text or the supplement.

Reviewer #2: Dear Authors,

I would like to apologize for the delay in my review. I have found that all my comments have been addressed fully. Thank you.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Feb 17;16(2):e0247182. doi: 10.1371/journal.pone.0247182.r005

Author response to Decision Letter 1


27 Jan 2021

Comment:

"The authors properly answered my questions in their response letter. My major concern about asymptomatic patients is now mentioned in the main text, with a reference to more details in the supplement, but the supplement was only minimally changed and the word asymptomatic does not even appear in the supplement. Thus some further update on the supplement and maybe on the main text could help to make this complete. The results and the discussion sections are relatively short. It might have been useful to add a section on the limitations of the model as it stands now. The above points are quite properly explained now in the authors' response letter. Maybe some of the comments from here could be moved into the main text or the supplement."

Answer:

We have updated both the manuscript and the supplement text with the discussion about the asymptomatic cases.

We have also updated the Discussion section of the manuscript where we discussed the model limitations outlined earlier.

The changes above are also emphasized in the tracked versions of the manuscript and of the supplement.

and

Comment:

"The authors have addressed my concerns, although the flow and narrative of the manuscript can be improved. For example, the authors addressed my comments regarding the lack of a table describing the parameters by including an external link in the manuscript to their code repository. This forces the reader to decipher and navigate the code repository website (github), thus creating an accessibility issue "

Answer:

Upon request, we have included an example of the parameters table in the supplement and referred the reader to the online repository for more detailed documentation about the tool.

The changes above are also emphasized in the tracked versions of the supplement.

Comment:

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

Answer:

No changes with the previous submission and re-submission.

Comment:

Reviewer #1: The authors properly answered my questions in their response letter. My major concern about asymptomatic patients is now mentioned in the main text, with a reference to more details in the supplement, but the supplement was only minimally changed and the word asymptomatic does not even appear in the supplement. Thus some further update on the supplement and maybe on the main text could help to make this complete.

The results and the discussion sections are relatively short. It might have been useful to add a section on the limitations of the model as it stands now.

The above points are quite properly explained now in the authors' response letter. Maybe some of the comments from here could be moved into the main text or the supplement.

Answer:

We have updated both the manuscript and the supplement text with the discussion about the asymptomatic cases.

We have also updated the Discussion section of the manuscript where we discussed the model limitations outlined earlier.

The changes above are also emphasized in the tracked versions of the manuscript and of the supplement.

Attachment

Submitted filename: Response_CLEANED.docx

Decision Letter 2

Gergely Röst

3 Feb 2021

Development of an interactive, agent-based local stochastic model of COVID-19 transmission and evaluation of mitigation strategies illustrated for the state of Massachusetts, USA

PONE-D-20-24277R2

Dear Dr. Gankin,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Gergely Röst

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Gergely Röst

5 Feb 2021

PONE-D-20-24277R2

Development of an interactive, agent-based local stochastic model of COVID-19 transmission and evaluation of mitigation strategies illustrated for the state of Massachusetts, USA

Dear Dr. Gankin:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Gergely Röst

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Model details.

    The details about the model formulation, parameterization, and calibration.

    (PDF)

    Attachment

    Submitted filename: Responses_to_reviewers_VK_AK_Cleaned_FINAL.pdf

    Attachment

    Submitted filename: Response_CLEAN.pdf

    Attachment

    Submitted filename: Response_CLEANED.docx

    Data Availability Statement

    The manuscript contains all the references. They are also duplicated below. The code is available here: https://github.com/quantori/COVID19-MA-Transmission The input data are available here: https://www.mass.gov/info-details/archive-of-covid-19-cases-in-massachusetts.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES