Skip to main content
PLOS Medicine logoLink to PLOS Medicine
. 2021 Apr 30;18(4):e1003585. doi: 10.1371/journal.pmed.1003585

Maximizing and evaluating the impact of test-trace-isolate programs: A modeling study

Kyra H Grantz 1,#, Elizabeth C Lee 1,#, Lucy D’Agostino McGowan 2, Kyu Han Lee 1, C Jessica E Metcalf 3,4, Emily S Gurley 1, Justin Lessler 1,*
PMCID: PMC8121292  PMID: 33930019

Abstract

Background

Test-trace-isolate programs are an essential part of coronavirus disease 2019 (COVID-19) control that offer a more targeted approach than many other nonpharmaceutical interventions. Effective use of such programs requires methods to estimate their current and anticipated impact.

Methods and findings

We present a mathematical modeling framework to evaluate the expected reductions in the reproductive number, R, from test-trace-isolate programs. This framework is implemented in a publicly available R package and an online application. We evaluated the effects of completeness in case detection and contact tracing and speed of isolation and quarantine using parameters consistent with COVID-19 transmission (R0: 2.5, generation time: 6.5 days). We show that R is most sensitive to changes in the proportion of cases detected in almost all scenarios, and other metrics have a reduced impact when case detection levels are low (<30%). Although test-trace-isolate programs can contribute substantially to reducing R, exceptional performance across all metrics is needed to bring R below one through test-trace-isolate alone, highlighting the need for comprehensive control strategies. Results from this model also indicate that metrics used to evaluate performance of test-trace-isolate, such as the proportion of identified infections among traced contacts, may be misleading. While estimates of the impact of test-trace-isolate are sensitive to assumptions about COVID-19 natural history and adherence to isolation and quarantine, our qualitative findings are robust across numerous sensitivity analyses.

Conclusions

Effective test-trace-isolate programs first need to be strong in the “test” component, as case detection underlies all other program activities. Even moderately effective test-trace-isolate programs are an important tool for controlling the COVID-19 pandemic and can alleviate the need for more restrictive social distancing measures.

Author summary

Why was this study done?

  • Control measures for the ongoing COVID-19 pandemic rely largely on untargeted interventions, like social distancing, which have high economic and social costs.

  • Test-trace-isolate programs, in which known cases are asked to isolate and their contacts are traced and then asked to quarantine, are an attractive option to control the spread of COVID-19 in a more targeted fashion.

  • Estimating the impact of test-trace-isolate programs is not straightforward, due to feedback loops between control measures and disease transmission.

What did the researchers do and find?

  • We developed a mathematical modeling framework to assess the potential impact of test-trace-isolate programs.

  • In most cases, increasing the percentage of cases successfully isolated will yield the largest relative reductions in disease transmission (as compared to improvements in successful contact quarantine or reductions in time to isolation or quarantine).

  • Programs already achieving a high percentage of case isolation will see more substantial gains from improving the speed of case isolation and improving the completeness and speed of contact tracing and quarantine.

What do these findings mean?

  • Test-trace-isolate programs must be supported by widespread and expeditious testing and case detection to suppress SARS-CoV-2 transmission.

  • Even imperfect test-trace-isolate programs can meaningfully complement other interventions as part of a comprehensive public health response with fewer social and economic costs.

  • The modeling framework is publicly available in an interactive web application, and additional teaching materials are available in a free online course.

Introduction

In the absence of a vaccine or a widely available prophylactic drug, nonpharmaceutical interventions are the only tools available to curb the spread of the ongoing coronavirus disease 2019 (COVID-19) pandemic. During the initial phases of the pandemic, broad-reaching interventions like stay-at-home orders and nonessential business closures were applied throughout the world, affecting large swathes of the population and causing severe social and economic disruption [16].

Because of the high costs of broadscale social distancing measures, there has been an increasing focus on alternative approaches with fewer ancillary costs. One such approach is a test-trace-isolate program, in which extensive “testing” is used to identify cases in the community; public health agencies then “trace” the contacts of these cases in order to identify people who may have been infected; and the initial cases are asked to “isolate” and their contacts are asked to quarantine for the period of time that they could be, or become, infectious [7]. If effective, test-trace-isolate programs can reduce the need for more restrictive, widespread control measures. Already they have played a critical role in controlling severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) transmission in places ranging from Utah to South Korea, where these programs have been credited with enabling successful control while avoiding the most restrictive social distancing measures (e.g., stay-at-home orders) [811].

Not all test-trace-isolate programs are created equal, and the success of test-trace-isolate programs is ultimately measured in their ability to reduce transmission. The proportion of infections identified through testing and contact tracing dictate the proportion of transmission chains we can potentially disrupt, while the speed of isolation and quarantine dictates how many potentially infectious contacts are prevented [12]. The resulting reductions in disease transmission can be quantified and compared by estimating the reproductive number, R, the average number of new infections caused by a single infected individual.

Translating test-trace-isolate program metrics into reductions in the reproductive number is not a direct calculation due to feedback loops between control measures and disease transmission dynamics. As a test-trace-isolate program interrupts chains of transmission, it changes the propagation of disease in future generations. Any approach aiming to translate quantitative program metrics into meaningful measures of the effectiveness of disease control must account for these dynamic processes.

Here, we propose a mathematical framework for modeling the impact of test-trace-isolate strategies on onward transmission, as measured by expected reductions in an average, population-level reproductive number. Using this approach, we explore the factors which most influence the success of a test-trace-isolate program, their interactions, and how these results may be used in developing strategies for improvement. To enable broad adoption of our approach, the methods presented here are implemented in an R package, tti [13], and the web-based Contact Tracing Evaluation and Strategic Support Application (ConTESSA) [14], both of which are freely available online.

Methods

Mathematical framework

To estimate the effectiveness of a test-trace-isolate program, we frame our analysis in terms of the effective reproductive number, R, defined as the number of onward transmissions an infected individual is expected to make given the current immune status of the population and implemented control measures. We first define the population of infected individuals to be spread across 3 compartments; infections Detected through testing and subsequently isolated (D), infections among Quarantined contacts of identified cases (Q), and undetected infections in the Community (C) (Fig 1). Though there will be uninfected individuals both in quarantine and in the community, these do not play a role in our calculations and are ignored.

Fig 1.

Fig 1

Conceptual representation of the model algorithm, where infections in generation t (left column) infect new individuals according to RD, RQ, and RC reproductive numbers that populate the INFECT matrix (center column). These newly propagated infections are then distributed into D, Q, and C compartments in generation t+1 (right column) according to the various detection transition probabilities specified in the DETECT matrix (colors of center column). Symptomatic individuals (darker shading) may be more likely to be detected than asymptomatic individuals (lighter shading).

We consider the proportion of the population in each compartment at any given time t to be defined by a 1×3 matrix, denoted DQCt. To calculate the proportion of infected individuals in each compartment at time t+1, we apply the rates at which individuals in each compartment cause new infections, and then the rates at which these secondary infections are detected and isolated through the following equation:

DQCt+1=(DQCt)(INFECT)(DETECT)[(DQCt)(INFECT)], (1)

where INFECT is a 3×3 diagonal matrix describing the number of infections caused in the next generation by members of each detection compartment, and DETECT is a 3×3 matrix describing the probability that infections in the next generation are detected and isolated, quarantined, or undetected in the community.

The diagonal elements of the INFECT matrix, [RD, RQ, RC], represent the reproductive number for members of each compartment. Hence, given the normalized version of the DQC matrix specified above, we can calculate the overall reproductive number at time t as:

Rt=(DQCt)(INFECT)

The DETECT matrix then assigns these new infections to the appropriate detection classes of the DQC matrix in the next generation. Specifically:

DETECT=[I(D)DI(D)QI(D)CI(Q)DI(Q)QI(Q)CI(C)D0I(C)C]=[(1ωD)ρωD(1ωD)(1ρ)(1ωQ)ρωQ(1ωQ)(1ρ)ρ0(1ρ)] (2)

where I(X) represents those infected by people in compartment X in the previous generation, ωX is the probability that a contact of a detected individual in compartment X is traced and quarantined (quarantine completeness), and ρ is the probability that a community infection is detected and effectively isolated by a test-trace-isolate program (isolation completeness). The transitions in each row of the DETECT matrix represent the probability that people in the corresponding notional infection compartment will be detected by a particular means (hence rows sum to one).

The other aspect that determines the effectiveness of a test-trace-isolate program is the reduction in R that we see among those who are isolated or quarantined (Fig 2). We define the relative transmissibility of individuals in these compartments by γD and γQ such that:

RD=γDRC (3)
RQ=γQRC (4)

Fig 2. Conceptual representation of test-trace-isolate programs, where detection of a case in generation t through widespread testing and subsequent isolation reduces onward transmission to generation t+1.

Fig 2

Individuals in generation t+1 are then traced and quarantined (and subsequently isolated, if the contact is a suspected or confirmed case) to reduce onward transmission from those who may be infected.

The main mechanism by which isolation and quarantine reduce transmission is the (at least partial) truncation of the infectious period. Hence, these values are defined by the equations:

γD=τDf(x)dx (5)
γQ=τQg(x)dx (6)

where f(x) is the distribution of relative infectiousness indexed from day of symptom onset; g(x) is the expected distribution of relative infectiousness of secondary cases indexed from their infector’s time of symptom onset; and τD and τQ represent the average time to case isolation and contact quarantine, respectively, from time of case symptom onset. We therefore assume isolation and quarantine are perfectly effective, such that individuals do not transmit once in quarantine or isolation, though exceptions to this assumption are discussed below.

Translating observed metrics to model inputs

Health departments collect data on their test-trace-isolate programs, but these observed metrics need to be translated into model inputs. To estimate isolation completeness (ρ), we can divide the average number of infections that were isolated by the estimated number of total infections in the community. The latter value may be difficult to obtain but can be approximated in a number of ways, including serosurveys and extrapolation from the number of deaths and approximate infection fatality ratio. Quarantine completeness (ω) can be estimated by dividing the number of quarantined individuals by the total number of contacts.

For the purposes of our model, time to isolation (τD) is the average number of days from case symptom onset to case isolation, while time to quarantine (τQ) is the average number of days from case symptom onset to contact quarantine. Often these timings are the composite of several constituent processes, including time from symptom onset to testing, time from testing to notification and isolation, and the time from obtaining a test result to tracing and quarantining contacts.

Adding real-world complexity to the model

Above we describe the basic model framework, but to take into account the complexities of the real world, we can expand the number of compartments in the DQC matrix and the corresponding INFECT and DETECT transitions. In the implementation used to generate the results described below, we create compartments to differentiate symptomatic and asymptomatic infections as well as household and community contacts to address the fact that these groups may differ in their probability and speed of detection, ability to be traced and quarantined, infectiousness, and risk of being infected.

Contact quarantine may not perfectly disrupt onward transmission in the real world; average quarantine duration may be modified in the expanded model to match local guidelines, and imperfect quarantine adherence may be incorporated by tuning the proportion of contacts assumed to be effectively quarantined. The assumption of perfectly effective case isolation may be modified by tuning the proportion of cases assumed to be effectively isolated.

This expanded model has 9 DQC compartments and is described in full in the Supplementary Methods (S1 Text).

Disease simulation

To obtain expected reductions in R, we first initiate the model with a DQC matrix that has only undetected community infections (C = 1). Then, we simulate the infection and detection processes across multiple disease generations until equilibrium is achieved in the DQC matrix (this usually occurs in less than 10 generations). This equilibrium provides an estimate of what would be achieved by a specified test-trace-isolate strategy if it maintained its current characteristics for the foreseeable future.

The model may also be run as a stochastic simulation, to explore the impact of overdispersion and stochasticity in the epidemic process in general. In stochastic simulations, we normalize the DQC matrix to a standard population size, then simulate the number of infections each individual causes for each notional INFECT compartment as a random draw from a negative binomial distribution based on the values in the INFECT matrix. These infections are then assigned to the compartments DQC matrix based on draws from a multinomial distribution parameterized by the rows of the DETECT matrix. Since there is no equilibrium state, stochastic simulations are run for a fixed number of generations.

The simulations presented in this paper assume that R0 = 2.5 without interventions, a generation time of 6.5 days (unless otherwise stated, Table C in S1 Text) [15], and initially, that whether individuals develop symptoms or not has no meaningful impact on transmission or detection probability in surveillance, and that household and community contacts are equally likely to be infected and quarantined. In later analyses, we relax these latter assumptions and add stochasticity to illustrate how our results are influenced by overdispersion in transmission, the presence of asymptomatic transmission, and differential risk of infection and tracing speed in household contacts.

All scenarios are based on hypothetical test-trace-isolate programs designed to represent a range of possible program effectiveness. Other parameter assumptions are available in Table C in S1 Text.

Model code and resources

The expanded model is implemented in the tti R package [13]. We also developed the ConTESSA, an R Shiny web application, around a simplified version of our modeling framework. The purpose of this application is to provide a user-friendly interface where managers of test-trace-isolate activities, equipped with their observed metrics, can examine how well their program reduces onward transmission and explore how their results might change with improvements to completeness and timing metrics as well as different underlying assumptions. The ConTESSA application is complemented by a free Coursera course that describes key contact tracing program metrics and provides more detailed instruction on how to use the application [16].

Results

Case isolation and contact quarantine completeness and timing

Application of our framework shows that the reproductive number can be reduced by improving performance across all dimensions of a test-trace-isolate program: detection and isolation completeness, the speed of case isolation, the proportion of contacts followed up and quarantined, and the speed at which quarantine occurs (Fig 3). However, the effect of improvements in one dimension are not independent of performance in the other dimensions, and as such, the aspect where improvements will yield the greatest dividends, the “next best move,” depends on the current status of the program.

Fig 3.

Fig 3

Improvements to case isolation and contact quarantine: Impact of case isolation timing (x-axis) and completeness (line colors) on the effective reproductive number (y-axis) for (A) a highly effective contact tracing program and (B) a less effective contact tracing program. (C) Heat map of the effective reproductive number across a range of case isolation timing (y-axis) and completeness (x-axis) scenarios, assuming that contact tracing is highly effective. Impact of contact tracing timing (x-axis) and completeness (line colors) on the effective reproductive number (y-axis) for (D) a widespread and rapid case isolation scenario and (E) a less effective and slower case isolation scenario. (F) Heat map of the effective reproductive number across a range of contact tracing timing (y-axis) and completeness (x-axis) scenarios, assuming that detection and isolation of index cases is widespread and rapid. For all panels, the open shapes mark example scenarios with highly effective contact tracing (70% quarantined on average 4 days after case symptom onset) in contrast to the filled shapes of a less effective contact tracing scenario (30% quarantined after 8 days). Circles mark example scenarios with widespread and rapid case isolation (50% isolated on average 4 days after case symptom onset) in contrast to squares, which have limited and slower case isolation (10% isolated after 7 days). Shapes display consistent scenarios across all panels in the figure.

Consider a situation where you only detect and isolate 10% of cases through your community testing program, and it takes an average of 7 days from symptom onset to do so (squares in Fig 3). Whether you have highly effective contact tracing (70% of contacts quarantined on average 4 days after case symptom onset, hollow shapes in Fig 3) or less effective contact tracing (30% quarantined on average 8 days after case symptom onset, solid shapes in Fig 3), little will be gained by improving the speed of case isolation, and the greatest reductions in transmission will be achieved by improving the proportion of infections detected and isolated (direction 1 in Fig 3A). Increasing the proportion of infections detected and isolated, regardless of other metrics, is critical because it is these detected cases that “seed” all other test-trace-isolate activities. If an infection is not detected, it cannot be isolated, and their contacts cannot be traced and quarantined.

Reducing the time to case isolation (direction 2 in Fig 3A) may be nearly as effective as improving case isolation completeness in certain contexts, in particular, if contact tracing is less effective and isolation completeness is reasonably high (over 30%). Because the vast majority of transmission occurs in the days immediately before and after symptom onset, improvements in the speed of case isolation that bring it to 4 days or fewer will yield the greatest reductions in transmission. Beyond this, there is limited opportunity to reduce onward transmission of the isolated case and thus little difference between delays of 6, 8, or 10 days. Increasing the speed of case isolation is particularly important when contact tracing is ineffective (Fig 3B), hence the program must rely predominantly on reductions in transmission from isolated cases themselves.

The benefits of increasing the speed and completeness of contact tracing and quarantine are greatest in the context of already highly effective testing and isolation (e.g., 50% of infections isolated on average 4 days after symptom onset, circles in Fig 3D). In such situations, increasing quarantine completeness yields the largest reductions in transmission (direction 3 in Fig 3D), particularly when the speed of contact quarantine is less than 8 days from case symptom onset.

Improvements in the speed of contact quarantine (direction 4 in Fig 3D) are most effective during the 4- to 8-day window after case symptom onset for similar reasons; this period corresponds to the greatest expected infectiousness of infected contacts. The impact of improvements in the speed or completeness of contact tracing is less if testing and isolation fail to reach a high percentage of infections (Fig 3E). As noted above, this is because without adequate detected cases to seed contact tracing activities, the ability of tracing and quarantine to have an impact is substantially reduced.

The completeness and timing of test-trace-isolate activities determine whether we can achieve goals in disease control using these approaches. A common goal is to bring R below one so that the epidemic will start to recede in the population. We explored the range of program characteristics that could achieve this goal, under the assumption that contacts were quarantined on the same day as case isolation, and quarantine completeness ranged from 50% to 100% (Fig 4).

Fig 4.

Fig 4

Isolation strategies (timing and completeness) capable of achieving R<1 when a given proportion of contacts (50% to 100%) are quarantined on the same day as case isolation. These strategies are shown for 4 possible baseline values of R, assuming other nonpharmaceutical interventions (NPIs) are in effect to reduce transmission from the uncontrolled scenario, R = 2.5.

At R = 2.5 (our baseline when no other interventions are in place) with perfect contact quarantine, at least 60% of cases must be isolated to achieve R<1; this minimum percentage decreases to 50% when starting at R = 2, 34% at R = 1.5, and 20% at R = 1.25 (corresponding to 20%, 40%, and 50% reductions in baseline R due to other interventions) (Fig 4). It is not possible to achieve R<1 if case isolation occurs more than 6.4 days after symptom onset, on average, and this threshold increases to 7, 9, and 10 days for R starting at 2, 1.5, and 1.25.

Quarantine need not be perfect to achieve R<1 (colors in Fig 4), but the tolerance for imperfect quarantine changes with isolation speed. For example, case isolation completeness needs to increase from 60% to 75% to offset a decrease in contact quarantine completeness from 100% to 50% when cases are isolated on the same day as symptom onset. However, this tolerance for incomplete quarantine rapidly degrades as the time to isolation increases, and, in the absence of other interventions (i.e., R = 2.5), no isolation program will achieve R<1 with 50% quarantine completeness if the average time to case isolation exceeds 2.6 days.

Infections arising in traced contacts

A metric often recommended for evaluating test-trace-isolate programs is the proportion of identified infections that were already under quarantine [7]. Programs are thought to be successful if this metric is high because it may indicate that a substantial fraction of transmission chains were interrupted through isolation of case contacts early in (or prior to) their infectious period. In practice, a program might approximate this by calculating the proportion of all newly detected infections among traced contacts, who may or may not be in quarantine when they are confirmed to be infected. This proportion is equivalent to QQ+D in our model.

An increasing proportion of new infections detected among traced contacts only represents an improvement in the program effectiveness if the timing of case isolation remains constant or becomes quicker. As delays in isolation increase, a greater number of secondary infections will occur among traced contacts. Hence, we can see both an increase in the proportion of newly detected infections among traced contacts and an increase in the effective reproductive number (direction “2” in Fig 5).

Fig 5. Relationship between R and the proportion of detected infections among traced contacts.

Fig 5

Each position along a line shows a single test-trace-isolate strategy, with a fixed delay from case symptom onset to isolation (shown in the numbers at the top) and 90% of contacts quarantined on the same day as case isolation. Points are colored by the proportion of infections detected and isolated through testing. When isolation timing remains constant, higher case isolation completeness corresponds with increases in the proportion of detected infections among traced contacts and reductions in R (Arrow 1). However, increases in the proportion of detected infections among traced contacts could indicate an increase in R, if the delay to case isolation is also increasing, thus leading to more secondary cases among traced contacts (Arrow 2).

Adding real-world complexity

In the sections above, we assume that all infected individuals are equally likely to transmit and be detected. Yet, there is evidence that asymptomatic individuals (those who never develop symptoms) are less infectious than those who do develop symptoms [17,18]. If the relative contribution of asymptomatic individuals to onward transmission is low, limited detection of asymptomatic cases will have little effect on the reproductive number (Fig A in S1 Text).

Similarly, previous scenarios assume that all contacts are equally at risk of being infected, but contact tracing studies suggest that the risk of SARS-CoV-2 infection for household contacts could be 6 (or more) times higher compared to other close contacts [11,17]. Quarantining household contacts therefore is expected to have a larger impact in reducing the reproductive number than quarantining nonhousehold contacts (Fig B in S1 Text).

There is growing evidence that the distribution of onward transmission for SARS-CoV-2 is overdispersed, meaning that most individuals contribute little to onward transmission, while superspreading events result in the bulk of secondary infections [19,20]. Overdispersion has little effect on the mean estimates of the reproductive number (Fig C in S1 Text). However, when there are few total infections in a community, the random occurrence or detection of any one superspreading event can drastically alter program impact, including ending an outbreak altogether, thereby increasing uncertainty in R.

Recent policy recommendations have suggested that 10-day quarantines rather than the previously recommended 14-day quarantines may be acceptable under certain circumstances [21]. When we modify our assumption of perfectly effective quarantine, we find that 10-day quarantines are somewhat less effective and that this effect is more pronounced in scenarios with rapid quarantine and widespread and rapid isolation (Fig D in S1 Text).

Sensitivity analyses

The above results are sensitive to assumptions about the infectious period and generation time of SARS-CoV-2. While the qualitative trends and relationships hold regardless, assumptions of a shorter generation time substantially increase the necessary speed at which activities must occur to have a meaningful impact (Fig E–I in S1 Text).

Discussion

Test-trace-isolate programs have the potential to play an important role in COVID-19 control, but the extent of that role depends on each program’s ability to limit transmission of the virus. Here, we have presented a modeling framework with which to evaluate the performance of the often independent test-and-isolate and contact tracing components of test-trace-isolate programs and shown how 4 key metrics of performance interact. The results show that a program’s ability to detect cases through community testing is one of the greatest drivers of program effectiveness, as it is these cases that seed all other activities. Rapid case isolation, complete contact tracing, and timely quarantine will compound the impact that identifying a new seed will have on the trajectory of the epidemic. Nevertheless, exceptional performance may be needed across all of these dimensions if transmission is to be controlled by test-trace-isolate alone, raising the importance of complementary control activities [22].

Previous work has emphasized the importance of decreasing delays to case isolation and contact quarantine to reduce disease transmission [23,24]. However, these models assumed high testing and isolation coverage (≥60%), levels perhaps attainable in the early or late stages of an outbreak, but far exceeding estimated infection detection rates in many locations with established epidemics [2528]. Here, we explore a broader range of case detection and isolation proportions, including values that may be more feasibly attained in areas with substantial incidence. In doing so, we show the critical importance of the proportion of cases detected.

Once adequate levels of detection are reached, the speed of case isolation and contact quarantine will begin to matter more. In practice, these delays are linked, as many of the same activities must be completed before isolation or quarantine can occur (e.g., sample collection, laboratory testing, contact of infected or exposed individuals). Hence, practical improvements in important aspects of a test-trace-isolate program, such as speed of laboratory testing, may have an outsized impact on the performance of the program overall.

These results have implications for the design and implementation of test-trace-isolate programs. The ability to identify and interrupt a high proportion of transmission chains will require investment in widespread testing. Population screening, in addition to symptom-based or at-will testing, could meaningfully improve a program’s impact on transmission. Inexpensive, easy to administer, and widely available tests could facilitate expanded detection efforts [29,30]. Even if such tests have lower sensitivity, the higher coverage attainable could result in detection of a higher percentage of infections [31]. Importantly, these improvements to testing capacity and access must be available to those populations most impacted by COVID-19 and not exacerbate existing testing disparities. If we increase testing coverage, but fail to reach those who are at highest risk for infection, there will be little impact on transmission.

Any increases in case detection will be ineffective if isolation and quarantine fail to interrupt transmission. To some extent, this can be counteracted by improvements to other aspects of a program (e.g., proportion of cases detected), but measures to facilitate effective isolation and quarantine may be needed to reach transmission control goals. Given the high risk of household transmission, measures that can intervene in these settings may be highly important. Facilities for isolation outside of the household were associated with substantial reductions in R in China [32]. Use of facial coverings has also been proven effective at reducing household transmission for SARS-CoV-2 and other respiratory viruses [3335]. Social and economic support for isolation and quarantine, particularly if outside the home, may be necessary for test-trace-isolate programs to be effective in many communities [7]. Technology, such as use of mobile phone data to identify contacts, may improve the speed and completeness of contact tracing, but compliance may be undermined if contact definitions are too broad, and substantial resources would still be required to initiate and support quarantine of identified contacts [36,37].

The case isolation and contact quarantine completeness metrics used in our model may be better conceptualized as the “proportion of onward transmission that would have been otherwise caused by those isolated or quarantined.” Thus, programs will see greater reductions in transmission from isolation or quarantine of those who are more likely to transmit. In the expanded version of our model, we already address differences between symptomatic and asymptomatic transmission and household versus community contacts. There may be programmatic reasons to specifically target other groups, and our basic framework could be extended to accommodate such strategies.

Our framework is not without limitations. This model describes a general strategy of tracing and quarantining the immediate contacts of identified cases in a community. It may not be easily extensible to settings such as schools or workplaces. Alternative strategies also exist, including tracing of contacts-of-contacts [38] and so-called backwards tracing [39]. The latter approach is part of a fundamentally different way of using contact tracing in disease control that has been used in COVID-19 response in some countries (e.g., Japan [40]), which focuses on identifying settings that have the potential to facilitate superspreading events or otherwise amplify transmission.

Our estimates of program effectiveness are sensitive to assumptions of disease natural history, though we have explored the impact of some of these assumptions (Fig E–I in S1 Text), and further exploration is possible. We assumed that the incubation period, generation time, and test-trace-isolate time delays were fixed at mean values, although previous work has shown that variability in these time delay distributions may affect the impact of disease control [12]. In addition, the model relies on a simplified version of transmission that does not account for many risk factors for SARS-CoV-2 infection or the contact structure in the population [38,41], which could lead to persistent transmission even when the population reproductive number is low (e.g., if there are clusters of connected cases that are not detected or cannot isolate completely). This may be particularly true if heterogeneities in transmission are associated with our ability to identify individuals through testing or contact tracing. Though nonadherence can be crudely considered by modifying the proportion isolated and proportion quarantined, our model framework does not capture the real-world imperfections where cases and contacts are unable to completely avoid contact with all other individuals. While the reproductive number is a useful representation of transmission control at the population level, it does not capture differential health burden of infections, and a program could have a higher R but better limit mortality if it effectively protects at-risk populations.

Test-trace-isolate programs should not alone be used to control COVID-19. It is exceedingly difficult to achieve a reproductive number less than one without additional reductions in transmission from other interventions, which may include masking or broadscale social distancing. Likewise, our model is based on proportions, but resource needs are determined by the absolute number of identified cases and traced contacts. When incidence is high, resources needed to test and trace the desired proportion of infections may be excessive, but if incidence is brought down through other control measures, the same targets may be logistically feasible. Still, test-trace-isolate programs need not themselves bring R below one to be valuable, and incremental reductions in transmission can alleviate the need for the most severe social distancing measures.

Hence, test-trace-isolate isolate programs have a valuable role to play in the COVID-19 response, even if such programs themselves are not the whole solution. Understanding the impact that a program is having, or that would result from investing in better program performance, is critical to the effective use of these programs within a broader control strategy. We hope that the model presented here, which is implemented in publicly available tools, will help facilitate the effective use of these programs in the COVID-19 response.

Supporting information

S1 Text. Supporting information.

Model details, input parameters, and sensitivity analyses.

(PDF)

Acknowledgments

We would like to thank the numerous public health workers and agencies that gave comments and guidance on the development of our model and the ConTESSA app, including Josh Sharfstein and Melissa Marx. We would also like to thank Isabel Rodríguez-Barraquer for her valuable comments on this manuscript. Finally, we recognize the valuable support from the Johns Hopkins Bloomberg School of Public Health Center for Teaching and Learning.

Abbreviations

ConTESSA

Contact Tracing Evaluation and Strategic Support Application

COVID-19

coronavirus disease 2019

SARS-CoV-2

severe acute respiratory syndrome coronavirus 2

Data Availability

All relevant data are within the manuscript and its Supplementary Information files.

Funding Statement

This work was supported by funding from State of California Institute of Technology (19-13081) (KHG, ECL, JL), Johns Hopkins Hospital (ECL, JL), and Bloomberg Philanthropies (KHG, ECL, LDM, KHL, ESG, JL). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Zheng Q, Jones FK, Leavitt SV, Ung L, Labrique AB, Peters DH, et al. HIT-COVID, a global database tracking public health interventions to COVID-19. Scientific Data. 2020;7(1):286. 10.1038/s41597-020-00610-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Desvars-Larrive A, Dervic E, Haug N, Niederkrotenthaler T, Chen J, Di Natale A, et al. A structured open dataset of government interventions in response to COVID-19. Scientific Data. 2020;7(1):285. 10.1038/s41597-020-00609-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Nicola M, Alsafi Z, Sohrabi C, Kerwan A, Al-Jabir A, Iosifidis C, et al. The socio-economic implications of the coronavirus pandemic (COVID-19): A review. Int J Surg. 2020;78:185–93. 10.1016/j.ijsu.2020.04.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.United Nations. Policy Brief: The Impact of COVID-19 on children; 2020. Available from: https://unsdg.un.org/resources/policy-brief-impact-covid-19-children. [Google Scholar]
  • 5.Wenham C, Smith J, Morgan R. COVID-19: the gendered impacts of the outbreak. Lancet. 2020;395(10227):846–8. 10.1016/S0140-6736(20)30526-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Hogan AB, Jewell BL, Sherrard-Smith E, Vesga JF, Watson OJ, Whittaker C, et al. Potential impact of the COVID-19 pandemic on HIV, tuberculosis, and malaria in low-income and middle-income countries: a modelling study. Lancet Glob Health. 2020;8(9):e1132–41. 10.1016/S2214-109X(20)30288-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Burka D, Steele L, Siegler A. Covid-19 Contact Tracing Playbook; 2020. Available from: https://contacttracingplaybook.resolvetosavelives.org/. [Google Scholar]
  • 8.Abbott S, Hellewell J, Thompson RN, Sherratt K, Gibbs HP, Bosse NI, et al. Estimating the time-varying reproduction number of SARS-CoV-2 using national and subnational case counts. Wellcome Open Research. 2020;5:112. 10.12688/wellcomeopenres.16006.1 [DOI] [Google Scholar]
  • 9.Abbott S, Hellewell J, Thompson RN, Sherratt K, Gibbs HP, Bosse NI, et al. Covid-19: National and Subnational estimates for the United States of America; 2020. Available from: https://epiforecasts.io/covid/posts/national/united-states/. [Google Scholar]
  • 10.Abbott S, Hellewell J, Thompson RN, Sherratt K, Gibbs HP, Bosse NI, et al. Covid-19: Estimates for South Korea; 2020. Available from: https://epiforecasts.io/covid/posts/national/south-korea/. [Google Scholar]
  • 11.Park YJ, Choe YJ, Park O, Park SY, Kim YM, Kim J, et al. Contact Tracing during Coronavirus Disease Outbreak, South Korea, 2020. Emerg Infect Dis. 2020;26(10). 10.3201/eid2610.201315 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Fraser C, Riley S, Anderson RM, Ferguson NM. Factors that make an infectious disease outbreak controllable. Proc Natl Acad Sci. 2004;101(16):6146–51. 10.1073/pnas.0307506101 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.TTI; 2020. Available from: 10.5281/ZENODO.4012424. [DOI]
  • 14.ConTESSA: Contact Tracing Evaluation and Strategic Support Application; 2020. Available from: https://iddynamicsjhu.shinyapps.io/contessa/.
  • 15.Bi Q, Wu Y, Mei S, Ye C, Zou X, Zhang Z, et al. Epidemiology and transmission of COVID-19 in 391 cases and 1286 of their close contacts in Shenzhen, China: a retrospective cohort study. Lancet Infect Dis. 2020;20(8):911–9. 10.1016/S1473-3099(20)30287-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Measuring and Maximizing Impact of COVID-19 Contact Tracing—Coursera; 2020. Available from: https://www.coursera.org/learn/measuring-and-maximizing-impact-of-covid-19-contact-tracing/.
  • 17.Madewell ZJ, Yang Y, Longini IM, Halloran ME, Dean NE. Household transmission of SARS-CoV-2: a systematic review and meta-analysis of secondary attack rate. JAMA Netw Open. 2020;3(12):e2031756. 10.1001/jamanetworkopen.2020.31756 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Buitrago-Garcia DC, Egli-Gany D, Counotte MJ, Hossmann S, Imeri H, Salanti G, et al. Occurrence and transmission potential of asymptomatic and presymptomatic SARS-CoV-2 infections: A living systematic review and meta-analysis. PLoS Med. 2020;17(9):e1003346. 10.1371/journal.pmed.1003346 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Endo A, Abbott S, Kucharski AJ, Funk S, Eggo RM, Quilty BJ, et al. Estimating the overdispersion in COVID-19 transmission using outbreak sizes outside China. Wellcome Open Research. 2020;5:67. 10.12688/wellcomeopenres.15842.3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Lloyd-Smith JO, Schreiber SJ, Kopp PE, Getz WM. Superspreading and the effect of individual variation on disease emergence. Nature. 2005;438(7066):355–9. 10.1038/nature04153 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.US Centers for Disease Control and Prevention. Options to reduce quarantine for contacts of persons with SARS-CoV-2 infection using symptom monitoring and diagnostic testing; 2020. Available from: https://www.cdc.gov/coronavirus/2019-ncov/more/scientific-brief-options-to-reduce-quarantine.html. [PubMed] [Google Scholar]
  • 22.Grassly NC, Pons-Salort M, Parker EPK, White PJ, Ferguson NM, Ainslie K, et al. Comparison of molecular testing strategies for COVID-19 control: a mathematical modelling study. Lancet Infect Dis. 2020;20(12):1381–9. 10.1016/S1473-3099(20)30630-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Hellewell J, Abbott S, Gimma A, Bosse NI, Jarvis CI, Russell TW, et al. Feasibility of controlling COVID-19 outbreaks by isolation of cases and contacts. Lancet Glob Health. 2020;8(4):e488–96. 10.1016/S2214-109X(20)30074-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Kretzschmar ME, Rozhnova G, Bootsma MCJ, van Boven M, van de Wijgert JHHM, Bonten MJM. Impact of delays on effectiveness of contact tracing strategies for COVID-19: a modelling study. Lancet Public Health. 2020;5(8):e452–9. 10.1016/S2468-2667(20)30157-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Pollán M, Pérez-Gómez B, Pastor-Barriuso R, Oteo J, Hernán MA, Pérez-Olmeda M, et al. Prevalence of SARS-CoV-2 in Spain (ENE-COVID): a nationwide, population-based seroepidemiological study. The Lancet. 2020;396(10250):535–544. 10.1016/S0140-6736(20)31483-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Xu X, Sun J, Nie S, Li H, Kong Y, Liang M, et al. Seroprevalence of immunoglobulin M and G antibodies against SARS-CoV-2 in China. Nat Med. 2020;26(8):1193–5. 10.1038/s41591-020-0949-6 [DOI] [PubMed] [Google Scholar]
  • 27.Stringhini S, Wisniak A, Piumatti G, Azman AS, Lauer SA, Baysson H, et al. Seroprevalence of anti-SARS-CoV-2 IgG antibodies in Geneva, Switzerland (SEROCoV-POP): a population-based study. The Lancet. 2020;396(10247):313–319. 10.1016/S0140-6736(20)31304-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Sood N, Simon P, Ebner P, Eichner D, Reynolds J, Bendavid E, et al. Seroprevalence of SARS-CoV-2-Specific Antibodies Among Adults in Los Angeles County, California, on April 10–11, 2020. JAMA. 2020;323(23):2425. 10.1001/jama.2020.8279 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Kaplan EH, Forman HP. Logistics of Aggressive Community Screening for Coronavirus 2019. JAMA Health Forum. 2020;1(5):e200565. 10.1001/jamahealthforum.2020.0565 [DOI] [PubMed] [Google Scholar]
  • 30.Shaw J. New Test Paradigm Needed for SARS-CoV-2. Harvard Magazine. 2020. [Google Scholar]
  • 31.Larremore DB, Wilder B, Lester E, Shehata S, Burke JM, Hay JA, et al. Test sensitivity is secondary to frequency and turnaround time for COVID-19 surveillance. Sci Adv. 2021;7(1):eabd5393. 10.1126/sciadv.abd5393 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Hao X, Cheng S, Wu D, Wu T, Lin X, Wang C. Reconstruction of the full transmission dynamics of COVID-19 in Wuhan. Nature. 2020;584(7821):420–4. 10.1038/s41586-020-2554-8 [DOI] [PubMed] [Google Scholar]
  • 33.Cowling BJ, Chan KH, Fang VJ, Cheng CKY, Fung ROP, Wai W, et al. Facemasks and hand hygiene to prevent influenza transmission in households: A cluster randomized trial. Ann Intern Med. 2009;151(7):437–446. 10.7326/0003-4819-151-7-200910060-00142 [DOI] [PubMed] [Google Scholar]
  • 34.Leung NHL, Chu DKW, Shiu EYC, Chan KH, McDevitt JJ, Hau BJP, et al. Respiratory virus shedding in exhaled breath and efficacy of face masks. Nat Med. 2020;26(5):676–80. 10.1038/s41591-020-0843-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Wang Y, Tian H, Zhang L, Zhang M, Guo D, Wu W, et al. Reduction of secondary transmission of SARS-CoV-2 in households by face mask use, disinfection and social distancing: a cohort study in Beijing, China. BMJ Glob Health. 2020;5(5):2794. 10.1136/bmjgh-2020-002794 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.European Centre for Disease Prevention and Control (ECDC). Mobile applications in support of contact tracing for COVID-19—a guidance for EU/EEA member states. 2020;(June):1–11. [Google Scholar]
  • 37.Kucharski AJ, Klepac P, Conlan AJK, Kissler SM, Tang ML, Fry H, et al. Effectiveness of isolation, testing, contact tracing, and physical distancing on reducing transmission of SARS-CoV-2 in different settings: a mathematical modelling study. Lancet Infect Dis. 2020;(0). 10.1016/s1473-3099(20)30457-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Firth JA, Hellewell J, Klepac P, Kissler S, Jit M, Atkins KE, et al. Using a real-world network to model localized COVID-19 control strategies. Nat Med. 2020:1–7. 10.1038/s41591-020-1036-8 [DOI] [PubMed] [Google Scholar]
  • 39.Endo A, Leclerc QJ, Knight GM, Medley GF, Atkins KE, Funk S, et al. Implication of backward contact tracing in the presence of overdispersed transmission in COVID-19 outbreak. Wellcome Open Research. 2021;5:239. 10.12688/wellcomeopenres.16344.3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Oshitani H. Cluster-based approach to Coronavirus Disease 2019 (COVID-19) response in Japan–February-April 2020. Jpn J Infect Dis. 2020; 10.7883/yoken.JJID.2020.363 [DOI] [PubMed] [Google Scholar]
  • 41.Wu C, Chen X, Cai Y, Xia J, Zhou X, Xu S, et al. Risk Factors Associated with Acute Respiratory Distress Syndrome and Death in Patients with Coronavirus Disease 2019 Pneumonia in Wuhan. China JAMA Internal Medicine. 2020;180(7):934–43. 10.1001/jamainternmed.2020.0994 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Helen Howard

3 Sep 2020

Dear Dr Lessler,

Thank you for submitting your manuscript entitled "Maximizing and evaluating the impact of test-trace-isolate programs" for consideration by PLOS Medicine.

Your manuscript has now been evaluated by the PLOS Medicine editorial staff and I am writing to let you know that we would like to send your submission out for external peer review.

However, before we can send your manuscript to reviewers, we need you to complete your submission by providing the metadata that is required for full assessment. To this end, please login to Editorial Manager where you will find the paper in the 'Submissions Needing Revisions' folder on your homepage. Please click 'Revise Submission' from the Action Links and complete all additional questions in the submission questionnaire.

Please re-submit your manuscript within two working days, i.e. by .

Login to Editorial Manager here: https://www.editorialmanager.com/pmedicine

Once your full submission is complete, your paper will undergo a series of checks in preparation for peer review. Once your manuscript has passed all checks it will be sent out for review.

Feel free to email us at plosmedicine@plos.org if you have any queries relating to your submission.

Kind regards,

Helen Howard, for Clare Stone PhD

Acting Editor-in-Chief

PLOS Medicine

plosmedicine.org

Decision Letter 1

Emma Veitch

11 Dec 2020

Dear Dr. Lessler,

Thank you very much for submitting your manuscript "Maximizing and evaluating the impact of test-trace-isolate programs" (PMEDICINE-D-20-04296R1) for consideration at PLOS Medicine.

Your paper was evaluated by a senior editor and discussed among all the editors here. It was also discussed with an academic editor with relevant expertise, and sent to three independent reviewers. The reviews are appended at the bottom of this email and any accompanying reviewer attachments can be seen via the link below:

[LINK]

In light of these reviews, I am afraid that we will not be able to accept the manuscript for publication in the journal in its current form, but we would like to consider a revised version that addresses the reviewers' and editors' comments. Obviously we cannot make any decision about publication until we have seen the revised manuscript and your response, and we plan to seek re-review by one or more of the reviewers.

In revising the manuscript for further consideration, your revisions should address the specific points made by each reviewer and the editors. Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments, the changes you have made in the manuscript, and include either an excerpt of the revised text or the location (eg: page and line number) where each change can be found. Please submit a clean version of the paper as the main article file; a version with changes marked should be uploaded as a marked up manuscript.

In addition, we request that you upload any figures associated with your paper as individual TIF or EPS files with 300dpi resolution at resubmission; please read our figure guidelines for more information on our requirements: http://journals.plos.org/plosmedicine/s/figures. While revising your submission, please upload your figure files to the PACE digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at PLOSMedicine@plos.org.

We expect to receive your revised manuscript by Jan 01 2021 11:59PM. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

We ask every co-author listed on the manuscript to fill in a contributing author statement, making sure to declare all competing interests. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. If new competing interests are declared later in the revision process, this may also hold up the submission. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT. You can see our competing interests policy here: http://journals.plos.org/plosmedicine/s/competing-interests.

Please use the following link to submit the revised manuscript:

https://www.editorialmanager.com/pmedicine/

Your article can be found in the "Submissions Needing Revision" folder.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see http://journals.plos.org/plosmedicine/s/submission-guidelines#loc-methods.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

We look forward to receiving your revised manuscript.

Sincerely,

Emma Veitch, PhD

PLOS Medicine

On behalf of Richard Turner, PhD, Senior Editor,

PLOS Medicine

plosmedicine.org

-----------------------------------------------------------

Requests from the editors:

*In line with the usual journal style and to support information retrieval in search indexes etc, we'd suggest including some designation of the study design/methodological approach in the article title (normally this is in a subtitle after a colon, and here we'd imagine something along the lines of "....: modelling study" might be appropriate).

*PLOS Medicine style for the abstract normally involves including a summary/note about any key limitations of the study methods in the abstract (normally in the last sentence of the Abstract Methods and Findings section). We noted that the reviewers raise queries about the extent to which compliance or adherence with isolation measures are factored into the model - so perhaps this could be mentioned. (see also below for the main discussion section).

*Because the paper addresses a topic of extreme current importance to public health, and the findings could directly influence policy, we'd imagine it may be (if accepted and published) widely read. Therefore it would be good to make sure the abstract, particularly, is framed in a way that can be more clearly understood by nonspecialists and perhaps even lay readers. Some sentences currently are a bit cryptic for non-specialists - eg the following, and we'd suggest reframing this (and some others) so the meaning is more clear: "**Formally framing the dynamical process** also indicates that metrics used to evaluate performance of test-trace-isolate, such as the proportion of identified infections among traced contacts, may be misleading". (The part in asterisks is the bit that many readers may stumble over).

*At this stage, we ask that you include a short, non-technical Author Summary of your research to make findings accessible to a wide audience that includes both scientists and non-scientists. The Author Summary should immediately follow the Abstract in your revised manuscript. This text is subject to editorial change and should be distinct from the scientific abstract. Please see our author guidelines for more information: https://journals.plos.org/plosmedicine/s/revising-your-manuscript#loc-author-summary

*Please clarify in the paper if the analytical approach followed here was set out prospectively - please state this (either way) early in the Methods section.

a) If a prospective analysis plan (from your funding proposal, IRB or other ethics committee submission, study protocol, or other planning document written before analyzing the data) was used in designing the study, please include the relevant prospectively written document with your revised manuscript as a Supporting Information file to be published alongside your study, and cite it in the Methods section. A legend for this file should be included at the end of your manuscript.

b) If no such document exists, please make sure that the Methods section transparently describes when analyses were planned, and when/why any data-driven changes to analyses took place.

c) In either case, changes in the analytical approach -- including those made in response to peer review comments-- should be identified as such in the Methods section of the paper, with rationale.

*As noted above for the abstract - it's not clear that one of the main limitations raised by reviewers - that of adherence to isolation measures - is taken into account in the models. If not, and/or if only done so to a limited extent, we'd suggest including this in the Limitations section as the reviewers note.

-----------------------------------------------------------

Comments from the reviewers:

Reviewer #1: The authors present a mathematical modeling framework aiming to evaluate the expected reductions in the reproductive number, R, from test-trace-isolate programs.

Comments:

This is a well written, important and timely article.

The mathematical model is presented clearly and concisely. The framework appears to be appropriate for the requirements of this modelling exercise.

Did the authors consider 'adherence or compliance to isolation or quarantine requests' as a parameter of interest?

The model treats all cases as equal, and does not include any element of behavioural effect or community exposure. For instance, a case where someone is working from home without the need to travel and with no dependents nor contacts in the community is different to a case where someone uses public transport on a daily basis to a communal workplace, with children at school, and an active social life.

This is acknowledged to some extent, but could be expanded upon, within the limitations, which state:

"This model describes a general strategy of tracing and quarantining the immediate contacts of identified cases in a community. It may not be easily extensible to settings such as schools or workplaces. ... The model relies on a simplified version of transmission that does not account for many risk factors for SARS-CoV-2 infection or the contact structure in the population, which could lead to persistent transmission even when the population reproductive number is low."

Furthermore, the authors acknowledge that "while the reproductive number is a useful representation of transmission control at the population level, it does not capture differential health burden of infections, and a program could have a higher R but better limit mortality if it effectively protects at-risk populations."

These caveats for accurate interpretation and application of the model should also be stated more clearly throughout the manuscript.

Overall, this study provides valuable insight to the elements of test-trace-isolate that have greatest impact on the transmission of SARS-CoV-2 infection, and how these elements relate with each other based on the models' assumptions of the disease natural history. Instrumentally, the model has been made publicly available, ready for further research and development, as well as the exploration of various what-if scenarios.

-----------------------------------------------------------

Reviewer #2: This is a nice piece of work describing a mathematical model of the potential impact of test, trace and isolate (TTI) on the reproduction number (R) of SARS-CoV-2. The work explores the impact of different levels of case detection, quarantine effectiveness and timeliness. It presents interesting findings on the proportion of contacts that are already quarantined, which is often used as a metric of TTI performance and yet depends strongly on the nature of the epidemic (e.g. R) and may in fact be inversely related to some measures of performance such as timeliness. The work is also supported by the provision of an online tool and comprehensive coursera course, which really increase the utility of this work. I would therefore recommend publication.

I have just a few comments. Firstly, it would be helpful to present the separate impact of case isolation (D compartment) and quarantine of contacts (Q). Typically the latter will be smaller than the former, which could be achieved without TTI if symptomatic individuals self-isolated. This would help understand the added value of TTI over just isolation based on symptoms. Secondly, it is likely that willingness to be tested and self-isolate is related to the probability of being identified as a contact and being willing to quarantine (i.e. rho and omega in the detection matric are likely to correlated at the individual level). This will limit the impact of TTI and should be mentioned as a caveat. Finally, there is related, published work that uses a similar framework and comes to similar conclusions that ought to be mentioned (doi:10.1016/S1473-3099(20)30630-7).

-----------------------------------------------------------

Reviewer #3: Review of 'Maximizing and evaluating the impact of test-trace-isolate programs'.

In this manuscript, the authors develop a mathematical framework for analysing a test trace isolate (TTI) programme for COVID, aimed at helping public health authorities work out the weak spot of their programmes and improve them. There are two broad conclusions 1/ to be really effective, TTI can't have too many weak spots at all, and 2/ if the testing component is weak, fix that before looking at anything else.

The mathematical framework is based on a next generation matrix formalism, and the outcome of interest is the effective reproduction number R. The paper is accompanied by an R package, an online page, and a Coursera online course; really useful work.

I think this is a very useful paper, very well put together.

Here are some comments, hope they help improve an already excellent paper.

You assume, but don't say in words, that self isolation and quarantine perfectly stop further transmission (can see in equations 5 and 6). That needs to be stated. I also wasn't too sure how to think about imperfectly effective isolation and quarantine in your framework. Please discuss (including in the Contessa website).

The swap from calendar time to generation time is a neat trick in epidemiology (see e.g. Pellis Math Bioscience 2008), and used very effectively here. I was nonetheless left a bit puzzled by the incorporation of delays, and given the conclusions, I would have liked to understand this better. In short, I didn't see any detailed treatment of the delays beyond equations (5) and (6), which are only half defined, since f(x) and g(x) are not defined. I would have liked to see quite a bit more detail here to be satisfied that these results are reproducible. I would also have liked to see what effects the fact that tau_D and tau_Q are themselves distributed, and to have seen more information about the functions f(x) and g(x). We have found in our simulations that the variances of incubation, generation time, and delay times, all have quite a big effect. This was pointed out in Fraser et al PNAS 2004 cited here, and seems to be relevant for COVID.

There is a sensitivity analysis to different choices of generation time etc, but I would still nonetheless say that the baseline choice is a bit odd for COVID-19, consisting of a long generation time estimate (6.5 days, unreferenced?) compared to many publications (see e.g. Ganyani et al Eurosurveillance and many others), and effectively no asymptomatic infection. I wonder if the authors could rejig which are their baseline assumptions and which are sensitivity analyses.

Initially I was puzzled by the results which include focus on areas of parameter space where testing is poor, isolation is imperfect, and yet tracing and quarantine is highly effective. Yet, I can imagine this happening in practice due to these engaging very different expertise, and different public health departments. So in some ways it shouldn't need to be said that you then need to test more and faster, but it's good to set it out, and the findings here are clear.

Sup Table S3 does not say what value was used for the proportions of asymptomatic and symptomatic infections that are detected by surveillance, and I don't understand why. These two parameters are presumably different from each other and relevant for the results.

The bottom half of Fig 2 should say quarantine instead of isolation. In Figs S1 and S2 the labels for the colours in the legend does not match the labels for the colours in the plot.

I haven't tried the R package. I think someone should before publication. It sounds like the Coursera materials have already been road tested, which is great. I tried the shiny app, very slick, though I wonder if some of the parameters are a bit obscure; e.g. the difference between being tested and being isolated. In our jurisdiction, people should isolate immediately after the test, a problem we face is that many don't.

Signed - Christophe Fraser

-----------------------------------------------------------

Any attachments provided with reviews can be seen via the following link:

[LINK]

Decision Letter 2

Raffaella Bosurgi

12 Mar 2021

Dear Dr Lessler, 

On behalf of my colleagues and the Academic Editor, Mirjam E. E. Kretzschmar I am pleased to inform you that we have agreed to publish your manuscript "Maximizing and evaluating the impact of test-trace-isolate programs: a modeling study" (PMEDICINE-D-20-04296R2) in PLOS Medicine.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. Please be aware that it may take several days for you to receive this email; during this time no action is required by you. Once you have received these formatting requests, please note that your manuscript will not be scheduled for publication until you have made the required changes.

In the meantime, please log into Editorial Manager at http://www.editorialmanager.com/pmedicine/, click the "Update My Information" link at the top of the page, and update your user information to ensure an efficient production process. 

PRESS

We frequently collaborate with press offices. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximise its impact. If the press office is planning to promote your findings, we would be grateful if they could coordinate with medicinepress@plos.org. If you have not yet opted out of the early version process, we ask that you notify us immediately of any press plans so that we may do so on your behalf.

We also ask that you take this opportunity to read our Embargo Policy regarding the discussion, promotion and media coverage of work that is yet to be published by PLOS. As your manuscript is not yet published, it is bound by the conditions of our Embargo Policy. Please be aware that this policy is in place both to ensure that any press coverage of your article is fully substantiated and to provide a direct link between such coverage and the published work. For full details of our Embargo Policy, please visit http://www.plos.org/about/media-inquiries/embargo-policy/.

Open Science

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Thank you again for submitting to PLOS Medicine. We look forward to publishing your paper. 

Sincerely, 

Dr Raffaella Bosurgi 

Executive Editor

PLOS Medicine

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Text. Supporting information.

    Model details, input parameters, and sensitivity analyses.

    (PDF)

    Attachment

    Submitted filename: PMEDICINE-D-20-04296R1_response.pdf

    Data Availability Statement

    All relevant data are within the manuscript and its Supplementary Information files.


    Articles from PLoS Medicine are provided here courtesy of PLOS

    RESOURCES