Skip to main content
AJPM Focus logoLink to AJPM Focus
. 2022 May 20;1(1):100006. doi: 10.1016/j.focus.2022.100006

The Impact of Testing Capacity and Compliance With Isolation on COVID-19: A Mathematical Modeling Study

Zhuoting Yu 1, Pinar Keskinocak 1,, Lauren N Steimle 1, Inci Yildirim 2,3,4
PMCID: PMC9119710  PMID: 36942015

HIGHLIGHTS

  • Starting testing programs early is effective in reducing the infection spread.

  • Starting testing programs early also leads to less self-isolation in total.

  • Higher symptomatic isolation compliance is favored if early testing is unavailable.

  • Delay in the start of testing results in extra testing capacity to make up.

Keywords: Infectious disease, diagnostic testing, compliance with self-isolation, simulation, mathematical modeling

Abstract

Introduction

Diagnostic tests can play an important role in reducing the transmission of infectious respiratory diseases, particularly during a pandemic. The potential benefit of diagnostic testing depends on at least 4 factors: (1) how soon testing becomes available after the beginning of the pandemic and (2) at what capacity; (3) compliance with isolation after testing positive; and (4) compliance with isolation when experiencing symptoms, even in the absence of testing.

Methods

To understand the interplay between these factors and provide further insight into policy decisions for future pandemics, we developed a compartmental model and simulated numerous scenarios using the dynamics of COVID-19 as a case study.

Results

Our results quantified the significant benefits of early start of testing and high compliance with isolation. Early start of testing, even with low testing capacity over time, could significantly slow down the disease spread if compliance with isolation is high. By contrast, when the start of testing was delayed, the benefit of testing on reducing infection spread was limited, even when testing capacity was high; the additional testing capacity required increased superlinearly for each day of delay to achieve a similar infection attack rate as in starting testing earlier.

Conclusions

Our study highlighted the importance of the early start of testing and public health messaging to promote isolation compliance when needed for an ongoing effective response to COVID-19 and future pandemics.

Graphical Abstract

graphic file with name ga1.gif

INTRODUCTION

The impact of pandemics on health and society has been significant throughout history and continues to grow.1 For example, coronavirus disease 2019 (COVID-19) has caused >5.57 million deaths worldwide (as of January 20, 2022).2 To control the spread of infectious diseases, governments and public health agencies rely on nonpharmaceutical interventions, such as physical distancing, and pharmaceutical interventions, such as vaccines or therapeutics. Widespread and frequent diagnostic testing can help to contain infection spread when the individuals who test positive comply with isolation,3, 4, 5 which significantly reduces disease transmission.6,7 However, it takes time to start implementing testing programs owing to the challenges associated with the development and distribution of testing kits, the collection of patient samples, and the limited laboratory capacity available for testing.8 For example, although the Centers for Disease Control and Prevention confirmed the first COVID-19 case in the U.S. on January 20, 2020,9 the total number of specimens tested daily for COVID-19 in the U.S. remained below 1,000 until March 4, 2020,10 whereas the number of confirmed cases reached 1,234 on March 15, 2020.11 Moreover, it is estimated that only 1 in 4 COVID-19 infections were reported.12 The impact of testing also depends on the individuals’ compliance with isolation protocols after receiving a positive test result or when experiencing symptoms (even in the absence of testing). In practice, there is high variability in self-isolation compliance across different settings. According to surveys, estimates of compliance with isolation across different communities worldwide ranged from 18% to 95%13, 14, 15, 16 and from 40% to 95% in the U.S.17,18 An individual's compliance with isolation depends on many factors, for example, the availability of financial support during isolation and/or the presence of symptoms.19,20

The effectiveness of diagnostic testing during an infectious disease outbreak depends on at least the following 4 factors: (1) how soon testing becomes available since the beginning of the pandemic and (2) at what capacity, (3) compliance with isolation after testing positive, and (4) compliance with isolation when experiencing symptoms. To understand the impact of these factors and their interactions on health outcomes, we developed a compartmental model21 to simulate the transmission dynamics under various levels of diagnostic testing capacity and compliance with 2 types of isolation: (1) post-testing isolation, where an individual self-isolates after receiving a positive test result, and (2) symptomatic isolation, where an individual self-isolates when experiencing symptoms in the absence of a diagnostic test. The compliance rate refers to the fraction of individuals who comply with post-testing or symptomatic isolation, respectively. Across different scenarios, we estimated and compared the infection attack rate (IAR) and isolation percentage (IP), that is, the percentage of the population who self-isolated at some point during the pandemic. Furthermore, we quantified the impact of the start day of testing (relative to Day 1, when the first case occurred) on the spread of the disease and identified the amount of additional testing capacity required to maintain an IAR similar to that of an equivalent scenario with an earlier start day of testing.

Compartmental models,21 including basic and extended Susceptible–Infected–Recovered (SIR) models, have been widely used in modeling the progression and spread of infectious diseases,22,23 the impact of behaviors,24 and interventions such as lockdowns or vaccines.25, 26, 27, 28 Complementing and extending previous work (e.g., Agusto et al.29 and Anand and colleagues30), the compartmental model proposed in this work explores the impact of the complex interactions between the testing start day, the dynamically changing daily diagnostic testing capacity, and the population behaviors (i.e., compliance with self-isolation) on health outcomes to help inform decisions regarding effective deployment of interventions.

METHODS

Model Description

The compartmental model21 (an extended SIR model) developed in this study consists of 12 states, which fall under 4 main groups: (1) S: susceptible; (2) I: infected (including IPs, presymptomatic; Is, symptomatic; Ia, asymptomatic), (3) R: recovered (RT, recovered and diagnosed with a test; RU, recovered but have not been diagnosed owing to the absence of testing), and (4) D: dead. Figure 1 shows the definitions of the states and transitions between the states. In addition to IPs,Is, and Ia,individuals who are infected were further divided into 5 groups (IsTQ,IaTQ,IsTX,IaTX,andIsUQ), considering (1) whether they are symptomatic (s) or asymptomatic (a), (2) whether they have been diagnosed with testing (T) or have not been tested (i.e., unconfirmed) (U), and (3) whether they are isolated/quarantined (Q) or not (X) after being diagnosed by a positive test. For example, IaTX refers to the group of infected individuals who are asymptomatic (a), diagnosed with a positive test (T), but not under isolation (X). Equations 1–12 in Methods of the Supplemental Materials describe the dynamics of the model in detail, taking account of both testing availability and self-isolation compliance.

Figure 1.

Figure 1

Simplified diagram of the extended SIR model incorporating compliance with post-testing isolation and symptomatic isolation.

SIR, Susceptible–Infected–Recovered.

Letting cs,ca[0,1] and w[0,1] denote the compliance rates of post-testing (with or without symptoms) and symptomatic (without testing) isolation, respectively, that is, the proportion of diagnosed (with a positive test) or symptomatic (but not tested/diagnosed) patients who self-isolate, we assumed that the compliance rate of post-testing isolation for symptomatic (cs)patients is greater than that for asymptomatic patients (ca), that is, cs>ca, and the compliance rate of post-testing isolation for symptomatic patients (cs)is greater than the compliance rate of symptomatic isolation, that is, cs>w. The parameter p0 represents the proportion of infections that were symptomatic, with an estimate of 0.6.31 Appendix Table 1 presents the parameters and their values/ranges.32, 33, 34, 35 Note that owing to nonpharmaceutical interventions, which contribute to the reductions in the basic reproduction number,36 we assumed that the transmission rates, βs and βa, linearly decrease during the first 4 months after the identification of the first case and then stabilize.

When there was limited testing capacity, we assumed that symptomatic individuals were prioritized for diagnostic testing; if the capacity was sufficient to test all symptomatic individuals, the remaining capacity would be uniformly distributed among all other individuals who have not been diagnosed before. We assumed that the available testing capacity increased linearly daily.

Using the model described earlier, we simulated a cohort of 500,000 individuals for a 1-year time horizon and estimated the number of infections and isolations. The cohort size was selected on the basis of the rough median population of the largest 100 cities in the U.S. For example, the population in Atlanta was estimated to be 498,715 in 2020.37 The simulations were initialized with 1 infected and symptomatic individual on Day 1. The simulation was coded using the statistical software R,38 and the package deSolve was used to solve the differential equations.39

Simulation Scenarios

We simulated various scenarios to investigate the impact of testing start day and testing capacity as well as compliance with isolation on IAR and other metrics. The simulated scenarios are shown in Table 1, where each scenario is defined by the start day of testing, capacity (daily testing capacity increments), post-testing isolation compliance rates (symptomatic and asymptomatic), and symptomatic isolation (without testing) compliance rate. We referred to testing start days of 30, 45, and 60 as early, moderate, and late, respectively. We referred to daily testing capacity increments of 100, 500, and 1,000 as low, medium, and high capacity, respectively. In each scenario, the post-testing isolation compliance rate for (1) symptomatic patients was 0.95 or 0.80, labeled as high and low, respectively, and (2) asymptomatic patients was 0.90, 0.50, or 0.10, labeled as high, medium, and low, respectively. Therefore, we used a pair of labels to denote the post-testing isolation compliance rate combinations for symptomatic and asymptomatic patients, as shown in Table 1. For example, (high, high) represents that the post-testing isolation compliance rates for both symptomatic and asymptomatic patients are high, that is, cs=0.95,ca=0.90. Moreover, we considered 2 levels of compliance with symptomatic isolation, that is, w=0.80 and 0.50, which were labeled as high and low, respectively. To emphasize the impact of testing and the corresponding post-testing isolation compliance, we fixed the symptomatic isolation compliance rate in the main body to be high (w=0.80).

Table 1.

Simulation Scenarios

Model parameters Labels Values
Testing start day (t0)
Early t0=30
Moderate t0=45
Late t0=60
Capacity (capacity on day t,tt0)
Low 100(tt0)
Medium 500(tt0)
High 1,000(tt0)
Post-testing isolation compliance rates (cs,ca)
(High, high) (0.95, 0.90)
(High, moderate) (0.95, 0.50)
(High, low) (0.95, 0.10)
(Low, moderate) (0.80, 0.50)
(Low, low) (0.80, 0.10)
Symptomatic isolation compliance rate (w)
High 0.8
Low 0.5

Note: The post-testing isolation compliance rate represents the proportion of individuals who isolate themselves after receiving a positive testing diagnosis, and the symptomatic isolation compliance rate represents the proportion of individuals who isolate themselves after starting to experience symptoms (and before diagnosis).

In the baseline scenario, there was no testing or self-isolation. The intervention scenarios included testing, post-testing isolation, and symptomatic isolation, assuming that symptomatic isolation started on Day 45 and that post-testing isolation started when testing capacity became available.

As summarized in Table 1, 90 intervention scenarios covering a wide range of settings and parameter values were tested in the simulations. The following 4 scenarios, where testing started on Day 45, were considered as benchmark scenarios when investigating the impact of delaying the testing start day and/or lowering post-testing self-isolation compliance:

  • 1.

    Scenario SI: low capacity; (high, high) post-testing isolation compliance (cs=0.95,ca=0.90); high symptomatic compliance (w=0.80);

  • 2.

    Scenario SII: low capacity; (high, high) post-testing isolation compliance (cs=0.95,ca=0.90); low symptomatic compliance (w=0.50);

  • 3.

    Scenario SIII: high capacity; (high, high) post-testing isolation compliance (cs=0.95,ca=0.90); high symptomatic compliance (w=0.80); and

  • 4.

    Scenario SIV: high capacity; (high, high) post-testing isolation compliance (cs=0.95,ca=0.90); low symptomatic compliance (w=0.50).

Outcome Metrics

To assess the impact of testing capacity and isolation compliance in different scenarios, we evaluated the following:

  • 1.

    IAR: percentage of the population infected during the time horizon;

  • 2.

    IP: percentage of the population who isolated either owing to a positive diagnostic test result or owing to symptoms; and

  • 3.

    Capacity counterbalance factor (α). Consider one of the scenarios from Scenarios SI, SII, SIII, and SIV, denoted by SO, as the benchmark scenario. SO is with capacity k0, testing start day t0, and (high, high) post-testing isolation compliance rates that lead to an IAR of x%. Consider a modified scenario, denoted by SM, which is similar to SO except that the testing start day is delayed to tt0 and/or post-testing isolation compliance rates are lower; in SM, a higher capacity k=α×k0, where α1 will be needed to keep the IAR (approximately) at x% as in SO. We refer to α as the capacity counterbalance factor.

IAR assesses the public health impact; IP serves as a proxy for assessing the potential social and economic impact40 of the disease, and α reveals the tradeoff between testing start date/post-testing isolation compliance and testing capacity.

RESULTS

In the baseline scenario, there is no testing or self-isolation. The resultant IAR is 69.43% and IP is 0.00%.

Table 2 depicts the IAR and IP under various intervention scenarios and shows the tradeoffs between testing start day, capacity, and compliance with isolation when the symptomatic isolation compliance is high (w=0.80). Additional results with low symptomatic isolation compliance (w=0.50) were summarized in Appendix Table 2. Earlier start of testing, higher testing capacity, and higher self-isolation compliance rates decrease the IAR. Among these factors, the start time of testing significantly impacts the IAR; hence, the results for IAR and IP are summarized on the basis of different testing start days. When fixing the testing start day and capacity, we observed that (high, high) post-testing isolation compliance leads to the lowest IAR, whereas (low, low) post-testing isolation compliance leads to the highest IAR.

Table 2.

IAR and IP in Various Scenarios When Symptomatic Isolation Compliance Is High (w=80%)

Testing start day Capacity Post-testing isolation compliance rates (cs,ca)
(High, high), % (High, moderate), % (High, low), % (How, moderate), % (Low, low), % (High, high), % (High, moderate), % (High, low), % (Low, moderate), % (Low, low), %
IAR IP
Early
Low 2.42 2.43 2.44 3.75 3.76 1.19 1.19 1.19 1.77 1.77
Medium 1.94 1.98 2.01 3.16 3.23 0.98 0.99 0.99 1.53 1.53
High 1.88 1.94 2.01 3.09 3.21 0.97 0.98 0.99 1.52 1.53
Moderate
Low 15.19 15.20 15.21 15.95 15.97 6.54 6.53 6.53 6.77 6.76
Medium 13.15 13.20 13.26 14.19 14.26 5.86 5.84 5.83 6.18 6.17
High 12.45 12.55 12.67 13.60 13.73 5.65 5.63 5.61 6.01 5.98
Late
Low 19.21 19.21 19.21 19.45 19.45 7.78 7.78 7.77 7.82 7.82
Medium 18.75 18.76 18.78 19.05 19.07 7.68 7.67 7.66 7.74 7.73
High 18.60 18.63 18.66 18.93 18.97 7.67 7.65 7.64 7.72 7.71

IAR, infection attack rate; IP, isolation percentage.

With an early testing start day, even low capacity can maintain a low IAR. Specifically, with (high, high) post-testing isolation compliance, the IAR is as low as 2.42%; with (high, low) post-testing isolation compliance, the IAR is 2.44%; and with (low, low) post-testing isolation compliance, the IAR is 3.76%. The IP under early versus late start of testing is also lower. With high testing capacity, the (high, high) post-testing isolation compliance leads to an IAR of 1.88% and an IP of 0.97%.

With moderate testing start day, both IAR and IP significantly increase compared with those of early start: under high capacity, the IAR and IP under (high, high) post-testing isolation compliance are 12.45% and 5.65%, respectively; under low capacity and (low, low) post-testing isolation compliance, the IAR and IP are 15.97% and 6.76%, respectively.

With late testing start day, both IAR and IP significantly increase compared with those of early or moderate start: under (high, high) post-testing isolation compliance, the IAR is as high as 19.21%, 18.75%, and 18.60% with low, medium, and high capacity, respectively. The IP exceeds 7.64% for all scenarios with late start of testing. However, with late start of testing, if the symptomatic isolation compliance is low, the IAR will be at least 28.20%.

Table 3 shows the results on capacity counterbalance factors required under various modified scenarios SM to achieve an IAR similar to that in Scenario SI (i.e., SO). For example, when post-testing isolation compliance rates are (high, high), delaying the start of testing for 5 days (i.e., t=50 versus t0=45) requires a capacity counterbalance factor of 13, that is, k=α×k0=13×100=1300. That is, to maintain the IAR, the daily testing capacity increments need to be 1,300, compared with 100 in Scenario SI. When there is no delay in the start of testing, that is, t=t0=45, but compliance with post-testing isolation of symptomatic patients is (low, low) in a modified scenario SM (versus [high, high] in Scenario SI as SO), then the capacity counterbalance factor is 2, that is, the testing capacity should be doubled in the modified scenario SM to maintain an IAR similar to that in Scenario SI.

Table 3.

Capacity Counterbalance Factors (α) in Modified Scenarios (SM) to Maintain an IAR Similar to That in the Benchmark Scenario SO When SO Is Scenario SI

Testing start day Post-testing isolation compliance rates
(High, high) (High, moderate) (High, low) (Low, moderate) (Low, low)
Day 45 1.0 2.0 2.0 2.0 2.0
Day 46 2.0 2.0 2.0 3.0 4.0
Day 47 2.0 3.0 3.0 5.0 6.0
Day 48 4.0 4.0 4.0 11.0 14.0
Day 49 6.0 7.0 7.0 30.0 213.0
Day 50 13.0 17.0 26.0 116.0
Day 51 35.0 69.0 534.0
Day 52 121.0 431.0
Day 53 420.0
Day 54 3,247.0

IAR, infection attack rate.

Appendix Table 3 shows the results regarding the capacity counterbalance factors under Scenarios SII, SIII, and SIV, where the testing capacity is higher and/or where the symptomatic isolation compliance is lower than in Scenario SI. Similarly, the delay in testing starting day significantly increases the required capacity to maintain an IAR similar to that in Scenario SII/SIII/SIV.

DISCUSSION

Diagnostic testing plays a significant role in controlling the spread of infectious diseases by enabling the early detection of infected individuals, encouraging self-isolation, and reducing transmission.6,41, 42, 43 The effectiveness of testing in preventing or controlling an outbreak depends on when (how early) testing becomes available, how quickly the testing capacity ramps up, and the willingness of individuals to self-isolate (i.e., compliance) when they test positive or have symptoms. The IAR and the IP, that is, the proportion of the population who self-isolate either owing to symptoms or a positive test result, are 2 metrics used in this study to assess the public health and social impact of testing programs. Moreover, we introduced the capacity counterbalance factor metric to assess the tradeoff between testing start date/post-testing isolation compliance and testing capacity.

The results of this study suggest that starting testing early with a lower capacity is more effective in reducing the infection spread than starting late with a higher capacity, especially when the individuals who tested positive have high compliance with self-isolation (each column in Table 2 shows results for a particular compliance rate). Moreover, early start of testing with higher testing capacity leads to lower IP in general, even when the compliance is high. When an early start of testing is not possible, improving compliance with symptomatic isolation is important in reducing the spread of the disease.

When the start of testing is delayed, the additional capacity required (capacity counterbalance factor) grows superlinearly to achieve an IAR similar to that in Scenario SI. The results highlight the importance of complying with post-testing isolation, especially for symptomatic patients. Let us consider small delay scenarios (the start of testing is delayed by <4 days, compared with Scenario SI, where the testing start day is 45). Comparing these small delay scenarios, when fixing the testing start day, a decrease in post-testing isolation compliance of asymptomatic patients (ca) does not significantly increase the capacity counterbalance factor, because the testing capacity is low, and thus, during the first 4 days after testing starts, symptomatic patients would be prioritized for testing. However, a decrease in post-testing isolation compliance of the symptomatic patients (cs) significantly increases the capacity counterbalance factor; for example, when the start of testing is delayed to day 49, α=7 under (high, medium) post-testing compliance, compared with α=30 under (low, medium) post-testing compliance.

Although the importance of early testing has been acknowledged,44 to the best of our knowledge, this study is the first that considers the complex interplay between multiple factors to evaluate the impact of testing and self-isolation on public health outcomes. The results of this study highlight the benefits of the early start of testing and high compliance with isolation. In practice, the testing capacity may not be sufficient to meet the demand,45 especially during the initial stages of the infection spread, and compliance with self-isolation may be low, even in the presence of symptoms. For example, 65%‒90% of working adults reported going to work when they had cold/influenza symptoms6,42,46 owing to a variety of reasons such as high work load, not wanting to use or limited sick time, and perceived pressure or fear of judgment.46,47 The results of this study show that low compliance with self-isolation can significantly increase the IAR, underscoring the importance of reducing barriers to self-isolation, which in turn could increase self-isolation compliance and reduce infectious disease spread. To improve public health outcomes and reduce the social and economic impact of the diseases spread, it is important to communicate the importance of self-isolation through public health campaigns and community-based organizations, as well as to encourage or require businesses, at a systems level, with legal requirements to remove (perceived) penalties or increase incentives for their employees to self-isolate when needed.

The extended SIR model assumes homogenous mixing of the population and is not able to account for demographic- 23 or geographic-dependent information, for example, as in agent-based models.33,48 In this computational study, the testing capacity linearly increased over time, whereas in practice, the capacity increase might follow different patterns. Other factors, such as the willingness to test or compliance with other interventions, would also impact health outcomes. In some cases, there might be correlations among some of these factors, for example, people who are willing to self-isolate might also be more likely to get tested or follow other interventions and recommendations. Exploring these additional complex interactions is an important direction for future research. Despite these limitations owing to modeling assumptions and parameter values, the model proposed in this study can capture the salient characteristics of disease spread dynamics considering the complex interplay between multiple factors related to diagnostic testing and self-isolation.

CONCLUSIONS

In this study, we developed and used an extended SIR model to analyze the impact of diagnostic testing availability (including the start day and capacity of testing programs), compliance with post-testing isolation, and compliance with symptomatic isolation on the disease spread. We quantified the significant advantages and effectiveness of early start of testing and high compliance with self-isolation. Investments in the early start of testing programs and public health education on self-isolation can lower the IAR substantially.

CREDIT AUTHOR STATEMENT

Zhuoting Yu: Conceptualization, Methodology, Software, Validation, Formal analysis, Writing - Original Draft, Visualization. Pinar Keskinocak: Conceptualization, Methodology, Validation, Formal analysis, Writing - Review and Editing, Visualization, Supervision, Project administration. Lauren N. Steimle: Conceptualization, Methodology, Validation, Formal analysis, Writing - Review and Editing, Visualization, Supervision. Inci Yildirim: Conceptualization, Writing - Review and Editing, Supervision.

Declarations of interest

None.

ACKNOWLEDGMENTS

The authors thank the anonymous referees for their valuable suggestions for improving this article.

This does not necessarily represent the views of the Centers for Disease Control and Prevention and Council of States and Territorial Epidemiologists.

This research has been supported in part by the RADx-UP NIH/NIDDK grant (P30DK111024-05S1) and by the Cooperative Agreement Number NU38OT000297 from the Centers for Disease Control and Prevention and Council of States and Territorial Epidemiologists. This research was also supported in part by the William W. George endowment and the following benefactors at Georgia Tech: Andrea Laliberte, Joseph C. Mello, Richard Rick E. and Charlene Zalesky, and Claudia and Paul Raines.

Footnotes

Supplementary material associated with this article can be found at doi:10.1016/j.focus.2022. 100006.

Appendix. Supplementary materials

mmc1.docx (45KB, docx)

REFERENCES

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

mmc1.docx (45KB, docx)

Articles from AJPM Focus are provided here courtesy of Elsevier

RESOURCES