Skip to main content

This is a preprint.

It has not yet been peer reviewed by a journal.

The National Library of Medicine is running a pilot to include preprints that result from research funded by NIH in PMC and PubMed.

medRxiv logoLink to medRxiv
[Preprint]. 2020 Sep 30:2020.09.30.20204529. [Version 1] doi: 10.1101/2020.09.30.20204529

Projected HIV and Bacterial STI Incidence Following COVID-Related Sexual Distancing and Clinical Service Interruption

Samuel M Jenness 1, Adrien Le Guillou 1,2, Christina Chandra 1, Laura M Mann 1, Travis Sanchez 1, Daniel Westreich 3, Julia L Marcus 4
PMCID: PMC7536881  PMID: 33024979

Abstract

Background

The global COVID-19 pandemic has the potential to indirectly impact the transmission dynamics and prevention of HIV and other sexually transmitted infections (STI). Studies have already documented reductions in sexual activity (“sexual distancing”) and interruptions in HIV/STI services, but it is unknown what combined impact these two forces will have on longer-term HIV/STI epidemic trajectories.

Methods

We adapted a network-based model of co-circulating HIV, gonorrhea, and chlamydia for a population of men who have sex with men (MSM) in the Atlanta area. Model scenarios varied the timing, overlap, and relative extent of COVID-related sexual distancing in casual and one-time partnership networks and service interruption within four service categories (HIV screening, HIV PrEP, HIV ART, and STI treatment).

Results

A 50% relative decrease in sexual partnerships and interruption of all clinical services, both lasting 18 months, would generally offset each other for HIV (total 5-year population impact for Atlanta MSM: −227 cases), but have net protective effect for STIs (−23,800 cases). Greater relative reductions and longer durations of service interruption would increase HIV and STI incidence, while greater relative reductions and longer durations of sexual distancing would decrease incidence of both. If distancing lasted only 3 months but service interruption lasted 18 months, the total 5-year population impact would be an additional 890 HIV cases and 57,500 STI cases.

Conclusions

The counterbalancing impact of sexual distancing and clinical service interruption depends on the infection and the extent and durability of these COVID-related changes. If sexual behavior rebounds while service interruption persists, we project an excess of hundreds of HIV cases and thousands of STI cases just among Atlanta MSM over the next 5 years. Immediate action to limit the impact of service interruptions is needed to address the indirect effects of the global COVID pandemic on the HIV/STI epidemic

Keywords: Mathematical model, Sexual networks, HIV, STI, COVID-19, Men who have sex with men

INTRODUCTION

The 2019 novel coronavirus (COVID-19) global pandemic has directly resulted in substantial COVID-related morbidity and mortality, but has also indirectly impacted the transmission of other infectious diseases.1 For HIV and other sexually transmitted infections (STIs), behavioral responses to COVID-19 have included major reductions in social contacts (“social distancing”) that also entailed reductions in sexual activity (“sexual distancing”).24 The pandemic also has interrupted the provision of clinical services for HIV/STIs.5 One critical question is how these two phenomena — distancing that could decrease HIV/STI transmission, and service interruption that could increase transmission — will impact the overall incidence of HIV and STIs immediately and in the post-COVID era.

In the United States, men who have sex with men (MSM) are a key population for HIV/STI prevention because of their longstanding higher disease incidence.6 COVID-19 has already resulted in sexual distancing for MSM, documented across several studies.4,79 Behavioral changes that began during COVID-related restrictions in the U.S. (March 2020) have included reductions in the number of sexual partners and lower frequency of sexual activity within partnerships. COVID-related morbidity has been substantial in areas of the U.S. with a high HIV/STI burden, including in cities like Atlanta, and may have been driven by existing racial and socioeconomic inequities.10 While some social activities have already rebounded in some areas,11 resumption back to “normal” levels will likely be delayed until the widespread availability of a SARS-CoV-2 vaccine.

Use of clinical HIV/STI services has also declined among MSM in the U.S. Major categories of reduced services included HIV and STI diagnostic screening, use of HIV preexposure prophylaxis (PrEP), and retention in ongoing HIV care.7,9 The CDC has provided guidance to STI clinics facing service disruptions and providers have partially addressed this interruption by replacing in-person clinical visits with telehealth services,12,13 but these tools may be less available to people with the greatest need.14 Local health departments have also redeployed disease control services (such as STI partner notification) towards COVID-19 contact tracing efforts.15 It is unknown what the immediate and longer-term impact of these service disruptions will be for uniquely for HIV versus STI incidence. STIs have a higher baseline incidence and thus a more rapid reaction to behavioral and clinical changes than HIV.

Parallel reductions in sexual behavior and HIV/STI screening rates because of COVID-19 make it challenging to understand whether any declines in reported case data reflect true changes in disease incidence or gaps in disease surveillance. Mechanistic modeling approaches can disentangle these two explanations. In this study, we used a stochastic network-based transmission model to project the impact of the competing forces of sexual distancing and HIV/STI service interruptions driven by the COVID-19 pandemic. We evaluated how changes to the sexual partnership networks among MSM in Atlanta may reduce the incidence of HIV and STIs in a model that represents the cocirculation of HIV, gonorrhea, and chlamydia. We also explored how COVID-related service disruptions in four categories (HIV screening, HIV PrEP, HIV treatment, and STI treatment) could increase the incidence of these infections. Our goal was to provide 5-year estimates of HIV and STI burden across these scenarios to support the public health and clinical response.

METHODS

Study Design.

This model of HIV/STI transmission dynamics for U.S. MSM was built with the EpiModel platform,16 which simulates epidemics over dynamic contact networks using temporal exponential random graph models (TERGMs).17 This builds on our previous applied HIV/STI modeling of co-circulating HIV, Neisseria gonorrhoeae (NG), and Chlamydia trachomatis (CT) among MSM.18 For this study, we implemented time points for the start and end of COVID-related sexual distancing and clinical service interruptions. Full methodological details are provided in the Supplemental Appendix.

Our model represented main, casual, and one-time sexual partnerships for Black, Hispanic, and white/other MSM, aged 15 to 65, in Atlanta. The starting network size in the model simulations was 10,000 MSM, which could stochastically increase or decrease over time based on arrival (sexual debut) and departure (mortality or sexual cessation). The model was simulated in weekly time steps.

HIV/STI Epidemic Model.

The epidemic model consisted of 5 main components: 1) statistical network models (TERGMs) to generate dynamic sexual partnerships; 2) statistical models to predict behavior within partnerships; 3) simulation of pathogen transmission across active partnerships; 4) simulation of disease progression and other natural history features; and 5) simulation of prevention and treatment service engagement.

To fit the network models, we used data from ARTnet, a web-based egocentric network study conducted in 2017–2019 of MSM in the US, with data from 4,904 respondents reporting on 16,198 partnerships.19 We included a main effect for geography in models to represent the Atlanta target population. Parameters were weighted by census-based race/ethnicity and age distributions to account for ARTnet sampling biases. Multivariate predictors of partnership formation included partnership type, degree distributions by partnership types, heterogeneity in network degree, assortative mixing by race/ethnicity and age, and mixing by sexual position. Partnership durations were modeled for main and causal partnerships as dissolution rates stratified by partnership type and age group. Other statistical models were fit to ARTnet to predict the frequency of acts and the probability of condom use as a multivariate function of race/ethnicity, age, diagnosed HIV status, and partnership type and duration.

MSM could be screened for HIV and initiate anti-retroviral therapy (ART), which would lower their HIV viral load (VL) and increase their longevity.20,21 MSM progressed through HIV disease with VLs represented continuously. Lower VL with sustained ART use was associated with a reduced probability of HIV transmission per act.22,23 Other factors modifying the HIV transmission probability per act included PrEP use,24 condom use,25 sexual position,26 circumcision,27 and a prevalent STI.28 Transmission was then simulated based on this multivariate set of predictors of the transmission probability.

For HIV services, we represented an integrated HIV continuum of antiretroviral-based prevention and care, with HIV screening as the gateway to both.29 MSM engaged in HIV screening at regular intervals, calibrated to local surveillance data on the proportion of MSM with HIV who were diagnosed.30 MSM screening HIV-positive could then enter the HIV care continuum (linkage and retention in ART) while MSM who screened negative could enter the HIV prevention continuum (PrEP initiation, adherence, and persistence). MSM were linked to ART, and could cycle off and back on ART based on rates calibrated to local surveillance of care entry and VL suppression.30 MSM on ART achieved suppression after 3 months,21 with a rebound to set-point VL after halting ART.31

The HIV prevention continuum consisted of initiation, adherence, and persistence in PrEP care for daily oral tenofovir/emtricitabine.32 MSM who tested HIV-negative and met indications for PrEP based on CDC guidelines were eligible to start.33 Eligible MSM then started PrEP based on an initiation probability generating a coverage level of 15%, consistent with Atlanta estimates.34 Heterogeneous PrEP adherence was modeled, with 78.4% meeting a high-adherence level35 that resulted in a 99% relative reduction in HIV acquisition risk.24 MSM with high PrEP adherence reduced their condom use, based on ARTnet data. PrEP discontinuation was based on secondary estimates of the proportion of MSM who were retained in PrEP care at 6 months (57%),36 transformed into median time to discontinuation. MSM additionally stopped PrEP if they no longer exhibited PrEP indications.33

Gonorrhea and chlamydia transmission were simulated along the same partnership network as HIV, but with disease recovery through either natural clearance or antibiotic treatment.37 STI transmission was directional and site-specific during anal intercourse at the rectal and urogenital sites; for example, receptive intercourse with a partner infected with urethral gonorrhea was necessary for a new rectal gonorrhea infection. Men could be infected at both anatomical sites and with both gonorrhea and chlamydia. The symptomatic status of the newly acquired infections depended on site of infection, with most rectal infections asymptomatic and most urethral infections symptomatic.38 STI symptoms influenced the probability of testing and treatment, which reduced mean time to clearance.39 Successful treatment for an STI at one site resulted in clearance at the other site for dual-site infections.

COVID-Related Impact on Behavior and Services.

Experimental scenarios implemented reductions to the partnership network structure and HIV/STI service utilization individually and jointly. All scenarios were simulated for a period of 5 years in weekly time steps. A base scenario kept all parameters constant over that simulation window. Experimental scenarios first simulated one year of no change, followed by the initiation of either sexual distancing only, service interruption only, or both combined. In primary scenarios, service interruption lasted for 18 months and sexual distancing either for 18 months or 3 months. The 18-month window was selected based on predictions of the timeline for COVID-19 vaccine deployment; the 3-month distancing window was selected based on empirical data suggesting a more rapid behavioral rebound.9,11 Sensitivity analyses varied the duration of both.

Distancing was modeled to varying levels by reducing network degree for casual partnerships and incidence for one-time partners; degree for main partnerships remained unchanged given minimal expected impact on cohabitating partners. Service interruption was reflected in four types of HIV/STI interventions: HIV screening, HIV PrEP, HIV ART (through retention in care), and bacterial STI treatment. These were reduced on a relative scale individually and jointly.

Calibration, Simulation, and Analysis.

Given uncertainty in some model parameters, we calibrated the model with a Bayesian approach40 that defined prior distributions for these parameters and fit the model to empirical surveillance-based estimates of diagnosed HIV, NG, and CT incidence for the target population. This involved projecting current incidence estimates based on historical data and trends in case reporting over the past decade. After calibration, for each study scenario, we simulated the model 500 times and summarized the distribution of results with medians and 95% simulation intervals.

Three primary outcomes were: 1) standardized HIV and STI incidence per 100 person-years at risk (PYAR) at 2.5 years (or 18 months after start of COVID-related response); 2) standardized cumulative incidence over 5 years per 1000 disease-susceptible MSM; and 3) the total 5-year population impact, which was calculated in two steps. We first multiplied the standardized cumulative incidence by estimates of the total susceptible population size of MSM in the Atlanta metropolitan area (102,642 sexually active MSM for STI outcomes,41 and 87,723 sexually active HIV-negative MSM for HIV outcomes42) to quantify the total population 5-year incidence. We then subtracted this total population incidence for each scenario from the value in the base scenario to obtain an absolute difference.

RESULTS

Figure 1 visualizes the primary scenarios of 18 months of service interruption and 18 months of sexual distancing. The panels show standardized incidence rates of HIV and STIs for scenarios in which networks and services were reduced by 50% during the COVID period. Sexual distancing was the joint reduction in casual and one-time partnerships, and service reduction was the joint interruption of all four service categories (HIV screening, HIV PrEP initiation, HIV ART retention, and STI treatment). Panel A shows that distancing in the absence of service reduction (green line) was associated with a decrease in HIV incidence, whereas service reduction only (red line) was associated with an increase in HIV incidence. HIV incidence changes in both scenarios persisted after the resumption of baseline behavior and services at year 2.5 (week 130). In the combined scenario (blue line), these relative changes in behavior and services effectively offset each other, resulting in minimal difference in HIV incidence compared with the base (no change) scenario. Panel B shows the impact of the same scenarios on combined gonorrhea and chlamydia incidence. Sexual distancing had a strong and sustained reduction in STI incidence. With only service interruption but no distancing, STI incidence increased substantially. In the combined scenario, the projected incidence was slightly lower initially, rebound after sexual distancing ends, and then continued to decline again through year 5.

Figure 1.

Figure 1.

HIV and combined STI incidence before, during, and after an 18-month period of clinical service interruption and 18-month period of sexual distancing. Model scenarios within each panel compare a 50% relative reduction in behavior only, service interruption only, or both jointly against the base (no change) model. Thick lines show median values and bands show inter-quartile range of values across 500 simulations per scenario.

Table 1 quantifies the estimated impact of the sexual-distancing-only scenarios with an 18-month duration. A relative 50% reduction in casual and one-time networks jointly (corresponding to the green line scenario in Figure 1) resulted in a decrease in HIV incidence from 1.23 per 100 PYAR to 0.79, a 36% relative reduction. The 5-year cumulative incidence per 1,000 susceptible MSM was 51.4 cases in that scenario, compared to 62.3 cases in the base scenario, corresponding with a 17% reduction in HIV incidence. The impact on the point incidence at year 2.5 was more extreme than the impact on the cumulative incidence across 5 years because the point incidence rebounded to the baseline level after distancing and service interruptions ended. The total population impact on HIV incidence for Atlanta MSM was projected in that scenario to be −966 cases, or 193 fewer cases per year, compared to the base scenario. The relative size of reductions in casual partnerships correlated with stronger relative declines in HIV incidence than comparable relative reductions in one-time partnerships. This was driven by the underlying behavioral patterns, in which coital frequency was higher and condom use lower for casual partnerships. The mechanistic impact on network degree statistics is provided in Supplemental Table 14.

Table 1.

Changes in HIV and Combined Gonorrhea & Chlamydia Incidence Following an 18-Month Period of Sexual Distancing, with no Associated Changes in HIV/STI Prevention or Treatment Service Utilization

HIV Combined STI
Scenario Incidence RateA Cumul. IncidenceB Population ImpactC Incidence RateA Cumul. IncidenceB Population ImpactC
(95% SI) (95% SI) (95% SI) (95% SI) (95% SI) in Thousands (95% SI)
Base Scenario
 No Changes 1.23 (0.56, 2.05) 62.3 (54.5, 70.7) 19.39 (8.89, 31.70) 960.4 (477.0, 1461.6)
Reduction in Casual Network Degree & One-Time Rate
 25% 1.00 (0.44, 1.77) 56.9 (49.8, 64.2) −488 (−518, −459) 10.67 (4.76, 18.55) 644.1 (330.8, 1033.4) −31.4 (−33.4, −29.3)
 50% 0.79 (0.33, 1.56) 51.4 (45.1, 58.0) −966 (−995, −939) 5.85 (2.40, 9.76) 445.9 (227.8, 710.9) −51.8 (−53.5, −50.3)
 90% 0.66 (0.11, 1.32) 44.5 (37.3, 171.0) −1547 (−1579, −1515) 1.30 (0.51, 2.73) 291.4 (154.2, 1409.6) −67.7 (−69.1, −66.3)
Reduction in Casual Network Degree
 25% 1.10 (0.44, 1.90) 58.2 (50.2, 65.5) −368 (−397, −340) 14.33 (6.86, 24.59) 728.1 (384.7, 1186.3) −22.2 (−24.2, −20.2)
 50% 0.90 (0.33, 1.68) 53.2 (46.7, 61.3) −781 (−812, −752) 10.54 (5.01, 18.05) 593.7 (332.6, 945.5) −37.1 (−39.0, −35.3)
 90% 0.67 (0.22, 1.45) 46.3 (38.8, 222.4) −1381 (−1417, −1348) 2.69 (1.04, 5.04) 341.3 (180.4, 1948.7) −62.4 (−64.2, −60.9)
Reduction in One-Time Rate
 25% 1.12 (0.45, 2.01) 60.5 (53.1, 68.8) −169 (−199, −141) 13.69 (6.24, 22.20) 783.4 (400.1, 1186.9) −17.7 (−19.8, −15.6)
 50% 1.11 (0.44, 1.88) 58.7 (51.6, 67.1) −322 (−352, −292) 9.52 (3.71, 15.84) 655.2 (298.8, 1028.8) −30.9 (−32.9, −28.9)
 90% 0.89 (0.33, 1.57) 55.9 (49.5, 63.6) −561 (−588, −532) 4.90 (2.07, 9.12) 470.8 (223.1, 785.3) −49.7 (−51.4, −48.0)
A

Standardized rate per 100 person-years at risk at 2.5 years

B

Standardized cumulative incidence over 5 years per 1000 susceptible MSM

C

Difference, compared to base scenario, in 5-year cumulative incidence for total susceptible population of MSM in Atlanta

The patterns were generally similar for STI incidence across the same Table 1 scenarios of sexual distancing only with an 18-month duration. The baseline STI incidence rate was 19.39 (per 100 PYAR), but 50% joint network distancing resulted in an estimated incidence of 5.85 at year 2.5 (a 70% reduction) and a cumulative incidence of 446 cases compared to 960 in the base scenario (a 54% reduction). The 5-year population impact of this scenario was a reduction in total STI cases by over 50,000. There was considerably more variability in STI than HIV incidence. Also compared to HIV, 50% reductions within each partnership sub-network were associated with similar declines in STI incidence, whereas HIV was more strongly impacted by casual network reductions. These differences were driven by the higher transmissibility of STIs (i.e., more efficiently transmitted in one-time partnerships), and by the potential for reinfection. Individual STI outcomes are provided in Supplemental Table 15.

Table 2 quantifies the impact of HIV/STI service reductions in the absence of sexual distancing. The scenario in which all services were reduced by 50% corresponds to the red lines in the Figure 1. Reductions in PrEP had a more moderate impact on HIV incidence than reductions in ART. This was because baseline PrEP coverage was relatively low (15%) in Atlanta, and COVID-related changes only applied to the PrEP-indicated population. In comparison, changes in ART retention would impact the care of the entire HIV-diagnosed population, subsequently affecting transmission through lower levels of VL suppression. For STIs, reductions in STI treatment had a dramatic impact on STI incidence, which was held in equilibrium in the base scenario by high levels of routine screening. Gaps in STI screening, which were projected to dramatically increase STI incidence, also had downstream effects on HIV incidence through the biological relationship between prevalent STI infection and HIV acquisition risk. Process outcomes associated for these scenarios are provided in Supplemental Table 16 and individual STI outcomes in Supplemental Table 17.

Table 2.

Changes in HIV and Combined Gonorrhea & Chlamydia Incidence Following an 18-Month Period of Reduced HIV/STI Prevention or Treatment Service Utilization, with no Associated Changes in Behavior

HIV Combined STI
Scenario Incidence RateA Cumul. IncidenceB Population ImpactC Incidence RateA Cumul. IncidenceB Population ImpactC
(95% SI) (95% SI) (95% SI) (95% SI) (95% SI) in Thousands (95% SI)
Base Scenario
 No Changes 1.23 (0.56, 2.05) 62.3 (54.5, 70.7) 19.39 (8.89, 31.70) 960.4 (477.0, 1461.6)
Reduction in All Services
 25% 1.56 (0.78, 2.44) 68.7 (60.4, 78.0) 558 (527, 590) 35.52 (17.93, 52.41) 1481.5 (786.4, 2081.4) 52.0 (49.5, 54.5)
 50% 1.90 (1.01, 3.02) 76.9 (67.0, 86.5) 1272 (1237, 1306) 48.83 (27.53, 71.19) 1862.1 (1114.8, 2636.8) 92.3 (89.7, 94.9)
 90% 3.26 (2.02, 4.63) 105.6 (94.7, 118.3) 3785 (3748, 3822) 64.23 (38.05, 90.76) 2261.8 (1475.7, 3045.5) 132.7 (130.1, 135.3)
Reduction in PrEP Initiation
 25% 1.24 (0.67, 2.14) 63.2 (55.3, 71.6) 63 (32, 95) 18.47 (8.73, 31.62) 943.7 (507.9, 1502.9) −1.0 (−3.3, 1.5)
 50% 1.33 (0.56, 2.13) 63.9 (55.9, 72.0) 131 (101, 165) 18.50 (9.23, 31.68) 936.4 (489.0, 1469.6) −1.5 (−3.7, 0.7)
 90% 1.35 (0.67, 2.25) 65.2 (57.5, 74.4) 261 (228, 290) 19.50 (8.98, 32.18) 991.6 (515.9, 1487.5) 2.3 (0.1, 4.6)
Reduction in HIV Screening
 25% 1.24 (0.56, 2.13) 63.2 (54.9, 71.4) 78 (47, 109) 18.61 (8.98, 31.28) 946.1 (485.3, 1462.1) −2.2 (−4.4, 0.0)
 50% 1.33 (0.56, 2.14) 64.3 (56.2, 73.2) 176 (144, 209) 18.58 (8.86, 30.76) 927.0 (496.8, 1476.8) −1.4 (−3.5, 0.7)
 90% 1.45 (0.67, 2.35) 66.3 (58.0, 75.9) 350 (319, 384) 18.79 (9.40, 28.83) 951.0 (495.8, 1424.5) −0.6 (−2.6, 1.6)
Reduction in ART Retention
 25% 1.24 (0.56, 2.24) 64.0 (56.9, 72.7) 157 (124, 189) 18.71 (8.72, 30.16) 943.7 (475.9, 1425.8) −1.5 (−3.4, 0.6)
 50% 1.45 (0.67, 2.48) 67.8 (60.0, 76.1) 469 (437, 498) 18.51 (8.77, 29.76) 943.0 (451.9, 1430.1) −1.7 (−4.0, 0.6)
 90% 2.26 (1.24, 3.30) 89.0 (79.0, 97.7) 2324 (2291, 2357) 18.21 (9.20, 29.63) 932.0 (508.5, 1404.8) −2.4 (−4.5, −0.2)
Reduction in NG/CT Treatment
 25% 1.24 (0.66, 2.26) 64.5 (56.2, 73.2) 184 (155, 217) 35.31 (17.10, 54.45) 1459.3 (768.0, 2127.0) 51.2 (48.5, 54.0)
 50% 1.44 (0.67, 2.35) 66.3 (57.7, 75.9) 346 (311, 377) 49.38 (27.71, 71.72) 1851.2 (1172.2, 2568.7) 92.6 (89.9, 95.3)
 90% 1.47 (0.77, 2.47) 68.7 (60.6, 78.0) 569 (536, 603) 66.62 (41.00, 90.51) 2310.7 (1562.6, 3010.2) 137.9 (134.8, 140.9)
A

Standardized rate per 100 person-years at risk at 2.5 years

B

Standardized cumulative incidence over 5 years per 1000 susceptible MSM

C

Difference, compared to base scenario, in 5-year cumulative incidence for total susceptible population of MSM in Atlanta

The top half of Table 3 shows the impact of combined sexual distancing and service reduction for 18 months. The 50% network reduction and 50% service reduction scenario corresponds to the blue lines in Figure 1. For HIV, commensurate relative reductions in behavior and services by the same amounts generally kept incidence similar to the base scenario. The population impact of paired scaled-down scenarios had a minor protective effect at lower reductions (25%/25%: −69; 50%/50%: −227) but resulted in slightly higher incidence for the most extreme reductions (90%/90%: 215). For STIs, in contrast, declines in behavior strongly overwhelmed the declines in services, with a net reduction of 23,800 cases in the 50%/50% paired scaled-down scenario.

Table 3.

Changes in HIV and Combined Gonorrhea & Chlamydia Incidence Following Joint Behavioral Change and Reduced HIV/STI Prevention and Treatment Service Utilization

HIV Combined STI
Scenario Incidence RateA Cumul. IncidenceB Population ImpactC Incidence RateA Cumul. IncidenceB Population ImpactC
(95% SI) (95% SI) (95% SI) (95% SI) (95% SI) in Thousands (95% SI)
Base Scenario
 No Changes 1.23 (0.56, 2.05) 62.3 (54.5, 70.7) 19.39 (8.89, 31.70) 960.4 (477.0, 1461.6)
Sexual Distancing for 18 Months, Service Reduction for 18 Months
 Reduced Casual/One-Time Networks by 25%
  Services by −25% 1.22 (0.55, 2.13) 61.7 (54.1, 69.1) −69 (−98, −38) 20.01 (9.89, 30.90) 955.4 (480.9, 1416.9) 0.0 (−2.3, 2.1)
  Services by −50% 1.46 (0.68, 2.36) 67.6 (59.7, 76.2) 465 (435, 496) 27.45 (14.61, 43.32) 1198.4 (704.1, 1750.8) 25.1 (22.8, 27.5)
  Services by −90% 2.49 (1.48, 3.71) 92.0 (82.9, 102.5) 2625 (2590, 2661) 35.71 (20.44, 55.03) 1470.9 (869.8, 2089.8) 51.9 (49.4, 54.5)
 Reduced Casual/One-Time Networks by 50%
  Services by −25% 0.90 (0.33, 1.67) 54.5 (47.8, 61.6) −689 (−718, −660) 10.49 (4.95, 17.57) 611.5 (313.6, 977.1) −35.4 (−37.1, −33.7)
  Services by −50% 1.12 (0.55, 2.01) 59.9 (52.1, 66.8) −227 (−257, −198) 13.59 (7.16, 22.00) 736.8 (375.3, 1135.6) −23.8 (−25.8, −21.9)
  Services by −90% 1.90 (1.11, 2.84) 79.9 (71.5, 88.4) 1532 (1500, 1565) 17.38 (9.52, 27.69) 860.3 (511.8, 1323.4) −9.3 (−11.3, −7.2)
 Reduced Casual/One-Time Networks by 90%
  Services by −25% 0.66 (0.11, 1.44) 47.2 (39.0, 188.9) −1298 (−1331, −1262) 2.42 (1.03, 4.39) 318.1 (167.5, 1232.6) −64.7 (−66.1, −63.1)
  Services by −50% 0.78 (0.33, 1.68) 49.8 (41.9, 348.0) −1074 (−1107, −1040) 3.11 (1.30, 5.28) 333.8 (183.7, 3540.3) −62.8 (−64.4, −61.3)
  Services by −90% 1.33 (0.56, 2.34) 64.5 (55.3, 384.4) 215 (178, 256) 3.63 (1.66, 6.20) 350.3 (191.6, 5041.2) −60.5 (−62.2, −59.0)
Sexual Distancing for 3 Months, Service Reduction for 18 Months
 Reduced Casual/One-Time Networks by 25%
  Services by −25% 1.45 (0.67, 2.47) 67.4 (58.6, 77.0) 423 (388, 455) 31.06 (16.36, 49.10) 1302.8 (741.7, 2008.1) 37.2 (34.7, 39.9)
  Services by −50% 1.80 (0.89, 2.92) 74.8 (65.4, 84.4) 1074 (1039, 1108) 44.10 (22.59, 64.69) 1719.4 (953.5, 2348.6) 76.6 (74.0, 79.2)
  Services by −90% 3.16 (1.93, 4.54) 103.1 (91.9, 114.2) 3559 (3523,3596) 58.60 (31.00, 81.66) 2105.9 (1273.2, 2829.7) 116.4 (113.7, 119.4)
 Reduced Casual/One-Time Networks by 50%
  Services by −25% 1.45 (0.67, 2.25) 65.3 (56.9, 74.3) 252 (220, 283) 27.08 (13.90, 43.78) 1184.6 (640.5, 1829.3) 23.7 (21.2, 26.0)
  Services by −50% 1.78 (0.89, 2.81) 72.6 (63.0, 82.0) 890 (858, 923) 38.45 (19.20, 55.92) 1529.3 (857.3, 2106.2) 57.5 (55.1, 60.0)
  Services by −90% 2.93 (1.70, 4.39) 99.2 (88.0, 111.0) 3240 (3202, 3277) 50.23 (28.22, 71.85) 1871.4 (1141.2, 2505.3) 93.1 (90.5, 95.8)
 Reduced Casual/One-Time Networks by 90%
  Services by −25% 1.13 (0.55, 1.99) 56.5 (49.9, 64.2) −513 (−543, −482) 11.79 (5.30, 20.57) 613.4 (320.9, 972.0) −34.9 (−36.6, −33.0)
  Services by −50% 1.34 (0.67, 2.23) 61.9 (54.4, 69.6) −46 (−75, −18) 17.15 (8.05, 27.05) 789.0 (384.4, 1181.6) −17.7 (−19.6, −15.9)
  Services by −90% 2.27 (1.34, 3.35) 83.2 (75.3, 92.7) 1835 (1803, 1867) 22.59 (11.02, 35.04) 954.1 (518.1, 1444.7) 0.8 (−1.4, 2.9)
A

Standardized rate per 100 person-years at risk at 2.5 years

B

Standardized cumulative incidence over 5 years per 1000 person-years at risk

C

Difference, compared to base scenario, in 5-year cumulative incidence for total susceptible population of MSM in Atlanta

Figure 2 demonstrates how the interaction of the duration of sexual distancing and service interruptions impacts the standardized cumulative incidence outcomes. Similar to Figure 1, the scenarios here reflected a 50% relative reduction in both behavior and services during the eligible change period. HIV and STI incidence were lowest (53 and 533 cases per 1,000 susceptible, respectively) when service interruption lasted for 3 months and distancing lasted for 18 months. Both HIV and combined STI incidence were highest (73 and 1,529 cases, respectively) when services were interrupted for 18 months but sexual distancing occurred for 3 months.

Figure 2.

Figure 2.

Relationship between the duration of sexual distancing and service interruption on cumulative (5-year) incidence of HIV and STIs per 1000 susceptible MSM. Individual boxes display the distribution of 500 simulations across each scenario.

Finally, we explored that last scenario further in Figure 3 and the bottom of Table 3. Here the resumption time for sexual behavior was varied independently from the resumption time for services. For HIV, 3-month distancing in the absence of service change had no substantive impact on the trajectory of HIV incidence (green line), and therefore was unable to counterbalance the effects of service interruption in the combined scenario (blue line). Higher point incidence lasted through the end of 5 years. Over 5 years, this resulted in 890 excess HIV cases. For STIs, incidence in the combined scenario followed a similar pattern as for HIV, but to a more extreme level. STI incidence in the combined scenario (blue line) more closely tracked the scenario with service interruption only (red line), and STI incidence did not return to baseline values through 5 years. This resulted in an excess of 57,500 cases over 5 years.

Figure 3.

Figure 3.

HIV and combined STI incidence before, during, and after an 18-month period of clinical service interruption and 3-month period of sexual distancing. Model scenarios within each panel compare a 50% relative reduction in behavior only, service interruption only, or both jointly against the base (no change) model. Thick lines show median values and bands show inter-quartile range of values across 500 simulations per scenario.

DISCUSSION

This study projected the 5-year impact of COVID-related sexual behavior changes (“sexual distancing”) and interruption of clinical services on the incidence of HIV, gonorrhea, and chlamydia among MSM in the Atlanta area. We found that the magnitude and timing of epidemiological impact depended on the infection and on the relative extent and durability of the COVID-related changes. Durable sexual distancing could offset (for HIV) or overcome (for STIs) the excess incidence attributable to an equal period of clinical service interruption. However, sexual activity rebounding while service interruption persists would lead to higher incidence for both HIV and STIs. Based on current estimated behavioral and clinical changes, we project an excess of nearly 900 HIV cases and over 57,000 STI cases just among Atlanta MSM over the next 5 years. Our findings therefore suggest that immediate action is needed to address the indirect effects of the COVID-19 pandemic on the HIV/STI epidemic.

The protective effects of sexual distancing on both HIV and STI incidence highlight the need to understand and address the extent and durability of behavior change during the COVID-19 pandemic. In our model, sexual partner reduction had a protective effect on HIV and STI incidence. For STIs, their higher baseline incidence and faster response to behavioral changes suggest that durable sexual distancing could result in a sustained reduction in STI incidence. Empirical data suggests a wide heterogeneity of changes in sexual activity during initial COVID restrictions in March 2020.7,8 However, fewer studies have characterized the timing of behavioral rebounds; some have suggested a return to pre-COVID levels starting as early as June 2020.9,11 Our model suggests that such a transient change will have no substantive impact for HIV and only a minor impact for STIs. This highlights the need for effective sexual health messaging that supports sustainable behavior changes throughout the pandemic, which could have a protective effect on both HIV/STIs and SARS-CoV-2 transmission. Local health departments, such as the New York City Department of Health, and the National Coalition of STD Directors have developed such guidelines.43,44 Sexual health messaging should adopt a harm reduction framework to emphasize that risk reduction for HIV/STIs does not require sexual abstinence.45

The projected detrimental effects on HIV and STI incidence of clinical service interruption in the model demonstrate the critical importance of maintaining sexual health services amidst the COVID-19 pandemic response. Our model evaluated four clinical services for which there was already evidence of interruption to the relative degree in our scenarios.7 In some jurisdictions, health department staff assigned to HIV/STI partner services have been redeployed for COVID contact tracing.15 Interruption of ART care for persons living with HIV had the largest impact on projected excess HIV incidence in our model; this is a cause for particular concern given the dual impact ART interruption will have on HIV morbidity and transmission. Minimizing service interruption will require innovative approaches to ensure access to clinical services and overcome common barriers to care during the COVID pandemic, including travel limitations, limited access to telehealth, and gaps in health insurance. These approaches will remain important even as sexual health services return to pre-COVID capacity and long-lasting impacts on health care access affect re-engagement in services.

Limitations.

The primary limitation of our model projections is the future uncertainty about the types and durability of both sexual distancing and service reduction. While our sensitivity analysis (Figure 2) explored the durability aspect, both components may change or rebound in different ways from those modeled. One strength of our model is its data-driven representation of dynamic sexual networks and engagement in comprehensive HIV/STI care in the pre-COVID era. However, modeling changes in the COVID-19 era required mapping data on broader aggregate reductions onto individual rate-based model parameters. Future empirical research on sexual distancing and service interruption should measure these changes with more individual-level specificity within and across persons. Second, we assumed that there was no correlation between changes in individual behavior and changes in service engagement. This decision was based on a re-analysis of one published study,7 provided in Supplemental Table 4.1, showing limited evidence of such individual-level correlation between change in sexual partner numbers and change in service access (small correlations were observed for HIV and STI screening only). However, correlations may emerge over time in ways that will be necessary to model, so updated empirical data capturing this relationship will be critical. Third, our model did not explicitly represent the transmission dynamics, morbidity, or community response to COVID-19 that may result in changes to sexual networks based on real or perceived COVID risk (e.g., partner selection by COVID status or risk factors). This is an important topic for future data collection and modeling studies. Finally, our target population was MSM in the Atlanta area, a population with lower baseline access to HIV/STI services and a higher baseline of disease incidence to other populations and areas. Therefore, our standardized results may not be scalable to populations with a different epidemiological context.

Conclusions.

The global COVID-19 pandemic has presented substantial challenges to the prevention and control of other infectious diseases, including HIV and STIs, as a result of clinical service interruptions. While sexual behavior change may offset service interruptions, this counterbalancing effect will depend on overlap in the timing of these changes. With transient behavior change but persistent service interruptions, we project major increases in HIV and STI incidence that may take years to return to pre-COVID levels. This calls for improved sexual health messaging and innovative approaches to addressing service gaps during the ongoing COVID-19 pandemic.

Supplementary Material

Supplement 1
media-1.pdf (1.1MB, pdf)

FUNDING

This work was supported by grants from National Institutes of Health grant (R01 AI138783 and P30AI050409) and the MAC AIDS Fund. JLM is supported in part by the National Institute of Allergy and Infectious Diseases (grant K01 AI122853).

Footnotes

DISCLOSURES

JLM has previously consulted for Kaiser Permanente Northern California on a research grant from Gilead Sciences. DW has consulted for Sanofi-Pasteur on unrelated topics.

REFERENCES

  • 1.Hogan AB, Jewell BL, Sherrard-Smith E, et al. Potential impact of the COVID-19 pandemic on HIV, tuberculosis, and malaria in low-income and middle-income countries: a modelling study. Lancet Glob Health 2020; 8: e1132–41. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Andersen M. Early Evidence on Social Distancing in Response to COVID-19 in the United States. 2020; published online April 5. DOI: 10.2139/ssrn.3569368 [DOI]
  • 3.Coombe J, Kong F, Bittleston H, et al. Love during lockdown: findings from an online survey examining the impact of COVID-19 on the sexual practices of people living in Australia. medRxiv 2020; : 2020.08.10.20171348. [DOI] [PubMed] [Google Scholar]
  • 4.Hensel DJ, Rosenberg M, Luetke M, Fu T, Herbenick D. Changes in Solo and Partnered Sexual Behaviors during the COVID-19 Pandemic: Findings from a U.S. Probability Survey. medRxiv 2020; published online June 12. DOI: 10.1101/2020.06.09.20125609 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Spinner T. Report from the Field: The Impact of COVID-19 on Local Health Department HIV, STI, and Hepatitis Programs - NACCHO. 2020; published online April 15. https://www.naccho.org/blog/articles/report-from-the-field-the-impact-of-covid-19-on-local-health-department-hiv-sti-and-hepatitis-programs (accessed Sept 29, 2020).
  • 6.Centers for Disease Control and Prevention. STDs in Men Who Have Sex with Men - 2018 Sexually Transmitted Diseases Surveillance. 2019; published online Oct 8. https://www.cdc.gov/std/stats18/msm.htm (accessed Sept 22, 2020).
  • 7.Sanchez TH, Zlotorzynska M, Rai M, Baral SD. Characterizing the Impact of COVID-19 on Men Who Have Sex with Men Across the United States in April, 2020. AIDS Behav 2020; published online April 29. DOI: 10.1007/s10461-020-02894-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.McKay T, Henne J, Gonzales G, Quarles R, Gavulic KA, Gallegos SG. The COVID-19 Pandemic and Sexual Behavior among Gay and Bisexual Men in the United States. SocArXiv 2020; published online May 30. DOI: 10.31235/osf.io/8fzay [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Pampati S, Emrick K, Siegler A, Jones, Jeb. Changes in sexual behavior and access to sexual health services due to the COVID-19 pandemic among PrEP-using MSM in the South. In: STD Prevention Conference 2020 Atlanta, GA, 2020. [Google Scholar]
  • 10.Bambra C, Riordan R, Ford J, Matthews F. The COVID-19 pandemic and health inequalities. J Epidemiol Community Health 2020; published online June. DOI: 10.1136/jech-2020-214401 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Stephenson R, Chavanduka TMD, Rosso MT, et al. Sex in the Time of COVID-19: Results of an Online Survey of Gay, Bisexual and Other Men Who Have Sex with Men’s Experience of Sex and HIV Prevention During the US COVID-19 Epidemic. AIDS Behav 2020; published online Sept 2. DOI: 10.1007/s10461-020-03024-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Rogers BG, Coats CS, Adams E, et al. Development of Telemedicine Infrastructure at an LGBTQ+ Clinic to Support HIV Prevention and Care in Response to COVID-19, Providence, RI. AIDS Behav 2020; 24: 2743–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Division of STD Prevention, National Center for HIV/AIDS, Viral Hepatitis, STD, and TB Prevention, Centers for Disease Control and Prevention. Guidance and Resources During Disruption of STD Clinical Services. Sexually Transmitted Diseases (STDs). 2020; published online Sept 8. https://www.cdc.gov/std/prevention/disruptionGuidance.htm (accessed Sept 23, 2020).
  • 14.Jaffe DH, Lee L, Huynh S, Haskell TP. Health Inequalities in the Use of Telehealth in the United States in the Lens of COVID-19. Population Health Management 2020; published online Aug 18. DOI: 10.1089/pop.2020.0186 [DOI] [PubMed] [Google Scholar]
  • 15.Centers for Disease Control and Prevention. Guidance and Resources During Disruption of STD Clinical Services. 2020; published online Sept 8. https://www.cdc.gov/std/prevention/disruptionGuidance.htm (accessed Sept 21, 2020).
  • 16.Jenness SM, Goodreau SM, Morris M. EpiModel: An R Package for Mathematical Modeling of Infectious Disease over Networks. J Stat Softw 2018; 84: 1–47. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Krivitsky PN, Handcock MS. A Separable Model for Dynamic Networks. J R Stat Soc Series B Stat Methodol 2014; 76: 29–46. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Jenness SM, Weiss KM, Goodreau SM, et al. Incidence of Gonorrhea and Chlamydia Following Human Immunodeficiency Virus Preexposure Prophylaxis Among Men Who Have Sex With Men: A Modeling Study. Clin Infect Dis 2017; 65: 712–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Weiss KM, Goodreau SM, Morris M, et al. Egocentric sexual networks of men who have sex with men in the United States: Results from the ARTnet study. Epidemics 2020; 30: 100386. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Buchbinder SP, Katz MH, Hessol NA, O’Malley PM, Holmberg SD. Long-term HIV-1 infection without immunologic progression. AIDS 1994; 8: 1123–8. [DOI] [PubMed] [Google Scholar]
  • 21.Chu H, Gange SJ, Li X, et al. The effect of HAART on HIV RNA trajectory among treatment-naive men and women: a segmental Bernoulli/lognormal random effects model with left censoring. Epidemiology 2010; 21 Suppl 4: S25–34. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Wilson DP, Law MG, Grulich AE, Cooper DA, Kaldor JM. Relation between HIV viral load and infectiousness: a model-based analysis. Lancet 2008; 372: 314–20. [DOI] [PubMed] [Google Scholar]
  • 23.Supervie V, Breban R. Brief Report: Per Sex-Act Risk of HIV Transmission Under Antiretroviral Treatment: A Data-Driven Approach. J Acquir Immune Defic Syndr 2018; 79: 440–4. [DOI] [PubMed] [Google Scholar]
  • 24.Grant RM, Anderson PL, McMahan V, et al. Uptake of pre-exposure prophylaxis, sexual practices, and HIV incidence in men and transgender women who have sex with men: a cohort study. Lancet Infect Dis 2014; 14: 820–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Smith DDK, Herbst JHJ, Zhang X, Rose CE. Condom effectiveness for HIV prevention by consistency of use among men who have sex with men in the United States. J Acquir Immune Defic Syndr 2015; 68: 337–44. [DOI] [PubMed] [Google Scholar]
  • 26.Goodreau SM, Carnegie NB, Vittinghoff E, et al. What drives the US and Peruvian HIV epidemics in men who have sex with men (MSM)? PLoS One 2012; 7: e50522. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Wiysonge CS, Kongnyuy EJ, Shey M, et al. Male circumcision for prevention of homosexual acquisition of HIV in men. Cochrane Database Syst Rev 2011; : CD007496. [DOI] [PubMed] [Google Scholar]
  • 28.Bernstein KT, Marcus JL, Nieri G, Philip SS, Klausner JD. Rectal gonorrhea and chlamydia reinfection is associated with increased risk of HIV seroconversion. J Acquir Immune Defic Syndr 2010; 53: 537–43. [DOI] [PubMed] [Google Scholar]
  • 29.Horn T, Sherwood J, Remien RH, Nash D, Auerbach JD. Towards an integrated primary and secondary HIV prevention continuum for the United States: A cyclical process model. J Int AIDS Soc 2016; 19: 21263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Georgia Department of Public Health, HIV/AIDS Epidemiology Section. HIV Surveillance Summary, Georgia 2017. 2019. https://dph.georgia.gov/data-fact-sheet-summaries (accessed April 20, 2020).
  • 31.Little SJ, McLean AR, Spina CA, Richman DD, Havlir DV. Viral dynamics of acute HIV-1 infection. J Exp Med 1999; 190: 841–850. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Jenness SM, Maloney KM, Smith DK, et al. Addressing Gaps in HIV Preexposure Prophylaxis Care to Reduce Racial Disparities in HIV Incidence in the United States. Am J Epidemiol 2019; 188: 743–752. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Centers for Disease Control and Prevention. Preexposure prophylaxis for the prevention of HIV infection in the United States-2017 Update: A Clinical Practice Guideline. 2017. https://www.cdc.gov/hiv/pdf/risk/prep/cdc-hiv-prep-guidelines-2017.pdf.
  • 34.Kelley CF, Kahle E, Siegler A, et al. Applying a PrEP Continuum of Care for Men who Have Sex with Men in Atlanta, GA. Clin Infect Dis 2015; 61: 1590–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Liu AY, Cohen SE, Vittinghoff E, et al. Preexposure Prophylaxis for HIV Infection Integrated With Municipal- and Community-Based Sexual Health Services. JAMA Intern Med 2016; 176: 75–84. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Chan PA, Mena L, Patel R, et al. Retention in care outcomes for HIV pre-exposure prophylaxis implementation programmes among men who have sex with men in three US cities. J Int AIDS Soc 2016; 19: 20903. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Chesson HW, Pinkerton SD. Sexually transmitted diseases and the increased risk for HIV transmission: Implications for cost-effectiveness analyses of sexually transmitted disease prevention interventions. J Acquir Immune Defic Syndr 2000; 24: 48–56. [DOI] [PubMed] [Google Scholar]
  • 38.Kent CK, Chaw JK, Wong W, et al. Prevalence of rectal, urethral, and pharyngeal chlamydia and gonorrhea detected in 2 clinical settings among men who have sex with men: San Francisco, California, 2003. Clin Infect Dis 2005; 41: 67–74. [DOI] [PubMed] [Google Scholar]
  • 39.Golden MR, Schillinger JA, Markowitz L, St Louis ME. Duration of untreated genital infections with chlamydia trachomatis: a review of the literature. Sexually transmitted diseases 2000; 27: 329–37. [DOI] [PubMed] [Google Scholar]
  • 40.Toni T, Welch D, Strelkowa N, et al. Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. J R Soc Interface 2009; 6: 187–202. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Grey JA, Bernstein KT, Sullivan PS, et al. Estimating the Population Sizes of Men Who Have Sex With Men in US States and Counties Using Data From the American Community Survey. JMIR Public Health Surveill 2016; 2: e14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Rosenberg ES, Grey JA, Sanchez TH, Sullivan PS. Rates of Prevalent HIV Infection, Prevalent Diagnoses, and New Diagnoses Among Men Who Have Sex With Men in US States, Metropolitan Statistical Areas, and Counties, 2012–2013. JMIR Public Health Surveill 2016; 2: e22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.New York City Department of Health and Mental Hygiene. Safer Sex and COVID-19. 2020. https://www1.nyc.gov/assets/doh/downloads/pdf/imm/covid-sex-guidance.pdf.
  • 44.National Coalition of STD Directors. Sex and COVID-19: Frequently Asked Questions. National Coalition of STD Directors, 2020. https://www.nastad.org/resource/sex-and-covid-19 (accessed Sept 29, 2020).
  • 45.Marcus J. Americans Aren’t Getting the Advice They Need. The Atlantic. 2020; published online May 28. https://www.theatlantic.com/ideas/archive/2020/05/no-one-telling-americans-how-reopen-their-lives/612172/ (accessed Sept 29, 2020).

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement 1
media-1.pdf (1.1MB, pdf)

Articles from medRxiv are provided here courtesy of Cold Spring Harbor Laboratory Preprints

RESOURCES