Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2016 Jan 31.
Published in final edited form as: J Acquir Immune Defic Syndr. 2015 Feb 1;68(2):241–244. doi: 10.1097/QAI.0000000000000423

Illustration of a measure to combine viral suppression and viral rebound in studies of HIV therapy

Jessie K Edwards 1, Stephen R Cole 1, Adaora Adimora 2, Jason Fine 3, Jeff Martin 4, Joseph Eron 2
PMCID: PMC4294958  NIHMSID: NIHMS640879  PMID: 25415292

Abstract

Viral load is an important tool for assessing antiretroviral treatment efficacy. However, the most common viral load endpoint, virologic failure, may be flawed. We illustrate an alternative endpoint that estimates the average time patients spent suppressed prior to rebound in the AIDS Clinical Trials Group A5095 trial. Patients averaged 644 days suppressed in the 3-drug arm and 686 days suppressed in the 4-drug arm, for a difference of 42 days in favor of the 4-drug regimen (95% CI: −11, 96). These results agree with results using virologic failure as the endpoint but better emphasize the separate suppression and rebound processes.

Introduction

Plasma HIV-1 RNA (henceforth, viral load) is an important biomarker to monitor infection and to assess the prognosis of patients with HIV. Clinicians use measurements of viral load together with CD4 cell count, symptoms, and AIDS-defining illnesses to inform treatment decisions and assess the efficacy of a given antiretroviral treatment (ART) regimen 1.

Viral load is also an important measure for researchers wishing to describe effects of a treatment over time or to compare effects of treatment regimens 2. Perhaps the most commonly used endpoint to compare the efficacy of treatment plans is the time to “virologic failure” 37. The time to virologic failure for patients whose viral load is not suppressed by a predetermined time during the study period is often set to that predetermined time 5,6 or time zero 8. In addition, studies using virologic failure as an endpoint often ignore viremia prior to suppression by measuring the time to virologic failure as the time from study onset to viral rebound 7.

Gouskova et al 9 formalized an alternative endpoint based on multistate methods 10 that uses information on time to both viral load suppression and rebound to estimate the probability of being suppressed as a function of time from study onset. Here, we provide an illustrative example in which we estimate this measure to compare the efficacy of two treatment regimens in a randomized trial.

Methods

We compare this alternative endpoint between treatment arms in publicly-available de-identified data from the AIDS Clinical Trials Group A5095 trial 6 conducted between March 2001 and March 2005. Briefly, 1125 therapy-naïve patients infected with HIV-1 were randomized to one of 3 arms: a triple-nucleoside regimen (zidovudine, lamivudine, and abacavir), a 3-drug standard of care regimen with efavirenz (zidovudine, lamivudine, and efavirenz), or a 4-drug regimen with efavirenz (zidovudine, lamivudine, abacavir, and efavirenz). We limit the analysis to patients randomized to the 3- and 4-drug efavirenz- containing regimens (as did Gulick et al 6) because the triple-nucleoside group was discontinued. Data for 761 of the 765 patients in the 3- and 4-drug arms were available in the public-use dataset. Treatment was initiated at randomization. Study visits were conducted at weeks 2, 4, 8, 12, 16, 20, 24, and then every 8 weeks, and viral load was measured at each study visit. Here we perform an intent-to-treat analysis in which we estimate the effect of being randomized to a specific treatment regimen, rather than the effect of the actual treatment received.

Patients were followed from randomization until viral rebound or censoring at time of death, loss to follow-up, or 1012 days. A patient is considered lost to follow-up if his last visit was before day 1012 and he had not yet experienced viral rebound or death.. Following Gulick 6, a patient’s viral load was “suppressed” if it was below 200 copies/mL, and a patient was considered to have experienced viral rebound if his viral load rose above 200 copies/mL after dropping below this threshold. Alternative thresholds for suppression and rebound could be chosen. We assume that viral load was unsuppressed until the first viral load measurement in which viral load was suppressed (and likewise for viral rebound).

To summarize treatment effects, we compare the mean time patients spend in a state of viral suppression in each trial arm 9. We define a patient to be in a “state of viral suppression” after initial viral suppression and prior to first viral rebound. To estimate this outcome measure for one treatment arm, we begin by estimating the probability of being in a state of suppression at each time point. Specifically, being suppressed at time t requires that a patient has already experienced viral suppression by time t, but not yet experienced viral rebound. Accordingly, the probability of being in a state of suppression can be denoted by G(t) and estimated for each treatment arm x as G^x(t)=S^xR(t)-S^xS(t), where S^xR(t) is the product limit estimator of the Kaplan-Meier survivor function for rebound for treatment arm X = x and S^xS(t) is the survivor function for initial viral suppression for that treatment arm. Note that S^xR(t) will always be greater than S^xS(t) because, by definition, a patient’s viral load cannot rebound before it is suppressed below the threshold value. The quantity Ĝx(t) has the intuitive interpretation as the proportion of patients in treatment arm x who have not yet rebounded, excluding those who have not yet initially suppressed. This measure can be summarized as the τ -restricted mean time spent in a state of suppression (prior to rebound) by integrating Ĝx(t) over the study period τ. Because the survivor functions can change at most once per day, the mean time suppressed over the 1012-day follow-up period for treatment arm x can be calculated as the Riemann sum A(x)=k=11012Gx(tk). The components of this measure for each arm can be seen in figure 1.

Figure 1.

Figure 1

Illustration of the survival curve for suppression a (solid line), the survival curve for rebound (dashed line), and the restricted mean time spent in a state of suppression b for 380 patients in the 3-drug arm (panel A) and 381 patients in the 4-drug arm (panel B) of the ACTG A5095 trial over 1012 days of follow-up

aThe survival curves for initial viral suppression, S^0S(t), and viral rebound, S^0R(t) were estimated using the Kaplan-Meier product limit estimator of the survivor function. Details are provided in the Supplemental Digital Content: Appendix

bThe restricted mean number of days spent in a state of suppression (i.e., time after initial suppression and prior to viral rebound) over the 1012-day follow-up period for each arm was estimated as A(x)=k=01012Gx(tk) where G^x(t)=S^xR(t)-S^xS(t)

The difference in mean time spent in a state of suppression can compared between treatment regimens, with inference based on the closed-form equation for the variance presented in Supplemental Digital Content: Appendix 1 or a nonparametric bootstrap. Additional technical details and SAS computer code are provided in Appendices 1 and 2.

Results

The 761 participants were 81% male, had a mean age of 37, and were predominantly white (41%) or black (35%). The prevalence of hepatitis C virus was 10% and the prevalence of hepatitis B virus was 3%. Demographic characteristics were similar between the 380 patients in the 3-drug arm and the 381 patients in the 4-drug arm.

Over the 1012 days of follow-up, 12 patients died (8 in the 3-drug arm and 4 in the 4-drug arm) and 236 patients became lost to follow-up (111 in the 3-drug arm and 125 in the 4-drug arm). Over the course of follow-up, 356 patients in the 3-drug arm (93.7%) and 354 patients in the 4-drug arm (92.9%) responded to treatment by suppressing their HIV-1 RNA viral load below 200 copies/mL at one or more time points. The median time from randomization to initial viral load suppression was 56 days in both groups. During the course of follow-up, 121 patients in the 3-drug arm and 112 patients in the 4-drug arm experienced viral rebound after initial viral suppression. The probability of being in a state of suppression prior to rebound at each time during follow-up, Gx(t), can be seen for both arms in Figure 2. Over the 1012-day follow-up period, the average number of days suppressed prior to rebound was 644 in the 3-drug arm and 686 in the 4-drug arm, for a difference of 42 days in favor of the 4-drug regimen (95% CI: −11, 96).

Figure 2.

Figure 2

Probability of being in a state of suppression prior to viral rebound, Gx(t), for 380 patients in the 3-drug arm and 381 patients in the 4-drug arm of the ACTG A5095 trial over 1012 days of follow-up

Discussion

Using the proposed endpoint, we have demonstrated that the 4-drug regimen conferred a slight benefit over the 3-drug regimen in terms of number of days spent in a state of viral suppression without viral rebound. These results agree with an existing study using virologic failure as the endpoint 6, which noted that the time to virologic failure, defined as the first of two successive viral load measurements above 200 copies/mL after 16 weeks, was not significantly longer in the 4-drug arm. However, the particular advantages of the 4-drug regimen regarding time to initial suppression and rebound are seen more readily using the proposed approach.

In addition to providing an endpoint that is readily interpretable and simple to communicate, the proposed approach avoids several pitfalls associated with using virologic failure as an endpoint. For example, virologic failure is sometimes defined as the time to the first viral load measurement over 200 copies/mL at or after 16 weeks from randomization 5,6. Under this definition, the time to virologic failure is set to the ad hoc time point of 16 weeks if the patient fails to respond to treatment by achieving a suppressed viral load by that time. When the event of interest is virologic failure, the event pool is a mixture of 2 distinct types of events: patients who have experienced virologic suppression and then rebound, and patients who did not achieve virologic suppression on or before the cut point. Such a composite endpoint fails to keep inferences distinct between these event types. For example, use of virologic failure as a composite endpoint hides differences in early suppression dynamics between treatment arms. Similarly, differences in the time to suppression are hidden if the time to virologic failure is estimated as the time from suppression to rebound only among patients who suppress.

The approach to measuring viral suppression illustrated here is based on the probability of being suppressed over time using ideas from multistate models developed for multiple time-to-event endpoints10. As formalized by Gouskova et al. 9, this approach can be extended to incorporate a time-varying weight to place greater importance on the probability of suppression at any time window during follow-up. For example, the weights can be used to improve precision by down weighting time points when the probability difference is highly variable (e.g., by applying a weight of 1/standard-error of the probability difference at each time point). Alternatively, weights can be used to tailor the analysis to research questions emphasizing outcomes at certain time windows. For example, if replication ceases at treatment initiation for both treatment arms, and the time to suppression is merely a function of the size and composition of a patient’s viral reservoir 1113, early differences in time spent in a state of suppression may be clinically less important than differences at later times. In this scenario, the investigator could down-weight the differences in the probability of suppression at these early time points to focus the analysis on differences in the probability of suppression after some clinically relevant time-point. When weights are set to 1 for all time points, as in the example presented here, the integral of the difference in the probability of suppression over time has the intuitive interpretation of the difference in the restricted mean number of days suppressed prior to rebound between treatment arms.

We have used this approach to compare the mean number of days spent in a state of suppression between arms of a randomized trial. This approach could also be used to compare suppression between exposure groups in observational studies using inverse probability weights14,15 or the parametric g-formula 16,17 to account for confounding by measured variables. Extensions of this approach to observational studies would allow this endpoint to be used when examining the effects of exposures that are unlikely to be randomized. In addition, while we define a patient to be in a state of viral suppression after initial viral suppression and prior to first viral rebound, this approach can be extended to allow for multiple cycles of suppression and rebound.

HIV-1 RNA viral load remains an important outcome measure in HIV randomized trials and observational studies. We have illustrated an endpoint that uses information on the time to viral suppression and time to subsequent viral rebound to provide a single summary measure of the mean time spent in a state of viral suppression before viral rebound in each treatment arm. This endpoint is well defined, has an appealing graphical representation, and facilitates straightforward comparisons of treatment effects between studies.

Supplementary Material

Supplemental Digital Content

Acknowledgments

Sources of Support

Supported in part by the National Institutes of Health [NIH R01AI100654, NIH R24AI067039, NIH U01AI103390, NIH P30AI027763, and NIH P30AI50410].

Footnotes

Conflicts of Interest:

The authors declare no conflicts of interest.

References

  • 1.Mellors JW. Plasma Viral Load and CD4+ Lymphocytes as Prognostic Markers of HIV-1 Infection. Ann Intern Med. 1997;126(12):946. doi: 10.7326/0003-4819-126-12-199706150-00003. [DOI] [PubMed] [Google Scholar]
  • 2.Cole SR, Hernán Ma, Anastos K, Jamieson BD, Robins JM. Determining the effect of highly active antiretroviral therapy on changes in human immunodeficiency virus type 1 RNA viral load using a marginal structural left-censored mean model. Am J Epidemiol. 2007;166(2):219–27. doi: 10.1093/aje/kwm047. [DOI] [PubMed] [Google Scholar]
  • 3.Gilbert PB, Ribaudo HJ, Greenberg L, et al. Considerations in choosing a primary endpoint that measures durability of virological suppression in an antiretroviral trial. AIDS. 2000;14(13):1961–72. doi: 10.1097/00002030-200009080-00012. [DOI] [PubMed] [Google Scholar]
  • 4.Ribaudo HJ, Kuritzkes DR, Schackman BR, Acosta EP, Shikuma CM, Gulick RM. Design issues in initial HIV-treatment trials: focus on ACTG A5095. Antivir Ther. 2006;11(6):751–60. [PubMed] [Google Scholar]
  • 5.Gulick RM, Ribaudo HJ, Shikuma CM, et al. Triple-nucleoside regimens versus efavirenz-containing regimens for the initial treatment of HIV-1 infection. N Engl J Med. 2004;350(18):1850–61. doi: 10.1056/NEJMoa031772. [DOI] [PubMed] [Google Scholar]
  • 6.Gulick RM, Ribaudo HJ, Shikuma CM, et al. Three- vs Four-Drug Antiretroviral Regimens for the Initial Treatment of HIV-1 Infection. J Am Med Assoc. 2006;296(7) doi: 10.1001/jama.296.7.769. [DOI] [PubMed] [Google Scholar]
  • 7.Riddler SA, Haubrich R, DiRienzo AG, et al. Class-sparing regimens for initial treatment of HIV-1 infection. N Engl J Med. 2008;358(20):2095–106. doi: 10.1056/NEJMoa074609. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.U.S. Department of Health and Human Services Food and Drug Administration Center for Drug Evaluation and Research (CDER) Guidance for industry: Antiretro- viral drugs using plasma HIV RNA measurements—Clinical considerations for accelerated and traditional approval. Oct, 2002. [Google Scholar]
  • 9.Gouskova NA, Cole SR, Eron JJ, Fine JP, Carolina N. Viral Suppression in HIV Studies: Combining Times to Suppression and Rebound. Biometrics. 2014 doi: 10.1111/biom.12140. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Pepe MS. Inference for events with dependent risks in multiple endpoint studies. J Am Stat Assoc. 1991;86(415):770–778. [Google Scholar]
  • 11.Kilby JM, Lee HY, Hazelwood JD, et al. Treatment response in acute/early infection versus advanced AIDS: equivalent first and second phases of HIV RNA decline. AIDS. 2008;22(8):957–62. doi: 10.1097/QAD.0b013e3282fbd1da. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Markowitz M, Louie M, Hurley A, et al. A Novel Antiviral Intervention Results in More Accurate Assessment of Human Immunodeficiency Virus Type 1 Replication Dynamics and T-Cell Decay In Vivo. J Virol. 2003;77(8):5037–5038. doi: 10.1128/JVI.77.8.5037-5038.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Andrade A, Rosenkranz SL, Cillo AR, et al. Three distinct phases of HIV-1 RNA decay in treatment-naive patients receiving raltegravir-based antiretroviral therapy: ACTG A5248. J Infect Dis. 2013;208(6):884–91. doi: 10.1093/infdis/jit272. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Robins JM, Hernán MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000;11(5):550–60. doi: 10.1097/00001648-200009000-00011. [DOI] [PubMed] [Google Scholar]
  • 15.Westreich D, Cole SR, Tien PC, et al. Time scale and adjusted survival curves for marginal structural cox models. Am J Epidemiol. 2010;171(6):691–700. doi: 10.1093/aje/kwp418. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Westreich D, Cole SR, Young JG, et al. The parametric g-formula to estimate the effect of highly active antiretroviral therapy on incident AIDS or death. Stat Med. 2012;31(18):2000–9. doi: 10.1002/sim.5316. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Keil A, Edwards JK, Richardson DB, Naimi AI, Cole SR. The Parametric g-Formula for Time-to-event Data Intuition and a Worked Example. Epidemiology. 2014 doi: 10.1097/EDE.0000000000000160. In press. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplemental Digital Content

RESOURCES