Abstract
Wild-type viruses from the ViroLogic phenotype-genotype database were evaluated to determine the upper confidence limit of the drug susceptibility distributions, or “biological cutoffs,” for the PhenoSense HIV phenotypic drug susceptibility assay. Definition of the natural variation in drug susceptibility in wild-type human immunodeficiency virus (HIV) type 1 isolates is necessary to determine the prevalence of innate drug resistance and to assess the capability of the PhenoSense assay to reliably measure subtle reductions in drug susceptibility. The biological cutoffs for each drug, defined by the 99th percentile of the fold change in the 50% inhibitory concentration distributions or the mean fold change plus 2 standard deviations, were lower than those previously reported for other phenotypic assays and lower than the clinically relevant cutoffs previously defined for the PhenoSense assay. The 99th percentile fold change values ranged from 1.2 (tenofovir) to 1.8 (zidovudine) for nucleoside reverse transcriptase RT inhibitors (RTIs), from 3.0 (efavirenz) to 6.2 (delavirdine) for nonnucleoside RTIs, and from 1.6 (lopinavir) to 3.6 (nelfinavir) for protease inhibitors. To evaluate the potential role of intrinsic assay variability in the observed variations in the drug susceptibilities of wild-type isolates, 10 reference viruses with different drug susceptibility patterns were tested 8 to 30 times each. The median coefficients of variation in fold change for the reference viruses ranged from 12 to 18% for all drugs except zidovudine (32%), strongly suggesting that the observed differences in wild-type virus susceptibility to the different drugs is related to intrinsic virus variability rather than assay variability. The low biological cutoffs and assay variability suggest that the PhenoSense HIV assay may assist in defining clinically relevant susceptibility cutoffs for resistance to antiretroviral drugs.
The use of antiretroviral drug therapy has greatly improved the long-term clinical outcome for human immunodeficiency virus (HIV) type 1 (HIV-1)-infected individuals (18). However, loss of suppression of viral replication is often accompanied by the emergence of drug-resistant HIV-1 in treated patients (21). This complicates the selection of drugs for second- or third-line regimens, as cross-resistance within drug classes is a common phenomenon (11, 24). The use of phenotypic and genotypic assays for the detection and quantification of drug resistance is considered the standard of care when designing drug regimens following treatment failure (13a, 23). Retrospective and prospective studies have demonstrated the benefit of using such assays to guide the selection of treatment regimens that include a greater number of drugs to which the virus is susceptible [1, 5, 7-9, 15, 22; R. Haubrich, P. Keiser, C. Kemper, M. Witt, J. Leedom, D. Forthal, M. Leibowitz, J. Hwang, E. Seefried, J. A. McCutchan, N. Hellmann, D. Richman, and CCTG, Antivir. Ther. 6(Suppl. 1):63, 2001, abstr.].
Phenotypic drug susceptibility is measured as the concentration of drug required to inhibit virus replication by 50% (IC50) and is commonly expressed as the fold change (FC) in the IC50 between that for the patient virus and that for a well-characterized drug-sensitive reference virus (FC = IC50 for patient virus/IC50 for reference virus). The interpretation of phenotypic susceptibility assay results is enhanced by relevant thresholds, or cutoffs, that are intended to define the point above which the utility of a given drug begins to decline. Clinical cutoffs based on virologic response data from clinical trials provide the most clinically relevant threshold but are also the most difficult to define. To date, clinical cutoffs for the PhenoSense HIV assay have been defined for seven drugs [16; Haubrich et al., Antivir. Ther. 6(Suppl. 1):63, 2001, abstr.; E. R. Lanier, N. Hellmann, and J. Scott, Abstr. 8th Conf. Retrovir. Opportunist. Infect., abstr., 254, 2001; M. D. Miller, L. Zhong, S. Chen, N. A. Margot, and M. Wulfsohn, Antivir. Ther. 7(Suppl. 1):S12, 2000, abstr.; G. Skowron, J. Whitcomb, M. Wesley, C. Petropoulos, N. Hellmann, M. Holodniy, J. Kolberg, J. Detmer, M. T. Wrin, and K. Frost, Antivir. Ther. 4(Suppl. 1):55-56, 1999, abstr.; J. Szumiloski, H. Wilson, E. Jensen, R. Campo, N. Miller, H. Rice, A. Zolopa, D. Klein, M. Horberg, M. Coram, N. Hellmann, M. Bates, and J. H. Condra, Antivir. Ther. 7(Suppl. 1):S127, 2002, abstr.]: abacavir (4.5-fold), tenofovir (1.4-fold), stavudine (1.7-fold), didanosine (1.7-fold), lamivudine (3.5-fold), ritonavir-boosted lopinavir (10-fold), and ritonavir-boosted indinavir (10-fold). In the absence of clinical cutoffs, two alternative types of cutoffs have been used. The assay cutoff is defined by the intrinsic variability and technical limits of the assay during repeated testing of patient-derived viruses. The biological cutoff is defined by an upper limit of the distribution of susceptibility exhibited by wild-type viruses. Harrigan et al. (13), using the AntiVirogram assay, defined the biological cutoff as the mean FC plus 2 standard deviations (SDs) among a population of viruses from 1,000 drug-naïve patients. The use of the biological cutoff as a clinically relevant threshold is limited, since a higher or a lower FC value may be associated with declining virological responses. Importantly, the biological cutoff reflects both natural variations in viral susceptibility and inherent assay variability. Thus, such cutoffs may differ among assays that have different intrinsic variabilities.
The range in FC observed among viruses from treatment-experienced patients varies for different drugs and is considerably narrower for some drugs than for others. For example, FC values over 10-fold are much less common for stavudine, didanosine, and tenofovir than for zidovudine, lamivudine, or the nonnucleoside reverse transcriptase (RT) inhibitors (NNRTIs), for which FC values over 100 are often seen. The clinical cutoffs for these drugs (stavudine, didanosine, and tenofovir) are also low (FC < 2). Thus, definition of the natural variation in drug susceptibility in wild-type viruses is necessary to determine the prevalence of innate drug resistance and to assess the capability of the assay to reliably measure subtle reductions in drug susceptibility. In this study, we sought to describe the variability in drug susceptibility in wild-type viruses and to assess the contribution of assay variability to the defined biological cutoffs.
MATERIALS AND METHODS
Phenotypes and genotypes were determined in the Clinical Laboratory Improvement Amendments-approved ViroLogic clinical reference laboratory (ViroLogic, Inc., South San Francisco, Calif.). The drug susceptibility phenotypes of HIV-1 isolates from patient plasma samples was determined by the PhenoSense HIV assay (20). This assay is performed by amplifying the protease (PR)-RT segment of the pol gene from patient plasma and inserting it into a genomic HIV-1 vector. The vector contains a luciferase reporter gene to monitor recombinant virus infection in cell culture. Results are expressed as the FC in the IC50 for the patient-derived virus compared to that for a reference control virus, NL4-3. Assay techniques have been optimized to minimize variability, and assay performance has been extensively validated (ViroLogic, data on file). Several recent modifications have further enhanced assay performance. Drug dilutions are arranged to maximize curve-fitting accuracy for the range of wild-type virus susceptibilities and over clinically relevant ranges of increased and decreased susceptibilities. Microtiter plates are incubated in customized incubators in which the temperature, CO2 level, and humidity are controlled to minimize variation in cell growth and medium composition changes throughout the plate (i.e., edge effects).
Genotypes were determined by the GeneSeq HIV assay. This assay uses the resistance test vectors constructed for the phenotype assay as the template, dye-terminator reaction chemistry, and automated capillary electrophoresis to determine the sequences of the patient-derived HIV-1 PRs and RTs (amino acids 1 to 99 in PR and amino acids 1 to 305 in RT). The electropherograms were analyzed and reviewed by trained clinical laboratory personnel to detect all mutations, mixed bases, insertions, and deletions. The deduced amino acid sequences of patient viruses were compared to the sequence of a reference virus strain (strain NL4-3; GenBank accession no. AF324493). In assay validation studies, the GeneSeq HIV assay detected minor virus populations in plasma samples present at concentrations as low as 10% of the total virus population (ViroLogic, GeneSeq HIV validation data on file).
ViroLogic maintains a database of phenotype and genotype results for all patient viruses submitted to the clinical reference laboratory for phenotypic and genotypic testing. Prior to analysis, repeat samples from the same patient were removed on the basis of coded unique identifiers. To avoid inclusion of resistant viruses transmitted to drug-naïve individuals (17), wild-type viruses were defined as any virus lacking a drug-selected mutation (DSM) in either PR or RT. Any amino acid substitution at the following positions in PR was considered a DSM: 23, 24, 30, 32, 46, 47, 48, 50, 54, 84, 88, and 90. In addition, L33F and V82A, V82F, V82S, or V82T were considered DSMs. Any substitution at the following positions in RT was considered a DSM: 41, 65, 67, 69, 70, 74, 75, 100, 151, 181, 184, 188, 190, 210, 215, 219, 225, 227, 230, and 236. In addition, A98G, K101E or K101P, K103N or K103S, and V106A or V106M were considered DSMs (2, 6, 14, 19). The data set primarily comprises subtype B HIV-1 isolates from the United States but also contains 7% non-clade B virus isolates. The number of non-B clade isolates and isolates from outside the United States was too small to permit meaningful subanalyses by clade or country of origin. FC data were log transformed and analyzed by using Statview (version 5.0) software (SAS, Inc., Cary, N.C.) to characterize the distribution of FC values for each drug. Two alternative definitions for the biological cutoff were used: the mean FC plus 2 SDs (calculated by using the log-transformed data) or the 99th percentile of the FC distribution.
Genotypic correlates of reduced susceptibility were determined for certain drugs (delavirdine and nelfinavir) with broader FC distributions among wild-type viruses by using the Fisher exact test after categorization of samples on the basis of phenotype (categorization as “high” if the FC was over the threshold or “low” if the FC was below the threshold) and genotype (categorization as “mutant” if a given mutation was present or “wild type” if the mutation was absent). An arbitrary phenotypic threshold corresponding to the 90th percentile of the FC distribution for a drug was selected to define a high FC in order to provide sufficient numbers of samples in that phenotypic category. Mixtures of wild-type and mutant variants were scored as mutants. Odds ratios to define the strength of association between a mutation and isolates for which FC were high were calculated as the fraction of isolates for which FC were high and which bore a certain mutation divided by the fraction of isolates for which FC were low and which bore the mutation. Mutations for which the odds ratios (ORs) were >1.5 and the P value was <0.05 by the Fisher exact test were considered significant.
To determine assay reproducibility, 10 clonal viruses (whole-assay controls [WACs]) with diverse patterns of drug resistance mutations (Table 1) were tested repeatedly through the entire assay. Each WAC represents a single variant derived from a clinical plasma sample. WAC viral stocks were prepared by transfecting HEK293 cells with WAC vector DNA, harvesting the cell culture supernatant after 48 h, and treating the virus stocks with DNase I. An aliquot of each virus stock was added to HIV-negative human plasma and then processed through the entire PhenoSense HIV assay multiple times on different days. The mean FC and coefficient of variation (CV) for each WAC were calculated for each drug. CVs were not determined when the IC50 for the WAC virus exceeded the highest drug concentration tested in the assay.
TABLE 1.
WAC virus genotypes (resistance-associated mutations)
WAC virus | PR mutation(s) | RT mutations |
---|---|---|
1 | L10I, M46I, F53L, L63P, A71V, G73S, V82T, L90M | M41L, A62V, T69SSA, L74V, M184V, L210W, T215Y |
3 | L63P | A62V, V75I, F77L, F116Y, Q151M, M184V |
5 | D30N, M46I, V77I | M41L, M184V, T215Y |
6 | L10I, K20I, M36I, I54V, L63P, A71V, V82T | D67N, T69D, K70R, V106A, T215F, K219Q, F227L |
7 | L10V, M36I, F53L, L63P, V82A | M41L, D67N, V118I, L210W, T215Y |
8 | L10I, K20I, M36I, I54V, L63P, A71V, V82T, L90M | D67N, T69D, K70R, Y181C, T215F, K219Q, F227L |
10 | L10F, D30N, L63P, V77I, N88D | M41L, D67N, K70R, K103N, M184V, T215Y, K219E |
11 | V32I, M46I, L63P, A71V, V77I, V82A | K103N, M184V |
13 | L10I, K20I, M46I, L63P, G73T, L90M | M41L, D67N, V75M, L210W, T215Y |
15 | L10I, L24I, M46I, F53L, L63P, A71V, V77I, V82T, I84V | M41L, E44D, D67N, M184V, L210W, T215Y, K219E |
RESULTS
Phenotypic drug susceptibility and PR and RT genotype data for 2,924 wild-type HIV-1 test vector pools were included in the analyses (data for all drugs were not available for all isolates) (Table 2). The viruses were derived from patient plasma samples submitted for either routine resistance testing or research studies and were collected between September 1985 and March 2003. The great majority (96%) of the samples were collected between 1999 and 2003.
TABLE 2.
Median drug susceptibilities by FC and IC50 for wild-type viruses and upper biological cutoffs as defined by two separate criteriaa
Drugb | Median FC | Mean + 2 SD FC | 99th percentile FC | Median IC50c | Mean + 2 SD IC50 | 99th percentile IC50 | No. of viruses |
---|---|---|---|---|---|---|---|
ZDV | 0.8 | 1.6 | 1.8 | 0.02 | 0.04 | 0.05 | 2,924 |
3TC | 0.9 | 1.5 | 1.6 | 2.4 | 4.2 | 4.4 | 2,923 |
ddI | 0.9 | 1.3 | 1.3 | 5.0 | 8.0 | 8.1 | 2,923 |
ddC | 0.9 | 1.3 | 1.3 | 0.8 | 1.4 | 1.5 | 2,896 |
d4T | 0.9 | 1.3 | 1.4 | 0.5 | 0.8 | 0.9 | 2,923 |
ABC | 0.8 | 1.3 | 1.3 | 1.6 | 2.6 | 2.8 | 2,923 |
TDF | 0.8 | 1.1 | 1.2 | 0.7 | 1.1 | 1.1 | 2,536 |
NVP | 0.9 | 3.0 | 4.5 | 0.09 | 0.31 | 0.47 | 2,923 |
DLV | 1.2 | 4.5 | 6.2 | 0.04 | 0.17 | 0.23 | 2,896 |
EFV | 0.8 | 2.2 | 3.0 | 1.6 | 4.5 | 5.8 | 2,924 |
APV | 0.7 | 1.8 | 2.0 | 11 | 30 | 33 | 2,923 |
IDV | 0.8 | 1.8 | 2.1 | 5.2 | 12 | 14 | 2,922 |
NFV | 1.0 | 2.9 | 3.6 | 4.8 | 14 | 18 | 2,922 |
RTV | 0.8 | 2.1 | 2.5 | 14 | 37 | 46 | 2,922 |
SQV | 0.7 | 1.5 | 1.7 | 2.2 | 4.5 | 5.4 | 2,923 |
LPV | 0.7 | 1.5 | 1.6 | 3.0 | 7.1 | 8.1 | 2,381 |
The two criteria are the mean FC plus 2 SDs and the 99th percentiles of the log-transformed distributions.
Drug abbreviations: ZDV, zidovudine; 3TC, lamivudine; ddI, didanosine; ddC, zalcitabine; d4T, stavudine; ABC, abacavir; TDF, tenofovir; NVP, nevirapine; DLV, delavirdine; EFV, efavirenz; APV, amprenavir; IDV, indinavir; NFV, nelfinavir; RTV, ritonavir; SQV, saquinavir; LPV, lopinavir.
Units for IC50 are micromolar for the NRTIs, NVP, and DLV and nanomolar for EFV and PIs.
Histograms of log-transformed FC values for each drug (except zalcitabine, for which the distribution was similar to that for didanosine) are shown in Fig. 1 (RT inhibitors) and Fig. 2 (PR inhibitors [PIs]). FC values were essentially log-normally distributed (the normal curve is shown for reference). The median FC for each drug as well as the corresponding IC50 is shown in Table 2. The median FC was below 1 for several drugs, particularly the PIs, indicating that many wild-type viruses are slightly more susceptible than the NL4-3 reference virus. Two alternative definitions for biological cutoff are presented: the mean FC plus 2 SDs or the 99th percentile of the FC distribution (Table 2). The former permits comparison to data from other phenotypic assays (12, 13), while the latter provides a more conservative estimate of the upper limits of the distributions (i.e., the 99th percentile FC values are always higher than the mean FC plus 2 SD values). In the nucleoside or nucleotide RTI (NRTI) class, the 99th percentile values ranged from 1.2-fold for tenofovir to 1.8-fold for zidovudine. Wider distributions were observed for the NNRTIs, with 99th percentile values ranging from 3.0-fold for efavirenz to 6.2-fold for delavirdine. The FC distributions for PIs were intermediate, with 99th percentile values ranging from 1.6-fold for lopinavir to 3.6-fold for nelfinavir.
FIG. 1.
Histograms of FC values for RT inhibitors for wild-type viruses obtained by the PhenoSense HIV assay. The FC in IC50 were log transformed and divided into 50 bins. The theoretical normal distribution curves are shown for comparison. The vertical lines represent FC of 1.0. See Table 2 for the numbers of samples included and the statistical parameters for each drug, and see footnote b of Table 2 for definitions of the drug abbreviations.
FIG. 2.
Histograms of FC values for PIs for wild-type viruses obtained by the PhenoSense HIV assay. The FC in IC50 were log transformed and divided into 50 bins. The theoretical normal distribution curves are shown for comparison. The vertical lines represent FC of 1.0. See Table 2 for the numbers of samples included and the statistical parameters for each drug, and see footnote b of Table 2 for definitions of the drug abbreviations.
Univariate analyses were performed to determine the genotypic correlates of phenotypic FC values above the 90th percentile of the distribution for two drugs with the broadest FC distributions: nelfinavir (2.0-fold) and delavirdine (2.6-fold). Eleven mutations were significantly associated with elevated FC values for nelfinavir (Table 3). Five of these mutations are recognized secondary PI resistance mutations that also exist as natural polymorphisms (L10I and L10V, A71V and A71T, and V77I). Another mutation associated with reduced nelfinavir susceptibility, Q61N, is often found in subtype F HIV-1 (4, 10), indicating that clade F HIV-1 may possess natural reductions in NFV susceptibility. Twelve mutations (K49R, A98S, K101Q, V108I, I135L, I135T, I142T, I142V, I178L, V179D, V179E, and V179I) were associated with elevated FC values for delavirdine (data not shown), including polymorphisms at positions 98, 101, 108, 135, and 179, which have previously been suggested to play a role in determining NNRTI susceptibility (3, 19).
TABLE 3.
Mutations associated with reduced susceptibility to nelfinavira
Isolates with mutation
|
Mean FC
|
|||||||
---|---|---|---|---|---|---|---|---|
Mutation | No. of isolates | % Isolates withb:
|
ORc | P valued | Mutant | Wild type | P valuee | |
High FC | Low FC | |||||||
L10I | 214 | 14.4 | 6.5 | 2.2 | <0.0001 | 1.47 | 1.15 | <0.0001 |
L10V | 77 | 6.2 | 2.2 | 2.8 | 0.0002 | 1.46 | 1.17 | 0.0014 |
R57K | 402 | 20.6 | 12.9 | 1.6 | 0.0004 | 1.33 | 1.15 | <0.0001 |
D60E | 210 | 13.7 | 6.4 | 2.1 | <0.0001 | 1.52 | 1.15 | <0.0001 |
Q61N | 31 | 2.6 | 0.9 | 3.0 | 0.0120 | 1.55 | 1.17 | 0.0016 |
I62V | 695 | 34.6 | 22.5 | 1.5 | <0.0001 | 1.34 | 1.14 | <0.0001 |
A71T | 181 | 16.0 | 5.0 | 3.2 | <0.0001 | 1.66 | 1.15 | <0.0001 |
A71V | 64 | 6.2 | 1.7 | 3.6 | <0.0001 | 1.72 | 1.16 | <0.0001 |
T74S | 21 | 2.0 | 0.6 | 3.4 | 0.0174 | 1.79 | 1.17 | 0.0002 |
V77I | 899 | 51.0 | 28.4 | 1.8 | <0.0001 | 1.37 | 1.09 | <0.0001 |
I93L | 816 | 49.7 | 25.4 | 2.0 | <0.0001 | 1.39 | 1.10 | <0.0001 |
Mutations for which P was <0.05 by the Fisher exact test and ORs >1.5 are listed. Reduced susceptibility to nelfinavir was considered an FC >2.0.
A high FC was >2.0, and a low FC was <2.0.
OR is the ratio of the percentage of isolates with the mutation for which the FC was high to the percentage of isolates with the mutation for which the FC was low.
The P value was determined by the Fisher exact test; mixtures with wild-type and mutant viruses were counted as mutants.
The P value was determined by the unpaired comparison of means test; mixtures were excluded.
To determine whether drug-specific differences in assay variability account for the different distributions that were observed, 10 clonal patient-derived viruses with various patterns of drug resistance were assayed repeatedly (8 to 30 replicates each) (Tables 1 and 4). Assay variations (median CVs) were similar for all drugs except zidovudine, ranging from 12% (for tenofovir and efavirenz) to 18% (for lamivudine and zalcitabine); the median CV for zidovudine was 32%. Thus, the wider distributions of FC values for certain drugs (NNRTIs and PIs) among wild-type viruses were not associated with increased assay variability for those drugs. Notably, the drug with the broadest distribution of FC for wild-type viruses, delavirdine (99th percentile, 6.2-fold), also had one of the lowest CVs (13%). The susceptibility curves for zidovudine typically had reduced slopes compared to the slopes of the curves for the other drugs, resulting in reductions in the precisions of IC50 and FC determinations (data not shown) and a higher CV than those for the other drugs.
TABLE 4.
Mean FC and median CVs for WAC viruses
WAC virus | No. of replicates | Mean FCa
|
|||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ZDV | 3TC | ddI | ddC | d4T | ABC | TDF | NVP | DLV | EFV | APV | IDV | NFV | RTV | SQV | LPV | ||
1 | 8 | — | — | 4.4 | 5.3 | 9.0 | 23.9 | 3.8 | 0.7 | 0.4 | 0.3 | 2.3 | 17.0 | 18.4 | 45.3 | 16.7 | 9.9 |
3 | 30 | 244 | — | 19.7 | 45.2 | 10.9 | 15.1 | 0.9 | 1.3 | 3.0 | 1.3 | 0.6 | 0.8 | 1.0 | 0.7 | 0.8 | 0.6 |
5 | 10 | 5.5 | — | 1.2 | 1.4 | 1.0 | 3.2 | 1.0 | 0.5 | 0.3 | 0.3 | 0.6 | 1.1 | 23.3 | 0.6 | 0.3 | 0.6 |
6 | 10 | — | 7.0 | 1.7 | 1.4 | 3.3 | 4.1 | 4.7 | — | 15.3 | 201 | 1.0 | 23.4 | 29.8 | 36.7 | 7.1 | 10.1 |
7 | 29 | — | 7.8 | 2.3 | 2.2 | 6.9 | 6.6 | 5.6 | 0.3 | 0.1 | 0.1 | 2.1 | 2.5 | 2.5 | 14.5 | 1.2 | 4.3 |
8 | 30 | 83.3 | 2.8 | 0.8 | 0.8 | 3.2 | 1.6 | 2.1 | — | 1.0 | 10.0 | 1.5 | 31.4 | 43.6 | 73.5 | 21.4 | 13.2 |
10 | 30 | 33.8 | — | 1.6 | 1.8 | 1.7 | 6.1 | 1.8 | 42.6 | 30.8 | 19.5 | 1.2 | 1.8 | 45.0 | 0.9 | 2.3 | 1.2 |
11 | 10 | 0.5 | — | 1.3 | 1.5 | 0.7 | 2.7 | 0.5 | 51.8 | 63.1 | 30.4 | 1.3 | 3.5 | 4.1 | 7.6 | 0.4 | 1.4 |
13 | 10 | 241 | 4.2 | 1.1 | 0.9 | 2.3 | 2.3 | 2.5 | 0.5 | 0.3 | 0.3 | 4.9 | 24.5 | 56.0 | 9.3 | 16.2 | 7.5 |
15 | 10 | 1.7 | — | 1.2 | 1.3 | 1.3 | 2.5 | 0.6 | 0.1 | 0.1 | 0.2 | 4.1 | 8.4 | 6.1 | 61.5 | 20.9 | 10.9 |
Median CV (%) | 32 | 18 | 14 | 18 | 16 | 14 | 12 | 15 | 13 | 12 | 17 | 14 | 16 | 15 | 16 | 14 |
The drug abbreviations are as defined in footnote b of Table 2. —, FC was not calculated due to high-level drug resistance (the IC50 was greater than the maximum drug concentration tested).
DISCUSSION
We have defined the natural variation in drug susceptibility among a large population of wild-type HIV-1 isolates using the PhenoSense HIV assay. The natural variation in drug susceptibility in wild-type HIV varies across drugs and drug classes. The greatest variation was observed among the NNRTIs (biological cutoff range, 3.0- to 6.2-fold), and the least variation was observed among the NRTIs (biological cutoff range, 1.2- to 1.8-fold). The measured biological variability in the present study is considerably lower than that previously reported by use of a different recombinant virus assay and a collection of >1,000 wild-type viruses (12, 13). For example, the mean FC plus 2 SDs for tenofovir is 1.2-fold by the PhenoSense HIV assay, whereas it is 3.0-fold by the Antivirogram method (12). Assuming that the extent of natural variation in susceptibility in the two virus populations studied is equivalent, the better precision of the PhenoSense HIV assay likely accounts for the lower biological cutoffs; however, as this was not a comparative study, the differences may be due to the viruses analyzed. Enhanced assay precision is important when susceptibility to drugs with clinical cutoffs that are close to the limits of assay reproducibility, such as tenofovir (1.4-fold), is measured. Notably, for each of the seven drugs with defined clinical cutoffs, the biological cutoff was lower than the clinical cutoff, indicating that there is no significant overlap among wild-type viruses and viruses with clinically relevant levels of reduced susceptibility to those drugs. Clinical cutoffs below twofold (i.e., for didanosine, stavudine, and tenofovir) are well above the 99th percentile of the distribution for wild-type virus, demonstrating the ability of the PhenoSense HIV assay to reliably measure subtle but clinically relevant changes in drug susceptibility. Differences between the biological and clinical cutoffs highlight the critical need to define clinical cutoffs for all drugs in order to provide the most clinically relevant thresholds for therapy guidance.
As with any biological assay, the accuracy of dichotomous categorization, such as “drug sensitive” and “drug resistant,” can never be 100% when the assay result is close to the defined resistance threshold. Thus, the closer that an FC value is to the cutoff, the lower the confidence level in the categorization of the result will be. Greater assay precision reduces the uncertainty associated with results close to the assay cutoff. Repeated testing of a virus for which the mean FC for tenofovir was 1.54 produced FC results over the clinical cutoff (1.4-fold) for 29 of 39 (74%) replicate results; similarly, the FC result for a virus for which the mean FC was 1.73 was above the cutoff for 34 of 36 (94%) replicate results (data not shown). The use of an assay with high precision provides an accurate indication of the biological cutoffs for wild-type viruses and an accurate classification of viruses that are drug sensitive (drug susceptibility below the cutoff) or drug resistant (susceptibility above the cutoff). Proper interpretation of phenotypic assay results should take into account both the quantitative nature of the result and the assay reproducibility.
This study demonstrates that the natural variation in drug susceptibility observed among wild-type HIV-1 isolates is not caused by assay variation. Assay reproducibility was similar for all drugs except zidovudine. Natural variation in drug susceptibility was greater for NNRTIs and some PIs than for NRTIs. Whether the variation in drug susceptibility for NNRTI and some PIs has clinical significance remains to be determined. The results of the few small studies that have attempted to assess the likelihood of clinical failure of NNRTI-based regimens in patients infected with viruses possessing low-level reduced susceptibility are inconclusive [L. Bacheler, L. Ploughman, K. Hertogs, and B. Larder, Antivir. Ther. 5(Suppl. 3):70, 2000, abstr.; P. R. Harrigan, W. Verbiest, B. Larder, K. Hertogs, J. Tilley, J. Raboud, and J. Montaner, Antivir. Ther. 5(Suppl. 3):68, 2000, abstr.]. The clinical cutoffs for these drugs are not yet defined. Notably, the FC for some viruses isolated after NNRTI treatment failure are as low as 5 to 10, despite the presence of well-recognized drug resistance mutations, and overlap the range of FC values observed for wild-type viruses.
The median FC value for wild-type viruses for most PIs (all PIs except NFV) was slightly below 1. The most likely explanation for this observation is that the reference virus containing PR and RT sequences from NL4-3 is slightly less susceptible to PIs than the average clinical isolate. The median FC value for wild-type viruses does not affect the interpretation of assay results, as long as the drug susceptibility cutoffs for the PhenoSense HIV assay are defined on the basis of data obtained with the same reference virus. For example, the clinical cutoff for ritonavir-boosted lopinavir (10-fold) was determined by the PhenoSense HIV assay (16), and so the PhenoSense HIV assay results do not require adjustment because the FC values for wild-type viruses tend to be less than 1. However, the cutoffs defined by using data from one assay or for one reference virus may require adjustment before they can be applied to another phenotypic assay that has different performance characteristics or that uses a different reference virus.
It is important to appreciate the potential drawbacks of using biological cutoffs to help interpret phenotypic test results for patient management. Natural variation in the drug susceptibilities of wild-type viruses may not relate to treatment response if an antiretroviral drug is not uniformly active against all wild-type viruses. A priori, an FC value lower than the biological cutoff does not necessarily indicate that the virus will respond to a drug; conversely, an FC value greater than the biological cutoff does not indicate that the drug will be ineffective. For example, the clinical cutoffs for abacavir and lopinavir were higher than their respective biological cutoffs. Thus, biological cutoffs are somewhat arbitrary and without clear clinical relevance for many drugs. Nevertheless, in the absence of a clinical cutoff, the natural variability in drug susceptibility among wild-type viruses provides a threshold for defining abnormal reductions in drug susceptibility and an indicator of an increased probability of drug resistance.
This analysis has several limitations. Our definition of wild-type virus may lead to the inclusion of drug-resistant test vector pools containing unrecognized DSMs or the exclusion of wild-type test vector pools that contain natural polymorphisms that have been defined as DSMs. However, the large size of the patient population and the use of standard genotypic guidelines to define DSMs minimize the impact of the occasional misclassification of viruses. Also, the use of the 99th percentile or the mean plus 2 SDs rather than the maximum of the distribution of FC values for wild-type viruses to define the biological cutoff reduces the potential impact of inclusion of a small number of resistant viruses in the analyses. Comparison of our results to those of Harrigan et al. (12, 13) is complicated by the different amplification strategies (different lengths of the RT sequences of the test viruses were sequenced) and cell-based assays (single-cycle versus multiple-cycle replication) used. With regard to the extent of RT sequence captured by RT-PCR, since lower biological cutoffs were also seen for PIs, this is unlikely to account for all of the observed differences. In addition, previous studies may have included samples from therapy-naïve patients infected with drug-resistant virus.
Examination of the natural variation in drug susceptibility provides a useful, albeit imperfect, means of defining the upper limit of expected drug susceptibility among wild-type viruses. However, biological cutoffs are not a substitute for clinical cutoffs rigorously defined by treatment outcome data obtained from carefully conducted clinical trials. The availability of a phenotypic assay with enhanced accuracy and precision permits the confident assessment of subtle changes in drug susceptibility. The use of carefully defined clinical and/or biological cutoffs further enhances the ability of phenotypic assays to provide relevant assessments of drug activity.
Acknowledgments
We are grateful for the contributions of the members of the ViroLogic Clinical Reference Laboratory for performing phenotypic and genotypic testing and the ViroLogic Information Technology group for database infrastructure support. We also thank Soumya Nidtha for assistance with the genotypic analysis.
The customized software for genotype analysis was provided by GeneCodes, Inc. (Ann Arbor, Mich.).
REFERENCES
- 1.Baxter, J. D., D. L. Mayers, D. N. Wentworth, J. D. Neaton, M. L. Hoover, M. A. Winters, S. B. Mannheimer, M. A. Thompson, D. I. Abrams, B. J. Brizz, J. P. Ioannidis, and T. C. Merigan. 2000. A randomized study of antiretroviral management based on plasma genotypic antiretroviral resistance testing in patients failing therapy. AIDS 14:F83-F93. [DOI] [PubMed] [Google Scholar]
- 2.Brenner, B., D. Turner, M. Oliveira, D. Moisi, M. Detorio, M. Carobene, R. G. Marlink, J. Schapiro, M. Roger, and M. A. Wainberg. 2003. A V106M mutation in HIV-1 clade C viruses exposed to efavirenz confers cross-resistance to non-nucleoside reverse transcriptase inhibitors. AIDS 17:F1-F5. [DOI] [PubMed] [Google Scholar]
- 3.Brown, A. J., H. M. Precious, J. M. Whitcomb, J. K. Wong, M. Quigg, W. Huang, E. S. Daar, R. T. D'Aquila, P. H. Keiser, E. Connick, N. S. Hellmann, C. J. Petropoulos, D. D. Richman, and S. J. Little. 2000. Reduced susceptibility of human immunodeficiency virus type 1 (HIV-1) from patients with primary HIV infection to nonnucleoside reverse transcriptase inhibitors is associated with variation at novel amino acid sites. J. Virol. 74:10269-10273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Caride, E., K. Hertogs, B. Larder, D. P., R. Brindeiro, E. Machado, C. A. M. De Sa, W. A. Eyer-Silva, F. S. Sion, L. F. C. Passioni, J. A. Menezes, A. R. Calazans, and A. Tanuri. 2001. Genotypic and phenotypic evidence of different drug-resistance mutation patterns between B and non-B subtype isolates of human immunodeficiency virus type 1 found in Brazilian patients failing HAART. Virus Genes 23:193-202. [DOI] [PubMed] [Google Scholar]
- 5.Cohen, C. J., S. Hunt, M. Sension, C. Farthing, M. Conant, S. Jacobson, J. Nadler, W. Verbiest, K. Hertogs, M. Ames, A. R. Rinehart, and N. M. Graham. 2002. A randomized trial assessing the impact of phenotypic resistance testing on antiretroviral therapy. AIDS 16:579-588. [DOI] [PubMed] [Google Scholar]
- 6.D'Aquila, R. T., J. M. Shapiro, F. Brun-Vezinet, B. Clotet, B. Conway, L. M. Demeter, R. M. Grant, V. A. Johnson, D. R. Kuritzkes, C. Loveday, R. W. Shafer, and D. D. Richman. 2002. Drug resistance mutations. Top. HIV Med. 10:21-25. [PubMed] [Google Scholar]
- 7.Deeks, S. G., N. S. Hellmann, R. M. Grant, N. T. Parkin, C. J. Petropoulos, M. Becker, W. Symonds, M. Chesney, and P. A. Volberding. 1999. Novel four-drug salvage treatment regimens after failure of a human immunodeficiency virus type 1 protease inhibitor-containing regimen: antiviral activity and correlation of baseline phenotypic drug susceptibility with virologic outcome. J. Infect. Dis. 179:1375-1381. [DOI] [PubMed] [Google Scholar]
- 8.DeGruttola, V., L. Dix, R. D'Aquila, D. Holder, A. Phillips, M. Ait-Khaled, J. Baxter, P. Clevenbergh, S. Hammer, R. Harrigan, D. Katzenstein, R. Lanier, M. Miller, M. Para, S. Yerly, A. Zolopa, J. Murray, A. Patick, V. Miller, S. Castillo, L. Pedneault, and J. Mellors. 2000. The relation between baseline HIV drug resistance and response to antiretroviral therapy: re-analysis of retrospective and prospective studies using a standardized data analysis plan. Antivir. Ther. 5:41-48. [DOI] [PubMed] [Google Scholar]
- 9.Durant, J., P. Clevenbergh, P. Halfon, P. Delgiudice, S. Porsin, P. Simonet, N. Montagne, C. A. Boucher, J. M. Schapiro, and P. Dellamonica. 1999. Drug-resistance genotyping in HIV-1 therapy: the VIRADAPT randomised controlled trial. Lancet 353:2195-2199. [DOI] [PubMed] [Google Scholar]
- 10.Gonzales, M. J., R. N. Machekano, and R. W. Shafer. 2001. Human immunodeficiency virus type 1 reverse-transcriptase and protease subtypes: classification, amino acid mutation patterns, and prevalence in a northern California clinic-based population. J. Infect. Dis. 184:998-1006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Harrigan, P. R., and B. A. Larder. 2002. Extent of cross-resistance between agents used to treat human immunodeficiency virus type 1 infection in clinically derived isolates. Antimicrob. Agents Chemother. 46:909-912. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Harrigan, P. R., M. D. Miller, P. McKenna, Z. L. Brumme, and B. A. Larder. 2002. Phenotypic susceptibilities to tenofovir in a large panel of clinically derived human immunodeficiency virus type 1 isolates. Antimicrob. Agents Chemother. 46:1067-1072. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Harrigan, P. R., J. S. Montaner, S. A. Wegner, W. Verbiest, V. Miller, R. Wood, and B. A. Larder. 2001. World-wide variation in HIV-1 phenotypic susceptibility in untreated individuals: biologically relevant values for resistance testing. AIDS 15:1671-1677. [DOI] [PubMed] [Google Scholar]
- 13a.Hirsch, M. S., F. Brun-Vezinet, B. Clotet, B. Conway, D. R. Kuritzkes, R. T. D’Aquila, L. M. Demeter, S. M. Hammer, V. A. Johnson, C. Loveday, J. W. Mellors, D. M. Jacobsen, and D. D. Richman. 2003. Antiretroviral drug resistance testing in adults infected with human immunodeficiency virus type 1: 2003 recommendations of an international AIDS Society-USA Panel. Clin. Infect. Dis. 37:113-128. [DOI] [PubMed]
- 14.Kantor, R., R. Machekano, M. J. Gonzales, K. Dupnik, J. M. Schapiro, and R. W. Shafer. 2001. Human immunodeficiency virus reverse transcriptase and protease sequence database: an expanded data model integrating natural language text and sequence analysis programs. Nucleic Acids Res. 29:296-299. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Katzenstein, D. A., R. J. Bosch, N. Hellmann, N. Wang, L. Bacheler, and M. A. Albrecht. 2003. Phenotypic susceptibility and virological outcome in nucleoside-experienced patients receiving three or four antiretroviral drugs. AIDS 17:821-830. [DOI] [PubMed] [Google Scholar]
- 16.Kempf, D. J., J. D. Isaacson, M. S. King, S. C. Brun, J. Sylte, B. Richards, B. Bernstein, R. Rode, and E. Sun. 2002. Analysis of the virologic response with respect to baseline viral phenotype and genotype in protease inhibitor-experienced HIV-1-infected patients receiving lopinavir/ritonavir therapy. Antivir. Ther. 7:165-174. [PubMed] [Google Scholar]
- 17.Little, S. J., S. Holte, J. P. Routy, E. S. Daar, M. Markowitz, A. C. Collier, R. A. Koup, J. W. Mellors, E. Connick, B. Conway, M. Kilby, L. Wang, J. M. Whitcomb, N. S. Hellmann, and D. D. Richman. 2002. Antiretroviral-drug resistance among patients recently infected with HIV. N. Engl. J. Med. 347:385-394. [DOI] [PubMed] [Google Scholar]
- 18.Palella, F. J., Jr., Delaney K. M., A. C. Moorman, M. O. Loveless, J. Fuhrer, G. A. Satten, D. J. Aschman, S. D. Holmberg, et al. 1998. Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. N. Engl. J. Med. 338:853-860. [DOI] [PubMed] [Google Scholar]
- 19.Parikh, U., J. Hammond, C. Calef, B. Larder, R. Schinazi, and J. W. Mellors. 2001. Mutations in retroviral genes associated with drug resistance. [Online.] http://hiv-web.lanl.gov/content/hiv-db/COMPENDIUM/2000/partI/Mellors.pdf.
- 20.Petropoulos, C. J., N. T. Parkin, K. L. Limoli, Y. S. Lie, T. Wrin, W. Huang, H. Tian, D. Smith, G. A. Winslow, D. J. Capon, and J. M. Whitcomb. 2000. A novel phenotypic drug susceptibility assay for human immunodeficiency virus type 1. Antimicrob. Agents Chemother. 44:920-928. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Pillay, D., S. Taylor, and D. D. Richman. 2000. Incidence and impact of resistance against approved antiretroviral drugs. Rev. Med. Virol. 10:231-253. [DOI] [PubMed] [Google Scholar]
- 22.Tural, C., L. Ruiz, C. Holtzer, J. Schapiro, P. Viciana, J. Gonzalez, P. Domingo, C. Boucher, C. Rey-Joly, and B. Clotet. 2002. Clinical utility of HIV-1 genotyping and expert advice: the Havana trial. AIDS 16:209-218. [DOI] [PubMed] [Google Scholar]
- 23.Vandamme, A. M., F. Houyez, D. Banhegyi, B. Clotet, G. De Schrijver, K. A. De Smet, W. W. Hall, R. Harrigan, N. Hellmann, K. Hertogs, C. Holtzer, B. Larder, D. Pillay, E. Race, J. C. Schmit, R. Schuurman, E. Schulse, A. Sonnerborg, and V. Miller. 2001. Laboratory guidelines for the practical use of HIV drug resistance tests in patient follow-up. Antivir. Ther. 6:21-39. [PubMed] [Google Scholar]
- 24.Whitcomb, J. M., N. T. Parkin, C. Chappey, N. S. Hellmann, and C. J. Petropoulos. 2003. Broad nucleoside reverse-transcriptase inhibitor cross-resistance in human immunodeficiency virus type 1 clinical isolates. J. Infect. Dis. 188:992-1000. [DOI] [PubMed] [Google Scholar]