Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2009 Jul 2.
Published in final edited form as: Cancer Epidemiol Biomarkers Prev. 2008 May;17(5):1248–1254. doi: 10.1158/1055-9965.EPI-07-2904

A Comparison of Linear Array and Hybrid Capture 2 for Detection of Carcinogenic HPV, and Cervical Precancer in ALTS

Patti E Gravitt 1, Mark Schiffman 2, Diane Solomon 3, Cosette M Wheeler 4, Philip E Castle 2,#
PMCID: PMC2705141  NIHMSID: NIHMS102109  PMID: 18483347

Abstract

Background

We were interested in comparing the performance of Linear Array (LA; Roche Molecular Systems, Alameda, CA) to Hybrid Capture 2 (hc2; Digene Corporation, Gaithersburg, MD) for the detection of carcinogenic HPV and cervical precancer.

Methods

LA and hc2 results were compared on baseline specimens collected from women with an atypical squamous cells of undetermined significance (ASCUS) Pap referred into ALTS (n = 3,488). Hybrid Capture 2 was conducted at the time of the study on liquid cytology specimens. LA was conducted retrospectively on aliquots from a second, stored cervical specimen masked to the hc2 results and clinical data. Paired LA and hc2 results (n = 3,289, 94%) were compared for the detection of carcinogenic HPV (HPV16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 66, and 68) and 2-year cumulative ≥CIN3 as diagnosed by the quality control pathology review.

Results

LA was more likely to test positive for carcinogenic HPV than hc2 (55% vs. 53%, p = 0.001). For two-year cumulative ≥CIN3, LA and hc2 had similar sensitivities (93.3% vs. 92.6%, respectively, p = 1.0), and LA was marginally less specific than hc2 (48.1% vs. 50.6%, respectively, p = 0.05). LA and hc2 had similar negative predictive values (98.70% vs. 98.64% respectively, p = 0.4), and LA had a slightly lower PPV than hc2 (14.6% vs. 15.1%, respectively, p < 0.0001).

Conclusion

We observed that LA and hc2 performed similarly in the detection of carcinogenic HPV and identification of CIN3 among women with an ASCUS Pap.

Keywords: cytology, cervical intraepithelial neoplasia (CIN), cervical cancer, human papillomavirus (HPV), HPV genotyping, ASCUS

INTRODUCTION

It is now generally recognized and accepted that approximately 15 cancer-associated (carcinogenic) human papillomavirus (HPV) genotypes cause virtually all cervical cancer and its immediate precursor lesions, most importantly cervical intraepithelial neoplasia grade 3 (CIN3) (“cervical precancer”). HPV infections are common and typically resolve within 1-2 years. Uncommonly, carcinogenic HPV infections can persist, and this persistence is strongly associated with cervical precancer, which if left untreated can lead to invasive disease.

Based on knowledge of the central role for persistent, carcinogenic HPV in the development of cervical cancer, carcinogenic HPV testing offers several advantages over cytology including: [1] greater sensitivity for the detection of CIN3 or cancer (≥CIN3) (1-7); [2] as a consequence of greater sensitivity, higher negative predictive value i.e., testing negative for carcinogenic HPV DNA implies an extremely low risk of prevalent or incipient cancer/CIN3 (1,2,8), permitting an extension of screening intervals; and [3] greater reproducibility (9,10). Accordingly, carcinogenic HPV testing has now been approved in the United States as an adjunct to cytology for triage of equivocal cytology at all ages and for general screening in women ≥30 years old (11).

One pooled probe test for detection of the carcinogenic genotypes of HPV DNA (as a group), Hybrid Capture 2 (hc2, Digene Corporation, Gaithersburg, MD, USA), has already been FDA-approved. Other tests are in development or being validated and are expected to become widely available soon. One of these tests, Linear Array (LA; Roche Molecular Systems, Alameda, CA, USA), is a PCR-based assay that detects 37 HPV genotypes individually, including the main 14 carcinogenic HPV genotypes. LA is the commercialized (research use-only) version of the Line Blot Assay (Roche) that has been used in numerous epidemiological and clinical studies (12-17), including the Atypical Squamous Cells of Undetermined Significance (ASCUS) and Low-Grade Squamous Intraepithelial Lesion (LSIL) Triage Study (ALTS) (14,17,18). Using baseline specimens from women referred into ALTS because of an ASCUS (equivocal) Pap, we sought to evaluate the performance of LA, compared to the referent standard of hc2, for detection of carcinogenic HPV and triage of ASCUS Paps for identifying women with ≥CIN3.

SUBJECTS AND METHODS

Study Design and Population

ALTS was a randomized trial comparing three management strategies for 5,060 women with ASCUS (n = 3,488) or LSIL (n = 1,572) Pap (19): 1) immediate colposcopy (IC arm) (referral to colposcopy regardless of enrollment test results); 2) HPV triage (HPV arm) (referral to colposcopy if enrollment HPV result was positive by hc2 or missing or if the enrollment cytology was high-grade squamous intraepithelial lesion [HSIL] for patient safety); or 3) conservative management (CM arm) (referral to colposcopy at enrollment if cytology was HSIL). At enrollment, all women received a pelvic examination with collection of two cervical specimens; the first specimen in PreservCyt for ThinPrep cytology (Cytyc Corporation, Marlborough, MA, USA) and hc2 testing and the second in specimen transport medium (STM; Digene Corporation). Women in all 3 arms of the study were reevaluated by cytology every 6 months for 2 years of follow-up and sent to colposcopy if cytology was HSIL. An exit examination with colposcopy was scheduled for all women, regardless of study arm or prior procedures, at the completion of the follow-up. We refer readers to other references for details on randomization, examination procedures, patient management, and laboratory and pathology methods (19-23). The National Cancer Institute and local institutional review boards approved the study and all participants provided written informed consent. This evaluation was restricted to women referred for an ASCUS Pap because previous work indicated that carcinogenic HPV testing was not clinically useful in young women with LSIL Paps, as more than two-thirds of the women were positive (20).

HPV DNA Testing

Residual PreservCyt specimens, after being used for liquid-based cytology, were tested by hc2 (23), a pooled-probe, signal-amplification DNA test that targets a group of 13 HPV genotypes (HPV16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 68) (24). Per the manufacturer's instructions, a protocol for converting the liquid cytology samples into an STM equivalent was used. In addition, hc2 cross-reacts strongly with a 14th carcinogenic HPV genotype, HPV66 (25-27), as well as other untargeted, non-carcinogenic HPV genotypes including HPV53. Hybrid Capture 2 signal strength (relative light units per positive control [RLU/CO]) was used as semi-quantitative measure of HPV viral load (“HPV semi-quantitative viral load”)(28). An equivalent of 10% of each original specimen was used for hc2 testing

Aliquots of the archived, enrollment STM specimens were retrospectively tested by LA (29), which employs L1 consensus primers PGMY09/11 for amplification, and amplicons were subjected to reverse-line blot hybridization for detection of 37 HPV individual genotypes (HPV 6, 11, 16, 18, 26, 31, 33, 35, 39, 40, 42, 45, 51-56, 58, 59, 61, 62, 64, 66-73, 81, 82, 82v, 83, 84, and 89). Because of intellectual property rights, LA does not directly detect HPV52 but combines a set of probes that detects HPV33, 35, 52 and 58 combined (HPVmix). Specimens that test negative for HPV33, 35, and 58 individually, but are positive for the HPVmix, are considered to be HPV52 positive. The specimens that test positive for the HPVmix and HPV33, 35, and/or 58 have an uncertain HPV52 status, and for this analysis these specimens were considered to be HPV52 negative. LA was used according to the manufacturer's instructions in the product insert, which includes DNA extraction using the QIAamp MinElute Media Kit (QIAGEN, Inc., Valencia, CA). The only deviation from the LA product insert protocol was to implement an automated sample preparation for extraction of up to 96 specimens at a time on the QIAGEN MDx platform (using the MinElute Media MDx Kit and manufacturer's instructions) rather than processing 24 specimens per batch with the manual vacuum method (30,31). An equivalent of 2.8% of each original specimen was used for LA testing. Specimens were tested by LA a median of 104 months after collection, masked to the hc2 results and clinical data.

HPV genotypes 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 66 and 68 were considered the primary carcinogenic genotypes (32,33). We included HPV66 in our definition because it was recently re-classified as a carcinogenic HPV genotype (33), and it is well-known that hc2 strongly detects HPV66 although it is not one of the 13 genotypes directly targeted by hc2 (25,26,34). In fact, in a previous analysis, we found hc2 to be more likely to be positive in the presence of HPV66 than in the presence of HPV68, one of the hc2-targeted HPV genotypes [Schiffman]. LA results were assigned a HPV risk group according to a priori established cervical cancer risk (e.g., HPV16 causes 50%-60% of all cancers, HPV18 causes 15%-20% of all cancers, and the other 12 carcinogenic HPV genotypes cause the remaining cases of cancer): (1) positive for HPV16; (2) else positive for HPV18 and negative for HPV16; (3) else positive for any carcinogenic HPV genotypes and negative for HPV16 and HPV18 (carcinogenic HPV exc. HPV16 & HPV18); (4) else positive for any non-carcinogenic HPV genotypes and negative for all carcinogenic genotypes; or (5) LA negative (HPV16>HPV18> carcinogenic HPV exc. HPV16 & HPV18>non-carcinogenic HPV>PCR negative).

Pathology and Treatment

Clinical management was based on the clinical center pathologists' cytologic and histologic diagnoses. In addition, all referral smears, ThinPreps, and histology slides were sent to the Pathology Quality Control Group (QC pathology) based at the Johns Hopkins Hospital for independent review and diagnosis. CIN2 or worse (≥CIN2) diagnosis based on the clinical center pathology or a CIN3 or worse (≥CIN3) diagnosis based on the QC pathology review triggered treatment by Loop Electrosurgical Excision Procedure (LEEP). In addition, women with persistent LSIL or carcinogenic HPV-positive ASCUS at the time of the exit from the study were offered LEEP.

Statistical Analysis

Detection of carcinogenic HPV by LA and hc2 was compared by calculating kappa values, percent total agreement, and percent positive agreement (i.e., agreement among paired tests in which at least one was positive). Differences in detection were tested for statistical significance (p < 0.05) using an exact McNemar's χ2 (2 categories). Results of paired tests were also compared following stratification on enrollment ThinPrep cytology results (negative vs. ASCUS or more severe; alternatively, negative, ASCUS, LSIL, and high-grade squamous intraepithelial lesion [HSIL] including atypical squamous cells, cannot rule out HSIL [ASC-H]) (n.b., because of the variability of cytologic interpretation (35), the enrollment ThinPrep cytology results differed from the referral cytology). LA results were also stratified on hc2 status (negative, positive) and hc2-derived log units of the HPV semi-quantitative viral load (1.00-9.99, 10.00-99.99, 99.99-999.99, and 1000+ RLU/CO).

Sensitivity, specificity, positive (PPV) and negative (NPV) predictive values, and Youden's Index (YI) were calculated for histologically-confirmed CIN3 or worse (≥CIN3) as diagnosed by QC pathology at enrollment restricted to the IC arm in which all women were referred to colposcopy (and therefore there was no bias in referral) and over the 2-year duration of ALTS in all arms combined since the 2-year cumulative ≥CIN3 did not differ by study arm, only in the timing of diagnosis. In secondary analyses, the clinical performance was also calculated for histologically-confirmed CIN2 or worse (≥CIN2) as diagnosed by the clinical center pathologist at enrollment (restricted to the IC arm) and over the 2-year duration of ALTS, restricted to IC and HPV arms of the trial because of the evidence of regression of CIN2 in the CM arm of the trial (21,22). Differences in test sensitivity and specificity for ≥CIN3 and ≥CIN2 were tested for statistical significance using an exact McNemar's χ2. Differences in PPV and NPV were tested for statistical significance using a method developed by Leisenring et al. (36). Differences in YI were tested for statistical significance as previously described (3). Finally, the 2-year cumulative absolute risks of histologically-confirmed ≥CIN3 as diagnosed by QC pathology were calculated for testing positive or negative at enrollment for carcinogenic HPV as detected by LA or hc2. These risks were also calculated for LA-defined subgroups of HPV genotypes and for log-unit categories of semi-quantitative viral load as measured by hc2.

RESULTS

Carcinogenic HPV Detection

Among the women referred into ALTS because of an ASCUS Pap, 3,289 (94%) had valid baseline results for hc2 using PreservCyt specimens (missing hc2 results were primarily the result of insufficient specimen volume [<4 mL] for testing), 3,446 (99%) had valid results for LA testing of archived, baseline STM specimens, and 3,289 (94%) had valid results for both tests. Restricting our analyses to paired results, LA was more likely to test positive for carcinogenic HPV than hc2 (55% vs. 53%, p = 0.001), with a percent agreement of 84%, a percent positive agreement of 74%, and a kappa of 0.68 (Table 1). Both tests were more likely to test positive for carcinogenic HPV among women with an enrollment cytology of ASCUS or worse (72% for LA vs. 74% for hc2, p = 0.003) than women with negative cytology (38% for LA vs. 30% for hc2, p < 0.0001). There was also better agreement between tests among women with an enrollment cytology of ASCUS or worse compared to women with negative cytology. Among women with enrollment LSIL and HSIL cytology, LA was less likely to test positive compared to hc2 (p < 0.0001 and p = 0.03, respectively). Among hc2-positive women, the proportion of LA tests positive for carcinogenic HPV increased with increasing semi-quantitative viral load categorized in log units (ptrend < 0.0001).

Table 1.

A comparison of and agreement for detection of carcinogenic HPV by Linear Array (LA) and Hybrid Capture 2 (hc2) for all paired tests, stratified by cytologic interpretations, and stratified by Hybrid Capture 2 status (negative, positive) and by log units of hc2 signal strength (RLU/CO), semi-quantitative measure of viral load, for women referred into ALTS for an ASCUS Pap. Row percentages are shown beneath number in each cell. Differences were tested for statistical significance using an exact McNemar's χ2 test.

N hc2+ LA+ LA-/hc2- LA-/hc2+ LA+/hc2- LA+/hc2+ %Agreement %Positive
Agreement
Kappa P

All hc2 3,289 1,749
53%
All LA 3,446 1,914
56%

All Pairs 3,289 1,749 1,824 1,238 227 302 1,522 84% 74% 0.68 0.001
53% 55% 38% 7% 9% 46%

Cytology Negative 1,535 465 580 862 93 208 372 80% 55% 0.57 <0.0001
30% 38% 56% 6% 14% 24%
Cytology Positive (≥ASC-US) 1,707 1,266 1,222 354 131 87 1,135 87% 84% 0.68 0.003
74% 72% 21% 8% 5% 66%

ASC-US 822 456 465 295 62 71 394 84% 75% 0.67 0.4
55% 57% 36% 8% 9% 48%
LSIL 581 535 493 37 51 9 484 90% 89% 0.50 <0.0001
92% 85% 6% 9% 2% 83%
HSIL (including ASC-H) 304 275 264 22 18 7 257 92% 91% 0.59 0.03
90% 87% 7% 6% 2% 85%

hc2-Positive (RLU/CO: 1.00-9.99) 409 287 122 287
70% 30% 70%
hc2-Positive (RLU/CO: 10.00-99.99) 478 418 60 418
87% 13% 87%
hc2-Positive (RLU/CO: 100.00-999.99) 621 582 39 582
94% 6% 94%
hc2-Positive (RLU/PC: 1000.00+) 241 235 6 235
98% 2% 98%

Clinical Performance

There were no significant differences between LA and hc2 in clinical sensitivity (89.1% vs. 90.9%, respectively, p = 1) and specificity (46.5% vs. 47.8%, respectively, p = 0.3) for detection of enrollment QC pathology-diagnosed ≥CIN3 (n = 55) in the IC arm (Table 2). Using Youden's Index (YI) (sensitivity + specificity -100%) as a measure of accuracy, LA appeared very slightly less accurate than hc2 (35.6% vs. 38.7%) but the difference was not significant (p = 0.4). LA had a slightly lower PPV than hc2 (8.1% vs. 8.5%, p = 0.0009), which was statistically but perhaps not clinically significant. The NPV for both assays were similar (98.77% for LA vs. 99.00% for hc2). Similar estimates for clinical performance parameters for both assays and similar differences between assays were observed when diagnoses of ≥CIN2 by the clinical center pathologists in the IC arm were used as the endpoint.

Table 2.

Clinical performance of carcinogenic HPV detection by Linear Array (LA) and Hybrid Capture 2 (hc2) for enrollment ≥CIN3 as diagnosed by QC pathology and ≥CIN2 as diagnosed by clinical center pathologists in women referred into ALTS for an ASCUS Pap and restricted to women participating in the IC arm (n = 1,089). Differences in sensitivity, specificity, and referral were tested for statistical significance using an exact McNemar's χ2 test. Statistical differences in positive (PPV) and negative (NPV) predictive values were a method developed by Leisenring et al. (36), a score statistic derived from a marginal regression model and bears some relation to McNemar's statistic.

Linear Array hc2

Estimate 95%CI Estimate 95%CI P

QC Pathology ≥CIN3 (n = 55)
Sensitivity 89.1% 77.8%-95.9% 90.9% 80.0%-97.0% 1
Specificity 46.5% 43.4%-49.6% 47.8% 44.7%- 50.9% 0.3
PPV 8.1% 6.1%-10.6% 8.5% 6.4%-11.0% 0.0009
NPV 98.77% 97.34%-99.55% 99.00% 97.68%-99.67% 0.8
Referral 55.3% 52.3%-58.3% 54.2% 51.2%-57.2% 0.4
CC Pathology ≥CIN2 (n = 113)
Sensitivity 87.6% 80.1%-93.1% 89.5% 82.3%-94.4% 0.8
Specificity 48.2% 45.0%-51.3% 50.0% 46.8%-53.2% 0.3
PPV 16.3% 13.4%-19.5% 17.3% 14.3%-20.6% <0.0001
NPV 97.12% 95.22%-98.42% 97.60% 95.84%-98.75% 0.8
Referral 55.5% 52.5%-58.5% 54.1% 51.1%-57.1% 0.4

We also considered the clinical performance of both assays for two-year cumulative QC pathology-diagnosed ≥CIN3 (in all arms) (Table 3), thereby correcting for the differences in sensitivity by study arm and initial clinical management (37). LA and hc2 had similar sensitivities (93.3% vs. 92.6%, respectively, p = 1) and LA was marginally less specific (48.1% vs. 50.6%, respectively, p = 0.05). The YI for LA, 42.2%, was similar to the YI for hc2, 43.2%, (p = 0.4). The PPV for LA was lower than for hc2 (14.6% vs. 15.1%, respectively, p < 0.0001) and there was no statistically significant difference in NPV between LA and hc2 (98.70% vs. 98.64%, respectively, p = 0.4). LA was less sensitive (87.8% vs. 91.0%, p = 0.09) and less specific (50.4% vs. 53.1%, p = 0.007) than hc2 for clinical center pathology-diagnosed ≥CIN2. The YI was lower for LA (38.2%) than for hc2 (44.1%) (p = 0.003).

Table 3.

Clinical performance of carcinogenic HPV detection by Linear Array (LA) and Hybrid Capture 2 (hc2) for two-year cumulative ≥CIN3 as diagnosed by QC pathology (n = 3,289) and ≥CIN2 as diagnosed by clinical center pathologists (n = 2,189, restricted to women in the IC and HPV arms) referred into ALTS for an ASCUS Pap. Differences in sensitivity, specificity, and referral were tested for statistical significance using an exact McNemar's χ2 test. Statistical differences in positive (PPV) and negative (NPV) predictive values were determined by Statistical differences in positive (PPV) and negative (NPV) predictive values were a method developed by Leisenring et al. (36), a score statistic derived from a marginal regression model and bears some relation to McNemar's statistic.

Linear Array hc2

Estimate 95%CI Estimate 95%CI P

QC Pathology ≥CIN3 (n = 285)
Sensitivity 93.3% 89.8%-95.9% 92.6% 89.0%-95.4% 1
Specificity 48.1% 46.3%-49.9% 50.6% 48.8%-52.4% 0.05
PPV 14.6% 13.0%-16.3% 15.1% 13.4%-16.9% <0.0001
NPV 98.70% 97.98%-99.22% 98.64% 97.92%-99.15% 0.4
Referral 55.5% 53.7%-57.2% 53.2% 51.5%-54.9% 0.001
CC Pathology ≥CIN2 (n = 354)
Sensitivity 87.8% 83.9%-91.1% 91.0% 87.5%-93.8% 0.09
Specificity 50.4% 48.1%-52.7% 53.1% 50.8%-55.4% 0.007
PPV 24.8% 22.4%-27.3% 26.5% 24.0%-29.2% <0.0001
NPV 95.68% 94.20%- 96.87% 96.93% 95.67%-97.91% 0.8
Referral 55.6% 53.5%-57.7% 53.9% 51.7%-56.0% 0.04

The 2-year cumulative risk of ≥CIN3 diagnosed by QC pathology for women with and without carcinogenic HPV considering the results of the two tests jointly is shown in Table 4. The risk of ≥CIN3 was <1.5% for women who tested negative for carcinogenic HPV and approximately 15% for women who tested positive by either test. Women who tested positive for HPV16 by LA (n = 563) were at a higher 2-year cumulative risk (28.6%) of ≥CIN3 than women with HPV18 (9.5%) or other carcinogenic HPV genotypes (8.2%). Women positive for any α9 genotype excluding HPV16 (n = 729) (HPV31, 33, 35, 52, 58, and 67) were at an 11.4% 2-year cumulative risk of ≥CIN3; women positive for any α7 genotype excluding HPV18 (n = 732) (HPV39, 45, 59, 68, and 70) were at a 12.4% 2-year cumulative risk of ≥CIN3 (data not shown). For comparison, we consider risk stratification for 2-year cumulative risk of ≥CIN3 using hc2-measured semi-quantitative HPV viral load. Women with higher semi-quantitative viral loads (10 RLU/CO or greater) were at about a 2-fold higher 2-year cumulative risk for ≥CIN3 than women with the lowest viral load (1-9.99 RLU/CO) (7.6%), but there was no trend with increasing viral load (17.4% for 10-99.99 RLU/CO, 18.2% for 100-999.99 RLU/CO, and 15.4% for 1000+ RLU/CO).

Table 4.

Two-year cumulative absolute risk of histologically-confirmed cervical intraepithelial neoplasia grade 3 or more severe (≥CIN3) as diagnosed by QC pathology for carcinogenic HPV detection by Linear Array vs. Hybrid Capture 2 referred into ALTS because of an ASCUS Pap. LA results were also stratified on HPV risk group, and hc2 results were stratified on log units of signal strength (RLU/CO), a semi-quantitative measure of viral load. Carc., positive for any carcinogenic HPV genotype other than HPV16 or HPV18; Non-carc., positive for any of non-carcinogenic HPV genotypes

QC Pathology
N N≥CIN3 %≥CIN3

Linear Array
Carcinogenic HPV
Negative 1,465 19 1.3%
Positive 1,824 266 14.6%
total 3,289 285 8.7%
HPV Risk Group
Negative 1,030 11 1.1%
Non-Carc. 435 8 1.8%
Carc. 1,103 90 8.2%
HPV18 158 15 9.5%
HPV16 563 161 28.6%
total 3,289 285 8.7%

Hybrid Capture 2
Carcinogenic HPV
Negative 1,540 21 11.4%
Positive 1,749 264 15.1%
total 3,289 285 8.7%
Semi-Quantitative Viral Load
1-9.99 (RLU/CO) 410 31 7.6%
10-99.99 (RLU/CO) 477 83 17.4%
100-999.99 (RLU/CO) 621 113 18.2%
1000+(RLU/CO) 241 37 15.4%

Total 3,289 285 8.7%

DISCUSSION

We compared detection of oncogenic HPV genotypes by LA to hc2, as a benchmark of performance, and found the two assays very similar for detection of carcinogenic HPV and ≥CIN3. Each assay offers different advantages over the other. Hybrid Capture 2 demonstrated slightly greater clinical specificity and therefore marginally better PPV than LA. Conversely, LA offers the advantage of HPV genotyping for identifying women at the greater risk of ≥CIN3 among carcinogenic HPV-positive women. These high-risk groups include women with HPV16 infection as shown here and in previous reports (18,38-41). Additionally, LA may confer an advantage of potentially identifying those women with genotype-specific persistent carcinogenic HPV infections that are at the greatest risk of having or getting cervical precancer or cancer (42-44).

When we used two-year cumulative, clinical center pathology diagnoses of ≥CIN2 as our endpoint, the differences between hc2 and LA were more pronounced, with hc2 showing marginally greater sensitivity than LA due to the detection of CIN2 caused by non-carcinogenic HPV genotypes. Eleven of the 22 CIN2 diagnoses that tested hc2 positive and LA negative for carcinogenic HPV were positive for non-carcinogenic HPV genotypes as detected by LA, and 10 of 11 were confirmed as having non-carcinogenic HPV genotypes (and no carcinogenic HPV genotypes) by Line Blot Assay, the prototype assay for LA (17,45) (data not shown). This is consistent with previous reports that hc2 cross-reacts with some non-carcinogenic HPV genotypes (25,26), and as shown here, these genotypes occasionally cause CIN2. In addition, some of these untargeted HPV genotypes, such as HPV73 and HPV82, are possibly carcinogenic (46). Although CIN2 is the threshold diagnosis for treatment, CIN2 is equivocal precancer (47), representing a mix of HPV infections of carcinogenic HPV and non-carcinogenic HPV that cause histopathologic changes such as CIN1, most likely to regress, and CIN3, which is precancerous and may invade if left undetected and untreated. It is also a poorly reproducible diagnosis (35) partly as a consequence of its ambiguous nature and because of the technical difficulties in mounting biopsies. It is therefore important when interpreting clinical performance for detection of ≥CIN2 to account for clinically-irrelevant diagnoses of CIN2. For these reasons, we emphasized ≥CIN3 as our primary and more rigorous endpoint.

We previously has shown that LA was more analytically sensitive for any carcinogenic HPV and HPV risk groups compared to its prototype assay, Line Blot Assay (LBA)(48). This is the likely explanation of why LA was more likely to test positive and was less clinically specific than hc2, the converse of what we observed in our comparison of LBA with hc2 (17). LA was more likely to test positive among women with normal cytology, which led to greater overall likelihood of testing positive compared to hc2. Conversely, hc2 was more likely than LA to test positive among women with LSIL and HSIL cytology. It was previously observed hc2 was more likely than another PCR assay, SPF10LiPA25, to test positive among women with LSIL cytology, which is indicative of a productive HPV infection producing higher viral loads compared with normal cytology. We suggest that viral load of the cervical specimen may have a greater influence on hc2 test performance than on PCR-based assay performance.

One additional advantage of LA has over hc2 is the internal β-globin control to verify the adequacy of the specimen. Although specimen inadequacy is probably an uncommon occurrence, the lack of internal control for hc2 is a concern. It is also noteworthy that LA uses a smaller fraction of the specimen than hc2 so that its use as a co-test with liquid cytology specimens is also less apt to have a missing test result due to insufficient specimen volume.

One limitation of our analysis was LA and hc2 were conducted on different specimens and in different manners. LA was conducted on STM specimens, a specimen genotype for which it has not been optimized, a median of 104 months after collection whereas hc2 was conducted on PreservCyt specimens in real time after cytology slides were made. We did not conduct the LA testing on the archived PreservCyt specimens, which had been stored at ambient temperature since 1997-8, because we found LA performed less sensitively on the PreservCyt specimens than the STM specimens in a pilot study (data not shown). Yet, the performance of LA was very similar to hc2, indicating that LA may be a robust assay as performed in an expert laboratory.

Although we found similar clinical performance between the two assays, we point out that clinical performance is only one of several important considerations for introducing a molecular test into clinical practice. Other criteria include reproducibility and capacity for high through-put. Hybrid Capture 2 testing has been shown to be reproducible (9,10,49,50) and using the automation provided by Rapid Capture® System (Digene) (http://www.digene.com/labs/labs_rapid_01.html) can achieve high-volume through-put. LA has neither demonstrated reproducibility nor high-volume capacity, both of which will be needed before LA can be widely used in cervical cancer screening programs.

LA has been approved for use in Europe and is currently in clinical trials, and it will be important to verify its clinical performance and establish reproducibility as criteria for clinical use. We compared LA to Hybrid Capture, which has repeatedly demonstrated both good clinical performance (1,7,51,52) and reliability (9,10,49,50), and found the two tests comparable. If and when it is FDA-approved and has high through-put capacity, LA may be another valuable screening tool for the secondary prevention of cervical cancer.

Acknowledgements

ALTS was supported by the National Cancer Institute, National Institutes of Health Department of Health and Human Services contracts CN-55153, CN-55154, CN-55155, CN-55156, CN-55157, CN-55158, CN-55159 and CN-55105. This work was also supported in part by intramural research program of the NCI. Some of the equipment and supplies used in these studies were donated or provided at reduced cost by Digene Corporation, Gaithersburg, MD; Cytyc Corporation, Boxborough, MA; National Testing Laboratories, Fenton, MO; DenVu, Tucson, AZ; and TriPath Imaging, Inc., Burlington, NC, and Roche Molecular Systems Inc., Alameda, CA. We thank the ALTS Group Investigators for their help in planning and conducting the trial. We thank Information Management Services, Inc., Rockville, MD for data management and programming support. We thank Meera Sangaramoorthy, Manu Sharma, and Kennita Riddick for the Roche Linear Array testing.

Reference List

  • 1.Cuzick J, Szarewski A, Cubie H, et al. Management of women who test positive for high-risk types of human papillomavirus: the HART study. Lancet. 2003;362:1871–6. doi: 10.1016/S0140-6736(03)14955-0. [DOI] [PubMed] [Google Scholar]
  • 2.Sherman ME, Lorincz AT, Scott DR, et al. Baseline cytology, human papillomavirus testing, and risk for cervical neoplasia: a 10-year cohort analysis. J Natl Cancer Inst. 2003;95:46–52. doi: 10.1093/jnci/95.1.46. [DOI] [PubMed] [Google Scholar]
  • 3.Ferreccio C, Bratti MC, Sherman ME, et al. A comparison of single and combined visual, cytologic, and virologic tests as screening strategies in a region at high risk of cervical cancer. Cancer Epidemiol Biomarkers Prev. 2003;12:815–23. [PubMed] [Google Scholar]
  • 4.Cuzick J, Clavel C, Petry KU, et al. Overview of the European and North American studies on HPV testing in primary cervical cancer screening. Int J Cancer. 2006 doi: 10.1002/ijc.21955. [DOI] [PubMed] [Google Scholar]
  • 5.Naucler P, Ryd W, Tornberg S, et al. Human papillomavirus and Papanicolaou tests to screen for cervical cancer. N Engl J Med. 2007;357:1589–97. doi: 10.1056/NEJMoa073204. [DOI] [PubMed] [Google Scholar]
  • 6.Bulkmans N, Berkhof J, Rozendaal L, et al. Human papillomavirus DNA testing for the detection of cervical intraepithelial neoplasia grade 3 and cancer: 5-year follow-up of a randomised controlled implementation trial. Lancet. 2007 doi: 10.1016/S0140-6736(07)61450-0. [DOI] [PubMed] [Google Scholar]
  • 7.Mayrand MH, Duarte-Franco E, Rodrigues I, et al. Human papillomavirus DNA versus Papanicolaou screening tests for cervical cancer. N Engl J Med. 2007;357:1579–88. doi: 10.1056/NEJMoa071430. [DOI] [PubMed] [Google Scholar]
  • 8.Kjaer S, Hogdall E, Frederiksen K, et al. The absolute risk of cervical abnormalities in high-risk human papillomavirus-positive, cytologically normal women over a 10-year period. Cancer Res. 2006;66:10630–6. doi: 10.1158/0008-5472.CAN-06-1057. [DOI] [PubMed] [Google Scholar]
  • 9.Castle PE, Wheeler CM, Solomon D, Schiffman M, Peyton CL. Interlaboratory reliability of Hybrid Capture 2. Am J Clin Pathol. 2004;122:238–45. doi: 10.1309/BA43-HMCA-J26V-WQH3. [DOI] [PubMed] [Google Scholar]
  • 10.Carozzi FM, Del Mistro A, Confortini M, et al. Reproducibility of HPV DNA Testing by Hybrid Capture 2 in a Screening Setting. Am J Clin Pathol. 2005;124:716–21. doi: 10.1309/84E5-WHJQ-HK83-BGQD. [DOI] [PubMed] [Google Scholar]
  • 11.Wright TC, Jr., Schiffman M, Solomon D, et al. Interim guidance for the use of human papillomavirus DNA testing as an adjunct to cervical cytology for screening. Obstet Gynecol. 2004;103:304–9. doi: 10.1097/01.AOG.0000109426.82624.f8. [DOI] [PubMed] [Google Scholar]
  • 12.Richardson H, Kelsall G, Tellier P, et al. The natural history of type-specific human papillomavirus infections in female university students. Cancer Epidemiol Biomarkers Prev. 2003;12:485–90. [PubMed] [Google Scholar]
  • 13.Richardson H, Abrahamowicz M, Tellier PP, et al. Modifiable risk factors associated with clearance of type-specific cervical human papillomavirus infections in a cohort of university students. Cancer Epidemiol Biomarkers Prev. 2005;14:1149–56. doi: 10.1158/1055-9965.EPI-04-0230. [DOI] [PubMed] [Google Scholar]
  • 14.Wheeler CM, Hunt WC, Schiffman M, Castle PE. Human papillomavirus genotypes and the cumulative 2-year risk of cervical precancer. J Infect Dis. 2006;194:1291–9. doi: 10.1086/507909. [DOI] [PubMed] [Google Scholar]
  • 15.Giuliano AR, Papenfuss M, Abrahamsen M, et al. Human papillomavirus infection at the United States-Mexico border: implications for cervical cancer prevention and control. Cancer Epidemiol Biomarkers Prev. 2001;10:1129–36. [PubMed] [Google Scholar]
  • 16.Tabrizi SN, Stevens M, Chen S, Rudland E, Kornegay JR, Garland SM. Evaluation of a modified reverse line blot assay for detection and typing of human papillomavirus. Am J Clin Pathol. 2005;123:896–9. doi: 10.1309/MPER-NJ0G-62RE-CHCQ. [DOI] [PubMed] [Google Scholar]
  • 17.Schiffman M, Wheeler CM, Dasgupta A, Solomon D, Castle PE. A comparison of a prototype PCR assay and hybrid capture 2 for detection of carcinogenic human papillomavirus DNA in women with equivocal or mildly abnormal papanicolaou smears. Am J Clin Pathol. 2005;124:722–32. doi: 10.1309/E067-X0L1-U3CY-37NW. [DOI] [PubMed] [Google Scholar]
  • 18.Castle PE, Solomon D, Schiffman M, Wheeler CM. Human papillomavirus type 16 infections and 2-year absolute risk of cervical precancer in women with equivocal or mild cytologic abnormalities. J Natl Cancer Inst. 2005;20(97):1066–71. doi: 10.1093/jnci/dji186. [DOI] [PubMed] [Google Scholar]
  • 19.Schiffman M, Adrianza ME. ASCUS-LSIL Triage Study. Design, methods and characteristics of trial participants. Acta Cytol. 2000;44:726–42. doi: 10.1159/000328554. [DOI] [PubMed] [Google Scholar]
  • 20.Human papillomavirus testing for triage of women with cytologic evidence of low-grade squamous intraepithelial lesions: baseline data from a randomized trial. The Atypical Squamous Cells of Undetermined Significance/Low-Grade Squamous Intraepithelial Lesions Triage Study (ALTS) Group. J Natl Cancer Inst. 2000;92:397–402. doi: 10.1093/jnci/92.5.397. [DOI] [PubMed] [Google Scholar]
  • 21.ASCUS-LSIL Triage Study (ALTS) Group A randomized trial on the management of low-grade squamous intraepithelial lesion cytology interpretations. Am J Obstet Gynecol. 2003;188:1393–400. doi: 10.1067/mob.2003.462. [DOI] [PubMed] [Google Scholar]
  • 22.ASCUS-LSIL Triage Study (ALTS) Group Results of a randomized trial on the management of cytology interpretations of atypical squamous cells of undetermined significance. Am J Obstet Gynecol. 2003;188:1383–92. doi: 10.1067/mob.2003.457. [DOI] [PubMed] [Google Scholar]
  • 23.Solomon D, Schiffman M, Tarone R. Comparison of three management strategies for patients with atypical squamous cells of undetermined significance: baseline results from a randomized trial. J Natl Cancer Inst. 2001;93:293–9. doi: 10.1093/jnci/93.4.293. [DOI] [PubMed] [Google Scholar]
  • 24.Schiffman M, Herrero R, Hildesheim A, et al. HPV DNA testing in cervical cancer screening: results from women in a high-risk province of Costa Rica. JAMA. 2000;283:87–93. doi: 10.1001/jama.283.1.87. [DOI] [PubMed] [Google Scholar]
  • 25.Castle PE, Schiffman M, Burk RD, et al. Restricted cross-reactivity of hybrid capture 2 with nononcogenic human papillomavirus types. Cancer Epidemiol Biomarkers Prev. 2002;11:1394–9. [PubMed] [Google Scholar]
  • 26.Schiffman M, Wheeler CM, Dasgupta A, Solomon D, Castle PE. A comparison of a prototype PCR assay and Hybrid Capture 2 for detection of carcinogenic human papillomavirus DNA in women with equivocal or mildly abnormal Pap smears. Am J Clin Pathol. 2005 doi: 10.1309/E067-X0L1-U3CY-37NW. in press. [DOI] [PubMed] [Google Scholar]
  • 27.Safaeian M, Herrero R, Hildesheim A, et al. Comparison of the SPF10/LiPA System to the HC2 Assay for Detection of Carcinogenic HPV Genotypes among 5683 Young Women in Guanacaste, Costa Rica. J Clin Microbiol. 2007 doi: 10.1128/JCM.02580-06. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Gravitt PE, Burk RD, Lorincz A, et al. A comparison between real-time polymerase chain reaction and hybrid capture 2 for human papillomavirus DNA quantitation. Cancer Epidemiol Biomarkers Prev. 2003;12:477–84. [PubMed] [Google Scholar]
  • 29.Castle PE, Gravitt PE, Solomon D, Wheeler CM, Schiffman M. A Comparison of Linear Array and Line Blot Assay for Detection of HPV and Cervical Precancer and Cancer in the ASCUS LSIL Triage Study. J Clin Microbiol. 2007 [Google Scholar]
  • 30.Castle PE, Sadorra M, Garcia F, Holladay EB, Kornegay J. Pilot Study of a Commercialized Human Papillomavirus (HPV) Genotyping Assay: Comparison of HPV Risk Group to Cytology and Histology. J Clin Microbiol. 2006;44:3915–7. doi: 10.1128/JCM.01305-06. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Castle PE, Gravitt PE, Solomon D, Wheeler CM, Schiffman M. A Comparison of Linear Array and Line Blot Assay for Detection of HPV and Cervical Precancer and Cancer in the ASCUS LSIL Triage Study. J Clin Microbiol. 2007 [Google Scholar]
  • 32.Bosch FX, Manos MM, Munoz N, et al. Prevalence of human papillomavirus in cervical cancer: a worldwide perspective. International biological study on cervical cancer (IBSCC) Study Group. J Natl Cancer Inst. 1995;87:796–802. doi: 10.1093/jnci/87.11.796. [DOI] [PubMed] [Google Scholar]
  • 33.Cogliano V, Baan R, Straif K, Grosse Y, Secretan B, El Ghissassi F. Carcinogenicity of human papillomaviruses. Lancet Oncol. 2005;6:204. doi: 10.1016/s1470-2045(05)70086-3. [DOI] [PubMed] [Google Scholar]
  • 34.Safaeian M, Herrero R, Hildesheim A, et al. Comparison of the SPF10/LiPA System to the HC2 Assay for Detection of Carcinogenic HPV Genotypes among 5683 Young Women in Guanacaste, Costa Rica. J Clin Microbiol. 2007 doi: 10.1128/JCM.02580-06. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Stoler MH, Schiffman M. Interobserver reproducibility of cervical cytologic and histologic interpretations: realistic estimates from the ASCUS-LSIL Triage Study. JAMA. 2001;285:1500–5. doi: 10.1001/jama.285.11.1500. [DOI] [PubMed] [Google Scholar]
  • 36.Leisenring W, Alonzo T, Pepe MS. Comparisons of predictive values of binary medical diagnostic tests for paired designs. Biometrics. 2000;56:345–51. doi: 10.1111/j.0006-341x.2000.00345.x. [DOI] [PubMed] [Google Scholar]
  • 37.Guido R, Schiffman M, Solomon D, Burke L. Postcolposcopy management strategies for women referred with low-grade squamous intraepithelial lesions or human papillomavirus DNA-positive atypical squamous cells of undetermined significance: a two-year prospective study. Am J Obstet Gynecol. 2003;188:1401–5. doi: 10.1067/mob.2003.456. [DOI] [PubMed] [Google Scholar]
  • 38.Khan MJ, Castle PE, Lorincz AT, et al. The elevated 10-year risk of cervical precancer and cancer in women with human papillomavirus (HPV) type 16 or 18 and the possible utility of type-specific HPV testing in clinical practice. J Natl Cancer Inst. 2005;20(97):1072–9. doi: 10.1093/jnci/dji187. [DOI] [PubMed] [Google Scholar]
  • 39.Naucler P, Ryd W, Tornberg S, et al. HPV type-specific risks of high-grade CIN during 4 years of follow-up: A population-based prospective study. Br J Cancer. 2007 doi: 10.1038/sj.bjc.6603843. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Bulk S, Berkhof J, Bulkmans NW, et al. Preferential risk of HPV16 for squamous cell carcinoma and of HPV18 for adenocarcinoma of the cervix compared to women with normal cytology in The Netherlands. Br J Cancer. 2006;94:171–5. doi: 10.1038/sj.bjc.6602915. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Bulkmans NW, Bleeker MC, Berkhof J, Voorhorst FJ, Snijders PJ, Meijer CJ. Prevalence of types 16 and 33 is increased in high-risk human papillomavirus positive women with cervical intraepithelial neoplasia grade 2 or worse. Int J Cancer. 2005;117:177–81. doi: 10.1002/ijc.21210. [DOI] [PubMed] [Google Scholar]
  • 42.Schiffman M, Herrero R, Desalle R, et al. The carcinogenicity of human papillomavirus types reflects viral evolution. Virology. 2005;20(337):76–84. doi: 10.1016/j.virol.2005.04.002. [DOI] [PubMed] [Google Scholar]
  • 43.Kjaer SK, van den Brule AJ, Paull G, et al. Type specific persistence of high risk human papillomavirus (HPV) as indicator of high grade cervical squamous intraepithelial lesions in young women: population based prospective follow up study. BMJ. 2002;325:572. doi: 10.1136/bmj.325.7364.572. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Liaw KL, Glass AG, Manos MM, et al. Detection of human papillomavirus DNA in cytologically normal women and subsequent cervical squamous intraepithelial lesions. J Natl Cancer Inst. 1999;91:954–60. doi: 10.1093/jnci/91.11.954. [DOI] [PubMed] [Google Scholar]
  • 45.Castle PE, Gravitt PE, Solomon D, Wheeler CM, Schiffman M. A Comparison of Linear Array and Line Blot Assay for Detection of HPV and Cervical Precancer and Cancer in the ASCUS LSIL Triage Study. J Clin Microbiol. 2007 [Google Scholar]
  • 46.Smith JS, Lindsay L, Hoots B, et al. Human papillomavirus type distribution in invasive cervical cancer and high-grade cervical lesions: a meta-analysis update. Int J Cancer. 2007;121:621–32. doi: 10.1002/ijc.22527. [DOI] [PubMed] [Google Scholar]
  • 47.Castle PE, Stoler MH, Solomon D, Schiffman M. The Relationship of Community Biopsy-Diagnosed Cervical Intraepithelial Neoplasia Grade 2 to the Quality Control Pathology-Reviewed Diagnoses:An ALTS Report. Am J Clin Pathol. 2007;127:805–15. doi: 10.1309/PT3PNC1QL2F4D2VL. [DOI] [PubMed] [Google Scholar]
  • 48.Castle PE, Gravitt PE, Solomon D, Wheeler CM, Schiffman M. Comparison of linear array and line blot assay for detection of human papillomavirus and diagnosis of cervical precancer and cancer in the atypical squamous cell of undetermined significance and low-grade squamous intraepithelial lesion triage study. J Clin Microbiol. 2008;46:109–17. doi: 10.1128/JCM.01667-07. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Castle PE, Lorincz AT, Mielzynska-Lohnas I, et al. Results of human papillomavirus DNA testing with the hybrid capture 2 assay are reproducible. J Clin Microbiol. 2002;40:1088–90. doi: 10.1128/JCM.40.3.1088-1090.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Terry G, Ho L, Londesborough P, Cuzick J, Mielzynska-Lohnas I, Lorincz A. Detection of high-risk HPV types by the hybrid capture 2 test. J Med Virol. 2001;65:155–62. [PubMed] [Google Scholar]
  • 51.Ronco G, Segnan N, Giorgi-Rossi P, et al. Human papillomavirus testing and liquid-based cytology: results at recruitment from the new technologies for cervical cancer randomized controlled trial. J Natl Cancer Inst. 2006;98:765–74. doi: 10.1093/jnci/djj209. [DOI] [PubMed] [Google Scholar]
  • 52.Cuzick J, Clavel C, Petry KU, et al. Overview of the European and North American studies on HPV testing in primary cervical cancer screening. Int J Cancer. 2006;119:1095–101. doi: 10.1002/ijc.21955. [DOI] [PubMed] [Google Scholar]

RESOURCES