Skip to main content
AACR Open Access logoLink to AACR Open Access
. 2021 Jun 9;27(19):5307–5316. doi: 10.1158/1078-0432.CCR-21-0293

A NGS-based Blood Test For the Diagnosis of Invasive HPV-associated Carcinomas with Extensive Viral Genomic Characterization

Xavier Sastre-Garau 1,2, Mamadou Diop 3, Fernando Martin 4, Gilles Dolivet 5,6, Frédéric Marchal 5,6, Claire Charra-Brunaud 7, Didier Peiffert 5,7, Léa Leufflen 6, Birama Dembélé 3, Jessica Demange 1, Priscillia Tosti 8, Jacques Thomas 1, Agnès Leroux 1, Jean-Louis Merlin 1,5, Halimatou Diop-Ndiaye 3, Jean-Marc Costa 4, Julia Salleron 9, Alexandre Harlé 1,5,*
PMCID: PMC9401522  PMID: 34108183

Abstract

Purpose:

Use of circulating tumor DNA (ctDNA) for diagnosis is limited regarding the low number of target molecules in early-stage tumors. Human papillomavirus (HPV)–associated carcinomas represent a privileged model using circulating viral DNA (ctHPV DNA) as a tumor marker. However, the plurality of HPV genotypes represents a challenge. The next-generation sequencing (NGS)-based CaptHPV approach is able to characterize any HPV DNA sequence. To assess the ability of this method to establish the diagnosis of HPV-associated cancer via a blood sample, we analyzed ctHPV DNA in HPV-positive or HPV-negative carcinomas.

Experimental Design:

Patients (135) from France and Senegal with carcinoma developed in the uterine cervix (74), oropharynx (25), oral cavity (19), anus (12), and vulva (5) were prospectively registered. Matched tumor tissue and blood samples (10 mL) were taken before treatment and independently analyzed using the CaptHPV method.

Results:

HPV prevalence in tumors was 60.0% (81/135; 15 different genotypes). Viral analysis of plasmas compared with tumors was available for 134 patients. In the group of 80 patients with HPV-positive tumors, 77 were also positive in plasma (sensitivity 95.0%); in the group of 54 patients with HPV-negative tumors, one was positive in plasma (specificity 98.1%). In most cases, the complete HPV pattern observed in tumors could be established from the analysis of ctHPV DNA.

Conclusions:

In patients with carcinoma associated with any HPV genotype, a complete viral genome characterization can be obtained via the analysis of a standard blood sample. This should favor the development of noninvasive diagnostic tests providing the identification of personalized tumor markers.

See related commentary by Rostami et al., p. 5158


Translational Relevance.

There is a large heterogeneity of oncogenic HPV genotypes and the interaction between viral and cell genomes frequently leads to genomic alterations implied in oncogenesis. The CaptHPV NGS-based innovative approach allows the extensive molecular characterization of any HPV DNA, including its full sequence (genotype), integration pattern, and chromosomal insertion site. We show here, via a systematic prospective study, that the HPV DNA pattern characterizing tumor cells can be identified from a standard blood sample by the analysis of circulating viral tumor DNA using this test. This allows a highly sensitive and specific noninvasive procedure for the characterization of viral sequences in patients with HPV-associated cancer. In practice, this approach should facilitate the diagnosis of deeply located tumor relapse. Furthermore, the specific tumor markers obtained via this approach can be useful for the biological follow-up of patients, as circulating and dynamic surrogates of tumor response in innovative therapeutic approaches.

Introduction

Numerous applications that identify circulating tumor DNA (ctDNA) as a diagnostic marker in oncology are under development (1–3). The current sensitivity rate of ctDNA detection for localized tumors is between 59% and 73% (1, 2). However, these methods of detection have limitations due to their inability to detect low levels of ctDNA fragments harboring point mutations dispersed among germline DNA which affects the overall detection of early-stage tumors (4).

Tumors associated with human papillomaviruses (HPV) represent an ideal model for the detection of ctDNA. Most carcinomas (95%) developed in the uterine cervix (5) or the anal canal (6) and 20%–30% of the tumors developed in the oropharynx (7, 8) or the vulva (9, 10) are associated with specific HPV genotypes. The HPV genome, a 7.8 kbp-long circular DNA molecule, is present in the nucleus of tumor cells as free episomes and/or as an integrated form into the cell genome. The viral genome is identified in the host with copy numbers varying from a few to thousands per cell which means that HPV DNA, released in the blood from tumor cells, is identified as foreign DNA and is more readily detected than rare circulating genomic DNA fragments with point mutations. Therefore, using droplet-digital PCR (ddPCR) with primers specific for HPV16 or HPV18, circulating HPV DNA could be detected in 71.2% to 95.2% of patients with carcinomas associated with these viral genotypes (11–13) and up to 100% in locally advanced (14) or metastatic (15) cervical tumors. No circulating viral DNA was found in nontumor patients (13) or in patients with intraepithelial neoplasia (12), indicating that ctHPV DNA constitutes a specific form of ctDNA, referred to as ctHPV DNA, specifically associated with invasive HPV-associated carcinomas that can serve as a tumor marker for improved diagnosis, prognosis, and treatment monitoring (16, 17).

In spite of this favorable context, the use of HPV DNA as a diagnostic and/or predictive marker is not yet fully developed. This is related first to the large diversity of the HPV genotypes associated with tumors. Among the hundreds of HPV types identified so far (18), at least 13 genotypes, classified as “high-risk”, including HPV16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, and 68, cause virtually all cases of HPV-associated cancers (19). Therefore, a methodologic approach designed to allow the diagnosis of HPV-associated tumors using a blood sample should be able to detect all of these genotypes. In addition, the identification of specific tumor markers such as viral-host DNA sequences (20), detectable in the blood (21) and of potential clinical relevance (22, 23) requires the full characterization of the viral sequences.

We have described the NGS-based CaptHPV method developed for the capture and the extensive characterization of all HPV DNA sequences identified in DNA extracted from tumor tissues (24). In order to further investigate whether this original method was also able to detect and characterize ct-HPV DNA, we designed a prospective study aiming to, first, demonstrate that, without knowledge of the tumor HPV status, our CaptHPV NGS-based method is able to detect ct-HPV DNA related to any HPV genotype from a blood specimen taken from patients with different types of HPV-associated carcinomas, in European and African populations, and, secondly, to show that the CaptHPV technique can provide a full molecular characterization of the circulating viral DNA sequences, including a map of the entire viral genome and of flanking cellular sequences related to viral integration.

Materials and Methods

Study design

This CaptHPV (NCT02981862) prospective study was performed at the Institut de Cancérologie de Lorraine (ICL), Nancy, France, and at the Institut du Cancer Joliot Curie (ICJC), Centre Hospitalier Aristide Le Dantec, Dakar, Sénégal. Two populations of patients were included: a series of 100 consecutive patients treated at the ICL in Nancy, France, for a tumor developed in the uterine cervix, anal canal, vulva, oral cavity, or oropharynx and a series of 50 consecutive patients treated at the ICJC, Dakar, Senegal, for a tumor developed in the uterine cervix. We collected simultaneously a tumor tissue fragment for histologic and virological analyses and a blood sample for virological analysis. Fifteen patients were excluded regarding irrelevance in histology (8) or inclusion criteria (4), or due to lack of blood samples (2) or of patient's consent (1). Altogether, the study was based on 135 invasive carcinoma cases with available tumor and blood samples. The clinical data registered includes patients' ages, tumor localizations, tumor sizes, tumor–node–metastasis (TNM) and/or Federation Internationale des Gynaecologistes et Obstetristes (FIGO) stages. Study was conducted in accordance with the Declaration of Helsinki. Informed written consent was obtained from each subject. The protocols received agreements from the Comité de Protection des Personnes (CPP) EST III (N° 16.04.04) and from the Agence Nationale de Sécurité du Médicament et des produits de Santé (ANSM; N° 2016-A01085–46) for the patients treated in Nancy, France, and from the Comité National de la Recherche en Santé du Sénégal for the patients treated in Dakar (Sénégal).

Procedures and strategy for analysis

The viral analysis of tumor tissues combined three tests: p16 IHC, PCR and CaptHPV methods. The tumor viral status was classified as “HPV-positive” when at least two of these tests provided positive result. Among 12 HPV-positive tumors with only two positive tests, there were 10 p16+/PCR-/CaptHPV+ cases, one p16-/PCR+/CaptHPV+ and one p16+/PCR+/CaptHPV- case. When none or only one test was positive, the tumor was classified as “HPV-negative”. The viral analysis of plasmas was performed using the CaptHPV method. The analyses were performed independently in three laboratories: (i) Histologic and immunophenotypic (p16) analyses were performed on formalin-fixed tissues in the Laboratory of Pathology (A. Leroux), ICL, Nancy, France; (ii) HPV DNA analyses on tumor tissue, using PCR and CaptHPV methods, were performed in the Tumor Biology Unit (J.-L. Merlin), ICL, Nancy; (iii) HPV DNA detection in cell-free DNA extracts from plasma specimens using the CaptHPV method were performed in the CERBA laboratory (J.-M. Costa), Saint-Ouen-L'Aumône, France. Results were blindly registered on a data base. Details on methods and regulatory aspects are provided in Supplementary Data I.

Statistical analyses

Statistical analyses were performed using SAS software, v9.4 (SAS Institute Inc., Cary, NC 25513). Qualitative parameters were described as frequency and percentage, quantitative parameters as mean and standard deviation or median and interquartile range according to the normality of the distribution assessed by the Shapiro–Wilk test. Comparisons according to HPV genotypes were performed with the χ2 test or Fisher exact test. Sensitivity and specificity of the CaptHPV blood test were computed with tumor viral DNA status as the gold standard. The sensitivities of the CaptHPV blood tests were compared between clinical stages with the Mac Nemar test within the HPV positive cases in tumors. P-values <0.05 were considered statistically significant.

Results

Tumor localization and histology

This case panel is comprised of 135 invasive carcinomas, developed in the cervix (74 cases including 28 from ICL, Nancy and 46 from ICJC, Dakar), oropharynx (25 cases), oral cavity (19 cases), anus (12 cases), and vulva (5 cases; Table 1). Histologically, we observed 117 squamous cell carcinomas (SCC, 86.7%), 7 adenocarcinomas (5.2%), 4 undifferentiated carcinomas (3%), and 7 cases with other histologic types (5.2%), including three small cell carcinoma, two cases of adenosquamous carcinoma, one verrucous, and one glassy cell carcinoma. Clinical data are provided in Table 1.

Table 1.

Clinical and virological data in invasive carcinomas.

Characteristics ICL (n = 89) ICJC (n = 46) All cases
Patients' age 59.7 ± 11.1 52.0 ± 11.2 57.1 ± 11.7
Tumor localization
 Cervix 28 (31.5%) 46 (100%) 74 (54.8%)
 Oropharynx 25 (28.1%) 25 (28.1%)
 Oral cavity 19 (21.4%) 19 (21.4%)
 Anal canal 12 (13.5%) 12 (13.5%)
 Vulva 5 (5.6%) 5 (5.6%)
Clinical tumor size (mm) 32 [27–51] 47.5 [40–52] 42 [30–52]
Tumor stage (TNM)
 T1 4 (4.5%) 0 (0%) 4 (3.0%)
 T2 16 (18.0%) 3 (6.5%) 19 (14.1%)
 T3 38 (42.7%) 27 (58.7%) 65 (48.1%)
 T4 16 (18.0%) 15 (32.6%) 31 (23.0%)
 TX 15 (16.8%) 1 (2.2%) 16 (11.8%)
 N0 47 (52.8%) NA 47 (52.8%)
 N1 17 (19.1%) NA 17 (19.1%)
 N2 18 (21.2%) NA 18 (21.2%)
 N3/N4 3 (3.5%) NA 3 (3.5%)
 M0 81 (94.2%) 46 (100%) 127 (96.2%)
 M1 5 (5.8%) 0 (0%) 5 (5.8%)
Histology
 SCC 82 (92.1%) 35 (76.1%) 117 (86.7%)
 ADC 3 (3.4%) 4 (8.7%) 7 (5.2%)
 UC 1 (1.1%) 3 (6.5%) 4 (3.0%)
 Others 3 (3.4%) 4 (8.7%) 7 (5.2%)
HPV-positive cases
 Cervix 24 (85.7%) 39 (84.8%) 63 (85.1%)
 Oropharynx 3 (12.0%) 3 (12.0%)
 Oral cavity 2 (10.5%) 2 (10.5%)
 Anal canal 12 (100%) 12 (100%)
 Vulva 1 (20.0%) 1 (20.0%)
HPV physical state
 Episomal (E) 10 (23.8%) 10 (25.6%) 20 (24.7%)
 Integrated ± (E) 31 (73.8%) 24 (61.6%) 55 (67.9%)
 NA 1 (2.4%) 5 (12.8%) 6 (7.4%)

Abbreviations: ADC, adenocarcinoma; NA, not available; UC, undifferentiated carcinoma.

HPV DNA detection in tumors

The prevalence of HPV DNA in tumors was 60.0% (81/135; Table 1). We observed HPV DNA in 85.1% (63/74) of cervical, 100% (12/12) of anal, 20.0% (1/5) of vulvar, 12.0% (3/25) of oropharyngeal, and 10.5% (2/19) of oral tumors. One p16+/PCR+/CaptHPV- anal cancer case was classified as HPV positive. Sequence analysis provided by CaptHPV identified 15 different HPV genotypes: HPV16 (45 cases), HPV18 (11 cases), HPV45 (7 cases), HPV 51 (5 cases), HPV31 (3 cases), HPV33 (2 cases), and single cases of HPV11, 35, 39, 52, 53, 56, 59, 68, and 69 (Table 2). Two different HPV genotypes were identified in six cases. The viral genome existed in a nonintegrated episomal state in 24.7% of all cases and in an integrated state in the cell genome, with or without episomes, in 67.9% cases (Table 1). Viral DNA integration was observed in 70.8% (34/48) of the HPV16-associated cases, 76.5% (13/17) for HPV18/45, and 55.6% (10/18) for the other genotypes. When comparing the respective prevalence of the viral genotypes in cervical cancers in the French and Senegalese populations, HPV16 was more frequent in France (36/47 = 76.2%) than in Senegal (14/42 = 33.3%; P = 0.001) whereas the prevalence was higher in Senegal for HPV18 (8/4 = 19.1% vs. 3/47 = 6.4%; P = 0.070), HPV45 (6/42 = 14.3% vs. 1/47 = 2.1%; P = 0.049), and HPV51 (5/42 = 11.9% vs. 0%; P = 0.020; Table 2).

Table 2.

Detailed data for each patient included in the study.

graphic file with name 5307tbl2.jpg

Comparison between HPV status in tumors and plasmas

The main objective of our project was to assess the sensitivity of the CaptHPV test for the detection of ctHPV DNA corresponding to various HPV genotypes in patients with different tumor localizations. Viral analysis of plasmas compared with tumors, available for 134 patients, showed that, in the group of 80 patients with HPV-positive tumors, 77 were also positive in plasma (sensitivity 95.0%; Table 3); in the group of 54 patients with HPV-negative tumors, one was positive in plasma (specificity 98.1%; Table 3). A positive relationship was found between clinical stage and sensitivity of the test which was 72.7% for T1 stage tumors, 95.9% for T2, and 100% for T3/T4 (P = 0.012; Table 3). All tumors with positive lymph node or metastasis were ctHPV DNA positive (sensitivity 100%, specificity 97.4%). We also identified the same genotypes within the tumor and plasma matched samples. Among the six tumors harboring two HPV genotypes, the analysis of matched plasmas found only one genotype in three and the two genotypes in three (Table 2).

Table 3.

Sensitivity and specificity of CaptHPV blood test according to tumor localization and clinical stage.

HPV-positive cases
Population No. of cases Tumors Blood Sensitivity Specificity
All cases 134 80 77 95.0% (76/80) 98.1% (53/54)
Cervix 73 62 60 96.8% (60/62) 100% (11/11)
Oropharynx 25 3 4 100% (3/3) 95.5% (21/22)
Oral cavity 19 2 2 100% (2/2) 100% (17/17)
Anal canal 12 12 10 83.3% (10/12)
Vulva 5 1 1 100% (1/1) 100% (4/4)
T1 19 11 8 72.7% (8/11) 100% (8/8)
T2 65 47 46 97.9% (46/47) 100% (18/18)
T3 30 18 19 100% (18/18) 91.7% (11/12)
T4 16 3 3 100% (3/3) 100% (13/13)
Tx 4 1 1 100% (1/1) 100% (3/3)
N0 47 29 26 89.7% (26/29) 100% (18/18)
N+ 38 12 13 100% (12/12) 96.1% (25/26)
Nx 4 1 1 100% (1/1) 100% (3/3)
M0 126 79 76 94.9% (75/79) 97.9% (46/47)
M1 5 1 1 100% (1/1) 100% (4/4)
Mx 3 0 0 100% (3/3)

HPV patterns identified from the analysis of plasma samples

The second aim of our study was to evaluate whether, from a blood sample analysis, CaptHPV could determine the HPV pattern and therefore identify specific tumor markers. The comparison between tumor and plasma HPV status could be performed in 76/80 cases. Analysis of the full viral sequences permitted identification of single-nucleotide polymorphism (SNP) and indels, a step allowing further characterization of each individual HPV strain and therefore preventing any false positive results (all SNPs and indels are presented in Supplementary Fig. S1). Regarding the integration status, viral genomes were detected in their full length corresponding to episomal form in both tumor and plasma in 8 cases (Fig. 1A; Table 2). In the other cases, hybrid viral-genome sequences, corresponding to an integrated HPV status with or without episomal forms, were detected in tumors and/or plasmas (Table 2). The case by case comparison showed that there was one single integration site in 34 cases. In 20 of them, the integration locus was identical in tumors and in plasmas (Fig. 1B), whereas in 14 cases, only the episomal form of the viral genome was detected in the matched specimen (Fig. 1C). Other cases harbored multiple integration sites, either clustered at the same locus (three cases; Fig. 1D) or scattered into different chromosome sites (31 cases; Fig. 1E). There were 58 hybrids identified in tumors and 60 in plasmas, among which 40 were commonly shared in the two types of specimens. In 4 cases, noncommon hybrids between tumor and blood sample were found (Fig. 1F). All integration patterns are provided in Supplementary Fig. S2 and molecular coordinates of the hybrid viral-genome sequences in tumors and plasmas are provided in Supplementary Table S1.

Figure 1.

Figure 1. Examples of the respective HPV status found in tumor and plasma DNA samples from the same patient, using the CaptHPV technique. A, Only episomal form of the viral genome with 50% common SNPs found in both tumor and plasma; B, Identical hybrid viral-genome sequences corresponding to a single HPV integration site found in the two specimens; C, Hybrid viral-genome detected in tumor DNA corresponding to a unique integration site, whereas only viral episomes found in plasma; D, Multiple viral-cell junctions clustered at the same chromosomal locus in tumor and plasma; E, Multiple hybrids corresponding to HPV integration loci scattered at different chromosome sites in tumor and plasma; F, Different hybrids corresponding to distinct viral integration sites detected in tumor and plasma. Names of target genes are in red. A double bar indicates that the HPV insertion is not within the gene locus and the closest gene is indicated in red. Hg38 reference genome has been used for the genomic coordinates indicated below the HPV box and the chromosomal loci. HPV breakpoints are reported above the HPV box. Hybrids or SNPs shared in common in tumor and plasma samples are indicated by a pink-colored box.

Examples of the respective HPV status found in tumor and plasma DNA samples from the same patient, using the CaptHPV technique. A, Only episomal form of the viral genome with 50% common SNPs found in both tumor and plasma; B, Identical hybrid viral-genome sequences corresponding to a single HPV integration site found in the two specimens; C, Hybrid viral-genome detected in tumor DNA corresponding to a unique integration site, whereas only viral episomes found in plasma; D, Multiple viral-cell junctions clustered at the same chromosomal locus in tumor and plasma; E, Multiple hybrids corresponding to HPV integration loci scattered at different chromosome sites in tumor and plasma; F, Different hybrids corresponding to distinct viral integration sites detected in tumor and plasma. Names of target genes are in red. A double bar indicates that the HPV insertion is not within the gene locus and the closest gene is indicated in red. Hg38 reference genome has been used for the genomic coordinates indicated below the HPV box and the chromosomal loci. HPV breakpoints are reported above the HPV box. Hybrids or SNPs shared in common in tumor and plasma samples are indicated by a pink-colored box.

Annotations of the HPV insertions

In HPV-associated carcinoma, the hybrid viral-genome sequences map at different chromosomal loci. We identified HPV DNA insertion at 140 different chromosomal loci in tumors or in plasma samples (Table 2 and Fig. 1). Viral sequences were found inserted within coding sequences in 93 loci (66.4%) or within 500 Kb from a known gene in 38 cases (27.1%). Recurrent integrations (two cases each) were found within CASC21, INPP4B, MAPK10, VMP1, NFIA, and near PIBF1-KLF1-KLF12. Interestingly, the two cases with viral insertions within CASC21 corresponded to HPV18-associated small cell carcinoma of the cervix, a very rare histologic type. In one of these cases (02–028), viral-genome junctions were located at each extremity of the CASC21 exon 2 which was deleted, and, in the second case, viral insertion occurred in the first intron of the gene (Fig. 2). Among the other genes directly targeted by HPV integration and that have not been reported thus far were TEX41, RBM47, IGF1, RAD51L3, RPTOR, IL1RAPL1.

Figure 2.

Figure 2. Virologic data from plasma analyses (right) in comparison with tumor histology (left) in patients with cervical carcinoma. SCC (A) with circulating HPV39 DNA sequences covering the whole viral genome (episomal form). Two cases of small-cell carcinoma with circulating HPV18 DNA sequences showing viral DNA inserted within the CASC21 gene, between exon 1 and exon 3 in B with gene disruption and loss of the exon 2, and between exon 1 and exon 2 in C. D, SCC with circulating HPV31 DNA sequences showing viral DNA inserted at the 5q32 chromosomal band with a complex pattern involving the CAM2KA, SLC6A7, CSF1R, and CDX1 genes located at this locus.

Virologic data from plasma analyses (right) in comparison with tumor histology (left) in patients with cervical carcinoma. SCC (A) with circulating HPV39 DNA sequences covering the whole viral genome (episomal form). Two cases of small-cell carcinoma with circulating HPV18 DNA sequences showing viral DNA inserted within the CASC21 gene, between exon 1 and exon 3 in B with gene disruption and loss of the exon 2, and between exon 1 and exon 2 in C. D, SCC with circulating HPV31 DNA sequences showing viral DNA inserted at the 5q32 chromosomal band with a complex pattern involving the CAM2KA, SLC6A7, CSF1R, and CDX1 genes located at this locus.

Discussion

The aims of our project were to demonstrate that, from the analysis of a standard blood sample, our original NGS-based CaptHPV method was able to detect ct-HPV DNA related to any HPV genotype and provide a full characterization of the circulating viral DNA. Our prospective study, including patients from France and Senegal, shows that, using this method, circulating viral DNA from 15 different HPV genotypes could be detected in patients with different types of HPV-associated carcinomas with a 95% rate of sensitivity and 98.1% of specificity. The approach further provided the full characterization of the viral pattern, allowing the identification of specific tumor markers, including cellular genes targeted by viral DNA insertion. These data should favor the development of noninvasive tests for the diagnosis of HPV-associated invasive cancers and for the identification of personalized tumor markers. These data constitute important steps for the clinical validation of the liquid biopsy approach to establish the diagnosis of invasive HPV-associated carcinoma. For instance, in the follow-up of patients previously treated for an HPV-associated carcinoma, the diagnosis of relapse may be difficult to obtain in cases of deeply located tumor growth that require micro-biopsies or fine needle aspirations, procedures that can lead to adverse events. In these circumstances, the “liquid biopsy” approach (25) may represent an attractive alternative. Regarding the use of specific tumor markers in the follow-up of patients with HPV-associated tumors, the differential diagnosis between a metastasis or a second primary tumor may be facilitated by the DNA sequence marker evidence showing identical HPV insertional signatures in both lesions (26).

Our study has certain limitations: no plasma samples from patients without tumors or from patients with different types of intraepithelial neoplasias were included in our study. The analysis of such samples using the CaptHPV assay would have reinforced the specificity of this approach and confirmed that the presence of ct-HPV DNA is the surrogate of an invasive tissular lesion. In addition, the NGS-based approach is more complex and expensive than the ddPCR technique which has equivalent sensitivity (11–15). Unlike the NGS approaches, prior knowledge of the viral sequences to be detected is required for ddPCR and this method is also limited by the number of targets that can be simultaneously detected. Therefore, ddPCR approach is not appropriate to analyze ctDNA straightforwardly and in a single step when the personalized targets (e.g., hybrids viral/host DNA or rare HPV genotypes sequences) have not been previously identified. This limitation accounts for the fact that we have not been able to compare ddPCR and NGS in the present prospective analysis of plasma samples. Further study, including multiplex ddPCR assays, will be necessary to compare the ability of the two methods to detect circulating viral DNA from any HPV genotype, and to assess their respective sensitivity. There is currently growing evidence that analyses of ctHPV DNA at the end of treatment (27) or during patients' follow-up (28) may facilitate early initiation of salvage therapy for tumor relapse. Obviously, sequential analyses of plasma during the biological follow-up of patients should be based on simple and inexpensive techniques. However we show that the full characterization of the HPV status, including genotyping, complete sequence, and insertion pattern, obtained from the analysis of a mere blood specimen, may represent an important preliminary step to identify markers of clinical relevance (23) or to verify the adequacy of the primers to be used in sequential analyses. In addition, the identification of the cellular genes altered by integration may point to potential therapeutic targets. As an example, two cases of cervical carcinoma harboring HPV DNA sequences integrated at the ERBB2 locus (29) and associated with ERBB2 amplification (30) have been recently reported. A limitation in the identification of tumor markers lies in the fact that tumors solely harboring HPV episomes do not present specific viral genome rearrangements or hybrids that may be detected specifically in the tumor or in the blood. However, the HPV genotype constitutes per se a diagnostic signature (31), and, in addition, HPV polymorphism, that is, single nucleotide variants and insertion or deletions identified via the full sequencing of the viral DNA can accurately characterize a “personalized HPV strain” for each patient (32). Nevertheless, the same virus strain can lead to the development of distinct tumors in a patient. We must also emphasize that our study based on an extensive NGS-based analysis of tumors and blood samples found 14.8% of HPV-negative cervical cancers, a rate slightly higher than the 9.8% and 13.0% rates recently reported (14, 33). Tumors of nonsquamous histology were slightly overrepresented in our cases. Several parameters, such as methodologic limitations or the truncation of viral sequences have been hypothesized to account for false negative results in the detection of HPV-associated tumors (34). Our data do not support the hypothesis of false negativity related to structural alterations of the viral genome and cervical cancers, especially of the glandular phenotype, may develop independently of viral oncogenesis (33, 34). Large scale molecular analyses should help to identify the alterations that characterize HPV-negative cervical carcinomas and provide a more accurate assessment of the prevalence of these tumors, ruling out the possibility that false positive results might have led to overestimates of the rate of HPV-associated cervical cancers in some studies.

Using NGS-based approaches, several works have reported extensive characterization of tumor-associated HPV DNA (35–38) but data on the analysis of ct-HPV DNA are scarce. In their detection of circulating viral DNA in patients with HPV16-associated head and neck tumors, Lee and colleagues have described an original NGS approach based on the use of a panel of 39 amplicons covering thirty-four distinct regions of the HPV16 genome (39). A 100% rate of detection of ct-HPV DNA has been obtained in this series of advanced stage tumors. Such an approach is particularly well adapted to the monitoring of patients with head & neck tumors regarding the high prevalence of HPV16 in this localization. However, this method does not allow the identification of viral integration loci and of other HPV genotypes, also observed in a limited number of head & neck tumors (40).

The systematic description of a detailed viral status in HPV-associated cancers should also increase our knowledge of HPV-related oncogenesis. We found one cervical cancer case associated with circulating HPV69 DNA, a genotype still classified as “potentially oncogenic in humans” (19). In our Senegalese population of patients with cervical cancer, we also observed three cases of small cell carcinomas, a rare histological type with severe outcome. Circulating HPV18 DNA was detected in these three cases, and, in two of them, viral sequences were found integrated at the 8q24.21 locus, targeting the long noncoding RNA (lncRNA) homosapiens cancer susceptibility 21 (CASC21) sequences. This lncRNA, also identified in colon carcinogenesis (41) and recently recognized as an HPV integration site (42), acts as a competing endogenous RNA to sponge miR-7–5p, a micro RNA able to impair DNA damage repair through PARP1 and BRCA1 inhibition. The consecutive cell apoptosis accounts for the tumor suppressive properties observed for miR-7–5p (41), also recognized as a mediator of chemo-resistance in small cell carcinomas of the lung (43). Our recurrent observation of HPV18 integrants that target CASC21 in small cell carcinomas of the cervix might help decipher the oncogenesis of this poorly documented tumor (44).

Whether HPV integration acts in carcinogenesis via the alteration of cellular genes remains a subject of debate (45, 46) but the role of viral mutational insertion in oncogenesis has been well documented in other models. For instance, it was recently reported that the HTLV-1/BLV proviruses insertion acts early in leukemogenesis via the cis-perturbation of driver genes (47). Three of the driver genes targeted by HTLV1 integration, CDX1, KLF12, KMT2C, were also the target of HPV insertions in our case panel and corresponding hybrids were identified in the blood of patients. The extent of the NGS-based tumor-associated HPV DNA analyses to the characterization of ctHPV DNA should be of value not only for diagnostic purposes, but also to facilitate the identification of specific tumor markers that may point to deregulated pathways (23, 48) or that allows optimal characterization of the viral sequences that constitute potential therapeutic targets (49).

We report that the detection of ct-HPV DNA and the characterization of the viral pattern in HPV-associated invasive carcinomas can be achieved via the analysis of a standard blood sample with a high level of sensitivity and specificity, whatever the tumor localization and the viral genotype. The clinical validation of the “liquid biopsy approach” in HPV-associated tumors should be helpful in certain circumstances to avoid more invasive diagnostic procedures. We show in addition that the complete characterization of the viral sequences provides the identification of specific tumor markers, and, potentially, of pathway disorders. Finally, our CaptHPV approach could be extended, using the same basic procedure, to capture and characterize other viral DNA/RNA sequences implicated in oncogenesis, such as MCPyV (50), EBV (51), or HTLV1 (52), opening up a systematic approach that provides screening of various viral-associated malignancies.

Authors' Disclosures

A. Harlé reports grants from Institut National du Cancer during the conduct of the study. No disclosures were reported by the other authors.

Supplementary Material

Suppl Figure 1

Supplementary Figure 1: Insertion patterns for all cases harboring HPV DNA integration. Two junctions co-linear (2J-CL) (a), two junctions non-linear (2J-NL) (b), multiple-junctions clustered (MJ-CL) (c) and multiple-junctions scattered (MJ-SC) (d). Insertions are presented with a black line when present in tissue only, a red line when present in plasma only and a dashed black and red line when present in both tissue and plasma. All genomics coordinates use Hg38 reference. Double-dash is used when the insertion is outside an intronic or exonic region of a gene and the closest gene is reported.

Supplementary Data I

Supplementary methods

Supplementary Data II

SNPs and indels for each cases

Supplementary Table 1

Detailed charecteristics and insertions for all cases

Supplementary Legend

Supplementary Legend

Acknowledgments

We are greatly indebted to Allyson Holmes for her critical reading of the manuscript. We thank Alain Nicolas and Christine Bergeron for their help in the design of the project. We also thank Life&Soft for their participation in this project.

The study was funded in part by the Institut National du Cancer (INCa), France (N° 2016–142) and the private Resarch Fund of Institut de Cancérologie de Lorraine.

The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

Footnotes

Note: Supplementary data for this article are available at Clinical Cancer Research Online (http://clincancerres.aacrjournals.org/).

Authors' Contributions

X. Sastre-Garau: Conceptualization, formal analysis, supervision, validation, writing–original draft, writing–review and editing. M. Diop: Investigation. F. Martin: Investigation, writing–review and editing. G. Dolivet: Investigation. F. Marchal: Investigation. C. Charra-Brunaud: Investigation. D. Peiffert: Investigation. L. Leufflen: Investigation. B. Dembélé: Investigation. J. Demange: Formal analysis, investigation. P. Tosti: Project administration. J. Thomas: Investigation. A. Leroux: Investigation. J.L. Merlin: Investigation. H. Diop-Ndiaye: Investigation. J.M. Costa: Investigation. J. Salleron: Data curation, methodology, writing–review and editing. A. Harlé: Conceptualization, data curation, formal analysis, supervision, validation, writing–review and editing.

References

  • 1. Phallen J, Sausen M, Adleff V, Leal A, Hruban C, White J, et al.  Direct detection of early-stage cancers using circulating tumor DNA. Sci Transl Med 2017;9:eaan2415. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Bettegowda C, Sausen M, Leary RJ, Kinde I, Wang Y, Agrawal N, et al.  Detection of circulating tumor DNA in early- and late-stage human malignancies. Sci Transl Med 2014;6:224ra24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Heitzer E, Haque IS, Roberts CES, Speicher MR. Current and future perspectives of liquid biopsies in genomics-driven oncology. Nat Rev Genet 2019;20:71–88. [DOI] [PubMed] [Google Scholar]
  • 4. Cabel L, Decraene C, Bieche I, Pierga JY, Bennamoun M, Fuks D, et al.  Limited Sensitivity of circulating tumor dna detection by droplet digital PCR in non-metastatic operable gastric cancer patients. Cancers 2019;11:396. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Walboomers JM, Jacobs MV, Manos MM, Bosch FX, Kummer JA, Shah KV, et al.  Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. J Pathol 1999;189:12–9. [DOI] [PubMed] [Google Scholar]
  • 6. Baricevic I, He X, Chakrabarty B, Oliver AW, Bailey C, Summers J, et al.  High-sensitivity human papilloma virus genotyping reveals near universal positivity in anal squamous cell carcinoma: different implications for vaccine prevention and prognosis. Eur J Cancer 2015;51:776–85. [DOI] [PubMed] [Google Scholar]
  • 7. Kreimer AR, Clifford GM, Boyle P, Franceschi S. Human papillomavirus types in head and neck squamous cell carcinomas worldwide: a systematic review. Cancer Epidemiol Biomarkers Prev 2005;14:467–75. [DOI] [PubMed] [Google Scholar]
  • 8. Haeggblom L, Ramqvist T, Tommasino M, Dalianis T, Nasman A. Time to change perspectives on HPV in oropharyngeal cancer. A systematic review of HPV prevalence per oropharyngeal sub-site the last 3 years. Papillomavirus Res 2017;4:1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Thomas J, Leufflen L, Chesnais V, Diry S, Demange J, Depardieu C, et al.  Identification of specific tumor markers in vulvar carcinoma through extensive human papillomavirus DNA characterization using next generation sequencing method. J Low Genit Trac Dis 2020;24:53–60. [DOI] [PubMed] [Google Scholar]
  • 10. de Sanjose S, Alemany L, Ordi J, Tous S, Alejo M, Bigby SM, et al.  Worldwide human papillomavirus genotype attribution in over 2000 cases of intraepithelial and invasive lesions of the vulva. Eur J Cancer 2013;49:3450–61. [DOI] [PubMed] [Google Scholar]
  • 11. Veyer D, Wack M, Mandavit M, Garrigou S, Hans S, Bonfils P, et al.  HPV circulating tumoral DNA quantification by droplet-based digital PCR: A promising predictive and prognostic biomarker for HPV-associated oropharyngeal cancers. Int J Cancer 2020;147:1222–7. [DOI] [PubMed] [Google Scholar]
  • 12. Jeannot E, Becette V, Campitelli M, Calmejane MA, Lappartient E, Ruff E, et al.  Circulating human papillomavirus DNA detected using droplet digital PCR in the serum of patients diagnosed with early stage human papillomavirus-associated invasive carcinoma. J Pathol Clin Res 2016;2:201–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Damerla RR, Lee NY, You D, Soni R, Shah R, Reyngold M, et al.  Detection of early human papillomavirus-associated cancers by liquid biopsy. JCO Precis Oncol 2019;3::PO.18.00276. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Han K, Leung E, Barbera L, Barnes E, Croke J, Di Grappa MA, et al.  Circulating Human Papillomavirus DNA as a biomarker of response in patients with locally advanced cervical cancer treated with definitive chemoradiation. JCO Precis Oncol 2018. [DOI] [PubMed] [Google Scholar]
  • 15. Kang Z, Stevanovic S, Hinrichs CS, Cao L. Circulating cell-free DNA for metastatic cervical cancer detection, genotyping, and monitoring. Clin Cancer Res 2017;23:6856–62. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Lauritano D, Oberti L, Gabrione F, Lucchese A, Petruzzi M, Carinci F, et al.  Liquid biopsy in head and neck squamous cell carcinoma: Prognostic significance of circulating tumor cells and circulating tumor DNA. A systematic review. Oral Oncol 2019;97:7–17. [DOI] [PubMed] [Google Scholar]
  • 17. Dahlstrom KR, Li G, Hussey CS, Vo JT, Wei Q, Zhao C, et al.  Circulating human papillomavirus DNA as a marker for disease extent and recurrence among patients with oropharyngeal cancer. Cancer 2015;121:3455–64. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Bernard HU, Burk RD, Chen Z, van Doorslaer K, zur Hausen H, de Villiers EM. Classification of papillomaviruses (PVs) based on 189 PV types and proposal of taxonomic amendments. Virology 2010;401:70–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Bouvard V, Baan R, Straif K, Grosse Y, Secretan B, El Ghissassi F, et al.  A review of human carcinogens–Part B: biological agents. Lancet Oncol 2009;10:321–2. [DOI] [PubMed] [Google Scholar]
  • 20. Carow K, Golitz M, Wolf M, Hafner N, Jansen L, Hoyer H, et al.  Viral-cellular DNA junctions as molecular markers for assessing intra-tumor heterogeneity in cervical cancer and for the detection of circulating tumor DNA. Int J Mol Sci 2017;18:2032. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Campitelli M, Jeannot E, Peter M, Lappartient E, Saada S, de la Rochefordiere A, et al.  Human papillomavirus mutational insertion: specific marker of circulating tumor DNA in cervical cancer patients. PLoS One 2012;7:e43393. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Arfi A, Hequet D, Bataillon G, Tran-Perennou C, Farkhondeh F, Sastre-Garau X, et al.  HPV DNA integration site as proof of the origin of ovarian metastasis from endocervical adenocarcinoma: three case reports. BMC Cancer 2019;19:375. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Koneva LA, Zhang Y, Virani S, Hall PB, McHugh JB, Chepeha DB, et al.  HPV Integration in HNSCC correlates with survival outcomes, immune response signatures, and candidate drivers. Mol Cancer Res 2018;16:90–102. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Holmes A, Lameiras S, Jeannot E, Marie Y, Castera L, Sastre-Garau X, et al.  Mechanistic signatures of HPV insertions in cervical carcinomas. NPJ Genom Med 2016;1:16004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Shohdy KS, West HJ. Circulating tumor DNA testing-liquid biopsy of a cancer. JAMA Oncol 2020;6:792. [DOI] [PubMed] [Google Scholar]
  • 26. Harle A, Guillet J, Thomas J, Demange J, Dolivet G, Peiffert D, et al.  HPV insertional pattern as a personalized tumor marker for the optimized tumor diagnosis and follow-up of patients with HPV-associated carcinomas: a case report. BMC Cancer 2019;19:277. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Rutkowski TW, Mazurek AM, Snietura M, Hejduk B, Jedrzejewska M, Bobek-Billewicz B, et al.  Circulating HPV16 DNA may complement imaging assessment of early treatment efficacy in patients with HPV-positive oropharyngeal cancer. J Transl Med 2020;18:167. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Chera BS, Kumar S, Shen C, Amdur R, Dagan R, Green R, et al.  Plasma circulating tumor HPV DNA for the surveillance of cancer recurrence in HPV-associated oropharyngeal cancer. J Clin Oncol 2020;38:1050–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Kamal M, Lameiras S, Deloger M, Morel A, Vacher S, Lecerf C, et al.  Human papilloma virus (HPV) integration signature in Cervical Cancer: identification of MACROD2 gene as HPV hot spot integration site. Br J Cancer 2021;124:777–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Scholl S, Popovic M, de la Rochefordiere A, Girard E, Dureau S, Mandic A, et al.  Clinical and genetic landscape of treatment naive cervical cancer: Alterations in PIK3CA and in epigenetic modulators associated with sub-optimal outcome. EBioMedicine 2019;43:253–60. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Shea S, Munoz M, Ward SC, Beasley MB, Gitman MR, Nowak MD, et al.  Human papillomavirus (HPV69/HPV73) coinfection associated with simultaneous squamous cell carcinoma of the anus and presumed lung metastasis. Viruses 2020;12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Mirabello L, Yeager M, Yu K, Clifford GM, Xiao Y, Zhu B, et al.  HPV16 E7 genetic conservation is critical to carcinogenesis. Cell 2017;170:1164–74. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Nicolas I, Marimon L, Barnadas E, Saco A, Rodriguez-Carunchio L, Fuste P, et al.  HPV-negative tumors of the uterine cervix. Mod Pathol 2019;32:1189–96. [DOI] [PubMed] [Google Scholar]
  • 34. Xing B, Guo J, Sheng Y, Wu G, Zhao Y. Human papillomavirus-negative cervical cancer: A comprehensive review. Front Oncol 2020;10:606335. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Akagi K, Li J, Broutian TR, Padilla-Nash H, Xiao W, Jiang B, et al.  Genome-wide analysis of HPV integration in human cancers reveals recurrent, focal genomic instability. Genome Res 2014;24:185–99. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Xu B, Chotewutmontri S, Wolf S, Klos U, Schmitz M, Durst M, et al.  Multiplex Identification of Human Papillomavirus 16 DNA Integration Sites in Cervical Carcinomas. PLoS One 2013;8:e66693. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Hu Z, Zhu D, Wang W, Li W, Jia W, Zeng X, et al.  Genome-wide profiling of HPV integration in cervical cancer identifies clustered genomic hot spots and a potential microhomology-mediated integration mechanism. Nat Genet 2015;47:158–63. [DOI] [PubMed] [Google Scholar]
  • 38. Chandrani P, Kulkarni V, Iyer P, Upadhyay P, Chaubal R, Das P, et al.  NGS-based approach to determine the presence of HPV and their sites of integration in human cancer genome. Br J Cancer 2015;112:1958–65. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Lee JY, Garcia-Murillas I, Cutts RJ, De Castro DG, Grove L, Hurley T, et al.  Predicting response to radical (chemo)radiotherapy with circulating HPV DNA in locally advanced head and neck squamous carcinoma. Br J Cancer 2017;117:876–83. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Sastre-Garau X, Harle A. Pathology of HPV-Associated head and neck carcinomas: recent data and perspectives for the development of specific tumor markers. Front Oncol 2020;10:528957. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Zheng Y, Nie P, Xu S. Long noncoding RNA CASC21 exerts an oncogenic role in colorectal cancer through regulating miR-7–5p/YAP1 axis. Biomed Pharmacother 2020;121:109628. [DOI] [PubMed] [Google Scholar]
  • 42. Li W, Qi Y, Cui X, Huo Q, Zhu L, Zhang A, et al.  Characteristic of HPV integration in the genome and transcriptome of cervical cancer tissues. Biomed Res Int 2018;2018:6242173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43. Lai J, Yang H, Zhu Y, Ruan M, Huang Y, Zhang Q. MiR-7–5p-mediated downregulation of PARP1 impacts DNA homologous recombination repair and resistance to doxorubicin in small cell lung cancer. BMC Cancer 2019;19:602. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. Xing D, Zheng G, Schoolmeester JK, Li Z, Pallavajjala A, Haley L, et al.  Next-generation sequencing reveals recurrent somatic mutations in small cell neuroendocrine carcinoma of the uterine cervix. Am J Surg Pathol 2018;42:750–60. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45. Bodelon C, Untereiner ME, Machiela MJ, Vinokurova S, Wentzensen N. Genomic characterization of viral integration sites in HPV-related cancers. Int J Cancer 2016;139:2001–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Bodily J, Laimins LA. Persistence of human papillomavirus infection: keys to malignant progression. Trends Microbiol 2011;19:33–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Rosewick N, Durkin K, Artesi M, Marcais A, Hahaut V, Griebel P, et al.  Cis-perturbation of cancer drivers by the HTLV-1/BLV proviruses is an early determinant of leukemogenesis. Nat Commun 2017;8:15264. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. Parfenov M, Pedamallu CS, Gehlenborg N, Freeman SS, Danilova L, Bristow CA, et al.  Characterization of HPV and host genome interactions in primary head and neck cancers. Proc Natl Acad Sci U S A 2014;111:15544–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49. Das M. A promising therapeutic vaccine for cervical precancer. Lancet Oncol 2019;20:e671. [DOI] [PubMed] [Google Scholar]
  • 50. Mazzoni E, Rotondo JC, Marracino L, Selvatici R, Bononi I, Torreggiani E, et al.  Detection of merkel cell Polyomavirus DNA in serum samples of healthy blood donors. Front Oncol 2017;7:294. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Chan KCA, Woo JKS, King A, Zee BCY, Lam WKJ, Chan SL, et al.  Analysis of plasma epstein-barr virus DNA to screen for nasopharyngeal cancer. N Engl J Med 2017;377:513–22. [DOI] [PubMed] [Google Scholar]
  • 52. Tagaya Y, Matsuoka M, Gallo R. 40 years of the human T-cell leukemia virus: past, present, and future. F1000Res 2019;8:F1000. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Suppl Figure 1

Supplementary Figure 1: Insertion patterns for all cases harboring HPV DNA integration. Two junctions co-linear (2J-CL) (a), two junctions non-linear (2J-NL) (b), multiple-junctions clustered (MJ-CL) (c) and multiple-junctions scattered (MJ-SC) (d). Insertions are presented with a black line when present in tissue only, a red line when present in plasma only and a dashed black and red line when present in both tissue and plasma. All genomics coordinates use Hg38 reference. Double-dash is used when the insertion is outside an intronic or exonic region of a gene and the closest gene is reported.

Supplementary Data I

Supplementary methods

Supplementary Data II

SNPs and indels for each cases

Supplementary Table 1

Detailed charecteristics and insertions for all cases

Supplementary Legend

Supplementary Legend


Articles from Clinical Cancer Research are provided here courtesy of American Association for Cancer Research

RESOURCES