Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Mar 26;15(3):e0229672. doi: 10.1371/journal.pone.0229672

Development and validation of a multiplex immunoassay for the simultaneous quantification of type-specific IgG antibodies to E6/E7 oncoproteins of HPV16 and HPV18

Hans Layman 1,*, Keith W Rickert 2,#, Susan Wilson 2,#, Anastasia A Aksyuk 3,, Jill M Dunty 3,, Dusit Natrakul 3,, Nithya Swaminathan 1,¤a,#, Christopher J DelNagro 1,¤b,#
Editor: Scott M Langevin4
PMCID: PMC7098588  PMID: 32214362

Abstract

More than 170 types of human papilloma viruses (HPV) exist with many causing proliferative diseases linked to malignancy in indications such as cervical cancer and head and neck squamous cell carcinoma. Characterization of antibody levels toward HPV serology is challenging due to complex biology of oncoproteins, pre-existing titers to multiple HPV types, cross-reactivity, and low affinity, polyclonal responses. Using multiplex technology from MSD, we have developed an assay that simultaneously characterizes antibodies against E6 and E7 oncoproteins of HPV16 and 18, the primary drivers of HPV-associated oncogenesis. We fusion tagged our E6 and E7 proteins with MBP via two-step purification, spot-printed an optimized concentration of protein into wells of MSD 96-well plates, and assayed various cynomolgus monkey, human and HPV+ cervical cancer patient serum to validate the assay. The dynamic range of the assay covered 4-orders of magnitude and antibodies were detected in serum at a dilution up to 100,000-fold. The assay was very precise (n = 5 assay runs) with median CV of human serum samples ~ 5.3% and inter-run variability of 11.4%. The multiplex serology method has strong cross-reactivity between E6 oncoproteins from human serum samples as HPV18 E6 antigens neutralized 5 of 6 serum samples as strongly as HPV16 E6. Moderate concordance (Spearman’s Rank = 0.775) was found between antibody responses against HPV16 E7 in the multiplex assay compared to standard ELISA serology methods. These results demonstrate the development of a high-throughput, multi-plex assay that requires lower sample quantity input with greater dynamic range to detect type-specific anti-HPV concentrations to E6 and E7 oncoproteins of HPV16 and 18.

1. Introduction

Human papilloma virus (HPV) is a diverse DNA virus from the papillomavirus family with 170 types known implicated in numerous etiologies including sexually transmitted diseases, skin lesions, and cancers [13]. At least 12 of these HPV types are high-risk as persistent HPV infection has been linked to cancers of the oropharynx, larynx, vulva, vagina, cervix, and anus [2,3]. HPV-associated cancers make up over 5% of all cancer cases diagnosed yearly and has been increasing since 2006 [4,5]. Of interest, oral infection with HPV16 and 18 account for a significant proportion of head and neck cancer (HNSCC) patients worldwide [6]. More specifically, oncoproteins E6 and E7 of HPV16 and 18 are of great importance as they drive suppression of pRb and increase levels of p16 protein via negative feedback mechanisms driving tumor progression [7,8]. Seropositivity of type-specific IgG polyclonal antibodies to these HPV oncoproteins in patients has demonstrated improved overall survival in HNSCC [9], therefore we sought to develop an assay that can evaluate antibodies to HPV16/18 E6 and E7 oncoproteins.

Assays employing analysis of antibodies to E6/E7 oncoproteins to HPV16 and 18 have demonstrated mixed results with few groups showing concordance between HPV16/18 genotype versus serotype positive typically relying on p16 genotype positivity [913]. These results may be attributed to the assembly patterns with E6 proteins [8] as E6 commonly folds and aggregates hindering the ability and accessibility of antibodies to bind in vitro [14]. To overcome this attribute, many groups have leveraged pseudovirion incorporation [15,16] or protein fusion tags such MBP or GST to reduce protein aggregation [17] resulting in robust and reproducible HPV serology assays toward serotyping of individuals in clinical trials. Here, we have developed MBP tagged versions of E6 and E7 oncoproteints of HPV16 and 18 for detection of anti-HPV16/18 positive sera.

Conventional assays for serology such as ELISA allow only one antigen at a time to be evaluated per well. Various multiplexing technologies for antibody-protein interactions have been validated for clinical use [18]. Competitive Luminex Immunoassays (cLIA) is a bead-based technology that has been leveraged in numerous HNSCC biomarker studies with mixed results attributed to modest increases in dynamic range compared to ELISA, lack of standardized reagents and lack of uniform methods to establish cut-off values [16]. Furthermore, chemical linkers to conjugate beads to protein may result in protein conformational changes [15]. Meso Scale Diagnostics, LLC (MSD, Rockville, MD) uses electrochemiluminescent (ECL) technology lending itself to a broad dynamic range. Spots for an MSD® ECL assay are printed in array and all antibodies of interest can be analyzed in one well. The small area of spots requires significantly less coating protein and sample reducing the quantity of consumables necessary to perform serologic analysis in complex clinical trials. Additionally, the proteins coated on the plate surface maintain their conformational state. Herein, we have developed and report a method for multiplex HPV serology analysis of antibodies specific to MBP-tagged HPV16 and 18 E6/ using the MSD platform. We investigated key assay performance metrics toward type-specific anti-HPV antibody concentrations including precision, linearity, reproducibility, robustness, cross-reactivity, and correlation to conventional ELISA across serum from suspected HPV+ adult donors, pediatric donors, and HPV16/18 E6 and E7 vaccinated cynomolgus monkeys.

2. Materials and methods

2.1 HPV16/18 E6 and E7 antigen production and purification

Protein sequences for HPV16/18 E6 and E7 were derived from UniProt (S1 Fig) and cloned into the pMalC5X vector facilitating the fusion and allowing the production of MBP-HPV16/18 E6 and MBP-HPV16/18 E7 proteins. All constructs were expressed in Escherichia coli BL21D3 cells (New England BioLabs), grown in LB medium supplemented with kanamycin (50 μg/mL) at 30°C until OD600 = 3.0 followed by a temperature reduction to 20°C and addition of IPTG at 1mM to the culture. Cells were harvested by centrifugation and lysed with BPER. Lysates were subjected to SDS-PAGE and anti-His Western blot.

MBP-tagged HPV16 E6/E7 and HPV18 E6/E7 were bound to a 5 mL MBPtrap column (GE Healthcare) in 20 mM Tris, 400 mM NaCl at pH 7.5 and eluted with 10 mM maltose. This was followed by dialysis and further purification on a Q-HP column at pH 8, eluting with a gradient from 0–500 mM NaCl. Size exclusion chromatography (SEC) and tandem mass spectrometry (MS) was run on proteins to confirm column elution time and identification of predicted proteins.

2.2 Antibodies, serum samples, and reference serums

Human samples were obtained from BioIVT (Hicksville NY) or Proteogenex (Inglewood, CA) with informed consent. Monkey serum samples were obtained as a gift from Jean Boyer and the animal protocol was approved with IACUC Board approval at Inovio Pharmaceuticals in San Diego, CA.

For assay development and validation, a heat-inactivated pool of human serum positive for anti-HPV16/18 E6 and E7 was used as a reference. Serum from various human donor cohorts was obtained with Ethics committee approval and informed consent obtained from BioIVT (Hicksville, NY) normal healthy adults (n = 6), adults with ≤1 sexual partner (n = 30), pediatric donors (age 1–5 days; n = 10), HPV+ serum from cervical cancer patients at CIN2/3 staging (Proteogenex Inglewood, CA; n = 3), and serum of HPV16/18 E6 and E7 vaccinated cynomolgus monkeys (n = 6; gifted by Dr. Jean Boyer, Inovio Pharmaceuticals, San Diego, CA) were used as samples to evaluate assay suitability. IgG depleted serum (BBI Solutions, Crumlin, UK) was used as a negative control in the assay. Type-specific mouse monoclonal antibodies to HPV16/18 E6 (Clone C1P5, Santa Cruz Biotechnology, Santa Cruz, USA), HPV16 E7 (Clone 716–281, ThermoFisher Scientific, South San Francisco, USA), HPV18 E6 (Clone G-7, Santa Cruz Biotechnology, Santa Cruz, USA), and HPV18 E7 (Clone F-7, Santa Cruz Biotechnology, Santa Cruz, USA) were purchased for specificity experiments.

2.3 MSD multiplex type-specific anti-HPV16/18 E6 E7 ECL protocol

Serological immunoassays with electrochemiluminescence (ECL) detection were performed using instrumentation and multiwell plate consumables from MSD.Assay plates were coated with an optimized concentration of HPV Concentration of antigens coated in well are 300 μg/mL for MBP-HPV16 E6, 400 μg/mL for MBP-HPV16 E7 and MBP-HPV18 E6, and 200 μg/mL for MBP-HPV18 E7. Plates were equilibrated to room temperature (RT) for 30 minutes prior to use and serum samples thawed on ice. 150 μL of MSD blocker A is added to the plate and incubated at RT for 1 hour with shaking at 705 rpm. Plates are washed three times with PBS-T followed by adding 50 μL of reference standard or sample to the wells at a 500-fold dilution in duplicate in assay diluent (Diluent 100, MSD). Samples were incubated for 2 hours at RT with shaking at 705 rpm. Following sample incubation, plates were washed 3 times with PBS-T. 50 μL of mouse monoclonal anti-Human IgG detection antibody labelled with SULFO-TAG label at a working concentration of 2 μg/mL was added to all wells of the plate and incubated at RT for 1 hour with shaking. Following incubation in detection antibody, plates were washed three times in PBS-T, MSD GOLD Read Buffer was added to the plate at a volume of 150 μL/well and the plate was read. The measurement of samples was performed on a SECTOR S 600 instrument and raw ECL values were acquired. For each antibody, the ECL signal was converted to AU/mL by interpolation from a four-parameter logistic standard curve based on the 4-fold, 8-point serial dilution (100–409,600-fold dilution) of the pooled human reference serum.

2.4 Establishing assay performance characteristics

2.4.1 Assay specificity

The specificity of the HPV multiplex ECL assay was assessed through evaluation of antigen-specific antibodies (n = 4) and their ability to be detected based on other coated spots in the well. Wells were treated as previously described with the addition of mouse monoclonal antibodies at the described concentrations: anti-HPV16/18 E6 (25 ng/mL), anti-HPV16 E7 (4 ng/mL), anti-HPV18 E6 (4 ng/mL), and anti-HPV18 E7 (1 ng/mL) followed by detection with MSD goat anti-mouse SULFO-TAG labelled detection antibody.

Specificity was confirmed using a competition assay by incubating the synthesized HPV soluble antigens with mouse monoclonal antibodies, as well as 4 adult donor serum samples and 2 HPV+ cervical cancer patient serum samples. Briefly, antibodies were pre-diluted to the concentrations described previously and samples were pre-diluted 500-fold. Samples were spiked with individual soluble antigens at 10x the coating mass. Samples were pre-incubated for 1 hr to facilitate neutralization before adding to the assay plate. The assay was conducted as described before and the ability to detect an antibody’s specificity and cross reactivity was expressed as a percent of on-board diluent spiked ECL signal.

2.4.2 Performance of reference serum

Two adult donors were identified with high antibody concentrations to HPV16/18 E6 and E7, pooled, and the performance of the reference serum was evaluated from 4-fold serial dilutions (100–409,600 fold) of serum in the multiplex assay (n = 5 assay runs). From these runs, a concentration reference assignment was assigned to each analyte across the dilution range.

2.4.3 Validation of the type-specific anti-HPV antibody assay

To validate the assay, the dilutional linearity, precision, range, and limits of detection were assessed over a range of serum samples: adult donor, HPV+ cervical cancer, pediatric, and monkey. In addition, the stability of samples in the assay was assessed after multiple freeze/thaw cycles and different sample storage conditions.

The dilutional linearity of the assay was established using 8 different human serum samples, and the reference serum. The human sera were tested at 2-fold dilution steps over 8 concentrations (100–12,800-fold dilution) to capture the dynamic range of the assay. The results of the antibody concentrations were normalized to the observed concentration at an 800-fold dilution and incorporated in semi-log plots.

The upper (ULOQ) and lower limit of quantification (LLOQ), defined as the maximal and minimal concentration of polyclonal anti-human HPV antibodies that is reliably quantified with %CV <20% and recovery between 80–120%, was determined for the assay. To quantify the ULOQ, reference serum was diluted 100-fold into assay diluent followed by three 1.2-fold dilutions. To quantify the LLOQ, two LLOQ sample series were prepared by spiking reference serum into IgG depleted serum, series one was pre-diluted 10-fold, and series two was pre-diluted 50-fold with the standard on-board dilution of 500-fold for standard sample analysis.

The precision of the assay (n = 6 assay runs) was established using 7 adult donor serum samples, 10 pediatric serum samples (suspected low concentration), and IgG depleted serum. Evaluation of the intra- and inter-assay calculated sample concentrations to each HPV antigen and the variance associated with the measurement to establish assay precision.

2.4.4 Comparison with an ELISA type-specific anti-HPV antibody assay

MSD multiplex and a standard single-plex ELISA for HPV16 E7 were compared head-to-head to confirm anti-HPV16 E7-specific responses and to determine the assay’s dynamic range. An additional subset of serum samples: 16 normal healthy donors, and 10 HPV+ cervical cancer serum samples were obtained from BioIVT or Proteogenex and tested across 8 concentrations of serum at 4-fold dilutions (10–163,480-fold dilution, on board). To evaluate the correlation between MSD and ELISA anti-HPV16 E7 signals, Spearman’s Rank Order Correlation Coefficient was utilized to confirm the relationship between the two technologies as the linear relationship between them is monotonic in reporting of ECL signal to OD450 values across all dilutions of each sample. In analysis of the semi-log data (log ECL signal versus OD450 ELISA), a Pearson coefficient is used to calculate linear-transformed data to confirm correlation between MSD and ELISA.

3. Results

Generation of HPV antigens

In order to overcome the hinderance of aggregation-prone E6 proteins, we evaluated the suitability of linking E6 or E7 proteins to maltose binding protein to reduce aggregation for improved reactivity in downstream assays. In evaluating the SDS-PAGE gel of MBP-HPV18 E6, we observed our expected mass of protein (MBP-HPV18 E6) at 64 kDa, however, substantial impurities in purification were observed (Fig 1A) before (lanes 4 and 5) and after reduction (lane 8) with DTT. SDS-PAGE gel evaluation following QHP purification (Fig 1B) demonstrated that the major impurities flowed through the column (lanes 2 and 3). Size-exclusion chromatography (SEC) demonstrated that a vast majority of the DTT reduced, peak MBP-HPV18 E6 protein is an aggregate with an estimated mass of 4x106 Da that elutes between 5 and 6 minutes (Fig 1C). The purified MBP-HPV18 E6 protein was analyzed by mass spectrometry (Fig 1D) and the primary mass observed is that of the predicted, intact protein at 63589 kDa, demonstrating that the observed aggregation is non-covalent. All other proteins (MBP-HPV16 E6/E7 and MBP-HPV18 E7) were subjected to the same processes with similar results demonstrating the expected mass determined by mass spectrometry (data not shown).

Fig 1. Characterization of MBP-tagged HPV18 E6 protein via SDS-PAGE, size-exclusion chromatography, and mass spectrometry.

Fig 1

A–SDS-PAGE gel of MBP-trap purification of pMal MBP-18E6. Lane 1 designated the molecular weight marker, lane 2 is protein loaded on the column, lane 3 is the flow-through from the column, lanes 4 and 5 are independent collections of the peak of the primary elution, lane 6 is empty, lanes 7–9 is raw load protein (7), column flow-through (8), and peak of the primary elution (9) subjected to DTT reduction. B–SDS-PAGE gel of MBP-HPV18 E6 protein prior to and following DTT reduction with a Hi trap Q anion exchange column. Lane 1 designated the molecular weight marker, lane 2 is protein loaded on the column, lane 3 is the flow-through from the column, lanes 4 and 5 are independent collections of the peak of the primary elution, lanes 6–8 is raw load protein (6), column flow-through (7), and peak of the primary elution (8) subjected to DTT reduction. C–Size-exclusion chromatography of the peak of the primary elution subjected to DTT reduction in Fig 1A. D–Mass spectrometry of MBP-HPV18 E6 protein from re-folded and reduced, peak eluate solution from the QHP column.

Selection and performance of anti-HPV reference sera

The suitability of 6 individual donors, 3 HPV+ cervical cancer donors, and 6 monkey serum samples were evaluated as possible serum sets as reference serum in the MSD HPV multiplex immunoassay. Because the monkeys were vaccinated with the HPV antigens of interest, we hypothesized that an individual serum or pooled serum of non-human primates would provide the most robust serum sample set as a reference serum. In preliminary evaluation of the six monkeys, robust ECL signal was observed across all six samples screened at 3 different dilution factors (Fig 2A), and one monkey serum (Cyno 6470) was identified as a potential reference serum as this serum had the highest median titer against all HPV antigens compared to all animals and donors screened. Across the 11 dilutions (100–1.04x108) evaluated of potential monkey reference serum, three of the four HPV proteins showed marked signal above background to a dilution of 409,600-fold (Fig 2B) whereas HPV16 E6 lost linearity after the fifth dilution. Poor precision was also identified for anti-HPV16 E6 in monkey serum at a dilution factor of 1,600 where 4 of the 6 monkeys evaluated had intra-assay variance ranging from 37.8% to 89.5% against HPV16 E6 (Fig 2C) demonstrating that the vaccinated monkey serum would not be reliable in routine testing.

Fig 2. Performance and selection of a panel of human and cynomolgus monkey serum in multiplex assay development.

Fig 2

A–Electrochemiluminescent (ECL) signal observed from the normal, adult healthy human donors (n = 6) for all antibodies tested in each well. Serum was evaluated at 3 different dilutions and plotted as the median ECL signal ± range. B–Concentration curves of observed ECL signal at 4-fold dilutions for Cyno 6470 for all HPV antibodies. C–Inter-assay variability observed for cynomolgus monkey serum (n = 4) for all HPV antibodies screened. D–intra-subject variability in antibody concentrations from normal, healthy adult donor serum, HPV+ cervical cancer subjects and IgG depleted serum to identify a reference serum sample. Samples BRH1516437 and BRH1516438 were selected and pooled as the reference material for subsequent assays.

In evaluating human serum, we found broad reactivity to HPV antigens in the multiplex assay. On average, the HPV+ cervical cancer patients had elevated antibody signal against all HPV antigens tested compared to adult donors, however, HPV+ cervical cancer patients had elevated ECL signal to HPV16 E7 at a 1,000-fold dilution (Fig 2D). We identified two normal donor serum with elevated ECL signal against all antigens (BRH1516437 and BRH1516438) and pooled these serums to create our reference serum. A standard curve was generated over 5 assay runs for the reference serum to assign concentrations in AU/mL for each analyte in the multiplex (Table 1). Reference serum intra-assay variance between duplicates ranged from 2.8% to 18.4% demonstrating reproducibility within experiments.

Table 1. Concentration assignment of the pooled human donor reference serum from observed ECL signal.

  HPV16 E6 HPV16 E7 HPV18 E6 HPV18 E7
Dilution factor ECL Signal Assigned Concentration (AU/mL) ECL Signal Assigned Concentration (AU/mL) ECL Signal Assigned Concentration (AU/mL) ECL Signal Assigned Concentration (AU/mL)
100 402403 30 88255 5 623159 50 315200 20
400 107323 7.5 23485 1.25 185969 12.5 77691 5
1600 28967 1.875 4541 0.313 51975 3.125 20165 1.250
6400 7218 0.469 956 0.078 13054 0.781 4689 0.313
25600 1832 0.117 330 0.020 3378 0.195 1269 0.078
102400 588 0.029 152 0.005 1131 0.049 369 0.020
409600 179 0.007 92 0.001 510 0.012 148 0.005
Blank 62   91   316   54  

Specificity of the MSD HPV multiplex assay

First, specificity of the multiplex immunoassay was evaluated by evaluating cross-reactivity with mouse monoclonal antigen-specific anti-HPV antibodies to HPV16/18 E6, HPV16 E7, HPV18 E6, and HPV18 E7 (n = 24 tests per antibody). Fig 3A demonstrates high affinity, mouse monoclonal antibodies produce signal as expected against target antigens with less than 3% cross-reactivity. As expected, high signal was observed for both HPV16 E6 and HPV18 E6 with the mouse monoclonal anti-HPV16/18 E6 antibody with a 2.6-fold increase in signal intensity for HPV18 E6 responses compared to HPV16 E6 at 0.25 μg/mL antibody concentration. Few specific monoclonal antibodies are commercially available for HPV16 E6, and those that are available have high variability and low ECL signal (data not shown).

Fig 3. Specificity of the multiplex HPV serology assay.

Fig 3

A–Specificity of mouse monoclonal anti-HPV antibodies to the coating antigen in each well as a total average ECL signal of 24 wells tested ± S.D. B–Competition assay to compete antigen and matched antibody signal. Monoclonal anti-HPV antibodies were incubated with the antigen and assayed to evaluate reduction of antibody-specific ECL signal. C–Competition assay on normal, healthy adult donor serum samples (n = 4; filled shapes) and HPV+ cervical cancer subjects (n = 2, black outline, open shapes). Serum samples were incubated with the antigen and assayed for percent inhibition of signal. D–Competition ELISA evaluating the contribution of anti-MBP antibodies in HPV+ cervical cancer subjects (n = 3). 10 μg of MBP was added to subject serum and levels of HPV16 E7 signal (OD450) are plotted as a function of dilution factor of serum.

Specificity of the assay was also evaluated by spiking soluble HPV16/18 E6 and E7 antigens at 10-fold greater mass than the amount coated in the well with pre-diluted antigen-specific antibodies, normal donor serum (n = 4), or HPV+ cervical cancer patient serum (n = 2). Expected depletion of signal was observed for antigen-specific monoclonal antibodies (Fig 3B) except for anti-HPV16 E6 where we observed a 52% reduction in signal. Additionally, HPV16 E6 competition was less efficient in reducing the anti-HPV16 E6 signal in human serum samples (Fig 3C). For the six human serum samples evaluated, the range of percent inhibition of HPV16 E6 was 6%-77% with a median inhibition of 40.5% (S1 Table).

Interestingly, antibodies to HPV18 E6 are as effective at inhibiting HPV16 E6 signal as its own signal in the assay indicating modest cross-reactivity due to nearly 50% sequence homology between these two proteins [19, 20]. One serum sample had significant antibody cross-reactivity with all antigens being analyzed less than 40% of maximal signal (range = 1–40%). This serum may have reactivity to common epitopes or to the maltose binding protein (MBP) portion of the antibody tag [19]. Additionally, 5 of 6 of the serum samples evaluated inhibited to the same magnitude for incubation with HPV18 E6 antigen and detecting HPV16 E6 antibodies demonstrating HPV16 and 18 E6 may be equally detected. Robust signal depletion was seen for both E7 proteins in all tested human serum samples. Three HPV+ cervical cancer patient samples were incubated with saturating concentrations of MBP (20 μg/mL) to examine whether we were detecting any anti-MBP antibodies thereby increasing background signal. Fig 3D demonstrates that the detection of anti-HPV16 E7 antibodies by ELISA was unencumbered across all dilutions of serum tested following sample incubation with or without MBP. Given these results, the assay can robustly detect type-specific HPV antibodies, however low affinity, polyclonal antibodies to both E6 targets may be difficult in differentiating.

Validation of the MSD HPV multiplex assay

The precision of the HPV multiplex immunoassay was evaluated based on intra-and inter-plate concentration assignments using human serum. 6 assay runs were completed evaluating 17 human serum donors at 500-fold dilution: 3 HPV+ cervical cancer patient serum (Group A), 4 human adult donor serum (Group B), and 10 pediatric donor serum (Group C) and IgG antibody depleted human serum was used as a negative control (Fig 4A–4D). In sample analysis, a broad range of reported concentrations was observed (21.29–13,534.79 AU/mL) with inter-run average %CV between 4.8%-23.9%, within typically established 75–125% of variance for ECL-based assays (S2 Table). Furthermore, the average concentration of intra-plate %CV of duplicates for all samples against all HPV antigens tested ranged from 1.5%-13.9% indicating that minimal ECL signal differences are observed when assayed in duplicate. From this analysis, we found that the reportable median concentrations 3 of 4 antigens (HPV16 E6, HPV18 E6 and HPV18 E7) were greater in adult and HPV+ cervical cancer serum samples compared to pediatric samples (Fig 4E). The median concentrations of the HPV+ cervical cancer group was 1.5-fold and 2.2-fold higher for HPV 16 E6 and HPV18 E6, respectively compared to adult donor serum. We expected the concentrations of pediatric samples to be approximately 0 units/mL however we found that there was a concentration range of 21–1881 units/mLwhich may be attributed to maternal antibodies generated in utero [21]. The median concentration of HPV16 E7 antibodies was no different between pediatric compared to adult donors as the average signal was 4-5-fold above the IgG depleted serum ECL levels.

Fig 4. Reproducibility and validation of the HPV multiplex MSD-based serology assay for various donor groups.

Fig 4

Group A–HPV+ cervical cancer subjects (n = 3); Group B–normal, healthy adult donors (n = 4); Group C–normal pediatric donors (n = 10). A–inter-subject variability for evaluating the concentration of IgG anti-HPV16 E6 over multiple assays (n = 5 assays). B–inter-subject variability for evaluating the concentration of IgG anti-HPV16 E7 over multiple assays (n = 6 assays). C—inter-subject variability for evaluating the concentration of IgG anti-HPV18 E6 over multiple assays (n = 5 assays). D—inter-subject variability for evaluating the concentration of IgG anti-HPV18 E7 over multiple assays (n = 5 assays). E–Inter-group anti-HPV IgG concentrations plotted as median ± interquartile range. Open shapes are Groups A and B and filled shapes is Group C.

Dilutional linearity of the assay was evaluated using 7 human serum samples and the reference serum. Intra-assay quadruplicates were evaluated for reactivity to all antigens between dilutions of 100–12,800-fold as shown in Fig 5A–5D. Normalizing to the 800-fold dilution, we found that a majority of the samples reported linear concentrations (±30%) between 400–6,400-fold dilution. These results confirm that sample testing at two dilutions: 500-fold and 10,000-fold are reasonable to determine HPV antibody concentration. In evaluating the linearity of the reference serum, serum was diluted 4-fold across 11 concentrations starting at a 100-fold dilution. Fig 5E demonstrates that linearity of the reference serum is linear from 100-fold to 106-fold for all HPV antibodies, however, the recovery, due to diluting of the serum, is lost for all antibodies at 105-fold dilution. From this data, we could reliably calculate antibody concentration to HPV antigens between 100 and 105-fold from the reference curve.

Fig 5. Sample-dependent and reference material dilutional linearity in the multiplex anti-HPV MSD assay.

Fig 5

Serum from HPV+ cervical cancer subjects (n = 3), and normal, healthy adult donors (n = 4) was evaluated to identify the linear range for sample testing over 2 assays. Concentration for each sample was normalized to the observed concentration at 800-fold and plotted as a percent change from this value across 8 dilutions. A–dilutional linearity for seven samples in relation to the reference standard for anti-HPV16 E6 concentration. B–dilutional linearity for seven samples in relation to the reference standard for anti-HPV16 E7 concentration. C–dilutional linearity for seven samples in relation to the reference standard for anti-HPV18 E6 concentration. D–dilutional linearity for seven samples in relation to the reference standard for anti-HPV18 E7 concentration. E–Dilutional linearity of the reference serum over three assays runs plotted as ECL signal (left axis; solid lines) or percent recovery (right axis; dashed lines) ± %CV as a function of dilution factor of serum.

Next, we evaluated the upper (ULOQ) and lower limits of quantitation (LLOQ) of the assay. The ULOQ material was prepared by spiking the reference serum into assay diluent, and 4 dilutions at 1.2-fold were evaluated for percent recovery and intra- and inter-plate variability. Table 2 demonstrates that the recovery of the ULOQ material was within the expected 80–120% across all HPV antibodies. The intra- and inter-plate %CV were less than 20% and 25%, respectively indicating robust detection at the upper limit of the assay. Given this data, we set the ULOQ of the assay at 85% of the top tested concentration of antibody in the well for all analytes.

Table 2. Estimated assay upper limit of quantitation (ULOQ) and percent recovery for type-specific anti-HPV concentrations from reference serum.

Antigen Expected Concentration (AU/mL) Observed Concentration (AU/mL) Percent Recovery Intra-plate %CV Inter-plate %CV Estimated ULOQ (AU/mL)
HPV16 E6 30 30.8 103% 4.3 6.2 25.5
25 26.5 106% 3.4 5.8
20.8 21.9 105% 1.8 3.8
17.4 18.5 106% 3.8 7.4
HPV16 E7 5 5.3 106% 4 8.7 4.25
4.2 4.5 107% 3.5 6.6
3.5 3.8 109% 1.4 9
2.9 3.2 110% 6.5 13.1
HPV18 E6 50 48.9 98% 4 6.3 42.5
41.7 43.4 104% 4.8 6.4
34.7 36.6 105% 3.5 4
28.9 30.2 104% 5.4 7.4
HPV18 E7 20 19.8 99% 6.3 6.3 17
16.7 16.9 101% 4.4 5.3
13.9 14.1 101% 4.4 4.8
11.6 11.3 97% 10.4 12.1

To establish the LLOQ of the assay, we created two series of samples by creating the first series with a pre-dilution of 500-fold and diluting serum in 1.5-fold steps across 8 dilutions. The second series was pre-diluted 500-fold with an additional 5-fold dilution and evaluated across 8 dilutions in 1.5-fold steps. We found that our assay lost sensitivity by the third dilution from all antigens on LLOQ series evaluated as indicated by the increase in inter-plate %CV above 25%. Our assay was able to detect to as low as 600 ECL units for anti-HPV16 E7 and as low as 2,500 ECL units for anti-HPV18 E6. These signals from the reference material result in the LLOQ assay ranging from 0.0457–0.1265 AU/mL (Table 3).

Table 3. Estimated assay lower limit of quantitation and percent recovery for type-specific anti-HPV concentrations of the reference serum.

Series 1 Series 2 Estimated LLOQ
Antigen Expected Concentration (AU/mL) Observed Concentration (AU/mL) Percent Recovery Intra-plate %CV Inter-plate %CV Expected Concentration (AU/mL) Observed Concentration (AU/mL) Percent Recovery Intra-plate %CV Inter-plate %CV Signal Concentration (AU/mL)
HPV16 E6 0.600 0.6953 116% 7.1 16.8 0.120 0.0973 81% 4.3 15.3 1000 0.0681
0.400 0.4141 104% 4.8 16.8 0.080 0.0729 91% 3.7 11.3
0.267 0.2765 104% 3.2 12.9 0.053 0.0509 95% 2.7 19.2
0.178 0.1623 91% 4.9 25.9 0.036 0.0305 86% 3.6 22.6
0.119 0.1112 94% 7.3 19.6 0.024 0.0187 79% 16.0 36.1
0.079 0.0762 96% 5.0 30.5 0.016 0.0131 83% 21.6 33.7
0.053 0.0474 90% 11.5 36.8 0.011 0.0087 83% 8.0 30.1
0.035 0.0297 85% 3.3 32.6 0.007 0.0051 73% 31.1 46.7
HPV16 E7 0.100 0.1182 118% 7.0 11.4 0.020 0.0177 89% 22.9 24.0 600 0.0457
0.067 0.0672 101% 4.2 18.5 0.013 0.0135 101% 24.4 24.6
0.044 0.0443 100% 7.6 18.3 0.009 0.0095 107% 40.1 43.4
0.030 0.0266 90% 9.8 35.1 0.006 0.0059 100% 42.7 44.6
0.020 0.0201 102% 11.0 19.7 0.004 NE NE 56.8 56.8
0.013 0.0143 109% 15.6 35.6 0.003 NE NE 64.8 64.8
0.009 0.0074 84% 22.5 36.8 0.002 NE NE 39.9 42.8
0.006 0.0047 80% NE 38.6 0.001 NE NE 69.3 67.2
HPV18 E6 1.000 1.1673 117% 7.6 16.6 0.200 0.1511 76% 20.0 12.5 2500 0.1265
0.667 0.6814 102% 5.5 18.8 0.133 0.1145 86% 11.7 11.0
0.444 0.4515 102% 2.8 15.0 0.089 0.0813 91% 18.9 17.4
0.296 0.2649 89% 4.7 29.5 0.059 0.0471 79% 18.2 19.5
0.198 0.1912 97% 5.9 25.0 0.040 0.0301 76% 24.0 26.1
0.132 0.1281 97% 7.1 35.5 0.026 0.0221 84% 33.6 36.8
0.088 0.0794 90% 9.0 36.0 0.018 0.0144 82% 37.7 24.0
0.059 0.0507 87% 5.7 32.6 0.012 0.0087 74% 32.2 33.5
HPV18 E7 0.400 0.4964 124% 10.3 12.4 0.080 0.0642 80% 21.6 15.9 1000 0.0561
0.267 0.2732 102% 5.4 13.0 0.053 0.0478 90% 17.2 18.6
0.178 0.1818 102% 2.7 12.0 0.036 0.0327 92% 19.5 20.0
0.119 0.1056 89% 7.5 27.4 0.024 0.0174 73% 35.2 37.9
0.079 0.0782 99% 5.5 19.4 0.016 0.0125 79% 40.4 42.1
0.053 0.0494 94% 5.7 31.4 0.011 0.0082 78% 41.0 42.6
0.035 0.031 88% 8.9 32.0 0.007 0.0055 78% 48.7 51.4
0.023 0.0197 84% 7.1 25.5 0.005 0.0033 70% 40.3 33.5

Next, we evaluated the robustness of the assay across a range of serum sample types. We collected 30 serum samples from adults with one or less sexual partner as a suspected low antibody concentration serum set and compared this to our panel of normal adult donors (n = 6) in combination with the HPV+ cervical cancer patient samples (n = 3) as a likely high antibody concentration subset. Fig 6A shows the range and median concentration of antibody observed for each donor cohort. The median concentration in the high group ranged between 19.2-fold to 46.1-fold greater than the low group. The greatest increase was in the anti-HPV18 E6 group whereas the lowest increase was observed in the anti-HPV18 E7 group. These results demonstrate that our assay can differentiate between people with high and low antibody titers and can stratify patients based on their pre-existing antibody concentrations.

Fig 6. Multiplex anti-HPV immunoassay robustness.

Fig 6

A–Suspected anti-HPV antibody low subjects (n = 30) versus suspected high anti-HPV subjects (n = 9) including previously assayed normal, healthy adult donor serum (n = 6) and HPV+ cervical cancer patient serum (n = 3) is plotted as median antibody concentration ± range. B–Effect of freeze-thaw cycles (1–3 freeze-thaw cycles), overnight (O/N) incubation at 4°C or room temperature (R/T) on anti-HPV concentrations for 4 samples: BRH1516439, BRH1516440, 15787S, and 15803S.

Lastly, we selected 2 normal healthy donor serum (BRH1516441, BRH1516442) and 2 HPV+ cervical cancer donor serum (15787S, 15803S) and evaluated sample stability at five conditions: overnight at 4°C, overnight at room temperature, and through 3 freeze/thaw cycles at -80°C. We observed modest reductions in observed antibody concentration when incubating samples overnight at room temperature (25–30%) for sample BRH1516442 whereas the other samples had a 20% reduction in concentration (Fig 6B). 10–25% reduction in antibody concentration was also seen at the third freeze/thaw cycle. These freeze/thaw results confirm the suitability of the assay for HPV antibody concentration assignment.

Comparison of anti-HPV16 E7 signal in MSD multiplex immunoassay to ELISA

In order to establish suitability of the assay to standard methods, we evaluated 26 serum samples (16 healthy donor, 10 HPV+ cervical cancer) in a head-to-head assay across 8 serial dilutions resulting in 208 evaluable data points between ELISA and multiplex MSD for detecting anti-HPV16 E7 responses. We analyzed the data using Spearman’s Rank-Order Correlation and Pearson’s Correlation as shown in Fig 7. The Spearman’s coefficient was calculated at r = 0.7775 as the data are logarithmic with respect to ECL signal from MSD and linear for OD450 values from ELISA. Given the positive value and r value of Spearman’s correlation approaching 1 indicates that the results are in strong agreement and that the technologies are comparable. Additionally, when log-transforming the data, a Pearson coefficient can be used to describe the similarity of the data. The Pearson’s correlation coefficient calculated (r) is r = 0.6692. While this r value is below a standard cut-off 0.7, the data is moderately linear. The data also demonstrate the range of signal detected by the MSD assay as it spans at least 5-logs of signal whereas the ELISA assay affords ~3-logs of signal.

Fig 7. Correlation between anti-HPV16 E7 responses measured by ELISA and MSD multiplex.

Fig 7

208 evaluable data points were plotted from a head-to-head assay with 26 matched donor samples (16 normal, healthy adult donor, 10 HPV+ cervical cancer) across 8 serial dilutions for anti-HPV16 E7 signals. Log axis for ECL signal is plotted on the x-axis and linear axis for OD450 ELISA values are plotted on the y-axis to evaluate the distribution and Spearman’s Coefficient.

Discussion

This report describes a multiplex assay leveraging the spot printing of the MSD electrochemiluminescent technology based on the fusion tagging of HPV oncoproteins to simultaneously detect antibody concentrations to HPV16 E6 and E7 as well as HPV18 E6 and E7 in a high-throughput manner with a small amount of sample needed to conduct the assay (500-fold dilution of sample in a 50 μL volume). The synthesis of these novel oncoproteins allowed us to detect a wide range of antibody concentrations to HPV proteins in human serum, HPV+ cervical cancer serum, and vaccinated subjects to HPV oncoproteins with precision, reproducibility, and some degree of cross-reacticity between HPV16 and 18 E6 antibodies.

Multiplex serology assays require less time and normalization efforts than traditional serology assays generally performed under standard ELISA methods. Here, our data generated for HPV16 E7 antibodies demonstrates excellent concordance, however MSD affords us two additional magnitudes of dynamic range. This range affords us the ability to detect low affinity polyclonal antibodies that may be detected approaching or below potential background in standard ELISA [2023]. While we hypothesized that HPV+ subjects would have greater antibody concentrations, we found a modest antibody concentration increase in HPV+ subjects to normal healthy donors. This may be attributed to the broad prevalence of HPV16 and 18 positivity in the general population due to the number of sexual partners [24,25] lending itself the need to identify a true negative population to set serostatus cutoff values from individuals with less than 1 sexual partner. Furthermore, we found low antibody concentrations in our pediatric donor cohort which may be attributed to material antibodies [21] as these children were between ages 1–5 days. In setting a serostatus cutoff value for these HPV antibodies, we would have increased confidence in identifying pharmacodynamic attributes of patients on current HPV vaccine trials targeting HPV16 and 18 oncoproteins E6 and E7, however we cannot rule out that the observed signal in non-HPV+ populations may be attributed to some degree of a lack of specificity [6,10,11].

Interestingly, vaccinated monkey serum to HPV16/18 E6 and E7 demonstrated excellent inter-assay precision to all antibodies except anti-HPV16 E6. This phenomenon was not observed in human serum and could be attributed to differing reactive epitopes [20], or poor interaction between monkey and human tags in the detection antibody [26]. Furthermore, modest cross-reactivity was observed in most human serum screened for antibodies to both HPV16 and 18 E6. This could be attributed to similar sequence homology (about 50%) and broad polyclonal responses [19]. Importantly, this effect was not observed for all 6 donors evaluated and is not attributed to the MBP fusion tag showing that the similar sequences and polyclonal nature of HPV antibodies may lend itself to modest cross-reactivity. Follow-up genotype testing on these subjects to identify HPV16 versus HPV18 positive individuals would be critical to understand which antigen or antibody a subject may have reactivity to as well as enhancing the specificity of our assay.

HPV E6 oncoproteins are difficult to synthesize due to the nature of their aggregation and lack of solubility due to cysteine-rich domains [14]. To overcome this, our E6 and E7 oncoproteins were synthesized with a maltose binding protein. Other groups have evaluated crystal structures of the p53 core domain binding pocket of HPV16 E6 when bound to MBP [8] and demonstrated better data reproducibility compared to other protein tags such as His, myc, or tag fusion proteins owing to the hypothesis that MBP-tagged E6 and E7 oncoproteins may be superior in quality over alternatively tagged recombinant proteins. MBP-tagged proteins can also be used as affinity tags on various resins [27] and here we demonstrate strong binding, remarkable recovery, moderate aggregation, and enhanced solubility of difficult proteins to synthesize due to the ability to capture and fold proteins on-column. The E6 and E7 oncoprotein reagents developed here demonstrate utility in an assay to evaluate the concentration of type-specific anti-HPV in serum of normal and cancer patients alike.

Our assay is the first assay explored and developed in a multiplex fashion in evaluating the serostatus of the key drivers of HPV+ oncogenesis in cervical and head and neck malignancies [2]. Other assays have explored the utility of antibodies to these oncoproteins in singlicate by ELISA [22], leveraged different technologies such as Luminex [17], other non-key drivers related to HPV oncogenesis such as HPV6, 11, 35 [28], or conjugation to pseudovirion particles [15,2830]. Other platforms such as ELISA and Luminex do not afford the dynamic range of detection that MSD provides, nor do they maintain confirmation of the HPV16 and 18 proteins for robust analysis of serum samples [7,8]. In using our reference serum, we can reproducibly determine antibody concentrations for subjects in support of ongoing clinical trials in the HPV cervical and head and neck cancer space [6,912] or other indications linked to HPV positivity. Our results demonstrate reproducibility across HPV16/18 E6 and E7 antibodies for our pooled serum to directly calculate serum antibody concentrations.

The primary limitation to our assay is two-fold. First, linking of proteins to maltose binding protein may increase signal background due to presence of antibodies to MBP [31]. While these antibodies may be low in concentration, we cannot rule out inter-subject variability that may increase background, leading to artificially enhanced signal. Second, due to the polyclonal nature of HPV antibodies, we cannot rule out the cross-reactive nature of HPV16 and 18 E6 antibodies. It is currently unknown as to the quantity of cross-reactive antibodies that may exist between HPV16 and 18 E6 contributing to the possibility of increased, cross-reactive signal. A polyclonal HPV16 E6 or HPV18 E6 antibody would be critical in evaluating this potential phenomenon.

In conclusion, we developed a specific, sensitive, reproducible multiplexed serology assay for the simultaneous quantitation of IgG antibodies to HPV16/18 E6 and E7. Our assay shows strong correlation to pre-existing technologies and could be a good alternative to standard single-plex serology assays in large-scale epidemiology studies or clinical trials in evaluation of primary drivers in HPV-driven oncogenesis.

Supporting information

S1 Fig. Protein sequences of MBP-tagged proteins.

UniProt derived and MBP-tagged sequences of synthesized HPV16/18 E6 and E7 proteins.

(DOCX)

S1 Table. Assay antibody-dependent competition.

Percent competition to target antibody following type-specific antigen spike with serum sample.

(XLSX)

S2 Table. Samples evaluated for assay metrics.

Reproducibility and precision of samples evaluated to establish assay precision for anti-HPV16/18 E6 and E7.

(XLSX)

S1 Raw images

(PDF)

Acknowledgments

We thank Dr. Jean Boyer from Inovio Pharmaceuticals for her gift and supply of HPV16/18 E6 and E7 vaccinated cynomolgus monkey serum. We also thank Mark Billadeau, Samarth Chugh from MSD for input on coating optimization. Lastly, we thank Dr. Nathan Standifer for critical review of the manuscript toward expertise of serology-based assay development.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

HL, KAR, SW, NS, CJD are current or former employees of AstraZeneca. They received compensation in the form of salary and stock as employees. AAA, JMD, and DN are current or former employees of Meso Scale Diagnostics LLC and receive compensation in the form of salary and stock. AstraZeneca nor Meso Scale Diagnostics LLC did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of salaries and research materials.

References

  • 1.de Koning MN, Quint KD, Bruggink SC, Gussekloo J, Bouwes Bavinck JN, et al. High prevalence of cutaneous warts in elementary school children and the ubiquitous presence of wart-associated human papillomavirus on clinically normal skin. Br J Dermatol. 2015. January;172(1):196–201. 10.1111/bjd.13216 [DOI] [PubMed] [Google Scholar]
  • 2.Berman TA, Schiller JT. Human papillomavirus in cervical cancer and oropharyngeal cancer: One cause, two diseases. Cancer. 2017. June 15;123(12):2219–2229. 10.1002/cncr.30588 [DOI] [PubMed] [Google Scholar]
  • 3.McCloskey JC, Kast WM, Flexman JP, McCallum D, French MA, Phillips M. Syndemic synergy of HPV and other sexually transmitted pathogens in the development of high-grade anal squamous intraepithelial lesions. Papillomavirus Res. 2017. December;4:90–98. 10.1016/j.pvr.2017.10.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Parkin DM. The global health burden of infection-associated cancers in the year 2002. Int J Cancer. 2006. June 15;118(12):3030–44. 10.1002/ijc.21731 [DOI] [PubMed] [Google Scholar]
  • 5.Hansen BT, Campbell S, Nygard M. Long-term incidence trends of HPV-related cancers, and cases preventable by HPV vaccination: a registry-based study in Norway. BMJ Open 2018;8:e019005 10.1136/bmjopen-2017-019005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Aggarwal C, Cohen RB, Morrow MP, Kraynyak KA, Sylvester AJ, Knoblock DM, et al. Immunotherapy Targeting HPV16/18 Generates Potent Immune Responses in HPV-Associated Head and Neck Cancer. Clin Cancer Res. 2019. January 1;25(1):110–124. 10.1158/1078-0432.CCR-18-1763 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Bolt J, Vo QN, Kim WJ, McWhorter AJ, Thomson J, Hagensee ME, et al. The ATM/p53 pathway is commonly targeted for inactivation in squamous cell carcinoma of the head and neck (SCCHN) by multiple molecular mechanisms. Oral Oncol. 2005. November;41(10):1013–20. 10.1016/j.oraloncology.2005.06.003 [DOI] [PubMed] [Google Scholar]
  • 8.Martinez-Zapien D, Ruiz FX, Poirson J, Mitschler A, Ramirez J, Forster A, et al. Structure of the E6/E6AP/p53 complex required for HPV-mediated degradation of p53. Nature. 2016. January 28;529(7587):541–5. 10.1038/nature16481 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Schroeder L, Wichmann G, Willner M, Michel A, Wiesenfarth M, Flechtenmacher C, et al. Antibodies against human papillomaviruses as diagnostic and prognostic biomarker in patients with neck squamous cell carcinoma from unknown primary tumor. Int J Cancer. 2018. April 1;142(7):1361–1368. 10.1002/ijc.31167 [DOI] [PubMed] [Google Scholar]
  • 10.Morrow MP, Kraynyak KA, Sylvester AJ, Dallas M, Knoblock D, Boyer JD, et al. Clinical and Immunologic Biomarkers for Histologic Regression of High-Grade Cervical Dysplasia and Clearance of HPV16 and HPV18 after Immunotherapy. Clin Cancer Res. 2018. January 15;24(2):276–294. 10.1158/1078-0432.CCR-17-2335 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Bagarazzi ML, Yan J, Morrow MP, Shen X, Parker RL, Lee JC, et al. Immunotherapy against HPV16/18 generates potent TH1 and cytotoxic cellular immune responses. Sci Transl Med. 2012. October 10;4(155):155ra138. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Wilson L, Pawlita M, Castle PE, Waterboer T, Sahasrabuddhe V, Gravitt PE, et al. Seroprevalence of 8 oncogenic human papillomavirus genotypes and acquired immunity against reinfection. J Infect Dis. 2014. August 1;210(3):448–55. 10.1093/infdis/jiu104 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Laban S, Gangkofner DS, Holzinger D, Schroeder L, Eichmüller SB, Zörnig I, et al. Antibody responses to cancer antigens identify patients with a poor prognosis among HPV-positive and HPV-negative head and neck squamous cell carcinoma patients. Clin Cancer Res. 2019. August 23 pii: clincanres.1490.2019. [DOI] [PubMed] [Google Scholar]
  • 14.Bonhoure A, Demenge A, Kostmann C, San José L, De la Cal E, Armisen P, et al. One-step affinity purification of fusion proteins with optimal monodispersity and biological activity: application to aggregation-prone HPV E6 proteins. Microb Cell Fact. 2018. December 1;17(1):191 10.1186/s12934-018-1039-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Panicker G, Rajbhandari I, Gurbaxani BM, Querec TD, Unger ER. Development and evaluation of multiplexed immunoassay for detection of antibodies to HPV vaccine types. J Immunol Methods. 2015. February;417:107–114. 10.1016/j.jim.2014.12.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Coseo SE, Porras C, Dodd LE, Hildesheim A, Rodriguez AC, Schiffman M, et al. Evaluation of the polyclonal ELISA HPV serology assay as a biomarker for human papillomavirus exposure. Sex Transm Dis. 2011. Oct;38(10):976–82. 10.1097/OLQ.0b013e31822545c0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Waterboer T, Sehr P, Michael KM, Franceschi S, Nieland JD, Joos TO, et al. Multiplex human papillomavirus serology based on in situ-purified glutathione s-transferase fusion proteins. Clin Chem. 2005. October;51(10):1845–53. 10.1373/clinchem.2005.052381 [DOI] [PubMed] [Google Scholar]
  • 18.Harper DM, Franco EL, Wheeler C, Ferris DG, Jenkins D, Schuind A, et al. Efficacy of a bivalent L1 virus-like particle vaccine in prevention of infection with human papillomavirus types 16 and 18 in young women: a randomised controlled trial. Lancet. 2004. November 13–19;364(9447):1757–65. 10.1016/S0140-6736(04)17398-4 [DOI] [PubMed] [Google Scholar]
  • 19.Nominé Y, Masson M, Charbonnier S, Zanier K, Ristriani T, Deryckère F, et al. Structural and functional analysis of E6 oncoprotein: insights in the molecular pathways of human papillomavirus-mediated pathogenesis. Mol Cell. 2006. March 3;21(5):665–78. 10.1016/j.molcel.2006.01.024 [DOI] [PubMed] [Google Scholar]
  • 20.Nakagawa M, Greenfield W, Moerman-Herzog A, Coleman HN. Cross-Reactivity, Epitope Spreading, and De Novo Immune Stimulation Are Possible Mechanisms of Cross-Protection of Nonvaccine Human Papillomavirus (HPV) Types in Recipients of HPV Therapeutic Vaccines. Clin Vaccine Immunol. 2015. July;22(7):679–87. 10.1128/CVI.00149-15 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Meschede W, Zumbach K, Braspenning J, Scheffner M, Benitez-Bribiesca L, Luande J, et al. Antibodies against early proteins of human papillomaviruses as diagnostic markers for invasive cervical cancer. J Clin Microbiol. 1998. February;36(2):475–80. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Zhang C, Huang X, Chen S, Li Y, Li Y, Wang X, et al. Epitope clustering analysis for vaccine-induced human antibodies in relationship to a panel of murine monoclonal antibodies against HPV16 viral capsid. Vaccine. 2018. October 29;36(45):6761–6771. 10.1016/j.vaccine.2018.09.035 [DOI] [PubMed] [Google Scholar]
  • 23.Safaeian M, Porras C, Schiffman M, Rodriguez AC, Wacholder S, Gonzalez P, et al. Epidemiological study of anti-HPV16/18 seropositivity and subsequent risk of HPV16 and -18 infections. J Natl Cancer Inst. 2010. November 3;102(21):1653–62. 10.1093/jnci/djq384 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Loenenbach AD, Poethko-Müller C, Pawlita M, Thamm M, Harder T, Waterboer T, et al. Mucosal and cutaneous Human Papillomavirus seroprevalence among adults in the prevaccine era in Germany—Results from a nationwide population-based survey. Int J Infect Dis. 2019. June;83:3–11. 10.1016/j.ijid.2019.03.022 [DOI] [PubMed] [Google Scholar]
  • 25.D'Souza G, Clemens G, Troy T, Castillo RG, Struijk L, Waterboer T, et al. Evaluating the Utility and Prevalence of HPV Biomarkers in Oral Rinses and Serology for HPV-related Oropharyngeal Cancer. Cancer Prev Res (Phila). 2019. October;12(10):689–700. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Bourdage JS, Brandt JT, Lee TN, Konrad RJ. Differential reactivity of anti-primate and anti-human secondary antibodies against human and monkey immunoglobulins: implications for determining the sensitivity of immunogenicity assays. J Immunol Methods. 2005. August;303(1–2):76–80. 10.1016/j.jim.2005.06.003 [DOI] [PubMed] [Google Scholar]
  • 27.Riggs P. Expression and purification of recombinant proteins by fusion to maltose-binding protein. Mol Biotechnol. 2000;15(1):51–63. 10.1385/MB:15:1:51 [DOI] [PubMed] [Google Scholar]
  • 28.Lin SW, Ghosh A, Porras C, Markt SC, Rodriguez AC, Schiffman M, et al. HPV16 seropositivity and subsequent HPV16 infection risk in a naturally infected population: comparison of serological assays. PLoS One. 2013;8(1):e53067 10.1371/journal.pone.0053067 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Opalka D, Matys K, Bojczuk P, Green T, Gesser R, Saah A, et al. Multiplexed serologic assay for nine anogenital human papillomavirus types. Clin Vaccine Immunol. 2010. May;17(5):818–27. 10.1128/CVI.00348-09 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Zanier K, Charbonnier S, Baltzinger M, Nominé Y, Altschuh D, Travé G. Kinetic analysis of the interactions of human papillomavirus E6 oncoproteins with the ubiquitin ligase E6AP using surface plasmon resonance. J Mol Biol. 2005. June 3;349(2):401–12. 10.1016/j.jmb.2005.03.071 [DOI] [PubMed] [Google Scholar]
  • 31.Kaufmann AM, Stern PL, Rankin EM, Sommer H, Nuessler V, Schneider A, et al. Safety and Immunogenicity of TA-HPV, a recombinant vaccinia virus expressing modified human papilloma virus (HPV)-16 and HPV-16 E6 and E7 genes, in women with progressive cervical cancer. Clin Cancer Res. 2002;8:3676–3685. [PubMed] [Google Scholar]

Decision Letter 0

Scott M Langevin

22 Jan 2020

PONE-D-19-34611

Development and validation of a multiplex immunoassay for the simultaneous quantification of type-specific IgG antibodies to E6/E7 oncoproteins of HPV16 and HPV18

PLOS ONE

Dear Dr Layman,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Mar 07 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Scott M. Langevin, Ph.D., M.H.A., C.T. (ASCP)

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please clarify whether human (healthy donors, paediatric donors, cervical cancer patients) and animal (monkey) specimens were all sourced from third parties commercial or not) and state name and location of those parties. Please also clarify whether third parties had obtained ethical approval.

3. Thank you for stating the following in the Financial Disclosure section: 'No'

    

We note that one or more of the authors are employed by commercial companies: Gilead Sciences, Inc., Exelixis, Inc., AstraZeneca plc and Meso Scale Diagnostics, LLC

a)    Please provide an amended Funding Statement declaring this commercial affiliation, as well as a statement regarding the Role of Funders in your study. If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study. You can update author roles in the Author Contributions section of the online submission form.

Please also include the following statement within your amended Funding Statement.

“The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.”

If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement.

b) Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc.  

Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and  there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This manuscript reports on the development and initial evaluation of a multiplex assay to detect antibodies against the E6 and E7 proteins of human papillomavirus types 16 and 18. Extensive development and characterization was performed and is well described in the manuscript. However, the following issues identified by the authors could be addressed more explicitly in the Abstract and Discussion:

1. Several lines of evidence suggest presence of cross-reactivity in the assay. Given this, not only does it appear that “… we cannot rule out the cross-reactive nature of HPV16 and HPV18 E6 antibodies.” But, one might “rule in” the likely presence of such an effect. The Abstract and Discussion should be more upfront about this fact.

2. No mention is made in the Abstract and Discussion regarding the high detection of antibodies in pediatric (presumably unexposed) samples, which is suggestive of some non-specificity of the assay (Figure 4). In fact, average concentrations between 100 – 1,000 were noted for all antigens except for HPV-18 E7. This high detection of signal among individuals expected to be unexposed, together with the increased dynamic range of the assay, suggest that the authors’ attempt to increase the dynamic range (decrease the LLOQ) might have led to reduced specificity of the assay.

3. The final sentence of the Abstract is a bit of an overstatement since comparison with ELISA was performed for only one of the four antigens included in the multiplex assay.

4. The 4th paragraph of the Discussion seems speculative and is not based on data reported in the Results. This reviewer suggests dropping that paragraph, which makes statements about the advantage of the newly developed assay vis-a vis other existent platforms (including multiplex platforms) without providing any data to support such asserions.

Reviewer #2: The authors developed a specific, sensitive, reproducible multiplexed serology assay for the simultaneous quantitation of IgG antibodies to HPV16/18 E6 and E7 using an electrochemiluminescent technology. The data are convincing. However, although this assay seems to be a good alternative to standard ELISA, the authors should better explain how this technology may be used as an alternative to the Luminex technology. Bead-based assays are widely used and demonstred high performance in large-scale epidemiology studies (Waterboer et al., PMID: 16099939). Why the authors didn’t compare the performance of their assay with a bead-based assay (or serum previously characterized using a bead-based assay)? WHat about the cost for each sample? Also the authors should also explain better this technology on its way to detect specifically each of the antigens. It is not clear.

Lines 434-435; The authors found similar antibody concentrations in HPV+ subjects to normal healthy donors which is surprising as only antibodies to L1 should be found. Please explain. The E6 antibodies should be rare in the general population.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Allan Hildesheim

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Mar 26;15(3):e0229672. doi: 10.1371/journal.pone.0229672.r002

Author response to Decision Letter 0


30 Jan 2020

Rebuttal Letter

We appreciate the thorough review from Reviewers 1 and 2 and their comments regarding the quality of the data and to more clearly state our abstract and conclusions in the discussion. Below, we capture the comments from each reviewer and respond with the following edits that can be found in the marked-up text document.

Editor Comments:

Style requirements for file naming – addressed

Clarify whether human and monkey specimens were obtained from third parties commercial or not. Human samples were obtained from BioIVT (Hicksville NY) or Proteogenex (Inglewood, CA) with informed consent. This has been updated in the cover letter. The monkey serum samples were obtained as a gift from Jean Boyer and the animal protocol was approved with IACUC Board approval at Inovio Pharmaceuticals in San Diego, CA.

Funding statements and competing interests have been updated for all authors in the cover letter.

Reviewer 1:

1. Several lines of evidence suggest presence of cross-reactivity in the assay. Given this, not only does it appear that “… we cannot rule out the cross-reactive nature of HPV18 and HPV18 E6 antibodies.” But, one might “rule in” the likely presence of such an effect. The abstract and discussion should be more upfront about this fact.

We address the cross-reactivity effect upfront in the abstract more clearly (line 32 and 33) by stating that HPV18E6 is as good as neutralizing HPV16 E6 in 5 of 6 samples tested in the cross-reactivity experiment. Before it merely stated that cross-reactivity existed and was observed. Lines 288-290 now address this observation in the results. However, for the discussion, this is addressed in lines 480-485. We feel that the development of the assay and the metrics for qualification against a reference serum is most important, and that these observations could be found in sample testing to identify the reference serum. We did include a brief summary (lines 429-430) regarding the finding of the cross-reactivity up front in the discussion.

2. No mention is made in the abstract and discussion regarding the high detection of antibodies in pediatric (presumably unexposed samples), which is suggestive of some non-specificity of the assay (Figure 4). In fact, average concentrations, between 100-1,000 were noted for all antigens except for HPV18 E7. This high detection of signal among individuals expected to be unexposed, together with the increased dynamic range of the assay, suggest that the authors’ attempt to increase dynamic range (decrease the LLOQ) might have led to reduced specificity of the assay.

We acknowledge the levels of basal activity in what we would presume would be an unexposed group to HPV. We have addressed this by updating the methods to include the age of the diagnostic retains of pediatric samples (1-5 day old infants; line 98). Having this information is important as maternal antibodies would be detected at this age and they may be at low concentrations. We have updated the text in the results to reflect this finding as well (lines 312-314) and included a reference from a CVI paper Matys et al from 2012 (PMID 22518014). This was also addressed in the discussion in lines 444-446.

3. The final sentence of the abstract is a bit of an overstatement since comparison with ELISA was performed for only one of the four antigens included in the assay.

We have removed the language regarding standard ELISA methods (lines 35-39) to show what we have really developed: an assay that is high throughput, multiplexed, a good dynamic range, and sample input.

4. The fourth paragraph of the discussion seems speculative and is not based on data reported in the results. This reviewer suggests dropping that paragraph, which makes statements about the advantage of the newly developed assay vis-à-vis other existing platforms (including multiplex platforms) without providing any data to support such assertions.

We feel that this section is necessary to describe the tag and recovery portion of the protein. Many other groups have tried other tags to HPV such as His, myc, etc and their results have not been as reproducible. We acknowledge this section is somewhat speculative and would require additional chemistry analysis but would be beyond the scope of the current paper.

Reviewer #2: The authors developed a specific, sensitive, reproducible multiplex serology assay for the simultaneous quantitation of IgG antibodies to HPV16/18 E6 and E7. The data are convincing. However, although the assay seems to be a good alternative to standard ELISA, the authors should better explain how this technology may be used as an alternative to the Luminex technology. Bead-based assays are widely used and demonstrate high performance in large-scale epidemiology studies (PMID: 16099939). Why the authors didn’t compare the performance of their assay with a bead-based assay (or serum previously characterized using a bead-based assay)? What about the cost for each sample? Also, the authors should explain better this technology on its way to detect specifically each of the antigens. It is not clear.

Point 1 – Why did the authors not compare the performance of their assay with a bead-based assay?

A previous study has evaluated a large cohort comparison of serum samples to HPV 6, 11, 16 and 18 L1 between MSD and Luminex (PMID: 25554636). We acknowledge there is a gap in our reagents toward their performance in a bead based assay. However, EDC crosslinking of proteins to beads may result in untoward effects of the labile HPV proteins. Because the MSD assay affords the protein to bind to the plate in its native confirmation post-synthesis, no chemical modifications are done to perturb the chemical structure. Text was added to the introduction (lines 69,70 and 75,76) to clarify the choice of MSD over Luminex and why we elected to not pursue Luminex.

Point 2 – What about the cost for each sample?

The cost of the sample was omitted from the manuscript because it does not contribute to the strength of the paper. However Luminex and MSD are comparable in cost. Roughly speaking MSD and Luminx would be around $200 per sample. Luminex would tend to be a little higher due to conjugation chemistry for proteins/antigens. 32 samples could be run per plate (in duplicate) with a standard curve in triplicate. For ELISA, sample cost would be significantly less, about $75/sample, however without the ability to multiplex, the cost per sample increases to $300+ and a much larger volume is needed. For precious samples, this could be a severe limitation.

Point 3 – The authors should better explain this technology on its way to detect specifically each of the antigens.

This is highlighted from point 1 in so far that the confirmation of the protein/antigen to the plate and its confirmation being conserved whereas with Luminex, conjugation chemistry may result in protein degradation.

Point 4 – Lines 434-435; the authors found similar antibody concentrations in HPV+ subjects to normal healthy donors which is surprising as only antibodies to L1 should be found. Please explain. The E6 antibodies should be rare in the general population.

We do agree that the antibody concentrations are similar, however this analysis needs to be expanded over a larger sample size to get true statistical differences and the scope of the manuscript is to report on the method development, and, secondarily, to identify who may be seropositive. We have adjusted the text to reflect the data shown in Fig 4. We did observe elevated median concentrations of E6 antibodies in patients with HPV+ infections (HPV16 and 18) of 1.5 – 2.2 fold (lines 317-320). We cannot rule out that the adult donor population may have an HPV infection not linked to cancer due to the source of our adult donor cohort which was unspecified for the number of sexual partners. It has been noted previously that women with 4+ sexual partners had seropositivity to HPV antibodies in >60% of serum evaluated (PMID: 11724843). We updated our conclusion (lines 447-453) to reflect the need to identify a truly negative population in additional assay development.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Scott M Langevin

6 Feb 2020

PONE-D-19-34611R1

Development and validation of a multiplex immunoassay for the simultaneous quantification of type-specific IgG antibodies to E6/E7 oncoproteins of HPV16 and HPV18

PLOS ONE

Dear Dr Layman,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Mar 22 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Scott M. Langevin, Ph.D., M.H.A., C.T. (ASCP)

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: In reviewing the responses to original comments and the revised manuscript, I have only one residual comment as follows:

In addressing the higher than expected positivity observed among pediatric subjects, the authors are correct in stating that one explanation is the presence of maternal antibodies. However, they fail to explicitly state that an alternative explanation is lack of assay specificity (i.e., pediatric positives are false positives). This should be explicitly stated in the manuscript.

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Allan Hildesheim

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Mar 26;15(3):e0229672. doi: 10.1371/journal.pone.0229672.r004

Author response to Decision Letter 1


10 Feb 2020

From the second round of reviews following primary revision, all comments and concerns were addressed from Reviewer #2, however reviewer #1 has a concern regarding the interpretation of cross-reactivity and false positives. Specifically: “In addressing the higher than expected positivity observed among pediatric subjects, the authors are correct in stating that one explanation is the presence of maternal antibodies. However, they fail to explicitly state that an alternative explanation is lack of assay specificity (i.e., pediatric positives are false positives). This should be explicitly stated in the manuscript.” We accept this as a true limitation of the current assay and an epidemiological study to identify cutoff levels would serve this assay significantly.

We have now included a statement regarding this in the manuscript in the marked-up copy on lines 476-477. We do agree that the false positives could be from other sources due to polyclonal antibody affinity and avidity. A much larger HPV-positive and -negative cohort would aid us in identifying true serostatus levels and that is a limitation of the current assay as it is presented.

Attachment

Submitted filename: Response to Reviewers - Second Revision.docx

Decision Letter 2

Scott M Langevin

12 Feb 2020

Development and validation of a multiplex immunoassay for the simultaneous quantification of type-specific IgG antibodies to E6/E7 oncoproteins of HPV16 and HPV18

PONE-D-19-34611R2

Dear Dr. Layman,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Scott M. Langevin, Ph.D., M.H.A., C.T. (ASCP)

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Scott M Langevin

13 Feb 2020

PONE-D-19-34611R2

Development and validation of a multiplex immunoassay for the simultaneous quantification of type-specific IgG antibodies to E6/E7 oncoproteins of HPV16 and HPV18

Dear Dr. Layman:

I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

For any other questions or concerns, please email plosone@plos.org.

Thank you for submitting your work to PLOS ONE.

With kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Scott M. Langevin

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Protein sequences of MBP-tagged proteins.

    UniProt derived and MBP-tagged sequences of synthesized HPV16/18 E6 and E7 proteins.

    (DOCX)

    S1 Table. Assay antibody-dependent competition.

    Percent competition to target antibody following type-specific antigen spike with serum sample.

    (XLSX)

    S2 Table. Samples evaluated for assay metrics.

    Reproducibility and precision of samples evaluated to establish assay precision for anti-HPV16/18 E6 and E7.

    (XLSX)

    S1 Raw images

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers - Second Revision.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES