Abstract
Typhoid vaccines based on protein-conjugated capsular Vi polysaccharide (TCVs) prevent typhoid in infants and young children. Analysis of the serum anti-Vi IgG response following immunisation against typhoid confirms the immunogenicity of TCVs and forms an important part of the pathway to licensing. Comparative studies could expedite the licencing process, and the availability of a standardised ELISA method alongside the 1st International Standard (IS) 16/138 for anti-typhoid capsular Vi polysaccharide IgG (human) will facilitate this process. To this end, a non-commercial ELISA based on a coat of Vi and poly-l-lysine (Vi-PLL ELISA) was evaluated by 10 laboratories. Eight serum samples, including IS 16/138, were tested in the standardised Vi-PLL ELISA (n = 10), a commercial Vi ELISA (n = 3) and a biotinylated Vi ELISA (n = 1). Valid estimates of potencies relative to IS 16/138 were obtained for all samples in the Vi-PLL ELISA and the commercial ELISA, with good repeatability and reproducibility evident from the study results and concordant estimates obtained by the two ELISA methods. The study demonstrates that the Vi-PLL ELISA can be used in clinical trial studies to determine the immunogenicity of TCVs.
Keywords: ELISA, IgG, Typhoid, Poly-l-lysine, Polysaccharide, Vi
Abbreviations: AD, Assay Diluent; BB, Blocking Buffer; CV, Coefficient of Variation; ECBS, Expert Committee on Biological Standardization; GCV, Geometric Coefficient of Variation; GM, Geometric Mean; IU, International Unit; IS, International Standard; PLL, poly-l-lysine; Vi, capsular Vi polysaccharide
1. Introduction
Typhoid fever is caused by an infection with Salmonella enterica subspecies enterica serovar Typhi (S. typhi). In developing countries, typhoid disease particularly affects children and infants and is a considerable cause of morbidity and mortality. A recent study estimated a global incidence of 12 million cases of typhoid and 129,000 deaths each year [1].
Capsular Vi polysaccharide (Vi) is a virulence factor of S. typhi and considered a protective antigen in typhoid vaccines [2,3]. Vaccination is the most cost-effective strategy to prevent and control typhoid fever in endemic areas and in areas where anti-microbial resistant strains reside. In the 1980s, oral live attenuated Ty21a and the injectable plain Vi vaccines were licensed and have been on the market since. Unfortunately, these vaccines suffer two drawbacks: they are not suitable for use in children under five and two years of age respectively, and plain Vi vaccines are unable to induce a booster response in adults and children, and for those at risk (e.g. lab workers) a repeat immunisation is required every 3 years [[4], [5], [6]]. Conjugation of Vi to a carrier protein such as a bacterial toxoid remedied these shortcomings: a prototype typhoid conjugate vaccine (TCV) consisting of Vi conjugated to recombinant Pseudomonas aeruginosa exoprotein A was proven to be immunogenic and induced a booster response in young children, was safe and efficacious in pre-school age children and infants and induced a long lasting anti-Vi IgG response [[7], [8], [9]]. The success of this TCV prompted the World Health Organization (WHO) to draft the WHO guideline on the quality, safety and efficacy of TCVs, which provides a framework to evaluate TCVs, compare clinical trial studies and analyse the safety, consistency and potency of TCVs by physicochemical assays and immunoassays [10,11].
Three TCVs consisting of Vi conjugated to tetanus toxoid (Vi-TT) are licensed in India on the bases of immunogenicity and safety studies [[12], [13], [14]]. Indeed, the presence of anti-Vi IgG following immunisation with a Vi vaccine is considered a correlate of protection [[7], [8], [9],11,15]. Studies in a controlled human infection model (CHIM), showed the Vi-TT vaccine to have similar effectiveness compared with plain Vi vaccine, but with improved immunological properties [16]. Currently, three TCVs are progressing through clinical trials, three are approaching licensure, and a further five are at the pre-clinical stage [14]. Recently, a phase III field trial in Nepal of Vi-TT showed it is efficacious and reduces the incidence of S. typhi in children [17], and, in Hyderabad (Pakistan) a mass immunisation campaign with Vi-TT is undertaken to control an outbreak of antimicrobial resistant variants [18].
To expedite the licensing process for new TCVs, we produced and evaluated the first International Standard (IS) for anti-Vi IgG (human), 16/138 [19]. A collaborative study showed that performance of IS 16/138, US reference reagent Vi-IgGR1, 2011 and individual post-immunisation sera was most consistent in the commercial VaccZyme Human Anti-Salmonella typhi Vi IgG ELISA (Binding Site, UK) followed by the Vi ELISA pre-coated with poly-l-lysine (Vi-PLL). The poor performance of ELISAs based on a coat of Vi only was noted in this study, its predecessor as well as an earlier study [[19], [20], [21]]. The latter observation agrees with previous studies that reported poor binding of bacterial polysaccharides to the micro-plate surface resulting in inconsistent ELISA results, which can be mitigated by pre- or co-coating the polysaccharide with a protein or by chemical modification of the polysaccharide [20,22,23]. Poly-l-lysine is a representative of nucleic acid binding polymers and has been used to bind DNA and RNA avidly on the basis of their charge and thus increase their adherence to the solid phase [24]. Like these polymers, polysaccharides have a negative charge and a PLL coating will capture these molecules efficiently. Poly-l-lysine was chosen as co-coating protein over human serum albumin, because the Vi PLL ELISA showed superior assay precision in a comparative study [19].
Following the establishment of IS 16/138, the WHO Expert Committee on Biological Standardization (ECBS) requested a study in order to establish whether a non-commercial Vi ELISA based on these principles could be a reliable and robust alternative to the commercial VaccZyme ELISA [25]. The current study was designed to evaluate the Vi-PLL ELISA as a generic and non-commercial alternative to the VaccZyme ELISA. The performance and reproducibility of the Vi-PLL ELISA alongside the commercial VaccZyme ELISA was assessed by 10 laboratories, using a set of pre- and post-immunisation sera from volunteers immunized with licenced Vi vaccines, as described previously, IS 16/138 and working standard 10/126 [19].
2. Materials and methods
2.1. Participating laboratories and assay codification
Ten participants, including vaccine manufacturers, national control laboratories and research laboratories from seven countries tested the study samples and supplied data for this study (see acknowledgments section for details). Throughout the study, laboratories were identified by a randomly assigned laboratory code number to maintain confidentiality. Data were collected and analysed at NIBSC. A study protocol and the procedure for the Vi-PLL ELISA was sent to each participant along with six suggested plate layouts to be used.
2.2. Samples used in the collaborative study
Each participant received a sample set comprising one ampoule of IS 16/138, coded ampoules (G to M), and one ampoule of 10/126. A brief characterisation of the study samples, study codes, NIBSC codes and their reactivity in the VaccZyme ELISA based on preliminary testing is given in Table 1. Samples IS 16/138, 10/126 and coded samples G, I and J had been used previously [19].
Table 1.
Characterisation of samples used in this study.
| Approximate activity in VaccZyme ELISA | NIBSC code | Description | ||
|---|---|---|---|---|
| Kit controla | IS 16/138 | |||
| IS 16/138 | NIBSC 16/138 | Pooled anti-Vi IgG sera from 16 volunteers | 631 EU mL−1b | 100 IU mL−1b |
| 10/126 | NIBSC 10/126 | Pooled anti-Vi IgG sera from 9 volunteers | 842 EU mL−1b | 109 IU mL−1b |
| G | NIBSC 16/150 | Post-Typbar TCV vaccination serum | 350 EU mL−1b | 38 IU mL−1b |
| H | NIBSC 16/138 | Pooled anti-Vi IgG sera from 16 volunteers | 631 EU mL−1b | 97 IU mL−1b |
| I | NIBSC 16/144 | Post-Typbar TCV vaccination serum | 345 EU mL−1b | 25 IU mL−1b |
| J | NIBSC 16/146 | Post-Typhim vaccination serum | 524 EU mL−1b | 62 IU mL−1b |
| K | NIBSC 16/148 | Post-Typhim vaccination serum | 150 EU mL−1c | – |
| L | NIBSC 16/168 | Post-Typbar TCV vaccination serum | 3876 EU mL−1c | – |
| M | NIBSC 16/180 | Post-Typhim vaccination serum | 61 EU mL−1c | – |
Supplied by manufacturer.
Rijpkema et al. 2018.
Preliminary estimate based on 2 VaccZyme ELISA runs performed at NIBSC.
Coded samples and IS 16/138 were produced using sera donated by volunteers immunized with WHO prequalified and licensed vaccines either a plain Vi vaccine or a Vi-TT conjugate vaccine, who were recruited by the Oxford Vaccine Group (OVG) [16,19]. Sera used for 10/126, originated from clinical trial volunteers immunized with the same Vi-TT conjugate vaccine and sera were donated by Bharat Biotech Limited International of India [19,20].
All samples tested negative for antibodies to HIV 1/2 and hepatitis C and hepatitis B surface antigen. Freeze dried samples IS 16/138, 10/126 and G to M were reconstituted as described in the instructions for use.
To allow for a standardised Vi-PLL ELISA to be performed by participants, each of them received essential reagents which met the designated specifications of the assay: one ampoule of IS 12/244 for Vi from Citrobacter freundii, one ampoule of mouse monoclonal anti-human IgG Fc alkaline phosphatase (AP) conjugate, one vial of poly-l-lysine and one vial of 4-nitrophenyl phosphate disodium salt hexahydrate substrate. In one instance, BRIJ-35 was supplied as well. VaccZyme ELISA kits were sent to 3 participants. All samples and reagents were sent on dry ice or 2–8 °C as prescribed.
2.3. ELISAs
All participants tested the study samples in the Vi-PLL ELISA. In addition, three participants used the VaccZyme ELISA and one participant carried out an in-house biotinylated Vi ELISA. The code and a brief description of the ELISAs are given in Table 2. ELISA procedures are described below. Six different plate layouts were provided, and samples were tested over two days with 3 plates on each day. Each participant was asked to prepare starting dilutions of samples at 1:100 in appropriate assay diluents, except for IS 16/138, which had a starting dilution of 1:25 and sample L which had a starting dilution of 1:400.
Table 2.
Format of Vi ELISAs used by participants.
| Laboratory code | ELISA method |
Vi characteristics |
Antigen coating procedure | |||
|---|---|---|---|---|---|---|
| Name | Format | Status | Biological origin | |||
| 1,5,6, | VaccZyme | Indirect | Not disclosed | S. Typhi | Procedure not disclosed | |
| 1,2,3,4,5,6,7,8,9,10 | Vi poly-l-lysine | Indirect | Native | C. freundii | Pre-coat with poly–l-Lysine to bind Vi | |
| 6 | Biotinylated Vi | Capture | Biotinylated | S. Typhi | Streptavidin coat to bind biotinylated Vi | |
2.3.1. VaccZyme ELISA
The VaccZyme ELISA was carried out according to the manufacturer's instructions (Binding Site). The VaccZyme ELISA is based on Vi of S. Typhi. Five calibrators, covering a range from 7.4, 22.2, 66.7, 200 and 600 EU mL−1, and a high and a low positive control were included in each run. The assay has a sensitivity of 7.4 EU mL−1. Plates were read at OD450nm.
2.3.2. Vi poly-l-lysine ELISA
The procedure for the Vi-PLL ELISA is a modification of the assay described by Szu et al. [26] by the addition of a pre-coating step with high molecular weight poly-l-lysine hydrobromide (P1399, Sigma) [24,27], followed by a coat of Vi from C. freundii (NIBSC 12/244). In brief, 100 μL of 10 μg poly-l-lysine mL−1 in PBS was added to wells of a Nunc Maxisorp plate, incubated at RT for 2 h and washed 6x with 0.85% NaCl and 0.1% Brij35 in ultrapure water (NaCl-Brij 35), 100 μL of 2 μg Vi mL−1 in PBS was added to the wells. Plates were incubated overnight at 37 °C and washed 6x with NaCl-Brij 35. 250 μL 1% BSA in PBS (Blocking Buffer, BB) was added to each well. Plates were incubated for 1 h at 37 °C and washed six times. Dilutions of test samples were prepared in assay diluent 1 (AD1: BB with 0.1% Brij35). 100 μL of diluted tested sample was dispensed to appropriate wells of the plate. Samples were incubated at 37 °C for 1 h, and washed 6x with NaCl-Brij 35. Then 100 μL of mouse monoclonal Anti-Human IgG Fc AP conjugate diluted 1:5000 in AD1 was added to each well, incubated at 37 °C for 1 h and washed 6x with NaCl-Brij 35. 100 μL 4-Nitrophenyl Phosphate disodium salt hexahydrate substrate (N 7653, Sigma) in Tris/3 mM Mg-buffer (pH 9.8) was added per well and incubated at RT in dark for 1 h, followed by the addition of 50 μL 3 M NaOH stop solution to each well. The plate was read at OD405nm.
A post-study questionnaire revealed that participants adhered closely to the procedure described above (results not shown). However, some variations occurred: plates were rinsed either by hand or by plate washer, and if a plate washer is used a 180° turn of the plate after three rinses should be carried out. Laboratories 1 and 10 sealed ELISA plates during incubation steps but most laboratories covered plates with lids.
2.3.3. Biotinylated Vi ELISA
The procedure carried out by laboratory 6 is a minor modification of the ELISA described by Ferry et al. [28]. The plate surface is coated with streptavidin to capture biotinylated Vi from S. typhi (Fina Biosolutions LLC). In brief, streptavidin from Streptomyces avidinii (Sigma, S4762) was prepared in a solution of 3 μg mL−1 and 100 μL was added to each well of flat bottom microtiter plates (Nunc Maxisorp) and incubated uncovered at 37 °C overnight, allowing the solution to evaporate to dryness. Pre-coated plates were stored at 4 °C until used for coating. For antigen coating, 2 μg mL−1 of biotinylated S. Typhi Vi PS produced locally was prepared in PBS (pH 7.4) and 100 μL was added to the wells of pre-treated plates. Plates were incubated for 3 h at 37 °C and washed with PBS-T and wells were blocked overnight with 250 μL PBS containing 10% non-fat dry milk at 4 °C. Plates were washed 6x with PBS-T with 2 min soaking period in between washes. Sera and reference reagents were diluted in AD2 (10% non-fat dry milk (w/v) in PBS (pH 7.3–7.5) and 0.05% Tween-20) and added to the plates. All plates were incubated for 1 h at 37 °C. Following incubation and washing as described above, plates were incubated with HRP-labelled goat anti-Human IgG (Jackson Immunoresearch, 109-035-008) diluted in AD2 for 1 h at 37 °C. The plates were washed 6x with PBS-T, and 100 μl of TMB Microwell Peroxidase Substrate (KPL, SeraCare Life Sciences Inc) was added to each well, incubating for 15 min in the dark (with agitation). The reaction was stopped by adding 100 μL of 1 M Phosphoric acid per well. Plates were read immediately at OD450nm.
2.4. Statistical analysis
Raw data from all individual plates were analysed with a four-parameter logistic model (sigmoid curves) in order to determine the potencies of study samples relative to IS 16/138. An example of the data obtained from a single plate is shown in Fig. 1. Analysis was performed using EDQM CombiStats Software Version 5.0 [29]. Acceptable parallelism of dose-response relationships for a test sample and IS 16/138 was concluded if the slope ratio calculated by CombiStats was within the range [0.80, 1.25]. Acceptable precision was concluded for each relative potency estimate if it had a 95% confidence interval no wider than 80–125% of the estimate. In addition to these criteria for individual samples, each plate was only considered acceptable if valid potency estimates were obtained for sample H (coded duplicate of IS 16/138) and 10/126, both within 66.7–150% of their assigned values of 100 IU mL−1 and 109 IU mL−1 respectively. No potency estimates have been reported where samples or plates did not meet these criteria. It should be noted that the validity criteria were intended for use in the analysis of data from this study only, in order to apply consistent criteria to all laboratories and assess their relative performance. They should not be interpreted as suitable for routine use in the assessment of assay validity within the collaborating laboratories unless suitably justified.
Fig. 1.
Example of data reported for single Vi-PLL ELISA plate.
Data from laboratory 3 indicated IS 16/138 was not tested at the appropriate requested dilutions, therefore potencies of study samples relative to sample H, the coded duplicate of IS 16/138, were analysed using a parallel line model. The same assay validity criteria as described above were applied.
All mean results shown in this report are unweighted geometric means (GM). Variability has been expressed using geometric coefficients of variation (GCV = {10s-1} × 100%, where s is the standard deviation of the log10 transformed estimates). Individual assay estimates of relative potency were log transformed and a mixed effects model used to determine intra-laboratory and inter-laboratory variance components (also expressed as % GCV) for each sample.
Further assessment of agreement in geometric mean results for each pair of laboratories was performed by calculating Lin's concordance correlation coefficient [30,31] with log transformed data. Calculations for this were performed using the R package ‘DescTools’ [32]. A value of 1 for this coefficient indicates perfect agreement between the two laboratories.
3. Results
3.1. Performance of individual laboratories
The number of valid relative potency estimates obtained for each sample in each laboratory are shown in Table 3 and cases where fewer than three valid estimates were obtained are highlighted. The intra-laboratory (between-plate) variability for each sample is shown in Table 4 and cases where the GCV value exceeds 25% are highlighted. Details of all individual assay results and outcomes are provided in the supplementary table (attached separately). A summary of the causes of assay invalidity when applying the criteria described above is given in Table 5. A large number of the invalid assays (21 out of 53) were due to the non-parallelism of sample K and IS 16/138 in Vi-PLL ELISAs, particularly those performed by laboratories 2, 3, 5 and 7, with slope ratios for sample K falling below the acceptable lower limit of 0.80 (see Fig. 2). This phenomenon appears to be unique for sample K and was not observed for sample M which has a similar low relative potency. Apart from this observation regarding sample K, the reasons for assay invalidity are mixed (e.g. non-parallelism, 10/126 giving result higher or lower than expected range) and related to the performance quality of the laboratory.
Table 3.
Number of valid potency estimates relative to IS 16/138 obtained out of 6 runs for each study sample in the VaccZyme, Vi poly-l-lysine and biotinylated-Vi ELISAs.
| ELISA | Laboratory code | Valid potency estimates per study sample |
|||||||
|---|---|---|---|---|---|---|---|---|---|
| 10/126 | G | Ha | I | J | K | L | M | ||
| Vi poly-l-lysine | 1 | 6 | 6 | 6 | 6 | 6 | 6 | 6 | 6 |
| 2 | 6 | 6 | 6 | 4 | 6 | 3 | 6 | 5 | |
| 3 | 6 | 6 | ntb | 6 | 6 | 1 | 6 | 5 | |
| 4 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 2 | |
| 5 | 6 | 5 | 6 | 5 | 6 | 1 | 6 | 6 | |
| 6 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | |
| 7 | 6 | 6 | 6 | 5 | 5 | 0 | 5 | 6 | |
| 8 | 5 | 5 | 5 | 5 | 5 | 5 | 5 | 5 | |
| 9 | 5 | 5 | 5 | 4 | 4 | 3 | 4 | 4 | |
| 10 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | |
| VaccZyme | 1 | 6 | 3 | 6 | 6 | 6 | 6 | 5 | 6 |
| 5 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | |
| 6 | 6 | 6 | 6 | 6 | 6 | 5 | 6 | 6 | |
| Biotinylated-Vi | 6 | 6 | 6 | 6 | 6 | 6 | 5 | 6 | 6 |
: Coded duplicate of IS 16/138.
: not tested.
Table 4.
Intra-laboratory variation for potency estimates of study samples in the VaccZyme, Vi poly-l-lysine and biotinylated-Vi ELISAs.
| ELISA | Laboratory code | Intra-laboratory variation for study samples as % GCVa |
|||||||
|---|---|---|---|---|---|---|---|---|---|
| 10/126 | G | Hb | I | J | K | L | M | ||
| Vi poly-l-lysine | 1 | 5 | 6 | 6 | 9 | 7 | 9 | 6 | 9 |
| 2 | 18 | 15 | 12 | 6 | 20 | 22 | 16 | 23 | |
| 3 | 6 | 10 | ntc | 12 | 8 | ncd | 8 | 7 | |
| 4 | 22 | 27 | 9 | 12 | ncd | 42 | 44 | ncd | |
| 5 | 12 | 27 | 10 | 11 | 16 | ncd | 28 | 10 | |
| 6 | 9 | 8 | 11 | 21 | 9 | 15 | 25 | 2 | |
| 7 | 12 | 25 | 22 | 51 | 29 | ncd | 47 | 22 | |
| 8 | 5 | 10 | 12 | 3 | 6 | 5 | 8 | 6 | |
| 9 | 17 | 12 | 12 | 10 | 14 | 10 | 13 | 13 | |
| 10 | 7 | 8 | 10 | 16 | 11 | ncd | 17 | 2 | |
| VaccZyme | 1 | 10 | 9 | 8 | 10 | 8 | 7 | 8 | 6 |
| 5 | 18 | 14 | 2 | 5 | 25 | 59 | 41 | 32 | |
| 6 | 5 | 6 | 3 | 5 | 2 | 2 | 5 | 5 | |
| Biotinylated-Vi | 6 | 5 | 5 | 2 | 7 | 8 | 2 | 4 | 4 |
Geometric Coefficient of Variation.
Coded duplicate of IS 16/138.
Not tested.
Not calculated as fewer than 3 valid potency estimates were obtained for the sample.
Table 5.
Causes of assay invalidity in Vi-PLL ELISA.
| Invalidity reason | Number of invalid cases |
|---|---|
| Non-parallel (slope ratio < 0.80) | 26a |
| Non-parallel (slope ratio > 1.25) | 7 |
| 10/126 low (<72.7 IU mL−1) | 2 |
| 10/126 high (>163.5 IU mL−1) | 4 |
| 10/126 non-parallel (slope ratio < 0.80) | 0 |
| 10/126 non-parallel (slope ratio > 1.25) | 0 |
| Sample H low (<66.7 IU mL−1) | 0 |
| Sample H high (>150 IU mL−1) | 4 |
| H non-parallel (slope ratio < 0.80) | 1 |
| H non-parallel (slope ratio > 1.25) | 2 |
| No convergence (cannot fit model) | 4 |
| Poor plate precision (wide CI) | 3 |
| Total of invalid cases | 53 (out of 474b) |
21 out of 26 cases are for sample K in the Vi-PLL-ELISA by labs 2, 3, 5 and 7.
Maximum number of potency estimates possible in this study.
Fig. 2.
Overview of slope ratios of samples 10/126 and G-M relative to IS 16/138 when tested in the Vi-PLL ELISA and Vacczyme ELISA. Sample H is a coded duplicate of 16/138.
If these criteria are used to define a good assay performance (i.e. three or more valid estimates for all samples and GCV values ≤ 25%), the Vi-PLL ELISA of laboratories 1, 2, 6, 8, 9, the VaccZyme ELISA of laboratories 1 and 6, and the biotinylated Vi ELISA of laboratory 6 were all considered to have been performed to a good standard.
Laboratories 3, 5 and 10 also appeared to perform the Vi-PLL ELISA to an acceptable standard, obtaining three or more valid estimates for all samples except for K. All GCV values for these laboratories were also ≤25%, with the exception of samples G and L by laboratory 5 (GCV values of 27% and 28% respectively).
Several high GCV values (>40%) or a low number of valid estimates were obtained by laboratories 4 and 7 for the Vi-PLL ELISA and by laboratory 5 for the VaccZyme ELISA, therefore the quality of the performances of these laboratories was considered doubtful for these assays. Based on our assessment, the data from these laboratories were excluded from further calculations to assess inter-laboratory variability (reproducibility) and the comparison of the two ELISAs.
3.2. Comparison of Vi poly-l-lysine and VaccZyme ELISAs
Table 6 and Fig. 3 show the GM potency estimates in IU mL−1 for each of the study samples as reported by each laboratory. Table 7 shows the concordance correlation coefficients for each laboratory pair, with values in excess 0.80, 0.90 and 0.95 shaded to indicate increasing levels of concordance in results obtained across the panel of samples tested in the Vi-PLL and VaccZyme ELISAs. The majority of values for laboratory 2 were <0.80, showing poor concordance with other laboratories. Excellent concordance was observed between laboratories 1, 3 and 8 performing the Vi-PLL ELISA and laboratories 1 and 6 performing the VaccZyme ELISA (all values > 0.95). In addition, low intra-laboratory variability was observed for these laboratories, with average GCV values < 10% (see Table 4).
Table 6.
Geometric mean potency estimates of study samples relative to IS 16/138 in the VaccZyme, Vi poly-l-lysine and biotinylated-Vi ELISAs.
| ELISA | Laboratory code | GMa potency estimates for study samples in IU mL−1 |
|||||||
|---|---|---|---|---|---|---|---|---|---|
| 10/126 | G | Hb | I | J | K | L | M | ||
| Vi poly-l-lysine | 1 | 95 | 46 | 98 | 29 | 70 | 10 | 372 | 12 |
| 2 | 97 | 37 | 96 | 57 | 47 | 43 | 134 | 19 | |
| 3 | 108 | 47 | ntc | 34 | 68 | ncd | 329 | 15 | |
| 5 | 130 | 62 | 115 | 28 | 74 | ncd | 445 | 18 | |
| 6 | 131 | 80 | 112 | 21 | 50 | 10 | 175 | 14 | |
| 8 | 98 | 49 | 105 | 22 | 72 | 14 | 384 | 17 | |
| 9 | 126 | 47 | 125 | 28 | 99 | 32 | 407 | 17 | |
| 10 | 150 | 75 | 114 | 38 | 59 | ncd | 220 | 16 | |
| VaccZyme | 1 | 89 | 33 | 84 | 22 | 57 | 9 | 307 | 11 |
| 6 | 111 | 42 | 100 | 27 | 69 | 11 | 365 | 15 | |
| Biotinylated-Vi | 6 | 149 | 131 | 101 | 10 | 40 | 11 | 208 | 11 |
Geometric Mean.
Coded duplicate of IS 16/138.
Not tested.
Not calculated as < 3 valid potency estimates were obtained for sample.
Fig. 3.
Geometric mean potency estimates for study samples relative to IS 16/138 in IU mL−1 for the VaccZyme ELISA performed by laboratories 1 and 6, the Vi poly-l-lysine ELISA (Vi-PLL) performed by laboratories 1, 3, 5, 6, 8, 9 and 10, and biotinylated-Vi ELISA performed by laboratory 6.
Table 7.
Concordance correlation coefficients in laboratory pairs for log potencies relative to IS 16/138 in the VaccZyme and Vi poly-l-lysine ELISAs.
A summary of overall GM potency estimates from each ELISA, excluding data from laboratory 2 for the Vi-PLL ELISA, is shown in Table 8 and Fig. 4a. An illustration of the highest levels of agreement and reproducibility that can be achieved for the Vi-PLL and VaccZyme ELISAs reached by laboratories which demonstrated a superior level of performance in this study is given in Table 8 and Fig. 4b. A high degree of concordance in geometric mean estimates was evident between the two ELISA methods (Lin's concordance correlation coefficient 0.974 and 0.992 in Fig. 4a and b, respectively).
Table 8.
Summary of overall geometric mean potency estimates of study samples relative to IS 16/138 in the VaccZyme and Vi poly-l-lysine ELISAs.
| Data From | Vi poly-l-lysine ELISA |
VaccZyme ELISA |
|||||||
|---|---|---|---|---|---|---|---|---|---|
| Laboratories 1, 3, 5, 6, 8, 9 and 10 | Laboratories 1, 3 and 8 | Laboratories 1 and 6 | |||||||
| Study sample | GMa | GCV (%)b | N | GM | GCV (%) | n | GM | GCV (%) | n |
| 10/126 | 118 | 17 | 7 | 100 | 7 | 3 | 99 | 17 | 2 |
| G | 56 | 26 | 7 | 47 | <1 | 3 | 37 | 18 | 2 |
| Hc | 111 | 8 | 6 | 101 | 3 | 2 | 92 | 12 | 2 |
| I | 28 | 22 | 7 | 28 | 22 | 3 | 25 | 14 | 2 |
| J | 69 | 22 | 7 | 70 | <1 | 3 | 63 | 15 | 2 |
| K | 15 | 48 | 4 | 12 | 23 | 2 | 10 | 16 | 2 |
| L | 318 | 40 | 7 | 361 | 8 | 3 | 335 | 13 | 2 |
| M | 16 | 14 | 7 | 15 | 18 | 3 | 13 | 21 | 2 |
Geometric Mean.
Inter-laboratory Geometric Coefficient of Variation.
Coded duplicate of IS 16/138.
Fig. 4.
a Comparison of overall geometric mean potency estimates in IU mL−1 relative to IS 16/138 by the Vi poly-l-lysine ELISA performed by laboratories 1, 3, 5, 6, 8, 9 and 10 and the VaccZyme ELISA performed by laboratories 1 and 6. 4b: Comparison of overall geometric mean potency estimates in IU mL−1 relative to IS 16/138 by the Vi poly-l-lysine ELISA performed by laboratories 1, 3 and 8 and the VaccZyme ELISA performed by laboratories 1 and 6.
It was noted that samples G, I and J were tested in the previous study to establish IS 16/138 [19]; and that the GM potency estimates obtained by the VaccZyme ELISA in that study (38, 25 and 62 IU mL−1 for samples G, I and J, respectively; n = 6) show excellent agreement with the geometric mean of values obtained by laboratories 1 and 6 in this study (37, 25 and 63 IU mL−1 for samples G, I and J, respectively; n = 2; Table 8). In the same study, geometric mean potencies were obtained by the Vi-PLL ELISA for these samples (43, 27 and 67 IU mL−1 for samples G, I and J, respectively; n = 2), showing good agreement with the optimum GM values obtained in this study (47, 28 and 70 IU mL−1 for samples G, I and J, respectively; n = 3; Table 8).
3.3. Biotinylated Vi ELISA
The biotinylated Vi ELISA performed by laboratory 6 gave valid estimates of potency relative to IS 16/138 for all samples (Table 4, Table 6), with low levels of intra-laboratory variation (GCV≤8%; Table 5). However, the ranking of samples G, I and J based on the geometric mean potencies differed from that obtained by the Vi-PLL and VaccZyme ELISAs (Table 6 and Fig. 3). Indeed, potency estimates obtained in the previous study for these study samples, then coded as B, D and E, by the same biotinylated Vi ELISA were ranked similarly and did not agree with values obtained by the VaccZyme ELISA [19]. The results of the current study again confirm a low level of concordance between the biotinylated Vi ELISA and the VaccZyme or Vi-PLL ELISAs [19].
4. Discussion
The aim of the current study was to evaluate the performance and reproducibility of a standardised Vi-PLL ELISA alongside the commercial VaccZyme ELISA by multiple laboratories. Only participant 6 used their in-house ELISA to test study samples, and thus the emphasis of the current study remains on the comparison of the performance of the Vi-PLL ELISA and the VaccZyme ELISA. The Vi-PLL ELISA has several advantages over the VaccZyme ELISA, in that its procedure is published in the public domain [24,26,27], it uses publicly available biologicals of standardised quality, its availability is not limited to a single source and it is less costly to run. Disadvantages are the lower level of standardization of reagents and the absence of assay specific run controls.
Two participants of the previous study, represented here by laboratory codes 1 and 8, submitted a superior dataset from the Vi-PLL ELISA, which was their in-house ELISA at the time of the previous study [19]. Both participants produced results with low intra-laboratory variability and consistently reported high numbers of valid estimates (see Table 3, Table 4). Indeed, a post-study questionnaire (results not shown) confirmed that participants adhered closely to the Vi-PLL ELISA procedure, and that familiarity with the Vi-PLL ELISA was the most important factor for achieving low intra-laboratory GCVs. A similar observation can be made for participant 6, a national reference laboratory, which performed their in-house Vi-biotinylated ELISA to a higher standard than the Vi-PLL ELISA, which was introduced in this laboratory as part of the current study. Participants 1, 2, 3, 5, 6, 8, 9 and 10 produced Vi-PLL ELISA data that were acceptable by our criteria. However, relative potency estimates produced by laboratory 2 showed the lowest concordance within this group. The cause of this discrepancy is unclear.
Potency estimates in the Vi-PLL ELISA produced by participants 4 and 7, and by participant 5 in the VaccZyme ELISA were less convincing, with several high GCV values (>40%) and a low number of valid estimates (see Table 3, Table 4). We speculate that in these cases limited experience with the two ELISA procedures may have played a part. We note that by criteria less stringent than used in our study these results may well be acceptable for routine serology.
Exclusion of the relative potency estimates from laboratories 2, 4 and 7 resulted in a high level of concordance between the Vi-PLL and VaccZyme ELISAs and confirmed the status of sample K as an outlier (see Table 8 and Fig. 4a and b). We also observed a good agreement with the relative potencies assigned to coded samples reported in the previous study [19].
Thus, despite most of the participating laboratories not being familiar with the Vi-PLL ELISA, a satisfactory performance was achieved in most cases, with good repeatability and reproducibility observed in the study results across the majority of laboratories. Concordance in the relative potency estimates obtained by the Vi-PLL ELISA and the VaccZyme ELISA was also evident for the panel of samples tested.
We conclude that this study demonstrated that the Vi-PLL ELISA is a credible alternative to the VaccZyme ELISA, provided operators are trained and competent, that criteria for reagent quality, for example the use of high molecular weight PLL, are adhered to, that an appropriate reference standard is used, and that assay validity criteria (system and sample suitability criteria) are applied. These measures should enable an optimal performance of the Vi-PLL ELISA. To minimise intra-laboratory variation, it is recommended that a dose response curve of an in-house reference standard calibrated in IU relative to the 1st WHO IS for anti-Vi IgG (human) is included in each run. With such an approach the Vi-PLL ELISA should aid the harmonisation of clinical trial studies with different TCV formulations and allow comparison of serology data from different target groups.
Acknowledgements
This work was supported by the Bill & Melinda Gates Foundation, Seattle, Washington, United States of America, (grant number OPP 1145952). We gratefully acknowledge the participants of the anti-Vi IgG working group for their important contributions in time, expertise and effort, which were indispensable for the completion of this study: Mrs. M. Usha, Dr D. Das, Dr VK Mohan and Mr SD Prasad of Quality Operations of Bharat Biotech International Ltd, Telangana, India; Mrs. Lestari and Ms. TM Fanselly of the Clinical Trial Department, Surveillance & Clinical Trial Division, Bio Farma, Bandung, Indonesia; Ms EY Lee of the laboratory for Clinical Immunology, International Vaccine Institute, Seoul, Republic of Korea; Ms I Mayo, Mrs M Reymann of the Centre for Vaccine Development, University of Maryland, Maryland, United States of America.
We thank Dr L-F Ma and Dr D Steele of the Bill and Melinda Gates Foundation, Dr I Feavers of NIBSC, Dr I Knezevic and Dr K Gao of WHO and Dr D Goldblatt of Great Ormond Street Institute of Child Health for their guidance and support. Finally, we thank Mr M Harris and Mrs S-J Holmes and their colleagues at the Centre for Biological Reference Materials for coding and packaging of samples and distribution of the study samples, assay reagents and ELISA kits.
Footnotes
Supplementary data to this article can be found online at https://doi.org/10.1016/j.biologicals.2020.05.002.
Appendix A. Supplementary data
The following are the Supplementary data to this article:
References
- 1.Mogasale V., Maskery B., Ochiai R.L., Lee J.S., Mogasale V.V., Ramani E. Burden of typhoid fever in low-income and middle-income countries: a systematic, literature-based update with risk-factor adjustment. Lancet Glob Health. 2014;2:e570–e580. doi: 10.1016/S2214-109X(14)70301-8. [DOI] [PubMed] [Google Scholar]
- 2.Felix A., Pitt R.M. A new antigen of B. typhosus. Its relation to virulence and to active and passive immunisation. Lancet. 1934;227:186–191. [Google Scholar]
- 3.Robbins J.D., Robbins J.B. Re-examination of the protective role of the capsular polysaccharide (Vi antigen) of Salmonella typhi. J Infect Dis. 1984;150:436–449. doi: 10.1093/infdis/150.3.436. [DOI] [PubMed] [Google Scholar]
- 4.Bhutta Z.A., Capeding M.R., Bavdekar A., Marchetti E., Ariff S., Soofi S.B. Immunogenicity and safety of the Vi-CRM197 conjugate vaccine against typhoid fever in adults, children, and infants in south and southeast Asia: results from two randomised, observer-blind, age de-escalation, phase 2 trials. Lancet Infect Dis. 2014;14:119–129. doi: 10.1016/S1473-3099(13)70241-X. [DOI] [PubMed] [Google Scholar]
- 5.Keitel W.A., Bond N.L., Zahradnik J.M., Cramton T.A., Robbins J.B. Clinical and serological responses following primary and booster immunization with Salmonella typhi Vi capsular polysaccharide vaccines. Vaccine. 1994;12:195–199. doi: 10.1016/0264-410x(94)90194-5. [DOI] [PubMed] [Google Scholar]
- 6.Zhou W.Z., Koo H.W., Wang X.Y., Zhang J., Park J.K., Zhu F. Revaccination with locally-produced Vi typhoid polysaccharide vaccine among Chinese school-aged children: safety and immunogenicity findings. Pediatr Infect Dis J. 2007;26:1001–1005. doi: 10.1097/INF.0b013e31812565bc. [DOI] [PubMed] [Google Scholar]
- 7.Kossaczka Z., Lin F.Y., Ho V.A., Thuy N.T., Van B.P., Thanh T.C. Safety and immunogenicity of Vi conjugate vaccines for typhoid fever in adults, teenagers, and 2- to 4-year-old children in Vietnam. Infect Immun. 1999;67:5806–5810. doi: 10.1128/iai.67.11.5806-5810.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Lin F.Y., Ho V.A., Khiem H.B., Trach D.D., Bay P.V., Thanh T.C. The efficacy of a Salmonella typhi Vi conjugate vaccine in two-to-five- year-old children. N Engl J Med. 2001;344:1263–1269. doi: 10.1056/NEJM200104263441701. [DOI] [PubMed] [Google Scholar]
- 9.Thiem V.D., Lin F.Y., Canh D.G., Son N.H., Anh D.D., Mao N.D. The Vi conjugate typhoid vaccine is safe, elicits protective levels of IgG anti-Vi, and is compatible with routine infant vaccines. Clin Vaccine Immunol. 2011;18:730–735. doi: 10.1128/CVI.00532-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Jones C., Lee C.K., Ahn C., Shin J., Knezevic I. Working Group on quality, safety and efficacy of typhoid Vi capsular polysaccharide conjugate vaccines, Jeju, Republic of Korea, 5-7 September 2012. Vaccine. 2013;31:4466–4469. doi: 10.1016/j.vaccine.2013.07.070. [DOI] [PubMed] [Google Scholar]
- 11.WHO WHO Guidelines on the quality, safety and efficacy of typhoid conjugate vaccines. 64th Meeting of the WHO Expert Committee on Biological Standardization. WHO Tech Rep Ser. 2014;987:101–175. http://www.who.int/biologicals/areas/vaccines/TYPHOID_BS2215_doc_v1.14_WEB_VERSION.pdf October 2013. [Google Scholar]
- 12.Mitra M., Shah N., Ghosh A., Chatterjee S., Kaur I., Bhattacharya N. Efficacy and safety of Vi-tetanus toxoid conjugated typhoid vaccine (PedaTyph™) in Indian children: school based cluster randomized study. Hum Vaccines Immunother. 2016;12:939–945. doi: 10.1080/21645515.2015.1117715. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Mohan V.K., Varanasi V., Singh A., Pasetti M.F., Levine M.M., Venkatesan R. Safety and immunogenicity of a Vi polysaccharide-tetanus toxoid conjugate vaccine (Typbar-TCV) in healthy infants, children, and adults in typhoid endemic areas: a multicenter, 2-cohort, open-label, double-blind, randomized controlled phase 3 study. Clin Infect Dis. 2015;61:393–402. doi: 10.1093/cid/civ295. [DOI] [PubMed] [Google Scholar]
- 14.Sahastrabuddhe S., Saluja T. Overview of the typhoid conjugate vaccine pipeline current status and future plans. Clin Infect Dis. 2019;68:S22–S26. doi: 10.1093/cid/ciy884. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Nanh M.N., Phan V.B., Vo A.H., Tran C.T., Lin F.Y., Bryla D.A. Persistent efficacy of Vi conjugate vaccine against typhoid fever in young children. N Engl J Med. 2003;349:1390–1391. doi: 10.1056/NEJM200310023491423. [DOI] [PubMed] [Google Scholar]
- 16.Jin C., Gibani M.M., Moore M., Juel H.B., Jones E., Meiring J. Efficacy and immunogenicity of a Vi-tetanus toxoid conjugate vaccine in the prevention of typhoid fever using a controlled human infection model of Salmonella Typhi: a randomised controlled, phase 2b trial. Lancet. 2017 doi: 10.1016/S0140-6736(17)32149-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Shakya M., Colin-Jones R., Theiss-Nyland K., Voysey M., Pant D., Smith N. Phase 3 efficacy analysis of a typhoid conjugate vaccine trial in Nepal. N Engl J Med. 2019;381:2209–2218. doi: 10.1056/NEJMoa1905047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Yousafzai M.T., Karim S., Kashif A., Baig A., Iqbal H., Rehman N., Qamar F. 11th Int Conference on Typhoid and other invasive Salmonelloses. 2019. Multipronged surveillance activities for identification of S. Typhi patients in Hyderabad: experience from XDR typhoid outbreak setting in Pakistan; p. p198. Abstract 183. [Google Scholar]
- 19.Rijpkema S., Hockley J., Logan A., Rigsby P., Atkinson E., Jin C. Establishment of the first International Standard for human anti-typhoid capsular Vi polysaccharide IgG. Biologicals. 2018;56:29–38. doi: 10.1016/j.biologicals.2018.09.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Losonsky G.A., Ferreccio C., Kotloff K.L., Kaintuck S., Robbins J.B., Levine M.M. Development and evaluation of an enzyme-linked immunosorbent assay for serum Vi antibodies for detection of chronic Salmonella typhi carriers. J Clin Microbiol. 1987;25:2266–2269. doi: 10.1128/jcm.25.12.2266-2269.1987. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.WHO Proposed First WHO International Standard for anti-Vi polysaccharide serum (human). 66th Meeting of the WHO Expert Committee on Biological Standardization, 12 to 16 October 2015. WHO Tech Rep Series. 2015;999:83. [Google Scholar]
- 22.Barra A., Schulz D., Aucouturier P., Preud'homme J.L. Measurement of anti-Haemophilus influenzae type b capsular polysaccharide antibodies by ELISA. J Immunol Methods. 1988;115:111–117. doi: 10.1016/0022-1759(88)90317-1. [DOI] [PubMed] [Google Scholar]
- 23.Arakere G., Frasch C.E. Specificity of antibodies to O-acetyl-positive and O-acetyl-negative group C Meningococcal polysaccharides in sera from vaccinees and carriers. Infect Immun. 1991;59:4349–4356. doi: 10.1128/iai.59.12.4349-4356.1991. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Stearns N.A., Zhou S., Petri M., Binder S.R., Pisetsky D.S. The use of poly-L-lysine as a capture agent to enhance the detection of anti-nuclear antibodies by ELISA. PloS One. 2016;9(11) doi: 10.1371/journal.pone.0161818. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.WHO First WHO International Standard for anti-typhoid capsular Vi polysaccharide immunoglobulin G (human). 68th Meeting of the WHO Expert Committee on Biological Standardization, 17 to 20 October 2017. WHO Tech Rep Ser. 2018;1011:72. [Google Scholar]
- 26.Szu S.C., Hunt S., Xie G., Robbins J.B., Schneerson R., Gupta R.K. A human IgG anti-Vi reference for Salmonella typhi with weight-based antibody units assigned. Vaccine. 2013;31:1970–1974. doi: 10.1016/j.vaccine.2013.02.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Capeding M.R., Teshome S., Saluja T., Syed K.A., Kim D.R., Park J.Y. Safety and immunogenicity of a Vi-DT typhoid conjugate vaccine: phase I trial in healthy Filipino adults and children. Vaccine. 2018;36:3794–3801. doi: 10.1016/j.vaccine.2018.05.038. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Ferry B.L., Misbah S.A., Stephens P., Sherrell Z., Lythgoe H., Bateman E. Development of an anti-Salmonella typhi Vi ELISA: assessment of immunocompetence in healthy donors. Clin Exp Immunol. 2004;136:297–303. doi: 10.1111/j.1365-2249.2004.02439.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.EDQM, Council of Europe CombiStats v5.0. www.combistats.eu
- 30.Lin L. A concordance correlation coefficient to evaluate reproducibility. Biometrics. 1989;45:255–268. [PubMed] [Google Scholar]
- 31.Lin L. A note on the concordance correlation coefficient. Biometrics. 2000;56:324–325. [Google Scholar]
- 32.R Core Team R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/Assessed.2018.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.