Abstract
There is no vaccine to protect from cryptosporidiosis, a leading cause of diarrhea in infants in low- and middle-income countries. Here, we comprehensively identified parasite antigens associated with protection from reinfection. A Cryptosporidium protein microarray was constructed by in vitro transcription and translation of 1,761 C. parvum, C. hominis, or C. meleagridis antigens, including proteins with a signal peptide and/or a transmembrane domain. Plasma IgG and/or IgA from Bangladeshi children longitudinally followed for cryptosporidiosis from birth to 3 years of age allowed for identification of 233 seroreactive proteins. Seven of these were associated with protection from reinfection. These included Cp23, Cp17, Gp900, and 4 additional antigens — CpSMP1, CpMuc8, CpCorA and CpCCDC1. Infection in the first year of life, however, often resulted in no detectable antigen-specific antibody response, and antibody responses, when detected, were specific to the infecting parasite genotype and decayed in the months after infection. In conclusion, humoral immune responses against specific parasite antigens were associated with acquired immunity. While antibody decay over time and parasite genotype-specificity may limit natural immunity, this work serves as a foundation for antigen selection for vaccine design.
Keywords: Immunology, Infectious disease
Keywords: Adaptive immunity, Parasitology
Introduction
Cryptosporidium parasites are a common cause of diarrhea in infants and children in low- and middle-income countries, globally are the most common cause of outbreaks of waterborne disease, and, in immunocompromised individuals, can cause protracted infections (1). Evidence that a vaccine is an achievable goal includes that the incidence of infection declines with age (2–4) and that antibodies against antigens on the surface of the infectious oocyst (5) and invasive sporozoite parasite life stages are associated with partial immunity to reinfection (6, 7). While the associated protective immune response involves both cellular and humoral immunity, identification of antibody responses against Cryptosporidium antigens associated with protection from reinfection may provide a foundation for the development of an effective anti-Cryptosporidium vaccine.
We previously conducted a natural history study of cryptosporidiosis in infants longitudinally followed for infection from birth to 3 years of age (National Clinical Trial Identifier: NCT02764918) (8–11). The infants resided in a low income community of Dhaka, Bangladesh. Fecal DNA was extracted from diarrheal and monthly surveillance stool samples and symptomatic and asymptomatic cases of cryptosporidiosis were identified using a pan-Cryptosporidium qPCR assay. By the end of the first year, 27.5% (n = 109) of infants had been infected at least once. The immunity arising from this infection was, however, incomplete, with most of these children reinfected by 3 years of age (Supplemental Figure 1; supplemental material available online with this article; https://doi.org/10.1172/JCI166814DS1) (9). These repeat infections had a lower burden of parasites and were more likely to be subclinical in nature.
Here, we present the results from probing a Cryptosporidium protein microarray with antisera from 1-year-old infants. The association of antibody responses against specific proteins with immunity to reinfection at 2 and 3 years of age was then tested.
Results
Identification of immunoreactive proteins.
The Cryptosporidium species protein microarray created for this study comprised a total of 1,761 antigens representing 1,250 unique genes from C. parvum (n = 980), C. hominis (n =263), and C. meleagridis (n =7). C. parvum sequences were used as the backbone of the protein microarray due to the ready availability of C. parvum DNA and its superior assembly and annotation (12, 13) (Supplemental Figure 2). The selected C. parvum proteins included those that had been previously identified as potential vaccine candidates (Supplemental Table 1) (6, 14–34). Open reading frames (ORFs) over 3,000 base pairs were cloned as overlapping segments to optimize in vitro translation. The array also included 15 genetically variant regions of the gp60 gene common in this Bangladeshi population (35). Proteins with conserved sequences in the different Cryptosporidium species that account for the majority of cryptosporidiosis in humans (C. hominis, C. parvum and C. meleagridis) and that were annotated as having a signal peptide — and, thus, potentially a membrane protein and accessible to human antibodies — were prioritized for inclusion (Supplemental Figure 3).
The array was incubated with a 1:100 dilution of plasma collected at 1 year of age from 500 children in the cohort and developed with anti-human IgG (DyLight650, Bethyl Laboratories) and Cy3 AffiniPure F(ab′)2 or anti-human IgA. The distribution of normalized fluorescence signal intensity (SI) values of each antigen was analyzed using a mixture modeling technique Supplemental Figure 4A) to identify the antigen specific background component of the spot signal and hence the appropriate intensity, or cut-off value, that was defined as seropositive (Supplemental Figure 4B).
Antigens were classified as seroreactive in this population if at least 10% of the children had either IgA (Figure 1A) or IgG (Figure 1B) antibodies against the antigen. Using this criterion, 36 antigens were seroreactive to both IgG and IgA (Supplemental Figure 5), 57 antigens by IgA alone, and 140 antigens by IgG alone (Figure 1C). Antigens recognized varied greatly between children, with each antigen recognized by only a subset of the responding infants (Figure 2).
We found that orthologues encoded by C. parvum and C. hominis generated similar signals; for example the C. parvum Cp23 (cgd4_3620) and the C. hominis Cp23 orthologue (Chro.40414) signals were correlated (Pearson r value 0.844 P = 2.11 × 10–119). In total, there were 124 IgG-reactive proteins and 70 IgA-reactive C. parvum proteins. Antigens recognized were from multiple developmental stages of the Cryptosporidium parasite (36–38) (Supplemental Figure 2).
Humoral immune response diminished with time from infection.
The anti-Cryptosporidium IgA and IgG antibody profiles were analyzed using t-distributed stochastic neighbor embedding (t-SNE) as an unsupervised data reduction method for visualization of the trends in the antibody profile, based on the number of days since the first Cryptosporidium-positive diagnostic qPCR and whether the child had a documented prior Cryptosporidium infection (Figure 3A). The antibody profile of children with more recent infections mapped to a distinct region within the t-SNE plot (Region 1, “R1”), while children with earlier infections did not cluster separately from children without a prior infection (Figure 3A). By analyzing the 100 most responsive antigens, the important factors that influenced the antibody profile of children in R1 of the t-SNE plot were the strength of the immune response (Figure 3B) and its breadth, or the number of parasite antigens recognized by IgA and IgG (Figure 3C) (39). Diminishing antibody responses over time were confirmed by a linear regression analysis where, most notably, the breadth of both the IgA and IgG anti-Cryptosporidium immune responses significantly decreased over time (Figure 3D).
Impact of prior infection on antibody response.
While the effect of time since Cryptosporidium infection on antibody levels was significant, it did not completely explain the failure to generate an anti-Cryptosporidium immune response in all cases. To focus on the impact of prior exposure to the Cryptosporidium parasite, the data were analyzed using partial least squares discriminant analysis (PLS-DA) (Figure 3, E and F). This analysis demonstrated that a subset of children with prior infection differed from the population of children with no prior infection, but that a substantial proportion of children with an earlier infection had antibody profiles similar to children without a documented prior infection. We concluded that some infections in this cohort were missed, despite the active surveillance system in place.
To explore whether malnutrition or inflammation impacted the humoral immune response, we examined whether the immune profile correlated with growth failure — a measure of chronic malnutrition measured by child height-for-age Z scores (HAZ) — or biomarkers of systemic and local inflammation (sCD14, IL-1Beta, CRP), or immunoregulatory cytokines (IL-4), but no correlations were observed (Supplemental Figure 6).
Protection from reinfection was not associated with the breadth of the antibody response, i.e., the number of antigens recognized by a given child.
Children for whom a previous infection had been identified had a greater number of parasite antigens recognized by IgA and IgG, or greater “breadth” (Figure 4A). However, no association was found between the breadth of the antibody response and resistance to reinfection using either a data set restricted to the infants with a qPCR-verified Cryptosporidium infection prior to year 1 (Figure 4B) or using the data from the entire study cohort (Figure 4C).
Validation of the array by examining the data obtained from antigens previously associated with a protective immune response.
C. hominis Cp23 (Chro.40414) and Cp17, a conserved peptide encoded by the variable C. hominis gp60 gene (Chro.601380: variant IaA25R3), are both potential vaccine candidates and have been previously shown to be associated with a delay in reinfection in our study population (8, 10, 34). We investigated whether we could also detect an association with protection from reinfection between IgA antibodies recognizing C. hominis Cp23 (Chro.40414) and the C. hominis gp60 (Chro.601380) antigens on the Cryptosporidium array. As the IgA anti-Cp23 (Chro.40414) signal was low in our array data we were only able to analyze the anti-IgG Cp23 (Chro.40414) data. As expected, a protective association was observed between both anti-IgA and IgG C. hominis Gp60 (Chro.601380) (Figure 5, A–D) and anti-IgG C. hominis Cp23 (Chro.40414) (Figure 5, E and F). Since Gp60 and Cp23 were a priori antigen candidates, P values were not adjusted for the FDR.
Impact of the polymorphisms in the gp60 gene on immune reactivity.
The protein encoded by the gp60 gene is processed by the parasite into Gp40 and Gp15 proteins (Figure 6A). The region of the gp60 gene that encodes the Gp40 protein has 3 variable domains: a SNP-based allelic family “type”; a variable number of trinucleotide repeats “subtypes”; and a repeat sequence “R” (40). In the Bangladeshi infant cohort, 15 different variants of gp60 were identified (2 in C. parvum and 13 in C. hominis) (Figure 6A), all of which were included in the protein array (35). The gp60 genotype of the infecting Cryptosporidium parasite was known in a subset of cases, and the data from the plasma collected from these children was examined to see if an allele-specific immune signal could be observed. With 1 exception, the infecting C. hominis genotype matched the Gp40 antigen variant recognized by the child’s plasma (Figure 6, B and C, and Supplemental Figure 7). The number of trinucleotide repeats in the gp60 gene, however, did not impact antibody recognition: children infected with the IaA18R3 subtype bound equivalently to the Ia antigens on the array that had different numbers of trinucleotide repeats, including IaA27R3, IaA26R3, IaA25R3, IaA22R3, IaA19R3, and IaA18R3 (Figure 6, A and B). We concluded that humoral immunity to the variable Gp40 antigen was genotype-specific.
Antigens associated with protection from reinfection.
We tested if a delay in the time to reinfection was associated with the development of anti-Cryptosporidium antibodies against specific antigens. This analysis was done for the children on follow up to ages 2 and 3 years who had qPCR-verified cryptosporidiosis during their first year of life (Table 1 and Supplemental Figure 8). The analysis was also performed including all the children in the cohort (Supplemental Table 2 and Supplemental Figure 9). To minimize false discoveries as well as false exclusions, a feature selection antigen filtering step was employed using random forest (RF) models on survival data. For the RF models, the children were stratified into seropositive versus seronegative for each of the 233 IgA- and/or IgG-reactive antigens, and variables that were important to the models over 100 iterations were identified (Figure 7, A and B).
Table 1. Antibody responses associated with protection resulting from a Cryptosporidium infection.
Among antigens with an average variable importance metric (VIMP) greater than 1 SD above the mean of all antigen VIMP scores and with positive VIMP scores (i.e., important to the model) in at least 80% of iterations, 7 antigens in addition to Gp60 and Cp23 had hazard ratios less than 1 (protective) in all 4 modeling groups (Figure 7C). Additional RF comparisons are shown in Supplemental Figure 8 and are included in Table 1 along with the adjustment for the number of antigens tested. Additional antigens associated with protection in survival analyses, but not by random forest, are shown in Supplemental Figure 12 and Supplemental Table 3). These were selected for evaluation in Cox proportional hazards models (Figure 7B) with adjustment for the FDR. In addition to the Gp60 and Cp23 antigens, a significant association with protection from cryptosporidiosis was observed for antibodies against the Gp900 mucin (cgd7_4020), the potential mucin CpMuc8 (cgd8_700), the putative metal ion transporter CpCorA (cgd2_1520), a small membrane protein (Chro.30111) (Figure 7D), the Gp900 mucin (cgd7_4020) (Figure 7E), the putative metal ion transporter CpCorA (cgd2_1520)(Figure 7F), the potential mucin CpMuc8 (cgd8_700)(Figure 7G), and the coiled coil domain protein CpCCDC (cgd8_830) (additional RF comparisons are shown in Supplemental Figure 8). Parenthetically, cgd8_830 seropositivity was associated with significantly lower incidence of infection, particularly during the first year of followup postsampling, but was found to be more abundant in children that ultimately were infected at the end of followup. Likewise, Chro.30111 antibody responses showed evidence of protection during followup and at the end of the first year of followup postsampling, but not at the end of 2 years of followup.
A PLS-DA regression model was then used to evaluate the relative contribution of the selected antigens in defining the latent components (“loading weights”) that maximize discrimination of children by infection status (Figure 8A). The endpoint metric was complete protection from reinfection associated with antibody levels. The analysis was performed at ages 2 (Figure 8B) and 3 (Figure 8C). The contribution of each antibody to the PLS-DA profile at ages 2 (Figure 8D) and 3 (Figure 8E) is also shown.
Discussion
The most important discovery from this work is the identification of 7 cryptosporidial antigens to which a humoral immune response is associated with protection from reinfection. These included previously identified vaccine candidates Cp23 and Cp17 proteins; (7, 8, 34, 41) the Gp900 mucin (16, 25, 30); as well as CpMuc8, a potential mucin; CpSMP1, a small membrane protein; CpCCDC, a coiled-coil protein; and CpCorA,a potential metal transporter.
The developmental stages of Cryptosporidium (36) include extracellular and intracellular forms that differ in protein repertoire (37, 38, 42). We considered it a possibility that only antigens from proteins expressed at specific stages in the parasite’s lifecycle were protective. Antibodies that target the early extracellular life stages in apicomplexans may be more effective at preventing infection (31, 43). However, in our case, the protective antigens were present in more than one life stage, as assessed by mRNA transcripts (36). A drawback of using transcriptomics data is that posttranscriptional regulation may influence protein expression. We, therefore, examined the available proteomic data and found peptides from 4 of the 7 candidates in the sporozoites/oocyst proteome (37, 38). In summary, the protective antigens are not all highly expressed in sporozoites. The available information suggests that protective antigens may not be restricted to the cryptosporidial sporozoite.
While plasma IgG anti-Cp23 and Cp17 had not been previously observed to be protective in our cohort (8, 10), reanalysis of the IgG data in our study suggests that our use of the mixed models to determine the boundary of the positive response in the protein array data improved the specificity of the immunoassay results and accounted for the apparent difference in the study conclusions (Supplemental Figure 4) (7, 44).
The association observed between antibody levels and time since detection of Cryptosporidium infection suggests that anti-Cryptosporidium antibodies may be short-lived in this young age group. It is possible that multiple repeat infections are needed to generate a more durable antibody response (45, 46). In addition, a substantial proportion of the children with prior infection had largely undetectable antibody levels, similar to the larger population of immunologically naive children. Failure to generate robust humoral immunity in infants has also been observed with infection with the apicomplexan parasite Plasmodium, with immunity to symptomatic disease developing only after repeated exposures to the pathogen (47, 48). Also in Plasmodium, a short-lived nonsterile immunity is common in infants, and in this case may involve defects in antibody affinity maturation in the host germinal centers (47, 49, 50). Whether this may also play a role in depressing the antibody response to the Cryptosporidium parasite, and if this can be remedied by an appropriate vaccination strategy remains to be discovered.
The immune mechanisms involved in the control of the Cryptosporidium parasite likely involve both the innate and adaptive arms of the immune system (1). The adaptive immune response consists of both cellular and humoral immunity. Preexisting anti-Cryptosporidium IgG was shown to be associated with immunity in this work and earlier in experimentally infected adults (27, 34, 51). The importance of cellular immunity and, in particular, IFN-γ is also evident (52–54). It remains to be determined the contribution of these 7 antigens to cellular immune responses.
In addition to the antibodies associated with protection, we identified some anti-Cryptosporidium antigen-specific antibody responses that were associated with an increased risk of reinfection (Figure 7B and Supplemental Figure 9). These antibodies occurred in a distinct subset of children, and their appearance was not correlated with that of the antibodies associated with the protective immune response (Supplemental Figure 10). This observation is in line with our earlier finding that not all antigen-antibody responses are associated with protection (Figure 4). We investigated but found no association between the appearance of the antibodies targeting these nonprotective antigens and biomarkers of inflammation or of IL-4, which is involved in modulating the humoral immune response (Supplemental Figure 11). Further studies are needed to identify the mechanism that promote a protective immune response.
A limitation of this study to identify antibody responses associated with protective immunity was that not every infection was detected, despite active surveillance that included twice-weekly home visits. This coupled with the heterogeneity observed in the antibody profile among children with prior exposure, i.e., lack of antibody responses in a subset of children, likely reduced the statistical power of our analysis. Another limitation was the inability to probe the protein microarray with fecal IgA due to high background. A final limitation was that the microarray did not contain the entire proteome of the C. parvum, C. hominis, and C. meleagridis parasites. To offset this limitation, we prioritized the inclusion of the potential vaccine candidates mentioned in earlier literature (n = 22), as well as conserved transmembrane and secreted proteins (Supplemental Figure 3 and Supplemental Table 1) (13–33). Of the C. parvum genes with no introns, 336 of 761 ORF annotated as containing a transmembrane domain were included in the protein microarray. The remaining 425 ORFs were eliminated as being either absent in the other Cryptosporidium species of C. meleagridis and C. hominis, or were represented by other orthologues on the array, or because they were part of the endomembrane system, components of the mitochondria, ribosome, or nucleus. We avoided potential metabolic proteins, annotated as DNA and RNA binding, involved in one of the biosynthetic pathways of the parasite, or involved in the ubiquitin pathway. We also eliminated genes with a nonsynonymous/synonymous substitution rate over 1 and that had at least 10 nonsynonymous SNPs. Sixteen of the C. parvum ORF candidates failed at either the cloning step or during IVTT quality control. Seventy-one of the remaining ORFs that otherwise met our criteria as conserved membrane proteins could not be included on the array due to space limitations.
Strengths of this study included the intensive surveillance undertaken for cryptosporidiosis from birth to 3 years of life and the use of a proteome array that enabled the identification of previously unknown protective antigens (55). In addition to the antigens discussed, these included some antigens that, although interesting, were not statistically significant (Supplemental Figure 11). This comprehensive identification of Cryptosporidium antigens to which an antibody response is associated with protection represents an important step forward in vaccine design. At the same time, the fact that many children do not develop a detectable antibody response to infection, and that the antibody responses, when generated, are short lived and parasite-genotype specific may offer insight into why recurrent infections are common.
Methods
ORF selection for the Cryptosporidium protein microarray.
Although many Cryptosporidium species can infect humans, the most common human pathogens are the zoonotic C. parvum and C. meleagridis and the anthroponotic C. hominis (6). The selected C. parvum proteins included those that had been previously identified as potential vaccine candidates (Supplemental Table 1) (6, 14–34). The genome sequences of C. parvumand C. hominis are very conserved (95%–97%) and C. meleagridis is not very divergent (8.5%; C. parvum versus C. meleagridis) (55, 56) The array included 522 conserved antigens derived from proteins (n = 376) that contained signal peptides (C. parvum: 382 antigens; C. hominis: 155 antigens [134 derived from the C. hominis orthologues of “high value” C. parvum proteins already on the array]); and C. meleagridis: 6 antigens [also represented by other orthologues on the array] (CryptoDB Database: Release 59 (57, 58)). Due to discovery of export motifs such as PEXEL in other apicomplexan parasites, we did not restrict our antigen selections to only those with a signal peptide (59, 60). Additional antigens from proteins (n = 327) without a signal peptide, but which nevertheless had a transmembrane domain, were included on the array (total antigens: 457; C. parvum antigens: 365; C. hominis antigens: 90 [66 were derived from the C. hominis orthologues of C. parvum proteins already on the array]; C. meleagridis antigens: 2 [both also represented by other orthologues on the array]).
Cryptosporidium protein microarray fabrication.
The protein microarray used in this study was produced by Antigen Discovery Inc. (ADI) (39, 61, 62). Briefly, the open reading frames selected as described above were subcloned into a T7 expression vector pXI and expressed using an in vitro the Escherichia coli transcription and cell free translation (IVTT) system (Rapid Translation System, Biotechrabbit). After expression the proteins were printed onto nitrocellulose-coated AVID slides (Grace Bio-Labs Inc.) using an Omni Grid Accent robotic microarray printer (Digilabs Inc.). As a positive control, the purified recombinant Cryptosporidium Cp17 and Cp23 peptides were also spotted onto the array (34, 63).
Child cohort.
A total of 500 children were enrolled within 1 week of birth from the Mirpur community of Dhaka, Bangladesh from June 2014 through March 2016 (ClinicalTrials.gov, NCT02764918) (11). Infants were monitored for cryptosporidiosis through testing of diarrheal and monthly surveillance stool samples during biweekly home visits by trained field investigators. Height and weight were measured quarterly to assess child growth (11). Children who had a HAZ score under –1 were defined as ‘at risk for stunting’ and HAZ under –2 were defined as stunted (64).
Sampling and specimen testing.
Fecal DNA was extracted from the diarrheal and monthly surveillance stools and a previously described multiplex qPCR assay that utilizes pan-Cryptosporidium primers and probes targeting the 18S rDNA gene was used to identify infected infants (11). In select isolates, the parasite was genotyped using standard protocols (35). Assays to measure select biomarkers of gut and systemic inflammation (CRP, sCD14, IL-1Beta, and IL-4) were performed as previously described (11). A blood sample was drawn at 18 weeks, 1 year, and then every 6 months (dbGAP Accession phs001665.v1.p1). The plasma samples from children collected at 1 year of age were diluted 1:100 and used to probe the Cryptosporidium proteome microarray using standard protocols (61). Samples were incubated on the arrays overnight at 4°C on a rocker, then washed and incubated with polyclonal goat anti-human IgG-Fc fragment DyLight650 (Bethyl Laboratories, A80-104D5) or Cy3 AffiniPure F(ab′)2 fragment of the polyclonal goat anti-human serum IgA, α chain specific (Jackson ImmunoResearch Laboratories, 109-166-011) for 1 hour at room temperature on a rocker, then washed, dried and stored in the dark until scanning. The exposed arrays were scanned, and the spot and background signal intensities (SI) were exported into R for statistical analysis (65). Spot SIs were adjusted for local background by subtraction, and values were floored to 1. Next, the data were normalized by dividing the Cryptosporidium protein spot values by the median of IVTT control spots (IVTT expression reactions with no Cryptosporidium ORFs), and values were log transformed using the base-2 logarithm. Thus, normalized data represented the log2 signal-to-noise ratio, where a value of 0 represents specific antibody SI equal to the background, 1.0 represented twice the background, 2.0 represented 4-fold over background, etcetera. For the purified Cp23 protein and Cp17 peptide printed on the microarrays, the data were unaffected by the IVTT background, and thus the normalization procedure was to floor the data to 1 and then transform values using the base-2 logarithm, resulting in normalized data that represent a doubling in fluorescence SI per unit increase. Thus, the scales of purified proteins and IVTT proteins differed due to the former being log-scale SI levels and the latter being log-scale signal-to-noise ratios. The results from the protein microarray are included in the Supplemental Data Set 1.
Statistics.
Cryptosporidium protein responses were classified as seropositive or negative by taking the distribution of each spot individually between all samples to model negative and positive subpopulations using mixture models executed with the “normalmixEM” function in the mixtools package (66), and a seropositivity cutoff was established for each antigen as the mean and 3 SDs of the negative SI distribution. When mixture models failed to converge, a simple seropositivity cutoff of 1.0, or 2-fold over background, was applied. IgG and IgA “reactivity” for each antigen was defined as a proportion of seropositive responses, or seroprevalence, of at least 10% among the study children. Overlap in IgG and IgA responses that recognized individual antigens was assessed using the VennDiagram package in R (67). Antibody breadth scores were calculated as the sum of seropositive responses per individual. Normalized SI and antibody breadth scores were visualized using the ComplexHeatmap package (68). Associations between normalized SI and protein features such as life cycle stage and signal peptides were analyzed using multivariable negative binomial regression for seropositivity classifications and ordinary least squares regression for normalized SI. Univariate groupwise analysis was performed using t tests. Correlations were assessed using Pearson’s correlation coefficient. Unsupervised data reduction and trends was analyzed using tSNE, using a perplexity parameter of 40, 1,000 iterations, and a theta of 0.0 after testing varying parameters for shape of the data (69, 70). To test differences in profile-wide normalized SI and to control for multiple measurements per subject, linear mixed effects regression (LMER) was performed using the lme4 package (71), allowing for random intercepts at the subject and antigen level. P values for LMER models were obtained by ANOVA between full models and null variable models. Supervised data reduction and multi-antigen analysis was performed using PLS-DA using the mixOmics package (72). PLS-DA results were visualized using plots of PLS-DA scores of first and second latent variables for trends discriminating groups and by plotting the loading weights (i.e. PLS-DA regression coefficients) to highlight the importance of the variables used to define the latent components that maximize the covariance between antibody data and Cryptosporidium infection endpoints (infection prior to sampling and infection 1 and 2 years after sampling). Analysis of antibody breadth was performed using negative binomial regression.
Analysis of seropositivity to an antigen and association with risk of infection or reinfection — only among children with infections prior to 1 year of age — during the 1-year and 2-year follow-up periods following sample collection was performed using Cox proportional hazards models adjusted by the number of episodes a child had; HAZ score at birth; mother’s age, BMI, and education level; household income and expenses; principal source of household drinking water; the water treatment method routinely used by the household; and proximity to one of the Dhaka water drainage channels. The 2 a priori vaccine candidate antigens Gp60 — containing the Cp17 peptide — and Cp23 were analyzed without correction for the FDR (73).
To control for false discovery due to the multiple comparisons made, antibody responses were modeled using random forest (“RF”) with survival data using the “randomForestSRC” and “ggRandomForests” packages to perform feature selection (74). All reactive antigens were included in each of 4 RF models: 1 year follow-up postsampling among (a) all children or (b) only children with previous infections, and (c) 2 year follow-up among (c) all children or (d) only children with previous infections. Each model performed 1,000 decision trees while allowing deterministic splitting (nsplit = 0) and computation of variable importance (VIMP) using permutation. Each model was repeated 100 times, and VIMP scores were computed for each repeat and then averaged for each antigen target. VIMP scores that were greater than 0 in at least 80% of repeats (80/100 RF models) were considered “potentially important variables” for the RF models. Further, a VIMP score cutoff was calculated as 1 SD above the mean of all VIMP scores returned from the 100 RF model iterations. The survival analysis identified which antibodies were associated with a HR below 1 (protective response) versus HRs greater than 1 (increased susceptibility). The criteria determined for selection of a minimal number of important variables were: (a) positive VIMP scores in at least 80% of repeats and average VIMP scores above the cutoff, and (b) seropositivity HRs below 1 in all models. The selected features were used in Cox models, reporting both raw P values and P values adjusted for the FDR. Analysis of Gp40/15 (aka Gp60) sequence variation and antibody associations was performed using the Prism 9 computer program (GraphPad).
Study approval.
The study was approved by the Ethical and Research Review Committees of the International Centre for Diarrhoeal Disease Research, Bangladesh (PR-13092) and the IRB of the University of Virginia (IRB# 20388). The ClinicalTrials.gov identifier is NCT02764918. Informed written consent was obtained from the parents or guardians for the participation of their child in the study.
Data availability.
Select clinical metadata for this study is available on the NCBI’s dbGaP under accession number phs001665.v2.p1. The data for this study were collected as a substudy of dbGaP phs001475.v2.p1.
Author contributions
Drafting of the manuscript was performed by CAG and JJC. The method used to assign initial authorship order was by mutual agreement. All authors edited and approved the final manuscript. CAG, WAP, and RH conceived of the analysis plan and JJC performed the bioinformatic analyses. JZM assisted in the statistical analysis. CAG designed and JJC, JVP, AT AO, and ADS built the array and analyzed samples. WAP, RH, and AF founded the birth cohort and directed the study. Field work and data collection at the International Centre for Diarrhoeal Disease Research, Bangladesh (icddr,b) were performed by MA and MK, with supervision from AF and RH.
Supplementary Material
Acknowledgments
This work was supported by the National Institute of Allergy and Infectious Diseases (NIAID) grants awarded to CAG and WAP (R01 AI-043596); CAG (R21 AI-109118); JJC (R43AI145607); and WAP (R21-AI154862); as well as the Bill and Melinda Gates Foundation Grant (OPP1100514) to AF. The funders had no role in study design, data collection and analysis, or decision to submit for publication. We also wish to thank our colleagues B. Mann and C. Marie Braun for careful reading of this manuscript and thoughtful feedback. We also wish to thank the field workers, nurses, and laboratory staff of the Parasitology Laboratory of icddr,b who worked for this project, and parents and children at the icddr,b study sites who participated in this study and without whom we could not have completed this research. Work at icddr,b is supported by the core donors (Government of the People’s Republic of Bangladesh, GAC, Sida, and UKAid).
Version 1. 06/22/2023
In-Press Preview
Version 2. 08/15/2023
Electronic publication
Footnotes
Conflict of interest: WAP is a consultant for TechLab Inc., a maker of diagnostic tests for cryptosporidiosis.
Copyright: © 2023, Gilchrist et al. This is an open access article published under the terms of the Creative Commons Attribution 4.0 International License.
Reference information: J Clin Invest. 2023;133(16):e166814. https://doi.org/10.1172/JCI166814.
See the related Commentary at Mining for crypto protection: A search for Cryptosporidium antibodies reveals antigens associated with immunity.
Contributor Information
Carol A. Gilchrist, Email: cg2p@virginia.edu.
Joseph J. Campo, Email: jcampo@antigendiscovery.com.
Jozelyn V. Pablo, Email: jpablo@antigendiscovery.com.
Jennie Z. Ma, Email: jzm4h@virginia.edu.
Andy Teng, Email: ateng@antigendiscovery.com.
Amit Oberai, Email: aoberai@antigendiscovery.com.
Adam D. Shandling, Email: ashandling@antigendiscovery.com.
Masud Alam, Email: masud@icddrb.org.
Mamun Kabir, Email: mamunk@icddrb.org.
Rashidul Haque, Email: rhaque@icddrb.org.
William A. Petri, Jr., Email: wap3g@virginia.edu.
References
- 1.Cohn IS, et al. Immunity to Cryptosporidium: lessons from acquired and primary immunodeficiencies. J Immunol. 2022;209(12):2261–2268. doi: 10.4049/jimmunol.2200512. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Kotloff KL, et al. Burden and aetiology of diarrhoeal disease in infants and young children in developing countries (the Global Enteric Multicenter Study, GEMS): a prospective, case-control study. Lancet. 2013;382(9888):209–222. doi: 10.1016/S0140-6736(13)60844-2. [DOI] [PubMed] [Google Scholar]
- 3.Sow SO, et al. The burden of Cryptosporidium diarrheal disease among children < 24 months of age in moderate/high mortality regions of Sub-Saharan Africa and South Asia, utilizing data from the Global Enteric Multicenter Study (GEMS) PLoS Negl Trop Dis. 2016;10(5):e0004729. doi: 10.1371/journal.pntd.0004729. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Haque R, et al. Prospective case-control study of the association between common enteric protozoal parasites and diarrhea in Bangladesh. Clin Infect Dis. 2009;48(9):1191–1197. doi: 10.1086/597580. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Korpe PS, et al. Breast milk parasite-specific antibodies and protection from amebiasis and cryptosporidiosis in Bangladeshi infants: a prospective cohort study. Clin Infect Dis. 2013;56(7):988–992. doi: 10.1093/cid/cis1044. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Matsubayashi M, et al. Elongation factor-1α is a novel protein associated with host cell invasion and a potential protective antigen of Cryptosporidium parvum. J Biol Chem. 2013;288(47):34111–34120. doi: 10.1074/jbc.M113.515544. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Ajjampur SSR, et al. Serum IgG response to Cryptosporidium immunodominant antigen gp15 and polymorphic antigen gp40 in children with cryptosporidiosis in South India. Clin Vaccine Immunol. 2011;18(4):633–639. doi: 10.1128/CVI.00464-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Steiner KL, et al. Delayed time to Cryptosporidiosis in Bangladeshi children is associated with greater fecal IgA against two sporozoite-expressed antigens. Am J Trop Med Hyg. 2021;104(1):229–232. doi: 10.4269/ajtmh.20-0657. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Kabir M, et al. Nonsterile immunity to cryptosporidiosis in infants is associated with mucosal IgA against the sporozoite and protection from malnutrition. PLoS Pathog. 2021;17(6):e1009445. doi: 10.1371/journal.ppat.1009445. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Steiner KL, et al. Fecal immunoglobulin A against a sporozoite antigen at 12 months is associated with delayed time to subsequent Cryptosporidiosis in urban Bangladesh: a prospective cohort study. Clin Infect Dis. 2020;70(2):323–326. doi: 10.1093/cid/ciz430. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Steiner KL, et al. Species of Cryptosporidia causing subclinical infection associated with growth faltering in rural and urban Bangladesh: a birth cohort study. Clin Infect Dis. 2018;67(9):1347–1355. doi: 10.1093/cid/ciy310. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Abrahamsen MS, et al. Complete genome sequence of the apicomplexan, Cryptosporidium parvum. Science. 2004;304(5669):441–445. doi: 10.1126/science.1094786. [DOI] [PubMed] [Google Scholar]
- 13.Baptista RP, et al. Long-read assembly and comparative evidence-based reanalysis of Cryptosporidium genome sequences reveal expanded transporter repertoire and duplication of entire chromosome ends including subtelomeric regions. Genome Res. 2022;32(1):203–213. doi: 10.1101/gr.275325.121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Putignani L, et al. The thrombospondin-related protein CpMIC1 (CpTSP8) belongs to the repertoire of micronemal proteins of Cryptosporidium parvum. Mol Biochem Parasitol. 2008;157(1):98–101. doi: 10.1016/j.molbiopara.2007.09.004. [DOI] [PubMed] [Google Scholar]
- 15.Wanyiri JW, et al. Role of CpSUB1, a subtilisin-like protease, in Cryptosporidium parvum infection in vitro. Eukaryot Cell. 2009;8(4):470–477. doi: 10.1128/EC.00306-08. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Li X, et al. The mucin-like, secretory type-I transmembrane glycoprotein GP900 in the apicomplexan Cryptosporidium parvum is cleaved in the secretory pathway and likely plays a lubrication role. Parasit Vectors. 2022;15(1):170. doi: 10.1186/s13071-022-05286-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Spano F, et al. Molecular cloning and expression analysis of a Cryptosporidium parvum gene encoding a new member of the thrombospondin family. Mol Biochem Parasitol. 1998;92(1):147–162. doi: 10.1016/S0166-6851(97)00243-0. [DOI] [PubMed] [Google Scholar]
- 18.Tosini F, et al. A new modular protein of Cryptosporidium parvum, with ricin B and LCCL domains, expressed in the sporozoite invasive stage. Mol Biochem Parasitol. 2004;134(1):137–147. doi: 10.1016/j.molbiopara.2003.11.014. [DOI] [PubMed] [Google Scholar]
- 19.O’Hara SP, et al. A novel Cryptosporidium parvum antigen, CP2, preferentially associates with membranous structures. Parasitol Res. 2004;92(4):317–327. doi: 10.1007/s00436-003-1057-5. [DOI] [PubMed] [Google Scholar]
- 20.Yu Q, et al. Induction of immune responses in mice by a DNA vaccine encoding Cryptosporidium parvum Cp12 and Cp21 and its effect against homologous oocyst challenge. Vet Parasitol. 2010;172(1–2):1–7. doi: 10.1016/j.vetpar.2010.04.036. [DOI] [PubMed] [Google Scholar]
- 21.Nesterenko MV, et al. Receptor/ligand interactions between Cryptosporidium parvum and the surface of the host cell. Biochim Biophys Acta. 1999;1454(2):165–173. doi: 10.1016/S0925-4439(99)00034-4. [DOI] [PubMed] [Google Scholar]
- 22.Manque PA, et al. Identification and immunological characterization of three potential vaccinogens against Cryptosporidium species. Clin Vaccine Immunol. 2011;18(11):1796–1802. doi: 10.1128/CVI.05197-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Panda C, Mahapatra RK. Identification of novel therapeutic candidates in Cryptosporidium parvum: an in silico approach. Parasitology. 2018;145(14):1907–1916. doi: 10.1017/S0031182018000677. [DOI] [PubMed] [Google Scholar]
- 24.O’Connor RM, et al. Polymorphic mucin antigens CpMuc4 and CpMuc5 are integral to Cryptosporidium parvum infection in vitro. Eukaryot Cell. 2009;8(4):461–469. doi: 10.1128/EC.00305-08. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Chatterjee A, et al. Evidence for mucin-like glycoproteins that tether sporozoites of Cryptosporidium parvum to the inner surface of the oocyst wall. Eukaryot Cell. 2010;9(1):84–96. doi: 10.1128/EC.00288-09. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Allison GM, et al. Antibody responses to the immunodominant Cryptosporidium gp15 antigen and gp15 polymorphisms in a case-control study of cryptosporidiosis in children in Bangladesh. Am J Trop Med Hyg. 2011;85(1):97–104. doi: 10.4269/ajtmh.2011.11-0043. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Preidis GA, et al. Seropositive human subjects produce interferon gamma after stimulation with recombinant Cryptosporidium hominis gp15. Am J Trop Med Hyg. 2007;77(3):583–585. doi: 10.4269/ajtmh.2007.77.583. [DOI] [PubMed] [Google Scholar]
- 28.Petersen C, et al. Cryptosporidium parvum GP900, a unique invasion protein. J Eukaryot Microbiol. 1997;44(6):89S–90S. doi: 10.1111/j.1550-7408.1997.tb05802.x. [DOI] [PubMed] [Google Scholar]
- 29.Askari N, et al. Evaluation of recombinant P23 protein as a vaccine for passive immunization of newborn calves against Cryptosporidium parvum. Parasite Immunol. 2016;38(5):282–289. doi: 10.1111/pim.12317. [DOI] [PubMed] [Google Scholar]
- 30.Haserick JR, et al. Cryptosporidium parvum vaccine candidates are incompletely modified with O-linked-N-acetylgalactosamine or contain N-terminal N-myristate and S-palmitate. PLoS One. 2017;12(8):e0182395. doi: 10.1371/journal.pone.0182395. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Bouzid M, et al. Cryptosporidium pathogenicity and virulence. Clin Microbiol Rev. 2013;26(1):115–134. doi: 10.1128/CMR.00076-12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Priest JW, et al. Cloning and characterization of the acidic ribosomal protein P2 of Cryptosporidium parvum, a new 17-kilodalton antigen. Clin Vaccine Immunol. 2010;17(6):954–965. doi: 10.1128/CVI.00073-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Benitez A, et al. Evaluation of DNA encoding acidic ribosomal protein P2 of Cryptosporidium parvum as a potential vaccine candidate for cryptosporidiosis. Vaccine. 2011;29(49):9239–9245. doi: 10.1016/j.vaccine.2011.09.094. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Moss DM, et al. The antibody response to 27-, 17-, and 15-kDa Cryptosporidium antigens following experimental infection in humans. J Infect Dis. 1998;178(3):827–833. doi: 10.1086/515377. [DOI] [PubMed] [Google Scholar]
- 35.Gilchrist CA, et al. Genetic diversity of Cryptosporidium hominis in a Bangladeshi community as revealed by whole-genome sequencing. J Infect Dis. 2018;218(2):259–264. doi: 10.1093/infdis/jiy121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Tandel J, et al. Life cycle progression and sexual development of the apicomplexan parasite Cryptosporidium parvum. Nat Microbiol. 2019;4(12):2226–2236. doi: 10.1038/s41564-019-0539-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Snelling WJ, et al. Proteomics analysis and protein expression during sporozoite excystation of Cryptosporidium parvum (Coccidia, Apicomplexa) Mol Cell Proteomics. 2007;6(2):346–355. doi: 10.1074/mcp.M600372-MCP200. [DOI] [PubMed] [Google Scholar]
- 38.Truong Q, Ferrari BC. Quantitative and qualitative comparisons of Cryptosporidium faecal purification procedures for the isolation of oocysts suitable for proteomic analysis. Int J Parasitol. 2006;36(7):811–819. doi: 10.1016/j.ijpara.2006.02.023. [DOI] [PubMed] [Google Scholar]
- 39.Obiero JM, et al. Antibody biomarkers associated with sterile protection induced by controlled human malaria infection under chloroquine prophylaxis. mSphere. 2019;4(1):e00027-19. doi: 10.1128/mSphereDirect.00027-19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Chalmers RM, et al. Analysis of the Cryptosporidium spp. and gp60 subtypes linked to human outbreaks of cryptosporidiosis in England and Wales, 2009 to 2017. Parasit Vectors. 2019;12(1):95. doi: 10.1186/s13071-019-3354-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Cevallos AM, et al. Mediation of Cryptosporidium parvum infection in vitro by mucin-like glycoproteins defined by a neutralizing monoclonal antibody. Infect Immun. 2000;68(9):5167–5175. doi: 10.1128/IAI.68.9.5167-5175.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Sanderson SJ, et al. Determining the protein repertoire of Cryptosporidium parvum sporozoites. Proteomics. 2008;8(7):1398–1414. doi: 10.1002/pmic.200700804. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Boulter-Bitzer JI, et al. Molecular targets for detection and immunotherapy in Cryptosporidium parvum. Biotechnol Adv. 2007;25(1):13–44. doi: 10.1016/j.biotechadv.2006.08.003. [DOI] [PubMed] [Google Scholar]
- 44.Urrea-Quezada A, et al. Serum IgG responses to gp15 and gp40 protein-derived synthetic peptides from Cryptosporidium parvum. Front Cell Infect Microbiol. 2022;11:810887. doi: 10.3389/fcimb.2021.810887. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.De Angelis ML, et al. Repeated exposure to subinfectious doses of SARS-CoV-2 may promote T cell immunity and protection against severe COVID-19. Viruses. 2021;13(6):961. doi: 10.3390/v13060961. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Fallet B, et al. Chronic viral infection promotes efficient germinal center B cell responses. Cell Rep. 2020;30(4):1013–1026. doi: 10.1016/j.celrep.2019.12.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Visweswaran GRR, et al. Germinal center activity and B cell maturation are associated with protective antibody responses against Plasmodium pre-erythrocytic infection. PLoS Pathog. 2022;18(7):e1010671. doi: 10.1371/journal.ppat.1010671. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Theander TG. Defence mechanisms and immune evasion in the interplay between the humane immune system and Plasmodium falciparum. Dan Med Bull. 1992;39(1):49–63. [PubMed] [Google Scholar]
- 49.O’Neal KA, et al. ICOS expression is required for maintenance but not the formation of germinal centers in the spleen in response to Plasmodium yoelii infection. Infect Immun. 2022;90(3):e0046821. doi: 10.1128/iai.00468-21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Lee MSJ, et al. B cell–intrinsic TBK1 is essential for germinal center formation during infection and vaccination in mice. J Exp Med. 2022;219(2):e202113363. doi: 10.1084/jem.20211336. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Chappell CL, et al. Infectivity of Cryptosporidium parvum in healthy adults with pre-existing anti-C. parvum serum immunoglobulin G. Am J Trop Med Hyg. 1999;60(1):157–164. doi: 10.4269/ajtmh.1999.60.157. [DOI] [PubMed] [Google Scholar]
- 52.Ungar BL, et al. Cryptosporidium infection in an adult mouse model. Independent roles for IFN-gamma and CD4+ T lymphocytes in protective immunity. J Immunol. 1991;147(3):1014–1022. doi: 10.4049/jimmunol.147.3.1014. [DOI] [PubMed] [Google Scholar]
- 53.Gullicksrud JA, et al. Enterocyte-innate lymphoid cell crosstalk drives early IFN-γ-mediated control of Cryptosporidium. Mucosal Immunol. 2022;15(2):362–372. doi: 10.1038/s41385-021-00468-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Choudhry N, et al. A protective role for interleukin 18 in interferon γ-mediated innate immunity to Cryptosporidium parvum that is independent of natural killer cells. J Infect Dis. 2012;206(1):117–124. doi: 10.1093/infdis/jis300. [DOI] [PubMed] [Google Scholar]
- 55.Mazurie AJ, et al. Comparative genomics of cryptosporidium. Int J Genomics. 2013;2013:832756. doi: 10.1155/2013/832756. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Arias-Agudelo LM, et al. Comparative genomic analysis of the principal Cryptosporidium species that infect humans. PeerJ. 2020;8:e10478. doi: 10.7717/peerj.10478. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Amos B, et al. VEuPathDB: the eukaryotic pathogen, vector and host bioinformatics resource center. Nucleic Acids Res. 2022;50(d1):D898–D911. doi: 10.1093/nar/gkab929. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Warrenfeltz S, Kissinger JC. Accessing Cryptosporidium omic and isolate data via CryptoDB.org. Methods Mol Biol. 2020;2052:139–192. doi: 10.1007/978-1-4939-9748-0_10. [DOI] [PubMed] [Google Scholar]
- 59.Heiber A, et al. Identification of new PNEPs indicates a substantial non-PEXEL exportome and underpins common features in Plasmodium falciparum protein export. PLoS Pathog. 2013;9(8):e1003546. doi: 10.1371/journal.ppat.1003546. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Pool MR, Russo I. The perplexing PEXEL protein secretory pathway. Nat Microbiol. 2018;3(9):969–970. doi: 10.1038/s41564-018-0235-2. [DOI] [PubMed] [Google Scholar]
- 61.Kessler A, et al. Convalescent Plasmodium falciparum-specific seroreactivity does not correlate with paediatric malaria severity or Plasmodium antigen exposure. Malar J. 2018;17(1):178. doi: 10.1186/s12936-018-2323-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Davies DH, et al. Profiling the humoral immune response to infection by using proteome microarrays: high-throughput vaccine and diagnostic antigen discovery. Proc Natl Acad Sci U S A. 2005;102(3):547–552. doi: 10.1073/pnas.0408782102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Smith LM, et al. Human T and B cell immunoreactivity to a recombinant 23-kDa Cryptosporidium parvum antigen. J Parasitol. 2001;87(3):704–707. doi: 10.1645/0022-3395(2001)087[0704:HTABCI]2.0.CO;2. [DOI] [PubMed] [Google Scholar]
- 64.de Onis M, Branca F. Childhood stunting: a global perspective. Matern Child Nutr. 2016;12:12–26. doi: 10.1111/mcn.12231. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65. RStudio Team. RStudio: Integrated Development for R. http://www.rstudio.com/ Accessed June 27, 2023.
- 66.Benaglia T, et al. mixtools: an R package for analyzing finite mixture models. J Stat Softw. 2009;32(6):1–29. doi: 10.18637/jss.v032.i06. [DOI] [Google Scholar]
- 67.Chen H, Boutros PC. VennDiagram: a package for the generation of highly-customizable Venn and Euler diagrams in R. BMC Bioinformatics. 2011;12(1):35. doi: 10.1186/1471-2105-12-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Gu Z, et al. Complex heatmaps reveal patterns and correlations in multidimensional genomic data. Bioinformatics. 2016;32(18):2847–2849. doi: 10.1093/bioinformatics/btw313. [DOI] [PubMed] [Google Scholar]
- 69.Van Der Maaten L, Hinton G. Visualizing data using t-SNE. J Mach Learn Res. 2008;9(86):2579–2605. [Google Scholar]
- 70.Van Der Maaten L, et al. Accelerating t-SNE using tree-based algorithms. J Mach Learn Res. 2014;15(1):3221–3245. [Google Scholar]
- 71.Bates D, et al. Fitting linear mixed-effects models using lme4. J Stat Softw. 2015;67(1):1–48. doi: 10.18637/jss.v067.i01. [DOI] [Google Scholar]
- 72.Pérez-Enciso M, Tenenhaus M. Prediction of clinical outcome with microarray data: a partial least squares discriminant analysis (PLS-DA) approach. Hum Genet. 2003;112(5–6):581–592. doi: 10.1007/s00439-003-0921-9. [DOI] [PubMed] [Google Scholar]
- 73.Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Series B Stat Methodol. 1995;57(1):289–300. [Google Scholar]
- 74.Ishwaran H, et al. Random survival forests. Ann Appl Stat. 2008;2(3):841–860. doi: 10.1214/08-AOAS169. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Select clinical metadata for this study is available on the NCBI’s dbGaP under accession number phs001665.v2.p1. The data for this study were collected as a substudy of dbGaP phs001475.v2.p1.