Abstract
Background
Microbe-microbe and host-microbe interactions in a microbiome play a vital role in both health and disease. However, the structure of the microbial community and the colonization patterns are highly complex to infer even under controlled wet laboratory conditions. In this study, we investigate what information, if any, can be provided by a Bayesian Network (BN) about a microbial community. Unlike the previously proposed Co-occurrence Networks (CoNs), BNs are based on conditional dependencies and can help in revealing complex associations.
Results
In this paper, we propose a way of combining a BN and a CoN to construct a signed Bayesian Network (sBN). We report a surprising association between directed edges in signed BNs and known colonization orders.
Conclusions
BNs are powerful tools for community analysis and extracting influences and colonization patterns, even though the analysis only uses an abundance matrix with no temporal information. We conclude that directed edges in sBNs when combined with negative correlations are consistent with and strongly suggestive of colonization order.
Keywords: Bayesian networks, Conditional dependence, Microbiome, Colonization order, PC-stable
Background
Bayesian Networks (BN) (also Belief Networks and Bayes Nets) are graphical models where nodes represent a set of multi-dimensional variables and edges represent conditional dependencies between the nodes. BNs can thus capture implicit and explicit relationships between these nodes [1]. When learning from data, edges in BNs can be directed or undirected. In fact, highly correlated variables very often lead to undirected (or two-way dependencies), since knowing one variable provides a lot of information about the other variable. In its simplest form, an edge in a BN expresses the conditional probability of knowing the (multi-dimensional) value of the variable at one node, given the value of the variable at another. BNs were used by Friedman et al. to use gene expression data to infer interactions between genes [2]. Conditional dependencies are often misinterpreted as causation, but are merely mathematical relationships that approximate causation under specific circumstances.
A significant feature of BNs is that they can allow us to differentiate between direct and indirect conditional dependence [3]. For example, if the dependence of variable B on variable A vanishes when conditioned on a third variable C, then it allows us to infer that a directed edge from A to B is superfluous and may be removed without loss of information since the directed edges (A,C) and (C,B) allows us to completely capture the dependency of B on A. BNs also help to differentiate between dependency configurations referred to as “common cause” and “common effect” [4].
Many algorithmic variants and implementations to construct BNs exist, including bnlearn [5], CGBayesNet [6], Banjo [7], DEAL [8], GlobalMIT [9], BNFinder [10] and Tetrad [11].
Causation is an important type of relationship to be explored with biological data. So it makes sense to see if BNs can identify relationships that are suggestive of causation and that could lead to wet lab experiments for validation. Recently, BNs were used by Zhang et al. to understand changes in gene regulatory networks under different cellular states [12]. By modeling metabolic reactions and their involvement in multiple subnetworks of “metabosystems”, Shafiei et al. used BNs to infer differential prevalence of metabolic subnetworks within microbial communities [13].
The term microbiota refers to the community of microbes, including bacteria, archaea, protists, fungi, and viruses that share an environmental niche [14]. The term microbiome refers to the entire habitat, including the microbes, their genetic material and the environmental factors. The total genome from microbiota is referred to as the metagenome. The microbes exist as a social network because of the complex set of potential interactions between its various taxonomic members [15, 16].
To understand potential interactions between taxa in a microbial community, the construction of co-occurrence networks (CoN) was proposed by Fernandez et al. [15] and Faust et al. [17]. The results suggested that groups of taxa frequently co-infected or co-avoided cohorts of subjects due to underlying interactions between them. Unfortunately, that is as far as CoNs are able to go in terms of inferring complex relationships in microbiomes.
In this paper, we investigate how to infer directional relationships between microbial taxa in a microbiome by focusing on the important challenge of inferring “colonization order” from abundance data.
In humans, normal microbial colonization starts from birth, and over time these communities become relatively stable [18]. Microbial communities are dynamic, and their compositions change with time [19]. Some microbes occupy an environmental niche early and then recruit other microbes suggesting an order of colonization in many microbial communities. Once new recruits enter the scene, their fitness for the environmental niche could determine the growth or decline of the early colonizers [20].
In the healthy state, our bodies harbor rich communities of microbes mostly on cutaneous and mucosal surfaces such as the skin, oral cavity, gastrointestinal tract, and the reproductive tract [21, 22]. Microbes in these communities have a variety of interactions that impact the health of the host or the environmental niche [17]. An imbalance (dysbiosis) in the microbial community is strongly associated with a variety of human diseases [23]. The dysbiosis is often due to invasion or increase in harmful pathogenic bacteria, which in turn is often preceded by colonization at the site of infection by specific early colonizers [24]. Thus, understanding colonization and its order can provide a window into how infections take hold. Understanding these functional (directed) relationships within the niche is critical for understanding healthy versus diseased microbiomes as well as the mechanisms and biological processes involved in the disease.
In this paper, we show that signed Bayesian Networks (sBNs), a variant of BNs obtained by combining BNs with co-occurrence networks can help tease apart some of these directed relationships and provide a glimpse into the complex and dynamic world of microbial communities. The paper is organized as follows. “Results and discussion” section provides foundations of BNs and some background on microbial colonization in select niches. “Conclusions” section presents the details of the data and experiments and summarizes the results, and “Methods” section presents some conclusions and future directions.
Results and discussion
The sBNs were obtained by prudent use of BNs in conjunction with CoNs. The main contribution of this paper is to show evidence to support the claim that sBNs can help make inferences about colonization order. In some niche environments, research has shown that microbes colonize the niche in specific orders, with early colonizers often recruiting late colonizers or creating conditions that make it more attractive for specific late colonizers [25]. We have observed that with high accuracy, the edges of sBNs are consistent with known colonization orders. In particular, we show that the sBNs can capture colonization order when augmented with the correlation coefficient. The findings were validated by analyzing oral, infant gut, and vaginal microbiome data sets, where prior published information on colonization order was available. The colonization order was also retained in our experiments with the semi-synthetic data sets as well.
The sBNs generated from the data sets mentioned above were visualized with Cytoscape. In all the sBNs generated (Figs. 1, 2, 3, 4 and additional files 1 – 6), nodes correspond to bacterial taxa, node sizes are proportional to the average abundance of the taxa, thickness of the edges are proportional to the absolute value of Pearson correlation coefficient (i.e., measure of co-occurrence), and opacity of an edge is proportional to its bootstrap values. Edges are colored green and red for positive and negative correlations, respectively. The purple and red node colors correspond to the bacterial taxa that are described as early and late colonizers (in published literature), respectively [26–28]. The black nodes indicate colonizers whose order has not been described previously. We note (data not shown) that while there are many strongly connected clusters in CoNs, these nodes remain connected in sBNs (as expected), but relatively sparsely because of the stringent conditional probability tests.
Semi-synthetic data from infant gut microbiome – sBN edges are consistent with temporal order
The infant gut data set was temporally aligned as described earlier. We then divided the time line into k periods, with k=1,2,… and created sBNs from each period. The goal was to see if any of the known orders of colonization can be observed in the figures, even after having modified the time axis of each subject differently.
The infant gut is dominated by three classes that generally appear and colonize in a sequential order: Bacilli (Firmicutes) soon after birth, which then gives way to the Gammaproteobacteria (Proteobacteria), and followed by Clostridia (Firmicutes) [29]. When we partitioned the time series into k=2 periods, the sBN from the first period had a directed edge from the Bacilli to Gammaproteobacteria. The red-colored edge suggested a negative correlation as would be expected if this inference came from colonization order. Additionally, the sBN generated from the second period showed a directed edge from Gammaproteobacteria to Clostridia, also colored red (Fig. 5).
When the time series were partitioned into three periods, the same two edges were represented strongly in periods 2 and 3 respectively. In fact, the strength of the two edges in the three periods were (1) 0.4 and 0.16 (i.e., both weak), (2) 0.94 and 0.16, and (3) 0.61 and 0.80. The above observations suggest strongly that the transition from Bacilli to Gammaproteobacteria occurs before the transition from Gammaproteobacteria to Clostridia, and that the colonization order is supported in the sBNs.
We, therefore, conclude that sBNs are capable of capturing colonization order using the methods suggested above. Red edges or negative correlations are consistent with the model that for both edges when one taxon is declining in abundance, the other is increasing in abundance.
Oral microbiome – sBN edges are consistent with colonization order
In the oral cavity, early and late bacterial colonizers have been identified and reviewed in the literature [26]. Many species from the genus Streptococcus is the early primary colonizer, accounting for 60% - 90% of the early abundance profile [30]. The following taxa have been identified as early and late colonizers for oral microbiomes [26–28]. Early: Streptococcus gordonii, Streptococcus mitis, Streptococcus oralis, Streptococcus sanguis, Actinomyces israelii, Actinomyces naeslundii, Propionibacterium acnes. Late: Selenomonas flueggei, Treponema spp., Porphyromonas gingivalis.
Comparison of the sBNs for all oral microbiomes (Figs. 1–2 and additional files 1–6) showed that the keratinized gingiva (Fig. 1) and tongue dorsum (Fig. 2) have the fewest number of distinct taxa. The sBNs for these two sites were more distinctive than those derived from other sites and showed stronger correlations between taxa. The saliva, subgingival, and palatine tonsils sites harbored a higher number of taxa and exhibited weaker correlations. Note that not every taxa is present in every oral site, thus explaining the differences in the set of nodes present in each sBN.
The sBNs for the oral microbiomes had a combined total of 716 edges. Of these, 78 edges connected vertices, which were associated with known early or late colonizers. Table 1 summarizes the directed edges between early and late colonizers, they are consistent with the known colonization order, and the correlation (negative/positive edges) among them. More than 90% of the sBN edges for the oral microbiome were directed with the exceptions of saliva and buccal mucosa, for which only 83-84% were directed. Of the 78 edges connecting labeled vertices, all edges except for two were consistent with the known colonization order, i.e., directed from early to late colonizers (Table 1). These two edges are shown as dashed lines in the corresponding sBNs (see additional file 2 and additional file 5). In summary, for the oral microbiome the directed sBN edges go from early to late colonizers, with few exceptions. For example, the sBN from keratinized gingiva (Fig. 1) has three directed edges (Actinomyces2-Porphyromonas1, Streptococcus1-Porphyromonas1, and Streptococcus2-Porphyromonas1) from early colonizers to late colonizers and none from late to early colonizers. Note that all taxonomic names have been abbreviated in the figures to the first five characters plus a number, each name refers to a distinct OTU. The sBN for the buccal mucosa (Additional file 1), palatine tonsils (Additional file 2), saliva (Additional file 3), subgingival plaque (Additional file 4), supragingival plaque (Additional file 5), and throat (Additional file 6) are included in the supplementary files.
Table 1.
Oral Site | Total | Directed | Red | E→L | E→E orE→L | L→E | Consistent Red edges |
---|---|---|---|---|---|---|---|
Buccal mucosa | 69 | 57 | 5 | 1 | 4 | 0 | 100% |
keratinized gingiva | 39 | 36 | 8 | 3 | 5 | 0 | 100% |
Palatine tonsils | 126 | 116 | 9 | 1 | 13 | 1 | 92% |
Saliva | 102 | 86 | 8 | 1 | 12 | 0 | 100% |
Subgingival plaque | 123 | 113 | 8 | 1 | 18 | 0 | 100% |
Supragingival plaque | 109 | 105 | 11 | 3 | 13 | 1 | 92% |
Dorsum of tongue | 56 | 50 | 11 | 1 | 4 | 0 | 100% |
Throat | 92 | 83 | 8 | 0 | 9 | 0 | 100% |
Total | 716 | 646 | 68 | 11 | 78 | 2 | 97.4% |
The columns indicate the following: sampled oral sites, total number of edges in causal network, number of directed edges, total number of negatively correlated (red) edges, number of edges connecting early to late colonizers, number of edges connecting early with early or late colonizers, number of inconsistent directed edges (i.e., from late to early colonizers), and percentage of negatively correlated edges connecting early to late colonizers
Oral microbiome – sBN edges with negative correlation are consistent with colonization order
As mentioned above, two out of the 78 edges are exceptions to the rule that no edges in the sBNs are directed from late to early colonizers. In particular, one edge goes from Trepo5 (Treponema, labeled as a late colonizer) to Actin3 (Actinomyces, labeled early colonizer) in palatine tonsils. Similarly, another edge goes from Porph3 (Porphyromonas, labeled as late colonizer) to Actin3 (Actinomyces, labeled early colonizer) in supra-gingival plaque. However, the correlation coefficient of the edges between them is positive. Thus, the accuracy in terms of direction is 97.4%, and all correctly directed edges have negative correlations. According to Kolenbrander et al., the bacterial taxa representing early colonizers coaggregate with only a specific set of other early colonizers, and not with any of the late colonizers [26]. Our findings, albeit limited, are consistent with this observation, that all edges connecting early to late colonizers in that direction are negatively correlated (red edges).
Infant gut microbiome
The abundance of microbes in neonatals over the course of the first few weeks of their lives have been reported [29]. In two infant gut microbiome studies, the class Bacteroidetes and Gammaproteobacteria were observed early, followed by Bacilli, Clostridia and Gammaproteobacteria [29, 31]. Over time, there was a significant decrease in Bacilli, and the infant’s gut appears to have a tug-of-war between the two classes Gammaproteobacteria and Clostridia [31]. When the sBNs were constructed with the infant gut microbiome data, we obtained a directed network that supported the claim that sBNs shed light on the colonization pattern (Fig. 3). There were directed edges from Bacteroidetes, Bacilli, and Clostridia to Gammaproteobacteria (Fig. 3). The results also supported the prior knowledge that Clostridia precedes Bacilli in the colonization order. All these taxa are mostly negatively correlated (red edges), as shown in Fig. 3, reinforcing the point that a directed edge combined with negative correlations is strongly suggestive of colonization order.
Vaginal microbiome
A healthy vaginal microbiome is dominated mainly by Lactobacillus species [32]. When women at a reproductive age suffer from bacterial vaginosis (BV), the Lactobacillus species are replaced by Gardnerella, Peptostreptococcus, Atopobium, Sneathia, Parvimonas, and Corynebacterium, among others [33]. Figure 4 shows three sBNs for vaginal microbiomes associated with low (healthy), medium (early BV), and high (advanced BV) Nugent scores. All samples were analyzed for the abundance of the same set of 23 genera. Overall, the predominant genera observed were Lactobacillus, Atopobium, Gardnerella, Parvimonas, and Prevotella (Fig. 4).
In the sBN associated with the healthy “vaginome”, the abundance of Lactobacillus was comparatively higher as expected. The Lactobacillus species, especially, L. crispatus and L. iners (data not shown) displayed an antagonistic relationship with the BV-associated Gardnerella.
In the sBN for the medium Nugent score cohort, indicative of early vaginosis, the BV-associated genera, Atopobium, and Sneathia AND Gardnerella were significantly increased in abundance, and appeared as early colonizers. The abundance of all the BV-associated pathogens was negatively correlated with Lactobacillus, reaffirming an antagonistic relationship.
In the sBN for the advanced BV cohort, characterized by higher Nugent scores, a proportional increase in abundance was observed with Atopobium followed by Gardnerella. Even with the antagonistic relationship with Lactobacillus, the BV-associated pathogenic genera especially Atopobium and Gardnerella, Sneathia are connected by a directed edge to Lactobacillus. The appearance of the pathogenic genera as late colonizers is consistent with clinical findings [34]. Strong positive relationships were observed between Prevotella and Peptostreptococcus, and Peptostreptococcus with Parvimonas. This may suggest that the presence of Prevotella enables the colonization of Peptostreptococcus followed by Parvimonas.
To check the robustness we also experimented with a higher number of taxa, i.e., by including all taxa whose abundance added up to 99.99%. We found that sBNs can retrieve the known colonization order even if we include taxa with small abundance (from 99% to 99.99% of most abundant taxa shown in Additional file 7).
Conclusions
In healthy oral microbiomes, taxa such as Actinobacteria were identified as early colonizers [35]. Many pathogenic microbes associated with oral diseases such as dental caries, gingivitis, and periodontitis appeared as late colonizers [36]. In addition, there were antagonistic relationships between these pathogens. The rivalry seemed to occur between Streptococcus, Fusobacterium, Prevotella, Porphyromonas, Veillonella, Propionibacterium and Neisseria. Since the oral samples came from healthy individuals, the existence of the rivalry could lead to the elimination of one or more taxa from the site. Alternatively, it is also possible that one taxon keeps the other in check to prevent dysbiosis. A well-known pathogenic genera, Treponema, appeared as a late colonizer with positive correlations in most of the sites. It was absent in keratinized gingiva and tongue dorsum, but appeared as an early colonizer in buccal mucosa. This may suggest that the buccal mucosa is the site in the oral cavity where Treponema colonizes.
The sBN for the vaginal microbiome confirmed previously known relationships between Lactobacillus and other BV-associated pathogens. In the process, it also suggested a possible colonization order. It would require a longitudinal study of women before and after BV to validate the suggested colonization order. Current analyses suggest that the balance in the relative abundance of Lactobacillus and Atopobium may be a biomarker for BV.
Inferring the interactions between different taxa within a microbial community and understanding their influence on health and disease is one of the primary goals of microbiome research. The sBNs help us to infer potential relationships and dependencies within a microbiome, and the colonization order, even without the use of data from longitudinal studies. The sBNs could help in understanding the dependencies between the entities of a microbial community.
Finally, we reiterate the conclusion that directed edges in sBNs when combined with negative correlations, may be strongly suggestive of colonization order.
Methods
Bayesian networks
Bayesian Networks (BNs) are a class of Probabilistic Graphical Models (PGMs) [1, 37] where each node represents a random variable from a set, X={Xi,i=1,...,n}, with n random variables. The BN is represented as a graph G=(V,E), where each vertex in V represents a random variable from X, and E is the set of edges on V. In general, a BN is represented as a Directed Acyclic Graph (DAG), although undirected edges are used in cases where the direction cannot be reliably determined or when both directions appear plausible. Each random variable Xi has a local probability distribution. A directed edge of E between two vertices represents direct stochastic dependencies. Therefore, if there is no edge connecting two vertices, the corresponding variables are either marginally independent or conditionally independent given (a subset of) the rest of the variables. The “local” probability distribution of a variable Xi depends only on itself and its parents (i.e., the vertices with directed edges into the node Xi); the “global” probability distribution, P(X) is the product of all local probabilities, i.e., a joint distribution [38] as shown below:
The task of fitting a BN is called “model learning” and its implementation generally involves two steps - structure learning and parameter learning. Structure learning involves finding a BN that encodes the conditional dependencies from the data, while parameter learning is the estimation of the parameters of the global distribution [39]. Eliminating edges in the structure helps to simplify the “global” joint distribution, allowing for more efficient computations with the model and for better inferring of critical relationships. In this paper, we only focus on the structure of the BN, not the parameters. For structure learning, at least three approaches have been proposed in the literature – constraint-based, score-based, and hybrid. We focus on the constraint-based algorithms, which are based on an approach called Inductive Causation (IC) [40]. IC provides a framework for learning the BN using conditional independence (CI) tests under the assumption that graphical separation in the BN is equivalent to probabilistic independence between the corresponding variables. Note that the resulting BN may be a partially directed acyclic graph (PDAG) [41] because not all edge directions can be resolved with IC.
Training the Bayesian network structure
The constraint-based IC approach to structure learning mentioned above was proposed by Spirtes et al. [42]. The constraint-based approaches are typically more conservative than score-based algorithms in terms of the number of edges they retain in the final Bayesian network. Furthermore, constraint-based approaches are better suited for causal inferences [41]. The approach of Spirtes et al. was later modified by Colombo and Maathuis to make it order independent in an algorithm known as PC-Stable [43]. The main feature of PC-Stable algorithm is the inference of a skeleton (undirected structure) in an order independent way [43]. Order dependency is a minor issue for low dimensional settings. However, in high dimensional settings, order dependence may give results with high variance [44].
PC-stable consists mainly of three steps – adjacency search in order to learn the “skeleton”, identifying important substructures called v-structures, and detecting and orienting other arcs. In Step 1, the algorithm starts with a complete undirected graph and then performs a series of conditional independence tests to eliminate as many edges as possible. The remaining undirected graph is referred to as the skeleton.
Step 2 is key to inferring a BN model, and uses the concept of v-structures, which are defined as follows. For any three nodes representing variables Xi,Xj,Xk in a Bayesian network G, if {Xi,Xj} and {Xj,Xk} are edges in G, but {Xi,Xk} is not, and if edges are oriented as Xi→Xj←Xk then the triple (Xi,Xj,Xk) is called a v-structure. Triples satisfying the v-structure property can be identified in the skeletons using conditional dependency tests, following which edges are appropriately directed to form a v-structure. The variable Xj in the triple forming the v-structure represents a “common effect” of Xi and Xk. These v-structures are critical in giving directions to some of the edges of the skeleton.
In Step 3, three rules [43] are applied repeatedly to orient edges not already in v-structures. Rule 1: Orient Xj−Xk as Xj→Xk whenever (a) there is a directed edge Xi→Xj and (b) Xi and Xk are not adjacent. Rule 2: Orient Xj−Xk as Xj→Xk whenever there is a chain Xj→Xi→Xk. Rule 3: Orient Xj−Xk as Xj→Xk whenever there are two chains Xj−Xi→Xk and Xj−Xl→Xk given that Xi and Xl are not adjacent.
Real data sets
Ribosomal 16S rRNA sequences from three microbiome data sets (oral, infant gut, and vaginal) were used (see Table 1). The oral data set was generated as part of the Human Microbiome Project (HMP) from eight different sites within the oral cavity from 242 healthy adults (129 males, 113 females) [14, 45]. The samples included: saliva, buccal mucosa (cheek), keratinized gingiva (gums), palatine tonsils, throat, tongue dorsum, and supra- and sub-gingiva dental plaque (tooth biofilm above and below the gum) [14, 45].
The preterm infant gut microbiome samples were collected and processed for a longitudinal study as described by La Rosa et al. [29]. This study involved a total of 922 stool samples from 58 premature babies, each weighing ≤1500 g at birth.
The vaginal microbiome data set was previously generated to determine temporal dynamics of the human vaginal microbiota [46]. This study involved 32 women from different ages (18 through 40), races (Black, White, Hispanic and other), educational backgrounds, and sexual habits [46]. Each sample was associated with a Nugent score [47], an indicator of the level of vaginosis. All OTUs associated with Lactobacillus were combined into one taxa.
Friedman et al. performed the BN inference by adding an extra “cell cycle phase” variable to account for the temporal aspect of the data [2]. Following their suggestion, an extra variable for sampling time was added to the analyses of the infant gut and vaginal microbiome data sets, thus assuming that the sampling time for each sample is an independent random variable from some distribution.
Data processing
The samples were processed by amplifying the V35 hypervariable region of the bacterial 16S rRNA gene. This was followed by sequencing and grouping reads into common Operational Taxonomic Units (OTUs). The Mothur pipeline [48] was used to compute the microbial abundance of each taxon.
OTU abundance data were stored in matrix B, an n×p abundance matrix, where n is the number of samples and p is the number of OTUs. The i-th sample is represented by the i-th row of B, , where denotes the abundance of the j-th bacterial OTU in the i-th sample. The total number of mapped reads from the i-th sample is denoted by . The relative abundance matrix is then computed by normalizing each raw count, , with the total number of reads in that sample w(i). The normalized vector of relative abundances for sample i is thus given by
Each data set from the HMP collection had abundances for several hundred taxa, most of which were extremely small [14, 45]. To make our computations efficient, taxa with abundance close to the background noise were eliminated. This is achieved by first sorting the relative abundance values of the OTU-level taxa and then picking the taxa with the highest values that added up to a total of 99%. In other words, the discarded taxa were the lowest values that summed up to less than 1%. Table 2 shows the number of taxa from each site used to learn the BNs during the structure learning step. The subjects in the vaginal data set were grouped by Nugent Scores – lower (healthy), medium, and higher. Individuals with higher Nugent scores had more severe cases of bacterial vaginosis [47].
Table 2.
Site | # of samples | # of taxa |
---|---|---|
Buccal mucosa | 309 | 51 |
Keratinized gingiva | 269 | 29 |
Palatine tonsils | 320 | 68 |
Saliva | 298 | 75 |
Subgingival dental plaque | 325 | 84 |
Supragingival dental plaque | 335 | 65 |
Dorsum of tongue | 335 | 37 |
Throat | 313 | 64 |
Infant gut | 922 | 12 |
Vaginal (lower Nugent score) | 3203 | 19 |
Vaginal (medium Nugent score) | 568 | 19 |
Vaginal (higher Nugent score) | 916 | 19 |
The first eight are from oral microbiomes, the next one from gut microbiome, and the last three from vaginal microbiomes. Note that the Nugent score is an indicator of the level of vaginosis
Semi-synthetic data
Besides using real data for our experiments, we also carried out experiments on what we refer to as “semi-synthetic” data, which were obtained by appropriate modifications of real data sets as described below. The semi-synthetic data sets were obtained by performing temporal alignments on the infant gut data sets using the time-warping methods proposed by Lugo-Martinez et al. [49, 50]. The purpose of temporal alignments was to align the “internal clocks” of the subjects correcting for their different metabolic speeds. The temporal alignment was done by interpolating the time series and stretching/squishing and shifting them with respect to time series of a reference subject. As a consequence, the time series are put on an artificial time scale and then uniformly sampled with a sampling rate of 1 per (warped) day.
Construction of Bayesian networks
The PC-stable, a causality-learning algorithm, was used to construct the BNs [43]. It is a constraint-based algorithm that is more conservative than score-based algorithms and results in fewer false positives. Also, it is partly order-independent, as described below [43]. The PC-stable algorithm from the bnlearn package [5] was used to obtain the BNs for each data set.
Construction of co-occurrence networks
The co-occurrence networks (CoNs) were constructed for each cohort using Pearson correlation coefficient, as described in previous work [15].
Construction of signed Bayesian networks
The edges of BNs were augmented with the coefficient values generated in CoNs, thus distinguishing between positive and negative correlations. As mentioned earlier, the resulting network is referred to as a Signed Bayesian Network (sBN). All sBNs in this paper were visualized using Cytoscape [51]. The color of the edges (green for positive and red for negative) indicates sign information.
Experiments and statistical analyses
The constraint-based algorithms employ statistical tests for deciding conditional independence. Since the random variables in our experiments hold continuous data representing the abundance of taxa, we used linear correlation (student’s exact T-test) and Fisher’s Z-test (asymptotic normal test) for conditional independence testing [52, 53].
In the PC-stable algorithm, inferring the skeleton structure and inferring the directions of edges involved in the v-structures are known to be “order-independent”. However, inferring the directions of edges not involved in the v-structures is not order-independent. A non-parametric bootstrap value was computed to indicate the strength of each edge in the output network in order to assess the accuracy of the output [54, 55]. To achieve this, the data was randomized before input into the PC-stable algorithm. The bootstrap values were computed by executing the program on 200 different permuted inputs and reporting the percentage of times it reports one direction.
Supplementary information
Acknowledgments
The authors thank the members of the Bioinformatics Research Group (BioRG) for many useful comments during the course of this research.
About this supplement
This article has been published as part of BMC Genomics Volume 21 Supplement 6, 2020: Selected articles from the 8th IEEE International Conference on Computational Advances in Bio and medical Sciences (ICCABS 2018): genomics. The full contents of the supplement are available online at https://bmcgenomics.biomedcentral.com/articles/supplements/volume-21-supplement-6.
Abbreviations
- BN
Bayesian network
- CoN
Co-occurence network
- DAG
Directed acyclic graph
- IC
Inductive causation
- CI
Conditional independence
- PDAG
Partially directed acyclic graph
- PGM
Probabilistic graphical model
- OTU
Operational taxonomic unit
- HMP
Human microbiome project
- sBN
Signed bayesian network
- BV
Bacterial vaginosis
Authors’ contributions
The research project was conceived and supervised by GN. MS wrote all necessary software and performed all the experiments. DR and TC assisted with data processing. KM contributed to writing and interpreting biological significance. All authors reviewed the manuscript. All authors read and approved the manuscript.
Funding
This work was partially supported by grants from the Department of Defense Contract W911NF-16-1-0494, NIH grant 1R15AI128714-01, and NIJ grant 2017-NE-BX-0001. The funding agency did not participate in the research idea, design, or implementation. Publication costs were funded by personal funds of the authors.
Availability of data and materials
Raw data for the oral microbiome dataset were downloaded from the Human Microbiome Project website (https://hmpdacc.org/hmp/), the accession number is PRJNA43021. The infant gut microbiome dataset was downloaded from the supplementary materials of La Rosa et al. [29]. The vaginal microbiome dataset was downloaded from the supplementary materials of Gajer et al. [46]. Source code and processed data can be available upon reasonable request to the corresponding author.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Musfiqur Sazal, Email: msaza001@fiu.edu.
Kalai Mathee, Email: matheek@fiu.edu.
Daniel Ruiz-Perez, Email: druiz072@fiu.edu.
Trevor Cickovski, Email: tcickovs@fiu.edu.
Giri Narasimhan, Email: giri@fiu.edu.
Supplementary information
Supplementary information accompanies this paper at 10.1186/s12864-020-07065-0.
References
- 1.Koller D, Friedman N. Probabilistic graphical models: Principles and techniques. Cambridge, MA: MIT press; 2009. [Google Scholar]
- 2.Friedman N, Linial M, Nachman I, Pe’er D. Using Bayesian networks to analyze expression data. J Comput Biol. 2000;7(3-4):601–20. doi: 10.1089/106652700750050961. [DOI] [PubMed] [Google Scholar]
- 3.Sazal MR, Ruiz-Perez D, Cickovski T, Narasimhan G. Inferring relationships in microbiomes from signed Bayesian networks. In: 2018 IEEE 8th International Conference on Computational Advances in Bio and Medical Sciences (ICCABS): 2018. p. 1, IEEE.
- 4.Steyvers M, Tenenbaum JB, Wagenmakers E-J, Blum B. Inferring causal networks from observations and interventions. Cogn Sci. 2003;27(3):453–89. doi: 10.1207/s15516709cog2703_6. [DOI] [Google Scholar]
- 5.Scutari M. Learning Bayesian networks with the bnlearn R package. arXiv preprint arXiv:0908.3817. 2009.
- 6.McGeachie MJ, Chang H-H, Weiss ST. CGBayesNets: conditional Gaussian Bayesian network learning and inference with mixed discrete and continuous data. PLoS Comput Biol. 2014;10(6):1003676. doi: 10.1371/journal.pcbi.1003676. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Smith VA, Yu J, Smulders TV, Hartemink AJ, Jarvis ED. Computational inference of neural information flow networks. PLoS Comput Biol. 2006;2(11):161. doi: 10.1371/journal.pcbi.0020161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Bøttcher S, Dethlefsen C. DEAL: A package for learning Bayesian networks. Online Technical report, Department of Mathematical Sciences, Aalborg University. 2003. www.math.auc.dk/research/reports/reports.htm. Accessed 15 July 2018.
- 9.Vinh NX, Chetty M, Coppel R, Wangikar PP. GlobalMIT: learning globally optimal dynamic bayesian network with the mutual information test criterion. Bioinformatics. 2011;27(19):2765–6. doi: 10.1093/bioinformatics/btr457. [DOI] [PubMed] [Google Scholar]
- 10.Wilczyński B, Dojer N. BNFinder: exact and efficient method for learning Bayesian networks. Bioinformatics. 2008;25(2):286–7. doi: 10.1093/bioinformatics/btn505. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.The Tetrad Project (Graphical Causal Models). http://www.phil.cmu.edu/tetrad/. Accessed 15 July 2018.
- 12.Zhang X-F, Ou-Yang L, Yan H. Incorporating prior information into differential network analysis using non-paranormal graphical models. Bioinformatics. 2017;33(16):2436–45. doi: 10.1093/bioinformatics/btx208. [DOI] [PubMed] [Google Scholar]
- 13.Shafiei M, Dunn KA, Chipman H, Gu H, Bielawski JP. BiomeNet: a Bayesian model for inference of metabolic divergence among microbial communities. PLoS Comput Biol. 2014;10(11):1003918. doi: 10.1371/journal.pcbi.1003918. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Peterson J, Garges S, Giovanni M, McInnes P, Wang L, Schloss JA, Bonazzi V, McEwen JE, Wetterstrand KA, Deal C, Baker CC. The NIH human microbiome project. Genome Res. 2009;19(12):2317–23. doi: 10.1101/gr.096651.109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Fernandez M, Riveros JD, Campos M, Mathee K, Narasimhan G. Microbial “social networks”. BMC Genomics. 2015;16(11):6. doi: 10.1186/1471-2164-16-S11-S6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Fernandez M, Aguiar-Pulido V, Riveros J, Huang W, Segal J, Zeng E, Campos M, Mathee K, Narasimhan G. Microbiome analysis: State of the art and future trends In: Mandoiu, Zelikovsky, editors. Computational Methods for Next Generation Sequencing Data Analysis, Chapter 18. John Wiley and Sons: 2016. p. 333–351.
- 17.Faust K, Sathirapongsasuti JF, Izard J, Segata N, Gevers D, Raes J, Huttenhower C. Microbial co-occurrence relationships in the human microbiome. PLoS Comp Biol. 2012;8(7):1002606. doi: 10.1371/journal.pcbi.1002606. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Houghteling PD, Walker WA. Why is initial bacterial colonization of the intestine important to the infant’s and child’s health? J Pediatr Gastroenterol Nutr. 2015;60(3):294–307. doi: 10.1097/MPG.0000000000000597. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Kong HH, Oh J, Deming C, Conlan S, Grice EA, Beatson MA, Nomicos E, Polley EC, Komarow HD, Murray PR, Turner ML. Temporal shifts in the skin microbiome associated with disease flares and treatment in children with atopic dermatitis. Genome Res. 2012;22(5):850–9. doi: 10.1101/gr.131029.111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Grice EA, Segre JA. The skin microbiome. Nat Rev Microbiol. 2011;9(4):244–53. doi: 10.1038/nrmicro2537. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Costello EK, Lauber CL, Hamady M, Fierer N, Gordon JI, Knight R. Bacterial community variation in human body habitats across space and time. Science. 2009;326(5960):1694–7. doi: 10.1126/science.1177486. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Peleg AY, Hogan DA, Mylonakis E. Medically important bacterial–fungal interactions. Nat Rev Microbiol. 2010;8(5):340–9. doi: 10.1038/nrmicro2313. [DOI] [PubMed] [Google Scholar]
- 23.Nadal I, Donant E, Ribes-Koninckx C, Calabuig M, Sanz Y. Imbalance in the composition of the duodenal microbiota of children with coeliac disease. J Med Microbiol. 2007;56(12):1669–74. doi: 10.1099/jmm.0.47410-0. [DOI] [PubMed] [Google Scholar]
- 24.Todar K. Online Textbook of Bacteriology; Chapter 3. http://textbookofbacteriology.net/colonization.html. Accessed 15 July 2018.
- 25.Curtis MA, Zenobia C, Darveau RP. The relationship of the oral microbiotia to periodontal health and disease. Cell Host Microbe. 2011;10(4):302–6. doi: 10.1016/j.chom.2011.09.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Kolenbrander PE, Andersen RN, Blehert DS, Egland PG, Foster JS, Palmer RJ. Communication among oral bacteria. Microbiol Mol Biol Rev. 2002;66(3):486–505. doi: 10.1128/MMBR.66.3.486-505.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Welch JLM, Rossetti BJ, Rieken CW, Dewhirst FE, Borisy GG. Biogeography of a human oral microbiome at the micron scale. Proc Natl Acad Sci. 2016;113(6):791–800. doi: 10.1073/pnas.1522149113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Kolenbrander PE, London J. Adhere today, here tomorrow: oral bacterial adherence. J Bacteriol. 1993;175(11):3247–52. doi: 10.1128/JB.175.11.3247-3252.1993. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.La Rosa PS, Warner BB, Zhou Y, Weinstock GM, Sodergren E, Hall-Moore CM, Stevens HJ, Bennett WE, Shaikh N, Linneman LA, Hoffmann JA. Patterned progression of bacterial populations in the premature infant gut. Proc Natl Acad Sci. 2014;111(34):12522–7. doi: 10.1073/pnas.1409497111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Nyvad B, Kilian M. Microbiology of the early colonization of human enamel and root surfaces in vivo. Scand J Dent Res. 1987;95(5):369–80. doi: 10.1111/j.1600-0722.1987.tb01627.x. [DOI] [PubMed] [Google Scholar]
- 31.McGeachie MJ, Sordillo JE, Gibson T, Weinstock GM, Liu Y-Y, Gold DR, Weiss ST, Litonjua A. Longitudinal prediction of the infant gut microbiome with dynamic Bayesian networks. Sci Rep. 2016;6:20359. doi: 10.1038/srep20359. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Petrova MI, Lievens E, Malik S, Imholz N, Lebeer S. Lactobacillus species as biomarkers and agents that can promote various aspects of vaginal health. Front Physiol. 2015;6:81. doi: 10.3389/fphys.2015.00081. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Onderdonk AB, Delaney ML, Fichorova RN. The human microbiome during bacterial vaginosis. Clin Microbiol Rev. 2016;29(2):223–38. doi: 10.1128/CMR.00075-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Machado A, Cerca N. Influence of biofilm formation by Gardnerella vaginalis and other anaerobes on bacterial vaginosis. J Infect Dis. 2015;212(12):1856–61. doi: 10.1093/infdis/jiv338. [DOI] [PubMed] [Google Scholar]
- 35.Schulz S, Porsch M, Grosse I, Hoffmann K, Schaller H-G, Reichert S. Comparison of the oral microbiome of patients with generalized aggressive periodontitis and periodontitis-free subjects. Arch Oral Biol. 2019;99:169–76. doi: 10.1016/j.archoralbio.2019.01.015. [DOI] [PubMed] [Google Scholar]
- 36.Gendron R, Grenier D, Maheu-Robert L-F. The oral cavity as a reservoir of bacterial pathogens for focal infections. Microbes Infect. 2000;2(8):897–906. doi: 10.1016/S1286-4579(00)00391-9. [DOI] [PubMed] [Google Scholar]
- 37.Pearl J. Probabilistic reasoning in intelligent systems: Networks of plausible inference. Amsterdam, Netherlands: Elsevier; 2014. [Google Scholar]
- 38.Scutari M. Bayesian network constraint-based structure learning algorithms: Parallel and optimised implementations in the bnlearn R package. arXiv preprint arXiv:1406.7648. 2014.
- 39.Scutari M, Denis J-B. Bayesian networks: with examples in R. Boca Raton, FL: CRC press; 2014. [Google Scholar]
- 40.Bonissone P, Henrion M, Kanal L, Lemmer J. Equivalence and synthesis of causal models. In: Uncertainty in Artificial Intelligence: 1991. p. 220–7.
- 41.Kalisch M, Mächler M, Colombo D, Maathuis MH, et al. Causal inference using graphical models with the R package pcalg. J Stat Softw. 2012;47(11):1–26. doi: 10.18637/jss.v047.i11. [DOI] [Google Scholar]
- 42.Spirtes P, Glymour CN, Scheines R. Causation, Prediction, and Search. Cambridge, MA: MIT press; 2000. [Google Scholar]
- 43.Colombo D, Maathuis MH. Order-independent constraint-based causal structure learning. J Mach Learn Res. 2014;15(1):3741–82. [Google Scholar]
- 44.Colombo D, Maathuis MH, Kalisch M, Richardson TS. Learning high-dimensional directed acyclic graphs with latent and selection variables. Ann Stat. 2012;40(1):294–321. doi: 10.1214/11-AOS940. [DOI] [Google Scholar]
- 45.Huttenhower C, Gevers D, Knight R, Abubucker S, Badger JH, Chinwalla AT, Creasy HH, Earl AM, FitzGerald MG, Fulton RS, Giglio MG. Structure, function and diversity of the healthy human microbiome. Nature. 2012;486(7402):207. doi: 10.1038/nature11234. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Gajer P, Brotman RM, Bai G, Sakamoto J, Schütte UM, Zhong X, Koenig SS, Fu L, Ma ZS, Zhou X, Abdo Z. Temporal dynamics of the human vaginal microbiota. Sci Transl Med. 2012;4(132):132ra52. doi: 10.1126/scitranslmed.3003605. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Nugent RP, Krohn MA, Hillier SL. Reliability of diagnosing bacterial vaginosis is improved by a standardized method of gram stain interpretation. J Clin Microbiol. 1991;29(2):297–301. doi: 10.1128/JCM.29.2.297-301.1991. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Schloss PD, Westcott SL, Ryabin T, Hall JR, Hartmann M, Hollister EB, Lesniewski RA, Oakley BB, Parks DH, Robinson CJ, Sahl JW. Introducing Mothur: open-source, platform-independent, community-supported software for describing and comparing microbial communities. Appl Environ Microbiol. 2009;75(23):7537–41. doi: 10.1128/AEM.01541-09. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Lugo-Martinez J, Ruiz-Perez D, Narasimhan G, Bar-Joseph Z. Dynamic interaction network inference from longitudinal microbiome data. Microbiome. 2019;7(1):54. doi: 10.1186/s40168-019-0660-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Bar-Joseph Z, Gerber GK, Gifford DK, Jaakkola TS, Simon I. Continuous representations of time-series gene expression data. J Comput Biol. 2003;10(3-4):341–56. doi: 10.1089/10665270360688057. [DOI] [PubMed] [Google Scholar]
- 51.Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, Ramage D, Amin N, Schwikowski B, Ideker T. Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Res. 2003;13(11):2498–504. doi: 10.1101/gr.1239303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.De Winter JC. Using the Student’s t-test with extremely small sample sizes. Pract Assess Res Eval. 2013; 18(10).
- 53.Cox NJ. Speaking Stata: Correlation with confidence, or Fisher’s z revisited. Stata J. 2008;8(3):413–39. doi: 10.1177/1536867X0800800307. [DOI] [Google Scholar]
- 54.Friedman N, Goldszmidt M, Wyner A. Data analysis with Bayesian networks: A bootstrap approach. In: Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann Publishers Inc.: 1999. p. 196–205.
- 55.Efron B, Halloran E, Holmes S. Bootstrap confidence levels for phylogenetic trees. Proc Natl Acad Sci. 1996;93(23):13429. doi: 10.1073/pnas.93.23.13429. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Raw data for the oral microbiome dataset were downloaded from the Human Microbiome Project website (https://hmpdacc.org/hmp/), the accession number is PRJNA43021. The infant gut microbiome dataset was downloaded from the supplementary materials of La Rosa et al. [29]. The vaginal microbiome dataset was downloaded from the supplementary materials of Gajer et al. [46]. Source code and processed data can be available upon reasonable request to the corresponding author.