Abstract
Evolutionary models on graphs, as an extension of the Moran process, have two major implementations: birth–death (BD) models (or the invasion process) and death–birth (DB) models (or voter models). The isothermal theorem states that the fixation probability of mutants in a large group of graph structures (known as isothermal graphs, which include regular graphs) coincides with that for the mixed population. This result has been proved by Lieberman et al. (2005 Nature 433, 312–316. (doi:10.1038/nature03204)) in the case of BD processes, where mutants differ from the wild-types by their birth rate (and not by their death rate). In this paper, we discuss to what extent the isothermal theorem can be formulated for DB processes, proving that it only holds for mutants that differ from the wild-type by their death rate (and not by their birth rate). For more general BD and DB processes with arbitrary birth and death rates of mutants, we show that the fixation probabilities of mutants are different from those obtained in the mass-action populations. We focus on spatial lattices and show that the difference between BD and DB processes on one- and two-dimensional lattices is non-small even for large population sizes. We support these results with a generating function approach that can be generalized to arbitrary graph structures. Finally, we discuss several biological applications of the results.
Keywords: evolutionary dynamics, stochastic process, numerical simulations
2. Introduction
Exploring the effect of spatial structure of an evolutionary system and its importance on the dynamics of selection has long been of interest in population genetics [1]. The original stepping stone model developed by Kimura & Weiss [2] is the backbone of the subsequent implementations of spatial structure into evolutionary modelling. Maruyama analysed the fixation behaviour of a Moran process in a geographically structured population and was able to show that regular spatial structures do not enhance or suppress selection [3,4]. More recently, Liberman et al. [5] revisited the problem and extended previous models to an arbitrary graph, where at each node of the graph a single species can reside. They were able to show that some categories of graphs (such as a star graph, where a central vertex is connected to all leaf vertices) enhance the selection, while other graphs suppress the selection (see also [6,7]). Masuda & Ohtsuki [8] considered the evolutionary dynamics in directed networks and studied the fixation probability of a mutant in finite populations for several update rules. The effects of spatial structure have been also discussed in the spatial evolutionary games (e.g. [9–11]). Other notable recent works have focused on the effect of spatial structure on evolution of cooperation [12] and on the replicator dynamics on a graph structure [13]. Selection dynamics on various types of random graphs has been the subject of a lot of interest recently in the context of applications to social networks [14], infectious disease and epidemiology [15,16], and cancer modelling [17,18], among others. Multi-hit processes and tumour suppressor gene inactivation [19], spatial pattern formation in evolutionary models [20,21] and the effect of spatial distribution of fitness on selection [22] are some other directions of current research. For a general review of evolutionary dynamics on graphs and some recent trends, see Shakarian et al. [23].
In the Moran process, we assume the existence of N individuals. To keep the population constant, it is assumed that each elementary update consists of a birth and a death event, where individuals are chosen for birth and death from the pool consisting of the entire population. It is of little consequence whether the first event in each elementary update is a birth or a death event. However, the order of these events can become important if we consider a spatial generalization of the Moran process.
To this end, we consider a regular spatial lattice or an unstructured mesh, and again impose the condition of a constant population. For each update, an independent birth (or death) event can occur at a randomly chosen site of the lattice, but the subsequent death (or birth) event should now happen at a neighbouring site of the lattice to represent the spatial structure and the fact that only daughters of individuals that are connected to a particular site can be placed there. In a birth–death (BD) process, a birth event is followed by a death event, and in a death–birth (DB) process, a death event happens first. These are the two main implementations of the generalized Moran process that have been considered in the literature.
Aside from DB or BD models, there have been other implementations of evolutionary processes on a graph structure. Sood et al. [14,24] discuss a model of link dynamics, where instead of random sampling of nodes, one considers random samples edges (links) of a graph as a first elementary event and then updates the values of the two nodes on the chosen link based on the fitness of individuals there (similar models are discussed in [13,25]). Evolutionary games in the context of linking dynamics have also been studied [26–28]. Another variation of BD models on a graph is considered by van Baalen & Rand [29], where each of the elementary events can be either a birth or a death or a migration (see also [18,30]).
It has been observed by Maruyama [3,4] and later generalized by Lieberman et al. [5] that in the case of the BD process, selection dynamics are not affected by regular and symmetric structures (or more generally isothermal graphs). This elegant result is referred to as the isothermal theorem. In this paper, we explore the applicability of this theorem to other types of processes. The motivation for this question is the result of Komarova [17], where the Moran process was studied on a one-dimensional spatial lattice, and the DB formulation was used. It was shown that the probability of mutant fixation in this case was different from the one obtained in the space-free Moran process. Therefore, in this paper, we study the connection between DB and BD processes on spatial lattices and explore the extent to which the order of birth and death events influences the probability of mutant fixation.
In the literature, differences between DB and BD updates have been described in somewhat different contexts. In papers by Fu et al. [31] and Ohtsuki & Nowak [32], evolutionary games were studied on graphs, and different behaviour under DB and BD models has been emphasized. In Ohtsuki & Nowak [13], the replicator equation on graphs is studied in the context of DB, BD and ‘imitation’ dynamics; applications include evolutionary games such as Prisoner's Dilemma, the Snow-Drift game, a coordination game, and the Rock–Scissors–Paper game. Zukewich et al. [33] studied evolution of cooperation and formulated the corresponding Moran process under the DB and BD implementations. It is shown that for DB updates, cooperation may be favoured in structured populations, while with BD updates this never is. The authors propose a mixed rule where in each time-step DB or BD updates are used with fixed probabilities, and they further derive the conditions for selection favouring cooperation under the mixed rule for various social dilemmas. Our work adds to these investigations by studying the difference between DB and BD updates in the Moran process in the context of mutant fixation.
Another natural generalization of the Moran process that we focus on here concerns the definition of fitness. In the conventional Moran model, all individuals are characterized by their ‘fitness’ parameters. Usually, an individual is chosen for division with a probability weighted by its fitness, and an individual is chosen for death with the probability 1/N (such that all individuals are equally likely to be chosen for death, e.g. [5,33]). In a more general setting, however, fitness could be influenced by the death rate as much as it is by the division rate. For example, a cancer cell in tissue could differ from the surrounding cells by its division rate and/or by its death rate. Therefore, in this paper, we aim to explore how the division and the death rates both influence the fixation dynamics of mutants in the DB and BD processes.
The rest of this paper is organized as follows. In §3, we formulate DB and BD models on a graph, with general death and birth rates. We show that DB and BD transition probabilities can be transformed into each other by using a duality property of the two models. To study the differences between the DB and BD processes, we start with the case of a complete graph (where all vertices are connected, §4) and derive closed algebraic forms for fixation probability in either of cases. In particular, we show that the difference between DB and BD implementation on a complete graph vanishes as 1/N, as the system size goes to infinity. In §5, we discuss exact solutions of DB and BD models on a one-dimensional circle and show that the differences are no longer negligible even for large system sizes. In §6, we find an approximation for the fixation probability in higher dimensions and the higher connectivities. Based on the results obtained, we conjecture that the difference between the two models has the order of the inverse of the degree of connectivity of the graph. This is supported by the exact solutions in the complete graph and one-dimensional cases, and numerical simulations in the two-dimensional case. We show that our approximation in two dimensions for a regular lattice matches the exact stochastic simulations within a very good error margin. Finally, a discussion is presented in §7.
3. Death–birth and birth–death processes on a graph
Assume two species, A (normal, or wild-type) and B (mutant), with corresponding proliferation rates rB and rA and death rates dB and dA. A general DB process is defined as follows: at each time step, one cell at site i (either A or B) is randomly chosen to die with weight dA or dB. One of the neighbouring sites to i (denoted by j) is chosen at random, with weight rA or rB to proliferate, and probability wij for the offspring to be placed in site i (to replace the dead cell). For each site i, we set ni=1 if the resident cell is mutant, and ni=0 if the resident cell is wild-type. Thus, the distribution of mutant cells at sites i is ni and the distribution of normal cells is 1−ni. Given the vector n=(n1,…,nN), the transition probabilities can be written as
3.1 |
Here, (W−DB) stands for the probability that in the DB process, a new mutant (a new wild-type cell) appears at site i after one elementary update. Similarly, in a BD process the sequence of the two death and birth events is switched and can formally be obtained by switching r's and d's in equation (3.1), and also .
3.2 |
In the case of BD, indicates that a new mutant appears at any site j neighbouring site i. Note that in the case of a DB process, the death event is a global event and the individual is chosen for death among all the individuals on the graph with weight of dA or dB. The following birth event, however, takes places among only the individuals that are connected to the previously chosen individual, and thus constitutes a local event. Even though both of the events occur through random sampling with weighted biases di or ri, with i=A,B, the subset of random sampling is smaller for the second event unless the graph is a complete graph. Similarly, in a BD process, the global event is a birth event, while the death event takes place for the neighbours of the chosen individual on the graph and thus is a local event.
There are specific cases of the above processes that have been often discussed in the literature. The case of dA=dB=1 has been typically implemented as either a DB or BD process on a graph. As the reader can easily see, the opposite limit where rA=rB=1 while dA,B are arbitrary, also leads to equivalent models while the dynamics of the two models are reversed. In other words, a DB model with rA=rB=1 is equivalent to a BD model with dA=dB=1 and vice versa.
In the case of BD models with dA=dB, it has been argued that for a wide range of graph structures, known as isothermal graphs, where , the fixation probability of the model is the same as the mixed population one [5] (see also [3,4,7]). The main examples of isothermal graphs are regular lattices with periodic boundary conditions, and the introduction of boundaries or randomness in connectivities removes the isothermal property (for effect of boundaries see [6,17,18]).
4. Fixation probability for death–birth and birth–death processes on a complete graph
Let us consider the simplest process which is on a complete graph, where every two nodes i and j are connected, i.e. wij=1/N. Let us use the following convenient notation:
The Kolmogorov backward equation for the absorption probability πm, where m is the mutant population, is written as
4.1 |
which is valid for both BD and DB processes. Transition probabilities are defined as the probabilities to gain or lose one mutant in a system with m mutants. The general solution for the fixation probability starting from only one mutant can be found in closed form. Denoting
we obtain for the probability of fixation,
4.2 |
Note that the above result is true when the transition probabilities in such a one step process only depend on the number of mutants in the system at every time step, and not on other degrees of freedom of the system. This condition holds for the complete graph, and, as we will see later, for one-dimensional rings.
Next, we will consider some implementations of DB and BD processes on a complete graph. First, we will assume the update rules where the second event (death in the BD process and division in the DB process) occurs in a neighbourhood of a given cell, which includes the cell itself. That is, for example, if a cell is chosen for reproduction first, during the death event this (mother) cell will be in a pool of cells that have a probability to die. This is equivalent to having a graph on which every node is connected to itself by a loop. (Ohtsuki & Nowak [12] call this an ‘imitation’ updating in the context of game theory on graphs.)
Later in this section, we will include a process where the neighbourhood does not includes ‘self’ as a candidate for the second event to take place. The preference for either of the two updatings is somewhat arbitrary and depends on the particular nature of the modelling problem at hand.
4.1. The complete network including ‘self’
First, we will consider the process where the network of neighbours of a given cell includes the cell itself. To explain the update procedure in more detail, note that at every time step, we randomly label a cell for death (birth) and then label a cell for birth (death). We let the death and birth events happen after both labels have been assigned. This way, for the complete graph (mass-action) scenario, the number of ‘neighbours’ is always N, and we have the following transition probabilities:
4.3 |
Interestingly, these probabilities are the same for the DB and BD processes, the two are completely equivalent in this case. We therefore have
and the following well-known result for the fixation probability holds:
4.4 |
Next, we will study networks that do not include ‘self’. For example, in the BD process described below, after the initial birth event, the cell that has just divided is excluded from the death event. In the following section, for the DB process, the cell that has been chosen for death will not be participating in the subsequent reproduction event.
4.2. The birth–death process
For a BD process on a complete graph excluding ‘self’, the transition probabilities are written as
4.5 |
For d=1 the ratio of for any m; however, this is not in general true as upon choosing a mutant/normal cell to divide (birth event) the next death event among the rest of the N−1 cells will normalize differently in W− and in W+. In other words, when a mutant cell is chosen to divide (W+ contribution) the successive death event happens among the rest of the m−1 mutants (excluding the one already chosen to divide) and N−m existing normal cells. When a normal cell is chosen to divide (W− contribution), the successive death event occurs among m mutant and N−m−1 normal cells. In general, the ratio of is
4.6 |
For d=1, the ratio will be 1/r and substituting into equation (4.2) give rise to the well-known Moran result, equation (4.4),
4.7 |
For general values of d, however, a closed form for π1 can be obtained,
where the Lerch transcendent is defined as
To evaluate the large-N behaviour of the fixation probability for advantageous mutants, we note that the function Φ(d/r,1,(N+d−2)/(d−1)) decays as a power law as , and (d/r)N decays exponentially for d<r. Therefore, we can ignore the term multiplying (d/r)N. Further, we note the following asymptotic behaviour of the Lerch transcendent:
Substituting this expression with z=d/r and a=(N+d−2)/(d−1) into the equation for π1, and expanding further in Taylor series in 1/N, we obtain
4.8 |
The same expansion can also be obtained by a different method. If we expand the expression for , equation (4.6), in terms of small 1/N, we obtain
4.9 |
an expression that does not depend on m. This means that up to the order O(1/N) we can simply use the geometric progression formula and obtain the result presented in equation (4.8).
4.3. The death–birth process
Similarly, for a DB process on a complete graph, the transition probabilities are given by
4.10 |
and thus,
4.11 |
Comparing equations (4.6) and (4.11), one can see a duality between the two models which comes naturally from the definition of the models
4.12 |
This results in an interesting connection between the DB and BD results for fixation probability.
Also, the fixation probability is obtained by
4.13 |
For r=1 this reduces to equation (4.4),
4.14 |
The expansion of equation (4.13) is
4.15 |
Again, the same result can be obtained by first expanding the expression for , equation (4.11), in terms of 1/N, and then performing the summation of a geometric series.
4.4. Conclusions for the complete graph scenario
— In the case where ‘self’ is a part of the neighbourhood graph, the BD and DB processes are identical, and we obtain the exact formula for the probability of fixation, equation (4.4).
— If ‘self’ is not included, then the BD and DB processes are different from each other. The difference is of the order of 1/N.
— If d=1 for the BD process, then the probability of fixation is given by expression (4.4). Similarly, if r=1 in the DB process, equation (4.4) holds. These results can be interpreted as the isothermal theorem for the mass action scenario.
— For large values of N, the probabilities of fixation can be approximated by expressions (4.9) and (4.15) for the BD and DB processes, respectively.
5. Exact results for fixation probability in one dimension
In this section, we focus on the solutions of the DB and BD models on a circle with arbitrary birth and death rates r and d for the mutant cells. Similar but more restricted cases have been discussed in the literature. Several papers [7,14,24] considered a representation of the model which is a weak-selection limit of the model we discussed in the previous section and showed that the result agrees with the isothermal theorem. Komarova [17] has approached the problem more directly by solving a backward Kolmogorov equation with periodic boundary conditions. We will consider a similar implementation to Komarova and suggest an alternative and more intuitive method to calculate the fixation probability that can be extended to higher dimensions and different connectivities.
One dimension is a particular case for which the mutant clone keeps a constant number of normal (or mutant) neighbours. Moreover, the DB events which lead to an increase or decrease of the mutant population only occur at the two ends of the boundary between mutant and normal clones. On the boundary, at any time, the number of mutant neighbours and normal neighbours remain the same. The sequence of events is depicted in figure 1. There are two exceptions to this condition: when there is one mutant cell and N−1 normal cells in the system, or N−1 mutant cells and 1 normal cell, in which the mutant (normal) cell has two normal (mutant), adjacent neighbouring cells (figure 2). This is not true in higher dimensions. In higher dimensions, the clonal front geometry and even the topology of a mutant clone can fluctuate.
In the following subsections, we will consider the DB and BD processes where the neighbourhoods do not include ‘self’. The case where ‘self’ is included is considered in appendix A.
5.1. The death–birth model
For the one-dimensional DB model, it turns out that the condition holds true for 1<m<N−1, since in this case the transition probabilities W± can be rewritten as
5.1 |
The ratio of transition probabilities is different for m=1, i.e. where there is only one mutant in the population, and for m=N−1, where only one normal cell is left in the population. This is due to the fact that the condition of having the same number of mutant or normal cell neighbours on the boundary is not correct in the latter two cases. A single mutant cell in the beginning has no neighbouring mutant cells, and the last remaining normal cell before a full takeover does not have any normal neighbours left. Therefore, we have
5.2 |
Substituting these values into equation (4.2) gives
5.3 |
In the case where d=1, we obtain
In the limit and r>1, this reduces to
a result obtained by Komarova [17]. For r=1, equation (5.3) gives
which coincides with equation (4.4) with r=1. Equation (5.3) can be also obtained using a generating function method (appendix C).
5.2. The birth–death process
Owing to duality between the formulation of a DB process and its corresponding BD process (see equations (3.1) and (3.2)) the same calculation can be repeated for a BD process by switching death and birth rates ( and ). The transition probabilities for the corresponding BD process are
5.4 |
Substituting these values into equation (4.2) gives
5.5 |
In the limit where d=1, the fixation probability above takes the well-known form for a Moran process
5.6 |
see equation (4.4) with d=1.
5.3. Comparison of one-dimensional death–birth and birth–death processes
Below we analyse the fixation probabilities for the one-dimensional DB and BD processes obtained in this section, see equations (5.3) and (5.5).
5.3.1. Comparison between the one-dimensional spatial processes and the non-spatial Moran process
We can compare the DB and DB processes with the non-spatial Moran process for general values of r and d. The results are as follows:
— If d>1, the BD process has a higher probability of fixation than the Moran process; if d<1, then it has a lower probability of fixation (figure 3a).
— If r>1, the DB process has a lower probability of fixation than the Moran process; if r<1, then it has a higher probability of fixation (figure 3b).
In figure 3, we plot the ratio of the probability of fixation in the spatial process (BD in (a) and DB in (b)) and the non-spatial Moran process. The set of values that satisfy the isothermal theorem separates the regions where the spatial process yields a higher and a lower probability of fixation, compared with the Moran process.
To prove the results above, we consider the cases d<r and r<d separately, and take the limit . For the case of the BD process, the expression πBD−1D/πMoran simplifies to
in the two cases. Both expressions are greater than 1 if d>1, and smaller than one otherwise.
Similarly, for the DB process, in the cases where d<r and r<d, the ratio πDB−1D/πMoran simplifies to
Both expressions are greater than one if r<1, and they are smaller than one otherwise.
The isothermal theorem can be considered a ‘borderline’ case, see the dashed lines in figure 3. This can be summarized by the following statements:
— The BD process satisfies the isothermal theorem in the particular case where d=1.
— The DB process satisfies the isothermal theorem if r=1.
5.3.2. Comparing the birth–death and death–birth processes to each other
For the same values of d and r, the DB and BD processes yield different probabilities of fixation. In the special case where d=1, the BD process has a higher fixation probability than the DB process iff r>1. That is, in the BD process, advantageous mutants have a higher probability of fixation, and disadvantageous mutants have a lower probability of fixation.
If r>d and , the probabilities of fixation have a simpler form:
In this limit, the two processes have the same probability of fixation if
In general, there is a certain threshold value, rc, such that for r>rc (r<rc), the BD process (the DB process) has a higher probability of fixation. This can be interpreted as follows: for mutants that are sufficiently advantageous, the BD process is more successful, and for less advantageous mutants, the DB process is more successful. This is illustrated in figure 4a, where we plot the ratio πBD−1D/πDB−1D as a function of the variables d and r. The contours correspond to equal values of this quantity, and lighter colours mark higher values. Above the line r=rc, the probability of fixation is larger for the BD process.
Another interesting limit is for large-N and large-r. Even in the simple case of d=1, while the BD process leads to , the DB result is . The fact that in a DB process the fixation probability of an arbitrarily advantageous mutant never approaches unity might sound surprising, but in fact is very intuitive. In a DB updating scheme, no matter how high the chances are for a single advantageous mutant to proliferate, the chance of extinction is always contributed by the early death events. In the case of a one-dimensional cycle, there is a 1/N chance for the mutant to be picked and replaced by one of its neighbours in the first time step, while there is 2/N chance for the mutant's neighbours to be chosen to die and be replaced by a mutant offspring. The ratio of the total number of events that the population changes to the ones that the mutant survives is , which is exactly the fixation probability for limit.
5.3.3. Neutrality of the mutants
The spatial processes require a different definition of neutrality for the mutant. In the non-spatial Moran process, neutral mutants satisfy r/d=1, and the probability of fixation of such mutants is 1/N. For one-dimensional spatial models, the sets of neutrality in the space (d,r) are presented in figure 4b. The red line corresponds to the DB process, the blue line to the BD process and the black line to the non-spatial Moran model. These lines become very close to the r/d=1 line as N increases.
6. Approximate results for fixation probability in two dimensions
In the following, we apply some of the understanding gained from the previous analysis on DB models and generalize it to find an approximate analytical result in higher dimensions. The one-dimensional case was rather special due to the following properties:
— The number of mutant/normal neighbours at every time during the evolution of the clone remains constant on the two fronts of the mutant clone. The only two exceptions are when there is only one mutant in the system (N−1 normal cell) or one normal (N−1 mutant).
— Owing to the above property, the ratio of transition probabilities for any clone size remains the same as for the mixed population Moran model other than the two exception of n=1 and n=N−1. Including these two new transition probabilities into the solutions of the Kolmogorov equation leads to an exact result for the fixation probability of the one-dimensional model.
— The topology of the mutant clone does not change with time. If we begin with a single mutant the domain of the mutant clone always remains a simply connected region.
In higher dimensions, none of the above properties are correct in a strict mathematical sense. The transition probabilities in two or higher dimensions are not only functions of the clone size but of the geometry of the clonal front. Also there are elementary events that can lead to splitting of a clone into two and thus the topology of a clone might change with time. As in the one-dimensional case, we assume periodic boundary conditions and without loss of generality we consider a regular square lattice with degree of connectivity k. The sequence of events for a DB process on a square lattice is depicted in figures 5 and 6.
The ratio of transition probabilities in higher dimensions for loss or gain of a mutant cell differs for large clone sizes and small clone sizes. Here, we assume that the dominant contribution comes from m=1 (in one dimension, m=1 was the only different term), and use the approximation for m≥2 (see appendix B). We have
6.1 |
Thus, we obtain,
6.2 |
and upon substitution from equation (6.1) we end up with an algebraic expression for , for large N,
6.3 |
For d=1 and k=2, this reduces to 2(r−1)/(3r−1). For large k, we obtain πDB−2D1≈1−d/r. Equation (6.3) can be compared with the result of the stochastic simulations result on a square lattice (k=4, d=1) as shown in figure 7.
We can even test the validity of this approximation for two-dimensional regular graphs for smaller lattice sizes. To do so, we can use the finite-N contribution from equation (6.2). In figure 8, we plotted the result for square lattices (k=4) with N=3×3 and N=5×5 and N=20×20. The match is good for closer to neutral limit cases while there is slight deviation from the analytical prediction as fitness increases away from the neutral limit.
We can also further test validity of equations (6.2) and (6.3) by comparing the results for fixation probability when one begins with two mutants, i.e. the transition probability γ1 which is claimed to be the main cause of deviation from isothermal behaviour in the DB case does not have any effect and we do expect the fixation probability to be close to a mixed population formula with the two-mutant initial condition. Note that γ1 is not the only cause of deviation from the isothermal result as other transition probabilities γi are only approximately l/r. This is in fact the case for the results of one- and two-mutant fixation probabilities which are depicted for a square lattice with N=20×20 and d=1 in figure 9.
Recalling the Moran fixation probability with the two-mutant initial condition π2
6.4 |
The exact result can be obtained (in either one-dimensional circle or two-dimensional regular lattices) by using the recursive relation
6.5 |
which is obtained from solutions of the Kolmogorov equation. This leads to the following results for π2 in one- and two-dimensional cases in the large-N limit,
6.6 |
The above approximation fits large-N simulation results well as shown in figure 9. Since equations (6.6) are obtained using a mixed population form of the Kolmogorov equation, the fits with the simulations further support our assumptions in deriving the formula for the two-dimensional DB fixation probability, given by equation (6.2).
In the case of a BD updating, while the special case of d=1 leads to the isothermal theorem for regular graphs, the fixation probability for arbitrary values of r and d might not follow isothermal behaviour analogous to the case discussed earlier. Similar to the two-dimensional DB case we obtain
6.7 |
This gives, for large N,
6.8 |
For d=1, equation (6.8) reduces to 1−1/r (independent of k). For large k, we have πBD−2D1≈1−d/r. Setting k=2, this reduces to the one-dimensional case.
7. Discussion
In this work, we discussed generalized versions of DB and BD updating models for evolutionary dynamics on graphs and spatial structures. In contrast to most previous approaches, we assume that the mutants can differ from the wild-type not only by their birth rate (r), but also by their death rate (d), giving rise to a two-parameter model where r and d are independent arbitrary parameters affecting the selection process. This is in fact more realistic, as in many scenarios either death rate or birth rate or both can vary and affect the selection dynamics in tissues in situations involving invasion mechanisms such as cancer. Focusing on regular lattices with periodic boundary conditions, we show that the models for both DB and BD updating are exactly solvable in a one-dimensional circle.
We further studied to what extent the isothermal theorem can be generalized. This theorem states that the selection dynamics are the same on any isothermal graph as they are for a mixed population/complete graph. This theorem was proved by Lieberman et al. [5] to hold for the d=1 BD update, and here we show that it also holds for the r=1 DB update. We further demonstrated that the more general, two-parameter models deviate from this theorem. The BD and DB systems exhibit fixation probabilities that are different from each other and from the canonical mass-action Moran result.
While for the case of the complete graph the difference is vanishingly small for large graphs, it remains finite for one- and two-dimensional spatial structures. In general, we conjecture that the difference between the two models has the order of the inverse of the degree of connectivity of the graph. For example, the connectivity of the complete graphs (the mass-action system) is N, and thus the difference scales with 1/N. The connectivity of regular spatial lattices is given by the number of neighbours of each node. In the one-dimensional ring, the number of neighbours is 2, and in typical two-dimensional lattices, it is 4 or 8. Thus, the difference in the fixation probability between the BD and DB models is the largest for the one-dimensional ‘nearest-neighbour’ ring, it is slightly smaller in the case of the von Neumann (4-cell) neighbourhood in two dimensions, and still smaller in the case of the Moore (8-cells) neighbourhood. It decays with the number of neighbours.
The reason for the deviation from the isothermal theorem is the different transition probabilities for the case when there is only one mutant in the system, compared to the rest of the transition probabilities. When the quantity of interest is the fixation probability starting from more than one mutant cells, then the difference between DB and BD models (and the deviation from the isothermal theorem) is smaller, compared with the case when we start with one mutant.
Depending on the parameters, the spatial DB and DB processes could be characterized by a smaller or larger mutant fixation probability compared with the conventional non-spatial Moran result. In particular, for the BD process, the fixation probability is higher than the Moran value as long as d>1. For the DB process, the fixation probability is higher than the Moran value as long as r<1.
The generalized two-parametric BD and DB models can be applied to investigate the evolutionary dynamics of tissue turnover. We would like to emphasize the importance of considering both birth and death rates of mutants (compared to those of the surrounding cells) in terms of the conceptual construct of the hallmarks of cancer [34]. Three of them are the most relevant for our study. They are listed below and put in our context by linking them with the cells' birth and death rates [35–37]:
1. Self-sufficiency in growth signals. While normal cells cannot proliferate in the absence of stimulatory signals, cancer cells can do this with the help of oncogenes, which mimic normal growth signalling. This can be achieved by means of different mechanisms. For example, cells can acquire the ability to synthesize their own growth factors, e.g. the production of PDGF (platelet-derived growth factor) and TGF-α (tumour growth factor α) by glioblastomas and sarcomas. Furthermore, cell surface receptors that transduce growth-stimulatory signals into the cell, for example, EGFR and HER2/neu, may be overexpressed or structurally altered, leading to ligand-independent signalling. Finally, downstream targets of the signalling pathway can be altered, e.g. the Ras oncogene, which is found mutated in about 25% of human tumours. In all these cases, the mutant cells are characterized by an increased birth rate compared with the surrounding cells.
2. Insensitivity to antigrowth signals. Antigrowth signals can block proliferation by (i) forcing cells out of the active proliferative cycle into the quiescent (G0) state, until appropriate growth signals put them back into the cell cycle or (ii) inducing differentiation, which permanently removes their proliferative potential. Cancer cells evade these antiproliferative signals, by e.g. loss of TGF-β, loss of Smad4, or loss of CDK inhibitors such as p16, p21 or p53. The corresponding cells again are characterized by an increased birth rate compared with the surrounding cells.
3. Evading apoptosis. The ability of tumour cell populations to expand in number is determined not only by the rate of cell proliferation but also by the rate of cell attrition. Programmed cell death (apoptosis) represents a major source of this attrition. Resistance to apoptosis can be acquired by cancer cells by e.g. loss of p53 (which normally activates pro-apoptotic proteins and represents the most common loss of a pro-apoptotic regulator), or by activation or upregulation of anti-apoptotic Bcl2. In these cases, the mutants are characterized by a decreased death rate compared with the surrounding cells.
Other applications are the cases when selection dynamics are affected by the introduction of a drug which increases the mutant cell death while the birth rate is determined by the cell division rate and is independent of the drug concentration. This can be applied to problems in both cancer and infectious diseases, where spatial structures affect selection dynamics.
Another interesting application is the stem cell dynamics in the case of the intestinal crypt. Recently, Vermuelen et al. [38] investigated the dynamics of niche success in the intestinal crypt base by inducing different types of mutations, including APC, p53 and Kras, and were able to measure the fraction of mutant stem cell clones at various time points for a wide number of crypts (in mice). The authors fitted the results to a simple BD model on a one-dimensional ring. They used Bayesian inference to infer model parameters such as proliferation rate r and total niche size N. It has been observed that Kras oncogenic mutation infers a relatively high selection advantage in a newly introduced mutant to the stem cell niche while APC−/+ is weakly disadvantageous and APC−/− mutation in a background of APC−/+ mutants is weakly advantageous. Similarly, it has been reported that p53 mutations in a normal intestinal base infer a very small selection advantage while in the inflamed gut the advantageous p53 has the higher chance of succeeding in the niche.
As discussed above, to compare with the experimental data, the birth and death rates of normal and mutant stem cells should be taken into account independently, particularly when both mechanisms are contributing to the selection dynamics at the same time. In the case of intestinal crypt stem cells, aside from the fact that different mutations can confer different death and birth rates (or combination of both), other mechanisms such as symmetric differentiation, and cell cycle and quiescent states can act as additional effective mechanisms for a death event in such an evolutionary model. We have used the reported fixation probability to estimate the possible set of death and birth rates. We also applied both DB and BD processes to see whether there is any significant difference between the two models. The results are depicted in figure 10a,b.
In figure 10a, we have plotted the lines indicating possible sets of birth rate and death rate for three mutants, Kras, APC−/+ and APC−/−. Dashed lines indicate the values for death rates d=1 and various birth rates r reported in Vermeulen et al. [38]. Similar results have been depicted for the case of a DB process where the death event occurs first. In the case of relatively advantageous mutations, such as Kras, the d=1 case leads to an unusual high division rate. In fact, higher divisor rates also point to much higher birth rates due to negative curvature of the (r,d) graphs. This is basically a special case of the duality reported in the previous sections. Our finding also supports the belief that the stem cell dynamics inside a crypt niche is dominated by birth (division) events, followed by death events due to geometrical constraints in the systems. Such death events some times are referred to as a ‘retraction’ in the biological context [39].
Acknowledgements
We would like to thank Arne Traulsen for fruitful discussions.
Appendix A. One-dimensional processes where ‘self’ is included in the neighbourhood network
Let us consider a one-dimensional, nearest-neighbour process, where the cell itself is considered to be one of its own neighbours. Therefore, instead of two neighbours, each cell has three neighbours. Performing calculations similar to those of §5, we obtain the following results. Note that although qualitatively the fixation probabilities behave similar to those of §5, the numerical values differ significantly in the two processes. Thus, whether or not we include ‘self’ in the neighbourhood will significantly change the resulting fixation probabilities, and the change does not disappear in the large N case, like it did in the mass-action scenario.
A.1. The birth–death process
We have the following expression for transition rate ratios:
A 1 |
Note that if d=1, we have for all m. Using equation (4.2), the probability of fixation can be easily calculated. Because the expression is rather cumbersome, here we only present the approximation for the case when, simultaneously, r>d, r>d(1+2d)/(2+d), and :
The isothermal theorem (for the general N) is satisfied for d=1.
A.2. The death–birth process
In this case, the transition rate ratios become
A 2 |
If r=1, we have for all m. Using equation (4.2), the probability of fixation can be calculated; again, the expression is cumbersome. Here we only present the approximation for the case when, simultaneously, r>d, d<r(1+2r)/(r+2), and :
The isothermal theorem is satisfied for r=1.
Appendix B. Two-dimensional graph transition probability
In this section, we briefly discuss the ratio of transition probabilities for both DB and BD models when the mutant population is large. For simplicity, we assume dA=dB=1, rA=1 and rB=r. Using equations (3.2), the ratio of transition probabilities are given by
B 1 |
For isothermal graphs the sum over indices i and j can be switched and the ratio becomes 1/r for any configuration. On the other hand, this is not quite true for the DB process. The ratio of transition probabilities using equations (3.1) are
B 2 |
where is the number of neighbours for each site. Note that the denominator and numerator do not simplify as the terms in the denominator now depend on i as well. However, for large mutant populations, we can approximate and make it independent of the index i. In this case, one can simplify the ratio and arrive at the result 1/r. This is, however, incorrect for smaller populations, as discussed in §6. The main contribution comes from the m=1 population. For m=1,2 (m is the mutant population), we have
B 3 |
Similar calculations for m=3 gives .
Appendix C. Generating function formalism
C.1. Mixed population in weak selection
In the following, we repeat the alternative derivation of the fixation probability for a non-spatial Moran model from Houchmandzadeh & Vallade [40]. Beginning with the master equation for the Moran process in the weak-selection limit
C 1 |
where p(n;t) is the probability of having n mutants at time t with a given initial condition. The transition rates W±(n) are given by
C 2 |
where the transition probabilities at the absorbing states are taken to be zero, W±(n=N)=W±(n=0)=0. Houchmandzadeh & Vallade [40] considered the special case of the above model where d=1, r−1≪1. This way the denominator in transition probabilities W±(n) can be approximated by N2. The probability generating function F(z,t):
C 3 |
obeys the following equation (d=1):
C 4 |
Note that equation (C 4) is derived using the identity
C 5 |
Boundary and initial conditions for the PDE in equation (C 4) are
C 6 |
where n0 is the number of mutant cells at t=0. The steady-state solution for F(z,t) is
C 7 |
where coefficients A and B are extinction and fixation probabilities. Applying the boundary and initial conditions and noticing that z*=1/r is a fixed point of equation (C 4), we can solve for the coefficient B to obtain
C 8 |
The trivial fixed point z*=1 leads to the absorption probability being unity. This corresponds to the initial condition of beginning with N initial mutants. Note that, in general, we do not need to find a fixed point of the PDE for the generating function but rather a point z* (or set of points) for which the right-hand side of equation (C 4) is zero.
C.2. Evolutionary graph models in weak selection
The above method can be generalized to derive the fixation probability of the DB (BD) model on a graph. This method has been developed by Houchmanzadeh and Vallade in the weak selection limit of BD and DB processes [7,41]. We will generalize their method to account for exact solutions for arbitrary values of r and d in one dimension.
Consider a DB model with transition probabilities
C 9 |
and master equation corresponding to the above transition probabilities is
C 10 |
where p(ni±1;t)≡p(n1,…,ni±1,…,nN). Introducing the probability generating function F({zi};t):
C 11 |
and using the master equation (C 10), an equation for the generating function can be obtained (see [7] and also previous section),
C 12 |
where operators and , are inverse of and , given by
C 13 |
Similar to the mixed population case, boundary and initial conditions for the spatial case are
C 14 |
Here, is the number of mutant cells at each site i at t=0. The system has only two absorbing state corresponding to fixation or extinction of the mutants introduced to the system indicating the following stationary form of the generating function (see [7] for detailed discussion):
C 15 |
where A and B are constants to be determined from the boundary and initial conditions, respectively. The fixed points of equation (C 12) indicated by determine the fixation probability [7]
C 16 |
Given the initial condition and assuming that , and , the fixation probability simplifies to:
C 17 |
To find z*'s in this limit, we put the terms in front of first derivative and second derivatives (∂/∂zi) terms equal to zero, separately. In the limit of d=1 and r≪1 both these operators are proportional to unity and can be dropped from the rest of the calculations in the same manner as in the previous section for mixed population. The first-order derivative term gives rise to a nonlinear relationship between zi's,
C 18 |
where the second-order terms cancel out for . It is straightforward to check that equation (C 18) is satisfied for zi=d/r in an isothermal graph. In the next part, we discuss the one-dimensional limit that also give rise to exact solutions for equation (C 12).
C.3. One-dimensional solutions
In the case of a one-dimensional circle, the operator Nr,i takes a simple form assuming that we begin with a single mutant at site i=1 at t=0 and additionally assuming that the last normal cell to be replaced by a mutant was at some site indexed by i=K. This leads to the following form for Nr,i:
C 19 |
This significantly simplifies equation (C 12) and solutions for that makes the RHS of equation (C 12) zero can be obtained (in a similar manner equation (C 18) was derived). Assuming , the equation for and can be written in terms of all other fixed points, while ,
C 20 |
which can be further simplified to
C 21 |
leading to,
C 22 |
Substituting the above values of fixed points into equation (C 17),
C 23 |
which is exactly the results for the one-dimensional DB model obtained in §4. An exactly similar calculation can be repeated to obtain the one-dimensional BD fixation probability as well.
Similarly, it can be argued that for a square lattice, in the large-N limit, equation (C 20) leads to (by including appropriate Nr for two-dimensional case, and for d=1)
C 24 |
leading to the result for the fixation probability given by equation (6.3), with k=4,
C 25 |
Funding statement
M.K. is supported by the Natural Sciences and Engineering Research Council of Canada (NSERC, discovery grants) as well as an NSERC/CIHR Collaborative Health Research grant.
Author contributions
All authors contributed to the design and the analysis of the study, as well as the draft of the manuscript, and gave final approval for publication.
Conflict of interests
There are no competing interests.
References
- 1.Kimura M. 1995. Population genetics, molecular evolution, and the neutral theory: selected papers, 1st edn Chicago, IL: University of Chicago Press. [Google Scholar]
- 2.Kimura M, Weiss G. 1964. The stepping stone model of population structure and the decrease of genetic correlation with distance. Genetics 49, 561–576. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Maruyama T. 1974. A Markov process of gene frequency change in a geographically structured population. Genetics 76, 367–377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Maruyama T. 1974. A simple proof that certain quantities are independent of the geographical structure of population. Theor. Popul. Biol. 5, 148–154. (doi:10.1016/0040-5809(74)90037-9) [DOI] [PubMed] [Google Scholar]
- 5.Lieberman E, Hauert C, Nowak M. 2005. Evolutionary dynamics on graphs. Nature 433, 312–316. (doi:10.1038/nature03204) [DOI] [PubMed] [Google Scholar]
- 6.Broom M, Rychtar J. 2008. An analysis of the fixation probability of a mutant on special classes of non-directed graphs. Proc. R. Soc. A 464, 2609–2627. (doi:10.1098/rspa.2008.0058) [Google Scholar]
- 7.Houchmandzadeh B, Vallade M. 2011. The fixation probability of a beneficial mutation in a geographically structured population. New J. Phys. 13, 073020 (doi:10.1088/1367-2630/13/7/073020) [Google Scholar]
- 8.Masuda N, Ohtsuki H. 2009. Evolutionary dynamics and fixation probabilities in directed networks. New J. Phys. 11, 033012 (doi:10.1088/1367-2630/11/3/033012) [Google Scholar]
- 9.Szabo G, Fath G. 2007. Evolutionary games on graphs. Phys. Rep. 4, 97–216. (doi:10.1016/j.physrep.2007.04.004) [Google Scholar]
- 10.Allen B, Nowak M. 2014. Games on graphs. EMS Surveys Math. Sci. 1, 113–151. (doi:10.4171/EMSS/3) [Google Scholar]
- 11.Wes M, Fu F, Hauert C. 2014. Evolutionary game dynamics in populations with heterogenous structures. PLoS Comput. Biol. 10, e1003567 (doi:10.1371/journal.pcbi.1003567) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Ohtsuki H, Hauert H, Lieberman E, Nowak M. 2006. A simple rule for the evolution of cooperation on graphs and social networks. Nature 411, 502–505. (doi:10.1038/nature04605) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ohtsuki H, Nowak M. 2006. The replicator equation on graphs. J. Theor. Biol. 243, 86–97. (doi:10.1016/j.jtbi.2006.06.004) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Antal A, Redner S, Sood V. 2006. Evolutionary dynamics on degree-heterogeneous graphs. Phys. Rev. Lett. 96, 188104 (doi:10.1103/PhysRevLett.96.188104) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Keeling M. 1999. The effects of local spatial structure on epidemiological invasions. Proc. R. Soc. Lond. B 266, 859–867. (doi:10.1098/rspb.1999.0716) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Britton T, House T, Lloyd A, Mollison D, Riley S, Trapman P. 2015. Five challenges for stochastic epidemic models involving global transmission. Epidemics 10, 54–57. (doi:10.1016/j.epidem.2014.05.002) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Komarova N. 2006. Spatial stochastic models for cancer initiation and progression. Bull. Math. Biol. 68, 1573–1599. (doi:10.1007/s11538-005-9046-8) [DOI] [PubMed] [Google Scholar]
- 18.Manem V, Kohandel M, Komarova N, Sivaloganathan S. 2014. Spatial invasion dynamics on random and unstructured meshes: Implications for heterogeneous tumor populations. J. Theor. Biol. 349, 66–73. (doi:10.1016/j.jtbi.2014.01.009) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Durrett R, Foo J, Leder K. Submitted Spatial Moran models II. Tumor growth and progression.
- 20.Korolev K, Nelson D. 2011. Genetic demixing and evolution in linear stepping stone models. Phys. Rev. Lett. 107, 088103 (doi:10.1103/PhysRevLett.107.088103) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Korolev K, Avlund M, Hallatschek O, Nelson D. 2010. Genetic demixing and evolution in linear stepping stone models. Rev. Mod. Phys. 82, 1691–1718. (doi:10.1103/RevModPhys.82.1691) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Manem V, Kaveh K, Kohandel M, Sivaloganathan S. Submitted The effect of heterogeneous tumour microenvironment on invasion dynamics: an evolutionary framework on lattices.
- 23.Shakarian P, Roos P, Johnson A. 2012. A review of evolutionary graph theory with applications to game theory. Biosystems 107, 66–80. (doi:10.1016/j.biosystems.2011.09.006) [DOI] [PubMed] [Google Scholar]
- 24.Sood V, Antal T, Redner S. 2008. Voter models on heterogeneous networks. Phys. Rev. E. 77, 041121 (doi:10.1103/PhysRevE.77.041121) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Nowak M. 2006. Evolutionary dynamics exploring the equations of life. 1st edn Cambridge, MA: Belknap Press. [Google Scholar]
- 26.Pacheco J, Traulsen A, Nowak M. 2006. Coevolution of strategy and structure in complex networks with dynamical linking. Phys. Rev. Lett. 97, e258103 (doi:10.1103/PhysRevLett.97.258103) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Pacheco J, Traulsen A, Nowak M. 2006. Active linking in evolutionary games. J. Theor. Biol. 437, 437–443. (doi:10.1016/j.jtbi.2006.06.027) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Wu B, Zhou D, Fu F, Luo Q, Wang L, Traulsen A. 2010. Evolution of cooperation on stochastic dynamical networks. PLoS ONE 5, e11187 (doi:10.1371/journal.pone.0011187) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.van Baalen M, Rand D. 1998. The unit of selection in viscous populations and the evolution of altruism. J. Theor. Biol. 193, 631–648. (doi:10.1006/jtbi.1998.0730) [DOI] [PubMed] [Google Scholar]
- 30.Thalhauser C, Lowengrub J, Stupack D, Komarova N. 2010. Selection in spatial stochastic models of cancer: migration as a key modulator of fitness. Biol. Direct. 5, 1–17. (doi:10.1186/1745-6150-5-1) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Fu F, Wang L, Nowak M, Hauert C. 2009. Evolutionary dynamics on graphs: efficient method for weak selection. Phys. Rev. E 79, e046707. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Ohtsuki H, Nowak M. 2006. Evolutionary games on cycles. Proc. R. Soc. B 273, 2249–2256. (doi:10.1098/rspb.2006.3576) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Zukewich J, Kurella V, Doebeli M, Hauert C. 2013. Consolidating birth–death and death–birth processes in structured populations. PLoS ONE 8, e54639 (doi:10.1371/journal.pone.0054639) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Hanahan D, Weinberg R. 2000. The hallmarks of cancer. J. Theor. Biol. 100, 57–70. (doi:10.1016/S0092-8674(00)81683-9) [DOI] [PubMed] [Google Scholar]
- 35.Vogelstein B, Kenneth W. 1998. The genetic basis of human cancer. New York, NY: McGraw-Hill, Health Professions Division. [Google Scholar]
- 36.Vogelstein B, Kinzler K. 2004. Cancer genes and the pathways they control. Nature Med. 10, 789–799. (doi:10.1038/nm1087) [DOI] [PubMed] [Google Scholar]
- 37.Mendelsohn J, Howley P, Israel M, Gray J. 2008. The molecular basis of cancer: expert consult. Amsterdam, The Netherlands: Elsevier Health Sciences. [Google Scholar]
- 38.Vermeulen L, Morrissey E, van der Heijden M, Nicholson A, Sottoriva A, Buczacki S, Kemp R, Tavare S, Winton D. 2013. Defining stem cell dynamics in models of intestinal tumor initiation. Science 342, 995–998. (doi:10.1126/science.1243148) [DOI] [PubMed] [Google Scholar]
- 39.Vermeulen L, Snippert H. 2014. Defining stem cell dynamics in models of intestinal tumor initiation. Nat. Rev. Cancer 14, 468–480. (doi:10.1038/nrc3744) [DOI] [PubMed] [Google Scholar]
- 40.Houchmandzadeh B, Vallade M. 2010. Alternative to the diffusion equation in population genetics. Phys. Rev. E 82, 051913 (doi:10.1103/PhysRevE.82.051913) [DOI] [PubMed] [Google Scholar]
- 41.Houchmandzadeh B, Vallade M. 2013. Exact results for fixation probability of bithermal evolutionary graphs. Biosystems 112, 49–54. (doi:10.1016/j.biosystems.2013.03.020) [DOI] [PubMed] [Google Scholar]