Abstract
Deterministically growing (wild-type) populations which seed stochastically developing mutant clones have found an expanding number of applications from microbial populations to cancer. The special case of exponential wild-type population growth, usually termed the Luria–Delbrück or Lea–Coulson model, is often assumed but seldom realistic. In this article, we generalise this model to different types of wild-type population growth, with mutants evolving as a birth–death branching process. Our focus is on the size distribution of clones—that is the number of progeny of a founder mutant—which can be mapped to the total number of mutants. Exact expressions are derived for exponential, power-law and logistic population growth. Additionally, for a large class of population growth, we prove that the long-time limit of the clone size distribution has a general two-parameter form, whose tail decays as a power-law. Considering metastases in cancer as the mutant clones, upon analysing a data-set of their size distribution, we indeed find that a power-law tail is more likely than an exponential one.
Keywords: Luria–Delbrück, Branching process, Clone size, Cancer
Introduction
Cancerous tumours spawning metastases, bacterial colonies developing antibiotic resistance or pathogens kickstarting the immune system are examples in which events in a primary population initiate a distinct, secondary population. Regardless of the scenario under consideration, the number of individuals in the secondary population, and how they are clustered into colonies, or clones, is of paramount importance. An approach which has offered insight has been to bundle the complexities of the initiation process into a mutation rate and assume that the primary, or wild-type, population seeding the secondary, or mutant, population is a random event.
This method was pioneered by microbiologist Salvador Luria and theoretical physicist Max Delbrück (Luria and Delbrück 1943). In their Nobel prize winning work, they considered an exponentially growing, virus susceptible, bacterial population. Upon reproduction, with small probability, a virus resistant mutant may arise and initiate a mutant clone. This model was contrasted with each wild-type individual developing resistance upon exposure to the virus with a constant probability per individual. By considering the variance in the total number of mutants in each case, they demonstrated that bacterial evolution developed spontaneously as opposed to adaptively in response to the environment.
In the original model of Luria and Delbrück, both wild-type and mutant populations grow deterministically, with mutant initiation events being the sole source of randomness. Lea and Coulson (1949) generalised this process by introducing stochastic mutant growth in the form of the pure birth process and were able to derive the distribution of the number of mutants for neutral mutations. This was again extended by Bartlett (1955) and later Kendall (1960), who considered both populations developing according to a birth process. An accessible review discussing these formulations is given by Zheng (1999).
Recent developments have focused on cancer modelling, where usually mutant cell death is included in the models. The main quantity of interest in these studies has been the total number of mutant cells. Explicit and approximate solutions appeared for deterministic, exponential wild-type growth, corresponding to a fixed size wild-type population (Angerer 2001; Dewanji et al. 2005; Iwasa et al. 2006; Komarova et al. 2007; Keller and Antal 2015), and fully stochastic wild-type growth either at fixed time or fixed size (Durrett and Moseley 2010; Antal and Krapivsky 2011; Kessler and Levine 2015). An exciting recent application has been to model emergence of resistance to cancer treatments (Kessler et al. 2014; Bozic et al. 2013; Bozic and Nowak 2014). The current study continues in this vein with our inspiration being primary tumours (wild-type) seeding metastases (mutant clones).
Interestingly, in the large time small mutation rate limit, the clone size distribution at a fixed wild-type population size coincides for stochastic and deterministic exponential wild-type growth (Kessler and Levine 2015; Keller and Antal 2015). The intuition behind this observation is that a supercritical birth–death branching process converges to exponential growth in the large time limit, and, for a small mutation rate, mutant clones are initiated at large times. So asymptotically the two methods are equivalent, but the deterministic description of the wild-type population has twofold advantages: (i) the calculations are much simpler in this case (Keller and Antal 2015), and (ii) the method can be easily generalised to arbitrary growth functions. This is the programme that we develop in the present paper.
The present work differs from previous approaches in two ways. Firstly, motivated by populations with environmental restrictions, we move away from the assumption of exponential wild-type growth, a setting which has received limited previous consideration as discussed in Foo and Michor (2014). We shall first review and extend results for the exponential case and then provide explicit solutions for power-law and logistic growth. Next, we present some general results which are valid for a large class of growth functions. This extends the classic results found in Kendall (1948), Athreya and Ney (2004), Karlin and Taylor (1981), Tavare (1987) and recent work in Tomasetti (2012), Houchmandzadeh (2015) who considered the wild-type population growth rate to be time-dependent but coupled with the mutant growth rate. Secondly, rather than the total number of mutants, our primary interest is on the distribution of mutant number in the clones initiated by mutation events. This complements Hanin et al. (2006), which allowed deterministic wild-type and mutant growth, and the treatment of clone sizes for constant wild-type populations found in Dewanji et al. (2011). While we focus on clone sizes, we demonstrate that the distribution for the total number of mutants follows as a consequence, and hence, results hold in that setting also.
The outline of this work is as follows. We define our model in Sect. 2, utilising formalism introduced in Karlin and Taylor (1981), and demonstrate a mapping between the mutant clone size distribution and the distribution for the total number of mutants. The exact time-dependent size distribution is given for exponential, power-law and logistic wild-type growth function in Sect. 4. Section 5 pertains to universal features of the clone size distribution and contains our most significant results. There, for a large class of wild-type growth functions, we demonstrate a general two-parameter distribution for clone sizes at large times. The distribution has power-law tail behaviour which corroborates previous work (Iwasa et al. 2006; Durrett and Moseley 2010; Williams et al. 2016). Large time results are also given for the mean and variance of the clone sizes under general wild-type growth. Adopting the interpretation of the wild-type population as the primary tumour and mutant clones as metastases, we test our results regarding the tail of the distribution on empirical metastatic data in Sect. 6. Section 7 considers alternative methods to ours, and we give some concluding remarks in Sect. 8.
Model
In our model, a wild-type population gives rise to mutants during reproduction events. The arisen mutant also reproduces, and so mutant clones stem from the original initiating mutant’s progeny. In many applications, the wild-type population is significantly larger than the mutant clones, and so we treat the wild-type population’s growth as deterministic, with size dictated by a time-dependent function . The mutant clones are smaller in comparison, and so their growth is stochastic. For logistic wild-type growth, a sample realisation of the process is shown in Fig. 1. The exact formulation is now given.
The Birth–Death Process
Stochastic growth of mutants will follow a birth–death branching process (Athreya and Ney 2004). Time is scaled such that each mutant has unit birth rate and death rate . A brief note on converting our results to the case when the birth rate is arbitrary is given in “Appendix B”. Let be the size of a population at time t, with . The forward Kolmogorov equation for the distribution is given by
1 |
with . Its solution in terms of the generating function, given on page 76 of Bartlett (1955), is
2 |
Due to our timescale, is the probability of eventual extinction for a mutant clone for , and is the mutant fitness. When , and so the stochastic proliferation follows a pure birth or Yule process, the mutants will be denoted immortal. By expanding the generating function around , we obtain for the probability of the population size being k a geometric distribution with a modified zero term
3 |
with the shorthand notation
4 |
For the particular case of a critical branching process, i.e. when birth and death rates are equal, the above probabilities are simplified by observing
5 |
Mutant Clone Size Distribution
Here, we employ standard methods as outlined in, for instance, Karlin and Taylor (1981), Dewanji et al. (2005). The system is observed at a fixed time t, and we let the number of wild-type individuals be denoted by for . Since mutants are produced by wild-type individuals, the rate of mutant clone initiations will be proportional to the product of and the mutation rate . More precisely, the process of clone initiations is an inhomogeneous Poisson process (Karlin and Taylor 1998) with intensity . Let the Poisson random variable denotes the number of clones that have been initiated by t, which has mean
Now, assuming , we consider a mutant clone sampled uniformly from the initiated clones and denote its size to be the random variable . The clone was initiated at the random time T, and as we must have , the density of T is given by
6 |
Where
7 |
is the expected number of clones seeded when the mutation rate is unity. The size of the clone is dictated not only by the initiation time but also by its manner of growth, here the birth–death process. Hence, by conditioning on the arrival time, we have
8 |
An immediate consequence is that the generating function of the clone size is given by
9 |
where is the generating function of the birth–death process (2).
We make the following remarks on the above. (i) The mutation rate does not appear in the density for initiation times in (6); hence mutant clone sizes are independent of the mutation rate and thus all following results regarding clone sizes will be also. (ii) The integral in (8) is a convolution, and as convolutions commute, we may swap the arguments of the integrand functions (). (iii) If we start with wild-type individuals, so the wild-type follows , then both the numerator and denominator in (6) will have a factor of , which cancel. So henceforth, apart from when (used occasionally for analytic convenience), we set without loss of generality. (iv) By similar logic, a positive random amplitude for the wild-type growth function, i.e. for a general positive random variable X, would also cancel, and so our results on clone sizes hold in that case also.
Mapping Distributions: Clone Size to Total Mutant Number
This section is related to the classic Luria–Delbrück problem. Let be the total number of mutants existing at time t. Then, is the sum of generic clones
where all are iid random variables specifying the clone sizes. As such, is a compound Poisson random variable, and hence its generating function is
10 |
which can be derived by conditioning on . It follows that
11 |
The link between the mass functions of the mutant clone size, , and the total number of mutants, , is given by the recursion
This relationship may be found as Lemma 2 in Zheng (1999), and a short proof is provided for convenience in “Appendix B”, Lemma B1. Hence, while we may initially work in the setting of size distribution of a single clone, by the above discussion, results are transferable to the total number of mutants case.
Often long-time results are sought, which significantly reduces the complexity of the distributions. For any fixed positive mutation rate, in the long-time limit, an infinite number of clones will have been initiated, and thus, the probability distributions of will not be tight (Durrett 1996). A common solution to this problem is the Large Population-Small Mutation limit (Keller and Antal 2015), where is kept constant. Then, for exponential wild-type growth, (or exponential-type, see Sect. 5), the expected number of initiated clones, , tends to for large times. Hence, we see that
demonstrating that the limit of the clone size distribution is of primary concern. Furthermore, if the expected number of initiated clones is small, we have the following proposition, whose proof can be found in “Appendix B”.
Proposition 1
For a small expected number of initiated clones, conditioned on survival, the size of a single clone and the total number of mutants are approximately equal in distribution. That is,
One immediate consequence of this result is that for immortal mutants () and we have
This agrees with intuition as for small enough , we expect only 0 or 1 clones to be initiated, and hence, the total number of mutants will be dictated by the clone size distribution. With exponential wild-type growth, this approximation was used in Iwasa et al. (2006) to investigate drug resistance in cancer.
Finite Time Clone Size Distributions
Three particular cases of wild-type growth function, , will be considered in detail, namely: exponential, power-law and logistic (Fig. 2). Exponential and logistic growth are widely used in biological modelling (Murray 2002). For the power-law cases, under the assumption that the radius of a spherical wild-type population is proportional to time, quadratic and cubic power-law growth represents mutation rates proportional to the surface area and volume, respectively. In each case, we give the generating function and probability mass function. We stress again that the mutation rate and an arbitrary positive prefactor for cancel in (8) and so are irrelevant for our results.
Exponential Wild-Type Growth
Let the wild-type population grow exponentially, that is with and so from (7), . The distribution for the total number of mutants, , was treated exhaustively in Keller and Antal (2015), and we follow their notation by letting . Using (10) and the results found in section 3 of Keller and Antal (2015), the generating function is
12 |
Similarly, the mass function is
and for
Here, is Gauss’s hypergeometric function, and is the Pochhammer symbol defined in “Appendix A”. The above expressions are given in terms of to allow easy comparison to the formulas in Keller and Antal (2015). For these exact time-dependent formulas, their form is somewhat cumbersome; however, simpler long-time limit expressions are given in Sect. 5. A reduction in complexity is also obtained for the special case of neutral mutants () where, by using (24), the generating function in (12) simplifies to
If additionally the neutral mutants are immortal, the above expression further simplifies to
The probabilities are then concisely given by
which corresponds to the classical Lea–Coulson result (Lea and Coulson 1949)
with .
Power-Law Wild-Type Growth
Now, we assume that the wild-type population grows according to a general power-law , for some non-negative integer , and therefore, . With power-law wild-type growth and stochastic mutant proliferation, the mutant clone size generating function is given by
13 |
Here, is the polylogarithm of order i defined in “Appendix A”. Details of the derivation are given in “Appendix C”. For immortal mutants, the mass function may be explicitly written as
14 |
If mutants may die, the exact mass function is most easily obtained via Cauchy’s integral formula which may be efficiently computed using the fast Fourier transform. For a brief discussion on implementation, see Antal and Krapivsky (2010) and references therein.
Note for , which, while useful for analytic tractability, is unrealistic. This can be overcome by letting . Then, by splitting the integral in the generating function (9) and using the above analysis, one can obtain the mass function for any . However, for practical purposes, the contribution of is negligible.
Constant Size Wild-Type
For the specific power-law growth when , i.e. (recall that this is equal to the general case when ), we recover some classical results for constant immigration (Kendall 1948). We note that the distribution of the ordered clone size, depending on initiation time, was discussed in Jeon et al. (2008). From (13) with , the generating function is
15 |
with as given in (4). By expanding this generating function in terms of s we obtain the probabilities
16 |
Then, using (10) with the clone sizes (15) we obtain the generating function of the total number of mutants
and from the binomial theorem we also get the probabilities
We recognise this as a negative binomial distribution under the interpretation that is the number of failures until successes, with failure probability . This result for was first derived by Kendall (1948) who was attempting to explain the appearance of the logarithmic distribution for species number when randomly sampling heterogeneous populations, conjectured by R.A. Fisher. From the distribution of , by an argument which may be considered a special case of Proposition 1, he derived that for constant rate initiation, the clone size conditioned on non-extinction is logarithmically distributed again with parameter , which can be obtained via (16).
Constant immigration may imply a constant size source; hence, mutants with equal birth and death rates (i.e. evolving as a critical branching process) are particularly interesting. This case yields analogous formulas to those above but is replaced with the expression given in (5).
Logistic Wild-Type Growth
Starting from a population of one and having a carrying capacity K, logistic growth is given by . We assume neutral mutations, i.e. is also the wild-type growth rate. Integrating the growth function gives
We aim to calculate the generating function using (9). Recalling the definition of we observe that
where C is an integration constant. Therefore, the generating function is
Agreeing with intuition for , we recover the generating function of the constant case, and gives the generating function for exponential wild-type growth. Therefore, the logistic case interpolates between the constant and exponential growth cases. The mass function can be obtained by expanding the non-logarithmic and logarithmic function in and using the Cauchy product formula. However, this method provides little insight, and numerically, it is simpler to use the fast Fourier transform.
Monotone Distribution and Finite Time Cut-Off
We conclude this section by demonstrating general features that exist in the clone size distribution at finite times. Again proofs are provided in “Appendix C”. Firstly, we see that, regardless of the particular wild-type growth function, the monotone decreasing nature of the mass function for the birth–death process is preserved in the clone size distribution.
Proposition 2
As long as is positive for some subinterval of [0, t], then for we have for any finite .
Whether depends on and t, but the inequality is typically true for long times. Note that in contrast, the mass function of the total number of mutants is not monotone in general (Keller and Antal 2015).
Now restricting ourselves to the case, as an example, consider the mass function when the size of the wild-type population is constant, which is given by (16), and specifically for . For any moderate t, is typically close to unity but for large k, will become the dominant term in the mass function, dictating exponential decay. We term this a cut-off in the distribution which occurs at approximately . It is an artefact of the mass function for the birth–death process (3). Hence, we will have (at least) two behaviour regimes for the mass function for finite times. Here, we show that this cut-off exists generally for finite times.
Theorem 1
Let and be continuous and positive for . Then
where is an unspecified subexponential factor, i.e. , and is given by (4).
Note that for finite t, and exponentially fast for large t. Hence, the cut-off will disappear for long times and the subexponential factor, discussed in detail in Sect. 5, will completely determine the tail of the distribution. Also notice that the power-law cases, , for are not covered as, to make the analysis tractable, they artificially start at . However, the generating function in this case (13) also has its closest to origin singularity at so the cut-off exists there also.
Universal Large Time Features
Here, we give results regarding the large time behaviour of our model which is relevant in many applications and also provides general insight. In many applications, the cut-off location ()) is so large that the distribution at or above this point is of little relevance, and hence, for this purpose the limiting approximations now discussed are of particular interest. Using the notation of Theorem 1, this section investigates the large time form of . The proofs for the results presented in this section can be found in “Appendix D”. We highlight the power-law decaying, “fat” tail found in each case. Henceforth, we again assume , i.e. a supercritical birth–death process.
General Wild-Type Growth Functions
To give general results, we introduce the following assumption which will be assumed to hold for the remainder of this section.
Assumption 1
For wild-type growth function , we assume
-
(i)
for , continuous for and right continuous at .
-
(ii)
is positive and monotone increasing for .
-
(iii)
For the limit exists, is positive and finite.
We note that the cases discussed in Sect. 4 are all covered by Assumption 1. The reason for the seemingly arbitrary limit assumed in (iii) becomes clear with the following result which is an application of the theory of regular variation found in Bingham et al. (1987).
Lemma 1
For
Often the long-time behaviour of the clone size distribution may be separated into and , and so we give the following definition (Flajolet and Sedgewick 2009).
Definition 1
Consider a real valued function f(x) such that
holds for some . Then, f(x) is of exponential-type for and is subexponential for .
Simple examples of subexponential functions are , , while , are of exponential-type, with .
Mean and Variance
We now address the asymptotic properties of the clone size distribution by first discussing its mean and variance.
Theorem 2
With subexponential functions such that
as .
The leading asymptotic behaviour which has different regimes dependent on is illustrated in Fig. 3. As an example, for the exponential case , by using (11) and the results found in Keller and Antal (2015), then and .
Large Time Clone Size Distribution
Turning to the distribution function, we have the following result regarding the generating function at large times.
Theorem 3
Let . Then for
This result is made clearer in the next corollary, in which the cases of exponential-type and subexponential growth are separated. This is as, for ,
For a proof, see Lemma D1. Consequently, in the exponential-type setting, the limiting result is a proper probability distribution, while in the subexponential case it is not. We can interpret this as the clone sizes staying finite in the exponential case but grow to infinity for subexponential cases at large times. Henceforth, for brevity, we do not impose such a separation but the reader should note that for exponential-type growth the above limit holds and may simplify further results.
Corollary 1
For ,
where the second expression is the limit of the first expression. Then for the probabilities for exponential-type growth are
and for subexponential growth ()
This result is exemplified in Fig. 4. The expressions obtained in the case also appeared as an approximation in Kessler and Levine (2015) for the total number of mutants with stochastic wild-type and mutant growth when the mean number of clones is small. This can now be interpreted as an application of Proposition 1.
The case of immortal mutants does not simplify the above expressions for subexponential growth, but for exponential-type growth, by applying (23) then (22) to the limiting generating function, we have the following link to the Yule-Simon distribution which appears often in random networks (Simon 1955; Krapivsky and Redner 2001).
Corollary 2
For immortal mutants with exponential-type wild-type growth the clone size distribution follows a Yule-Simon distribution with parameter for large times. That is, for ,
and thus, for ,
With immortal, neutral () mutants we have
which is in agreement with the long-time limit of (4.1). For immortal mutants and exponential-type growth, as the clone size distribution tends to a Yule-Simon distribution, we expect power-law tail behaviour at large times (Newman 2005). Interestingly, we see that this behaviour holds when we include mutant death and have general wild-type growth.
Corollary 3
At large times, the tail of the clone size distribution follows a power-law with index . More precisely,
Large Time Distribution for Total Number of Mutants
Finally, to conclude this section, we give the corresponding results for the total number of mutants in the often used Large Population-Small Mutation limit.
Theorem 4
Letting be constant and with subexponential functions as in Theorem 2
as . For
and we have the following tail result
Tail Behaviour in Empirical Metastatic Data
Given the above discussion we expect, for a large class of wild-type growth functions, to see power tail behaviour on approach to the exponential cut-off in the clone size distribution. We take the first steps to verify this theoretical hypothesis by analysing an empirical metastatic data. In this setting, the wild-type population is the primary tumour and mutant clones are the metastases.
Our data are sourced from the supplementary materials in Bozic et al. (2013). These data are taken from 22 patients; 7 with pancreatic ductal adenocarcinomas, 11 with colorectal carcinomas, and 6 with melanomas. One patient had only a single metastasis so we discard this data. Of the 21 remaining patients, the number of cells in a single metastasis ranged from to . Our theoretical model predicts a cut-off in the distribution around . Taking some sample parameters from the literature, namely /day (Diaz et al. 2012), and years (Yachida et al. 2010), this leads to a cut-off around cells. Due to the enormity of this value, we ignore the cut-off here. Additionally, as the minimum observed metastasis size is cells, we assume that all data points are sampled from the tail of the distribution.
For each of the data-sets, we examine the likelihood ratio to determine whether the data is more likely sampled from a power-law decaying or geometrically decaying distribution. Nineteen of the 21 data-set return the power-law hypothesis as more plausible which is in agreement with the theoretical prediction. Both are single parameter distributions, and maximum likelihood analysis was utilised to estimate the parameters. The methodology outlined in Clauset et al. (2009) was broadly followed, and brief details regarding calculating maximum likelihood estimates (MLEs) are given in “Appendix E”. We note that in this context the likelihood ratio point esimator returns equivalent results to the Akaike information criterion widely used in model selection (Burnham and Anderson 1998). Under the power-law model, , for 20 of the 21 data-sets, we find the point estimate of the power-law index, , lies in . The outlier comes from the smallest data-set (3 metastases). Due to the small size of data-sets, we recognise the influence of statistical fluctuations.
Details of the likelihood ratio are as follows. Let be a data-set of size N. We test the hypothesis that is drawn from a power-law distribution, , versus that it is sampled from a geometric distribution, , where are normalising constants and p is the parameter for the geometric distribution. The log-likelihood ratio is
where gives support to the hypothesis that the data is drawn from the power-law distribution with MLE exponent , over the geometric distribution with MLE parameter . The results are given in Fig. 5a.
Assuming a power-law distribution, the maximum likelihood estimates for the exponent for each data-set are given in Fig. 5b. Due to the small sample size of our data-sets and the high variance in the distribution, we do not derive confidence intervals via normal distribution approximations. Instead we show the normalised log-likelihood, , for our best data-set, with , in Fig. 5c, where is the likelihood function. Also, following Hudson (1971), we demonstrate the likelihood interval defined as
If a large sample size was possible this interval would correspond to a confidence interval. For the data-set with , we numerically determined , demonstrated as the domain between the vertical bars in Fig. 5c.
Alternative Approaches
Deterministic Approximation
In order to circumvent the complexity introduced by the birth–death process, one might be tempted to simply assume the mutant clone size grows according to , the mean of the birth–death process. This approach corroborates our results regarding the tail of the size distribution. Indeed, the clone size density may be found to be
17 |
which has support . This formula can also be found in Hanin et al. (2006). Then, as in Sect. 5 under Assumption 1,
Thus, asymptotically the density has the same behaviour as the tail of the limiting result given in Corollary 3, but with a different amplitude.
However, despite this agreement, the densities given by (17) for specific wild-type growth function differ significantly compared with stochastic mutant proliferation. Letting be the clone size distribution with stochastic mutant growth and be its deterministic approximation specified by (17), we may quantify the approximation error, at least for the moments, by the following theorem, whose proof can be found in “Appendix F”.
Theorem 5
As
Time-Dependent Rate Parameters
Some authors Houchmandzadeh (2015), Tomasetti (2012) have previously considered the case where all rates in the system are multiplied by a time-dependent function, say . This is relevant in the scenario where both the wild-type and mutant populations have their growth restricted simultaneously by environmental factors, for example exposure to a chemotherapeutic agent. We observe that under a change of timescale this system is equivalent to our setting with exponential wild-type growth. This is due to the following argument.
In this setting, the wild-type population is governed by
18 |
Mutant clones are now initiated at a rate . Let be the size of a mutant population governed by the birth–death process with time-dependent rates. Once initiated, the size distribution obeys the forward Kolmogorov equation for time-dependent stochastic mutant proliferation
19 |
If we let
then under a new timescale, , the mutant clone initiation will occur at a rate . Further, using the chain rule to express (18) and (19) in terms of , we see that and that the forward Kolmogorov equation (19) becomes (1). Thus, under a time-rescaling, all dynamics are equivalent to the system with exponential wild-type growth and stochastic mutant proliferation with constant birth and death rates, as studied in this article or in Keller and Antal (2015).
Poisson Process Characterisation of Tail
Complementing Corollary 3 in Sect. 5, following Tavare (1987), we can also describe the size distribution for large clones at long times via a Poisson process in the following way. Let be independent copies of the birth–death process as in Sect. 2 and be the points of a of Poisson process with intensity , for . The represent the clone arrival times, and so is the number of less than or equal to t.
Let us consider the size of the first clone. By known results about the large time behaviour of the birth–death process (Athreya and Ney 2004), as ,
The distribution of the limiting random variable is composed of a point mass at 0 and an exponential random variable, precisely
Analogously, with the details given in Tavare (1987) (Theorem 3), the limiting behaviour of the time-ordered clone sizes is given by
where is as before and all are iid. The random sequence takes non-negative real values; however, if we restrict our attention to only the positive elements (that is clones that do not die), then these can be taken to be points from a non-homogeneous Poisson process. More precisely, the set are the points (in some order) from a Poisson process on with mean measure
20 |
The proof of the above only requires minor modification from that of Theorem 4 in Tavare (1987).
The Poisson process description of the large clones, at large times, can also offer insight into further properties of the system, including links to the Poisson-Dirichlet distribution, see Tavare (1987), Durrett (2015). With regards to the present article, the interesting point is that for fixed , as the number of is finite almost surely, we may sample unformly from this set (i.e. ) and construct a random variable with distribution
where is as in (20). The new variable can be related to the previously considered random variable by the following result, whose proof is contained in “Appendix F”.
Theorem 6
For , with as above,
Of note is the reappearance of power-law behaviour with a cut-off in the density of . For example in the constant wild-type case, , the density, using (20), is given by
For exponential growth with neutral mutants, ,
Note that the exponents in the power-law terms is equal to that given in Corollary 3, indicating the two approaches are complimentary.
Discussion
In this study, we focus on the size distribution for mutant clones initiated at a rate proportional to the size of the wild-type population. The size of the wild-type population is dictated by a generic deterministic growth function, and the mutant growth is stochastic. This shifts the focus from previous studies which have mostly been concerned with exponential, or mean exponential, wild-type growth, and considered the total number of mutants. Results for the total number of mutants are, however, easily obtained from the clone size distribution.
The special cases of exponential, power-law and logistic wild-type growth were treated in detail, due to their extensive use in models for various applications. Utilising a generating function centred approach, exact time-dependent formulas were ascertained for the probability distributions in each case. Regardless of the growth function, the mass function is monotone decreasing and the distribution has a cut-off for any finite time. This cut-off goes to infinity for large times and is often enormous in practical applications; hence, we focused on the approach to the cut-off.
We found that the clone size distribution behaves quite distinctly for exponential-type versus subexponential wild-type growth. Although the probability of finding a clone of any given size stays finite as for exponential-type growth, it tends to zero for subexponential type. Despite these differences, with a proper scaling, for a large class of growth functions, we proved that the clone size distribution has a universal long-time form. This long-time form possesses a power-law “fat” tail which decays as 1 / k for subexponential wild-type growth, but faster for exponential-type growth. This can be intuitively understood as the tail distribution represents clones that arrive early, and the chance that a clone is initiated early in the process is larger for a slower growing wild-type function. Hence, we expect a “fatter” tail in the subexponential case.
Note that although we consider the case of subexponential wild-type growth, surviving mutant clones will grow exponentially for large time, which can be unrealistic in some situations. Stochastic growth which accounts for environmental restrictions, for instance the logistic branching process, introduces further technical difficulties and is left for future work. We do note that, despite the drawbacks of deterministic mutant growth as discussed in Sect. 7, when both the wild-type and mutant populations grow deterministically as , it is easy to see that for large times the clone size distribution still displays a power-law tail,
An underlying motivation for this work is the scenario of primary tumours spawning metastases in cancer. We test our hypothesis regarding a power-law tail in metastasis size distributions by analysing empirical data. For 19 of 21 data-sets, the power-law distribution is deemed more likely than an exponentially decaying distribution. The exponent of the power-law decay was estimated in each case and found to lie between and . Interpreting this in light of our theory, either the primary tumour had entered a subexponential growth phase or, if one assumes exponential primary growth, the metastatic cells had a fitness advantage compared to those in the primary. Either way we can conclude that, for the majority of patients, the metastases grew faster than the primary tumour.
Acknowledgments
We thank Peter Keller, Paul Krapivsky, Martin Nowak, Karen Ogilvie, Bartlomiej Waclaw and Bruce Worton for helpful discussions. MDN acknowledges support from EPSRC via a studentship.
Appendix A: Special Functions, Definitions and Requisite Results
Required definitions and identities taken from DLMF (2016) unless otherwise stated.
With the polylogarithm of order s is defined as
Note that . A required identity (from Weisstein 2016) is
21 |
for . Here, S(n, k) are the Stirling numbers of the second kind.
Gauss’s hypergeometric function also appears and for complex a, b, c, z is defined by the power series
and by analytic continuation elsewhere. Here, denotes the Pochhammer symbol or rising factorial, that is
Some required identities for the hypergeometric function are:
22 |
23 |
24 |
and the following connection can be made to the incomplete beta-function
25 |
For any analytic function , we denote the nth coefficient as
Theorem A1
(Flajolet and Sedgewick 2009: Exponential Growth Formula) If f(z) is analytic at 0 and R is the modulus of a singularity nearest the origin in the sense that Then the coefficient satisfies where .
We utilise several results from Bingham et al. (1987) on the theory of regularly varying functions which we now define.
Definition 2
(Bingham et al. 1987) A Lebesgue measurable function that is eventually positive is regularly varying (at infinity) if for some ,
The notation will be used and we will denote as slowly varying functions.
Theorem A2
(Bingham et al. 1987: Characterisation Theorem) Suppose is measurable, eventually positive, and exists, and is finite and positive for all x in a set of positive Lebesgue measure. Then, for some ,
-
(i)
.
-
(ii)
where .
Proposition A1
(Bingham et al. 1987: Proposition 1.3.6) For
Theorem A3
(Bingham et al. 1987: Karamata’s Theorem) If , X sufficiently large such that f(y) is locally bounded in , and , then
Proposition A2
(Bingham et al. 1987: Proposition 1.5.9.a) Let and choose X so that l is locally integrable on . Then,
-
(i)
.
-
(ii)
.
Appendix B: Proofs for Section 3
In this work, we have fixed the birth rate to be one. Other works, for example Keller and Antal (2015), use a birth–death process with birth rate and death rate under timescale . Then, the timescale used in the present work is defined by . This in turn implies that all rates under t are given by dividing the corresponding rate under by , e.g. .
Lemma B1
Consider generating functions and where . Then and for the following recursion holds
Proof
Clearly, from . By differentiating F(s), we obtain , and in general
which can be shown by induction using Pascal’s formula for binomial coefficients. Evaluating the above equation at and using that and we arrive at the announced recursion.
Proof of Proposition 1
Utilising generating functions,
Appendix C: Proofs for Section 4
We derive the generating function for the clone size distribution for stochastic growth and power-law wild-type growth, , given in (13). From (9), we have
It is enough to show
26 |
where C is a constant of integration. This may be derived by a binomial expansion of the denominator and an identity for the incomplete gamma function, but for succinctness we simply differentiate both sides with respect to . First, we note that
Now differentiating the right hand side of (26) yields
where the equality follows by the telescoping nature of the sums. Noting that and applying the limits of the integral gives the desired result.
To determine the mass function, we seek a power series representation of the generating function. We focus on the case and thus . By the definition of the polylogarithm and the binomial theorem
Reindexing the sum, we obtain
Applying this to the polylogarithmic terms in , and noting
yields (14) as the desired mass function.
Proof of Proposition 2
Using (8), we see that for
Now from (3), it is clear that the integrand is negative for finite, positive giving the result.
Proof of Theorem 1
The result is an application of Theorem A1. We seek the closest to the origin singularity of
which is claimed to be at . Indeed, we note that for , is analytic for all , and as is continuous, we can conclude that the is analytic in this region also [Chapter 2, Theorem 5.4 in Stein and Shakarchi (2003)]. As there exists such that
The rightmost expression can be seen to have closest to origin singularity at and as , by Theorem A1, we can conclude Theorem 1.
Appendix D: Proofs for Section 5
Proof of Lemma 1
Choose and let . Consider the function . Then Theorem A2(i) yields
Further, Proposition A1 gives
The non-negativity of is dictated by the monotone increasing nature of .
To prove Theorem 2, we require the following:
Lemma D1
Let be subexponential functions, then
-
(i)
.
-
(ii)For
We highlight that neither subexponential function depend on .
Proof
(i) For , . Now hence with by Theorem A2(ii). Setting , by Lemma 1, is subexponential. (ii) Let g(y) be as above. With and using the change of variables we have
27 |
where the asymptotic equivalence is due to Theorem A3 applied to and the final equality is by part (i). For , by Theorem A2(ii) the integrand will be a subexponential function. Applying the same change of variables as in (27), we see by Proposition A2(i) that the integral is a slowly varying function in y and hence is subexponential in t, which we denote . Now for , by Lemma 1, we may choose t large enough such that which by a basic result for Laplace transforms, see, e.g. Theorem 1.11 in Schiff (1999), ensures convergence to a finite, positive constant.
As an example, which will be useful for the next proof, we apply the above lemma to . With subexponential functions
Proof of Theorem 2
We require the first and second moments of which may be found by differentiating (2), or see Lemma F1. Then
28 |
29 |
Throughout let be a generic subexponential function and it will be helpful to observe that the reciprocal or constant multiples of a subexponential function are subexponential. We first consider the mean. For the cases , applying Lemma D1(ii) to (28) with for the numerator and for the denominator proves the claim. For , using Lemma D1(i) then (ii), we have
30 |
That diverges can be seen by applying the standard change of variables coupled with Proposition A2(ii). Turning to the variance, with , when we apply Lemma D1(ii) term by term to (29). For all integrals converge and so, with constants,
The last relation is due to the monotonicity of and the desired representation is obtained by applying Lemma D1(ii) to and absorbing into . When , the same argument holds as long as we note that
By Proposition A2(i) the rightmost integral is a subexponential function and as we may always choose t sufficiently large such that , we find
Applying Lemma D1 to demonstrates the contribution from the mean squared is negligible. For , we apply the same argument as in (30) to each term and this completes the proof.
In order to prove Theorem 3, we require the following lemma.
Lemma D2
For , and as in (2), we have
Proof
By the definition of ,
The triangle inequality yields
and
The claimed inequality now follows.
Proof of Theorem 3
To avoid division by 0 let . Taking the generating function for from equation (9), we apply the change of variables which gives
Now recalling for and multiplying both sides by yields
Noting that by monotonicity which coupled with Lemma D2 shows the integrand may be dominated. By assumption, the integrand converges, and therefore, using Lemma 1 and the dominated convergence theorem, we have
Proof of Corollary 1
The first statement is given by applying Lemma D1(ii) to . Then, taking the limiting generating function in Theorem 3, we firstly apply (23) then (24) which yields generating function representation for . The mass function for is simply a logarithmic expansion. For , we use the expression given in Appendix A of Keller and Antal (2015) to obtain a series expansion for the generating function in terms of s, and the coefficients of the expansion give the mass function.
Proof of Corollary 3
The analysis involves expanding the limiting generating function in Theorem 3 around its singularity at and exactly mirrors that given in section 6 of Keller and Antal (2015) and so is omitted.
Proof of Theorem 4
The mean and variance can be obtained by using (11) with Theorem 2 (the second moment dominates the mean squared in all divergent cases). For the generating function, (10) gives
which coupled with Theorem 3 yields the result. The map in (10) is analytic so the tail can be obtained by its expansion coupled with Corollary 3.
Appendix E: Maximum Likelihood Estimators for Distributions Considered
Consider a data-set assumed to be a realisation of the random vector where all are random variables representing the metastasis sizes and let . Then the maximum likelihood estimator (MLE) for a one parameter probability distribution is
where is the likelihood function and the joint distribution becomes a product by independence. We derive the MLE under the assumption that the data is sampled from a distribution whose tail follows the geometric distribution, the power-law case is analogous but for the final step.
Assume for at least , that . Let (no indices are required as this quantity is assumed independent of the tail) then
The log-likelihood is now given by
Setting , we solve to find the MLE
The power-law case is analogous. There , where is the Hurwitz zeta function. No closed form expression is found for the MLE and instead we have the approximation (Clauset et al. 2009)
This was used for the estimates given in Sect. 6.
Appendix F: Proofs for Section 7
In order to prove Theorem 5, we require the following lemma regarding the moments of the birth–death process:
Lemma F1
where S(m, k) are Stirling numbers of the second kind. Hence, as ,
Proof of Lemma F1
Recall the generating function for the birth–death process (2) whose power series representation has coefficients given by (3). The moment generating function is and hence
Thus for
Since , we can use (21) and thus arrive at our first result. Note and so focusing on the leading order in t, the summand with is , which proves the claim.
Proof of Theorem 5
In the deterministic case, we have
The moments for stochastic mutant growth are obtained from the moment generating function . The moments are therefore
Hence, using the second statement in Lemma F1, we have
which is the desired result.
Proof of Theorem 6
Immediately from (8), we see
It is enough to examine the numerator. As, from (3),
we have
31 |
Here, denotes the integer part of a and is necessary as is defined on the non-negative integers. Focusing on the first term from the right hand side of (31) and using the definition of (4) gives
Now, we change variables to and note that the resulting integrand can be dominated by which is integrable for all under consideration (by Laplace transform arguments, Schiff 1999). Hence, by the dominated convergence theorem, we can conclude
The second integral from the right hand side of (31) can be treated analogously and yields an identical result with as a prefactor. Hence,
and the claimed result follows.
Contributor Information
Michael D. Nicholson, Email: Michael.Nicholson@ed.ac.uk
Tibor Antal, Email: Tibor.Antal@ed.ac.uk.
References
- Angerer WP. An explicit representation of the Luria–Delbrück distribution. J Math Biol. 2001;42(2):145–174. doi: 10.1007/s002850000053. [DOI] [PubMed] [Google Scholar]
- Antal T, Krapivsky PL. Exact solution of a two-type branching process: clone size distribution in cell division kinetics. J Stat Mech. 2010;7:P07028. [Google Scholar]
- Antal T (2011) Krapivsky PL (2011) Exact solution of a two-type branching process: models of tumor progression. J Stat Mech 2011(8):P08018
- Athreya KB, Ney PE. Branching processes. Mineola: Dover Publications; 2004. [Google Scholar]
- Bartlett M. An introduction to stochastic processes. 3. Cambridge: Cambridge University Press; 1955. [Google Scholar]
- Bingham N, Goldie C, Teugels J. Regular variation. Cambridge: Cambridge University Press; 1987. [Google Scholar]
- Bozic I, Nowak M. Timing and heterogeneity of mutations associated with drug resistance in metastatic cancers. Proc Natl Acad Sci USA. 2014;111(45):15964–15968. doi: 10.1073/pnas.1412075111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bozic I, Reiter JG, Allen B, Antal T, Chatterjee K, Shah P, Moon YS, Yaqubie A, Kelly N, Le DT, Lipson EJ, Chapman PB, Diaz LA, Vogelstein B, Nowak MA. Evolutionary dynamics of cancer in response to targeted combination therapy. eLife. 2013;2:e00747. doi: 10.7554/eLife.00747. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burnham K, Anderson D (1998) Model selection and inference: a practical information-theoretic approach. Springer-Verlag, New York
- Clauset A, Shalizi CR, Newman MEJ. Power-law distributions in empirical data. SIAM Rev. 2009;51:661–703. doi: 10.1137/070710111. [DOI] [Google Scholar]
- Dewanji A, Luebeck EG, Moolgavkar SH. A generalized Luria–Delbrück model. Math Biosci. 2005;197(2):140–152. doi: 10.1016/j.mbs.2005.07.003. [DOI] [PubMed] [Google Scholar]
- Dewanji A, Jeon J, Mexa R, Luebeck EG. Number and size distribution of colorectal adenomas under the multistage clonal expansion model of cancer. PLoS Comput Biol. 2011;7(10):e1002213. doi: 10.1371/journal.pcbi.1002213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Diaz LA, Jr, Williams RT, Wu J, Kinde I, Hecht JR, Berlin J, Allen B, Bozic I, Reiter JG, Nowak MA, Kinzler KW, Oliner KS, Vogelstein B. The molecular evolution of acquired resistance to targeted EGFR blockade in colorectal cancers. Nature. 2012;486:537–540. doi: 10.1038/nature11219. [DOI] [PMC free article] [PubMed] [Google Scholar]
- DLMF (2016) NIST Digital Library of Mathematical Functions. Release 1.0.11 of 2016-06-08, http://dlmf.nist.gov/
- Durrett R (1996) Probability: theory and examples, 4th edn., Cambridge series in statistical and probabilistic mathematics. Cambridge University Press, Cambridge
- Durrett R (2015) Branching process models of cancer, 1st edn., Stochastics in biological systems. Springer, New York
- Durrett R, Moseley S. Evolution of resistance and progression to disease during clonal expansion of cancer. Theor Popul Biol. 2010;77(1):42–48. doi: 10.1016/j.tpb.2009.10.008. [DOI] [PubMed] [Google Scholar]
- Flajolet P, Sedgewick R. Analytic combinatorics. Cambridge: Cambridge University Press; 2009. [Google Scholar]
- Foo J, Michor F. Evolution of acquired resistance to anti-cancer therapy. J Theor Biol. 2014;355:10–20. doi: 10.1016/j.jtbi.2014.02.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hanin L, Rose J, Zaider M. A stochastic model for the sizes of detectable metastases. J Theor Biol. 2006;243(3):407–417. doi: 10.1016/j.jtbi.2006.07.005. [DOI] [PubMed] [Google Scholar]
- Houchmandzadeh B. General formulation of Luria–Delbrück distribution of the number of mutants. Phys Rev E. 2015;012719:92. doi: 10.1103/PhysRevE.92.012719. [DOI] [PubMed] [Google Scholar]
- Hudson DJ. Interval estimation from the likelihood function. J R Stat Soc Ser B. 1971;33(2):256–262. [Google Scholar]
- Iwasa Y, Nowak MA, Michor F. Evolution of resistance during clonal expansion. Genetics. 2006;172(4):2557–2566. doi: 10.1534/genetics.105.049791. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jeon J, Meza R, Moolgavkar SH, Luebeck EG. Evaluation of screening strategies for pre-malignant lesions using a biomathematical approach. Math Biosci. 2008;213(1):56–70. doi: 10.1016/j.mbs.2008.02.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Karlin S, Taylor HM. A second course in stochastic processes. New York: Academic Press Inc, a subsidiary of Harcourt Brace Jovanovich, Publishers. XVI; 1981. [Google Scholar]
- Karlin S, Taylor HM. An introduction to stochastic modeling. 3. London: Academic Press Inc; 1998. [Google Scholar]
- Keller P, Antal T. Mutant number distribution in an exponentially growing population. J Stat Mech. 2015;1:P01011. doi: 10.1088/1742-5468/2015/01/P01011. [DOI] [Google Scholar]
- Kendall DG. On some modes of population growth leading to R. A. Fisher’s logarithmic series distribution. Biometrika. 1948;35(1/2):6–15. doi: 10.2307/2332624. [DOI] [PubMed] [Google Scholar]
- Kendall DG. Birth-and-death processes, and the theory of carcinogenesis. Biometrika. 1960;47:13–21. doi: 10.1093/biomet/47.1-2.13. [DOI] [Google Scholar]
- Kessler D, Levine H. Scaling solution in the large population limit of the general asymmetric stochastic LuriaDelbrück evolution process. J Stat Phys. 2015;158(4):783–805. doi: 10.1007/s10955-014-1143-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kessler DA, Austin RH, Levine H. Resistance to chemotherapy: patient variability and cellular heterogeneity. Cancer Res. 2014;74(17):4663–4670. doi: 10.1158/0008-5472.CAN-14-0118. [DOI] [PubMed] [Google Scholar]
- Komarova NL, Wu L, Baldi P. The fixed-size Luria–Delbrück model with nonzero death rate. Math Biosci. 2007;210:253–290. doi: 10.1016/j.mbs.2007.04.007. [DOI] [PubMed] [Google Scholar]
- Krapivsky PL, Redner S. Organization of growing random networks. Phys Rev E. 2001;63(6):1–066123. doi: 10.1103/PhysRevE.63.066123. [DOI] [PubMed] [Google Scholar]
- Lea DE, Coulson CA. The distribution of the numbers of mutants in bacterial populations. J Genet. 1949;49(3):264–285. doi: 10.1007/BF02986080. [DOI] [PubMed] [Google Scholar]
- Luria SE, Delbrück M. Mutations of bacteria from virus sensitivity to virus resistance. Genetics. 1943;48(6):491–511. doi: 10.1093/genetics/28.6.491. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Murray JD (2002) Mathematical biology I. An introduction, vol. 17. Springer-Verlag, New York
- Newman M. Power laws, Pareto distributions and Zipf’s law. Contemp Phys. 2005;46(5):323–351. doi: 10.1080/00107510500052444. [DOI] [Google Scholar]
- Schiff J (1999) The Laplace transform: theory and applications, vol. 85. Springer-Verlag, New York
- Simon HA. On a class of skew distribution functions. Biometrika. 1955;42(3–4):425–440. doi: 10.1093/biomet/42.3-4.425. [DOI] [Google Scholar]
- Stein EM, Shakarchi R. Complex analysis. Princeton: Princeton University Press; 2003. [Google Scholar]
- Tavare S. The birth process with immigration, and the genealogical structure of large populations. J Math Biol. 1987;25:161–168. doi: 10.1007/BF00276387. [DOI] [PubMed] [Google Scholar]
- Tomasetti C. On the probability of random genetic mutations for various types of tumor growth. Bull Math Biol. 2012;74(6):1379–1395. doi: 10.1007/s11538-012-9717-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weisstein EW (2016) Polylogarithm. MathWorld-A Wolfram Web Resource. http://mathworld.wolfram.com/Polylogarithm.html
- Williams MJ, Werner B, Barnes CP, Graham TA, Sottoriva A. Identification of neutral tumor evolution across cancer types. Nat Genet. 2016;48:238–244. doi: 10.1038/ng.3489. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yachida S, Jones S, Bozic I, Antal T, Leary R, Fu B, Kamiyama M, Hruban RH, Eshleman JR, Nowak MA, Velculescu VE, Kinzler KW, Vogelstein B, Iacobuzio-Donahue CA. Distant metastasis occurs late during the genetic evolution of pancreatic cancer. Nature. 2010;467(7319):1114–1117. doi: 10.1038/nature09515. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zheng Q. Progress of a half century in the study of the Luria–Delbrück distribution. Math Biosci. 1999;162(1–2):1–32. doi: 10.1016/S0025-5564(99)00045-0. [DOI] [PubMed] [Google Scholar]